2024-09-19T05:45:57.140 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-19T05:45:57.165 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T05:45:57.256 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911704 branch: squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-quiesce/with-quiesce 6-workunit/suites/fsstress}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7911704' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 1 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 subvols: create: 2 subvol_options: --namespace-isolated --size 25000000000 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 install: ceph: flavor: default sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=secure - wsync syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 6fad5dd73c93545e52f57f681e140a9c3529c11e owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 1747 sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 sleep_before_teardown: 0 subset: 176/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 6fad5dd73c93545e52f57f681e140a9c3529c11e syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi037.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ8aZidad/bYqKdjkAalkuvBItuPKQGj4NyOjgI4PuCms9/OAPECqQZ/MG+5nxu/6WXXENKdWrDnO+FDXjhZErM= smithi099.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPggEvCmpucNXPJYWZvEfrXZMRWEzN7cAyWPCHMkE3hNNOUy017v8bn+GiRckQwkVyrdgcjVPlU1QF+DbQWHMHM= smithi117.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJC1m+skL1Gb1b8Y85585XcvB2FaRWvAgM8Uf/y0TeFlNEg6khEZGRIuMsHv9TK9716kDVagnSEi6NlAaSYiX2Y= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - check-counter: {} - quiescer: null - workunit: clients: all: - suites/fsstress.sh timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-18_21:24:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-19T05:45:57.256 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa; will attempt to use it 2024-09-19T05:45:57.257 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks 2024-09-19T05:45:57.257 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-19T05:45:57.259 INFO:teuthology.task.internal:Checking packages... 2024-09-19T05:45:57.280 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '2f599a46ad10e37c929e5c43da2f6907ddcd1961' 2024-09-19T05:45:57.280 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-19T05:45:57.281 INFO:teuthology.packaging:ref: None 2024-09-19T05:45:57.281 INFO:teuthology.packaging:tag: None 2024-09-19T05:45:57.281 INFO:teuthology.packaging:branch: squid 2024-09-19T05:45:57.281 INFO:teuthology.packaging:sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T05:45:57.281 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-19T05:45:57.521 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-363.g6fad5dd7 2024-09-19T05:45:57.522 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-19T05:45:57.529 INFO:teuthology.task.internal:no buildpackages task found 2024-09-19T05:45:57.529 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-19T05:45:57.535 INFO:teuthology.task.internal:Saving configuration 2024-09-19T05:45:57.555 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-19T05:45:57.561 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-19T05:45:57.585 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi037.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911704', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 05:40:58.703638', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ8aZidad/bYqKdjkAalkuvBItuPKQGj4NyOjgI4PuCms9/OAPECqQZ/MG+5nxu/6WXXENKdWrDnO+FDXjhZErM='} 2024-09-19T05:45:57.609 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi099.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911704', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 05:40:58.705206', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPggEvCmpucNXPJYWZvEfrXZMRWEzN7cAyWPCHMkE3hNNOUy017v8bn+GiRckQwkVyrdgcjVPlU1QF+DbQWHMHM='} 2024-09-19T05:45:57.629 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi117.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911704', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 05:40:58.701755', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJC1m+skL1Gb1b8Y85585XcvB2FaRWvAgM8Uf/y0TeFlNEg6khEZGRIuMsHv9TK9716kDVagnSEi6NlAaSYiX2Y='} 2024-09-19T05:45:57.629 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-19T05:45:57.635 INFO:teuthology.task.internal:roles: ubuntu@smithi037.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-19T05:45:57.635 INFO:teuthology.task.internal:roles: ubuntu@smithi099.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-19T05:45:57.635 INFO:teuthology.task.internal:roles: ubuntu@smithi117.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-19T05:45:57.635 INFO:teuthology.run_tasks:Running task console_log... 2024-09-19T05:45:57.709 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f38bc9e3be0>, signals=[15]) 2024-09-19T05:45:57.709 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-19T05:45:57.715 INFO:teuthology.task.internal:Opening connections... 2024-09-19T05:45:57.715 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi037.front.sepia.ceph.com 2024-09-19T05:45:57.716 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:45:57.797 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi099.front.sepia.ceph.com 2024-09-19T05:45:57.799 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:45:57.871 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi117.front.sepia.ceph.com 2024-09-19T05:45:57.872 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:45:57.948 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-19T05:45:57.955 DEBUG:teuthology.orchestra.run.smithi037:> uname -m 2024-09-19T05:45:57.973 INFO:teuthology.orchestra.run.smithi037.stdout:x86_64 2024-09-19T05:45:57.974 DEBUG:teuthology.orchestra.run.smithi037:> cat /etc/os-release 2024-09-19T05:45:58.031 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="CentOS Stream" 2024-09-19T05:45:58.031 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="9" 2024-09-19T05:45:58.032 INFO:teuthology.orchestra.run.smithi037.stdout:ID="centos" 2024-09-19T05:45:58.032 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE="rhel fedora" 2024-09-19T05:45:58.032 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="9" 2024-09-19T05:45:58.032 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM_ID="platform:el9" 2024-09-19T05:45:58.032 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T05:45:58.032 INFO:teuthology.orchestra.run.smithi037.stdout:ANSI_COLOR="0;31" 2024-09-19T05:45:58.032 INFO:teuthology.orchestra.run.smithi037.stdout:LOGO="fedora-logo-icon" 2024-09-19T05:45:58.032 INFO:teuthology.orchestra.run.smithi037.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T05:45:58.032 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://centos.org/" 2024-09-19T05:45:58.032 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T05:45:58.032 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T05:45:58.032 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T05:45:58.033 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server 2024-09-19T05:45:58.059 DEBUG:teuthology.orchestra.run.smithi099:> uname -m 2024-09-19T05:45:58.078 INFO:teuthology.orchestra.run.smithi099.stdout:x86_64 2024-09-19T05:45:58.078 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2024-09-19T05:45:58.136 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="CentOS Stream" 2024-09-19T05:45:58.137 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="9" 2024-09-19T05:45:58.137 INFO:teuthology.orchestra.run.smithi099.stdout:ID="centos" 2024-09-19T05:45:58.137 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="rhel fedora" 2024-09-19T05:45:58.137 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="9" 2024-09-19T05:45:58.137 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el9" 2024-09-19T05:45:58.138 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T05:45:58.138 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31" 2024-09-19T05:45:58.138 INFO:teuthology.orchestra.run.smithi099.stdout:LOGO="fedora-logo-icon" 2024-09-19T05:45:58.138 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T05:45:58.138 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://centos.org/" 2024-09-19T05:45:58.138 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T05:45:58.138 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T05:45:58.138 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T05:45:58.138 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2024-09-19T05:45:58.159 DEBUG:teuthology.orchestra.run.smithi117:> uname -m 2024-09-19T05:45:58.178 INFO:teuthology.orchestra.run.smithi117.stdout:x86_64 2024-09-19T05:45:58.179 DEBUG:teuthology.orchestra.run.smithi117:> cat /etc/os-release 2024-09-19T05:45:58.237 INFO:teuthology.orchestra.run.smithi117.stdout:NAME="CentOS Stream" 2024-09-19T05:45:58.237 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION="9" 2024-09-19T05:45:58.237 INFO:teuthology.orchestra.run.smithi117.stdout:ID="centos" 2024-09-19T05:45:58.237 INFO:teuthology.orchestra.run.smithi117.stdout:ID_LIKE="rhel fedora" 2024-09-19T05:45:58.237 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_ID="9" 2024-09-19T05:45:58.237 INFO:teuthology.orchestra.run.smithi117.stdout:PLATFORM_ID="platform:el9" 2024-09-19T05:45:58.237 INFO:teuthology.orchestra.run.smithi117.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T05:45:58.238 INFO:teuthology.orchestra.run.smithi117.stdout:ANSI_COLOR="0;31" 2024-09-19T05:45:58.238 INFO:teuthology.orchestra.run.smithi117.stdout:LOGO="fedora-logo-icon" 2024-09-19T05:45:58.238 INFO:teuthology.orchestra.run.smithi117.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T05:45:58.238 INFO:teuthology.orchestra.run.smithi117.stdout:HOME_URL="https://centos.org/" 2024-09-19T05:45:58.238 INFO:teuthology.orchestra.run.smithi117.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T05:45:58.238 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T05:45:58.238 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T05:45:58.238 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server 2024-09-19T05:45:58.259 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-19T05:45:58.271 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-19T05:45:58.277 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-19T05:45:58.277 DEBUG:teuthology.orchestra.run.smithi037:> test '!' -e /home/ubuntu/cephtest 2024-09-19T05:45:58.281 DEBUG:teuthology.orchestra.run.smithi099:> test '!' -e /home/ubuntu/cephtest 2024-09-19T05:45:58.283 DEBUG:teuthology.orchestra.run.smithi117:> test '!' -e /home/ubuntu/cephtest 2024-09-19T05:45:58.300 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-19T05:45:58.311 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-19T05:45:58.312 DEBUG:teuthology.orchestra.run.smithi037:> test -z $(ls -A /var/lib/ceph) 2024-09-19T05:45:58.338 DEBUG:teuthology.orchestra.run.smithi099:> test -z $(ls -A /var/lib/ceph) 2024-09-19T05:45:58.341 DEBUG:teuthology.orchestra.run.smithi117:> test -z $(ls -A /var/lib/ceph) 2024-09-19T05:45:58.431 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-19T05:45:58.495 INFO:teuthology.run_tasks:Running task kernel... 2024-09-19T05:45:58.509 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-19T05:45:58.509 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-09-19T05:45:58.510 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-09-19T05:45:58.510 DEBUG:teuthology.orchestra.run.smithi037:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T05:45:58.527 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:45:58.528 DEBUG:teuthology.orchestra.run.smithi037:> uname -r 2024-09-19T05:45:58.587 INFO:teuthology.orchestra.run.smithi037.stdout:5.14.0-503.el9.x86_64 2024-09-19T05:45:58.587 INFO:teuthology.task.kernel:Running kernel on smithi037: 5.14.0-503.el9.x86_64 2024-09-19T05:45:58.587 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum install -y kernel 2024-09-19T05:46:01.848 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - BaseOS 5.1 MB/s | 8.3 MB 00:01 2024-09-19T05:46:10.607 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - AppStream 2.7 MB/s | 20 MB 00:07 2024-09-19T05:46:16.282 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - CRB 4.5 MB/s | 6.5 MB 00:01 2024-09-19T05:46:18.625 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - Extras packages 17 kB/s | 19 kB 00:01 2024-09-19T05:46:19.463 INFO:teuthology.orchestra.run.smithi037.stdout:Extra Packages for Enterprise Linux 32 MB/s | 23 MB 00:00 2024-09-19T05:46:25.035 INFO:teuthology.orchestra.run.smithi037.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-19T05:46:27.017 INFO:teuthology.orchestra.run.smithi037.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-19T05:46:27.017 INFO:teuthology.orchestra.run.smithi037.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-19T05:46:27.113 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-09-19T05:46:27.124 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-19T05:46:27.124 INFO:teuthology.orchestra.run.smithi037.stdout: Package Architecture Version Repository Size 2024-09-19T05:46:27.125 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-19T05:46:27.125 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-09-19T05:46:27.125 INFO:teuthology.orchestra.run.smithi037.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-19T05:46:27.125 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2024-09-19T05:46:27.125 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-19T05:46:27.125 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-19T05:46:27.125 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-19T05:46:27.125 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T05:46:27.125 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-09-19T05:46:27.125 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-19T05:46:27.125 INFO:teuthology.orchestra.run.smithi037.stdout:Install 4 Packages 2024-09-19T05:46:27.125 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T05:46:27.126 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 79 M 2024-09-19T05:46:27.126 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 126 M 2024-09-19T05:46:27.126 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-09-19T05:46:27.253 INFO:teuthology.orchestra.run.smithi037.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 338 kB/s | 36 kB 00:00 2024-09-19T05:46:28.012 INFO:teuthology.orchestra.run.smithi037.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 18 MB/s | 16 MB 00:00 2024-09-19T05:46:28.487 INFO:teuthology.orchestra.run.smithi037.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 23 MB/s | 29 MB 00:01 2024-09-19T05:46:28.846 INFO:teuthology.orchestra.run.smithi037.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 20 MB/s | 35 MB 00:01 2024-09-19T05:46:28.846 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-09-19T05:46:28.846 INFO:teuthology.orchestra.run.smithi037.stdout:Total 46 MB/s | 79 MB 00:01 2024-09-19T05:46:29.558 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-09-19T05:46:29.943 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-09-19T05:46:29.943 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-09-19T05:46:30.906 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-09-19T05:46:30.906 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-09-19T05:46:33.464 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-09-19T05:46:34.158 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-19T05:46:34.238 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T05:46:36.982 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T05:46:37.125 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T05:46:42.256 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T05:46:42.301 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:46:47.449 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:47:26.875 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:47:26.916 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:47:27.281 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:47:27.281 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-19T05:47:27.281 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T05:47:27.281 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T05:47:28.181 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:47:28.181 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T05:47:28.181 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-09-19T05:47:28.181 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-19T05:47:28.181 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-19T05:47:28.182 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-19T05:47:28.182 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-19T05:47:28.182 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T05:47:28.182 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-09-19T05:47:28.522 DEBUG:teuthology.orchestra.run.smithi037:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T05:47:28.612 INFO:teuthology.orchestra.run.smithi037.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T05:47:28.612 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T05:47:28.612 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-19T05:47:28.612 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-19T05:47:28.612 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-19T05:47:28.612 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-19T05:47:28.613 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi037.front.sepia.ceph.com, path=None, version=distro) 2024-09-19T05:47:28.613 DEBUG:teuthology.orchestra.run.smithi037:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T05:47:28.671 INFO:teuthology.orchestra.run.smithi037.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T05:47:28.672 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T05:47:28.672 DEBUG:teuthology.orchestra.run.smithi037:> sudo rpm -qi grub2-tools 2024-09-19T05:47:28.703 INFO:teuthology.orchestra.run.smithi037.stdout:Name : grub2-tools 2024-09-19T05:47:28.703 INFO:teuthology.orchestra.run.smithi037.stdout:Epoch : 1 2024-09-19T05:47:28.703 INFO:teuthology.orchestra.run.smithi037.stdout:Version : 2.06 2024-09-19T05:47:28.703 INFO:teuthology.orchestra.run.smithi037.stdout:Release : 82.el9 2024-09-19T05:47:28.704 INFO:teuthology.orchestra.run.smithi037.stdout:Architecture: x86_64 2024-09-19T05:47:28.704 INFO:teuthology.orchestra.run.smithi037.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-19T05:47:28.704 INFO:teuthology.orchestra.run.smithi037.stdout:Group : Unspecified 2024-09-19T05:47:28.704 INFO:teuthology.orchestra.run.smithi037.stdout:Size : 8274670 2024-09-19T05:47:28.704 INFO:teuthology.orchestra.run.smithi037.stdout:License : GPLv3+ 2024-09-19T05:47:28.704 INFO:teuthology.orchestra.run.smithi037.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-19T05:47:28.704 INFO:teuthology.orchestra.run.smithi037.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-19T05:47:28.704 INFO:teuthology.orchestra.run.smithi037.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-19T05:47:28.704 INFO:teuthology.orchestra.run.smithi037.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-19T05:47:28.704 INFO:teuthology.orchestra.run.smithi037.stdout:Packager : builder@centos.org 2024-09-19T05:47:28.704 INFO:teuthology.orchestra.run.smithi037.stdout:Vendor : CentOS 2024-09-19T05:47:28.704 INFO:teuthology.orchestra.run.smithi037.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-19T05:47:28.704 INFO:teuthology.orchestra.run.smithi037.stdout:Summary : Support tools for GRUB. 2024-09-19T05:47:28.704 INFO:teuthology.orchestra.run.smithi037.stdout:Description : 2024-09-19T05:47:28.705 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T05:47:28.705 INFO:teuthology.orchestra.run.smithi037.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-19T05:47:28.705 INFO:teuthology.orchestra.run.smithi037.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-19T05:47:28.705 INFO:teuthology.orchestra.run.smithi037.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-19T05:47:28.705 INFO:teuthology.orchestra.run.smithi037.stdout:hardware devices. 2024-09-19T05:47:28.705 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T05:47:28.705 INFO:teuthology.orchestra.run.smithi037.stdout:This subpackage provides tools for support of all platforms. 2024-09-19T05:47:28.706 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-19T05:47:28.706 INFO:teuthology.task.kernel:Updating grub on smithi037 to boot 5.14.0-508.el9.x86_64 2024-09-19T05:47:28.706 DEBUG:teuthology.orchestra.run.smithi037:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-19T05:47:29.377 INFO:teuthology.orchestra.run.smithi037.stderr:Generating grub configuration file ... 2024-09-19T05:47:30.821 INFO:teuthology.orchestra.run.smithi037.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-19T05:47:30.849 INFO:teuthology.orchestra.run.smithi037.stderr:done 2024-09-19T05:47:30.851 DEBUG:teuthology.orchestra.run.smithi037:> mktemp 2024-09-19T05:47:30.906 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/tmp.STOnfwxFyd 2024-09-19T05:47:30.907 DEBUG:teuthology.orchestra.run.smithi037:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.STOnfwxFyd 2024-09-19T05:47:30.981 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0666 /tmp/tmp.STOnfwxFyd 2024-09-19T05:47:31.118 DEBUG:teuthology.orchestra.remote:smithi037:/tmp/tmp.STOnfwxFyd is 6KB 2024-09-19T05:47:31.168 DEBUG:teuthology.orchestra.run.smithi037:> rm -fr /tmp/tmp.STOnfwxFyd 2024-09-19T05:47:31.185 DEBUG:teuthology.orchestra.run.smithi037:> sudo /bin/ls /boot/loader/entries || true 2024-09-19T05:47:31.244 INFO:teuthology.orchestra.run.smithi037.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-19T05:47:31.245 INFO:teuthology.orchestra.run.smithi037.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-19T05:47:31.245 INFO:teuthology.orchestra.run.smithi037.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-19T05:47:31.245 INFO:teuthology.orchestra.run.smithi037.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-19T05:47:31.246 DEBUG:teuthology.orchestra.run.smithi037:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-19T05:47:31.533 DEBUG:teuthology.orchestra.run.smithi037:> sudo shutdown -r now 2024-09-19T05:48:01.536 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-19T05:48:01.536 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-09-19T05:48:01.537 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:48:36.033 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.37 2024-09-19T05:48:45.035 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-09-19T05:48:45.036 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:48:48.093 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.37 2024-09-19T05:49:00.094 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-09-19T05:49:00.095 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:49:02.239 DEBUG:teuthology.orchestra.run.smithi037:> true 2024-09-19T05:49:02.689 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-09-19T05:49:02.689 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-508.el9.x86_64"... 2024-09-19T05:49:02.689 DEBUG:teuthology.orchestra.run.smithi037:> uname -r 2024-09-19T05:49:02.704 INFO:teuthology.orchestra.run.smithi037.stdout:5.14.0-508.el9.x86_64 2024-09-19T05:49:02.705 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-19T05:49:02.705 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-19T05:49:02.705 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-19T05:49:03.707 DEBUG:teuthology.parallel:result is None 2024-09-19T05:49:03.707 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-19T05:49:03.713 INFO:teuthology.task.internal:Creating test directory... 2024-09-19T05:49:03.714 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T05:49:03.716 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T05:49:03.719 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T05:49:03.737 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-19T05:49:03.744 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-19T05:49:03.751 INFO:teuthology.task.internal:Creating archive directory... 2024-09-19T05:49:03.751 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T05:49:03.773 DEBUG:teuthology.orchestra.run.smithi099:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T05:49:03.780 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T05:49:03.902 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-19T05:49:03.912 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-19T05:49:03.912 DEBUG:teuthology.orchestra.run.smithi099:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T05:49:03.930 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:49:03.930 DEBUG:teuthology.orchestra.run.smithi117:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T05:49:03.947 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:49:03.948 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T05:49:03.950 DEBUG:teuthology.orchestra.run.smithi099:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T05:49:03.973 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T05:49:04.026 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T05:49:04.032 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T05:49:04.048 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T05:49:04.053 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T05:49:04.063 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T05:49:04.087 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T05:49:04.089 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-19T05:49:04.100 INFO:teuthology.task.internal:Configuring sudo... 2024-09-19T05:49:04.100 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T05:49:04.103 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T05:49:04.105 DEBUG:teuthology.orchestra.run.smithi117:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T05:49:04.134 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-19T05:49:04.144 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-19T05:49:04.144 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T05:49:04.169 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T05:49:04.173 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T05:49:04.191 DEBUG:teuthology.orchestra.run.smithi037:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T05:49:04.269 DEBUG:teuthology.orchestra.run.smithi037:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T05:49:04.315 DEBUG:teuthology.orchestra.run.smithi037:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T05:49:04.399 DEBUG:teuthology.orchestra.run.smithi037:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T05:49:04.440 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-19T05:49:04.440 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T05:49:04.524 DEBUG:teuthology.orchestra.run.smithi099:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T05:49:04.569 DEBUG:teuthology.orchestra.run.smithi099:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T05:49:04.619 DEBUG:teuthology.orchestra.run.smithi099:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T05:49:04.702 DEBUG:teuthology.orchestra.run.smithi099:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T05:49:04.745 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-19T05:49:04.745 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T05:49:04.811 DEBUG:teuthology.orchestra.run.smithi117:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T05:49:04.856 DEBUG:teuthology.orchestra.run.smithi117:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T05:49:04.907 DEBUG:teuthology.orchestra.run.smithi117:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T05:49:04.991 DEBUG:teuthology.orchestra.run.smithi117:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T05:49:05.033 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-19T05:49:05.033 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T05:49:05.099 DEBUG:teuthology.orchestra.run.smithi037:> sudo service rsyslog restart 2024-09-19T05:49:05.102 DEBUG:teuthology.orchestra.run.smithi099:> sudo service rsyslog restart 2024-09-19T05:49:05.104 DEBUG:teuthology.orchestra.run.smithi117:> sudo service rsyslog restart 2024-09-19T05:49:05.137 INFO:teuthology.orchestra.run.smithi099.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T05:49:05.148 INFO:teuthology.orchestra.run.smithi037.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T05:49:05.178 INFO:teuthology.orchestra.run.smithi117.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T05:49:05.549 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-19T05:49:05.557 INFO:teuthology.task.internal:Starting timer... 2024-09-19T05:49:05.557 INFO:teuthology.run_tasks:Running task pcp... 2024-09-19T05:49:05.599 INFO:teuthology.run_tasks:Running task selinux... 2024-09-19T05:49:05.609 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-19T05:49:05.609 DEBUG:teuthology.orchestra.run.smithi037:> sudo service auditd rotate 2024-09-19T05:49:05.672 INFO:teuthology.orchestra.run.smithi037.stdout:Rotating logs: 2024-09-19T05:49:05.674 DEBUG:teuthology.orchestra.run.smithi099:> sudo service auditd rotate 2024-09-19T05:49:05.729 INFO:teuthology.orchestra.run.smithi099.stdout:Rotating logs: 2024-09-19T05:49:05.731 DEBUG:teuthology.orchestra.run.smithi117:> sudo service auditd rotate 2024-09-19T05:49:05.782 INFO:teuthology.orchestra.run.smithi117.stdout:Rotating logs: 2024-09-19T05:49:05.784 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-19T05:49:05.784 DEBUG:teuthology.orchestra.run.smithi037:> /usr/sbin/getenforce 2024-09-19T05:49:05.802 INFO:teuthology.orchestra.run.smithi037.stdout:Permissive 2024-09-19T05:49:05.802 DEBUG:teuthology.orchestra.run.smithi099:> /usr/sbin/getenforce 2024-09-19T05:49:05.825 INFO:teuthology.orchestra.run.smithi099.stdout:Permissive 2024-09-19T05:49:05.825 DEBUG:teuthology.orchestra.run.smithi117:> /usr/sbin/getenforce 2024-09-19T05:49:05.846 INFO:teuthology.orchestra.run.smithi117.stdout:Permissive 2024-09-19T05:49:05.846 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi037.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi099.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi117.front.sepia.ceph.com': 'permissive'} 2024-09-19T05:49:05.847 DEBUG:teuthology.orchestra.run.smithi037:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T05:49:05.873 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:49:05.874 DEBUG:teuthology.orchestra.run.smithi099:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T05:49:05.901 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:49:05.901 DEBUG:teuthology.orchestra.run.smithi117:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T05:49:05.928 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:49:05.929 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-19T05:49:05.929 DEBUG:teuthology.orchestra.run.smithi037:> sudo /usr/sbin/setenforce permissive 2024-09-19T05:49:05.964 DEBUG:teuthology.orchestra.run.smithi099:> sudo /usr/sbin/setenforce permissive 2024-09-19T05:49:05.994 DEBUG:teuthology.orchestra.run.smithi117:> sudo /usr/sbin/setenforce permissive 2024-09-19T05:49:06.029 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-19T05:49:06.038 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-19T05:49:06.050 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-19T05:49:06.051 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi037.front.sepia.ceph.com,smithi099.front.sepia.ceph.com,smithi117.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-19T05:53:11.206 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi037.front.sepia.ceph.com'), Remote(name='ubuntu@smithi099.front.sepia.ceph.com'), Remote(name='ubuntu@smithi117.front.sepia.ceph.com')] 2024-09-19T05:53:11.207 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-09-19T05:53:11.208 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:53:11.301 DEBUG:teuthology.orchestra.run.smithi037:> true 2024-09-19T05:53:11.389 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-09-19T05:53:11.389 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-09-19T05:53:11.390 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:53:11.510 DEBUG:teuthology.orchestra.run.smithi099:> true 2024-09-19T05:53:11.594 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-09-19T05:53:11.595 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-09-19T05:53:11.595 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:53:11.696 DEBUG:teuthology.orchestra.run.smithi117:> true 2024-09-19T05:53:11.780 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-09-19T05:53:11.781 INFO:teuthology.run_tasks:Running task clock... 2024-09-19T05:53:11.857 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-19T05:53:11.857 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T05:53:11.858 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T05:53:11.861 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T05:53:11.861 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T05:53:11.864 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T05:53:11.864 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T05:53:11.894 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T05:53:11.896 INFO:teuthology.orchestra.run.smithi099.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T05:53:11.898 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T05:53:11.910 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T05:53:11.913 INFO:teuthology.orchestra.run.smithi099.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T05:53:11.914 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T05:53:11.938 INFO:teuthology.orchestra.run.smithi037.stderr:sudo: ntpd: command not found 2024-09-19T05:53:11.939 INFO:teuthology.orchestra.run.smithi099.stderr:sudo: ntpd: command not found 2024-09-19T05:53:11.940 INFO:teuthology.orchestra.run.smithi117.stderr:sudo: ntpd: command not found 2024-09-19T05:53:11.950 INFO:teuthology.orchestra.run.smithi037.stdout:506 Cannot talk to daemon 2024-09-19T05:53:11.951 INFO:teuthology.orchestra.run.smithi099.stdout:506 Cannot talk to daemon 2024-09-19T05:53:11.952 INFO:teuthology.orchestra.run.smithi117.stdout:506 Cannot talk to daemon 2024-09-19T05:53:11.966 INFO:teuthology.orchestra.run.smithi099.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T05:53:11.967 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T05:53:11.967 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T05:53:11.981 INFO:teuthology.orchestra.run.smithi099.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T05:53:11.981 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T05:53:11.981 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T05:53:12.037 INFO:teuthology.orchestra.run.smithi037.stderr:bash: line 1: ntpq: command not found 2024-09-19T05:53:12.041 INFO:teuthology.orchestra.run.smithi037.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T05:53:12.041 INFO:teuthology.orchestra.run.smithi037.stdout:=============================================================================== 2024-09-19T05:53:12.041 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:53:12.041 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:53:12.041 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:53:12.041 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:53:12.041 INFO:teuthology.orchestra.run.smithi099.stderr:bash: line 1: ntpq: command not found 2024-09-19T05:53:12.045 INFO:teuthology.orchestra.run.smithi099.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T05:53:12.045 INFO:teuthology.orchestra.run.smithi099.stdout:=============================================================================== 2024-09-19T05:53:12.046 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:53:12.046 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:53:12.046 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:53:12.046 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:53:12.046 INFO:teuthology.orchestra.run.smithi117.stderr:bash: line 1: ntpq: command not found 2024-09-19T05:53:12.050 INFO:teuthology.orchestra.run.smithi117.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T05:53:12.050 INFO:teuthology.orchestra.run.smithi117.stdout:=============================================================================== 2024-09-19T05:53:12.050 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:53:12.050 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:53:12.050 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:53:12.051 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:53:12.051 INFO:teuthology.run_tasks:Running task install... 2024-09-19T05:53:12.059 DEBUG:teuthology.task.install:project ceph 2024-09-19T05:53:12.059 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'}} 2024-09-19T05:53:12.059 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'} 2024-09-19T05:53:12.060 INFO:teuthology.task.install:Using flavor: default 2024-09-19T05:53:12.065 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-19T05:53:12.065 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-19T05:53:12.065 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T05:53:12.066 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T05:53:12.067 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T05:53:12.068 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T05:53:12.068 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T05:53:12.069 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T05:53:12.213 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T05:53:12.213 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T05:53:12.219 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T05:53:12.219 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T05:53:12.226 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T05:53:12.226 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T05:53:12.321 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T05:53:12.322 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-19T05:53:12.322 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T05:53:12.330 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T05:53:12.331 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-19T05:53:12.331 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T05:53:12.347 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T05:53:12.347 DEBUG:teuthology.orchestra.run.smithi117:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T05:53:12.350 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T05:53:12.350 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-19T05:53:12.350 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T05:53:12.357 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T05:53:12.357 DEBUG:teuthology.orchestra.run.smithi037:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T05:53:12.377 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T05:53:12.378 DEBUG:teuthology.orchestra.run.smithi099:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T05:53:12.413 DEBUG:teuthology.orchestra.run.smithi117:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T05:53:12.425 DEBUG:teuthology.orchestra.run.smithi037:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T05:53:12.444 DEBUG:teuthology.orchestra.run.smithi099:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T05:53:12.488 DEBUG:teuthology.orchestra.run.smithi117:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T05:53:12.502 DEBUG:teuthology.orchestra.run.smithi037:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T05:53:12.519 DEBUG:teuthology.orchestra.run.smithi099:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T05:53:12.552 INFO:teuthology.orchestra.run.smithi117.stdout:check_obsoletes = 1 2024-09-19T05:53:12.554 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum clean all 2024-09-19T05:53:12.567 INFO:teuthology.orchestra.run.smithi037.stdout:check_obsoletes = 1 2024-09-19T05:53:12.569 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum clean all 2024-09-19T05:53:12.583 INFO:teuthology.orchestra.run.smithi099.stdout:check_obsoletes = 1 2024-09-19T05:53:12.585 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum clean all 2024-09-19T05:53:12.781 INFO:teuthology.orchestra.run.smithi117.stdout:45 files removed 2024-09-19T05:53:12.808 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T05:53:12.809 INFO:teuthology.orchestra.run.smithi037.stdout:45 files removed 2024-09-19T05:53:12.813 INFO:teuthology.orchestra.run.smithi099.stdout:45 files removed 2024-09-19T05:53:12.836 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T05:53:12.838 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T05:53:13.344 INFO:teuthology.orchestra.run.smithi117.stdout:ceph packages for x86_64 321 kB/s | 84 kB 00:00 2024-09-19T05:53:13.392 INFO:teuthology.orchestra.run.smithi099.stdout:ceph packages for x86_64 297 kB/s | 84 kB 00:00 2024-09-19T05:53:13.407 INFO:teuthology.orchestra.run.smithi037.stdout:ceph packages for x86_64 314 kB/s | 84 kB 00:00 2024-09-19T05:53:13.612 INFO:teuthology.orchestra.run.smithi117.stdout:ceph noarch packages 52 kB/s | 12 kB 00:00 2024-09-19T05:53:13.685 INFO:teuthology.orchestra.run.smithi099.stdout:ceph noarch packages 47 kB/s | 12 kB 00:00 2024-09-19T05:53:13.691 INFO:teuthology.orchestra.run.smithi037.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-19T05:53:13.879 INFO:teuthology.orchestra.run.smithi117.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-19T05:53:13.960 INFO:teuthology.orchestra.run.smithi099.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-19T05:53:13.966 INFO:teuthology.orchestra.run.smithi037.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-19T05:53:14.685 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.3 MB 00:00 2024-09-19T05:53:15.558 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - BaseOS 5.3 MB/s | 8.3 MB 00:01 2024-09-19T05:53:15.895 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - BaseOS 4.2 MB/s | 8.3 MB 00:01 2024-09-19T05:53:16.437 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - AppStream 29 MB/s | 20 MB 00:00 2024-09-19T05:53:19.896 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - AppStream 6.9 MB/s | 20 MB 00:02 2024-09-19T05:53:19.967 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - AppStream 6.2 MB/s | 20 MB 00:03 2024-09-19T05:53:20.671 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - CRB 16 MB/s | 6.5 MB 00:00 2024-09-19T05:53:22.338 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - Extras packages 40 kB/s | 19 kB 00:00 2024-09-19T05:53:23.317 INFO:teuthology.orchestra.run.smithi099.stdout:Extra Packages for Enterprise Linux 26 MB/s | 23 MB 00:00 2024-09-19T05:53:24.427 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-19T05:53:25.338 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - CRB 3.9 MB/s | 6.5 MB 00:01 2024-09-19T05:53:25.877 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - Extras packages 115 kB/s | 19 kB 00:00 2024-09-19T05:53:26.757 INFO:teuthology.orchestra.run.smithi037.stdout:Extra Packages for Enterprise Linux 30 MB/s | 23 MB 00:00 2024-09-19T05:53:27.639 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - Extras packages 17 kB/s | 19 kB 00:01 2024-09-19T05:53:28.460 INFO:teuthology.orchestra.run.smithi117.stdout:Extra Packages for Enterprise Linux 33 MB/s | 23 MB 00:00 2024-09-19T05:53:28.814 INFO:teuthology.orchestra.run.smithi099.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-09-19T05:53:30.974 INFO:teuthology.orchestra.run.smithi099.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T05:53:30.975 INFO:teuthology.orchestra.run.smithi099.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T05:53:30.986 INFO:teuthology.orchestra.run.smithi099.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T05:53:30.987 INFO:teuthology.orchestra.run.smithi099.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T05:53:30.988 INFO:teuthology.orchestra.run.smithi099.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T05:53:30.989 INFO:teuthology.orchestra.run.smithi099.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T05:53:30.990 INFO:teuthology.orchestra.run.smithi099.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T05:53:30.992 INFO:teuthology.orchestra.run.smithi099.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T05:53:30.993 INFO:teuthology.orchestra.run.smithi099.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T05:53:31.055 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-19T05:53:31.072 INFO:teuthology.orchestra.run.smithi099.stdout:====================================================================================== 2024-09-19T05:53:31.073 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repository Size 2024-09-19T05:53:31.073 INFO:teuthology.orchestra.run.smithi099.stdout:====================================================================================== 2024-09-19T05:53:31.073 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-09-19T05:53:31.073 INFO:teuthology.orchestra.run.smithi099.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T05:53:31.073 INFO:teuthology.orchestra.run.smithi099.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T05:53:31.074 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T05:53:31.074 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T05:53:31.074 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T05:53:31.074 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T05:53:31.074 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T05:53:31.074 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T05:53:31.075 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T05:53:31.075 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T05:53:31.075 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T05:53:31.075 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T05:53:31.075 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T05:53:31.076 INFO:teuthology.orchestra.run.smithi099.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T05:53:31.076 INFO:teuthology.orchestra.run.smithi099.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T05:53:31.076 INFO:teuthology.orchestra.run.smithi099.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T05:53:31.076 INFO:teuthology.orchestra.run.smithi099.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T05:53:31.076 INFO:teuthology.orchestra.run.smithi099.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T05:53:31.077 INFO:teuthology.orchestra.run.smithi099.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T05:53:31.077 INFO:teuthology.orchestra.run.smithi099.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T05:53:31.077 INFO:teuthology.orchestra.run.smithi099.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T05:53:31.077 INFO:teuthology.orchestra.run.smithi099.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T05:53:31.078 INFO:teuthology.orchestra.run.smithi099.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T05:53:31.078 INFO:teuthology.orchestra.run.smithi099.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T05:53:31.078 INFO:teuthology.orchestra.run.smithi099.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T05:53:31.078 INFO:teuthology.orchestra.run.smithi099.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T05:53:31.078 INFO:teuthology.orchestra.run.smithi099.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T05:53:31.079 INFO:teuthology.orchestra.run.smithi099.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T05:53:31.079 INFO:teuthology.orchestra.run.smithi099.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T05:53:31.079 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T05:53:31.079 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T05:53:31.079 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T05:53:31.079 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T05:53:31.080 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T05:53:31.080 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T05:53:31.080 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T05:53:31.080 INFO:teuthology.orchestra.run.smithi099.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T05:53:31.080 INFO:teuthology.orchestra.run.smithi099.stdout:Upgrading: 2024-09-19T05:53:31.081 INFO:teuthology.orchestra.run.smithi099.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T05:53:31.081 INFO:teuthology.orchestra.run.smithi099.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T05:53:31.081 INFO:teuthology.orchestra.run.smithi099.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T05:53:31.081 INFO:teuthology.orchestra.run.smithi099.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T05:53:31.081 INFO:teuthology.orchestra.run.smithi099.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T05:53:31.082 INFO:teuthology.orchestra.run.smithi099.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T05:53:31.082 INFO:teuthology.orchestra.run.smithi099.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T05:53:31.082 INFO:teuthology.orchestra.run.smithi099.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T05:53:31.082 INFO:teuthology.orchestra.run.smithi099.stdout:Installing dependencies: 2024-09-19T05:53:31.082 INFO:teuthology.orchestra.run.smithi099.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T05:53:31.082 INFO:teuthology.orchestra.run.smithi099.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T05:53:31.082 INFO:teuthology.orchestra.run.smithi099.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T05:53:31.083 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T05:53:31.083 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T05:53:31.083 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T05:53:31.083 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T05:53:31.083 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T05:53:31.083 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T05:53:31.084 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T05:53:31.084 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T05:53:31.084 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T05:53:31.084 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T05:53:31.084 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T05:53:31.084 INFO:teuthology.orchestra.run.smithi099.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T05:53:31.085 INFO:teuthology.orchestra.run.smithi099.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T05:53:31.085 INFO:teuthology.orchestra.run.smithi099.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T05:53:31.085 INFO:teuthology.orchestra.run.smithi099.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T05:53:31.085 INFO:teuthology.orchestra.run.smithi099.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T05:53:31.085 INFO:teuthology.orchestra.run.smithi099.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T05:53:31.085 INFO:teuthology.orchestra.run.smithi099.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T05:53:31.085 INFO:teuthology.orchestra.run.smithi099.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T05:53:31.086 INFO:teuthology.orchestra.run.smithi099.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T05:53:31.086 INFO:teuthology.orchestra.run.smithi099.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T05:53:31.086 INFO:teuthology.orchestra.run.smithi099.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T05:53:31.086 INFO:teuthology.orchestra.run.smithi099.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T05:53:31.086 INFO:teuthology.orchestra.run.smithi099.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T05:53:31.086 INFO:teuthology.orchestra.run.smithi099.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T05:53:31.087 INFO:teuthology.orchestra.run.smithi099.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T05:53:31.087 INFO:teuthology.orchestra.run.smithi099.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T05:53:31.087 INFO:teuthology.orchestra.run.smithi099.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T05:53:31.087 INFO:teuthology.orchestra.run.smithi099.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T05:53:31.087 INFO:teuthology.orchestra.run.smithi099.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T05:53:31.087 INFO:teuthology.orchestra.run.smithi099.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T05:53:31.087 INFO:teuthology.orchestra.run.smithi099.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T05:53:31.088 INFO:teuthology.orchestra.run.smithi099.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T05:53:31.088 INFO:teuthology.orchestra.run.smithi099.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T05:53:31.088 INFO:teuthology.orchestra.run.smithi099.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T05:53:31.088 INFO:teuthology.orchestra.run.smithi099.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T05:53:31.089 INFO:teuthology.orchestra.run.smithi099.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T05:53:31.089 INFO:teuthology.orchestra.run.smithi099.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T05:53:31.089 INFO:teuthology.orchestra.run.smithi099.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T05:53:31.089 INFO:teuthology.orchestra.run.smithi099.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T05:53:31.089 INFO:teuthology.orchestra.run.smithi099.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T05:53:31.090 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T05:53:31.090 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T05:53:31.090 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T05:53:31.090 INFO:teuthology.orchestra.run.smithi099.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T05:53:31.090 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T05:53:31.090 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T05:53:31.091 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T05:53:31.091 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T05:53:31.091 INFO:teuthology.orchestra.run.smithi099.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T05:53:31.091 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T05:53:31.091 INFO:teuthology.orchestra.run.smithi099.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T05:53:31.091 INFO:teuthology.orchestra.run.smithi099.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T05:53:31.092 INFO:teuthology.orchestra.run.smithi099.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T05:53:31.092 INFO:teuthology.orchestra.run.smithi099.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T05:53:31.092 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T05:53:31.092 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T05:53:31.092 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T05:53:31.093 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T05:53:31.093 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T05:53:31.093 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T05:53:31.093 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T05:53:31.093 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T05:53:31.093 INFO:teuthology.orchestra.run.smithi099.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T05:53:31.094 INFO:teuthology.orchestra.run.smithi099.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T05:53:31.094 INFO:teuthology.orchestra.run.smithi099.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T05:53:31.094 INFO:teuthology.orchestra.run.smithi099.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T05:53:31.094 INFO:teuthology.orchestra.run.smithi099.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T05:53:31.094 INFO:teuthology.orchestra.run.smithi099.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T05:53:31.094 INFO:teuthology.orchestra.run.smithi099.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T05:53:31.095 INFO:teuthology.orchestra.run.smithi099.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T05:53:31.095 INFO:teuthology.orchestra.run.smithi099.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T05:53:31.095 INFO:teuthology.orchestra.run.smithi099.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T05:53:31.095 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T05:53:31.095 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T05:53:31.095 INFO:teuthology.orchestra.run.smithi099.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T05:53:31.095 INFO:teuthology.orchestra.run.smithi099.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T05:53:31.096 INFO:teuthology.orchestra.run.smithi099.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T05:53:31.096 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T05:53:31.096 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T05:53:31.096 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T05:53:31.097 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T05:53:31.097 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T05:53:31.098 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T05:53:31.098 INFO:teuthology.orchestra.run.smithi099.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T05:53:31.098 INFO:teuthology.orchestra.run.smithi099.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T05:53:31.098 INFO:teuthology.orchestra.run.smithi099.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T05:53:31.098 INFO:teuthology.orchestra.run.smithi099.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T05:53:31.098 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T05:53:31.098 INFO:teuthology.orchestra.run.smithi099.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T05:53:31.099 INFO:teuthology.orchestra.run.smithi099.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T05:53:31.099 INFO:teuthology.orchestra.run.smithi099.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T05:53:31.099 INFO:teuthology.orchestra.run.smithi099.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T05:53:31.099 INFO:teuthology.orchestra.run.smithi099.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T05:53:31.099 INFO:teuthology.orchestra.run.smithi099.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T05:53:31.099 INFO:teuthology.orchestra.run.smithi099.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T05:53:31.100 INFO:teuthology.orchestra.run.smithi099.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T05:53:31.100 INFO:teuthology.orchestra.run.smithi099.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T05:53:31.100 INFO:teuthology.orchestra.run.smithi099.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T05:53:31.100 INFO:teuthology.orchestra.run.smithi099.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T05:53:31.100 INFO:teuthology.orchestra.run.smithi099.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T05:53:31.100 INFO:teuthology.orchestra.run.smithi099.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T05:53:31.101 INFO:teuthology.orchestra.run.smithi099.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T05:53:31.101 INFO:teuthology.orchestra.run.smithi099.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T05:53:31.101 INFO:teuthology.orchestra.run.smithi099.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T05:53:31.101 INFO:teuthology.orchestra.run.smithi099.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T05:53:31.101 INFO:teuthology.orchestra.run.smithi099.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T05:53:31.101 INFO:teuthology.orchestra.run.smithi099.stdout:Installing weak dependencies: 2024-09-19T05:53:31.102 INFO:teuthology.orchestra.run.smithi099.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T05:53:31.102 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T05:53:31.102 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-09-19T05:53:31.102 INFO:teuthology.orchestra.run.smithi099.stdout:====================================================================================== 2024-09-19T05:53:31.102 INFO:teuthology.orchestra.run.smithi099.stdout:Install 148 Packages 2024-09-19T05:53:31.102 INFO:teuthology.orchestra.run.smithi099.stdout:Upgrade 8 Packages 2024-09-19T05:53:31.103 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T05:53:31.104 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 226 M 2024-09-19T05:53:31.104 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-09-19T05:53:32.190 INFO:teuthology.orchestra.run.smithi099.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 49 kB/s | 6.6 kB 00:00 2024-09-19T05:53:32.415 INFO:teuthology.orchestra.run.smithi099.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 3.9 MB/s | 896 kB 00:00 2024-09-19T05:53:32.513 INFO:teuthology.orchestra.run.smithi037.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-19T05:53:32.532 INFO:teuthology.orchestra.run.smithi099.stdout:(3/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 11 MB/s | 5.4 MB 00:00 2024-09-19T05:53:32.549 INFO:teuthology.orchestra.run.smithi099.stdout:(4/156): ceph-immutable-object-cache-19.1.1-361 1.1 MB/s | 145 kB 00:00 2024-09-19T05:53:32.732 INFO:teuthology.orchestra.run.smithi099.stdout:(5/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 8.3 MB/s | 1.5 MB 00:00 2024-09-19T05:53:33.133 INFO:teuthology.orchestra.run.smithi099.stdout:(6/156): ceph-common-19.1.1-361.g2f599a46.el9.x 20 MB/s | 21 MB 00:01 2024-09-19T05:53:33.191 INFO:teuthology.orchestra.run.smithi099.stdout:(7/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 3.6 MB/s | 2.4 MB 00:00 2024-09-19T05:53:33.267 INFO:teuthology.orchestra.run.smithi099.stdout:(8/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 8.8 MB/s | 4.7 MB 00:00 2024-09-19T05:53:33.350 INFO:teuthology.orchestra.run.smithi099.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 302 kB/s | 25 kB 00:00 2024-09-19T05:53:33.767 INFO:teuthology.orchestra.run.smithi099.stdout:(10/156): ceph-radosgw-19.1.1-361.g2f599a46.el9 18 MB/s | 11 MB 00:00 2024-09-19T05:53:33.865 INFO:teuthology.orchestra.run.smithi117.stdout:lab-extras 37 kB/s | 1.7 kB 00:00 2024-09-19T05:53:33.942 INFO:teuthology.orchestra.run.smithi099.stdout:(11/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 21 MB/s | 17 MB 00:00 2024-09-19T05:53:33.967 INFO:teuthology.orchestra.run.smithi099.stdout:(12/156): cephfs-mirror-19.1.1-361.g2f599a46.el 1.1 MB/s | 228 kB 00:00 2024-09-19T05:53:33.993 INFO:teuthology.orchestra.run.smithi099.stdout:(13/156): cephfs-shell-19.1.1-361.g2f599a46.el9 542 kB/s | 27 kB 00:00 2024-09-19T05:53:34.018 INFO:teuthology.orchestra.run.smithi099.stdout:(14/156): libcephfs-devel-19.1.1-361.g2f599a46. 634 kB/s | 32 kB 00:00 2024-09-19T05:53:34.051 INFO:teuthology.orchestra.run.smithi099.stdout:(15/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 13 MB/s | 751 kB 00:00 2024-09-19T05:53:34.077 INFO:teuthology.orchestra.run.smithi099.stdout:(16/156): libcephsqlite-19.1.1-361.g2f599a46.el 2.7 MB/s | 163 kB 00:00 2024-09-19T05:53:34.110 INFO:teuthology.orchestra.run.smithi099.stdout:(17/156): librados-devel-19.1.1-361.g2f599a46.e 2.1 MB/s | 127 kB 00:00 2024-09-19T05:53:34.144 INFO:teuthology.orchestra.run.smithi099.stdout:(18/156): libradosstriper1-19.1.1-361.g2f599a46 7.4 MB/s | 506 kB 00:00 2024-09-19T05:53:34.227 INFO:teuthology.orchestra.run.smithi099.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 543 kB/s | 45 kB 00:00 2024-09-19T05:53:34.319 INFO:teuthology.orchestra.run.smithi099.stdout:(20/156): python3-ceph-common-19.1.1-361.g2f599 1.5 MB/s | 136 kB 00:00 2024-09-19T05:53:34.403 INFO:teuthology.orchestra.run.smithi099.stdout:(21/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 18 MB/s | 5.3 MB 00:00 2024-09-19T05:53:34.428 INFO:teuthology.orchestra.run.smithi099.stdout:(22/156): python3-cephfs-19.1.1-361.g2f599a46.e 1.5 MB/s | 161 kB 00:00 2024-09-19T05:53:34.470 INFO:teuthology.orchestra.run.smithi099.stdout:(23/156): python3-rados-19.1.1-361.g2f599a46.el 4.7 MB/s | 320 kB 00:00 2024-09-19T05:53:34.504 INFO:teuthology.orchestra.run.smithi099.stdout:(24/156): python3-rbd-19.1.1-361.g2f599a46.el9. 3.9 MB/s | 300 kB 00:00 2024-09-19T05:53:34.529 INFO:teuthology.orchestra.run.smithi099.stdout:(25/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.7 MB/s | 99 kB 00:00 2024-09-19T05:53:34.563 INFO:teuthology.orchestra.run.smithi099.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.4 MB/s | 85 kB 00:00 2024-09-19T05:53:34.779 INFO:teuthology.orchestra.run.smithi099.stdout:(27/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 12 MB/s | 3.1 MB 00:00 2024-09-19T05:53:34.799 INFO:teuthology.orchestra.run.smithi037.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T05:53:34.800 INFO:teuthology.orchestra.run.smithi037.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T05:53:34.812 INFO:teuthology.orchestra.run.smithi037.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T05:53:34.817 INFO:teuthology.orchestra.run.smithi037.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T05:53:34.817 INFO:teuthology.orchestra.run.smithi037.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T05:53:34.818 INFO:teuthology.orchestra.run.smithi037.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T05:53:34.818 INFO:teuthology.orchestra.run.smithi037.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T05:53:34.819 INFO:teuthology.orchestra.run.smithi037.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T05:53:34.820 INFO:teuthology.orchestra.run.smithi037.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T05:53:34.855 INFO:teuthology.orchestra.run.smithi099.stdout:(28/156): ceph-grafana-dashboards-19.1.1-361.g2 424 kB/s | 32 kB 00:00 2024-09-19T05:53:34.888 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-09-19T05:53:34.907 INFO:teuthology.orchestra.run.smithi037.stdout:====================================================================================== 2024-09-19T05:53:34.908 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2024-09-19T05:53:34.908 INFO:teuthology.orchestra.run.smithi037.stdout:====================================================================================== 2024-09-19T05:53:34.908 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-09-19T05:53:34.908 INFO:teuthology.orchestra.run.smithi037.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T05:53:34.908 INFO:teuthology.orchestra.run.smithi037.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T05:53:34.908 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T05:53:34.908 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T05:53:34.908 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T05:53:34.908 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T05:53:34.908 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T05:53:34.908 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T05:53:34.908 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T05:53:34.908 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T05:53:34.908 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T05:53:34.909 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T05:53:34.909 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T05:53:34.909 INFO:teuthology.orchestra.run.smithi037.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T05:53:34.909 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T05:53:34.909 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T05:53:34.909 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T05:53:34.909 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T05:53:34.909 INFO:teuthology.orchestra.run.smithi037.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T05:53:34.909 INFO:teuthology.orchestra.run.smithi037.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T05:53:34.909 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T05:53:34.909 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T05:53:34.909 INFO:teuthology.orchestra.run.smithi037.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T05:53:34.909 INFO:teuthology.orchestra.run.smithi037.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T05:53:34.910 INFO:teuthology.orchestra.run.smithi037.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T05:53:34.910 INFO:teuthology.orchestra.run.smithi037.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T05:53:34.910 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T05:53:34.910 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T05:53:34.910 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T05:53:34.910 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T05:53:34.910 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T05:53:34.910 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T05:53:34.910 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T05:53:34.910 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T05:53:34.910 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T05:53:34.910 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T05:53:34.910 INFO:teuthology.orchestra.run.smithi037.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T05:53:34.911 INFO:teuthology.orchestra.run.smithi037.stdout:Upgrading: 2024-09-19T05:53:34.911 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T05:53:34.911 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T05:53:34.911 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T05:53:34.911 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T05:53:34.911 INFO:teuthology.orchestra.run.smithi037.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T05:53:34.911 INFO:teuthology.orchestra.run.smithi037.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T05:53:34.911 INFO:teuthology.orchestra.run.smithi037.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T05:53:34.911 INFO:teuthology.orchestra.run.smithi037.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T05:53:34.911 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2024-09-19T05:53:34.911 INFO:teuthology.orchestra.run.smithi037.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T05:53:34.911 INFO:teuthology.orchestra.run.smithi037.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T05:53:34.911 INFO:teuthology.orchestra.run.smithi037.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T05:53:34.911 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T05:53:34.912 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T05:53:34.912 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T05:53:34.912 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T05:53:34.912 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T05:53:34.912 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T05:53:34.912 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T05:53:34.912 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T05:53:34.912 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T05:53:34.912 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T05:53:34.912 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T05:53:34.912 INFO:teuthology.orchestra.run.smithi037.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T05:53:34.912 INFO:teuthology.orchestra.run.smithi037.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T05:53:34.912 INFO:teuthology.orchestra.run.smithi037.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T05:53:34.913 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T05:53:34.913 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T05:53:34.913 INFO:teuthology.orchestra.run.smithi037.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T05:53:34.913 INFO:teuthology.orchestra.run.smithi037.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T05:53:34.913 INFO:teuthology.orchestra.run.smithi037.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T05:53:34.913 INFO:teuthology.orchestra.run.smithi037.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T05:53:34.913 INFO:teuthology.orchestra.run.smithi037.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T05:53:34.913 INFO:teuthology.orchestra.run.smithi037.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T05:53:34.913 INFO:teuthology.orchestra.run.smithi037.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T05:53:34.913 INFO:teuthology.orchestra.run.smithi037.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T05:53:34.913 INFO:teuthology.orchestra.run.smithi037.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T05:53:34.913 INFO:teuthology.orchestra.run.smithi037.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T05:53:34.913 INFO:teuthology.orchestra.run.smithi037.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T05:53:34.913 INFO:teuthology.orchestra.run.smithi037.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T05:53:34.914 INFO:teuthology.orchestra.run.smithi037.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T05:53:34.914 INFO:teuthology.orchestra.run.smithi037.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T05:53:34.914 INFO:teuthology.orchestra.run.smithi037.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T05:53:34.914 INFO:teuthology.orchestra.run.smithi037.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T05:53:34.914 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T05:53:34.914 INFO:teuthology.orchestra.run.smithi037.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T05:53:34.914 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T05:53:34.914 INFO:teuthology.orchestra.run.smithi037.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T05:53:34.914 INFO:teuthology.orchestra.run.smithi037.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T05:53:34.914 INFO:teuthology.orchestra.run.smithi037.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T05:53:34.914 INFO:teuthology.orchestra.run.smithi037.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T05:53:34.914 INFO:teuthology.orchestra.run.smithi037.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T05:53:34.914 INFO:teuthology.orchestra.run.smithi037.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T05:53:34.914 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T05:53:34.915 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T05:53:34.915 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T05:53:34.915 INFO:teuthology.orchestra.run.smithi037.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T05:53:34.915 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T05:53:34.915 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T05:53:34.915 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T05:53:34.915 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T05:53:34.915 INFO:teuthology.orchestra.run.smithi037.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T05:53:34.915 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T05:53:34.915 INFO:teuthology.orchestra.run.smithi037.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T05:53:34.915 INFO:teuthology.orchestra.run.smithi037.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T05:53:34.915 INFO:teuthology.orchestra.run.smithi037.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T05:53:34.915 INFO:teuthology.orchestra.run.smithi037.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T05:53:34.915 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T05:53:34.916 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T05:53:34.916 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T05:53:34.916 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T05:53:34.916 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T05:53:34.916 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T05:53:34.916 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T05:53:34.916 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T05:53:34.916 INFO:teuthology.orchestra.run.smithi037.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T05:53:34.916 INFO:teuthology.orchestra.run.smithi037.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T05:53:34.916 INFO:teuthology.orchestra.run.smithi037.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T05:53:34.916 INFO:teuthology.orchestra.run.smithi037.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T05:53:34.916 INFO:teuthology.orchestra.run.smithi037.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T05:53:34.916 INFO:teuthology.orchestra.run.smithi037.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T05:53:34.916 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T05:53:34.917 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T05:53:34.917 INFO:teuthology.orchestra.run.smithi037.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T05:53:34.917 INFO:teuthology.orchestra.run.smithi037.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T05:53:34.917 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T05:53:34.917 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T05:53:34.917 INFO:teuthology.orchestra.run.smithi037.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T05:53:34.917 INFO:teuthology.orchestra.run.smithi037.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T05:53:34.917 INFO:teuthology.orchestra.run.smithi037.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T05:53:34.917 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T05:53:34.917 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T05:53:34.917 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T05:53:34.917 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T05:53:34.917 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T05:53:34.917 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T05:53:34.918 INFO:teuthology.orchestra.run.smithi037.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T05:53:34.918 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T05:53:34.918 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T05:53:34.918 INFO:teuthology.orchestra.run.smithi037.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T05:53:34.918 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T05:53:34.918 INFO:teuthology.orchestra.run.smithi037.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T05:53:34.918 INFO:teuthology.orchestra.run.smithi037.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T05:53:34.918 INFO:teuthology.orchestra.run.smithi037.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T05:53:34.918 INFO:teuthology.orchestra.run.smithi037.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T05:53:34.918 INFO:teuthology.orchestra.run.smithi037.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T05:53:34.918 INFO:teuthology.orchestra.run.smithi037.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T05:53:34.918 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T05:53:34.918 INFO:teuthology.orchestra.run.smithi037.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T05:53:34.918 INFO:teuthology.orchestra.run.smithi037.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T05:53:34.919 INFO:teuthology.orchestra.run.smithi037.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T05:53:34.919 INFO:teuthology.orchestra.run.smithi037.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T05:53:34.919 INFO:teuthology.orchestra.run.smithi037.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T05:53:34.919 INFO:teuthology.orchestra.run.smithi037.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T05:53:34.919 INFO:teuthology.orchestra.run.smithi037.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T05:53:34.919 INFO:teuthology.orchestra.run.smithi037.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T05:53:34.919 INFO:teuthology.orchestra.run.smithi037.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T05:53:34.919 INFO:teuthology.orchestra.run.smithi037.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T05:53:34.919 INFO:teuthology.orchestra.run.smithi037.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T05:53:34.919 INFO:teuthology.orchestra.run.smithi037.stdout:Installing weak dependencies: 2024-09-19T05:53:34.919 INFO:teuthology.orchestra.run.smithi037.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T05:53:34.919 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T05:53:34.919 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-09-19T05:53:34.919 INFO:teuthology.orchestra.run.smithi037.stdout:====================================================================================== 2024-09-19T05:53:34.919 INFO:teuthology.orchestra.run.smithi037.stdout:Install 148 Packages 2024-09-19T05:53:34.920 INFO:teuthology.orchestra.run.smithi037.stdout:Upgrade 8 Packages 2024-09-19T05:53:34.920 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T05:53:34.920 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 226 M 2024-09-19T05:53:34.920 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-09-19T05:53:34.947 INFO:teuthology.orchestra.run.smithi099.stdout:(29/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 1.6 MB/s | 146 kB 00:00 2024-09-19T05:53:35.064 INFO:teuthology.orchestra.run.smithi099.stdout:(30/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 341 kB/s | 171 kB 00:00 2024-09-19T05:53:35.206 INFO:teuthology.orchestra.run.smithi099.stdout:(31/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 14 MB/s | 3.6 MB 00:00 2024-09-19T05:53:35.297 INFO:teuthology.orchestra.run.smithi099.stdout:(32/156): ceph-mgr-modules-core-19.1.1-361.g2f5 2.7 MB/s | 249 kB 00:00 2024-09-19T05:53:35.398 INFO:teuthology.orchestra.run.smithi099.stdout:(33/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 494 kB/s | 49 kB 00:00 2024-09-19T05:53:35.498 INFO:teuthology.orchestra.run.smithi099.stdout:(34/156): ceph-prometheus-alerts-19.1.1-361.g2f 164 kB/s | 16 kB 00:00 2024-09-19T05:53:35.573 INFO:teuthology.orchestra.run.smithi037.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 19 kB/s | 6.6 kB 00:00 2024-09-19T05:53:35.599 INFO:teuthology.orchestra.run.smithi099.stdout:(35/156): ceph-volume-19.1.1-361.g2f599a46.el9. 2.8 MB/s | 285 kB 00:00 2024-09-19T05:53:35.707 INFO:teuthology.orchestra.run.smithi099.stdout:(36/156): ceph-mgr-diskprediction-local-19.1.1- 12 MB/s | 7.4 MB 00:00 2024-09-19T05:53:35.741 INFO:teuthology.orchestra.run.smithi099.stdout:(37/156): cephadm-19.1.1-361.g2f599a46.el9.noar 5.3 MB/s | 765 kB 00:00 2024-09-19T05:53:35.791 INFO:teuthology.orchestra.run.smithi099.stdout:(38/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 218 kB/s | 18 kB 00:00 2024-09-19T05:53:35.850 INFO:teuthology.orchestra.run.smithi099.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 735 kB/s | 80 kB 00:00 2024-09-19T05:53:35.919 INFO:teuthology.orchestra.run.smithi099.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 2.8 MB/s | 191 kB 00:00 2024-09-19T05:53:35.975 INFO:teuthology.orchestra.run.smithi099.stdout:(41/156): libgfortran-11.5.0-2.el9.x86_64.rpm 4.3 MB/s | 801 kB 00:00 2024-09-19T05:53:36.000 INFO:teuthology.orchestra.run.smithi099.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2024-09-19T05:53:36.007 INFO:teuthology.orchestra.run.smithi117.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T05:53:36.008 INFO:teuthology.orchestra.run.smithi117.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T05:53:36.020 INFO:teuthology.orchestra.run.smithi117.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T05:53:36.020 INFO:teuthology.orchestra.run.smithi117.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T05:53:36.021 INFO:teuthology.orchestra.run.smithi117.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T05:53:36.022 INFO:teuthology.orchestra.run.smithi117.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T05:53:36.023 INFO:teuthology.orchestra.run.smithi117.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T05:53:36.026 INFO:teuthology.orchestra.run.smithi117.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T05:53:36.027 INFO:teuthology.orchestra.run.smithi117.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T05:53:36.050 INFO:teuthology.orchestra.run.smithi099.stdout:(43/156): python3-cryptography-36.0.1-4.el9.x86 16 MB/s | 1.2 MB 00:00 2024-09-19T05:53:36.076 INFO:teuthology.orchestra.run.smithi099.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-09-19T05:53:36.089 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-09-19T05:53:36.101 INFO:teuthology.orchestra.run.smithi099.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-19T05:53:36.108 INFO:teuthology.orchestra.run.smithi117.stdout:====================================================================================== 2024-09-19T05:53:36.108 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repository Size 2024-09-19T05:53:36.108 INFO:teuthology.orchestra.run.smithi117.stdout:====================================================================================== 2024-09-19T05:53:36.108 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-09-19T05:53:36.108 INFO:teuthology.orchestra.run.smithi117.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T05:53:36.108 INFO:teuthology.orchestra.run.smithi117.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T05:53:36.108 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T05:53:36.108 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T05:53:36.108 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T05:53:36.109 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T05:53:36.109 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T05:53:36.109 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T05:53:36.109 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T05:53:36.109 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T05:53:36.109 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T05:53:36.109 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T05:53:36.109 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T05:53:36.109 INFO:teuthology.orchestra.run.smithi117.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T05:53:36.109 INFO:teuthology.orchestra.run.smithi117.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T05:53:36.109 INFO:teuthology.orchestra.run.smithi117.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T05:53:36.109 INFO:teuthology.orchestra.run.smithi117.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T05:53:36.109 INFO:teuthology.orchestra.run.smithi117.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T05:53:36.110 INFO:teuthology.orchestra.run.smithi117.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T05:53:36.110 INFO:teuthology.orchestra.run.smithi117.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T05:53:36.110 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T05:53:36.110 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T05:53:36.110 INFO:teuthology.orchestra.run.smithi117.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T05:53:36.110 INFO:teuthology.orchestra.run.smithi117.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T05:53:36.110 INFO:teuthology.orchestra.run.smithi117.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T05:53:36.110 INFO:teuthology.orchestra.run.smithi117.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T05:53:36.110 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T05:53:36.110 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T05:53:36.110 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T05:53:36.110 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T05:53:36.110 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T05:53:36.111 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T05:53:36.111 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T05:53:36.111 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T05:53:36.111 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T05:53:36.111 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T05:53:36.111 INFO:teuthology.orchestra.run.smithi117.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T05:53:36.111 INFO:teuthology.orchestra.run.smithi117.stdout:Upgrading: 2024-09-19T05:53:36.111 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T05:53:36.111 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T05:53:36.111 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T05:53:36.111 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T05:53:36.111 INFO:teuthology.orchestra.run.smithi117.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T05:53:36.111 INFO:teuthology.orchestra.run.smithi117.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T05:53:36.111 INFO:teuthology.orchestra.run.smithi117.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T05:53:36.112 INFO:teuthology.orchestra.run.smithi117.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T05:53:36.112 INFO:teuthology.orchestra.run.smithi117.stdout:Installing dependencies: 2024-09-19T05:53:36.112 INFO:teuthology.orchestra.run.smithi117.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T05:53:36.112 INFO:teuthology.orchestra.run.smithi117.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T05:53:36.112 INFO:teuthology.orchestra.run.smithi117.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T05:53:36.112 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T05:53:36.112 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T05:53:36.112 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T05:53:36.112 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T05:53:36.112 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T05:53:36.112 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T05:53:36.112 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T05:53:36.112 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T05:53:36.113 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T05:53:36.113 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T05:53:36.113 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T05:53:36.113 INFO:teuthology.orchestra.run.smithi117.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T05:53:36.113 INFO:teuthology.orchestra.run.smithi117.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T05:53:36.113 INFO:teuthology.orchestra.run.smithi117.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T05:53:36.113 INFO:teuthology.orchestra.run.smithi117.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T05:53:36.113 INFO:teuthology.orchestra.run.smithi117.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T05:53:36.113 INFO:teuthology.orchestra.run.smithi117.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T05:53:36.113 INFO:teuthology.orchestra.run.smithi117.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T05:53:36.113 INFO:teuthology.orchestra.run.smithi117.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T05:53:36.113 INFO:teuthology.orchestra.run.smithi117.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T05:53:36.113 INFO:teuthology.orchestra.run.smithi117.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T05:53:36.114 INFO:teuthology.orchestra.run.smithi117.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T05:53:36.114 INFO:teuthology.orchestra.run.smithi117.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T05:53:36.114 INFO:teuthology.orchestra.run.smithi117.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T05:53:36.114 INFO:teuthology.orchestra.run.smithi117.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T05:53:36.114 INFO:teuthology.orchestra.run.smithi117.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T05:53:36.114 INFO:teuthology.orchestra.run.smithi117.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T05:53:36.114 INFO:teuthology.orchestra.run.smithi117.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T05:53:36.114 INFO:teuthology.orchestra.run.smithi117.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T05:53:36.114 INFO:teuthology.orchestra.run.smithi117.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T05:53:36.114 INFO:teuthology.orchestra.run.smithi117.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T05:53:36.114 INFO:teuthology.orchestra.run.smithi117.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T05:53:36.114 INFO:teuthology.orchestra.run.smithi117.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T05:53:36.114 INFO:teuthology.orchestra.run.smithi117.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T05:53:36.114 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T05:53:36.115 INFO:teuthology.orchestra.run.smithi117.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T05:53:36.115 INFO:teuthology.orchestra.run.smithi117.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T05:53:36.115 INFO:teuthology.orchestra.run.smithi117.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T05:53:36.115 INFO:teuthology.orchestra.run.smithi117.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T05:53:36.115 INFO:teuthology.orchestra.run.smithi117.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T05:53:36.115 INFO:teuthology.orchestra.run.smithi117.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T05:53:36.115 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T05:53:36.115 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T05:53:36.115 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T05:53:36.115 INFO:teuthology.orchestra.run.smithi117.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T05:53:36.115 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T05:53:36.115 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T05:53:36.115 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T05:53:36.116 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T05:53:36.116 INFO:teuthology.orchestra.run.smithi117.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T05:53:36.116 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T05:53:36.116 INFO:teuthology.orchestra.run.smithi117.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T05:53:36.116 INFO:teuthology.orchestra.run.smithi117.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T05:53:36.116 INFO:teuthology.orchestra.run.smithi117.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T05:53:36.116 INFO:teuthology.orchestra.run.smithi117.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T05:53:36.116 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T05:53:36.116 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T05:53:36.116 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T05:53:36.116 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T05:53:36.116 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T05:53:36.116 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T05:53:36.116 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T05:53:36.117 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T05:53:36.117 INFO:teuthology.orchestra.run.smithi117.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T05:53:36.117 INFO:teuthology.orchestra.run.smithi117.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T05:53:36.117 INFO:teuthology.orchestra.run.smithi117.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T05:53:36.117 INFO:teuthology.orchestra.run.smithi117.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T05:53:36.117 INFO:teuthology.orchestra.run.smithi117.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T05:53:36.117 INFO:teuthology.orchestra.run.smithi117.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T05:53:36.117 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T05:53:36.117 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T05:53:36.117 INFO:teuthology.orchestra.run.smithi117.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T05:53:36.117 INFO:teuthology.orchestra.run.smithi117.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T05:53:36.117 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T05:53:36.117 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T05:53:36.118 INFO:teuthology.orchestra.run.smithi117.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T05:53:36.118 INFO:teuthology.orchestra.run.smithi117.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T05:53:36.118 INFO:teuthology.orchestra.run.smithi117.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T05:53:36.118 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T05:53:36.118 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T05:53:36.118 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T05:53:36.118 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T05:53:36.118 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T05:53:36.118 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T05:53:36.118 INFO:teuthology.orchestra.run.smithi117.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T05:53:36.118 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T05:53:36.118 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T05:53:36.118 INFO:teuthology.orchestra.run.smithi117.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T05:53:36.118 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T05:53:36.119 INFO:teuthology.orchestra.run.smithi117.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T05:53:36.119 INFO:teuthology.orchestra.run.smithi117.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T05:53:36.119 INFO:teuthology.orchestra.run.smithi117.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T05:53:36.119 INFO:teuthology.orchestra.run.smithi117.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T05:53:36.119 INFO:teuthology.orchestra.run.smithi117.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T05:53:36.119 INFO:teuthology.orchestra.run.smithi117.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T05:53:36.119 INFO:teuthology.orchestra.run.smithi117.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T05:53:36.119 INFO:teuthology.orchestra.run.smithi117.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T05:53:36.119 INFO:teuthology.orchestra.run.smithi117.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T05:53:36.119 INFO:teuthology.orchestra.run.smithi117.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T05:53:36.119 INFO:teuthology.orchestra.run.smithi117.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T05:53:36.119 INFO:teuthology.orchestra.run.smithi117.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T05:53:36.119 INFO:teuthology.orchestra.run.smithi117.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T05:53:36.119 INFO:teuthology.orchestra.run.smithi117.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T05:53:36.120 INFO:teuthology.orchestra.run.smithi117.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T05:53:36.120 INFO:teuthology.orchestra.run.smithi117.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T05:53:36.120 INFO:teuthology.orchestra.run.smithi117.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T05:53:36.120 INFO:teuthology.orchestra.run.smithi117.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T05:53:36.120 INFO:teuthology.orchestra.run.smithi117.stdout:Installing weak dependencies: 2024-09-19T05:53:36.120 INFO:teuthology.orchestra.run.smithi117.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T05:53:36.120 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T05:53:36.120 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-09-19T05:53:36.120 INFO:teuthology.orchestra.run.smithi117.stdout:====================================================================================== 2024-09-19T05:53:36.120 INFO:teuthology.orchestra.run.smithi117.stdout:Install 148 Packages 2024-09-19T05:53:36.120 INFO:teuthology.orchestra.run.smithi117.stdout:Upgrade 8 Packages 2024-09-19T05:53:36.121 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T05:53:36.121 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 226 M 2024-09-19T05:53:36.122 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-09-19T05:53:36.126 INFO:teuthology.orchestra.run.smithi099.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-19T05:53:36.152 INFO:teuthology.orchestra.run.smithi099.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-19T05:53:36.239 INFO:teuthology.orchestra.run.smithi037.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 1.3 MB/s | 896 kB 00:00 2024-09-19T05:53:36.340 INFO:teuthology.orchestra.run.smithi037.stdout:(3/156): ceph-immutable-object-cache-19.1.1-361 1.4 MB/s | 145 kB 00:00 2024-09-19T05:53:36.932 INFO:teuthology.orchestra.run.smithi117.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 22 kB/s | 6.6 kB 00:00 2024-09-19T05:53:37.002 INFO:teuthology.orchestra.run.smithi099.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 787 kB/s | 689 kB 00:00 2024-09-19T05:53:37.044 INFO:teuthology.orchestra.run.smithi099.stdout:(49/156): bison-3.7.4-5.el9.x86_64.rpm 1.0 MB/s | 943 kB 00:00 2024-09-19T05:53:37.215 INFO:teuthology.orchestra.run.smithi037.stdout:(4/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 2.7 MB/s | 2.4 MB 00:00 2024-09-19T05:53:37.298 INFO:teuthology.orchestra.run.smithi037.stdout:(5/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 2.6 MB/s | 5.4 MB 00:02 2024-09-19T05:53:37.765 INFO:teuthology.orchestra.run.smithi037.stdout:(6/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 2.8 MB/s | 1.5 MB 00:00 2024-09-19T05:53:37.961 INFO:teuthology.orchestra.run.smithi099.stdout:(50/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 11 MB/s | 49 MB 00:04 2024-09-19T05:53:37.986 INFO:teuthology.orchestra.run.smithi099.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 23 kB/s | 22 kB 00:00 2024-09-19T05:53:38.003 INFO:teuthology.orchestra.run.smithi099.stdout:(52/156): boost-program-options-1.75.0-8.el9.x8 107 kB/s | 107 kB 00:01 2024-09-19T05:53:38.074 INFO:teuthology.orchestra.run.smithi117.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 785 kB/s | 896 kB 00:01 2024-09-19T05:53:38.149 INFO:teuthology.orchestra.run.smithi117.stdout:(3/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 3.6 MB/s | 5.4 MB 00:01 2024-09-19T05:53:38.175 INFO:teuthology.orchestra.run.smithi117.stdout:(4/156): ceph-immutable-object-cache-19.1.1-361 1.4 MB/s | 145 kB 00:00 2024-09-19T05:53:38.400 INFO:teuthology.orchestra.run.smithi117.stdout:(5/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 6.8 MB/s | 1.5 MB 00:00 2024-09-19T05:53:38.483 INFO:teuthology.orchestra.run.smithi117.stdout:(6/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 7.2 MB/s | 2.4 MB 00:00 2024-09-19T05:53:38.586 INFO:teuthology.orchestra.run.smithi099.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 54 kB/s | 33 kB 00:00 2024-09-19T05:53:38.782 INFO:teuthology.orchestra.run.smithi037.stdout:(7/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 3.2 MB/s | 4.7 MB 00:01 2024-09-19T05:53:38.811 INFO:teuthology.orchestra.run.smithi099.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 369 kB/s | 313 kB 00:00 2024-09-19T05:53:39.054 INFO:teuthology.orchestra.run.smithi099.stdout:(55/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.8 MB/s | 3.0 MB 00:01 2024-09-19T05:53:39.179 INFO:teuthology.orchestra.run.smithi099.stdout:(56/156): flexiblas-openblas-openmp-3.0.4-8.el9 31 kB/s | 18 kB 00:00 2024-09-19T05:53:39.320 INFO:teuthology.orchestra.run.smithi099.stdout:(57/156): libaio-devel-0.3.111-13.el9.x86_64.rp 22 kB/s | 11 kB 00:00 2024-09-19T05:53:39.334 INFO:teuthology.orchestra.run.smithi117.stdout:(7/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 5.0 MB/s | 4.7 MB 00:00 2024-09-19T05:53:39.763 INFO:teuthology.orchestra.run.smithi099.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 78 kB/s | 45 kB 00:00 2024-09-19T05:53:39.787 INFO:teuthology.orchestra.run.smithi099.stdout:(59/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 221 kB/s | 160 kB 00:00 2024-09-19T05:53:40.204 INFO:teuthology.orchestra.run.smithi099.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 750 kB/s | 662 kB 00:00 2024-09-19T05:53:40.299 INFO:teuthology.orchestra.run.smithi037.stdout:(8/156): ceph-common-19.1.1-361.g2f599a46.el9.x 4.2 MB/s | 21 MB 00:05 2024-09-19T05:53:40.346 INFO:teuthology.orchestra.run.smithi099.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 44 kB/s | 24 kB 00:00 2024-09-19T05:53:40.357 INFO:teuthology.orchestra.run.smithi037.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 432 kB/s | 25 kB 00:00 2024-09-19T05:53:40.622 INFO:teuthology.orchestra.run.smithi099.stdout:(62/156): libtool-2.4.6-46.el9.x86_64.rpm 676 kB/s | 581 kB 00:00 2024-09-19T05:53:40.780 INFO:teuthology.orchestra.run.smithi099.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 82 kB/s | 47 kB 00:00 2024-09-19T05:53:40.800 INFO:teuthology.orchestra.run.smithi117.stdout:(8/156): ceph-common-19.1.1-361.g2f599a46.el9.x 5.1 MB/s | 21 MB 00:04 2024-09-19T05:53:40.917 INFO:teuthology.orchestra.run.smithi117.stdout:(9/156): ceph-radosgw-19.1.1-361.g2f599a46.el9. 6.7 MB/s | 11 MB 00:01 2024-09-19T05:53:40.943 INFO:teuthology.orchestra.run.smithi117.stdout:(10/156): ceph-selinux-19.1.1-361.g2f599a46.el9 177 kB/s | 25 kB 00:00 2024-09-19T05:53:41.101 INFO:teuthology.orchestra.run.smithi117.stdout:(11/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 6.4 MB/s | 17 MB 00:02 2024-09-19T05:53:41.127 INFO:teuthology.orchestra.run.smithi117.stdout:(12/156): cephfs-mirror-19.1.1-361.g2f599a46.el 1.2 MB/s | 228 kB 00:00 2024-09-19T05:53:41.160 INFO:teuthology.orchestra.run.smithi117.stdout:(13/156): cephfs-shell-19.1.1-361.g2f599a46.el9 463 kB/s | 27 kB 00:00 2024-09-19T05:53:41.177 INFO:teuthology.orchestra.run.smithi117.stdout:(14/156): libcephfs-devel-19.1.1-361.g2f599a46. 632 kB/s | 32 kB 00:00 2024-09-19T05:53:41.197 INFO:teuthology.orchestra.run.smithi099.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 344 kB/s | 292 kB 00:00 2024-09-19T05:53:41.227 INFO:teuthology.orchestra.run.smithi117.stdout:(15/156): libcephsqlite-19.1.1-361.g2f599a46.el 3.2 MB/s | 163 kB 00:00 2024-09-19T05:53:41.286 INFO:teuthology.orchestra.run.smithi117.stdout:(16/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 5.9 MB/s | 751 kB 00:00 2024-09-19T05:53:41.311 INFO:teuthology.orchestra.run.smithi117.stdout:(17/156): librados-devel-19.1.1-361.g2f599a46.e 1.5 MB/s | 127 kB 00:00 2024-09-19T05:53:41.364 INFO:teuthology.orchestra.run.smithi099.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 254 kB/s | 188 kB 00:00 2024-09-19T05:53:41.386 INFO:teuthology.orchestra.run.smithi117.stdout:(18/156): libradosstriper1-19.1.1-361.g2f599a46 4.9 MB/s | 506 kB 00:00 2024-09-19T05:53:41.391 INFO:teuthology.orchestra.run.smithi037.stdout:(10/156): ceph-radosgw-19.1.1-361.g2f599a46.el9 4.1 MB/s | 11 MB 00:02 2024-09-19T05:53:41.406 INFO:teuthology.orchestra.run.smithi099.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 62 kB/s | 38 kB 00:00 2024-09-19T05:53:41.445 INFO:teuthology.orchestra.run.smithi117.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 772 kB/s | 45 kB 00:00 2024-09-19T05:53:41.504 INFO:teuthology.orchestra.run.smithi117.stdout:(20/156): python3-ceph-common-19.1.1-361.g2f599 2.3 MB/s | 136 kB 00:00 2024-09-19T05:53:41.558 INFO:teuthology.orchestra.run.smithi037.stdout:(11/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 4.4 MB/s | 17 MB 00:03 2024-09-19T05:53:41.570 INFO:teuthology.orchestra.run.smithi117.stdout:(21/156): python3-cephfs-19.1.1-361.g2f599a46.e 2.4 MB/s | 161 kB 00:00 2024-09-19T05:53:41.583 INFO:teuthology.orchestra.run.smithi037.stdout:(12/156): cephfs-mirror-19.1.1-361.g2f599a46.el 1.2 MB/s | 228 kB 00:00 2024-09-19T05:53:41.608 INFO:teuthology.orchestra.run.smithi037.stdout:(13/156): cephfs-shell-19.1.1-361.g2f599a46.el9 542 kB/s | 27 kB 00:00 2024-09-19T05:53:41.637 INFO:teuthology.orchestra.run.smithi117.stdout:(22/156): python3-rados-19.1.1-361.g2f599a46.el 4.7 MB/s | 320 kB 00:00 2024-09-19T05:53:41.642 INFO:teuthology.orchestra.run.smithi037.stdout:(14/156): libcephfs-devel-19.1.1-361.g2f599a46. 542 kB/s | 32 kB 00:00 2024-09-19T05:53:41.709 INFO:teuthology.orchestra.run.smithi037.stdout:(15/156): libcephsqlite-19.1.1-361.g2f599a46.el 2.4 MB/s | 163 kB 00:00 2024-09-19T05:53:41.712 INFO:teuthology.orchestra.run.smithi117.stdout:(23/156): python3-rbd-19.1.1-361.g2f599a46.el9. 3.9 MB/s | 300 kB 00:00 2024-09-19T05:53:41.759 INFO:teuthology.orchestra.run.smithi037.stdout:(16/156): librados-devel-19.1.1-361.g2f599a46.e 2.5 MB/s | 127 kB 00:00 2024-09-19T05:53:41.788 INFO:teuthology.orchestra.run.smithi117.stdout:(24/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.3 MB/s | 99 kB 00:00 2024-09-19T05:53:41.809 INFO:teuthology.orchestra.run.smithi037.stdout:(17/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 3.7 MB/s | 751 kB 00:00 2024-09-19T05:53:41.876 INFO:teuthology.orchestra.run.smithi117.stdout:(25/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 976 kB/s | 85 kB 00:00 2024-09-19T05:53:41.926 INFO:teuthology.orchestra.run.smithi037.stdout:(18/156): libradosstriper1-19.1.1-361.g2f599a46 3.0 MB/s | 506 kB 00:00 2024-09-19T05:53:41.977 INFO:teuthology.orchestra.run.smithi037.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 907 kB/s | 45 kB 00:00 2024-09-19T05:53:41.997 INFO:teuthology.orchestra.run.smithi117.stdout:(26/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 7.8 MB/s | 5.3 MB 00:00 2024-09-19T05:53:42.044 INFO:teuthology.orchestra.run.smithi037.stdout:(20/156): python3-ceph-common-19.1.1-361.g2f599 2.0 MB/s | 136 kB 00:00 2024-09-19T05:53:42.072 INFO:teuthology.orchestra.run.smithi117.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 2.2 MB/s | 171 kB 00:00 2024-09-19T05:53:42.119 INFO:teuthology.orchestra.run.smithi037.stdout:(21/156): python3-cephfs-19.1.1-361.g2f599a46.e 2.1 MB/s | 161 kB 00:00 2024-09-19T05:53:42.139 INFO:teuthology.orchestra.run.smithi117.stdout:(28/156): ceph-grafana-dashboards-19.1.1-361.g2 478 kB/s | 32 kB 00:00 2024-09-19T05:53:42.206 INFO:teuthology.orchestra.run.smithi117.stdout:(29/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 2.1 MB/s | 146 kB 00:00 2024-09-19T05:53:42.236 INFO:teuthology.orchestra.run.smithi037.stdout:(22/156): python3-rados-19.1.1-361.g2f599a46.el 2.7 MB/s | 320 kB 00:00 2024-09-19T05:53:42.369 INFO:teuthology.orchestra.run.smithi037.stdout:(23/156): python3-rbd-19.1.1-361.g2f599a46.el9. 2.2 MB/s | 300 kB 00:00 2024-09-19T05:53:42.398 INFO:teuthology.orchestra.run.smithi117.stdout:(30/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 5.9 MB/s | 3.1 MB 00:00 2024-09-19T05:53:42.428 INFO:teuthology.orchestra.run.smithi037.stdout:(24/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.7 MB/s | 99 kB 00:00 2024-09-19T05:53:42.431 INFO:teuthology.orchestra.run.smithi099.stdout:(67/156): openblas-openmp-0.3.26-2.el9.x86_64.r 4.0 MB/s | 4.9 MB 00:01 2024-09-19T05:53:42.473 INFO:teuthology.orchestra.run.smithi099.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 1.5 MB/s | 1.6 MB 00:01 2024-09-19T05:53:42.486 INFO:teuthology.orchestra.run.smithi037.stdout:(25/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.4 MB/s | 85 kB 00:00 2024-09-19T05:53:42.548 INFO:teuthology.orchestra.run.smithi099.stdout:(69/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 3.7 MB/s | 4.4 MB 00:01 2024-09-19T05:53:42.715 INFO:teuthology.orchestra.run.smithi117.stdout:(31/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 7.0 MB/s | 3.6 MB 00:00 2024-09-19T05:53:42.840 INFO:teuthology.orchestra.run.smithi117.stdout:(32/156): ceph-mgr-modules-core-19.1.1-361.g2f5 2.0 MB/s | 249 kB 00:00 2024-09-19T05:53:42.907 INFO:teuthology.orchestra.run.smithi117.stdout:(33/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 743 kB/s | 49 kB 00:00 2024-09-19T05:53:42.966 INFO:teuthology.orchestra.run.smithi117.stdout:(34/156): ceph-prometheus-alerts-19.1.1-361.g2f 281 kB/s | 16 kB 00:00 2024-09-19T05:53:42.970 INFO:teuthology.orchestra.run.smithi037.stdout:(26/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 4.6 MB/s | 5.3 MB 00:01 2024-09-19T05:53:43.033 INFO:teuthology.orchestra.run.smithi117.stdout:(35/156): ceph-volume-19.1.1-361.g2f599a46.el9. 4.2 MB/s | 285 kB 00:00 2024-09-19T05:53:43.037 INFO:teuthology.orchestra.run.smithi037.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 2.5 MB/s | 171 kB 00:00 2024-09-19T05:53:43.104 INFO:teuthology.orchestra.run.smithi037.stdout:(28/156): ceph-grafana-dashboards-19.1.1-361.g2 478 kB/s | 32 kB 00:00 2024-09-19T05:53:43.141 INFO:teuthology.orchestra.run.smithi117.stdout:(36/156): cephadm-19.1.1-361.g2f599a46.el9.noar 6.9 MB/s | 765 kB 00:00 2024-09-19T05:53:43.171 INFO:teuthology.orchestra.run.smithi037.stdout:(29/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 2.1 MB/s | 146 kB 00:00 2024-09-19T05:53:43.173 INFO:teuthology.orchestra.run.smithi099.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 196 kB/s | 137 kB 00:00 2024-09-19T05:53:43.208 INFO:teuthology.orchestra.run.smithi117.stdout:(37/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 274 kB/s | 18 kB 00:00 2024-09-19T05:53:43.238 INFO:teuthology.orchestra.run.smithi037.stdout:(30/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 4.1 MB/s | 3.1 MB 00:00 2024-09-19T05:53:43.309 INFO:teuthology.orchestra.run.smithi117.stdout:(38/156): fuse-2.9.9-16.el9.x86_64.rpm 797 kB/s | 80 kB 00:00 2024-09-19T05:53:43.373 INFO:teuthology.orchestra.run.smithi099.stdout:(71/156): postgresql-contrib-13.16-1.el9.x86_64 966 kB/s | 910 kB 00:00 2024-09-19T05:53:43.432 INFO:teuthology.orchestra.run.smithi117.stdout:(39/156): ceph-mgr-diskprediction-local-19.1.1- 7.2 MB/s | 7.4 MB 00:01 2024-09-19T05:53:43.535 INFO:teuthology.orchestra.run.smithi117.stdout:(40/156): libgfortran-11.5.0-2.el9.x86_64.rpm 3.5 MB/s | 801 kB 00:00 2024-09-19T05:53:43.560 INFO:teuthology.orchestra.run.smithi117.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.5 MB/s | 191 kB 00:00 2024-09-19T05:53:43.636 INFO:teuthology.orchestra.run.smithi117.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.5 MB/s | 253 kB 00:00 2024-09-19T05:53:43.686 INFO:teuthology.orchestra.run.smithi117.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-19T05:53:43.730 INFO:teuthology.orchestra.run.smithi037.stdout:(31/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 6.4 MB/s | 3.6 MB 00:00 2024-09-19T05:53:43.740 INFO:teuthology.orchestra.run.smithi099.stdout:(72/156): postgresql-server-13.16-1.el9.x86_64. 4.8 MB/s | 5.8 MB 00:01 2024-09-19T05:53:43.761 INFO:teuthology.orchestra.run.smithi117.stdout:(44/156): python3-cryptography-36.0.1-4.el9.x86 6.1 MB/s | 1.2 MB 00:00 2024-09-19T05:53:43.778 INFO:teuthology.orchestra.run.smithi117.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 1.4 MB/s | 135 kB 00:00 2024-09-19T05:53:43.805 INFO:teuthology.orchestra.run.smithi037.stdout:(32/156): ceph-mgr-modules-core-19.1.1-361.g2f5 3.3 MB/s | 249 kB 00:00 2024-09-19T05:53:43.820 INFO:teuthology.orchestra.run.smithi117.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-09-19T05:53:43.863 INFO:teuthology.orchestra.run.smithi037.stdout:(33/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 851 kB/s | 49 kB 00:00 2024-09-19T05:53:43.887 INFO:teuthology.orchestra.run.smithi117.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 1.9 MB/s | 215 kB 00:00 2024-09-19T05:53:43.922 INFO:teuthology.orchestra.run.smithi037.stdout:(34/156): ceph-prometheus-alerts-19.1.1-361.g2f 281 kB/s | 16 kB 00:00 2024-09-19T05:53:44.013 INFO:teuthology.orchestra.run.smithi117.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 3.5 MB/s | 689 kB 00:00 2024-09-19T05:53:44.022 INFO:teuthology.orchestra.run.smithi037.stdout:(35/156): ceph-volume-19.1.1-361.g2f599a46.el9. 2.8 MB/s | 285 kB 00:00 2024-09-19T05:53:44.063 INFO:teuthology.orchestra.run.smithi117.stdout:(49/156): bison-3.7.4-5.el9.x86_64.rpm 5.3 MB/s | 943 kB 00:00 2024-09-19T05:53:44.088 INFO:teuthology.orchestra.run.smithi117.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 1.4 MB/s | 107 kB 00:00 2024-09-19T05:53:44.099 INFO:teuthology.orchestra.run.smithi099.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 121 kB/s | 87 kB 00:00 2024-09-19T05:53:44.122 INFO:teuthology.orchestra.run.smithi117.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 371 kB/s | 22 kB 00:00 2024-09-19T05:53:44.132 INFO:teuthology.orchestra.run.smithi099.stdout:(74/156): protobuf-3.14.0-13.el9.x86_64.rpm 1.1 MB/s | 1.0 MB 00:00 2024-09-19T05:53:44.155 INFO:teuthology.orchestra.run.smithi117.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 4.6 MB/s | 313 kB 00:00 2024-09-19T05:53:44.189 INFO:teuthology.orchestra.run.smithi117.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 489 kB/s | 33 kB 00:00 2024-09-19T05:53:44.206 INFO:teuthology.orchestra.run.smithi037.stdout:(36/156): cephadm-19.1.1-361.g2f599a46.el9.noar 4.1 MB/s | 765 kB 00:00 2024-09-19T05:53:44.264 INFO:teuthology.orchestra.run.smithi037.stdout:(37/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 313 kB/s | 18 kB 00:00 2024-09-19T05:53:44.289 INFO:teuthology.orchestra.run.smithi117.stdout:(54/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 22 MB/s | 3.0 MB 00:00 2024-09-19T05:53:44.315 INFO:teuthology.orchestra.run.smithi117.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 145 kB/s | 18 kB 00:00 2024-09-19T05:53:44.365 INFO:teuthology.orchestra.run.smithi117.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 148 kB/s | 11 kB 00:00 2024-09-19T05:53:44.382 INFO:teuthology.orchestra.run.smithi117.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.3 MB/s | 160 kB 00:00 2024-09-19T05:53:44.406 INFO:teuthology.orchestra.run.smithi037.stdout:(38/156): fuse-2.9.9-16.el9.x86_64.rpm 563 kB/s | 80 kB 00:00 2024-09-19T05:53:44.440 INFO:teuthology.orchestra.run.smithi117.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 602 kB/s | 45 kB 00:00 2024-09-19T05:53:44.482 INFO:teuthology.orchestra.run.smithi117.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 6.5 MB/s | 662 kB 00:00 2024-09-19T05:53:44.515 INFO:teuthology.orchestra.run.smithi037.stdout:(39/156): ceph-mgr-diskprediction-local-19.1.1- 5.8 MB/s | 7.4 MB 00:01 2024-09-19T05:53:44.516 INFO:teuthology.orchestra.run.smithi117.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 7.6 MB/s | 581 kB 00:00 2024-09-19T05:53:44.550 INFO:teuthology.orchestra.run.smithi117.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 366 kB/s | 24 kB 00:00 2024-09-19T05:53:44.583 INFO:teuthology.orchestra.run.smithi117.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 709 kB/s | 47 kB 00:00 2024-09-19T05:53:44.617 INFO:teuthology.orchestra.run.smithi117.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.3 MB/s | 292 kB 00:00 2024-09-19T05:53:44.624 INFO:teuthology.orchestra.run.smithi037.stdout:(40/156): libgfortran-11.5.0-2.el9.x86_64.rpm 3.6 MB/s | 801 kB 00:00 2024-09-19T05:53:44.659 INFO:teuthology.orchestra.run.smithi117.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 2.4 MB/s | 188 kB 00:00 2024-09-19T05:53:44.674 INFO:teuthology.orchestra.run.smithi037.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.0 MB/s | 253 kB 00:00 2024-09-19T05:53:44.692 INFO:teuthology.orchestra.run.smithi117.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 511 kB/s | 38 kB 00:00 2024-09-19T05:53:44.700 INFO:teuthology.orchestra.run.smithi037.stdout:(42/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.0 MB/s | 191 kB 00:00 2024-09-19T05:53:44.716 INFO:teuthology.orchestra.run.smithi099.stdout:(75/156): python3-colorama-0.4.6-3.el9.noarch.r 99 kB/s | 61 kB 00:00 2024-09-19T05:53:44.758 INFO:teuthology.orchestra.run.smithi037.stdout:(43/156): python3-cryptography-36.0.1-4.el9.x86 15 MB/s | 1.2 MB 00:00 2024-09-19T05:53:44.784 INFO:teuthology.orchestra.run.smithi037.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 106 kB 00:00 2024-09-19T05:53:44.801 INFO:teuthology.orchestra.run.smithi117.stdout:(66/156): openblas-openmp-0.3.26-2.el9.x86_64.r 35 MB/s | 4.9 MB 00:00 2024-09-19T05:53:44.809 INFO:teuthology.orchestra.run.smithi037.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-19T05:53:44.842 INFO:teuthology.orchestra.run.smithi037.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-09-19T05:53:44.868 INFO:teuthology.orchestra.run.smithi037.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-09-19T05:53:44.891 INFO:teuthology.orchestra.run.smithi099.stdout:(76/156): python3-babel-2.9.1-2.el9.noarch.rpm 5.2 MB/s | 6.0 MB 00:01 2024-09-19T05:53:44.896 INFO:teuthology.orchestra.run.smithi117.stdout:(67/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 22 MB/s | 4.4 MB 00:00 2024-09-19T05:53:44.916 INFO:teuthology.orchestra.run.smithi099.stdout:(77/156): python3-devel-3.9.19-8.el9.x86_64.rpm 312 kB/s | 245 kB 00:00 2024-09-19T05:53:44.960 INFO:teuthology.orchestra.run.smithi117.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 10 MB/s | 1.6 MB 00:00 2024-09-19T05:53:44.994 INFO:teuthology.orchestra.run.smithi117.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 8.9 MB/s | 910 kB 00:00 2024-09-19T05:53:45.035 INFO:teuthology.orchestra.run.smithi117.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 1.8 MB/s | 137 kB 00:00 2024-09-19T05:53:45.128 INFO:teuthology.orchestra.run.smithi117.stdout:(71/156): postgresql-server-13.16-1.el9.x86_64. 43 MB/s | 5.8 MB 00:00 2024-09-19T05:53:45.161 INFO:teuthology.orchestra.run.smithi117.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 8.1 MB/s | 1.0 MB 00:00 2024-09-19T05:53:45.195 INFO:teuthology.orchestra.run.smithi117.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-19T05:53:45.295 INFO:teuthology.orchestra.run.smithi117.stdout:(74/156): python3-babel-2.9.1-2.el9.noarch.rpm 45 MB/s | 6.0 MB 00:00 2024-09-19T05:53:45.320 INFO:teuthology.orchestra.run.smithi117.stdout:(75/156): python3-colorama-0.4.6-3.el9.noarch.r 489 kB/s | 61 kB 00:00 2024-09-19T05:53:45.379 INFO:teuthology.orchestra.run.smithi117.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.9 MB/s | 245 kB 00:00 2024-09-19T05:53:45.404 INFO:teuthology.orchestra.run.smithi117.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 2.9 MB/s | 248 kB 00:00 2024-09-19T05:53:45.438 INFO:teuthology.orchestra.run.smithi117.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 438 kB/s | 26 kB 00:00 2024-09-19T05:53:45.442 INFO:teuthology.orchestra.run.smithi099.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 36 kB/s | 19 kB 00:00 2024-09-19T05:53:45.463 INFO:teuthology.orchestra.run.smithi117.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 326 kB/s | 19 kB 00:00 2024-09-19T05:53:45.475 INFO:teuthology.orchestra.run.smithi099.stdout:(79/156): python3-jsonpatch-1.21-16.el9.noarch. 44 kB/s | 26 kB 00:00 2024-09-19T05:53:45.497 INFO:teuthology.orchestra.run.smithi117.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-19T05:53:45.501 INFO:teuthology.orchestra.run.smithi099.stdout:(80/156): python3-jinja2-2.11.3-6.el9.noarch.rp 317 kB/s | 248 kB 00:00 2024-09-19T05:53:45.522 INFO:teuthology.orchestra.run.smithi117.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 594 kB/s | 35 kB 00:00 2024-09-19T05:53:45.581 INFO:teuthology.orchestra.run.smithi117.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 250 kB 00:00 2024-09-19T05:53:45.648 INFO:teuthology.orchestra.run.smithi117.stdout:(83/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 34 MB/s | 5.1 MB 00:00 2024-09-19T05:53:45.673 INFO:teuthology.orchestra.run.smithi117.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.4 MB/s | 222 kB 00:00 2024-09-19T05:53:45.715 INFO:teuthology.orchestra.run.smithi117.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.1 MB/s | 77 kB 00:00 2024-09-19T05:53:45.749 INFO:teuthology.orchestra.run.smithi117.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 561 kB/s | 42 kB 00:00 2024-09-19T05:53:45.774 INFO:teuthology.orchestra.run.smithi117.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 4.5 MB/s | 269 kB 00:00 2024-09-19T05:53:46.026 INFO:teuthology.orchestra.run.smithi099.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 63 kB/s | 35 kB 00:00 2024-09-19T05:53:46.151 INFO:teuthology.orchestra.run.smithi037.stdout:(48/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 8.4 MB/s | 49 MB 00:05 2024-09-19T05:53:46.167 INFO:teuthology.orchestra.run.smithi099.stdout:(82/156): python3-mako-1.1.4-6.el9.noarch.rpm 237 kB/s | 172 kB 00:00 2024-09-19T05:53:46.185 INFO:teuthology.orchestra.run.smithi037.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 513 kB/s | 689 kB 00:01 2024-09-19T05:53:46.191 INFO:teuthology.orchestra.run.smithi117.stdout:(88/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 9.2 MB/s | 49 MB 00:05 2024-09-19T05:53:46.216 INFO:teuthology.orchestra.run.smithi117.stdout:(89/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 340 kB/s | 159 kB 00:00 2024-09-19T05:53:46.241 INFO:teuthology.orchestra.run.smithi117.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 597 kB/s | 279 kB 00:00 2024-09-19T05:53:46.283 INFO:teuthology.orchestra.run.smithi117.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 802 kB/s | 54 kB 00:00 2024-09-19T05:53:46.285 INFO:teuthology.orchestra.run.smithi037.stdout:(50/156): bison-3.7.4-5.el9.x86_64.rpm 665 kB/s | 943 kB 00:01 2024-09-19T05:53:46.308 INFO:teuthology.orchestra.run.smithi117.stdout:(92/156): python3-pytz-2021.1-5.el9.noarch.rpm 436 kB/s | 51 kB 00:00 2024-09-19T05:53:46.342 INFO:teuthology.orchestra.run.smithi117.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 712 kB/s | 42 kB 00:00 2024-09-19T05:53:46.375 INFO:teuthology.orchestra.run.smithi117.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 660 kB/s | 44 kB 00:00 2024-09-19T05:53:46.409 INFO:teuthology.orchestra.run.smithi117.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-09-19T05:53:46.451 INFO:teuthology.orchestra.run.smithi117.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 477 kB/s | 36 kB 00:00 2024-09-19T05:53:46.476 INFO:teuthology.orchestra.run.smithi117.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 710 kB/s | 47 kB 00:00 2024-09-19T05:53:46.609 INFO:teuthology.orchestra.run.smithi099.stdout:(83/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.6 MB/s | 5.1 MB 00:01 2024-09-19T05:53:46.660 INFO:teuthology.orchestra.run.smithi117.stdout:(98/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 39 MB/s | 16 MB 00:00 2024-09-19T05:53:46.685 INFO:teuthology.orchestra.run.smithi117.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 277 kB/s | 58 kB 00:00 2024-09-19T05:53:46.710 INFO:teuthology.orchestra.run.smithi117.stdout:(100/156): socat-1.7.4.1-6.el9.x86_64.rpm 1.1 MB/s | 304 kB 00:00 2024-09-19T05:53:46.727 INFO:teuthology.orchestra.run.smithi117.stdout:(101/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.4 MB/s | 96 kB 00:00 2024-09-19T05:53:46.743 INFO:teuthology.orchestra.run.smithi037.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 39 kB/s | 22 kB 00:00 2024-09-19T05:53:46.753 INFO:teuthology.orchestra.run.smithi117.stdout:(102/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 948 kB/s | 64 kB 00:00 2024-09-19T05:53:46.786 INFO:teuthology.orchestra.run.smithi117.stdout:(103/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 594 kB/s | 45 kB 00:00 2024-09-19T05:53:46.810 INFO:teuthology.orchestra.run.smithi037.stdout:(52/156): boost-program-options-1.75.0-8.el9.x8 162 kB/s | 107 kB 00:00 2024-09-19T05:53:46.837 INFO:teuthology.orchestra.run.smithi117.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-19T05:53:46.859 INFO:teuthology.orchestra.run.smithi099.stdout:(84/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 301 kB/s | 250 kB 00:00 2024-09-19T05:53:46.862 INFO:teuthology.orchestra.run.smithi117.stdout:(105/156): lua-devel-5.4.4-4.el9.x86_64.rpm 167 kB/s | 22 kB 00:00 2024-09-19T05:53:46.896 INFO:teuthology.orchestra.run.smithi117.stdout:(106/156): gperftools-libs-2.9.1-3.el9.x86_64.r 5.2 MB/s | 308 kB 00:00 2024-09-19T05:53:46.918 INFO:teuthology.orchestra.run.smithi099.stdout:(85/156): python3-oauthlib-3.1.1-5.el9.noarch.r 296 kB/s | 222 kB 00:00 2024-09-19T05:53:46.929 INFO:teuthology.orchestra.run.smithi117.stdout:(107/156): grpc-data-1.46.7-10.el9.noarch.rpm 290 kB/s | 19 kB 00:00 2024-09-19T05:53:46.963 INFO:teuthology.orchestra.run.smithi117.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 784 kB/s | 26 kB 00:00 2024-09-19T05:53:47.038 INFO:teuthology.orchestra.run.smithi117.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 647 kB/s | 49 kB 00:00 2024-09-19T05:53:47.055 INFO:teuthology.orchestra.run.smithi117.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 4.0 MB/s | 67 kB 00:00 2024-09-19T05:53:47.060 INFO:teuthology.orchestra.run.smithi037.stdout:(53/156): flex-2.6.4-9.el9.x86_64.rpm 404 kB/s | 313 kB 00:00 2024-09-19T05:53:47.089 INFO:teuthology.orchestra.run.smithi117.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 4.4 MB/s | 151 kB 00:00 2024-09-19T05:53:47.181 INFO:teuthology.orchestra.run.smithi117.stdout:(112/156): libarrow-9.0.0-11.el9.x86_64.rpm 16 MB/s | 4.4 MB 00:00 2024-09-19T05:53:47.206 INFO:teuthology.orchestra.run.smithi117.stdout:(113/156): protobuf-compiler-3.14.0-13.el9.x86_ 1.9 MB/s | 863 kB 00:00 2024-09-19T05:53:47.248 INFO:teuthology.orchestra.run.smithi117.stdout:(114/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 5.2 MB/s | 839 kB 00:00 2024-09-19T05:53:47.268 INFO:teuthology.orchestra.run.smithi099.stdout:(86/156): python3-packaging-20.9-5.el9.noarch.r 117 kB/s | 77 kB 00:00 2024-09-19T05:53:47.281 INFO:teuthology.orchestra.run.smithi117.stdout:(115/156): python3-asyncssh-2.13.2-5.el9.noarch 5.3 MB/s | 548 kB 00:00 2024-09-19T05:53:47.306 INFO:teuthology.orchestra.run.smithi117.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 567 kB/s | 32 kB 00:00 2024-09-19T05:53:47.319 INFO:teuthology.orchestra.run.smithi037.stdout:(54/156): flexiblas-3.0.4-8.el9.x86_64.rpm 57 kB/s | 33 kB 00:00 2024-09-19T05:53:47.340 INFO:teuthology.orchestra.run.smithi117.stdout:(117/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 324 kB/s | 43 kB 00:00 2024-09-19T05:53:47.368 INFO:teuthology.orchestra.run.smithi117.stdout:(118/156): python3-certifi-2023.05.07-4.el9.noa 169 kB/s | 14 kB 00:00 2024-09-19T05:53:47.391 INFO:teuthology.orchestra.run.smithi117.stdout:(119/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.0 MB/s | 172 kB 00:00 2024-09-19T05:53:47.416 INFO:teuthology.orchestra.run.smithi117.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-09-19T05:53:47.435 INFO:teuthology.orchestra.run.smithi099.stdout:(87/156): python3-prettytable-0.7.2-27.el9.noar 73 kB/s | 42 kB 00:00 2024-09-19T05:53:47.441 INFO:teuthology.orchestra.run.smithi117.stdout:(121/156): python3-cherrypy-18.6.1-2.el9.noarch 3.5 MB/s | 358 kB 00:00 2024-09-19T05:53:47.466 INFO:teuthology.orchestra.run.smithi117.stdout:(122/156): python3-google-auth-2.34.0-1.el9.noa 2.9 MB/s | 220 kB 00:00 2024-09-19T05:53:47.492 INFO:teuthology.orchestra.run.smithi117.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-09-19T05:53:47.517 INFO:teuthology.orchestra.run.smithi117.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 213 kB/s | 11 kB 00:00 2024-09-19T05:53:47.542 INFO:teuthology.orchestra.run.smithi117.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 354 kB/s | 18 kB 00:00 2024-09-19T05:53:47.544 INFO:teuthology.orchestra.run.smithi037.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 38 kB/s | 18 kB 00:00 2024-09-19T05:53:47.559 INFO:teuthology.orchestra.run.smithi117.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 555 kB/s | 23 kB 00:00 2024-09-19T05:53:47.576 INFO:teuthology.orchestra.run.smithi117.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 580 kB/s | 19 kB 00:00 2024-09-19T05:53:47.593 INFO:teuthology.orchestra.run.smithi117.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 587 kB/s | 20 kB 00:00 2024-09-19T05:53:47.619 INFO:teuthology.orchestra.run.smithi117.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-19T05:53:47.644 INFO:teuthology.orchestra.run.smithi117.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-19T05:53:47.670 INFO:teuthology.orchestra.run.smithi117.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-19T05:53:47.702 INFO:teuthology.orchestra.run.smithi099.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 344 kB/s | 269 kB 00:00 2024-09-19T05:53:47.703 INFO:teuthology.orchestra.run.smithi117.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 8.1 MB/s | 1.0 MB 00:00 2024-09-19T05:53:47.728 INFO:teuthology.orchestra.run.smithi117.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 659 kB/s | 16 kB 00:00 2024-09-19T05:53:47.753 INFO:teuthology.orchestra.run.smithi117.stdout:(134/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-19T05:53:47.780 INFO:teuthology.orchestra.run.smithi117.stdout:(135/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.4 MB/s | 272 kB 00:00 2024-09-19T05:53:47.803 INFO:teuthology.orchestra.run.smithi037.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 23 kB/s | 11 kB 00:00 2024-09-19T05:53:47.804 INFO:teuthology.orchestra.run.smithi117.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 562 kB/s | 28 kB 00:00 2024-09-19T05:53:47.829 INFO:teuthology.orchestra.run.smithi117.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 612 kB/s | 31 kB 00:00 2024-09-19T05:53:47.853 INFO:teuthology.orchestra.run.smithi037.stdout:(57/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.9 MB/s | 3.0 MB 00:01 2024-09-19T05:53:47.854 INFO:teuthology.orchestra.run.smithi117.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-19T05:53:47.880 INFO:teuthology.orchestra.run.smithi117.stdout:(139/156): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-09-19T05:53:47.905 INFO:teuthology.orchestra.run.smithi117.stdout:(140/156): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-09-19T05:53:47.930 INFO:teuthology.orchestra.run.smithi117.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-19T05:53:47.972 INFO:teuthology.orchestra.run.smithi117.stdout:(142/156): python3-grpcio-1.46.7-10.el9.x86_64. 3.7 MB/s | 2.0 MB 00:00 2024-09-19T05:53:47.977 INFO:teuthology.orchestra.run.smithi099.stdout:(89/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 224 kB/s | 159 kB 00:00 2024-09-19T05:53:47.997 INFO:teuthology.orchestra.run.smithi117.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.3 MB/s | 90 kB 00:00 2024-09-19T05:53:48.023 INFO:teuthology.orchestra.run.smithi117.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-09-19T05:53:48.048 INFO:teuthology.orchestra.run.smithi117.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-19T05:53:48.073 INFO:teuthology.orchestra.run.smithi117.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-19T05:53:48.098 INFO:teuthology.orchestra.run.smithi117.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-19T05:53:48.157 INFO:teuthology.orchestra.run.smithi117.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-19T05:53:48.319 INFO:teuthology.orchestra.run.smithi099.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 316 kB/s | 279 kB 00:00 2024-09-19T05:53:48.320 INFO:teuthology.orchestra.run.smithi037.stdout:(58/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 209 kB/s | 160 kB 00:00 2024-09-19T05:53:48.344 INFO:teuthology.orchestra.run.smithi099.stdout:(91/156): python3-pytz-2021.1-5.el9.noarch.rpm 79 kB/s | 51 kB 00:00 2024-09-19T05:53:48.399 INFO:teuthology.orchestra.run.smithi117.stdout:(149/156): librados2-19.1.1-361.g2f599a46.el9.x 11 MB/s | 3.4 MB 00:00 2024-09-19T05:53:48.448 INFO:teuthology.orchestra.run.smithi037.stdout:(59/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 70 kB/s | 45 kB 00:00 2024-09-19T05:53:48.466 INFO:teuthology.orchestra.run.smithi117.stdout:(150/156): librbd1-19.1.1-361.g2f599a46.el9.x86 8.6 MB/s | 3.2 MB 00:00 2024-09-19T05:53:48.583 INFO:teuthology.orchestra.run.smithi117.stdout:(151/156): NetworkManager-team-1.51.0-1.el9.x86 351 kB/s | 41 kB 00:00 2024-09-19T05:53:48.636 INFO:teuthology.orchestra.run.smithi099.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 81 kB/s | 54 kB 00:00 2024-09-19T05:53:48.675 INFO:teuthology.orchestra.run.smithi117.stdout:(152/156): NetworkManager-tui-1.51.0-1.el9.x86_ 2.7 MB/s | 249 kB 00:00 2024-09-19T05:53:48.771 INFO:teuthology.orchestra.run.smithi037.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 722 kB/s | 662 kB 00:00 2024-09-19T05:53:48.825 INFO:teuthology.orchestra.run.smithi117.stdout:(153/156): NetworkManager-1.51.0-1.el9.x86_64.r 3.5 MB/s | 2.3 MB 00:00 2024-09-19T05:53:48.953 INFO:teuthology.orchestra.run.smithi099.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 68 kB/s | 42 kB 00:00 2024-09-19T05:53:48.958 INFO:teuthology.orchestra.run.smithi117.stdout:(154/156): NetworkManager-libnm-1.51.0-1.el9.x8 3.2 MB/s | 1.8 MB 00:00 2024-09-19T05:53:49.001 INFO:teuthology.orchestra.run.smithi117.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 4.2 MB/s | 1.4 MB 00:00 2024-09-19T05:53:49.030 INFO:teuthology.orchestra.run.smithi037.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 42 kB/s | 24 kB 00:00 2024-09-19T05:53:49.237 INFO:teuthology.orchestra.run.smithi099.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 74 kB/s | 44 kB 00:00 2024-09-19T05:53:49.246 INFO:teuthology.orchestra.run.smithi037.stdout:(62/156): libtool-2.4.6-46.el9.x86_64.rpm 628 kB/s | 581 kB 00:00 2024-09-19T05:53:49.355 INFO:teuthology.orchestra.run.smithi037.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 81 kB/s | 47 kB 00:00 2024-09-19T05:53:49.534 INFO:teuthology.orchestra.run.smithi117.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 3.4 MB/s | 2.4 MB 00:00 2024-09-19T05:53:49.540 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-09-19T05:53:49.541 INFO:teuthology.orchestra.run.smithi117.stdout:Total 17 MB/s | 226 MB 00:13 2024-09-19T05:53:49.787 INFO:teuthology.orchestra.run.smithi099.stdout:(95/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-09-19T05:53:49.812 INFO:teuthology.orchestra.run.smithi099.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 62 kB/s | 36 kB 00:00 2024-09-19T05:53:49.837 INFO:teuthology.orchestra.run.smithi099.stdout:(97/156): qatlib-24.02.0-1.el9.x86_64.rpm 250 kB/s | 221 kB 00:00 2024-09-19T05:53:49.897 INFO:teuthology.orchestra.run.smithi037.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 337 kB/s | 292 kB 00:00 2024-09-19T05:53:49.939 INFO:teuthology.orchestra.run.smithi037.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 66 kB/s | 38 kB 00:00 2024-09-19T05:53:50.072 INFO:teuthology.orchestra.run.smithi037.stdout:(66/156): lua-5.4.4-4.el9.x86_64.rpm 228 kB/s | 188 kB 00:00 2024-09-19T05:53:50.379 INFO:teuthology.orchestra.run.smithi099.stdout:(98/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 80 kB/s | 47 kB 00:00 2024-09-19T05:53:50.438 INFO:teuthology.orchestra.run.smithi099.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 96 kB/s | 58 kB 00:00 2024-09-19T05:53:50.671 INFO:teuthology.orchestra.run.smithi099.stdout:(100/156): socat-1.7.4.1-6.el9.x86_64.rpm 355 kB/s | 304 kB 00:00 2024-09-19T05:53:50.779 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-09-19T05:53:50.931 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-09-19T05:53:50.931 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-09-19T05:53:51.006 INFO:teuthology.orchestra.run.smithi037.stdout:(67/156): openblas-openmp-0.3.26-2.el9.x86_64.r 4.5 MB/s | 4.9 MB 00:01 2024-09-19T05:53:51.030 INFO:teuthology.orchestra.run.smithi099.stdout:(101/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 147 kB/s | 96 kB 00:00 2024-09-19T05:53:51.048 INFO:teuthology.orchestra.run.smithi037.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 1.6 MB/s | 1.6 MB 00:00 2024-09-19T05:53:51.072 INFO:teuthology.orchestra.run.smithi099.stdout:(102/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 100 kB/s | 64 kB 00:00 2024-09-19T05:53:51.147 INFO:teuthology.orchestra.run.smithi099.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 192 kB/s | 22 kB 00:00 2024-09-19T05:53:51.148 INFO:teuthology.orchestra.run.smithi037.stdout:(69/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 3.7 MB/s | 4.4 MB 00:01 2024-09-19T05:53:51.206 INFO:teuthology.orchestra.run.smithi099.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-19T05:53:51.231 INFO:teuthology.orchestra.run.smithi099.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 12 MB/s | 308 kB 00:00 2024-09-19T05:53:51.248 INFO:teuthology.orchestra.run.smithi099.stdout:(106/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 79 kB/s | 45 kB 00:00 2024-09-19T05:53:51.265 INFO:teuthology.orchestra.run.smithi099.stdout:(107/156): grpc-data-1.46.7-10.el9.noarch.rpm 597 kB/s | 19 kB 00:00 2024-09-19T05:53:51.290 INFO:teuthology.orchestra.run.smithi099.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.5 MB/s | 26 kB 00:00 2024-09-19T05:53:51.307 INFO:teuthology.orchestra.run.smithi099.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 3.3 MB/s | 49 kB 00:00 2024-09-19T05:53:51.332 INFO:teuthology.orchestra.run.smithi099.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-19T05:53:51.357 INFO:teuthology.orchestra.run.smithi099.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-19T05:53:51.399 INFO:teuthology.orchestra.run.smithi099.stdout:(112/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.6 MB/s | 863 kB 00:00 2024-09-19T05:53:51.441 INFO:teuthology.orchestra.run.smithi099.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 9.8 MB/s | 839 kB 00:00 2024-09-19T05:53:51.458 INFO:teuthology.orchestra.run.smithi099.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.9 MB/s | 43 kB 00:00 2024-09-19T05:53:51.475 INFO:teuthology.orchestra.run.smithi099.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.9 MB/s | 32 kB 00:00 2024-09-19T05:53:51.492 INFO:teuthology.orchestra.run.smithi099.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 849 kB/s | 14 kB 00:00 2024-09-19T05:53:51.517 INFO:teuthology.orchestra.run.smithi099.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 6.7 MB/s | 172 kB 00:00 2024-09-19T05:53:51.551 INFO:teuthology.orchestra.run.smithi099.stdout:(118/156): python3-asyncssh-2.13.2-5.el9.noarch 3.5 MB/s | 548 kB 00:00 2024-09-19T05:53:51.576 INFO:teuthology.orchestra.run.smithi099.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-19T05:53:51.610 INFO:teuthology.orchestra.run.smithi099.stdout:(120/156): python3-google-auth-2.34.0-1.el9.noa 6.5 MB/s | 220 kB 00:00 2024-09-19T05:53:51.635 INFO:teuthology.orchestra.run.smithi099.stdout:(121/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.5 MB/s | 303 kB 00:00 2024-09-19T05:53:51.660 INFO:teuthology.orchestra.run.smithi099.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-19T05:53:51.686 INFO:teuthology.orchestra.run.smithi099.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 426 kB/s | 11 kB 00:00 2024-09-19T05:53:51.711 INFO:teuthology.orchestra.run.smithi099.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 718 kB/s | 18 kB 00:00 2024-09-19T05:53:51.736 INFO:teuthology.orchestra.run.smithi099.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 924 kB/s | 23 kB 00:00 2024-09-19T05:53:51.761 INFO:teuthology.orchestra.run.smithi099.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 781 kB/s | 19 kB 00:00 2024-09-19T05:53:51.798 INFO:teuthology.orchestra.run.smithi037.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 183 kB/s | 137 kB 00:00 2024-09-19T05:53:51.820 INFO:teuthology.orchestra.run.smithi099.stdout:(127/156): libarrow-9.0.0-11.el9.x86_64.rpm 7.7 MB/s | 4.4 MB 00:00 2024-09-19T05:53:51.845 INFO:teuthology.orchestra.run.smithi099.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 235 kB/s | 20 kB 00:00 2024-09-19T05:53:51.896 INFO:teuthology.orchestra.run.smithi099.stdout:(129/156): python3-grpcio-1.46.7-10.el9.x86_64. 7.1 MB/s | 2.0 MB 00:00 2024-09-19T05:53:51.915 INFO:teuthology.orchestra.run.smithi037.stdout:(71/156): postgresql-contrib-13.16-1.el9.x86_64 1.0 MB/s | 910 kB 00:00 2024-09-19T05:53:51.921 INFO:teuthology.orchestra.run.smithi099.stdout:(130/156): python3-logutils-0.3.5-21.el9.noarch 615 kB/s | 46 kB 00:00 2024-09-19T05:53:51.946 INFO:teuthology.orchestra.run.smithi099.stdout:(131/156): python3-more-itertools-8.12.0-2.el9. 1.5 MB/s | 79 kB 00:00 2024-09-19T05:53:51.971 INFO:teuthology.orchestra.run.smithi099.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-09-19T05:53:51.997 INFO:teuthology.orchestra.run.smithi099.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 655 kB/s | 16 kB 00:00 2024-09-19T05:53:52.022 INFO:teuthology.orchestra.run.smithi099.stdout:(134/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-19T05:53:52.047 INFO:teuthology.orchestra.run.smithi099.stdout:(135/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-09-19T05:53:52.073 INFO:teuthology.orchestra.run.smithi099.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 561 kB/s | 28 kB 00:00 2024-09-19T05:53:52.098 INFO:teuthology.orchestra.run.smithi099.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 615 kB/s | 31 kB 00:00 2024-09-19T05:53:52.132 INFO:teuthology.orchestra.run.smithi099.stdout:(138/156): python3-kubernetes-26.1.0-2.el9.noar 3.3 MB/s | 1.0 MB 00:00 2024-09-19T05:53:52.157 INFO:teuthology.orchestra.run.smithi099.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-09-19T05:53:52.182 INFO:teuthology.orchestra.run.smithi099.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 715 kB/s | 36 kB 00:00 2024-09-19T05:53:52.207 INFO:teuthology.orchestra.run.smithi099.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 1.4 MB/s | 188 kB 00:00 2024-09-19T05:53:52.233 INFO:teuthology.orchestra.run.smithi099.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 987 kB/s | 74 kB 00:00 2024-09-19T05:53:52.258 INFO:teuthology.orchestra.run.smithi099.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-19T05:53:52.275 INFO:teuthology.orchestra.run.smithi099.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 1.2 MB/s | 20 kB 00:00 2024-09-19T05:53:52.299 INFO:teuthology.orchestra.run.smithi037.stdout:(72/156): postgresql-server-13.16-1.el9.x86_64. 5.0 MB/s | 5.8 MB 00:01 2024-09-19T05:53:52.300 INFO:teuthology.orchestra.run.smithi099.stdout:(145/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-09-19T05:53:52.334 INFO:teuthology.orchestra.run.smithi099.stdout:(146/156): python3-werkzeug-2.0.3-3.el9.1.noarc 4.2 MB/s | 427 kB 00:00 2024-09-19T05:53:52.359 INFO:teuthology.orchestra.run.smithi099.stdout:(147/156): re2-20211101-20.el9.x86_64.rpm 2.2 MB/s | 191 kB 00:00 2024-09-19T05:53:52.409 INFO:teuthology.orchestra.run.smithi099.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-19T05:53:52.582 INFO:teuthology.orchestra.run.smithi037.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 131 kB/s | 87 kB 00:00 2024-09-19T05:53:52.609 INFO:teuthology.orchestra.run.smithi099.stdout:(149/156): NetworkManager-1.51.0-1.el9.x86_64.r 12 MB/s | 2.3 MB 00:00 2024-09-19T05:53:52.676 INFO:teuthology.orchestra.run.smithi099.stdout:(150/156): librbd1-19.1.1-361.g2f599a46.el9.x86 10 MB/s | 3.2 MB 00:00 2024-09-19T05:53:52.735 INFO:teuthology.orchestra.run.smithi099.stdout:(151/156): librados2-19.1.1-361.g2f599a46.el9.x 8.5 MB/s | 3.4 MB 00:00 2024-09-19T05:53:52.744 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-09-19T05:53:52.745 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-09-19T05:53:52.752 INFO:teuthology.orchestra.run.smithi099.stdout:(152/156): NetworkManager-team-1.51.0-1.el9.x86 544 kB/s | 41 kB 00:00 2024-09-19T05:53:52.758 INFO:teuthology.orchestra.run.smithi037.stdout:(74/156): protobuf-3.14.0-13.el9.x86_64.rpm 1.1 MB/s | 1.0 MB 00:00 2024-09-19T05:53:52.794 INFO:teuthology.orchestra.run.smithi099.stdout:(153/156): NetworkManager-libnm-1.51.0-1.el9.x8 9.8 MB/s | 1.8 MB 00:00 2024-09-19T05:53:52.869 INFO:teuthology.orchestra.run.smithi099.stdout:(154/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 32 MB/s | 2.4 MB 00:00 2024-09-19T05:53:52.894 INFO:teuthology.orchestra.run.smithi099.stdout:(155/156): NetworkManager-tui-1.51.0-1.el9.x86_ 1.5 MB/s | 249 kB 00:00 2024-09-19T05:53:52.928 INFO:teuthology.orchestra.run.smithi099.stdout:(156/156): openssl-3.2.2-6.el9.x86_64.rpm 7.7 MB/s | 1.4 MB 00:00 2024-09-19T05:53:52.934 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-09-19T05:53:52.934 INFO:teuthology.orchestra.run.smithi099.stdout:Total 10 MB/s | 226 MB 00:21 2024-09-19T05:53:53.283 INFO:teuthology.orchestra.run.smithi037.stdout:(75/156): python3-colorama-0.4.6-3.el9.noarch.r 87 kB/s | 61 kB 00:00 2024-09-19T05:53:53.691 INFO:teuthology.orchestra.run.smithi037.stdout:(76/156): python3-babel-2.9.1-2.el9.noarch.rpm 4.3 MB/s | 6.0 MB 00:01 2024-09-19T05:53:53.725 INFO:teuthology.orchestra.run.smithi037.stdout:(77/156): python3-devel-3.9.19-8.el9.x86_64.rpm 253 kB/s | 245 kB 00:00 2024-09-19T05:53:54.165 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-09-19T05:53:54.217 INFO:teuthology.orchestra.run.smithi037.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 39 kB/s | 19 kB 00:00 2024-09-19T05:53:54.250 INFO:teuthology.orchestra.run.smithi037.stdout:(79/156): python3-jsonpatch-1.21-16.el9.noarch. 47 kB/s | 26 kB 00:00 2024-09-19T05:53:54.284 INFO:teuthology.orchestra.run.smithi037.stdout:(80/156): python3-jinja2-2.11.3-6.el9.noarch.rp 248 kB/s | 248 kB 00:01 2024-09-19T05:53:54.315 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-09-19T05:53:54.315 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-09-19T05:53:54.818 INFO:teuthology.orchestra.run.smithi037.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 61 kB/s | 35 kB 00:00 2024-09-19T05:53:54.951 INFO:teuthology.orchestra.run.smithi037.stdout:(82/156): python3-mako-1.1.4-6.el9.noarch.rpm 235 kB/s | 172 kB 00:00 2024-09-19T05:53:55.410 INFO:teuthology.orchestra.run.smithi037.stdout:(83/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.5 MB/s | 5.1 MB 00:01 2024-09-19T05:53:55.568 INFO:teuthology.orchestra.run.smithi037.stdout:(84/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 334 kB/s | 250 kB 00:00 2024-09-19T05:53:55.710 INFO:teuthology.orchestra.run.smithi037.stdout:(85/156): python3-oauthlib-3.1.1-5.el9.noarch.r 293 kB/s | 222 kB 00:00 2024-09-19T05:53:56.110 INFO:teuthology.orchestra.run.smithi037.stdout:(86/156): python3-packaging-20.9-5.el9.noarch.r 110 kB/s | 77 kB 00:00 2024-09-19T05:53:56.116 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-09-19T05:53:56.116 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-09-19T05:53:56.135 INFO:teuthology.orchestra.run.smithi037.stdout:(87/156): python3-prettytable-0.7.2-27.el9.noar 75 kB/s | 42 kB 00:00 2024-09-19T05:53:56.511 INFO:teuthology.orchestra.run.smithi037.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 337 kB/s | 269 kB 00:00 2024-09-19T05:53:56.819 INFO:teuthology.orchestra.run.smithi037.stdout:(89/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 224 kB/s | 159 kB 00:00 2024-09-19T05:53:56.928 INFO:teuthology.orchestra.run.smithi037.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 352 kB/s | 279 kB 00:00 2024-09-19T05:53:57.153 INFO:teuthology.orchestra.run.smithi037.stdout:(91/156): python3-pytz-2021.1-5.el9.noarch.rpm 79 kB/s | 51 kB 00:00 2024-09-19T05:53:57.437 INFO:teuthology.orchestra.run.smithi037.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 87 kB/s | 54 kB 00:00 2024-09-19T05:53:57.729 INFO:teuthology.orchestra.run.smithi037.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 73 kB/s | 42 kB 00:00 2024-09-19T05:53:58.004 INFO:teuthology.orchestra.run.smithi037.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 78 kB/s | 44 kB 00:00 2024-09-19T05:53:58.379 INFO:teuthology.orchestra.run.smithi037.stdout:(95/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-09-19T05:53:58.580 INFO:teuthology.orchestra.run.smithi037.stdout:(96/156): qatlib-24.02.0-1.el9.x86_64.rpm 260 kB/s | 221 kB 00:00 2024-09-19T05:53:58.796 INFO:teuthology.orchestra.run.smithi037.stdout:(97/156): qatlib-service-24.02.0-1.el9.x86_64.r 45 kB/s | 36 kB 00:00 2024-09-19T05:53:58.951 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-09-19T05:53:59.013 INFO:teuthology.orchestra.run.smithi037.stdout:(98/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 76 kB/s | 47 kB 00:00 2024-09-19T05:53:59.078 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T05:53:59.204 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T05:53:59.390 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T05:53:59.405 INFO:teuthology.orchestra.run.smithi037.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 95 kB/s | 58 kB 00:00 2024-09-19T05:53:59.430 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T05:53:59.430 INFO:teuthology.orchestra.run.smithi037.stdout:(100/156): socat-1.7.4.1-6.el9.x86_64.rpm 358 kB/s | 304 kB 00:00 2024-09-19T05:53:59.455 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T05:53:59.500 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T05:53:59.723 INFO:teuthology.orchestra.run.smithi037.stdout:(101/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 137 kB/s | 96 kB 00:00 2024-09-19T05:53:59.828 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T05:53:59.939 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T05:54:00.006 INFO:teuthology.orchestra.run.smithi037.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 78 kB/s | 45 kB 00:00 2024-09-19T05:54:00.031 INFO:teuthology.orchestra.run.smithi037.stdout:(103/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 102 kB/s | 64 kB 00:00 2024-09-19T05:54:00.057 INFO:teuthology.orchestra.run.smithi037.stdout:(104/156): lua-devel-5.4.4-4.el9.x86_64.rpm 67 kB/s | 22 kB 00:00 2024-09-19T05:54:00.060 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T05:54:00.090 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T05:54:00.181 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T05:54:00.207 INFO:teuthology.orchestra.run.smithi037.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 3.6 MB/s | 548 kB 00:00 2024-09-19T05:54:00.210 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T05:54:00.232 INFO:teuthology.orchestra.run.smithi037.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 780 kB/s | 19 kB 00:00 2024-09-19T05:54:00.266 INFO:teuthology.orchestra.run.smithi037.stdout:(107/156): gperftools-libs-2.9.1-3.el9.x86_64.r 1.4 MB/s | 308 kB 00:00 2024-09-19T05:54:00.291 INFO:teuthology.orchestra.run.smithi037.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-19T05:54:00.316 INFO:teuthology.orchestra.run.smithi037.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-19T05:54:00.341 INFO:teuthology.orchestra.run.smithi037.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.7 MB/s | 67 kB 00:00 2024-09-19T05:54:00.358 INFO:teuthology.orchestra.run.smithi037.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 8.9 MB/s | 151 kB 00:00 2024-09-19T05:54:00.367 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T05:54:00.424 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T05:54:00.425 INFO:teuthology.orchestra.run.smithi037.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 12 MB/s | 839 kB 00:00 2024-09-19T05:54:00.452 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T05:54:00.476 INFO:teuthology.orchestra.run.smithi037.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 11 MB/s | 548 kB 00:00 2024-09-19T05:54:00.543 INFO:teuthology.orchestra.run.smithi037.stdout:(114/156): libarrow-9.0.0-11.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2024-09-19T05:54:00.547 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T05:54:00.568 INFO:teuthology.orchestra.run.smithi037.stdout:(115/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 473 kB/s | 43 kB 00:00 2024-09-19T05:54:00.570 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T05:54:00.593 INFO:teuthology.orchestra.run.smithi037.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 643 kB/s | 32 kB 00:00 2024-09-19T05:54:00.618 INFO:teuthology.orchestra.run.smithi037.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-19T05:54:00.633 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T05:54:00.644 INFO:teuthology.orchestra.run.smithi037.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.4 MB/s | 172 kB 00:00 2024-09-19T05:54:00.663 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T05:54:00.678 INFO:teuthology.orchestra.run.smithi037.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-19T05:54:00.682 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T05:54:00.702 INFO:teuthology.orchestra.run.smithi037.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-19T05:54:00.736 INFO:teuthology.orchestra.run.smithi037.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-19T05:54:00.770 INFO:teuthology.orchestra.run.smithi037.stdout:(122/156): protobuf-compiler-3.14.0-13.el9.x86_ 1.1 MB/s | 863 kB 00:00 2024-09-19T05:54:00.795 INFO:teuthology.orchestra.run.smithi037.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 2.4 MB/s | 144 kB 00:00 2024-09-19T05:54:00.829 INFO:teuthology.orchestra.run.smithi037.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 721 kB/s | 18 kB 00:00 2024-09-19T05:54:00.862 INFO:teuthology.orchestra.run.smithi037.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 741 kB/s | 23 kB 00:00 2024-09-19T05:54:00.864 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T05:54:00.888 INFO:teuthology.orchestra.run.smithi037.stdout:(126/156): python3-jaraco-8.2.1-3.el9.noarch.rp 91 kB/s | 11 kB 00:00 2024-09-19T05:54:00.904 INFO:teuthology.orchestra.run.smithi037.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 465 kB/s | 19 kB 00:00 2024-09-19T05:54:00.930 INFO:teuthology.orchestra.run.smithi037.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 470 kB/s | 20 kB 00:00 2024-09-19T05:54:00.964 INFO:teuthology.orchestra.run.smithi037.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.4 MB/s | 46 kB 00:00 2024-09-19T05:54:00.989 INFO:teuthology.orchestra.run.smithi037.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-19T05:54:00.997 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T05:54:01.022 INFO:teuthology.orchestra.run.smithi037.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 1.7 MB/s | 58 kB 00:00 2024-09-19T05:54:01.081 INFO:teuthology.orchestra.run.smithi037.stdout:(132/156): python3-grpcio-1.46.7-10.el9.x86_64. 5.4 MB/s | 2.0 MB 00:00 2024-09-19T05:54:01.106 INFO:teuthology.orchestra.run.smithi037.stdout:(133/156): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-09-19T05:54:01.111 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T05:54:01.131 INFO:teuthology.orchestra.run.smithi037.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 328 kB/s | 16 kB 00:00 2024-09-19T05:54:01.165 INFO:teuthology.orchestra.run.smithi037.stdout:(135/156): python3-kubernetes-26.1.0-2.el9.noar 3.9 MB/s | 1.0 MB 00:00 2024-09-19T05:54:01.327 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T05:54:01.327 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T05:54:01.327 INFO:teuthology.orchestra.run.smithi037.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 484 kB/s | 28 kB 00:00 2024-09-19T05:54:01.327 INFO:teuthology.orchestra.run.smithi037.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 614 kB/s | 31 kB 00:00 2024-09-19T05:54:01.327 INFO:teuthology.orchestra.run.smithi037.stdout:(138/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 826 kB/s | 90 kB 00:00 2024-09-19T05:54:01.327 INFO:teuthology.orchestra.run.smithi037.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-19T05:54:01.328 INFO:teuthology.orchestra.run.smithi037.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-09-19T05:54:01.328 INFO:teuthology.orchestra.run.smithi037.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-09-19T05:54:01.347 INFO:teuthology.orchestra.run.smithi037.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 989 kB/s | 74 kB 00:00 2024-09-19T05:54:01.369 INFO:teuthology.orchestra.run.smithi037.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-19T05:54:01.395 INFO:teuthology.orchestra.run.smithi037.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 804 kB/s | 20 kB 00:00 2024-09-19T05:54:01.423 INFO:teuthology.orchestra.run.smithi037.stdout:(145/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-09-19T05:54:01.445 INFO:teuthology.orchestra.run.smithi037.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-19T05:54:01.468 INFO:teuthology.orchestra.run.smithi037.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-19T05:54:01.485 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T05:54:01.526 INFO:teuthology.orchestra.run.smithi037.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-19T05:54:01.591 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T05:54:01.687 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T05:54:01.734 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T05:54:01.769 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T05:54:01.785 INFO:teuthology.orchestra.run.smithi037.stdout:(149/156): NetworkManager-1.51.0-1.el9.x86_64.r 9.0 MB/s | 2.3 MB 00:00 2024-09-19T05:54:01.832 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T05:54:01.860 INFO:teuthology.orchestra.run.smithi037.stdout:(150/156): NetworkManager-libnm-1.51.0-1.el9.x8 24 MB/s | 1.8 MB 00:00 2024-09-19T05:54:01.878 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T05:54:01.902 INFO:teuthology.orchestra.run.smithi037.stdout:(151/156): NetworkManager-team-1.51.0-1.el9.x86 984 kB/s | 41 kB 00:00 2024-09-19T05:54:01.918 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T05:54:01.952 INFO:teuthology.orchestra.run.smithi037.stdout:(152/156): librbd1-19.1.1-361.g2f599a46.el9.x86 6.5 MB/s | 3.2 MB 00:00 2024-09-19T05:54:01.962 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T05:54:01.977 INFO:teuthology.orchestra.run.smithi037.stdout:(153/156): NetworkManager-tui-1.51.0-1.el9.x86_ 3.2 MB/s | 249 kB 00:00 2024-09-19T05:54:01.998 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T05:54:02.034 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T05:54:02.036 INFO:teuthology.orchestra.run.smithi037.stdout:(154/156): librados2-19.1.1-361.g2f599a46.el9.x 5.8 MB/s | 3.4 MB 00:00 2024-09-19T05:54:02.103 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T05:54:02.103 INFO:teuthology.orchestra.run.smithi037.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 19 MB/s | 2.4 MB 00:00 2024-09-19T05:54:02.156 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T05:54:02.187 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T05:54:02.222 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T05:54:02.299 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T05:54:02.333 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T05:54:02.376 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T05:54:02.405 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T05:54:02.475 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T05:54:02.478 INFO:teuthology.orchestra.run.smithi037.stdout:(156/156): openssl-3.2.2-6.el9.x86_64.rpm 2.6 MB/s | 1.4 MB 00:00 2024-09-19T05:54:02.485 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-09-19T05:54:02.485 INFO:teuthology.orchestra.run.smithi037.stdout:Total 8.2 MB/s | 226 MB 00:27 2024-09-19T05:54:02.529 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T05:54:02.596 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-09-19T05:54:02.602 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T05:54:02.680 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T05:54:02.720 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T05:54:02.735 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T05:54:02.781 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T05:54:02.788 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T05:54:02.815 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T05:54:02.840 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T05:54:02.883 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T05:54:03.212 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T05:54:03.309 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T05:54:03.324 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T05:54:03.392 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T05:54:03.422 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T05:54:03.445 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T05:54:03.456 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T05:54:03.475 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T05:54:03.494 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T05:54:03.536 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T05:54:03.565 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T05:54:03.596 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T05:54:03.690 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T05:54:03.744 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T05:54:03.747 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T05:54:03.765 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-09-19T05:54:03.802 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T05:54:03.802 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T05:54:03.829 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T05:54:03.875 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T05:54:03.916 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T05:54:03.932 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T05:54:03.935 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-09-19T05:54:03.935 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-09-19T05:54:03.953 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T05:54:03.956 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T05:54:03.999 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T05:54:04.019 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T05:54:04.035 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T05:54:04.039 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T05:54:04.059 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T05:54:04.078 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T05:54:04.120 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T05:54:04.199 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T05:54:04.255 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T05:54:04.297 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T05:54:04.334 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T05:54:04.338 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T05:54:04.445 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T05:54:04.463 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T05:54:04.560 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T05:54:04.672 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T05:54:04.673 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T05:54:04.896 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T05:54:04.943 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T05:54:04.980 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T05:54:05.004 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T05:54:05.085 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T05:54:05.186 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T05:54:05.216 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T05:54:05.252 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T05:54:05.273 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T05:54:05.280 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T05:54:05.311 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T05:54:05.314 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T05:54:05.345 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T05:54:05.354 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T05:54:05.386 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T05:54:05.418 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T05:54:05.418 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T05:54:05.451 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T05:54:05.462 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T05:54:05.485 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T05:54:05.494 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T05:54:05.526 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T05:54:05.538 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T05:54:05.561 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T05:54:05.570 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T05:54:05.599 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T05:54:05.647 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T05:54:05.667 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T05:54:05.707 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T05:54:05.721 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T05:54:05.739 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T05:54:05.751 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T05:54:05.786 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T05:54:05.841 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T05:54:05.862 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T05:54:05.890 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T05:54:05.898 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T05:54:05.941 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T05:54:05.978 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T05:54:06.050 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T05:54:06.104 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T05:54:06.178 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T05:54:06.266 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-09-19T05:54:06.266 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-09-19T05:54:06.313 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T05:54:06.364 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T05:54:06.613 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T05:54:06.662 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T05:54:06.696 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T05:54:06.793 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T05:54:06.842 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T05:54:06.882 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T05:54:06.887 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T05:54:06.960 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T05:54:06.974 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T05:54:06.989 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T05:54:07.006 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T05:54:07.032 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T05:54:07.078 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T05:54:07.120 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T05:54:07.190 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T05:54:07.221 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T05:54:07.276 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T05:54:07.297 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T05:54:07.340 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T05:54:07.394 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T05:54:07.468 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T05:54:07.499 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T05:54:07.535 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T05:54:07.581 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T05:54:07.626 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T05:54:07.669 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T05:54:07.711 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T05:54:07.847 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T05:54:07.896 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T05:54:07.936 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T05:54:07.937 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T05:54:08.041 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T05:54:08.052 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T05:54:08.080 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T05:54:08.119 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T05:54:08.145 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T05:54:08.170 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T05:54:08.252 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T05:54:08.378 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T05:54:08.410 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T05:54:08.438 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T05:54:08.473 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T05:54:08.511 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T05:54:08.543 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T05:54:08.573 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T05:54:08.607 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T05:54:08.656 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T05:54:08.699 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T05:54:08.733 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T05:54:08.820 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T05:54:08.872 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T05:54:08.904 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T05:54:09.005 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T05:54:09.054 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T05:54:09.256 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T05:54:09.333 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T05:54:09.361 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T05:54:09.394 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T05:54:09.702 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T05:54:09.749 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T05:54:09.772 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T05:54:09.818 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T05:54:09.839 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T05:54:09.852 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T05:54:09.870 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T05:54:09.906 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T05:54:09.951 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T05:54:09.998 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T05:54:10.046 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T05:54:10.133 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T05:54:10.173 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T05:54:10.356 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T05:54:10.384 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T05:54:10.387 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T05:54:10.410 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T05:54:10.464 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T05:54:10.481 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T05:54:10.511 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T05:54:11.117 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T05:54:11.251 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T05:54:12.473 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T05:54:12.549 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T05:54:12.576 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T05:54:12.609 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T05:54:12.777 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T05:54:12.816 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T05:54:12.840 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-09-19T05:54:12.918 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T05:54:12.956 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T05:54:12.974 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T05:54:13.013 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T05:54:13.045 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T05:54:13.067 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T05:54:13.077 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T05:54:13.108 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T05:54:13.130 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T05:54:13.133 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T05:54:13.187 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T05:54:13.355 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T05:54:13.386 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T05:54:13.491 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T05:54:13.491 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T05:54:13.492 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T05:54:13.492 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T05:54:13.521 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T05:54:13.534 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T05:54:13.609 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T05:54:13.642 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T05:54:13.668 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T05:54:13.713 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T05:54:13.744 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T05:54:13.792 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T05:54:13.827 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T05:54:13.920 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T05:54:13.956 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T05:54:14.146 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T05:54:14.211 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T05:54:14.240 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T05:54:14.346 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T05:54:14.374 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T05:54:14.437 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T05:54:14.458 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T05:54:14.480 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T05:54:14.669 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T05:54:14.864 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T05:54:15.014 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T05:54:15.129 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T05:54:15.208 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T05:54:15.445 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T05:54:15.558 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T05:54:15.654 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T05:54:15.688 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T05:54:15.723 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T05:54:15.799 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T05:54:15.858 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T05:54:15.897 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T05:54:15.941 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T05:54:15.974 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T05:54:16.001 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T05:54:16.049 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T05:54:16.072 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T05:54:16.081 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T05:54:16.125 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T05:54:16.154 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T05:54:16.198 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T05:54:16.277 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T05:54:16.317 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T05:54:16.361 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T05:54:16.388 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T05:54:16.461 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T05:54:16.503 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T05:54:16.590 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T05:54:16.622 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T05:54:16.660 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T05:54:16.733 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T05:54:16.752 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T05:54:16.752 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T05:54:16.752 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T05:54:16.752 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T05:54:16.781 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T05:54:16.786 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T05:54:17.345 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T05:54:17.445 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T05:54:17.481 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T05:54:17.524 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T05:54:17.570 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T05:54:17.621 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T05:54:17.779 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T05:54:17.839 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T05:54:17.896 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T05:54:17.969 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T05:54:18.007 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T05:54:18.043 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T05:54:18.093 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T05:54:18.134 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T05:54:18.186 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T05:54:18.229 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T05:54:18.372 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T05:54:18.413 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T05:54:18.455 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T05:54:18.560 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T05:54:18.596 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T05:54:18.637 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T05:54:18.677 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T05:54:18.706 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T05:54:18.796 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T05:54:18.937 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T05:54:18.979 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T05:54:19.016 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T05:54:19.050 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T05:54:19.089 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T05:54:19.130 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T05:54:19.159 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T05:54:19.193 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T05:54:19.227 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T05:54:19.269 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T05:54:19.303 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T05:54:19.392 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T05:54:19.450 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T05:54:19.489 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T05:54:19.598 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T05:54:19.658 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T05:54:20.418 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T05:54:20.470 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T05:54:20.512 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T05:54:20.622 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T05:54:20.667 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T05:54:20.712 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T05:54:20.804 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T05:54:20.839 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T05:54:21.039 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T05:54:21.079 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T05:54:21.158 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T05:54:21.845 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T05:54:21.971 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T05:54:23.304 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T05:54:23.392 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T05:54:23.420 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T05:54:23.453 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T05:54:23.781 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T05:54:23.824 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T05:54:23.915 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T05:54:23.945 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T05:54:23.982 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T05:54:24.491 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T05:54:24.535 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T05:54:24.606 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T05:54:24.645 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T05:54:25.305 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T05:54:25.305 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /sys 2024-09-19T05:54:25.305 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /proc 2024-09-19T05:54:25.305 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /mnt 2024-09-19T05:54:25.305 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /var/tmp 2024-09-19T05:54:25.305 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /home 2024-09-19T05:54:25.305 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /root 2024-09-19T05:54:25.305 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /tmp 2024-09-19T05:54:25.305 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T05:54:25.482 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T05:54:25.498 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T05:54:25.499 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:54:25.499 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T05:54:25.499 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T05:54:26.985 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T05:54:27.012 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T05:54:27.012 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:54:27.012 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T05:54:27.012 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T05:54:27.012 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T05:54:27.012 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T05:54:27.075 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T05:54:27.108 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T05:54:27.235 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T05:54:27.259 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T05:54:27.259 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:54:27.259 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T05:54:27.259 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T05:54:27.260 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T05:54:27.260 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T05:54:27.692 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T05:54:27.697 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T05:54:27.718 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T05:54:27.718 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:54:27.718 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T05:54:27.718 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T05:54:27.718 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T05:54:27.718 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T05:54:27.736 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T05:54:27.828 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T05:54:27.828 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T05:54:27.829 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T05:54:27.829 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T05:54:27.833 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T05:54:27.871 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T05:54:27.889 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T05:54:27.944 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T05:54:28.130 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T05:54:28.178 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T05:54:28.247 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T05:54:28.335 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T05:54:28.474 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T05:54:28.520 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T05:54:28.552 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T05:54:28.579 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T05:54:28.692 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T05:54:28.692 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /sys 2024-09-19T05:54:28.692 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /proc 2024-09-19T05:54:28.693 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /mnt 2024-09-19T05:54:28.693 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /var/tmp 2024-09-19T05:54:28.693 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /home 2024-09-19T05:54:28.693 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /root 2024-09-19T05:54:28.693 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /tmp 2024-09-19T05:54:28.693 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T05:54:28.870 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T05:54:28.887 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T05:54:28.887 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:54:28.887 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T05:54:28.887 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T05:54:29.008 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T05:54:29.036 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T05:54:29.068 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T05:54:29.129 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T05:54:29.159 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T05:54:30.200 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T05:54:30.236 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T05:54:30.373 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T05:54:30.400 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T05:54:30.401 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:54:30.401 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T05:54:30.401 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T05:54:30.401 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T05:54:30.401 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T05:54:30.632 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T05:54:30.656 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T05:54:30.656 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:54:30.656 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T05:54:30.656 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T05:54:30.656 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T05:54:30.656 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T05:54:31.091 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T05:54:31.115 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T05:54:31.115 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:54:31.115 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T05:54:31.115 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T05:54:31.115 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T05:54:31.115 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T05:54:31.192 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T05:54:31.221 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T05:54:31.228 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T05:54:31.277 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T05:54:31.330 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T05:54:31.332 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T05:54:31.489 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T05:54:31.517 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T05:54:31.530 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T05:54:31.555 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T05:54:31.555 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:54:31.555 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T05:54:31.555 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T05:54:31.555 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T05:54:31.555 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T05:54:31.566 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T05:54:31.605 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T05:54:31.618 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T05:54:31.635 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T05:54:31.714 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T05:54:31.723 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T05:54:31.762 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T05:54:31.854 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T05:54:31.900 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T05:54:31.989 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T05:54:31.990 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T05:54:32.432 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T05:54:32.450 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T05:54:32.481 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T05:54:32.544 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T05:54:32.573 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T05:54:32.683 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T05:54:32.708 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T05:54:32.732 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T05:54:32.732 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:54:32.732 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T05:54:32.732 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T05:54:32.732 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T05:54:32.732 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T05:54:32.775 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T05:54:32.798 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T05:54:32.798 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:54:32.798 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T05:54:32.799 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T05:54:32.843 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T05:54:32.866 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T05:54:32.866 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:54:32.867 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T05:54:32.867 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T05:54:32.867 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T05:54:32.867 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T05:54:33.168 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T05:54:33.192 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T05:54:33.193 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:54:33.193 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T05:54:33.193 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T05:54:33.193 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T05:54:33.193 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T05:54:33.622 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T05:54:33.657 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T05:54:34.628 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T05:54:34.649 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T05:54:34.753 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T05:54:34.912 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T05:54:34.943 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T05:54:34.967 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T05:54:34.967 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:54:34.967 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T05:54:34.967 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T05:54:34.967 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T05:54:34.967 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T05:54:35.019 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T05:54:35.030 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T05:54:35.128 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T05:54:35.184 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T05:54:36.107 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T05:54:36.138 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T05:54:36.161 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T05:54:36.161 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:54:36.161 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T05:54:36.161 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T05:54:36.161 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T05:54:36.162 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T05:54:36.214 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T05:54:36.236 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T05:54:36.237 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:54:36.237 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T05:54:36.237 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T05:54:36.281 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T05:54:36.304 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T05:54:36.304 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:54:36.304 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T05:54:36.304 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T05:54:36.304 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T05:54:36.304 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T05:54:36.614 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T05:54:36.638 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T05:54:36.638 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:54:36.638 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T05:54:36.638 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T05:54:36.638 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T05:54:36.638 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T05:54:37.722 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T05:54:37.763 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T05:54:37.804 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T05:54:37.836 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T05:54:37.863 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T05:54:38.046 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T05:54:38.093 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T05:54:38.115 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T05:54:38.153 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T05:54:38.191 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T05:54:38.814 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T05:54:38.856 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T05:54:38.876 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T05:54:39.698 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T05:54:39.794 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T05:54:39.834 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T05:54:39.915 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T05:54:39.955 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T05:54:39.980 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T05:54:40.006 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T05:54:40.007 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T05:54:40.099 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T05:54:40.099 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T05:54:40.183 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T05:54:40.208 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T05:54:40.208 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T05:54:40.208 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /sys 2024-09-19T05:54:40.209 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /proc 2024-09-19T05:54:40.209 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /mnt 2024-09-19T05:54:40.209 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /var/tmp 2024-09-19T05:54:40.209 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /home 2024-09-19T05:54:40.209 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /root 2024-09-19T05:54:40.209 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /tmp 2024-09-19T05:54:40.209 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T05:54:40.213 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T05:54:40.213 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T05:54:40.382 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T05:54:40.384 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T05:54:40.385 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T05:54:40.398 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T05:54:40.398 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:54:40.399 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T05:54:40.399 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T05:54:40.469 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T05:54:40.532 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T05:54:41.210 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T05:54:41.250 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T05:54:41.291 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T05:54:41.323 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T05:54:41.351 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T05:54:41.532 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T05:54:41.572 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T05:54:41.602 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T05:54:41.632 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T05:54:41.670 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T05:54:41.926 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T05:54:41.955 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T05:54:41.955 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:54:41.955 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T05:54:41.955 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T05:54:41.955 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T05:54:41.955 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T05:54:42.194 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T05:54:42.218 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T05:54:42.219 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:54:42.219 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T05:54:42.219 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T05:54:42.219 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T05:54:42.219 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T05:54:42.285 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T05:54:42.326 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T05:54:42.346 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T05:54:42.678 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T05:54:42.702 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T05:54:42.703 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:54:42.703 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T05:54:42.703 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T05:54:42.703 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T05:54:42.703 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T05:54:42.817 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T05:54:42.875 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T05:54:42.939 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T05:54:43.134 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T05:54:43.187 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T05:54:43.188 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T05:54:43.276 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T05:54:43.288 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T05:54:43.329 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T05:54:43.365 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T05:54:43.410 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T05:54:43.441 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T05:54:43.467 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T05:54:43.493 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T05:54:43.493 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T05:54:43.510 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T05:54:43.566 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T05:54:43.577 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T05:54:43.577 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T05:54:43.602 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T05:54:43.630 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T05:54:43.652 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T05:54:43.680 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T05:54:43.683 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T05:54:43.683 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T05:54:43.854 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T05:54:43.854 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T05:54:43.946 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T05:54:44.011 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T05:54:44.101 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T05:54:44.128 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T05:54:44.160 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T05:54:44.225 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T05:54:44.251 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T05:54:45.361 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T05:54:45.403 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T05:54:46.100 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T05:54:46.101 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T05:54:46.101 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T05:54:46.101 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T05:54:46.101 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T05:54:46.101 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T05:54:46.101 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T05:54:46.101 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T05:54:46.101 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T05:54:46.101 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T05:54:46.101 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T05:54:46.101 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T05:54:46.101 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T05:54:46.101 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T05:54:46.102 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T05:54:46.102 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T05:54:46.102 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T05:54:46.102 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T05:54:46.102 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T05:54:46.102 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T05:54:46.102 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T05:54:46.102 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T05:54:46.103 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T05:54:46.103 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T05:54:46.103 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T05:54:46.103 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T05:54:46.103 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T05:54:46.103 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T05:54:46.103 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T05:54:46.103 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T05:54:46.103 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T05:54:46.103 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T05:54:46.115 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T05:54:46.115 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T05:54:46.115 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T05:54:46.115 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T05:54:46.115 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T05:54:46.115 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T05:54:46.115 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T05:54:46.115 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T05:54:46.115 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T05:54:46.116 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T05:54:46.116 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T05:54:46.116 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T05:54:46.116 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T05:54:46.116 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T05:54:46.116 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T05:54:46.116 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T05:54:46.116 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T05:54:46.116 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T05:54:46.117 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T05:54:46.117 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T05:54:46.117 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T05:54:46.117 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T05:54:46.117 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T05:54:46.117 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T05:54:46.117 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T05:54:46.117 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T05:54:46.117 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T05:54:46.118 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T05:54:46.118 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T05:54:46.118 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T05:54:46.118 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T05:54:46.118 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T05:54:46.118 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T05:54:46.118 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T05:54:46.118 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T05:54:46.118 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T05:54:46.118 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T05:54:46.118 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T05:54:46.118 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T05:54:46.118 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T05:54:46.119 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T05:54:46.119 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T05:54:46.119 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T05:54:46.119 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T05:54:46.119 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T05:54:46.119 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T05:54:46.119 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T05:54:46.119 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T05:54:46.119 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T05:54:46.119 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T05:54:46.119 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T05:54:46.120 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T05:54:46.120 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T05:54:46.120 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T05:54:46.120 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T05:54:46.120 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T05:54:46.120 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T05:54:46.120 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T05:54:46.120 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T05:54:46.120 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T05:54:46.121 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T05:54:46.121 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T05:54:46.121 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T05:54:46.121 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T05:54:46.121 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T05:54:46.121 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T05:54:46.121 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T05:54:46.121 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T05:54:46.121 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T05:54:46.121 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T05:54:46.121 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T05:54:46.122 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T05:54:46.122 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T05:54:46.122 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T05:54:46.122 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T05:54:46.122 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T05:54:46.122 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T05:54:46.122 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T05:54:46.122 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T05:54:46.122 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T05:54:46.122 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T05:54:46.123 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T05:54:46.123 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T05:54:46.123 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T05:54:46.123 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T05:54:46.123 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T05:54:46.123 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T05:54:46.123 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T05:54:46.123 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T05:54:46.123 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T05:54:46.124 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T05:54:46.124 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T05:54:46.124 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T05:54:46.124 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T05:54:46.124 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T05:54:46.124 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T05:54:46.124 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T05:54:46.124 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T05:54:46.124 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T05:54:46.124 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T05:54:46.124 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T05:54:46.124 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T05:54:46.124 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T05:54:46.125 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T05:54:46.125 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T05:54:46.125 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T05:54:46.125 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T05:54:46.125 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T05:54:46.125 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T05:54:46.125 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T05:54:46.125 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T05:54:46.125 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T05:54:46.125 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T05:54:46.125 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T05:54:46.125 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T05:54:46.125 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T05:54:46.125 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T05:54:46.126 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T05:54:46.126 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T05:54:46.126 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T05:54:46.126 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T05:54:46.126 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T05:54:46.126 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T05:54:46.126 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T05:54:46.126 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T05:54:46.126 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T05:54:46.126 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T05:54:46.126 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T05:54:46.126 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T05:54:46.126 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T05:54:46.127 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T05:54:46.127 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T05:54:46.418 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T05:54:46.445 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T05:54:46.555 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T05:54:46.723 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T05:54:46.755 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T05:54:46.781 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T05:54:46.781 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:54:46.781 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T05:54:46.781 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T05:54:46.781 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T05:54:46.781 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T05:54:46.831 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T05:54:46.843 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T05:54:46.953 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T05:54:47.009 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T05:54:47.991 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T05:54:48.025 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T05:54:48.050 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T05:54:48.050 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:54:48.050 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T05:54:48.050 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T05:54:48.050 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T05:54:48.050 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T05:54:48.092 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T05:54:48.117 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T05:54:48.117 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:54:48.117 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T05:54:48.117 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T05:54:48.168 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T05:54:48.193 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T05:54:48.193 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:54:48.193 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T05:54:48.193 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T05:54:48.193 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T05:54:48.193 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T05:54:48.510 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T05:54:48.536 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T05:54:48.536 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:54:48.536 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T05:54:48.536 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T05:54:48.536 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T05:54:48.536 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T05:54:48.961 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T05:54:48.961 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T05:54:48.961 INFO:teuthology.orchestra.run.smithi117.stdout:Upgraded: 2024-09-19T05:54:48.961 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T05:54:48.961 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T05:54:48.961 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T05:54:48.961 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T05:54:48.961 INFO:teuthology.orchestra.run.smithi117.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:54:48.961 INFO:teuthology.orchestra.run.smithi117.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:54:48.961 INFO:teuthology.orchestra.run.smithi117.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T05:54:48.962 INFO:teuthology.orchestra.run.smithi117.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T05:54:48.962 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-09-19T05:54:48.962 INFO:teuthology.orchestra.run.smithi117.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T05:54:48.962 INFO:teuthology.orchestra.run.smithi117.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T05:54:48.962 INFO:teuthology.orchestra.run.smithi117.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T05:54:48.962 INFO:teuthology.orchestra.run.smithi117.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T05:54:48.962 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:54:48.962 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:54:48.962 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:54:48.962 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:54:48.962 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:54:48.962 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:54:48.962 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:54:48.962 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:54:48.963 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:54:48.963 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:54:48.963 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:54:48.963 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:54:48.963 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:54:48.963 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:54:48.963 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:54:48.963 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:54:48.963 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:54:48.963 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:54:48.963 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:54:48.963 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:54:48.963 INFO:teuthology.orchestra.run.smithi117.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:54:48.964 INFO:teuthology.orchestra.run.smithi117.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:54:48.964 INFO:teuthology.orchestra.run.smithi117.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:54:48.964 INFO:teuthology.orchestra.run.smithi117.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:54:48.964 INFO:teuthology.orchestra.run.smithi117.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T05:54:48.964 INFO:teuthology.orchestra.run.smithi117.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T05:54:48.964 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T05:54:48.964 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T05:54:48.964 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T05:54:48.964 INFO:teuthology.orchestra.run.smithi117.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T05:54:48.964 INFO:teuthology.orchestra.run.smithi117.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T05:54:48.964 INFO:teuthology.orchestra.run.smithi117.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T05:54:48.964 INFO:teuthology.orchestra.run.smithi117.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T05:54:48.965 INFO:teuthology.orchestra.run.smithi117.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T05:54:48.965 INFO:teuthology.orchestra.run.smithi117.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T05:54:48.965 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:54:48.965 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:54:48.965 INFO:teuthology.orchestra.run.smithi117.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:54:48.965 INFO:teuthology.orchestra.run.smithi117.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T05:54:48.965 INFO:teuthology.orchestra.run.smithi117.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T05:54:48.965 INFO:teuthology.orchestra.run.smithi117.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T05:54:48.965 INFO:teuthology.orchestra.run.smithi117.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T05:54:48.965 INFO:teuthology.orchestra.run.smithi117.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T05:54:48.965 INFO:teuthology.orchestra.run.smithi117.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:54:48.965 INFO:teuthology.orchestra.run.smithi117.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:54:48.965 INFO:teuthology.orchestra.run.smithi117.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T05:54:48.965 INFO:teuthology.orchestra.run.smithi117.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:54:48.966 INFO:teuthology.orchestra.run.smithi117.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T05:54:48.966 INFO:teuthology.orchestra.run.smithi117.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T05:54:48.966 INFO:teuthology.orchestra.run.smithi117.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T05:54:48.966 INFO:teuthology.orchestra.run.smithi117.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T05:54:48.966 INFO:teuthology.orchestra.run.smithi117.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T05:54:48.966 INFO:teuthology.orchestra.run.smithi117.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T05:54:48.966 INFO:teuthology.orchestra.run.smithi117.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T05:54:48.966 INFO:teuthology.orchestra.run.smithi117.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T05:54:48.966 INFO:teuthology.orchestra.run.smithi117.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T05:54:48.966 INFO:teuthology.orchestra.run.smithi117.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T05:54:48.966 INFO:teuthology.orchestra.run.smithi117.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T05:54:48.966 INFO:teuthology.orchestra.run.smithi117.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T05:54:48.966 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T05:54:48.966 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T05:54:48.967 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T05:54:48.967 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T05:54:48.967 INFO:teuthology.orchestra.run.smithi117.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T05:54:48.967 INFO:teuthology.orchestra.run.smithi117.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T05:54:48.967 INFO:teuthology.orchestra.run.smithi117.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T05:54:48.967 INFO:teuthology.orchestra.run.smithi117.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T05:54:48.967 INFO:teuthology.orchestra.run.smithi117.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T05:54:48.967 INFO:teuthology.orchestra.run.smithi117.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T05:54:48.967 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T05:54:48.967 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:54:48.967 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:54:48.967 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:54:48.967 INFO:teuthology.orchestra.run.smithi117.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T05:54:48.968 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T05:54:48.968 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T05:54:48.968 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T05:54:48.968 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T05:54:48.968 INFO:teuthology.orchestra.run.smithi117.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T05:54:48.968 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T05:54:48.968 INFO:teuthology.orchestra.run.smithi117.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T05:54:48.968 INFO:teuthology.orchestra.run.smithi117.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T05:54:48.968 INFO:teuthology.orchestra.run.smithi117.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T05:54:48.968 INFO:teuthology.orchestra.run.smithi117.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T05:54:48.968 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T05:54:48.968 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T05:54:48.968 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T05:54:48.968 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T05:54:48.969 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T05:54:48.969 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T05:54:48.969 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T05:54:48.969 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T05:54:48.969 INFO:teuthology.orchestra.run.smithi117.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T05:54:48.969 INFO:teuthology.orchestra.run.smithi117.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T05:54:48.969 INFO:teuthology.orchestra.run.smithi117.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T05:54:48.969 INFO:teuthology.orchestra.run.smithi117.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T05:54:48.969 INFO:teuthology.orchestra.run.smithi117.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T05:54:48.969 INFO:teuthology.orchestra.run.smithi117.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T05:54:48.969 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T05:54:48.969 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T05:54:48.969 INFO:teuthology.orchestra.run.smithi117.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T05:54:48.969 INFO:teuthology.orchestra.run.smithi117.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T05:54:48.970 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T05:54:48.970 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T05:54:48.970 INFO:teuthology.orchestra.run.smithi117.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T05:54:48.970 INFO:teuthology.orchestra.run.smithi117.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T05:54:48.970 INFO:teuthology.orchestra.run.smithi117.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T05:54:48.970 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T05:54:48.970 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T05:54:48.970 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T05:54:48.970 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T05:54:48.970 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T05:54:48.970 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T05:54:48.970 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:54:48.970 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:54:48.970 INFO:teuthology.orchestra.run.smithi117.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T05:54:48.971 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T05:54:48.971 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T05:54:48.971 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:54:48.971 INFO:teuthology.orchestra.run.smithi117.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T05:54:48.971 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T05:54:48.971 INFO:teuthology.orchestra.run.smithi117.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T05:54:48.971 INFO:teuthology.orchestra.run.smithi117.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T05:54:48.971 INFO:teuthology.orchestra.run.smithi117.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T05:54:48.971 INFO:teuthology.orchestra.run.smithi117.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T05:54:48.971 INFO:teuthology.orchestra.run.smithi117.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T05:54:48.971 INFO:teuthology.orchestra.run.smithi117.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T05:54:48.971 INFO:teuthology.orchestra.run.smithi117.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T05:54:48.971 INFO:teuthology.orchestra.run.smithi117.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T05:54:48.971 INFO:teuthology.orchestra.run.smithi117.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T05:54:48.972 INFO:teuthology.orchestra.run.smithi117.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T05:54:48.972 INFO:teuthology.orchestra.run.smithi117.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T05:54:48.972 INFO:teuthology.orchestra.run.smithi117.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T05:54:48.972 INFO:teuthology.orchestra.run.smithi117.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T05:54:48.972 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:54:48.972 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:54:48.972 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:54:48.972 INFO:teuthology.orchestra.run.smithi117.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T05:54:48.972 INFO:teuthology.orchestra.run.smithi117.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T05:54:48.972 INFO:teuthology.orchestra.run.smithi117.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T05:54:48.972 INFO:teuthology.orchestra.run.smithi117.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T05:54:48.972 INFO:teuthology.orchestra.run.smithi117.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T05:54:48.972 INFO:teuthology.orchestra.run.smithi117.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T05:54:48.973 INFO:teuthology.orchestra.run.smithi117.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T05:54:48.973 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T05:54:48.973 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-09-19T05:54:49.385 DEBUG:teuthology.parallel:result is None 2024-09-19T05:54:49.787 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T05:54:49.787 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T05:54:49.787 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T05:54:49.787 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T05:54:49.787 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T05:54:49.788 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T05:54:49.788 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T05:54:49.788 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T05:54:49.788 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T05:54:49.788 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T05:54:49.788 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T05:54:49.788 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T05:54:49.788 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T05:54:49.788 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T05:54:49.788 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T05:54:49.788 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T05:54:49.788 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T05:54:49.788 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T05:54:49.789 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T05:54:49.789 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T05:54:49.789 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T05:54:49.789 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T05:54:49.789 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T05:54:49.789 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T05:54:49.789 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T05:54:49.789 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T05:54:49.789 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T05:54:49.789 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T05:54:49.789 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T05:54:49.789 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T05:54:49.789 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T05:54:49.789 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T05:54:49.790 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T05:54:49.790 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T05:54:49.790 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T05:54:49.790 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T05:54:49.790 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T05:54:49.790 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T05:54:49.790 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T05:54:49.790 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T05:54:49.790 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T05:54:49.790 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T05:54:49.790 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T05:54:49.790 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T05:54:49.790 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T05:54:49.790 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T05:54:49.791 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T05:54:49.791 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T05:54:49.791 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T05:54:49.791 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T05:54:49.791 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T05:54:49.791 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T05:54:49.791 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T05:54:49.791 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T05:54:49.791 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T05:54:49.791 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T05:54:49.791 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T05:54:49.791 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T05:54:49.791 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T05:54:49.791 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T05:54:49.792 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T05:54:49.792 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T05:54:49.792 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T05:54:49.792 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T05:54:49.792 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T05:54:49.792 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T05:54:49.792 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T05:54:49.792 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T05:54:49.792 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T05:54:49.792 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T05:54:49.792 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T05:54:49.792 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T05:54:49.792 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T05:54:49.792 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T05:54:49.793 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T05:54:49.793 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T05:54:49.793 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T05:54:49.793 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T05:54:49.793 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T05:54:49.793 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T05:54:49.793 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T05:54:49.793 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T05:54:49.793 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T05:54:49.793 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T05:54:49.793 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T05:54:49.793 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T05:54:49.793 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T05:54:49.793 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T05:54:49.794 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T05:54:49.794 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T05:54:49.794 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T05:54:49.794 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T05:54:49.794 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T05:54:49.794 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T05:54:49.794 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T05:54:49.794 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T05:54:49.794 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T05:54:49.794 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T05:54:49.794 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T05:54:49.794 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T05:54:49.794 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T05:54:49.794 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T05:54:49.795 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T05:54:49.795 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T05:54:49.795 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T05:54:49.795 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T05:54:49.795 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T05:54:49.795 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T05:54:49.795 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T05:54:49.795 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T05:54:49.795 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T05:54:49.795 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T05:54:49.795 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T05:54:49.795 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T05:54:49.795 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T05:54:49.796 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T05:54:49.796 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T05:54:49.796 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T05:54:49.796 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T05:54:49.796 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T05:54:49.796 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T05:54:49.796 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T05:54:49.796 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T05:54:49.796 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T05:54:49.796 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T05:54:49.796 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T05:54:49.796 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T05:54:49.796 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T05:54:49.796 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T05:54:49.797 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T05:54:49.797 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T05:54:49.797 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T05:54:49.797 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T05:54:49.797 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T05:54:49.797 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T05:54:49.797 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T05:54:49.797 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T05:54:49.797 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T05:54:49.797 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T05:54:49.797 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T05:54:49.797 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T05:54:49.797 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T05:54:49.798 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T05:54:49.798 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T05:54:49.798 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T05:54:49.798 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T05:54:49.798 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T05:54:49.798 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T05:54:49.798 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T05:54:49.798 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T05:54:49.798 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T05:54:49.798 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T05:54:49.798 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T05:54:49.798 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T05:54:49.798 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T05:54:49.798 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T05:54:49.798 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T05:54:49.799 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T05:54:49.799 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T05:54:49.799 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T05:54:49.799 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T05:54:49.799 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T05:54:49.799 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T05:54:49.799 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T05:54:52.479 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T05:54:52.479 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T05:54:52.479 INFO:teuthology.orchestra.run.smithi099.stdout:Upgraded: 2024-09-19T05:54:52.479 INFO:teuthology.orchestra.run.smithi099.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T05:54:52.479 INFO:teuthology.orchestra.run.smithi099.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T05:54:52.479 INFO:teuthology.orchestra.run.smithi099.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T05:54:52.479 INFO:teuthology.orchestra.run.smithi099.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T05:54:52.479 INFO:teuthology.orchestra.run.smithi099.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:54:52.479 INFO:teuthology.orchestra.run.smithi099.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:54:52.479 INFO:teuthology.orchestra.run.smithi099.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T05:54:52.480 INFO:teuthology.orchestra.run.smithi099.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T05:54:52.480 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-09-19T05:54:52.480 INFO:teuthology.orchestra.run.smithi099.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T05:54:52.480 INFO:teuthology.orchestra.run.smithi099.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T05:54:52.480 INFO:teuthology.orchestra.run.smithi099.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T05:54:52.480 INFO:teuthology.orchestra.run.smithi099.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T05:54:52.480 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:54:52.480 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:54:52.480 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:54:52.480 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:54:52.480 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:54:52.480 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:54:52.481 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:54:52.481 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:54:52.481 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:54:52.481 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:54:52.481 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:54:52.481 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:54:52.481 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:54:52.481 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:54:52.481 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:54:52.481 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:54:52.481 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:54:52.481 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:54:52.482 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:54:52.482 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:54:52.482 INFO:teuthology.orchestra.run.smithi099.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:54:52.482 INFO:teuthology.orchestra.run.smithi099.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:54:52.482 INFO:teuthology.orchestra.run.smithi099.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:54:52.482 INFO:teuthology.orchestra.run.smithi099.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:54:52.482 INFO:teuthology.orchestra.run.smithi099.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T05:54:52.482 INFO:teuthology.orchestra.run.smithi099.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T05:54:52.482 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T05:54:52.482 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T05:54:52.482 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T05:54:52.482 INFO:teuthology.orchestra.run.smithi099.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T05:54:52.482 INFO:teuthology.orchestra.run.smithi099.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T05:54:52.482 INFO:teuthology.orchestra.run.smithi099.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T05:54:52.483 INFO:teuthology.orchestra.run.smithi099.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T05:54:52.483 INFO:teuthology.orchestra.run.smithi099.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T05:54:52.483 INFO:teuthology.orchestra.run.smithi099.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T05:54:52.483 INFO:teuthology.orchestra.run.smithi099.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:54:52.483 INFO:teuthology.orchestra.run.smithi099.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:54:52.483 INFO:teuthology.orchestra.run.smithi099.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:54:52.483 INFO:teuthology.orchestra.run.smithi099.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T05:54:52.483 INFO:teuthology.orchestra.run.smithi099.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T05:54:52.483 INFO:teuthology.orchestra.run.smithi099.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T05:54:52.483 INFO:teuthology.orchestra.run.smithi099.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T05:54:52.483 INFO:teuthology.orchestra.run.smithi099.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T05:54:52.483 INFO:teuthology.orchestra.run.smithi099.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:54:52.483 INFO:teuthology.orchestra.run.smithi099.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:54:52.484 INFO:teuthology.orchestra.run.smithi099.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T05:54:52.484 INFO:teuthology.orchestra.run.smithi099.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:54:52.484 INFO:teuthology.orchestra.run.smithi099.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T05:54:52.484 INFO:teuthology.orchestra.run.smithi099.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T05:54:52.484 INFO:teuthology.orchestra.run.smithi099.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T05:54:52.484 INFO:teuthology.orchestra.run.smithi099.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T05:54:52.484 INFO:teuthology.orchestra.run.smithi099.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T05:54:52.484 INFO:teuthology.orchestra.run.smithi099.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T05:54:52.484 INFO:teuthology.orchestra.run.smithi099.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T05:54:52.484 INFO:teuthology.orchestra.run.smithi099.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T05:54:52.484 INFO:teuthology.orchestra.run.smithi099.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T05:54:52.484 INFO:teuthology.orchestra.run.smithi099.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T05:54:52.484 INFO:teuthology.orchestra.run.smithi099.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T05:54:52.484 INFO:teuthology.orchestra.run.smithi099.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T05:54:52.485 INFO:teuthology.orchestra.run.smithi099.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T05:54:52.485 INFO:teuthology.orchestra.run.smithi099.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T05:54:52.485 INFO:teuthology.orchestra.run.smithi099.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T05:54:52.485 INFO:teuthology.orchestra.run.smithi099.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T05:54:52.485 INFO:teuthology.orchestra.run.smithi099.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T05:54:52.485 INFO:teuthology.orchestra.run.smithi099.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T05:54:52.485 INFO:teuthology.orchestra.run.smithi099.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T05:54:52.485 INFO:teuthology.orchestra.run.smithi099.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T05:54:52.485 INFO:teuthology.orchestra.run.smithi099.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T05:54:52.485 INFO:teuthology.orchestra.run.smithi099.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T05:54:52.485 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T05:54:52.485 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:54:52.485 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:54:52.486 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:54:52.486 INFO:teuthology.orchestra.run.smithi099.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T05:54:52.486 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T05:54:52.486 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T05:54:52.486 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T05:54:52.486 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T05:54:52.486 INFO:teuthology.orchestra.run.smithi099.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T05:54:52.486 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T05:54:52.486 INFO:teuthology.orchestra.run.smithi099.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T05:54:52.486 INFO:teuthology.orchestra.run.smithi099.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T05:54:52.486 INFO:teuthology.orchestra.run.smithi099.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T05:54:52.486 INFO:teuthology.orchestra.run.smithi099.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T05:54:52.486 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T05:54:52.486 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T05:54:52.487 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T05:54:52.487 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T05:54:52.487 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T05:54:52.487 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T05:54:52.487 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T05:54:52.487 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T05:54:52.487 INFO:teuthology.orchestra.run.smithi099.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T05:54:52.487 INFO:teuthology.orchestra.run.smithi099.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T05:54:52.487 INFO:teuthology.orchestra.run.smithi099.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T05:54:52.487 INFO:teuthology.orchestra.run.smithi099.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T05:54:52.487 INFO:teuthology.orchestra.run.smithi099.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T05:54:52.487 INFO:teuthology.orchestra.run.smithi099.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T05:54:52.487 INFO:teuthology.orchestra.run.smithi099.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T05:54:52.487 INFO:teuthology.orchestra.run.smithi099.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T05:54:52.488 INFO:teuthology.orchestra.run.smithi099.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T05:54:52.488 INFO:teuthology.orchestra.run.smithi099.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T05:54:52.488 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T05:54:52.488 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T05:54:52.488 INFO:teuthology.orchestra.run.smithi099.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T05:54:52.488 INFO:teuthology.orchestra.run.smithi099.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T05:54:52.488 INFO:teuthology.orchestra.run.smithi099.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T05:54:52.488 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T05:54:52.488 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T05:54:52.488 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T05:54:52.488 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T05:54:52.488 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T05:54:52.488 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T05:54:52.488 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:54:52.488 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:54:52.489 INFO:teuthology.orchestra.run.smithi099.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T05:54:52.489 INFO:teuthology.orchestra.run.smithi099.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T05:54:52.489 INFO:teuthology.orchestra.run.smithi099.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T05:54:52.489 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:54:52.489 INFO:teuthology.orchestra.run.smithi099.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T05:54:52.489 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T05:54:52.489 INFO:teuthology.orchestra.run.smithi099.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T05:54:52.489 INFO:teuthology.orchestra.run.smithi099.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T05:54:52.489 INFO:teuthology.orchestra.run.smithi099.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T05:54:52.489 INFO:teuthology.orchestra.run.smithi099.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T05:54:52.489 INFO:teuthology.orchestra.run.smithi099.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T05:54:52.489 INFO:teuthology.orchestra.run.smithi099.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T05:54:52.489 INFO:teuthology.orchestra.run.smithi099.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T05:54:52.489 INFO:teuthology.orchestra.run.smithi099.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T05:54:52.489 INFO:teuthology.orchestra.run.smithi099.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T05:54:52.489 INFO:teuthology.orchestra.run.smithi099.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T05:54:52.490 INFO:teuthology.orchestra.run.smithi099.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T05:54:52.490 INFO:teuthology.orchestra.run.smithi099.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T05:54:52.490 INFO:teuthology.orchestra.run.smithi099.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T05:54:52.490 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:54:52.490 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:54:52.490 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:54:52.490 INFO:teuthology.orchestra.run.smithi099.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T05:54:52.490 INFO:teuthology.orchestra.run.smithi099.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T05:54:52.490 INFO:teuthology.orchestra.run.smithi099.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T05:54:52.490 INFO:teuthology.orchestra.run.smithi099.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T05:54:52.490 INFO:teuthology.orchestra.run.smithi099.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T05:54:52.490 INFO:teuthology.orchestra.run.smithi099.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T05:54:52.491 INFO:teuthology.orchestra.run.smithi099.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T05:54:52.491 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T05:54:52.491 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-19T05:54:52.924 DEBUG:teuthology.parallel:result is None 2024-09-19T05:54:53.364 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T05:54:53.406 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T05:54:53.447 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T05:54:53.478 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T05:54:53.505 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T05:54:53.707 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T05:54:53.752 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T05:54:53.782 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T05:54:53.812 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T05:54:53.858 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T05:54:54.500 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T05:54:54.539 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T05:54:54.561 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T05:54:55.464 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T05:54:55.552 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T05:54:55.602 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T05:54:55.703 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T05:54:55.738 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T05:54:55.764 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T05:54:55.798 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T05:54:55.798 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T05:54:55.890 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T05:54:55.890 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T05:54:55.991 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T05:54:56.016 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T05:54:56.022 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T05:54:56.022 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T05:54:56.218 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T05:54:56.218 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T05:54:56.302 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T05:54:56.370 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T05:55:01.994 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T05:55:01.994 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T05:55:01.995 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T05:55:01.995 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T05:55:01.995 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T05:55:01.995 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T05:55:01.995 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T05:55:01.995 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T05:55:01.995 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T05:55:01.995 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T05:55:01.995 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T05:55:01.995 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T05:55:01.995 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T05:55:01.996 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T05:55:01.996 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T05:55:01.996 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T05:55:01.996 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T05:55:01.996 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T05:55:01.996 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T05:55:01.996 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T05:55:01.996 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T05:55:01.996 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T05:55:01.997 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T05:55:01.997 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T05:55:01.997 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T05:55:01.997 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T05:55:01.997 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T05:55:01.997 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T05:55:01.997 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T05:55:01.997 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T05:55:02.009 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T05:55:02.009 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T05:55:02.009 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T05:55:02.009 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T05:55:02.009 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T05:55:02.009 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T05:55:02.010 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T05:55:02.010 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T05:55:02.010 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T05:55:02.010 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T05:55:02.010 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T05:55:02.010 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T05:55:02.010 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T05:55:02.010 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T05:55:02.010 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T05:55:02.010 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T05:55:02.010 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T05:55:02.010 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T05:55:02.010 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T05:55:02.010 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T05:55:02.011 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T05:55:02.011 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T05:55:02.011 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T05:55:02.011 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T05:55:02.011 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T05:55:02.011 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T05:55:02.011 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T05:55:02.011 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T05:55:02.011 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T05:55:02.011 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T05:55:02.011 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T05:55:02.011 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T05:55:02.011 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T05:55:02.012 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T05:55:02.012 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T05:55:02.012 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T05:55:02.012 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T05:55:02.012 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T05:55:02.012 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T05:55:02.012 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T05:55:02.012 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T05:55:02.012 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T05:55:02.013 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T05:55:02.013 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T05:55:02.013 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T05:55:02.013 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T05:55:02.013 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T05:55:02.013 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T05:55:02.013 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T05:55:02.013 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T05:55:02.013 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T05:55:02.013 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T05:55:02.013 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T05:55:02.013 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T05:55:02.013 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T05:55:02.014 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T05:55:02.014 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T05:55:02.014 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T05:55:02.014 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T05:55:02.014 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T05:55:02.014 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T05:55:02.014 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T05:55:02.014 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T05:55:02.014 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T05:55:02.014 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T05:55:02.014 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T05:55:02.014 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T05:55:02.014 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T05:55:02.014 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T05:55:02.014 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T05:55:02.015 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T05:55:02.015 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T05:55:02.015 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T05:55:02.015 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T05:55:02.015 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T05:55:02.015 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T05:55:02.015 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T05:55:02.015 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T05:55:02.015 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T05:55:02.015 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T05:55:02.015 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T05:55:02.015 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T05:55:02.015 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T05:55:02.015 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T05:55:02.016 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T05:55:02.016 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T05:55:02.016 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T05:55:02.016 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T05:55:02.016 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T05:55:02.016 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T05:55:02.016 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T05:55:02.016 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T05:55:02.016 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T05:55:02.016 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T05:55:02.016 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T05:55:02.016 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T05:55:02.016 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T05:55:02.016 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T05:55:02.016 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T05:55:02.017 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T05:55:02.017 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T05:55:02.017 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T05:55:02.017 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T05:55:02.017 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T05:55:02.017 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T05:55:02.017 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T05:55:02.017 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T05:55:02.017 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T05:55:02.017 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T05:55:02.017 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T05:55:02.017 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T05:55:02.017 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T05:55:02.018 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T05:55:02.018 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T05:55:02.018 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T05:55:02.018 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T05:55:02.018 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T05:55:02.018 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T05:55:02.018 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T05:55:02.018 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T05:55:02.018 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T05:55:02.018 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T05:55:02.018 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T05:55:02.018 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T05:55:02.018 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T05:55:02.018 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T05:55:02.019 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T05:55:02.019 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T05:55:02.019 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T05:55:02.019 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T05:55:02.019 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T05:55:02.019 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T05:55:02.019 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T05:55:02.019 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T05:55:04.632 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T05:55:04.632 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T05:55:04.633 INFO:teuthology.orchestra.run.smithi037.stdout:Upgraded: 2024-09-19T05:55:04.633 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T05:55:04.633 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T05:55:04.633 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T05:55:04.633 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T05:55:04.633 INFO:teuthology.orchestra.run.smithi037.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:55:04.633 INFO:teuthology.orchestra.run.smithi037.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:55:04.633 INFO:teuthology.orchestra.run.smithi037.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T05:55:04.633 INFO:teuthology.orchestra.run.smithi037.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T05:55:04.633 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-09-19T05:55:04.633 INFO:teuthology.orchestra.run.smithi037.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T05:55:04.633 INFO:teuthology.orchestra.run.smithi037.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T05:55:04.634 INFO:teuthology.orchestra.run.smithi037.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T05:55:04.634 INFO:teuthology.orchestra.run.smithi037.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T05:55:04.634 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:55:04.634 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:55:04.634 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:55:04.634 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:55:04.634 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:55:04.634 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:55:04.634 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:55:04.634 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:55:04.634 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:55:04.634 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:55:04.634 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:55:04.635 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:55:04.635 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:55:04.635 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:55:04.635 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:55:04.635 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:55:04.635 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:55:04.635 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:55:04.635 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:55:04.635 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:55:04.635 INFO:teuthology.orchestra.run.smithi037.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:55:04.635 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:55:04.635 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:55:04.635 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:55:04.635 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T05:55:04.636 INFO:teuthology.orchestra.run.smithi037.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T05:55:04.636 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T05:55:04.636 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T05:55:04.636 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T05:55:04.636 INFO:teuthology.orchestra.run.smithi037.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T05:55:04.636 INFO:teuthology.orchestra.run.smithi037.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T05:55:04.636 INFO:teuthology.orchestra.run.smithi037.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T05:55:04.636 INFO:teuthology.orchestra.run.smithi037.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T05:55:04.636 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T05:55:04.636 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T05:55:04.636 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:55:04.636 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:55:04.636 INFO:teuthology.orchestra.run.smithi037.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:55:04.636 INFO:teuthology.orchestra.run.smithi037.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T05:55:04.636 INFO:teuthology.orchestra.run.smithi037.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T05:55:04.636 INFO:teuthology.orchestra.run.smithi037.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T05:55:04.637 INFO:teuthology.orchestra.run.smithi037.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T05:55:04.637 INFO:teuthology.orchestra.run.smithi037.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T05:55:04.637 INFO:teuthology.orchestra.run.smithi037.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:55:04.637 INFO:teuthology.orchestra.run.smithi037.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:55:04.637 INFO:teuthology.orchestra.run.smithi037.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T05:55:04.637 INFO:teuthology.orchestra.run.smithi037.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:55:04.637 INFO:teuthology.orchestra.run.smithi037.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T05:55:04.637 INFO:teuthology.orchestra.run.smithi037.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T05:55:04.637 INFO:teuthology.orchestra.run.smithi037.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T05:55:04.637 INFO:teuthology.orchestra.run.smithi037.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T05:55:04.637 INFO:teuthology.orchestra.run.smithi037.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T05:55:04.637 INFO:teuthology.orchestra.run.smithi037.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T05:55:04.637 INFO:teuthology.orchestra.run.smithi037.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T05:55:04.638 INFO:teuthology.orchestra.run.smithi037.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T05:55:04.638 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T05:55:04.638 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T05:55:04.638 INFO:teuthology.orchestra.run.smithi037.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T05:55:04.638 INFO:teuthology.orchestra.run.smithi037.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T05:55:04.638 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T05:55:04.638 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T05:55:04.638 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T05:55:04.638 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T05:55:04.638 INFO:teuthology.orchestra.run.smithi037.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T05:55:04.639 INFO:teuthology.orchestra.run.smithi037.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T05:55:04.639 INFO:teuthology.orchestra.run.smithi037.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T05:55:04.639 INFO:teuthology.orchestra.run.smithi037.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T05:55:04.639 INFO:teuthology.orchestra.run.smithi037.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T05:55:04.639 INFO:teuthology.orchestra.run.smithi037.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T05:55:04.639 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T05:55:04.639 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:55:04.639 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:55:04.639 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:55:04.639 INFO:teuthology.orchestra.run.smithi037.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T05:55:04.639 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T05:55:04.639 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T05:55:04.639 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T05:55:04.640 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T05:55:04.640 INFO:teuthology.orchestra.run.smithi037.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T05:55:04.640 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T05:55:04.640 INFO:teuthology.orchestra.run.smithi037.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T05:55:04.640 INFO:teuthology.orchestra.run.smithi037.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T05:55:04.640 INFO:teuthology.orchestra.run.smithi037.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T05:55:04.640 INFO:teuthology.orchestra.run.smithi037.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T05:55:04.640 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T05:55:04.640 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T05:55:04.640 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T05:55:04.640 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T05:55:04.640 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T05:55:04.641 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T05:55:04.641 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T05:55:04.641 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T05:55:04.641 INFO:teuthology.orchestra.run.smithi037.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T05:55:04.641 INFO:teuthology.orchestra.run.smithi037.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T05:55:04.641 INFO:teuthology.orchestra.run.smithi037.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T05:55:04.641 INFO:teuthology.orchestra.run.smithi037.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T05:55:04.641 INFO:teuthology.orchestra.run.smithi037.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T05:55:04.641 INFO:teuthology.orchestra.run.smithi037.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T05:55:04.641 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T05:55:04.641 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T05:55:04.641 INFO:teuthology.orchestra.run.smithi037.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T05:55:04.642 INFO:teuthology.orchestra.run.smithi037.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T05:55:04.642 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T05:55:04.642 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T05:55:04.642 INFO:teuthology.orchestra.run.smithi037.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T05:55:04.642 INFO:teuthology.orchestra.run.smithi037.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T05:55:04.642 INFO:teuthology.orchestra.run.smithi037.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T05:55:04.642 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T05:55:04.642 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T05:55:04.642 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T05:55:04.642 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T05:55:04.642 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T05:55:04.642 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T05:55:04.642 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:55:04.642 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:55:04.642 INFO:teuthology.orchestra.run.smithi037.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T05:55:04.643 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T05:55:04.643 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T05:55:04.643 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:55:04.643 INFO:teuthology.orchestra.run.smithi037.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T05:55:04.643 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T05:55:04.643 INFO:teuthology.orchestra.run.smithi037.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T05:55:04.643 INFO:teuthology.orchestra.run.smithi037.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T05:55:04.643 INFO:teuthology.orchestra.run.smithi037.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T05:55:04.643 INFO:teuthology.orchestra.run.smithi037.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T05:55:04.643 INFO:teuthology.orchestra.run.smithi037.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T05:55:04.643 INFO:teuthology.orchestra.run.smithi037.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T05:55:04.643 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T05:55:04.643 INFO:teuthology.orchestra.run.smithi037.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T05:55:04.643 INFO:teuthology.orchestra.run.smithi037.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T05:55:04.644 INFO:teuthology.orchestra.run.smithi037.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T05:55:04.644 INFO:teuthology.orchestra.run.smithi037.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T05:55:04.644 INFO:teuthology.orchestra.run.smithi037.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T05:55:04.644 INFO:teuthology.orchestra.run.smithi037.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T05:55:04.644 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:55:04.644 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:55:04.644 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:55:04.644 INFO:teuthology.orchestra.run.smithi037.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T05:55:04.644 INFO:teuthology.orchestra.run.smithi037.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T05:55:04.644 INFO:teuthology.orchestra.run.smithi037.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T05:55:04.644 INFO:teuthology.orchestra.run.smithi037.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T05:55:04.644 INFO:teuthology.orchestra.run.smithi037.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T05:55:04.644 INFO:teuthology.orchestra.run.smithi037.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T05:55:04.645 INFO:teuthology.orchestra.run.smithi037.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T05:55:04.645 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T05:55:04.645 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-09-19T05:55:05.056 DEBUG:teuthology.parallel:result is None 2024-09-19T05:55:05.057 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T05:55:05.206 DEBUG:teuthology.orchestra.run.smithi037:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T05:55:05.230 INFO:teuthology.orchestra.run.smithi037.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T05:55:05.231 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T05:55:05.231 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T05:55:05.233 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T05:55:05.381 DEBUG:teuthology.orchestra.run.smithi099:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T05:55:05.408 INFO:teuthology.orchestra.run.smithi099.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T05:55:05.408 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T05:55:05.408 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T05:55:05.410 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T05:55:05.548 DEBUG:teuthology.orchestra.run.smithi117:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T05:55:05.575 INFO:teuthology.orchestra.run.smithi117.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T05:55:05.575 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T05:55:05.575 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T05:55:05.577 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-19T05:55:05.578 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-19T05:55:05.578 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T05:55:05.610 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-19T05:55:05.610 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T05:55:05.642 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-19T05:55:05.642 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T05:55:05.674 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-19T05:55:05.674 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-19T05:55:05.674 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T05:55:05.703 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T05:55:05.771 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-19T05:55:05.771 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T05:55:05.804 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T05:55:05.873 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-19T05:55:05.873 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T05:55:05.903 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T05:55:05.987 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-19T05:55:05.988 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-19T05:55:05.988 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T05:55:06.018 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T05:55:06.089 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-19T05:55:06.089 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T05:55:06.114 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T05:55:06.179 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-19T05:55:06.179 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T05:55:06.204 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T05:55:06.269 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-19T05:55:06.270 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-19T05:55:06.270 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T05:55:06.301 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T05:55:06.370 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-19T05:55:06.370 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T05:55:06.395 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T05:55:06.460 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-19T05:55:06.461 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T05:55:06.485 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T05:55:06.550 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-19T05:55:06.655 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 1, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-09-19T05:55:06.655 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T05:55:06.656 INFO:tasks.cephadm:Cluster fsid is b8c8bdae-764b-11ef-bceb-c7b262605968 2024-09-19T05:55:06.656 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-19T05:55:06.656 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.37', 'mon.b': '172.21.15.99', 'mon.c': '172.21.15.117'} 2024-09-19T05:55:06.656 INFO:tasks.cephadm:First mon is mon.a on smithi037 2024-09-19T05:55:06.656 INFO:tasks.cephadm:First mgr is x 2024-09-19T05:55:06.657 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-19T05:55:06.657 DEBUG:teuthology.orchestra.run.smithi037:> sudo hostname $(hostname -s) 2024-09-19T05:55:06.688 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname $(hostname -s) 2024-09-19T05:55:06.714 DEBUG:teuthology.orchestra.run.smithi117:> sudo hostname $(hostname -s) 2024-09-19T05:55:06.739 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-19T05:55:06.739 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T05:55:06.890 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/56106/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-361-g2f599a46', 'node_name': '172.21.2.7+braggi07', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-361.g2f599a46'}, 'url': 'https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-18 17:52:24.287651', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-19T05:55:07.030 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref squid, sha1 2f599a46ad10e37c929e5c43da2f6907ddcd1961 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T05:55:07.032 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm 2024-09-19T05:55:07.032 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm 2024-09-19T05:55:07.032 DEBUG:teuthology.orchestra.run.smithi037:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T05:55:07.432 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 05:55 /home/ubuntu/cephtest/cephadm 2024-09-19T05:55:07.432 DEBUG:teuthology.orchestra.run.smithi099:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T05:55:07.828 INFO:teuthology.orchestra.run.smithi099.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 05:55 /home/ubuntu/cephtest/cephadm 2024-09-19T05:55:07.829 DEBUG:teuthology.orchestra.run.smithi117:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T05:55:08.231 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 05:55 /home/ubuntu/cephtest/cephadm 2024-09-19T05:55:08.231 DEBUG:teuthology.orchestra.run.smithi037:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T05:55:08.252 DEBUG:teuthology.orchestra.run.smithi099:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T05:55:08.271 DEBUG:teuthology.orchestra.run.smithi117:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T05:55:08.318 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 on all hosts... 2024-09-19T05:55:08.319 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T05:55:08.321 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T05:55:08.324 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T05:55:09.824 INFO:teuthology.orchestra.run.smithi099.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T05:55:09.929 INFO:teuthology.orchestra.run.smithi117.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T05:55:09.940 INFO:teuthology.orchestra.run.smithi037.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T05:55:41.346 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-09-19T05:55:41.347 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T05:55:41.347 INFO:teuthology.orchestra.run.smithi117.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T05:55:41.347 INFO:teuthology.orchestra.run.smithi117.stdout: "repo_digests": [ 2024-09-19T05:55:41.347 INFO:teuthology.orchestra.run.smithi117.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T05:55:41.347 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2024-09-19T05:55:41.347 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-09-19T05:56:12.473 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-19T05:56:12.473 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T05:56:12.473 INFO:teuthology.orchestra.run.smithi037.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T05:56:12.473 INFO:teuthology.orchestra.run.smithi037.stdout: "repo_digests": [ 2024-09-19T05:56:12.473 INFO:teuthology.orchestra.run.smithi037.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T05:56:12.473 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-09-19T05:56:12.473 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-19T05:56:13.231 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T05:56:13.231 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T05:56:13.231 INFO:teuthology.orchestra.run.smithi099.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T05:56:13.231 INFO:teuthology.orchestra.run.smithi099.stdout: "repo_digests": [ 2024-09-19T05:56:13.231 INFO:teuthology.orchestra.run.smithi099.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T05:56:13.231 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-19T05:56:13.232 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T05:56:13.256 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /etc/ceph 2024-09-19T05:56:13.290 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /etc/ceph 2024-09-19T05:56:13.317 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /etc/ceph 2024-09-19T05:56:13.351 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 777 /etc/ceph 2024-09-19T05:56:13.382 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 777 /etc/ceph 2024-09-19T05:56:13.406 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 777 /etc/ceph 2024-09-19T05:56:13.435 INFO:tasks.cephadm:Writing seed config... 2024-09-19T05:56:13.436 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-19T05:56:13.436 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-19T05:56:13.436 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-19T05:56:13.436 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-19T05:56:13.436 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-19T05:56:13.436 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-19T05:56:13.436 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-19T05:56:13.437 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-19T05:56:13.437 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-19T05:56:13.437 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-19T05:56:13.437 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-19T05:56:13.437 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-19T05:56:13.437 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-19T05:56:13.437 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-19T05:56:13.437 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-19T05:56:13.437 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-19T05:56:13.438 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-19T05:56:13.438 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-19T05:56:13.438 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-19T05:56:13.438 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-19T05:56:13.438 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-19T05:56:13.438 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-19T05:56:13.438 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-19T05:56:13.438 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-19T05:56:13.438 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-19T05:56:13.438 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-19T05:56:13.438 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-19T05:56:13.438 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-19T05:56:13.438 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-19T05:56:13.439 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-19T05:56:13.439 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-19T05:56:13.439 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-19T05:56:13.439 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-09-19T05:56:13.439 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-09-19T05:56:13.439 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-19T05:56:13.439 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-19T05:56:13.439 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-09-19T05:56:13.439 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-19T05:56:13.439 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-19T05:56:13.439 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-19T05:56:13.439 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-19T05:56:13.439 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-19T05:56:13.440 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-19T05:56:13.440 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-19T05:56:13.440 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-09-19T05:56:13.440 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-19T05:56:13.441 DEBUG:teuthology.orchestra.run.smithi037:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-19T05:56:13.459 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = b8c8bdae-764b-11ef-bceb-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-19T05:56:13.460 DEBUG:teuthology.orchestra.run.smithi037:mon.a> sudo journalctl -f -n 0 -u ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@mon.a.service 2024-09-19T05:56:13.502 DEBUG:teuthology.orchestra.run.smithi037:mgr.x> sudo journalctl -f -n 0 -u ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@mgr.x.service 2024-09-19T05:56:13.544 INFO:tasks.cephadm:Bootstrapping... 2024-09-19T05:56:13.545 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 -v bootstrap --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.37 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-19T05:56:13.758 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-09-19T05:56:13.759 INFO:teuthology.orchestra.run.smithi037.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961', '-v', 'bootstrap', '--fsid', 'b8c8bdae-764b-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.37', '--skip-admin-label'] 2024-09-19T05:56:13.759 INFO:teuthology.orchestra.run.smithi037.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-19T05:56:13.759 INFO:teuthology.orchestra.run.smithi037.stdout:Verifying podman|docker is present... 2024-09-19T05:56:13.784 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stdout 5.2.2 2024-09-19T05:56:13.784 INFO:teuthology.orchestra.run.smithi037.stdout:Verifying lvm2 is present... 2024-09-19T05:56:13.784 INFO:teuthology.orchestra.run.smithi037.stdout:Verifying time synchronization is in place... 2024-09-19T05:56:13.792 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-19T05:56:13.792 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-19T05:56:13.798 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-19T05:56:13.798 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout inactive 2024-09-19T05:56:13.805 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout enabled 2024-09-19T05:56:13.812 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout active 2024-09-19T05:56:13.812 INFO:teuthology.orchestra.run.smithi037.stdout:Unit chronyd.service is enabled and running 2024-09-19T05:56:13.812 INFO:teuthology.orchestra.run.smithi037.stdout:Repeating the final host check... 2024-09-19T05:56:13.835 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stdout 5.2.2 2024-09-19T05:56:13.835 INFO:teuthology.orchestra.run.smithi037.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-19T05:56:13.835 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl is present 2024-09-19T05:56:13.835 INFO:teuthology.orchestra.run.smithi037.stdout:lvcreate is present 2024-09-19T05:56:13.842 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-19T05:56:13.842 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-19T05:56:13.849 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-19T05:56:13.849 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout inactive 2024-09-19T05:56:13.856 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout enabled 2024-09-19T05:56:13.862 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout active 2024-09-19T05:56:13.862 INFO:teuthology.orchestra.run.smithi037.stdout:Unit chronyd.service is enabled and running 2024-09-19T05:56:13.862 INFO:teuthology.orchestra.run.smithi037.stdout:Host looks OK 2024-09-19T05:56:13.862 INFO:teuthology.orchestra.run.smithi037.stdout:Cluster fsid: b8c8bdae-764b-11ef-bceb-c7b262605968 2024-09-19T05:56:13.863 INFO:teuthology.orchestra.run.smithi037.stdout:Acquiring lock 140580576191488 on /run/cephadm/b8c8bdae-764b-11ef-bceb-c7b262605968.lock 2024-09-19T05:56:13.863 INFO:teuthology.orchestra.run.smithi037.stdout:Lock 140580576191488 acquired on /run/cephadm/b8c8bdae-764b-11ef-bceb-c7b262605968.lock 2024-09-19T05:56:13.863 INFO:teuthology.orchestra.run.smithi037.stdout:Verifying IP 172.21.15.37 port 3300 ... 2024-09-19T05:56:13.863 INFO:teuthology.orchestra.run.smithi037.stdout:Verifying IP 172.21.15.37 port 6789 ... 2024-09-19T05:56:13.863 INFO:teuthology.orchestra.run.smithi037.stdout:Base mon IP(s) is [172.21.15.37:3300, 172.21.15.37:6789], mon addrv is [v2:172.21.15.37:3300,v1:172.21.15.37:6789] 2024-09-19T05:56:13.867 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.37 metric 100 2024-09-19T05:56:13.867 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.37 metric 100 2024-09-19T05:56:13.870 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-19T05:56:13.870 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-19T05:56:13.870 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1785sec hoplimit 64 pref medium 2024-09-19T05:56:13.872 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-19T05:56:13.872 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-19T05:56:13.872 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-19T05:56:13.872 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-19T05:56:13.872 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe88:7794/64 scope link 2024-09-19T05:56:13.873 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-19T05:56:13.873 INFO:teuthology.orchestra.run.smithi037.stdout:Mon IP `172.21.15.37` is in CIDR network `172.21.0.0/20` 2024-09-19T05:56:13.873 INFO:teuthology.orchestra.run.smithi037.stdout:Mon IP `172.21.15.37` is in CIDR network `172.21.0.0/20` 2024-09-19T05:56:13.873 INFO:teuthology.orchestra.run.smithi037.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-19T05:56:13.874 INFO:teuthology.orchestra.run.smithi037.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-19T05:56:13.875 INFO:teuthology.orchestra.run.smithi037.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T05:56:14.441 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stdout d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d 2024-09-19T05:56:14.441 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T05:56:14.441 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stderr Getting image source signatures 2024-09-19T05:56:14.441 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stderr Copying blob sha256:c4221751d16d26d2a4b7031ebd71ecffffff13c8cf7401cf95ce80dab3b6d67a 2024-09-19T05:56:14.441 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-19T05:56:14.441 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stderr Copying config sha256:d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d 2024-09-19T05:56:14.441 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-19T05:56:15.270 INFO:teuthology.orchestra.run.smithi037.stdout:ceph: stdout ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable) 2024-09-19T05:56:15.270 INFO:teuthology.orchestra.run.smithi037.stdout:Ceph version: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable) 2024-09-19T05:56:15.270 INFO:teuthology.orchestra.run.smithi037.stdout:Extracting ceph user uid/gid from container image... 2024-09-19T05:56:16.260 INFO:teuthology.orchestra.run.smithi037.stdout:stat: stdout 167 167 2024-09-19T05:56:16.260 INFO:teuthology.orchestra.run.smithi037.stdout:Creating initial keys... 2024-09-19T05:56:17.166 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph-authtool: stdout AQAAvetm1wlNIxAAq0OhRBtmzJWnONbpxmoFbQ== 2024-09-19T05:56:18.137 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph-authtool: stdout AQABvetm7tSqHBAATNEslsRLzAPzFzHmWpcz0Q== 2024-09-19T05:56:19.093 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph-authtool: stdout AQACvetmv30VHRAAvQZFwm9iGKkj1kDkvTFrfA== 2024-09-19T05:56:19.094 INFO:teuthology.orchestra.run.smithi037.stdout:Creating initial monmap... 2024-09-19T05:56:19.983 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-19T05:56:19.983 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-19T05:56:19.983 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to b8c8bdae-764b-11ef-bceb-c7b262605968 2024-09-19T05:56:19.983 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-19T05:56:19.983 INFO:teuthology.orchestra.run.smithi037.stdout:monmaptool for a [v2:172.21.15.37:3300,v1:172.21.15.37:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-19T05:56:19.983 INFO:teuthology.orchestra.run.smithi037.stdout:setting min_mon_release = quincy 2024-09-19T05:56:19.984 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/monmaptool: set fsid to b8c8bdae-764b-11ef-bceb-c7b262605968 2024-09-19T05:56:19.984 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-19T05:56:19.984 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T05:56:19.984 INFO:teuthology.orchestra.run.smithi037.stdout:Creating mon... 2024-09-19T05:56:20.921 INFO:teuthology.orchestra.run.smithi037.stdout:create mon.a on 2024-09-19T05:56:21.137 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-19T05:56:21.300 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-19T05:56:21.500 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-b8c8bdae-764b-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-b8c8bdae-764b-11ef-bceb-c7b262605968.target. 2024-09-19T05:56:21.500 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-b8c8bdae-764b-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-b8c8bdae-764b-11ef-bceb-c7b262605968.target. 2024-09-19T05:56:21.773 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@mon.a 2024-09-19T05:56:21.773 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Failed to reset failed state of unit ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@mon.a.service: Unit ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@mon.a.service not loaded. 2024-09-19T05:56:21.964 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-b8c8bdae-764b-11ef-bceb-c7b262605968.target.wants/ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@mon.a.service → /etc/systemd/system/ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@.service. 2024-09-19T05:56:22.022 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:21 smithi037 systemd[1]: Starting Ceph mon.a for b8c8bdae-764b-11ef-bceb-c7b262605968... 2024-09-19T05:56:22.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:22 smithi037 podman[30826]: 2024-09-19 05:56:22.110626102 +0000 UTC m=+0.016929506 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T05:56:22.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:22 smithi037 podman[30826]: 2024-09-19 05:56:22.253188434 +0000 UTC m=+0.159491823 container create ce8821299b6fee8dcd9934c7f424f985be7b8466355d557be094ce10dd7e05f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mon-a, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T05:56:22.580 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T05:56:22.580 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout disabled 2024-09-19T05:56:22.587 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T05:56:22.587 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout inactive 2024-09-19T05:56:22.588 INFO:teuthology.orchestra.run.smithi037.stdout:firewalld.service is not enabled 2024-09-19T05:56:22.588 INFO:teuthology.orchestra.run.smithi037.stdout:Not possible to enable service . firewalld.service is not available 2024-09-19T05:56:22.588 INFO:teuthology.orchestra.run.smithi037.stdout:Waiting for mon to start... 2024-09-19T05:56:22.588 INFO:teuthology.orchestra.run.smithi037.stdout:Waiting for mon... 2024-09-19T05:56:22.711 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:22 smithi037 podman[30826]: 2024-09-19 05:56:22.4806651 +0000 UTC m=+0.386968513 container init ce8821299b6fee8dcd9934c7f424f985be7b8466355d557be094ce10dd7e05f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4) 2024-09-19T05:56:22.712 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:22 smithi037 podman[30826]: 2024-09-19 05:56:22.484014461 +0000 UTC m=+0.390317856 container start ce8821299b6fee8dcd9934c7f424f985be7b8466355d557be094ce10dd7e05f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mon-a, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-19T05:56:22.712 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:22 smithi037 ceph-mon[30845]: mkfs b8c8bdae-764b-11ef-bceb-c7b262605968 2024-09-19T05:56:22.712 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:22 smithi037 ceph-mon[30845]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-19T05:56:22.712 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:22 smithi037 bash[30826]: ce8821299b6fee8dcd9934c7f424f985be7b8466355d557be094ce10dd7e05f7 2024-09-19T05:56:22.712 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:22 smithi037 systemd[1]: Started Ceph mon.a for b8c8bdae-764b-11ef-bceb-c7b262605968. 2024-09-19T05:56:23.688 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:23 smithi037 ceph-mon[30845]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-19T05:56:23.689 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:23 smithi037 ceph-mon[30845]: monmap epoch 1 2024-09-19T05:56:23.689 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:23 smithi037 ceph-mon[30845]: fsid b8c8bdae-764b-11ef-bceb-c7b262605968 2024-09-19T05:56:23.689 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:23 smithi037 ceph-mon[30845]: last_changed 2024-09-19T05:56:19.390249+0000 2024-09-19T05:56:23.689 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:23 smithi037 ceph-mon[30845]: created 2024-09-19T05:56:19.390249+0000 2024-09-19T05:56:23.689 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:23 smithi037 ceph-mon[30845]: min_mon_release 19 (squid) 2024-09-19T05:56:23.689 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:23 smithi037 ceph-mon[30845]: election_strategy: 1 2024-09-19T05:56:23.689 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:23 smithi037 ceph-mon[30845]: 0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-19T05:56:23.689 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:23 smithi037 ceph-mon[30845]: fsmap 2024-09-19T05:56:23.689 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:23 smithi037 ceph-mon[30845]: osdmap e1: 0 total, 0 up, 0 in 2024-09-19T05:56:23.689 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:23 smithi037 ceph-mon[30845]: mgrmap e1: no daemons active 2024-09-19T05:56:23.689 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:23 smithi037 ceph-mon[30845]: from='client.? 172.21.15.37:0/2225445149' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-19T05:56:23.697 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout cluster: 2024-09-19T05:56:23.697 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout id: b8c8bdae-764b-11ef-bceb-c7b262605968 2024-09-19T05:56:23.697 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-19T05:56:23.698 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-09-19T05:56:23.698 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout services: 2024-09-19T05:56:23.698 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.563096s) 2024-09-19T05:56:23.698 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-19T05:56:23.698 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-19T05:56:23.698 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-09-19T05:56:23.698 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout data: 2024-09-19T05:56:23.698 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-19T05:56:23.698 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-19T05:56:23.698 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-19T05:56:23.698 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout pgs: 2024-09-19T05:56:23.698 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-09-19T05:56:23.698 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:23.012+0000 7fa9a6e5f640 1 Processor -- start 2024-09-19T05:56:23.699 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:23.012+0000 7fa9a6e5f640 1 -- start start 2024-09-19T05:56:23.699 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:23.012+0000 7fa9a6e5f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9a01074d0 0x7fa9a01078d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:56:23.699 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:23.012+0000 7fa9a6e5f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a0107ea0 con 0x7fa9a01074d0 2024-09-19T05:56:23.699 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:23.013+0000 7fa9a4bfb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9a01074d0 0x7fa9a01078d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:56:23.699 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:23.013+0000 7fa9a4bfb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9a01074d0 0x7fa9a01078d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60460/0 (socket says 172.21.15.37:60460) 2024-09-19T05:56:23.699 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:23.013+0000 7fa9a4bfb640 1 -- 172.21.15.37:0/141318071 learned_addr learned my addr 172.21.15.37:0/141318071 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T05:56:23.699 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:23.013+0000 7fa9a4bfb640 1 -- 172.21.15.37:0/141318071 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9a0108680 con 0x7fa9a01074d0 2024-09-19T05:56:23.699 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:23.015+0000 7fa9a4bfb640 1 --2- 172.21.15.37:0/141318071 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9a01074d0 0x7fa9a01078d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fa994009820 tx=0x7fa99402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d95296ab94fcbf7b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:56:23.699 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:23.015+0000 7fa99f7fe640 1 -- 172.21.15.37:0/141318071 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa994037070 con 0x7fa9a01074d0 2024-09-19T05:56:23.700 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:23.015+0000 7fa99f7fe640 1 -- 172.21.15.37:0/141318071 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa994032440 con 0x7fa9a01074d0 2024-09-19T05:56:23.700 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:23.015+0000 7fa99f7fe640 1 -- 172.21.15.37:0/141318071 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa994032740 con 0x7fa9a01074d0 2024-09-19T05:56:23.700 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:23.016+0000 7fa9a6e5f640 1 -- 172.21.15.37:0/141318071 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9a01074d0 msgr2=0x7fa9a01078d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:56:23.700 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:23.016+0000 7fa9a6e5f640 1 --2- 172.21.15.37:0/141318071 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9a01074d0 0x7fa9a01078d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fa994009820 tx=0x7fa99402a270 comp rx=0 tx=0).stop 2024-09-19T05:56:23.700 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:23.016+0000 7fa9a6e5f640 1 -- 172.21.15.37:0/141318071 shutdown_connections 2024-09-19T05:56:23.700 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:23.016+0000 7fa9a6e5f640 1 --2- 172.21.15.37:0/141318071 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9a01074d0 0x7fa9a01078d0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:56:23.700 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:23.016+0000 7fa9a6e5f640 1 -- 172.21.15.37:0/141318071 >> 172.21.15.37:0/141318071 conn(0x7fa9a0102c40 msgr2=0x7fa9a01050a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:56:23.700 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:23.016+0000 7fa9a6e5f640 1 -- 172.21.15.37:0/141318071 shutdown_connections 2024-09-19T05:56:23.700 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:23.016+0000 7fa9a6e5f640 1 -- 172.21.15.37:0/141318071 wait complete. 2024-09-19T05:56:23.700 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:23.017+0000 7fa9a6e5f640 1 Processor -- start 2024-09-19T05:56:23.700 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:23.017+0000 7fa9a6e5f640 1 -- start start 2024-09-19T05:56:23.700 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:23.017+0000 7fa9a6e5f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9a01074d0 0x7fa9a019ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:56:23.701 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:23.017+0000 7fa9a6e5f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a0108c20 con 0x7fa9a01074d0 2024-09-19T05:56:23.701 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:23.017+0000 7fa9a4bfb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9a01074d0 0x7fa9a019ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:56:23.701 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:23.017+0000 7fa9a4bfb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9a01074d0 0x7fa9a019ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60476/0 (socket says 172.21.15.37:60476) 2024-09-19T05:56:23.701 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:23.017+0000 7fa9a4bfb640 1 -- 172.21.15.37:0/2225445149 learned_addr learned my addr 172.21.15.37:0/2225445149 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T05:56:23.701 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:23.018+0000 7fa9a4bfb640 1 -- 172.21.15.37:0/2225445149 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9a019b1c0 con 0x7fa9a01074d0 2024-09-19T05:56:23.701 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:23.018+0000 7fa9a4bfb640 1 --2- 172.21.15.37:0/2225445149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9a01074d0 0x7fa9a019ac80 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fa9940090b0 tx=0x7fa9940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:56:23.701 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:23.018+0000 7fa99dffb640 1 -- 172.21.15.37:0/2225445149 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa994041070 con 0x7fa9a01074d0 2024-09-19T05:56:23.701 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:23.018+0000 7fa99dffb640 1 -- 172.21.15.37:0/2225445149 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa99403c7a0 con 0x7fa9a01074d0 2024-09-19T05:56:23.701 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:23.018+0000 7fa9a6e5f640 1 -- 172.21.15.37:0/2225445149 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9a019b450 con 0x7fa9a01074d0 2024-09-19T05:56:23.701 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:23.018+0000 7fa99dffb640 1 -- 172.21.15.37:0/2225445149 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa994037040 con 0x7fa9a01074d0 2024-09-19T05:56:23.701 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:23.018+0000 7fa9a6e5f640 1 -- 172.21.15.37:0/2225445149 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9a019b870 con 0x7fa9a01074d0 2024-09-19T05:56:23.701 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:23.018+0000 7fa99dffb640 1 -- 172.21.15.37:0/2225445149 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa994044070 con 0x7fa9a01074d0 2024-09-19T05:56:23.701 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:23.019+0000 7fa99dffb640 1 -- 172.21.15.37:0/2225445149 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa99403d790 con 0x7fa9a01074d0 2024-09-19T05:56:23.702 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:23.020+0000 7fa9a6e5f640 1 -- 172.21.15.37:0/2225445149 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9a0109270 con 0x7fa9a01074d0 2024-09-19T05:56:23.702 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:23.022+0000 7fa99dffb640 1 -- 172.21.15.37:0/2225445149 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fa99403cc80 con 0x7fa9a01074d0 2024-09-19T05:56:23.702 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:23.085+0000 7fa9a6e5f640 1 -- 172.21.15.37:0/2225445149 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7fa9a019e200 con 0x7fa9a01074d0 2024-09-19T05:56:23.702 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:23.085+0000 7fa99dffb640 1 -- 172.21.15.37:0/2225445149 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7fa99403d990 con 0x7fa9a01074d0 2024-09-19T05:56:23.702 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:23.086+0000 7fa9a6e5f640 1 -- 172.21.15.37:0/2225445149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9a01074d0 msgr2=0x7fa9a019ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:56:23.702 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:23.086+0000 7fa9a6e5f640 1 --2- 172.21.15.37:0/2225445149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9a01074d0 0x7fa9a019ac80 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fa9940090b0 tx=0x7fa9940046c0 comp rx=0 tx=0).stop 2024-09-19T05:56:23.702 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:23.086+0000 7fa9a6e5f640 1 -- 172.21.15.37:0/2225445149 shutdown_connections 2024-09-19T05:56:23.702 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:23.086+0000 7fa9a6e5f640 1 --2- 172.21.15.37:0/2225445149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9a01074d0 0x7fa9a019ac80 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:56:23.702 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:23.086+0000 7fa9a6e5f640 1 -- 172.21.15.37:0/2225445149 >> 172.21.15.37:0/2225445149 conn(0x7fa9a0102c40 msgr2=0x7fa9a018ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:56:23.702 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:23.086+0000 7fa9a6e5f640 1 -- 172.21.15.37:0/2225445149 shutdown_connections 2024-09-19T05:56:23.702 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:23.086+0000 7fa9a6e5f640 1 -- 172.21.15.37:0/2225445149 wait complete. 2024-09-19T05:56:23.702 INFO:teuthology.orchestra.run.smithi037.stdout:mon is available 2024-09-19T05:56:23.703 INFO:teuthology.orchestra.run.smithi037.stdout:Assimilating anything we can from ceph.conf... 2024-09-19T05:56:24.688 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-09-19T05:56:24.695 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout [global] 2024-09-19T05:56:24.695 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout fsid = b8c8bdae-764b-11ef-bceb-c7b262605968 2024-09-19T05:56:24.695 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.37:3300,v1:172.21.15.37:6789] 2024-09-19T05:56:24.695 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-19T05:56:24.695 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-19T05:56:24.695 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-19T05:56:24.696 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-19T05:56:24.696 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-09-19T05:56:24.696 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-19T05:56:24.696 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-19T05:56:24.696 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-09-19T05:56:24.696 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout [osd] 2024-09-19T05:56:24.696 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-19T05:56:24.696 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-19T05:56:24.696 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-19T05:56:24.697 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-19T05:56:24.697 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-19T05:56:24.697 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:24.073+0000 7f05891b9640 1 Processor -- start 2024-09-19T05:56:24.697 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:24.073+0000 7f05891b9640 1 -- start start 2024-09-19T05:56:24.697 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:24.074+0000 7f05891b9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0584107510 0x7f0584107910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:56:24.697 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:24.074+0000 7f05891b9640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0584107ee0 con 0x7f0584107510 2024-09-19T05:56:24.697 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:24.074+0000 7f0582d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0584107510 0x7f0584107910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:56:24.697 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:24.074+0000 7f0582d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0584107510 0x7f0584107910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47412/0 (socket says 172.21.15.37:47412) 2024-09-19T05:56:24.697 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:24.074+0000 7f0582d9d640 1 -- 172.21.15.37:0/2487755890 learned_addr learned my addr 172.21.15.37:0/2487755890 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T05:56:24.697 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:24.074+0000 7f0582d9d640 1 -- 172.21.15.37:0/2487755890 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05841086c0 con 0x7f0584107510 2024-09-19T05:56:24.697 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:24.075+0000 7f0582d9d640 1 --2- 172.21.15.37:0/2487755890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0584107510 0x7f0584107910 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f0574009820 tx=0x7f057402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8096393d8ab953b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:56:24.697 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:24.075+0000 7f0581d9b640 1 -- 172.21.15.37:0/2487755890 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0574037070 con 0x7f0584107510 2024-09-19T05:56:24.698 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:24.075+0000 7f0581d9b640 1 -- 172.21.15.37:0/2487755890 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0574032440 con 0x7f0584107510 2024-09-19T05:56:24.698 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:24.075+0000 7f0581d9b640 1 -- 172.21.15.37:0/2487755890 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0574032740 con 0x7f0584107510 2024-09-19T05:56:24.698 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:24.076+0000 7f05891b9640 1 -- 172.21.15.37:0/2487755890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0584107510 msgr2=0x7f0584107910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:56:24.698 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:24.076+0000 7f05891b9640 1 --2- 172.21.15.37:0/2487755890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0584107510 0x7f0584107910 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f0574009820 tx=0x7f057402a270 comp rx=0 tx=0).stop 2024-09-19T05:56:24.698 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:24.076+0000 7f05891b9640 1 -- 172.21.15.37:0/2487755890 shutdown_connections 2024-09-19T05:56:24.698 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:24.076+0000 7f05891b9640 1 --2- 172.21.15.37:0/2487755890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0584107510 0x7f0584107910 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:56:24.698 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:24.076+0000 7f05891b9640 1 -- 172.21.15.37:0/2487755890 >> 172.21.15.37:0/2487755890 conn(0x7f0584102ce0 msgr2=0x7f0584105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:56:24.698 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:24.076+0000 7f05891b9640 1 -- 172.21.15.37:0/2487755890 shutdown_connections 2024-09-19T05:56:24.698 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:24.076+0000 7f05891b9640 1 -- 172.21.15.37:0/2487755890 wait complete. 2024-09-19T05:56:24.698 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:24.076+0000 7f05891b9640 1 Processor -- start 2024-09-19T05:56:24.698 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:24.077+0000 7f05891b9640 1 -- start start 2024-09-19T05:56:24.698 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:24.077+0000 7f05891b9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0584107510 0x7f058419ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:56:24.698 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:24.077+0000 7f05891b9640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0584108c60 con 0x7f0584107510 2024-09-19T05:56:24.698 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:24.077+0000 7f0582d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0584107510 0x7f058419ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:56:24.699 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:24.077+0000 7f0582d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0584107510 0x7f058419ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47416/0 (socket says 172.21.15.37:47416) 2024-09-19T05:56:24.699 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:24.077+0000 7f0582d9d640 1 -- 172.21.15.37:0/1013530268 learned_addr learned my addr 172.21.15.37:0/1013530268 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T05:56:24.699 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:24.077+0000 7f0582d9d640 1 -- 172.21.15.37:0/1013530268 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f058419b1a0 con 0x7f0584107510 2024-09-19T05:56:24.699 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:24.078+0000 7f0582d9d640 1 --2- 172.21.15.37:0/1013530268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0584107510 0x7f058419ac60 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f05740090b0 tx=0x7f05740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:56:24.699 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:24.078+0000 7f056bfff640 1 -- 172.21.15.37:0/1013530268 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0574041070 con 0x7f0584107510 2024-09-19T05:56:24.699 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:24.078+0000 7f056bfff640 1 -- 172.21.15.37:0/1013530268 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f057403c7a0 con 0x7f0584107510 2024-09-19T05:56:24.699 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:24.078+0000 7f05891b9640 1 -- 172.21.15.37:0/1013530268 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f058419b430 con 0x7f0584107510 2024-09-19T05:56:24.699 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:24.078+0000 7f056bfff640 1 -- 172.21.15.37:0/1013530268 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0574037040 con 0x7f0584107510 2024-09-19T05:56:24.699 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:24.078+0000 7f05891b9640 1 -- 172.21.15.37:0/1013530268 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f058419e120 con 0x7f0584107510 2024-09-19T05:56:24.699 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:24.078+0000 7f056bfff640 1 -- 172.21.15.37:0/1013530268 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0574044070 con 0x7f0584107510 2024-09-19T05:56:24.699 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:24.078+0000 7f056bfff640 1 -- 172.21.15.37:0/1013530268 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f057403d3f0 con 0x7f0584107510 2024-09-19T05:56:24.699 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:24.079+0000 7f05891b9640 1 -- 172.21.15.37:0/1013530268 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05841092b0 con 0x7f0584107510 2024-09-19T05:56:24.699 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:24.081+0000 7f056bfff640 1 -- 172.21.15.37:0/1013530268 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f0574046450 con 0x7f0584107510 2024-09-19T05:56:24.700 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:24.141+0000 7f05891b9640 1 -- 172.21.15.37:0/1013530268 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f058402d980 con 0x7f0584107510 2024-09-19T05:56:24.700 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:24.144+0000 7f056bfff640 1 -- 172.21.15.37:0/1013530268 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+429 (secure 0 0 0) 0x7f0574046630 con 0x7f0584107510 2024-09-19T05:56:24.700 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:24.145+0000 7f056bfff640 1 -- 172.21.15.37:0/1013530268 <== mon.0 v2:172.21.15.37:3300/0 8 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f05740584b0 con 0x7f0584107510 2024-09-19T05:56:24.700 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:24.146+0000 7f05891b9640 1 -- 172.21.15.37:0/1013530268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0584107510 msgr2=0x7f058419ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:56:24.700 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:24.146+0000 7f05891b9640 1 --2- 172.21.15.37:0/1013530268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0584107510 0x7f058419ac60 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f05740090b0 tx=0x7f05740046c0 comp rx=0 tx=0).stop 2024-09-19T05:56:24.700 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:24.146+0000 7f05891b9640 1 -- 172.21.15.37:0/1013530268 shutdown_connections 2024-09-19T05:56:24.700 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:24.146+0000 7f05891b9640 1 --2- 172.21.15.37:0/1013530268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0584107510 0x7f058419ac60 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:56:24.701 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:24.146+0000 7f05891b9640 1 -- 172.21.15.37:0/1013530268 >> 172.21.15.37:0/1013530268 conn(0x7f0584102ce0 msgr2=0x7f058418ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:56:24.701 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:24.146+0000 7f05891b9640 1 -- 172.21.15.37:0/1013530268 shutdown_connections 2024-09-19T05:56:24.701 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:24.146+0000 7f05891b9640 1 -- 172.21.15.37:0/1013530268 wait complete. 2024-09-19T05:56:24.701 INFO:teuthology.orchestra.run.smithi037.stdout:Generating new minimal ceph.conf... 2024-09-19T05:56:24.811 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:24 smithi037 ceph-mon[30845]: from='client.? 172.21.15.37:0/1013530268' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-19T05:56:24.812 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:24 smithi037 ceph-mon[30845]: from='client.? 172.21.15.37:0/1013530268' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-19T05:56:25.726 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:25 smithi037 ceph-mon[30845]: from='client.? 172.21.15.37:0/4240740536' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:56:25.734 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:25.113+0000 7f9889268640 1 Processor -- start 2024-09-19T05:56:25.734 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:25.114+0000 7f9889268640 1 -- start start 2024-09-19T05:56:25.734 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:25.114+0000 7f9889268640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f988407de20 0x7f988407c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:56:25.734 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:25.114+0000 7f9889268640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f988407c810 con 0x7f988407de20 2024-09-19T05:56:25.734 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:25.114+0000 7f9882ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f988407de20 0x7f988407c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:56:25.734 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:25.114+0000 7f9882ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f988407de20 0x7f988407c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47428/0 (socket says 172.21.15.37:47428) 2024-09-19T05:56:25.735 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:25.114+0000 7f9882ffd640 1 -- 172.21.15.37:0/768459392 learned_addr learned my addr 172.21.15.37:0/768459392 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T05:56:25.735 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:25.114+0000 7f9882ffd640 1 -- 172.21.15.37:0/768459392 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f988407c990 con 0x7f988407de20 2024-09-19T05:56:25.735 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:25.115+0000 7f9882ffd640 1 --2- 172.21.15.37:0/768459392 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f988407de20 0x7f988407c2d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f9874009820 tx=0x7f987402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2e02fb88d3c8d37 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:56:25.735 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:25.115+0000 7f98827fc640 1 -- 172.21.15.37:0/768459392 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9874037070 con 0x7f988407de20 2024-09-19T05:56:25.735 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:25.115+0000 7f98827fc640 1 -- 172.21.15.37:0/768459392 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9874032900 con 0x7f988407de20 2024-09-19T05:56:25.735 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:25.115+0000 7f98827fc640 1 -- 172.21.15.37:0/768459392 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98740308e0 con 0x7f988407de20 2024-09-19T05:56:25.735 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:25.116+0000 7f9889268640 1 -- 172.21.15.37:0/768459392 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f988407de20 msgr2=0x7f988407c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:56:25.735 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:25.116+0000 7f9889268640 1 --2- 172.21.15.37:0/768459392 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f988407de20 0x7f988407c2d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f9874009820 tx=0x7f987402a300 comp rx=0 tx=0).stop 2024-09-19T05:56:25.735 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:25.116+0000 7f9889268640 1 -- 172.21.15.37:0/768459392 shutdown_connections 2024-09-19T05:56:25.735 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:25.116+0000 7f9889268640 1 --2- 172.21.15.37:0/768459392 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f988407de20 0x7f988407c2d0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:56:25.735 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:25.116+0000 7f9889268640 1 -- 172.21.15.37:0/768459392 >> 172.21.15.37:0/768459392 conn(0x7f9884102ce0 msgr2=0x7f9884105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:56:25.736 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:25.116+0000 7f9889268640 1 -- 172.21.15.37:0/768459392 shutdown_connections 2024-09-19T05:56:25.736 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:25.116+0000 7f9889268640 1 -- 172.21.15.37:0/768459392 wait complete. 2024-09-19T05:56:25.736 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:25.116+0000 7f9889268640 1 Processor -- start 2024-09-19T05:56:25.736 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:25.117+0000 7f9889268640 1 -- start start 2024-09-19T05:56:25.736 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:25.117+0000 7f9889268640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f988407de20 0x7f988419d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:56:25.736 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:25.117+0000 7f9889268640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f988410db20 con 0x7f988407de20 2024-09-19T05:56:25.736 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:25.117+0000 7f9882ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f988407de20 0x7f988419d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:56:25.736 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:25.117+0000 7f9882ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f988407de20 0x7f988419d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47442/0 (socket says 172.21.15.37:47442) 2024-09-19T05:56:25.736 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:25.117+0000 7f9882ffd640 1 -- 172.21.15.37:0/4240740536 learned_addr learned my addr 172.21.15.37:0/4240740536 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T05:56:25.736 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:25.117+0000 7f9882ffd640 1 -- 172.21.15.37:0/4240740536 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f988419dc00 con 0x7f988407de20 2024-09-19T05:56:25.736 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:25.118+0000 7f9882ffd640 1 --2- 172.21.15.37:0/4240740536 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f988407de20 0x7f988419d6c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9874030610 tx=0x7f9874032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:56:25.737 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:25.118+0000 7f9880ff9640 1 -- 172.21.15.37:0/4240740536 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9874037040 con 0x7f988407de20 2024-09-19T05:56:25.737 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:25.118+0000 7f9889268640 1 -- 172.21.15.37:0/4240740536 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f988419de90 con 0x7f988407de20 2024-09-19T05:56:25.737 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:25.118+0000 7f9880ff9640 1 -- 172.21.15.37:0/4240740536 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9874040070 con 0x7f988407de20 2024-09-19T05:56:25.737 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:25.118+0000 7f9880ff9640 1 -- 172.21.15.37:0/4240740536 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f987403a390 con 0x7f988407de20 2024-09-19T05:56:25.737 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:25.118+0000 7f9889268640 1 -- 172.21.15.37:0/4240740536 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98841a0b80 con 0x7f988407de20 2024-09-19T05:56:25.737 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:25.118+0000 7f9880ff9640 1 -- 172.21.15.37:0/4240740536 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f987403a690 con 0x7f988407de20 2024-09-19T05:56:25.737 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:25.118+0000 7f9880ff9640 1 -- 172.21.15.37:0/4240740536 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f9874045860 con 0x7f988407de20 2024-09-19T05:56:25.737 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:25.119+0000 7f9889268640 1 -- 172.21.15.37:0/4240740536 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f988407c350 con 0x7f988407de20 2024-09-19T05:56:25.737 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:25.121+0000 7f9880ff9640 1 -- 172.21.15.37:0/4240740536 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f987403b430 con 0x7f988407de20 2024-09-19T05:56:25.737 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:25.181+0000 7f9889268640 1 -- 172.21.15.37:0/4240740536 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f98841a1100 con 0x7f988407de20 2024-09-19T05:56:25.737 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:25.181+0000 7f9880ff9640 1 -- 172.21.15.37:0/4240740536 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7f987403b650 con 0x7f988407de20 2024-09-19T05:56:25.737 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:25.182+0000 7f9889268640 1 -- 172.21.15.37:0/4240740536 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f988407de20 msgr2=0x7f988419d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:56:25.737 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:25.182+0000 7f9889268640 1 --2- 172.21.15.37:0/4240740536 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f988407de20 0x7f988419d6c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9874030610 tx=0x7f9874032670 comp rx=0 tx=0).stop 2024-09-19T05:56:25.738 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:25.182+0000 7f9889268640 1 -- 172.21.15.37:0/4240740536 shutdown_connections 2024-09-19T05:56:25.738 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:25.182+0000 7f9889268640 1 --2- 172.21.15.37:0/4240740536 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f988407de20 0x7f988419d6c0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:56:25.738 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:25.182+0000 7f9889268640 1 -- 172.21.15.37:0/4240740536 >> 172.21.15.37:0/4240740536 conn(0x7f9884102ce0 msgr2=0x7f9884103850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:56:25.738 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:25.182+0000 7f9889268640 1 -- 172.21.15.37:0/4240740536 shutdown_connections 2024-09-19T05:56:25.738 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:25.182+0000 7f9889268640 1 -- 172.21.15.37:0/4240740536 wait complete. 2024-09-19T05:56:25.738 INFO:teuthology.orchestra.run.smithi037.stdout:Restarting the monitor... 2024-09-19T05:56:26.039 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:25 smithi037 systemd[1]: Stopping Ceph mon.a for b8c8bdae-764b-11ef-bceb-c7b262605968... 2024-09-19T05:56:26.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:26 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mon-a[30841]: 2024-09-19T05:56:26.037+0000 7f1f5c32c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:56:26.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:26 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mon-a[30841]: 2024-09-19T05:56:26.037+0000 7f1f5c32c640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-19T05:56:26.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:26 smithi037 podman[31090]: 2024-09-19 05:56:26.221584877 +0000 UTC m=+0.308643252 container died ce8821299b6fee8dcd9934c7f424f985be7b8466355d557be094ce10dd7e05f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mon-a, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-19T05:56:26.738 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:26 smithi037 podman[31090]: 2024-09-19 05:56:26.478373341 +0000 UTC m=+0.565431712 container cleanup ce8821299b6fee8dcd9934c7f424f985be7b8466355d557be094ce10dd7e05f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mon-a, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T05:56:26.738 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:26 smithi037 bash[31090]: ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mon-a 2024-09-19T05:56:27.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:26 smithi037 podman[31102]: 2024-09-19 05:56:26.737506564 +0000 UTC m=+0.515929244 container remove ce8821299b6fee8dcd9934c7f424f985be7b8466355d557be094ce10dd7e05f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mon-a, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-19T05:56:27.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:26 smithi037 systemd[1]: ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-19T05:56:27.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:26 smithi037 systemd[1]: Stopped Ceph mon.a for b8c8bdae-764b-11ef-bceb-c7b262605968. 2024-09-19T05:56:27.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:26 smithi037 systemd[1]: Starting Ceph mon.a for b8c8bdae-764b-11ef-bceb-c7b262605968... 2024-09-19T05:56:27.358 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 podman[31192]: 2024-09-19 05:56:26.981946455 +0000 UTC m=+0.016157729 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T05:56:27.358 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 podman[31192]: 2024-09-19 05:56:27.0882734 +0000 UTC m=+0.122484707 container create 916a85ee7b219c4087ba3fe080feb879d234175f7ebb5bec4db3c039fc238149 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mon-a, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-19T05:56:27.359 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 podman[31192]: 2024-09-19 05:56:27.290630368 +0000 UTC m=+0.324841643 container init 916a85ee7b219c4087ba3fe080feb879d234175f7ebb5bec4db3c039fc238149 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-19T05:56:27.359 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 podman[31192]: 2024-09-19 05:56:27.293897129 +0000 UTC m=+0.328108393 container start 916a85ee7b219c4087ba3fe080feb879d234175f7ebb5bec4db3c039fc238149 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mon-a, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-19T05:56:27.359 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: set uid:gid to 167:167 (ceph:ceph) 2024-09-19T05:56:27.359 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable), process ceph-mon, pid 2 2024-09-19T05:56:27.359 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: pidfile_write: ignore empty --pid-file 2024-09-19T05:56:27.359 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: load: jerasure load: lrc 2024-09-19T05:56:27.359 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: RocksDB version: 7.9.2 2024-09-19T05:56:27.359 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Git sha 0 2024-09-19T05:56:27.359 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Compile date 2024-09-18 16:29:48 2024-09-19T05:56:27.359 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: DB SUMMARY 2024-09-19T05:56:27.359 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: DB Session ID: HTFC9CF1CJQ9TFMVHF0T 2024-09-19T05:56:27.359 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: CURRENT file: CURRENT 2024-09-19T05:56:27.359 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: IDENTITY file: IDENTITY 2024-09-19T05:56:27.360 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-19T05:56:27.360 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-19T05:56:27.360 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 104260 ; 2024-09-19T05:56:27.360 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.error_if_exists: 0 2024-09-19T05:56:27.360 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.create_if_missing: 0 2024-09-19T05:56:27.360 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.paranoid_checks: 1 2024-09-19T05:56:27.360 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-19T05:56:27.360 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-19T05:56:27.360 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-19T05:56:27.360 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.env: 0x5611f2aa9940 2024-09-19T05:56:27.360 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.fs: PosixFileSystem 2024-09-19T05:56:27.360 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.info_log: 0x5611f4b196e0 2024-09-19T05:56:27.360 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.max_file_opening_threads: 16 2024-09-19T05:56:27.360 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.statistics: (nil) 2024-09-19T05:56:27.361 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.use_fsync: 0 2024-09-19T05:56:27.361 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.max_log_file_size: 0 2024-09-19T05:56:27.361 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-19T05:56:27.361 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-19T05:56:27.361 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.keep_log_file_num: 1000 2024-09-19T05:56:27.361 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.recycle_log_file_num: 0 2024-09-19T05:56:27.361 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.allow_fallocate: 1 2024-09-19T05:56:27.361 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.allow_mmap_reads: 0 2024-09-19T05:56:27.361 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.allow_mmap_writes: 0 2024-09-19T05:56:27.361 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.use_direct_reads: 0 2024-09-19T05:56:27.361 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-19T05:56:27.361 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.create_missing_column_families: 0 2024-09-19T05:56:27.361 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.db_log_dir: 2024-09-19T05:56:27.361 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.wal_dir: 2024-09-19T05:56:27.362 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-19T05:56:27.362 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-19T05:56:27.362 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-19T05:56:27.362 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-19T05:56:27.362 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-19T05:56:27.362 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-19T05:56:27.362 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.advise_random_on_open: 1 2024-09-19T05:56:27.362 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.db_write_buffer_size: 0 2024-09-19T05:56:27.362 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.write_buffer_manager: 0x5611f4b28dc0 2024-09-19T05:56:27.362 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-19T05:56:27.362 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-19T05:56:27.362 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-19T05:56:27.362 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.rate_limiter: (nil) 2024-09-19T05:56:27.362 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-19T05:56:27.362 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.wal_recovery_mode: 2 2024-09-19T05:56:27.364 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.enable_thread_tracking: 0 2024-09-19T05:56:27.364 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.enable_pipelined_write: 0 2024-09-19T05:56:27.364 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.unordered_write: 0 2024-09-19T05:56:27.364 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-19T05:56:27.364 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-19T05:56:27.364 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-19T05:56:27.364 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-19T05:56:27.364 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.row_cache: None 2024-09-19T05:56:27.364 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.wal_filter: None 2024-09-19T05:56:27.364 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-19T05:56:27.364 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.allow_ingest_behind: 0 2024-09-19T05:56:27.365 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.two_write_queues: 0 2024-09-19T05:56:27.365 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.manual_wal_flush: 0 2024-09-19T05:56:27.365 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.wal_compression: 0 2024-09-19T05:56:27.365 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.atomic_flush: 0 2024-09-19T05:56:27.365 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-19T05:56:27.365 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-19T05:56:27.365 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-19T05:56:27.365 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.log_readahead_size: 0 2024-09-19T05:56:27.365 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-19T05:56:27.365 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.best_efforts_recovery: 0 2024-09-19T05:56:27.365 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-19T05:56:27.365 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-19T05:56:27.365 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.allow_data_in_errors: 0 2024-09-19T05:56:27.365 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.db_host_id: __hostname__ 2024-09-19T05:56:27.365 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-19T05:56:27.366 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.max_background_jobs: 2 2024-09-19T05:56:27.366 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.max_background_compactions: -1 2024-09-19T05:56:27.366 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.max_subcompactions: 1 2024-09-19T05:56:27.366 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-19T05:56:27.366 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-19T05:56:27.366 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-19T05:56:27.366 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.max_total_wal_size: 0 2024-09-19T05:56:27.366 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-19T05:56:27.366 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-19T05:56:27.366 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-19T05:56:27.366 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-19T05:56:27.366 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.max_open_files: -1 2024-09-19T05:56:27.366 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.bytes_per_sync: 0 2024-09-19T05:56:27.366 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-19T05:56:27.366 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-19T05:56:27.367 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.compaction_readahead_size: 0 2024-09-19T05:56:27.367 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.max_background_flushes: -1 2024-09-19T05:56:27.367 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Compression algorithms supported: 2024-09-19T05:56:27.367 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: kZSTD supported: 0 2024-09-19T05:56:27.367 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: kXpressCompression supported: 0 2024-09-19T05:56:27.367 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: kBZip2Compression supported: 0 2024-09-19T05:56:27.367 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-19T05:56:27.367 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: kLZ4Compression supported: 1 2024-09-19T05:56:27.367 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: kZlibCompression supported: 1 2024-09-19T05:56:27.367 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: kLZ4HCCompression supported: 1 2024-09-19T05:56:27.367 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: kSnappyCompression supported: 1 2024-09-19T05:56:27.367 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-19T05:56:27.367 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-19T05:56:27.367 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-19T05:56:27.368 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-19T05:56:27.368 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-19T05:56:27.368 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.merge_operator: 2024-09-19T05:56:27.368 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.compaction_filter: None 2024-09-19T05:56:27.368 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.compaction_filter_factory: None 2024-09-19T05:56:27.368 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.sst_partitioner_factory: None 2024-09-19T05:56:27.368 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-19T05:56:27.368 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-19T05:56:27.368 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5611f4b19320) 2024-09-19T05:56:27.368 INFO:journalctl@ceph.mon.a.smithi037.stdout: cache_index_and_filter_blocks: 1 2024-09-19T05:56:27.368 INFO:journalctl@ceph.mon.a.smithi037.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-19T05:56:27.368 INFO:journalctl@ceph.mon.a.smithi037.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-19T05:56:27.368 INFO:journalctl@ceph.mon.a.smithi037.stdout: pin_top_level_index_and_filter: 1 2024-09-19T05:56:27.369 INFO:journalctl@ceph.mon.a.smithi037.stdout: index_type: 0 2024-09-19T05:56:27.369 INFO:journalctl@ceph.mon.a.smithi037.stdout: data_block_index_type: 0 2024-09-19T05:56:27.369 INFO:journalctl@ceph.mon.a.smithi037.stdout: index_shortening: 1 2024-09-19T05:56:27.369 INFO:journalctl@ceph.mon.a.smithi037.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-19T05:56:27.369 INFO:journalctl@ceph.mon.a.smithi037.stdout: checksum: 4 2024-09-19T05:56:27.369 INFO:journalctl@ceph.mon.a.smithi037.stdout: no_block_cache: 0 2024-09-19T05:56:27.369 INFO:journalctl@ceph.mon.a.smithi037.stdout: block_cache: 0x5611f4b0d1f0 2024-09-19T05:56:27.369 INFO:journalctl@ceph.mon.a.smithi037.stdout: block_cache_name: BinnedLRUCache 2024-09-19T05:56:27.369 INFO:journalctl@ceph.mon.a.smithi037.stdout: block_cache_options: 2024-09-19T05:56:27.369 INFO:journalctl@ceph.mon.a.smithi037.stdout: capacity : 536870912 2024-09-19T05:56:27.369 INFO:journalctl@ceph.mon.a.smithi037.stdout: num_shard_bits : 4 2024-09-19T05:56:27.369 INFO:journalctl@ceph.mon.a.smithi037.stdout: strict_capacity_limit : 0 2024-09-19T05:56:27.369 INFO:journalctl@ceph.mon.a.smithi037.stdout: high_pri_pool_ratio: 0.000 2024-09-19T05:56:27.369 INFO:journalctl@ceph.mon.a.smithi037.stdout: block_cache_compressed: (nil) 2024-09-19T05:56:27.370 INFO:journalctl@ceph.mon.a.smithi037.stdout: persistent_cache: (nil) 2024-09-19T05:56:27.370 INFO:journalctl@ceph.mon.a.smithi037.stdout: block_size: 4096 2024-09-19T05:56:27.370 INFO:journalctl@ceph.mon.a.smithi037.stdout: block_size_deviation: 10 2024-09-19T05:56:27.370 INFO:journalctl@ceph.mon.a.smithi037.stdout: block_restart_interval: 16 2024-09-19T05:56:27.370 INFO:journalctl@ceph.mon.a.smithi037.stdout: index_block_restart_interval: 1 2024-09-19T05:56:27.370 INFO:journalctl@ceph.mon.a.smithi037.stdout: metadata_block_size: 4096 2024-09-19T05:56:27.370 INFO:journalctl@ceph.mon.a.smithi037.stdout: partition_filters: 0 2024-09-19T05:56:27.370 INFO:journalctl@ceph.mon.a.smithi037.stdout: use_delta_encoding: 1 2024-09-19T05:56:27.370 INFO:journalctl@ceph.mon.a.smithi037.stdout: filter_policy: bloomfilter 2024-09-19T05:56:27.370 INFO:journalctl@ceph.mon.a.smithi037.stdout: whole_key_filtering: 1 2024-09-19T05:56:27.370 INFO:journalctl@ceph.mon.a.smithi037.stdout: verify_compression: 0 2024-09-19T05:56:27.370 INFO:journalctl@ceph.mon.a.smithi037.stdout: read_amp_bytes_per_bit: 0 2024-09-19T05:56:27.370 INFO:journalctl@ceph.mon.a.smithi037.stdout: format_version: 5 2024-09-19T05:56:27.370 INFO:journalctl@ceph.mon.a.smithi037.stdout: enable_index_compression: 1 2024-09-19T05:56:27.371 INFO:journalctl@ceph.mon.a.smithi037.stdout: block_align: 0 2024-09-19T05:56:27.371 INFO:journalctl@ceph.mon.a.smithi037.stdout: max_auto_readahead_size: 262144 2024-09-19T05:56:27.371 INFO:journalctl@ceph.mon.a.smithi037.stdout: prepopulate_block_cache: 0 2024-09-19T05:56:27.371 INFO:journalctl@ceph.mon.a.smithi037.stdout: initial_auto_readahead_size: 8192 2024-09-19T05:56:27.371 INFO:journalctl@ceph.mon.a.smithi037.stdout: num_file_reads_for_auto_readahead: 2 2024-09-19T05:56:27.371 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.write_buffer_size: 33554432 2024-09-19T05:56:27.371 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.max_write_buffer_number: 2 2024-09-19T05:56:27.371 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.compression: NoCompression 2024-09-19T05:56:27.371 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.bottommost_compression: Disabled 2024-09-19T05:56:27.371 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.prefix_extractor: nullptr 2024-09-19T05:56:27.371 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-19T05:56:27.371 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.num_levels: 7 2024-09-19T05:56:27.371 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-19T05:56:27.371 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-19T05:56:27.371 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-19T05:56:27.372 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-19T05:56:27.372 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-19T05:56:27.372 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-19T05:56:27.372 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-19T05:56:27.372 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-19T05:56:27.372 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-19T05:56:27.372 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-19T05:56:27.372 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-19T05:56:27.372 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-19T05:56:27.372 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-19T05:56:27.372 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.compression_opts.level: 32767 2024-09-19T05:56:27.372 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.compression_opts.strategy: 0 2024-09-19T05:56:27.372 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-19T05:56:27.372 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-19T05:56:27.373 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-19T05:56:27.373 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-19T05:56:27.373 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.compression_opts.enabled: false 2024-09-19T05:56:27.373 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-19T05:56:27.373 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-19T05:56:27.373 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-19T05:56:27.373 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-19T05:56:27.373 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.target_file_size_base: 67108864 2024-09-19T05:56:27.373 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-19T05:56:27.373 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-19T05:56:27.373 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-19T05:56:27.373 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-19T05:56:27.373 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-19T05:56:27.374 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-19T05:56:27.374 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-19T05:56:27.374 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-19T05:56:27.374 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-19T05:56:27.374 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-19T05:56:27.374 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-19T05:56:27.374 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-19T05:56:27.374 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-19T05:56:27.374 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-19T05:56:27.374 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.arena_block_size: 1048576 2024-09-19T05:56:27.374 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-19T05:56:27.374 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-19T05:56:27.374 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.disable_auto_compactions: 0 2024-09-19T05:56:27.374 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-19T05:56:27.374 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-19T05:56:27.375 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-19T05:56:27.375 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-19T05:56:27.375 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-19T05:56:27.375 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-19T05:56:27.375 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-19T05:56:27.375 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-19T05:56:27.375 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-19T05:56:27.375 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-19T05:56:27.375 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-19T05:56:27.375 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.inplace_update_support: 0 2024-09-19T05:56:27.375 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-19T05:56:27.375 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-19T05:56:27.375 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-19T05:56:27.375 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-19T05:56:27.376 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.bloom_locality: 0 2024-09-19T05:56:27.376 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.max_successive_merges: 0 2024-09-19T05:56:27.376 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-19T05:56:27.376 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.paranoid_file_checks: 0 2024-09-19T05:56:27.376 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.force_consistency_checks: 1 2024-09-19T05:56:27.376 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.report_bg_io_stats: 0 2024-09-19T05:56:27.376 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.ttl: 2592000 2024-09-19T05:56:27.376 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-19T05:56:27.376 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-19T05:56:27.376 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-19T05:56:27.376 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.enable_blob_files: false 2024-09-19T05:56:27.376 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.min_blob_size: 0 2024-09-19T05:56:27.376 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.blob_file_size: 268435456 2024-09-19T05:56:27.377 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-19T05:56:27.377 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-19T05:56:27.377 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-19T05:56:27.377 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-19T05:56:27.377 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-19T05:56:27.377 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.blob_file_starting_level: 0 2024-09-19T05:56:27.377 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-19T05:56:27.377 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-19T05:56:27.377 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-19T05:56:27.378 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: d24d5ebf-075a-4ef0-9b66-70ee24dfebbb 2024-09-19T05:56:27.378 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726725387321438, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-19T05:56:27.378 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-19T05:56:27.378 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726725387323114, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 99485, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 324, "table_properties": {"data_size": 97379, "index_size": 298, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14048, "raw_average_key_size": 49, "raw_value_size": 89707, "raw_average_value_size": 316, "num_data_blocks": 12, "num_entries": 283, "num_filter_entries": 283, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726725387, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d24d5ebf-075a-4ef0-9b66-70ee24dfebbb", "db_session_id": "HTFC9CF1CJQ9TFMVHF0T", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-19T05:56:27.378 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726725387323278, "job": 1, "event": "recovery_finished"} 2024-09-19T05:56:27.378 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-19T05:56:27.378 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-19T05:56:27.378 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5611f4b3ae00 2024-09-19T05:56:27.378 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: DB pointer 0x5611f4c36000 2024-09-19T05:56:27.378 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-19T05:56:27.378 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-19T05:56:27.378 INFO:journalctl@ceph.mon.a.smithi037.stdout: ** DB Stats ** 2024-09-19T05:56:27.378 INFO:journalctl@ceph.mon.a.smithi037.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T05:56:27.378 INFO:journalctl@ceph.mon.a.smithi037.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-19T05:56:27.378 INFO:journalctl@ceph.mon.a.smithi037.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T05:56:27.379 INFO:journalctl@ceph.mon.a.smithi037.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T05:56:27.379 INFO:journalctl@ceph.mon.a.smithi037.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-19T05:56:27.379 INFO:journalctl@ceph.mon.a.smithi037.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T05:56:27.379 INFO:journalctl@ceph.mon.a.smithi037.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T05:56:27.379 INFO:journalctl@ceph.mon.a.smithi037.stdout: 2024-09-19T05:56:27.379 INFO:journalctl@ceph.mon.a.smithi037.stdout: ** Compaction Stats [default] ** 2024-09-19T05:56:27.379 INFO:journalctl@ceph.mon.a.smithi037.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T05:56:27.379 INFO:journalctl@ceph.mon.a.smithi037.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-19T05:56:27.379 INFO:journalctl@ceph.mon.a.smithi037.stdout: L0 2/0 99.01 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 93.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T05:56:27.379 INFO:journalctl@ceph.mon.a.smithi037.stdout: Sum 2/0 99.01 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 93.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T05:56:27.379 INFO:journalctl@ceph.mon.a.smithi037.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 93.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T05:56:27.379 INFO:journalctl@ceph.mon.a.smithi037.stdout: 2024-09-19T05:56:27.379 INFO:journalctl@ceph.mon.a.smithi037.stdout: ** Compaction Stats [default] ** 2024-09-19T05:56:27.379 INFO:journalctl@ceph.mon.a.smithi037.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T05:56:27.380 INFO:journalctl@ceph.mon.a.smithi037.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-19T05:56:27.380 INFO:journalctl@ceph.mon.a.smithi037.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 93.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T05:56:27.380 INFO:journalctl@ceph.mon.a.smithi037.stdout: 2024-09-19T05:56:27.380 INFO:journalctl@ceph.mon.a.smithi037.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-19T05:56:27.380 INFO:journalctl@ceph.mon.a.smithi037.stdout: 2024-09-19T05:56:27.380 INFO:journalctl@ceph.mon.a.smithi037.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T05:56:27.380 INFO:journalctl@ceph.mon.a.smithi037.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-19T05:56:27.380 INFO:journalctl@ceph.mon.a.smithi037.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-19T05:56:27.380 INFO:journalctl@ceph.mon.a.smithi037.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-19T05:56:27.380 INFO:journalctl@ceph.mon.a.smithi037.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-19T05:56:27.380 INFO:journalctl@ceph.mon.a.smithi037.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-19T05:56:27.380 INFO:journalctl@ceph.mon.a.smithi037.stdout: Cumulative compaction: 0.00 GB write, 19.55 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T05:56:27.380 INFO:journalctl@ceph.mon.a.smithi037.stdout: Interval compaction: 0.00 GB write, 19.55 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T05:56:27.381 INFO:journalctl@ceph.mon.a.smithi037.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-19T05:56:27.381 INFO:journalctl@ceph.mon.a.smithi037.stdout: Block cache BinnedLRUCache@0x5611f4b0d1f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-19T05:56:27.381 INFO:journalctl@ceph.mon.a.smithi037.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-09-19T05:56:27.381 INFO:journalctl@ceph.mon.a.smithi037.stdout: 2024-09-19T05:56:27.381 INFO:journalctl@ceph.mon.a.smithi037.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-19T05:56:27.381 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: starting mon.a rank 0 at public addrs [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] at bind addrs [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid b8c8bdae-764b-11ef-bceb-c7b262605968 2024-09-19T05:56:27.381 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: mon.a@-1(???) e1 preinit fsid b8c8bdae-764b-11ef-bceb-c7b262605968 2024-09-19T05:56:27.381 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: mon.a@-1(???).mds e1 new map 2024-09-19T05:56:27.381 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: mon.a@-1(???).mds e1 print_map 2024-09-19T05:56:27.381 INFO:journalctl@ceph.mon.a.smithi037.stdout: e1 2024-09-19T05:56:27.381 INFO:journalctl@ceph.mon.a.smithi037.stdout: btime 2024-09-19T05:56:22:522867+0000 2024-09-19T05:56:27.381 INFO:journalctl@ceph.mon.a.smithi037.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T05:56:27.381 INFO:journalctl@ceph.mon.a.smithi037.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T05:56:27.381 INFO:journalctl@ceph.mon.a.smithi037.stdout: legacy client fscid: -1 2024-09-19T05:56:27.381 INFO:journalctl@ceph.mon.a.smithi037.stdout: 2024-09-19T05:56:27.382 INFO:journalctl@ceph.mon.a.smithi037.stdout: No filesystems configured 2024-09-19T05:56:27.382 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-19T05:56:27.382 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T05:56:27.382 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T05:56:27.382 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T05:56:27.382 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-19T05:56:27.382 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 bash[31192]: 916a85ee7b219c4087ba3fe080feb879d234175f7ebb5bec4db3c039fc238149 2024-09-19T05:56:27.382 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 systemd[1]: Started Ceph mon.a for b8c8bdae-764b-11ef-bceb-c7b262605968. 2024-09-19T05:56:27.382 INFO:teuthology.orchestra.run.smithi037.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-19T05:56:27.712 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-19T05:56:27.712 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: monmap epoch 1 2024-09-19T05:56:27.712 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: fsid b8c8bdae-764b-11ef-bceb-c7b262605968 2024-09-19T05:56:27.712 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: last_changed 2024-09-19T05:56:19.390249+0000 2024-09-19T05:56:27.712 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: created 2024-09-19T05:56:19.390249+0000 2024-09-19T05:56:27.712 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: min_mon_release 19 (squid) 2024-09-19T05:56:27.712 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: election_strategy: 1 2024-09-19T05:56:27.712 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: 0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-19T05:56:27.712 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: fsmap 2024-09-19T05:56:27.712 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: osdmap e1: 0 total, 0 up, 0 in 2024-09-19T05:56:27.712 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:27 smithi037 ceph-mon[31211]: mgrmap e1: no daemons active 2024-09-19T05:56:28.421 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:27.794+0000 7f41d8ac3640 1 Processor -- start 2024-09-19T05:56:28.421 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:27.794+0000 7f41d8ac3640 1 -- start start 2024-09-19T05:56:28.421 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:27.794+0000 7f41d8ac3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41d4107510 0x7f41d4107910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:56:28.421 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:27.794+0000 7f41d8ac3640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f41d4107ee0 con 0x7f41d4107510 2024-09-19T05:56:28.421 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:27.795+0000 7f41d259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41d4107510 0x7f41d4107910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:56:28.421 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:27.795+0000 7f41d259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41d4107510 0x7f41d4107910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47452/0 (socket says 172.21.15.37:47452) 2024-09-19T05:56:28.422 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:27.795+0000 7f41d259c640 1 -- 172.21.15.37:0/737467804 learned_addr learned my addr 172.21.15.37:0/737467804 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T05:56:28.422 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:27.795+0000 7f41d259c640 1 -- 172.21.15.37:0/737467804 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41d41086c0 con 0x7f41d4107510 2024-09-19T05:56:28.422 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:27.797+0000 7f41d259c640 1 --2- 172.21.15.37:0/737467804 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41d4107510 0x7f41d4107910 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f41c4009820 tx=0x7f41c402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a3cfc12aa9fa798 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:56:28.422 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:27.797+0000 7f41d159a640 1 -- 172.21.15.37:0/737467804 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41c4037070 con 0x7f41d4107510 2024-09-19T05:56:28.422 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:27.797+0000 7f41d159a640 1 -- 172.21.15.37:0/737467804 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f41c4032900 con 0x7f41d4107510 2024-09-19T05:56:28.422 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:27.797+0000 7f41d159a640 1 -- 172.21.15.37:0/737467804 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41c4030850 con 0x7f41d4107510 2024-09-19T05:56:28.422 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:27.797+0000 7f41d8ac3640 1 -- 172.21.15.37:0/737467804 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41d4107510 msgr2=0x7f41d4107910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:56:28.422 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:27.797+0000 7f41d8ac3640 1 --2- 172.21.15.37:0/737467804 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41d4107510 0x7f41d4107910 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f41c4009820 tx=0x7f41c402a270 comp rx=0 tx=0).stop 2024-09-19T05:56:28.422 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:27.797+0000 7f41d8ac3640 1 -- 172.21.15.37:0/737467804 shutdown_connections 2024-09-19T05:56:28.422 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:27.797+0000 7f41d8ac3640 1 --2- 172.21.15.37:0/737467804 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41d4107510 0x7f41d4107910 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:56:28.422 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:27.798+0000 7f41d8ac3640 1 -- 172.21.15.37:0/737467804 >> 172.21.15.37:0/737467804 conn(0x7f41d4102ce0 msgr2=0x7f41d4105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:56:28.422 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:27.798+0000 7f41d8ac3640 1 -- 172.21.15.37:0/737467804 shutdown_connections 2024-09-19T05:56:28.422 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:27.798+0000 7f41d8ac3640 1 -- 172.21.15.37:0/737467804 wait complete. 2024-09-19T05:56:28.422 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:27.798+0000 7f41d8ac3640 1 Processor -- start 2024-09-19T05:56:28.423 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:27.798+0000 7f41d8ac3640 1 -- start start 2024-09-19T05:56:28.423 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:27.798+0000 7f41d8ac3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41d4107510 0x7f41d419b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:56:28.423 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:27.798+0000 7f41d8ac3640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f41d410ba70 con 0x7f41d4107510 2024-09-19T05:56:28.423 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:27.799+0000 7f41d259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41d4107510 0x7f41d419b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:56:28.423 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:27.799+0000 7f41d259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41d4107510 0x7f41d419b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47462/0 (socket says 172.21.15.37:47462) 2024-09-19T05:56:28.423 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:27.799+0000 7f41d259c640 1 -- 172.21.15.37:0/201499238 learned_addr learned my addr 172.21.15.37:0/201499238 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T05:56:28.423 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:27.799+0000 7f41d259c640 1 -- 172.21.15.37:0/201499238 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41d419ba20 con 0x7f41d4107510 2024-09-19T05:56:28.423 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:27.799+0000 7f41d259c640 1 --2- 172.21.15.37:0/201499238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41d4107510 0x7f41d419b4e0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f41c4009940 tx=0x7f41c4032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:56:28.423 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:27.799+0000 7f41c37fe640 1 -- 172.21.15.37:0/201499238 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41c4042070 con 0x7f41d4107510 2024-09-19T05:56:28.423 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:27.799+0000 7f41c37fe640 1 -- 172.21.15.37:0/201499238 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f41c40308c0 con 0x7f41d4107510 2024-09-19T05:56:28.423 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:27.799+0000 7f41d8ac3640 1 -- 172.21.15.37:0/201499238 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41d419bcb0 con 0x7f41d4107510 2024-09-19T05:56:28.423 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:27.799+0000 7f41c37fe640 1 -- 172.21.15.37:0/201499238 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41c4037040 con 0x7f41d4107510 2024-09-19T05:56:28.423 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:27.799+0000 7f41d8ac3640 1 -- 172.21.15.37:0/201499238 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41d419e9a0 con 0x7f41d4107510 2024-09-19T05:56:28.424 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:27.800+0000 7f41c37fe640 1 -- 172.21.15.37:0/201499238 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f41c4045070 con 0x7f41d4107510 2024-09-19T05:56:28.424 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:27.800+0000 7f41c37fe640 1 -- 172.21.15.37:0/201499238 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f41c4047b70 con 0x7f41d4107510 2024-09-19T05:56:28.424 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:27.800+0000 7f41d8ac3640 1 -- 172.21.15.37:0/201499238 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41d410bbf0 con 0x7f41d4107510 2024-09-19T05:56:28.424 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:27.803+0000 7f41c37fe640 1 -- 172.21.15.37:0/201499238 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f41c40327b0 con 0x7f41d4107510 2024-09-19T05:56:28.424 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:27.862+0000 7f41d8ac3640 1 -- 172.21.15.37:0/201499238 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f41d419ef90 con 0x7f41d4107510 2024-09-19T05:56:28.424 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:27.866+0000 7f41c37fe640 1 -- 172.21.15.37:0/201499238 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7f41c403c760 con 0x7f41d4107510 2024-09-19T05:56:28.424 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:27.867+0000 7f41d8ac3640 1 -- 172.21.15.37:0/201499238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41d4107510 msgr2=0x7f41d419b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:56:28.424 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:27.867+0000 7f41d8ac3640 1 --2- 172.21.15.37:0/201499238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41d4107510 0x7f41d419b4e0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f41c4009940 tx=0x7f41c4032ce0 comp rx=0 tx=0).stop 2024-09-19T05:56:28.424 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:27.867+0000 7f41d8ac3640 1 -- 172.21.15.37:0/201499238 shutdown_connections 2024-09-19T05:56:28.425 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:27.867+0000 7f41d8ac3640 1 --2- 172.21.15.37:0/201499238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41d4107510 0x7f41d419b4e0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:56:28.425 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:27.867+0000 7f41d8ac3640 1 -- 172.21.15.37:0/201499238 >> 172.21.15.37:0/201499238 conn(0x7f41d4102ce0 msgr2=0x7f41d4103820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:56:28.425 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:27.867+0000 7f41d8ac3640 1 -- 172.21.15.37:0/201499238 shutdown_connections 2024-09-19T05:56:28.425 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:27.867+0000 7f41d8ac3640 1 -- 172.21.15.37:0/201499238 wait complete. 2024-09-19T05:56:28.425 INFO:teuthology.orchestra.run.smithi037.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-19T05:56:28.439 INFO:teuthology.orchestra.run.smithi037.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-19T05:56:28.439 INFO:teuthology.orchestra.run.smithi037.stdout:Creating mgr... 2024-09-19T05:56:28.439 INFO:teuthology.orchestra.run.smithi037.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-19T05:56:28.440 INFO:teuthology.orchestra.run.smithi037.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-19T05:56:28.704 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@mgr.x 2024-09-19T05:56:28.704 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Failed to reset failed state of unit ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@mgr.x.service: Unit ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@mgr.x.service not loaded. 2024-09-19T05:56:28.860 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-b8c8bdae-764b-11ef-bceb-c7b262605968.target.wants/ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@.service. 2024-09-19T05:56:29.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:28 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/201499238' entity='client.admin' 2024-09-19T05:56:29.074 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:28 smithi037 systemd[1]: Starting Ceph mgr.x for b8c8bdae-764b-11ef-bceb-c7b262605968... 2024-09-19T05:56:29.419 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:29 smithi037 podman[31424]: 2024-09-19 05:56:29.000902111 +0000 UTC m=+0.016315744 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T05:56:29.419 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:29 smithi037 podman[31424]: 2024-09-19 05:56:29.09929255 +0000 UTC m=+0.114706170 container create 404ceebffacfc1838cbb4a1f6f58bdd7e5fb8c4f71759a683e41007baa313b54 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-19T05:56:29.419 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:29 smithi037 podman[31424]: 2024-09-19 05:56:29.33442814 +0000 UTC m=+0.349841763 container init 404ceebffacfc1838cbb4a1f6f58bdd7e5fb8c4f71759a683e41007baa313b54 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T05:56:29.419 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:29 smithi037 podman[31424]: 2024-09-19 05:56:29.337287005 +0000 UTC m=+0.352700626 container start 404ceebffacfc1838cbb4a1f6f58bdd7e5fb8c4f71759a683e41007baa313b54 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-19T05:56:29.433 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T05:56:29.433 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout disabled 2024-09-19T05:56:29.441 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T05:56:29.441 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout inactive 2024-09-19T05:56:29.441 INFO:teuthology.orchestra.run.smithi037.stdout:firewalld.service is not enabled 2024-09-19T05:56:29.441 INFO:teuthology.orchestra.run.smithi037.stdout:Not possible to enable service . firewalld.service is not available 2024-09-19T05:56:29.450 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T05:56:29.450 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout disabled 2024-09-19T05:56:29.458 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T05:56:29.458 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout inactive 2024-09-19T05:56:29.458 INFO:teuthology.orchestra.run.smithi037.stdout:firewalld.service is not enabled 2024-09-19T05:56:29.458 INFO:teuthology.orchestra.run.smithi037.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-19T05:56:29.458 INFO:teuthology.orchestra.run.smithi037.stdout:Waiting for mgr to start... 2024-09-19T05:56:29.458 INFO:teuthology.orchestra.run.smithi037.stdout:Waiting for mgr... 2024-09-19T05:56:29.686 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:29 smithi037 bash[31424]: 404ceebffacfc1838cbb4a1f6f58bdd7e5fb8c4f71759a683e41007baa313b54 2024-09-19T05:56:29.687 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:29 smithi037 systemd[1]: Started Ceph mgr.x for b8c8bdae-764b-11ef-bceb-c7b262605968. 2024-09-19T05:56:29.687 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:29 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:56:29.462+0000 7fc1c4b51040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T05:56:29.687 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:29 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:56:29.529+0000 7fc1c4b51040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T05:56:29.687 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:29 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:56:29.684+0000 7fc1c4b51040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T05:56:29.973 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:29 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:56:29.756+0000 7fc1c4b51040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T05:56:29.973 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:29 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:56:29.914+0000 7fc1c4b51040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T05:56:30.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:30 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/244738091' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T05:56:30.250 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:30 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:56:30.064+0000 7fc1c4b51040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T05:56:30.494 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-09-19T05:56:30.506 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout { 2024-09-19T05:56:30.506 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "fsid": "b8c8bdae-764b-11ef-bceb-c7b262605968", 2024-09-19T05:56:30.506 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T05:56:30.506 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T05:56:30.506 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T05:56:30.506 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T05:56:30.506 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:56:30.506 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T05:56:30.507 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T05:56:30.507 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 0 2024-09-19T05:56:30.507 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-09-19T05:56:30.507 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T05:56:30.507 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T05:56:30.507 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-09-19T05:56:30.507 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-19T05:56:30.507 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T05:56:30.507 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T05:56:30.507 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T05:56:30.507 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T05:56:30.507 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:56:30.507 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T05:56:30.508 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T05:56:30.508 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T05:56:30.508 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T05:56:30.508 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T05:56:30.508 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T05:56:30.508 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T05:56:30.508 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T05:56:30.508 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:56:30.508 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T05:56:30.508 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T05:56:30.508 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T05:56:30.508 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T05:56:30.509 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T05:56:30.509 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T05:56:30.509 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T05:56:30.509 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T05:56:30.509 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T05:56:30.509 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:56:30.509 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T05:56:30.509 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T05:56:30.509 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T05:56:22:522867+0000", 2024-09-19T05:56:30.509 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T05:56:30.509 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T05:56:30.509 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:56:30.509 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T05:56:30.509 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-19T05:56:30.510 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T05:56:30.510 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T05:56:30.510 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T05:56:30.510 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T05:56:30.510 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T05:56:30.510 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-09-19T05:56:30.510 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T05:56:30.510 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:56:30.510 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T05:56:30.510 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T05:56:30.510 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T05:56:22.523594+0000", 2024-09-19T05:56:30.510 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T05:56:30.510 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:56:30.511 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T05:56:30.511 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout } 2024-09-19T05:56:30.511 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:29.900+0000 7fd30aff9640 1 Processor -- start 2024-09-19T05:56:30.511 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:29.900+0000 7fd30aff9640 1 -- start start 2024-09-19T05:56:30.511 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:29.901+0000 7fd30aff9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3041057a0 0x7fd304105ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:56:30.511 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:29.901+0000 7fd30aff9640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd304106170 con 0x7fd3041057a0 2024-09-19T05:56:30.511 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:29.901+0000 7fd308d95640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3041057a0 0x7fd304105ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:56:30.511 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:29.901+0000 7fd308d95640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3041057a0 0x7fd304105ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47470/0 (socket says 172.21.15.37:47470) 2024-09-19T05:56:30.511 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:29.901+0000 7fd308d95640 1 -- 172.21.15.37:0/3131140429 learned_addr learned my addr 172.21.15.37:0/3131140429 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T05:56:30.511 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:29.901+0000 7fd308d95640 1 -- 172.21.15.37:0/3131140429 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd304108780 con 0x7fd3041057a0 2024-09-19T05:56:30.511 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:29.902+0000 7fd308d95640 1 --2- 172.21.15.37:0/3131140429 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3041057a0 0x7fd304105ba0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fd2f8009820 tx=0x7fd2f802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=451dca01b8fc766d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:56:30.511 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:29.902+0000 7fd3037fe640 1 -- 172.21.15.37:0/3131140429 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2f8037070 con 0x7fd3041057a0 2024-09-19T05:56:30.512 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:29.902+0000 7fd3037fe640 1 -- 172.21.15.37:0/3131140429 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd2f8032900 con 0x7fd3041057a0 2024-09-19T05:56:30.512 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:29.902+0000 7fd3037fe640 1 -- 172.21.15.37:0/3131140429 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2f8030850 con 0x7fd3041057a0 2024-09-19T05:56:30.512 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:29.903+0000 7fd30aff9640 1 -- 172.21.15.37:0/3131140429 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3041057a0 msgr2=0x7fd304105ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:56:30.512 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:29.903+0000 7fd30aff9640 1 --2- 172.21.15.37:0/3131140429 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3041057a0 0x7fd304105ba0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fd2f8009820 tx=0x7fd2f802a270 comp rx=0 tx=0).stop 2024-09-19T05:56:30.512 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:29.903+0000 7fd30aff9640 1 -- 172.21.15.37:0/3131140429 shutdown_connections 2024-09-19T05:56:30.512 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:29.903+0000 7fd30aff9640 1 --2- 172.21.15.37:0/3131140429 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3041057a0 0x7fd304105ba0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:56:30.512 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:29.903+0000 7fd30aff9640 1 -- 172.21.15.37:0/3131140429 >> 172.21.15.37:0/3131140429 conn(0x7fd3041012f0 msgr2=0x7fd304103730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:56:30.512 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:29.903+0000 7fd30aff9640 1 -- 172.21.15.37:0/3131140429 shutdown_connections 2024-09-19T05:56:30.512 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:29.903+0000 7fd30aff9640 1 -- 172.21.15.37:0/3131140429 wait complete. 2024-09-19T05:56:30.512 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:29.904+0000 7fd30aff9640 1 Processor -- start 2024-09-19T05:56:30.512 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:29.904+0000 7fd30aff9640 1 -- start start 2024-09-19T05:56:30.513 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:29.904+0000 7fd30aff9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3041057a0 0x7fd30419d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:56:30.513 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:29.904+0000 7fd30aff9640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd30410b9b0 con 0x7fd3041057a0 2024-09-19T05:56:30.513 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:29.904+0000 7fd308d95640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3041057a0 0x7fd30419d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:56:30.513 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:29.904+0000 7fd308d95640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3041057a0 0x7fd30419d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47472/0 (socket says 172.21.15.37:47472) 2024-09-19T05:56:30.513 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:29.904+0000 7fd308d95640 1 -- 172.21.15.37:0/244738091 learned_addr learned my addr 172.21.15.37:0/244738091 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T05:56:30.513 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:29.905+0000 7fd308d95640 1 -- 172.21.15.37:0/244738091 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd30419dca0 con 0x7fd3041057a0 2024-09-19T05:56:30.513 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:29.905+0000 7fd308d95640 1 --2- 172.21.15.37:0/244738091 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3041057a0 0x7fd30419d760 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd2f8009940 tx=0x7fd2f8032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:56:30.513 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:29.905+0000 7fd301ffb640 1 -- 172.21.15.37:0/244738091 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2f8042070 con 0x7fd3041057a0 2024-09-19T05:56:30.513 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:29.905+0000 7fd301ffb640 1 -- 172.21.15.37:0/244738091 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd2f80308c0 con 0x7fd3041057a0 2024-09-19T05:56:30.513 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:29.905+0000 7fd301ffb640 1 -- 172.21.15.37:0/244738091 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2f8037040 con 0x7fd3041057a0 2024-09-19T05:56:30.514 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:29.905+0000 7fd30aff9640 1 -- 172.21.15.37:0/244738091 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd30419df30 con 0x7fd3041057a0 2024-09-19T05:56:30.514 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:29.905+0000 7fd30aff9640 1 -- 172.21.15.37:0/244738091 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3041a0c20 con 0x7fd3041057a0 2024-09-19T05:56:30.514 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:29.906+0000 7fd301ffb640 1 -- 172.21.15.37:0/244738091 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd2f8045070 con 0x7fd3041057a0 2024-09-19T05:56:30.514 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:29.906+0000 7fd301ffb640 1 -- 172.21.15.37:0/244738091 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd2f8047b70 con 0x7fd3041057a0 2024-09-19T05:56:30.514 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:29.906+0000 7fd30aff9640 1 -- 172.21.15.37:0/244738091 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd304105c20 con 0x7fd3041057a0 2024-09-19T05:56:30.514 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:29.908+0000 7fd301ffb640 1 -- 172.21.15.37:0/244738091 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fd2f80327b0 con 0x7fd3041057a0 2024-09-19T05:56:30.514 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:29.971+0000 7fd30aff9640 1 -- 172.21.15.37:0/244738091 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fd3041a0df0 con 0x7fd3041057a0 2024-09-19T05:56:30.514 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:29.971+0000 7fd301ffb640 1 -- 172.21.15.37:0/244738091 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7fd2f803c760 con 0x7fd3041057a0 2024-09-19T05:56:30.514 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:29.973+0000 7fd30aff9640 1 -- 172.21.15.37:0/244738091 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3041057a0 msgr2=0x7fd30419d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:56:30.514 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:29.973+0000 7fd30aff9640 1 --2- 172.21.15.37:0/244738091 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3041057a0 0x7fd30419d760 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd2f8009940 tx=0x7fd2f8032ce0 comp rx=0 tx=0).stop 2024-09-19T05:56:30.514 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:29.973+0000 7fd30aff9640 1 -- 172.21.15.37:0/244738091 shutdown_connections 2024-09-19T05:56:30.515 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:29.973+0000 7fd30aff9640 1 --2- 172.21.15.37:0/244738091 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3041057a0 0x7fd30419d760 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:56:30.515 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:29.973+0000 7fd30aff9640 1 -- 172.21.15.37:0/244738091 >> 172.21.15.37:0/244738091 conn(0x7fd3041012f0 msgr2=0x7fd304101e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:56:30.515 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:29.973+0000 7fd30aff9640 1 -- 172.21.15.37:0/244738091 shutdown_connections 2024-09-19T05:56:30.515 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:29.973+0000 7fd30aff9640 1 -- 172.21.15.37:0/244738091 wait complete. 2024-09-19T05:56:30.515 INFO:teuthology.orchestra.run.smithi037.stdout:mgr not available, waiting (1/15)... 2024-09-19T05:56:30.573 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:30 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:56:30.396+0000 7fc1c4b51040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T05:56:30.574 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:30 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:56:30.460+0000 7fc1c4b51040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T05:56:31.073 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:30 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:56:30.654+0000 7fc1c4b51040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T05:56:32.034 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:31 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:56:31.575+0000 7fc1c4b51040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T05:56:32.034 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:31 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:56:31.645+0000 7fc1c4b51040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T05:56:32.666 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:32 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:56:32.410+0000 7fc1c4b51040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T05:56:32.666 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:32 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:56:32.536+0000 7fc1c4b51040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T05:56:32.965 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:32 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:56:32.692+0000 7fc1c4b51040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T05:56:32.965 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:32 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:56:32.756+0000 7fc1c4b51040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T05:56:32.965 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:32 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:56:32.912+0000 7fc1c4b51040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T05:56:33.281 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:32 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:56:32.983+0000 7fc1c4b51040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T05:56:33.281 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:33 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:56:33.046+0000 7fc1c4b51040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T05:56:33.281 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:33 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:56:33.211+0000 7fc1c4b51040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T05:56:33.282 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:33 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:56:33.279+0000 7fc1c4b51040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T05:56:33.560 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:33 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:56:33.348+0000 7fc1c4b51040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T05:56:33.560 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:33 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:56:33.434+0000 7fc1c4b51040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T05:56:33.560 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:33 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:56:33.496+0000 7fc1c4b51040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T05:56:33.560 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:33 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:56:33.557+0000 7fc1c4b51040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T05:56:34.824 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:34 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:56:34.388+0000 7fc1c4b51040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T05:56:34.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:34 smithi037 ceph-mon[31211]: Activating manager daemon x 2024-09-19T05:56:34.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:34 smithi037 ceph-mon[31211]: mgrmap e2: x(active, starting, since 0.00319181s) 2024-09-19T05:56:34.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:34 smithi037 ceph-mon[31211]: from='mgr.14100 172.21.15.37:0/931550707' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T05:56:34.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:34 smithi037 ceph-mon[31211]: from='mgr.14100 172.21.15.37:0/931550707' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T05:56:34.825 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:34 smithi037 ceph-mon[31211]: from='mgr.14100 172.21.15.37:0/931550707' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T05:56:34.825 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:34 smithi037 ceph-mon[31211]: from='mgr.14100 172.21.15.37:0/931550707' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T05:56:34.825 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:34 smithi037 ceph-mon[31211]: from='mgr.14100 172.21.15.37:0/931550707' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T05:56:34.825 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:34 smithi037 ceph-mon[31211]: Manager daemon x is now available 2024-09-19T05:56:34.825 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:34 smithi037 ceph-mon[31211]: from='mgr.14100 172.21.15.37:0/931550707' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T05:56:34.825 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:34 smithi037 ceph-mon[31211]: from='mgr.14100 172.21.15.37:0/931550707' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T05:56:34.825 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:34 smithi037 ceph-mon[31211]: from='mgr.14100 172.21.15.37:0/931550707' entity='mgr.x' 2024-09-19T05:56:34.825 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:34 smithi037 ceph-mon[31211]: from='mgr.14100 172.21.15.37:0/931550707' entity='mgr.x' 2024-09-19T05:56:34.825 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:34 smithi037 ceph-mon[31211]: from='mgr.14100 172.21.15.37:0/931550707' entity='mgr.x' 2024-09-19T05:56:36.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:36 smithi037 ceph-mon[31211]: mgrmap e3: x(active, since 1.00761s) 2024-09-19T05:56:36.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:36 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/522234555' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T05:56:37.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:37 smithi037 ceph-mon[31211]: mgrmap e4: x(active, since 2s) 2024-09-19T05:56:41.777 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-09-19T05:56:41.777 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout { 2024-09-19T05:56:41.777 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "fsid": "b8c8bdae-764b-11ef-bceb-c7b262605968", 2024-09-19T05:56:41.777 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T05:56:41.777 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T05:56:41.778 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T05:56:41.778 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T05:56:41.778 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:56:41.778 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T05:56:41.778 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T05:56:41.778 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 0 2024-09-19T05:56:41.778 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-09-19T05:56:41.778 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T05:56:41.778 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T05:56:41.778 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-09-19T05:56:41.778 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-09-19T05:56:41.778 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T05:56:41.778 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T05:56:41.778 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T05:56:41.778 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T05:56:41.779 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:56:41.779 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T05:56:41.779 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T05:56:41.779 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T05:56:41.779 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T05:56:41.779 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T05:56:41.787 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T05:56:41.787 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T05:56:41.787 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T05:56:41.787 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:56:41.787 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T05:56:41.787 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T05:56:41.787 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T05:56:41.788 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T05:56:41.788 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T05:56:41.788 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T05:56:41.788 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T05:56:41.788 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T05:56:41.788 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T05:56:41.788 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:56:41.788 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T05:56:41.788 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T05:56:41.788 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T05:56:22:522867+0000", 2024-09-19T05:56:41.788 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T05:56:41.788 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T05:56:41.788 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:56:41.789 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T05:56:41.789 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T05:56:41.789 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T05:56:41.789 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T05:56:41.789 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T05:56:41.789 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T05:56:41.789 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T05:56:41.789 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-09-19T05:56:41.789 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T05:56:41.789 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:56:41.789 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T05:56:41.789 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T05:56:41.789 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T05:56:22.523594+0000", 2024-09-19T05:56:41.789 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T05:56:41.790 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:56:41.790 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T05:56:41.790 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout } 2024-09-19T05:56:41.790 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:35.497+0000 7fe742d87640 1 Processor -- start 2024-09-19T05:56:41.790 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:35.497+0000 7fe742d87640 1 -- start start 2024-09-19T05:56:41.790 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:35.497+0000 7fe742d87640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe73c108020 0x7fe73c10a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:56:41.790 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:35.497+0000 7fe742d87640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe73c07bda0 con 0x7fe73c108020 2024-09-19T05:56:41.790 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:35.497+0000 7fe740b23640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe73c108020 0x7fe73c10a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:56:41.790 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:35.497+0000 7fe740b23640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe73c108020 0x7fe73c10a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42348/0 (socket says 172.21.15.37:42348) 2024-09-19T05:56:41.790 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:35.497+0000 7fe740b23640 1 -- 172.21.15.37:0/4209460170 learned_addr learned my addr 172.21.15.37:0/4209460170 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T05:56:41.790 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:35.498+0000 7fe740b23640 1 -- 172.21.15.37:0/4209460170 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe73c10a950 con 0x7fe73c108020 2024-09-19T05:56:41.790 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:35.498+0000 7fe740b23640 1 --2- 172.21.15.37:0/4209460170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe73c108020 0x7fe73c10a410 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe730009820 tx=0x7fe73002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0c1859abf52045e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:56:41.790 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:35.499+0000 7fe73b7fe640 1 -- 172.21.15.37:0/4209460170 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe730037070 con 0x7fe73c108020 2024-09-19T05:56:41.791 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:35.499+0000 7fe73b7fe640 1 -- 172.21.15.37:0/4209460170 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe730032900 con 0x7fe73c108020 2024-09-19T05:56:41.791 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:35.499+0000 7fe73b7fe640 1 -- 172.21.15.37:0/4209460170 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe730030850 con 0x7fe73c108020 2024-09-19T05:56:41.791 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:35.499+0000 7fe742d87640 1 -- 172.21.15.37:0/4209460170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe73c108020 msgr2=0x7fe73c10a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:56:41.791 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:35.499+0000 7fe742d87640 1 --2- 172.21.15.37:0/4209460170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe73c108020 0x7fe73c10a410 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe730009820 tx=0x7fe73002a270 comp rx=0 tx=0).stop 2024-09-19T05:56:41.791 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:35.499+0000 7fe742d87640 1 -- 172.21.15.37:0/4209460170 shutdown_connections 2024-09-19T05:56:41.791 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:35.499+0000 7fe742d87640 1 --2- 172.21.15.37:0/4209460170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe73c108020 0x7fe73c10a410 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:56:41.791 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:35.499+0000 7fe742d87640 1 -- 172.21.15.37:0/4209460170 >> 172.21.15.37:0/4209460170 conn(0x7fe73c101b60 msgr2=0x7fe73c103fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:56:41.791 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:35.499+0000 7fe742d87640 1 -- 172.21.15.37:0/4209460170 shutdown_connections 2024-09-19T05:56:41.791 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:35.499+0000 7fe742d87640 1 -- 172.21.15.37:0/4209460170 wait complete. 2024-09-19T05:56:41.791 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:35.500+0000 7fe742d87640 1 Processor -- start 2024-09-19T05:56:41.791 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:35.500+0000 7fe742d87640 1 -- start start 2024-09-19T05:56:41.791 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:35.500+0000 7fe742d87640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe73c108020 0x7fe73c19d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:56:41.791 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:35.500+0000 7fe742d87640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe73c10b8d0 con 0x7fe73c108020 2024-09-19T05:56:41.791 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:35.500+0000 7fe740b23640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe73c108020 0x7fe73c19d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:56:41.792 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:35.500+0000 7fe740b23640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe73c108020 0x7fe73c19d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42358/0 (socket says 172.21.15.37:42358) 2024-09-19T05:56:41.792 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:35.500+0000 7fe740b23640 1 -- 172.21.15.37:0/522234555 learned_addr learned my addr 172.21.15.37:0/522234555 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T05:56:41.792 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:35.500+0000 7fe740b23640 1 -- 172.21.15.37:0/522234555 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe73c19dc20 con 0x7fe73c108020 2024-09-19T05:56:41.792 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:35.501+0000 7fe740b23640 1 --2- 172.21.15.37:0/522234555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe73c108020 0x7fe73c19d6e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe7300097f0 tx=0x7fe730030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:56:41.792 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:35.501+0000 7fe739ffb640 1 -- 172.21.15.37:0/522234555 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe730037040 con 0x7fe73c108020 2024-09-19T05:56:41.792 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:35.501+0000 7fe739ffb640 1 -- 172.21.15.37:0/522234555 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe730040070 con 0x7fe73c108020 2024-09-19T05:56:41.792 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:35.501+0000 7fe742d87640 1 -- 172.21.15.37:0/522234555 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe73c19deb0 con 0x7fe73c108020 2024-09-19T05:56:41.792 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:35.501+0000 7fe739ffb640 1 -- 172.21.15.37:0/522234555 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe73003a390 con 0x7fe73c108020 2024-09-19T05:56:41.792 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:35.501+0000 7fe742d87640 1 -- 172.21.15.37:0/522234555 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe73c1a0ba0 con 0x7fe73c108020 2024-09-19T05:56:41.792 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:35.502+0000 7fe739ffb640 1 -- 172.21.15.37:0/522234555 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 3) ==== 46344+0+0 (secure 0 0 0) 0x7fe730032900 con 0x7fe73c108020 2024-09-19T05:56:41.792 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:35.502+0000 7fe742d87640 1 -- 172.21.15.37:0/522234555 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe73c108480 con 0x7fe73c108020 2024-09-19T05:56:41.792 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:35.502+0000 7fe739ffb640 1 --2- 172.21.15.37:0/522234555 >> [v2:172.21.15.37:6800/3277805697,v1:172.21.15.37:6801/3277805697] conn(0x7fe72c0390a0 0x7fe72c03b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:56:41.792 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:35.502+0000 7fe739ffb640 1 -- 172.21.15.37:0/522234555 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe73006c130 con 0x7fe73c108020 2024-09-19T05:56:41.793 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:35.502+0000 7fe73bfff640 1 --2- 172.21.15.37:0/522234555 >> [v2:172.21.15.37:6800/3277805697,v1:172.21.15.37:6801/3277805697] conn(0x7fe72c0390a0 0x7fe72c03b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:56:41.793 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:35.503+0000 7fe73bfff640 1 --2- 172.21.15.37:0/522234555 >> [v2:172.21.15.37:6800/3277805697,v1:172.21.15.37:6801/3277805697] conn(0x7fe72c0390a0 0x7fe72c03b560 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe7280098c0 tx=0x7fe728006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:56:41.793 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:35.507+0000 7fe739ffb640 1 -- 172.21.15.37:0/522234555 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe73003a6a0 con 0x7fe73c108020 2024-09-19T05:56:41.793 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:35.750+0000 7fe742d87640 1 -- 172.21.15.37:0/522234555 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fe73c1a0d70 con 0x7fe73c108020 2024-09-19T05:56:41.793 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:35.751+0000 7fe739ffb640 1 -- 172.21.15.37:0/522234555 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1290 (secure 0 0 0) 0x7fe730032bf0 con 0x7fe73c108020 2024-09-19T05:56:41.793 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:35.753+0000 7fe742d87640 1 -- 172.21.15.37:0/522234555 >> [v2:172.21.15.37:6800/3277805697,v1:172.21.15.37:6801/3277805697] conn(0x7fe72c0390a0 msgr2=0x7fe72c03b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:56:41.793 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:35.753+0000 7fe742d87640 1 --2- 172.21.15.37:0/522234555 >> [v2:172.21.15.37:6800/3277805697,v1:172.21.15.37:6801/3277805697] conn(0x7fe72c0390a0 0x7fe72c03b560 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe7280098c0 tx=0x7fe728006db0 comp rx=0 tx=0).stop 2024-09-19T05:56:41.793 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:35.753+0000 7fe742d87640 1 -- 172.21.15.37:0/522234555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe73c108020 msgr2=0x7fe73c19d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:56:41.793 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:35.753+0000 7fe742d87640 1 --2- 172.21.15.37:0/522234555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe73c108020 0x7fe73c19d6e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe7300097f0 tx=0x7fe730030d80 comp rx=0 tx=0).stop 2024-09-19T05:56:41.793 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:35.753+0000 7fe742d87640 1 -- 172.21.15.37:0/522234555 shutdown_connections 2024-09-19T05:56:41.793 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:35.753+0000 7fe742d87640 1 --2- 172.21.15.37:0/522234555 >> [v2:172.21.15.37:6800/3277805697,v1:172.21.15.37:6801/3277805697] conn(0x7fe72c0390a0 0x7fe72c03b560 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:56:41.793 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:35.753+0000 7fe742d87640 1 --2- 172.21.15.37:0/522234555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe73c108020 0x7fe73c19d6e0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:56:41.793 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:35.753+0000 7fe742d87640 1 -- 172.21.15.37:0/522234555 >> 172.21.15.37:0/522234555 conn(0x7fe73c101b60 msgr2=0x7fe73c102700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:56:41.793 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:35.753+0000 7fe742d87640 1 -- 172.21.15.37:0/522234555 shutdown_connections 2024-09-19T05:56:41.794 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:35.753+0000 7fe742d87640 1 -- 172.21.15.37:0/522234555 wait complete. 2024-09-19T05:56:41.794 INFO:teuthology.orchestra.run.smithi037.stdout:mgr is available 2024-09-19T05:56:43.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:43 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/2091755756' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-19T05:56:43.610 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-09-19T05:56:43.610 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout [global] 2024-09-19T05:56:43.610 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout fsid = b8c8bdae-764b-11ef-bceb-c7b262605968 2024-09-19T05:56:43.610 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.37:3300,v1:172.21.15.37:6789] 2024-09-19T05:56:43.610 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-19T05:56:43.610 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-19T05:56:43.610 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-19T05:56:43.610 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-19T05:56:43.610 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-09-19T05:56:43.610 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-19T05:56:43.610 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-19T05:56:43.611 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-09-19T05:56:43.611 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout [osd] 2024-09-19T05:56:43.611 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-19T05:56:43.611 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-19T05:56:43.611 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-19T05:56:43.611 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-19T05:56:43.611 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-19T05:56:43.611 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:42.811+0000 7f467c40b640 1 Processor -- start 2024-09-19T05:56:43.611 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:42.811+0000 7f467c40b640 1 -- start start 2024-09-19T05:56:43.611 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:42.811+0000 7f467c40b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4674107f10 0x7f467410a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:56:43.611 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:42.811+0000 7f467c40b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f467410a840 con 0x7f4674107f10 2024-09-19T05:56:43.611 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:42.812+0000 7f467a1a7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4674107f10 0x7f467410a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:56:43.611 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:42.812+0000 7f467a1a7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4674107f10 0x7f467410a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42374/0 (socket says 172.21.15.37:42374) 2024-09-19T05:56:43.612 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:42.812+0000 7f467a1a7640 1 -- 172.21.15.37:0/1826985529 learned_addr learned my addr 172.21.15.37:0/1826985529 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T05:56:43.612 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:42.812+0000 7f467a1a7640 1 -- 172.21.15.37:0/1826985529 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f467410a9c0 con 0x7f4674107f10 2024-09-19T05:56:43.612 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:42.813+0000 7f467a1a7640 1 --2- 172.21.15.37:0/1826985529 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4674107f10 0x7f467410a300 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4668009820 tx=0x7f466802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e075f228bd067195 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:56:43.612 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:42.813+0000 7f46791a5640 1 -- 172.21.15.37:0/1826985529 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4668037070 con 0x7f4674107f10 2024-09-19T05:56:43.612 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:42.813+0000 7f46791a5640 1 -- 172.21.15.37:0/1826985529 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4668032900 con 0x7f4674107f10 2024-09-19T05:56:43.612 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:42.813+0000 7f46791a5640 1 -- 172.21.15.37:0/1826985529 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4668030850 con 0x7f4674107f10 2024-09-19T05:56:43.612 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:42.813+0000 7f467c40b640 1 -- 172.21.15.37:0/1826985529 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4674107f10 msgr2=0x7f467410a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:56:43.612 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:42.813+0000 7f467c40b640 1 --2- 172.21.15.37:0/1826985529 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4674107f10 0x7f467410a300 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4668009820 tx=0x7f466802a270 comp rx=0 tx=0).stop 2024-09-19T05:56:43.612 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:42.814+0000 7f467c40b640 1 -- 172.21.15.37:0/1826985529 shutdown_connections 2024-09-19T05:56:43.612 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:42.814+0000 7f467c40b640 1 --2- 172.21.15.37:0/1826985529 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4674107f10 0x7f467410a300 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:56:43.612 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:42.814+0000 7f467c40b640 1 -- 172.21.15.37:0/1826985529 >> 172.21.15.37:0/1826985529 conn(0x7f4674101af0 msgr2=0x7f4674103f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:56:43.612 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:42.814+0000 7f467c40b640 1 -- 172.21.15.37:0/1826985529 shutdown_connections 2024-09-19T05:56:43.612 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:42.814+0000 7f467c40b640 1 -- 172.21.15.37:0/1826985529 wait complete. 2024-09-19T05:56:43.613 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:42.814+0000 7f467c40b640 1 Processor -- start 2024-09-19T05:56:43.613 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:42.814+0000 7f467c40b640 1 -- start start 2024-09-19T05:56:43.613 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:42.814+0000 7f467c40b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4674107f10 0x7f4674107790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:56:43.613 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:42.814+0000 7f467c40b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f467410b9a0 con 0x7f4674107f10 2024-09-19T05:56:43.613 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:42.815+0000 7f467a1a7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4674107f10 0x7f4674107790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:56:43.613 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:42.815+0000 7f467a1a7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4674107f10 0x7f4674107790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42378/0 (socket says 172.21.15.37:42378) 2024-09-19T05:56:43.613 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:42.815+0000 7f467a1a7640 1 -- 172.21.15.37:0/2091755756 learned_addr learned my addr 172.21.15.37:0/2091755756 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T05:56:43.613 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:42.815+0000 7f467a1a7640 1 -- 172.21.15.37:0/2091755756 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4674107cd0 con 0x7f4674107f10 2024-09-19T05:56:43.613 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:42.815+0000 7f467a1a7640 1 --2- 172.21.15.37:0/2091755756 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4674107f10 0x7f4674107790 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f46680097f0 tx=0x7f4668030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:56:43.613 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:42.815+0000 7f46677fe640 1 -- 172.21.15.37:0/2091755756 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4668037040 con 0x7f4674107f10 2024-09-19T05:56:43.613 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:42.815+0000 7f467c40b640 1 -- 172.21.15.37:0/2091755756 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4674105ec0 con 0x7f4674107f10 2024-09-19T05:56:43.613 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:42.815+0000 7f46677fe640 1 -- 172.21.15.37:0/2091755756 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4668040070 con 0x7f4674107f10 2024-09-19T05:56:43.613 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:42.815+0000 7f46677fe640 1 -- 172.21.15.37:0/2091755756 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f466803a390 con 0x7f4674107f10 2024-09-19T05:56:43.614 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:42.815+0000 7f467c40b640 1 -- 172.21.15.37:0/2091755756 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46741063a0 con 0x7f4674107f10 2024-09-19T05:56:43.614 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:42.816+0000 7f46677fe640 1 -- 172.21.15.37:0/2091755756 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7f466803a630 con 0x7f4674107f10 2024-09-19T05:56:43.614 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:42.816+0000 7f46677fe640 1 --2- 172.21.15.37:0/2091755756 >> [v2:172.21.15.37:6800/3277805697,v1:172.21.15.37:6801/3277805697] conn(0x7f4660039160 0x7f466003b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:56:43.614 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:42.816+0000 7f467c40b640 1 -- 172.21.15.37:0/2091755756 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4674108370 con 0x7f4674107f10 2024-09-19T05:56:43.614 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:42.816+0000 7f46677fe640 1 -- 172.21.15.37:0/2091755756 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f466806d4c0 con 0x7f4674107f10 2024-09-19T05:56:43.614 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:42.816+0000 7f46799a6640 1 --2- 172.21.15.37:0/2091755756 >> [v2:172.21.15.37:6800/3277805697,v1:172.21.15.37:6801/3277805697] conn(0x7f4660039160 0x7f466003b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:56:43.614 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:42.817+0000 7f46799a6640 1 --2- 172.21.15.37:0/2091755756 >> [v2:172.21.15.37:6800/3277805697,v1:172.21.15.37:6801/3277805697] conn(0x7f4660039160 0x7f466003b620 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f46700098c0 tx=0x7f4670006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:56:43.614 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:42.821+0000 7f46677fe640 1 -- 172.21.15.37:0/2091755756 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f466806d220 con 0x7f4674107f10 2024-09-19T05:56:43.614 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:43.003+0000 7f467c40b640 1 -- 172.21.15.37:0/2091755756 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f4674106ad0 con 0x7f4674107f10 2024-09-19T05:56:43.614 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:43.004+0000 7f46677fe640 1 -- 172.21.15.37:0/2091755756 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+429 (secure 0 0 0) 0x7f4668043760 con 0x7f4674107f10 2024-09-19T05:56:43.614 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:43.007+0000 7f467c40b640 1 -- 172.21.15.37:0/2091755756 >> [v2:172.21.15.37:6800/3277805697,v1:172.21.15.37:6801/3277805697] conn(0x7f4660039160 msgr2=0x7f466003b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:56:43.614 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:43.007+0000 7f467c40b640 1 --2- 172.21.15.37:0/2091755756 >> [v2:172.21.15.37:6800/3277805697,v1:172.21.15.37:6801/3277805697] conn(0x7f4660039160 0x7f466003b620 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f46700098c0 tx=0x7f4670006db0 comp rx=0 tx=0).stop 2024-09-19T05:56:43.614 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:43.007+0000 7f467c40b640 1 -- 172.21.15.37:0/2091755756 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4674107f10 msgr2=0x7f4674107790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:56:43.615 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:43.007+0000 7f467c40b640 1 --2- 172.21.15.37:0/2091755756 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4674107f10 0x7f4674107790 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f46680097f0 tx=0x7f4668030d80 comp rx=0 tx=0).stop 2024-09-19T05:56:43.615 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:43.007+0000 7f467c40b640 1 -- 172.21.15.37:0/2091755756 shutdown_connections 2024-09-19T05:56:43.615 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:43.007+0000 7f467c40b640 1 --2- 172.21.15.37:0/2091755756 >> [v2:172.21.15.37:6800/3277805697,v1:172.21.15.37:6801/3277805697] conn(0x7f4660039160 0x7f466003b620 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:56:43.615 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:43.007+0000 7f467c40b640 1 --2- 172.21.15.37:0/2091755756 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4674107f10 0x7f4674107790 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:56:43.615 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:43.007+0000 7f467c40b640 1 -- 172.21.15.37:0/2091755756 >> 172.21.15.37:0/2091755756 conn(0x7f4674101af0 msgr2=0x7f46741026b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:56:43.615 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:43.007+0000 7f467c40b640 1 -- 172.21.15.37:0/2091755756 shutdown_connections 2024-09-19T05:56:43.615 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:43.007+0000 7f467c40b640 1 -- 172.21.15.37:0/2091755756 wait complete. 2024-09-19T05:56:43.615 INFO:teuthology.orchestra.run.smithi037.stdout:Enabling cephadm module... 2024-09-19T05:56:44.480 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:44 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/1463254243' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-19T05:56:44.481 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:44 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: ignoring --setuser ceph since I am not root 2024-09-19T05:56:44.481 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:44 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: ignoring --setgroup ceph since I am not root 2024-09-19T05:56:44.481 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:44 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:56:44.418+0000 7f1ebff7b040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T05:56:44.481 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:44 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:56:44.478+0000 7f1ebff7b040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T05:56:44.774 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:44 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:56:44.632+0000 7f1ebff7b040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T05:56:44.775 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:44 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:56:44.701+0000 7f1ebff7b040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T05:56:44.776 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:43.992+0000 7f3996356640 1 Processor -- start 2024-09-19T05:56:44.781 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:43.992+0000 7f3996356640 1 -- start start 2024-09-19T05:56:44.781 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:43.992+0000 7f3996356640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39901057d0 0x7f3990105bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:56:44.781 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:43.992+0000 7f3996356640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f39901061a0 con 0x7f39901057d0 2024-09-19T05:56:44.782 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:43.993+0000 7f398ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39901057d0 0x7f3990105bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:56:44.782 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:43.993+0000 7f398ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39901057d0 0x7f3990105bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45550/0 (socket says 172.21.15.37:45550) 2024-09-19T05:56:44.782 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:43.993+0000 7f398ffff640 1 -- 172.21.15.37:0/143039073 learned_addr learned my addr 172.21.15.37:0/143039073 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T05:56:44.782 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:43.993+0000 7f398ffff640 1 -- 172.21.15.37:0/143039073 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3990106320 con 0x7f39901057d0 2024-09-19T05:56:44.782 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:43.994+0000 7f398ffff640 1 --2- 172.21.15.37:0/143039073 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39901057d0 0x7f3990105bd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3980009820 tx=0x7f398002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ede456c51c6baa19 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:56:44.782 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:43.994+0000 7f398effd640 1 -- 172.21.15.37:0/143039073 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3980037070 con 0x7f39901057d0 2024-09-19T05:56:44.782 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:43.994+0000 7f398effd640 1 -- 172.21.15.37:0/143039073 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3980032900 con 0x7f39901057d0 2024-09-19T05:56:44.782 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:43.994+0000 7f398effd640 1 -- 172.21.15.37:0/143039073 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3980030850 con 0x7f39901057d0 2024-09-19T05:56:44.782 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:43.994+0000 7f3996356640 1 -- 172.21.15.37:0/143039073 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39901057d0 msgr2=0x7f3990105bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:56:44.782 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:43.994+0000 7f3996356640 1 --2- 172.21.15.37:0/143039073 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39901057d0 0x7f3990105bd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3980009820 tx=0x7f398002a270 comp rx=0 tx=0).stop 2024-09-19T05:56:44.782 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:43.995+0000 7f3996356640 1 -- 172.21.15.37:0/143039073 shutdown_connections 2024-09-19T05:56:44.782 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:43.995+0000 7f3996356640 1 --2- 172.21.15.37:0/143039073 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39901057d0 0x7f3990105bd0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:56:44.782 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:43.995+0000 7f3996356640 1 -- 172.21.15.37:0/143039073 >> 172.21.15.37:0/143039073 conn(0x7f3990101360 msgr2=0x7f3990103780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:56:44.783 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:43.995+0000 7f3996356640 1 -- 172.21.15.37:0/143039073 shutdown_connections 2024-09-19T05:56:44.783 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:43.995+0000 7f3996356640 1 -- 172.21.15.37:0/143039073 wait complete. 2024-09-19T05:56:44.783 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:43.995+0000 7f3996356640 1 Processor -- start 2024-09-19T05:56:44.783 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:43.995+0000 7f3996356640 1 -- start start 2024-09-19T05:56:44.783 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:43.995+0000 7f3996356640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39901057d0 0x7f399019b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:56:44.783 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:43.995+0000 7f3996356640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f39901096b0 con 0x7f39901057d0 2024-09-19T05:56:44.783 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:43.996+0000 7f398ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39901057d0 0x7f399019b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:56:44.783 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:43.996+0000 7f398ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39901057d0 0x7f399019b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45558/0 (socket says 172.21.15.37:45558) 2024-09-19T05:56:44.783 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:43.996+0000 7f398ffff640 1 -- 172.21.15.37:0/1463254243 learned_addr learned my addr 172.21.15.37:0/1463254243 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T05:56:44.783 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:43.996+0000 7f398ffff640 1 -- 172.21.15.37:0/1463254243 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f399019b9e0 con 0x7f39901057d0 2024-09-19T05:56:44.783 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:43.996+0000 7f398ffff640 1 --2- 172.21.15.37:0/1463254243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39901057d0 0x7f399019b4a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3980009940 tx=0x7f3980032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:56:44.783 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:43.996+0000 7f398d7fa640 1 -- 172.21.15.37:0/1463254243 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3980042070 con 0x7f39901057d0 2024-09-19T05:56:44.783 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:43.996+0000 7f3996356640 1 -- 172.21.15.37:0/1463254243 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f399019bcd0 con 0x7f39901057d0 2024-09-19T05:56:44.783 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:43.996+0000 7f398d7fa640 1 -- 172.21.15.37:0/1463254243 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f39800308c0 con 0x7f39901057d0 2024-09-19T05:56:44.784 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:43.996+0000 7f398d7fa640 1 -- 172.21.15.37:0/1463254243 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3980037040 con 0x7f39901057d0 2024-09-19T05:56:44.784 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:43.996+0000 7f3996356640 1 -- 172.21.15.37:0/1463254243 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f399019e960 con 0x7f39901057d0 2024-09-19T05:56:44.784 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:43.997+0000 7f398d7fa640 1 -- 172.21.15.37:0/1463254243 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7f3980045070 con 0x7f39901057d0 2024-09-19T05:56:44.784 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:43.997+0000 7f3996356640 1 -- 172.21.15.37:0/1463254243 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3990105c50 con 0x7f39901057d0 2024-09-19T05:56:44.784 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:43.998+0000 7f398d7fa640 1 --2- 172.21.15.37:0/1463254243 >> [v2:172.21.15.37:6800/3277805697,v1:172.21.15.37:6801/3277805697] conn(0x7f3978039160 0x7f397803b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:56:44.784 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:43.998+0000 7f398d7fa640 1 -- 172.21.15.37:0/1463254243 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f398006c440 con 0x7f39901057d0 2024-09-19T05:56:44.784 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:43.998+0000 7f398f7fe640 1 --2- 172.21.15.37:0/1463254243 >> [v2:172.21.15.37:6800/3277805697,v1:172.21.15.37:6801/3277805697] conn(0x7f3978039160 0x7f397803b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:56:44.784 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:43.998+0000 7f398f7fe640 1 --2- 172.21.15.37:0/1463254243 >> [v2:172.21.15.37:6800/3277805697,v1:172.21.15.37:6801/3277805697] conn(0x7f3978039160 0x7f397803b620 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f39840098c0 tx=0x7f3984006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:56:44.784 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:44.002+0000 7f398d7fa640 1 -- 172.21.15.37:0/1463254243 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f398006be60 con 0x7f39901057d0 2024-09-19T05:56:44.784 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:44.224+0000 7f3996356640 1 -- 172.21.15.37:0/1463254243 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f399019f140 con 0x7f39901057d0 2024-09-19T05:56:44.784 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:44.275+0000 7f398d7fa640 1 -- 172.21.15.37:0/1463254243 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f398004c070 con 0x7f39901057d0 2024-09-19T05:56:44.784 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:44.277+0000 7f398d7fa640 1 -- 172.21.15.37:0/1463254243 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7f3980047440 con 0x7f39901057d0 2024-09-19T05:56:44.785 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:44.278+0000 7f3996356640 1 -- 172.21.15.37:0/1463254243 >> [v2:172.21.15.37:6800/3277805697,v1:172.21.15.37:6801/3277805697] conn(0x7f3978039160 msgr2=0x7f397803b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:56:44.785 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:44.278+0000 7f3996356640 1 --2- 172.21.15.37:0/1463254243 >> [v2:172.21.15.37:6800/3277805697,v1:172.21.15.37:6801/3277805697] conn(0x7f3978039160 0x7f397803b620 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f39840098c0 tx=0x7f3984006db0 comp rx=0 tx=0).stop 2024-09-19T05:56:44.785 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:44.278+0000 7f3996356640 1 -- 172.21.15.37:0/1463254243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39901057d0 msgr2=0x7f399019b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:56:44.785 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:44.278+0000 7f3996356640 1 --2- 172.21.15.37:0/1463254243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39901057d0 0x7f399019b4a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3980009940 tx=0x7f3980032ce0 comp rx=0 tx=0).stop 2024-09-19T05:56:44.785 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:44.278+0000 7f3996356640 1 -- 172.21.15.37:0/1463254243 shutdown_connections 2024-09-19T05:56:44.785 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:44.278+0000 7f3996356640 1 --2- 172.21.15.37:0/1463254243 >> [v2:172.21.15.37:6800/3277805697,v1:172.21.15.37:6801/3277805697] conn(0x7f3978039160 0x7f397803b620 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:56:44.785 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:44.278+0000 7f3996356640 1 --2- 172.21.15.37:0/1463254243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39901057d0 0x7f399019b4a0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:56:44.785 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:44.278+0000 7f3996356640 1 -- 172.21.15.37:0/1463254243 >> 172.21.15.37:0/1463254243 conn(0x7f3990101360 msgr2=0x7f3990101f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:56:44.785 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:44.278+0000 7f3996356640 1 -- 172.21.15.37:0/1463254243 shutdown_connections 2024-09-19T05:56:44.785 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:44.279+0000 7f3996356640 1 -- 172.21.15.37:0/1463254243 wait complete. 2024-09-19T05:56:45.025 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:44 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:56:44.862+0000 7f1ebff7b040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T05:56:45.025 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:45 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:56:45.015+0000 7f1ebff7b040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T05:56:45.413 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:45 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/1463254243' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-19T05:56:45.413 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:45 smithi037 ceph-mon[31211]: mgrmap e5: x(active, since 9s) 2024-09-19T05:56:45.413 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:45 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:56:45.350+0000 7f1ebff7b040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T05:56:45.823 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:45 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:56:45.414+0000 7f1ebff7b040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T05:56:45.824 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:45 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:56:45.612+0000 7f1ebff7b040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T05:56:46.222 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout { 2024-09-19T05:56:46.222 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-19T05:56:46.222 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T05:56:46.222 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-19T05:56:46.222 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-19T05:56:46.222 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout } 2024-09-19T05:56:46.222 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:45.204+0000 7faa463cb640 1 Processor -- start 2024-09-19T05:56:46.222 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:45.204+0000 7faa463cb640 1 -- start start 2024-09-19T05:56:46.222 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:45.205+0000 7faa463cb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa40107550 0x7faa40107950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:56:46.223 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:45.205+0000 7faa463cb640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7faa40107f20 con 0x7faa40107550 2024-09-19T05:56:46.223 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:45.205+0000 7faa3ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa40107550 0x7faa40107950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:56:46.223 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:45.205+0000 7faa3ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa40107550 0x7faa40107950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45578/0 (socket says 172.21.15.37:45578) 2024-09-19T05:56:46.223 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:45.205+0000 7faa3ffff640 1 -- 172.21.15.37:0/1706681308 learned_addr learned my addr 172.21.15.37:0/1706681308 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T05:56:46.223 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:45.205+0000 7faa3ffff640 1 -- 172.21.15.37:0/1706681308 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa40108700 con 0x7faa40107550 2024-09-19T05:56:46.223 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:45.206+0000 7faa3ffff640 1 --2- 172.21.15.37:0/1706681308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa40107550 0x7faa40107950 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7faa30009820 tx=0x7faa3002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6d7aaa736aeda41 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:56:46.223 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:45.206+0000 7faa3f7fe640 1 -- 172.21.15.37:0/1706681308 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa30037070 con 0x7faa40107550 2024-09-19T05:56:46.223 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:45.206+0000 7faa3f7fe640 1 -- 172.21.15.37:0/1706681308 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faa30032900 con 0x7faa40107550 2024-09-19T05:56:46.223 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:45.206+0000 7faa3f7fe640 1 -- 172.21.15.37:0/1706681308 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa30030850 con 0x7faa40107550 2024-09-19T05:56:46.223 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:45.207+0000 7faa463cb640 1 -- 172.21.15.37:0/1706681308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa40107550 msgr2=0x7faa40107950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:56:46.223 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:45.207+0000 7faa463cb640 1 --2- 172.21.15.37:0/1706681308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa40107550 0x7faa40107950 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7faa30009820 tx=0x7faa3002a270 comp rx=0 tx=0).stop 2024-09-19T05:56:46.223 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:45.207+0000 7faa463cb640 1 -- 172.21.15.37:0/1706681308 shutdown_connections 2024-09-19T05:56:46.223 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:45.207+0000 7faa463cb640 1 --2- 172.21.15.37:0/1706681308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa40107550 0x7faa40107950 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:56:46.224 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:45.207+0000 7faa463cb640 1 -- 172.21.15.37:0/1706681308 >> 172.21.15.37:0/1706681308 conn(0x7faa40102ca0 msgr2=0x7faa40105120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:56:46.224 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:45.207+0000 7faa463cb640 1 -- 172.21.15.37:0/1706681308 shutdown_connections 2024-09-19T05:56:46.224 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:45.207+0000 7faa463cb640 1 -- 172.21.15.37:0/1706681308 wait complete. 2024-09-19T05:56:46.224 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:45.208+0000 7faa463cb640 1 Processor -- start 2024-09-19T05:56:46.224 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:45.208+0000 7faa463cb640 1 -- start start 2024-09-19T05:56:46.224 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:45.208+0000 7faa463cb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa40107550 0x7faa4007ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:56:46.224 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:45.208+0000 7faa463cb640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7faa4010bab0 con 0x7faa40107550 2024-09-19T05:56:46.224 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:45.208+0000 7faa3ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa40107550 0x7faa4007ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:56:46.224 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:45.208+0000 7faa3ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa40107550 0x7faa4007ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45588/0 (socket says 172.21.15.37:45588) 2024-09-19T05:56:46.224 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:45.208+0000 7faa3ffff640 1 -- 172.21.15.37:0/2371616721 learned_addr learned my addr 172.21.15.37:0/2371616721 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T05:56:46.224 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:45.208+0000 7faa3ffff640 1 -- 172.21.15.37:0/2371616721 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa4007cf70 con 0x7faa40107550 2024-09-19T05:56:46.224 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:45.208+0000 7faa3ffff640 1 --2- 172.21.15.37:0/2371616721 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa40107550 0x7faa4007ca30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7faa30009940 tx=0x7faa30032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:56:46.224 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:45.209+0000 7faa3dffb640 1 -- 172.21.15.37:0/2371616721 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa30042070 con 0x7faa40107550 2024-09-19T05:56:46.225 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:45.209+0000 7faa3dffb640 1 -- 172.21.15.37:0/2371616721 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faa300308c0 con 0x7faa40107550 2024-09-19T05:56:46.225 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:45.209+0000 7faa463cb640 1 -- 172.21.15.37:0/2371616721 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa4007b160 con 0x7faa40107550 2024-09-19T05:56:46.225 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:45.209+0000 7faa3dffb640 1 -- 172.21.15.37:0/2371616721 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa30037040 con 0x7faa40107550 2024-09-19T05:56:46.225 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:45.209+0000 7faa463cb640 1 -- 172.21.15.37:0/2371616721 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa4007b6a0 con 0x7faa40107550 2024-09-19T05:56:46.225 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:45.210+0000 7faa3dffb640 1 -- 172.21.15.37:0/2371616721 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7faa30045070 con 0x7faa40107550 2024-09-19T05:56:46.225 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:45.210+0000 7faa3dffb640 1 --2- 172.21.15.37:0/2371616721 >> [v2:172.21.15.37:6800/3277805697,v1:172.21.15.37:6801/3277805697] conn(0x7faa2c0391b0 0x7faa2c03b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:56:46.225 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:45.210+0000 7faa463cb640 1 -- 172.21.15.37:0/2371616721 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa401079d0 con 0x7faa40107550 2024-09-19T05:56:46.225 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:45.210+0000 7faa3dffb640 1 -- 172.21.15.37:0/2371616721 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7faa3006c260 con 0x7faa40107550 2024-09-19T05:56:46.225 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:45.210+0000 7faa37fff640 1 -- 172.21.15.37:0/2371616721 >> [v2:172.21.15.37:6800/3277805697,v1:172.21.15.37:6801/3277805697] conn(0x7faa2c0391b0 msgr2=0x7faa2c03b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.37:6800/3277805697 2024-09-19T05:56:46.225 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:45.210+0000 7faa37fff640 1 --2- 172.21.15.37:0/2371616721 >> [v2:172.21.15.37:6800/3277805697,v1:172.21.15.37:6801/3277805697] conn(0x7faa2c0391b0 0x7faa2c03b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:56:46.225 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:45.219+0000 7faa3dffb640 1 -- 172.21.15.37:0/2371616721 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7faa3002fd90 con 0x7faa40107550 2024-09-19T05:56:46.225 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:45.411+0000 7faa37fff640 1 -- 172.21.15.37:0/2371616721 >> [v2:172.21.15.37:6800/3277805697,v1:172.21.15.37:6801/3277805697] conn(0x7faa2c0391b0 msgr2=0x7faa2c03b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.37:6800/3277805697 2024-09-19T05:56:46.225 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:45.411+0000 7faa37fff640 1 --2- 172.21.15.37:0/2371616721 >> [v2:172.21.15.37:6800/3277805697,v1:172.21.15.37:6801/3277805697] conn(0x7faa2c0391b0 0x7faa2c03b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T05:56:46.225 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:45.442+0000 7faa463cb640 1 -- 172.21.15.37:0/2371616721 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7faa4007bf60 con 0x7faa40107550 2024-09-19T05:56:46.226 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:45.443+0000 7faa3dffb640 1 -- 172.21.15.37:0/2371616721 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7faa3003cd40 con 0x7faa40107550 2024-09-19T05:56:46.226 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:45.445+0000 7faa463cb640 1 -- 172.21.15.37:0/2371616721 >> [v2:172.21.15.37:6800/3277805697,v1:172.21.15.37:6801/3277805697] conn(0x7faa2c0391b0 msgr2=0x7faa2c03b670 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T05:56:46.226 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:45.445+0000 7faa463cb640 1 --2- 172.21.15.37:0/2371616721 >> [v2:172.21.15.37:6800/3277805697,v1:172.21.15.37:6801/3277805697] conn(0x7faa2c0391b0 0x7faa2c03b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:56:46.226 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:45.445+0000 7faa463cb640 1 -- 172.21.15.37:0/2371616721 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa40107550 msgr2=0x7faa4007ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:56:46.226 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:45.445+0000 7faa463cb640 1 --2- 172.21.15.37:0/2371616721 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa40107550 0x7faa4007ca30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7faa30009940 tx=0x7faa30032ce0 comp rx=0 tx=0).stop 2024-09-19T05:56:46.226 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:45.445+0000 7faa463cb640 1 -- 172.21.15.37:0/2371616721 shutdown_connections 2024-09-19T05:56:46.226 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:45.445+0000 7faa463cb640 1 --2- 172.21.15.37:0/2371616721 >> [v2:172.21.15.37:6800/3277805697,v1:172.21.15.37:6801/3277805697] conn(0x7faa2c0391b0 0x7faa2c03b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:56:46.226 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:45.445+0000 7faa463cb640 1 --2- 172.21.15.37:0/2371616721 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa40107550 0x7faa4007ca30 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:56:46.226 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:45.445+0000 7faa463cb640 1 -- 172.21.15.37:0/2371616721 >> 172.21.15.37:0/2371616721 conn(0x7faa40102ca0 msgr2=0x7faa40103870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:56:46.226 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:45.445+0000 7faa463cb640 1 -- 172.21.15.37:0/2371616721 shutdown_connections 2024-09-19T05:56:46.226 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:45.445+0000 7faa463cb640 1 -- 172.21.15.37:0/2371616721 wait complete. 2024-09-19T05:56:46.226 INFO:teuthology.orchestra.run.smithi037.stdout:Waiting for the mgr to restart... 2024-09-19T05:56:46.226 INFO:teuthology.orchestra.run.smithi037.stdout:Waiting for mgr epoch 5... 2024-09-19T05:56:46.546 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:46 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/2371616721' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-19T05:56:46.823 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:46 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:56:46.543+0000 7f1ebff7b040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T05:56:46.824 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:46 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:56:46.616+0000 7f1ebff7b040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T05:56:47.573 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:47 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:56:47.358+0000 7f1ebff7b040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T05:56:47.573 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:47 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:56:47.478+0000 7f1ebff7b040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T05:56:47.926 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:47 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:56:47.628+0000 7f1ebff7b040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T05:56:47.926 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:47 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:56:47.694+0000 7f1ebff7b040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T05:56:47.926 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:47 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:56:47.851+0000 7f1ebff7b040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T05:56:47.926 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:47 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:56:47.924+0000 7f1ebff7b040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T05:56:48.232 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:47 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:56:47.989+0000 7f1ebff7b040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T05:56:48.233 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:48 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:56:48.162+0000 7f1ebff7b040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T05:56:48.233 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:48 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:56:48.230+0000 7f1ebff7b040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T05:56:48.510 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:48 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:56:48.300+0000 7f1ebff7b040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T05:56:48.510 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:48 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:56:48.385+0000 7f1ebff7b040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T05:56:48.510 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:48 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:56:48.447+0000 7f1ebff7b040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T05:56:48.510 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:48 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:56:48.508+0000 7f1ebff7b040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T05:56:49.823 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:49 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:56:49.333+0000 7f1ebff7b040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T05:56:49.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:49 smithi037 ceph-mon[31211]: Active manager daemon x restarted 2024-09-19T05:56:49.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:49 smithi037 ceph-mon[31211]: Activating manager daemon x 2024-09-19T05:56:49.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:49 smithi037 ceph-mon[31211]: osdmap e2: 0 total, 0 up, 0 in 2024-09-19T05:56:49.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:49 smithi037 ceph-mon[31211]: mgrmap e6: x(active, starting, since 0.00372762s) 2024-09-19T05:56:49.825 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:49 smithi037 ceph-mon[31211]: from='mgr.14116 172.21.15.37:0/3995008439' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T05:56:49.825 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:49 smithi037 ceph-mon[31211]: from='mgr.14116 172.21.15.37:0/3995008439' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T05:56:49.825 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:49 smithi037 ceph-mon[31211]: from='mgr.14116 172.21.15.37:0/3995008439' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T05:56:49.825 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:49 smithi037 ceph-mon[31211]: from='mgr.14116 172.21.15.37:0/3995008439' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T05:56:49.825 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:49 smithi037 ceph-mon[31211]: from='mgr.14116 172.21.15.37:0/3995008439' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T05:56:49.825 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:49 smithi037 ceph-mon[31211]: Manager daemon x is now available 2024-09-19T05:56:49.826 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:49 smithi037 ceph-mon[31211]: from='mgr.14116 172.21.15.37:0/3995008439' entity='mgr.x' 2024-09-19T05:56:49.826 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:49 smithi037 ceph-mon[31211]: from='mgr.14116 172.21.15.37:0/3995008439' entity='mgr.x' 2024-09-19T05:56:49.826 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:49 smithi037 ceph-mon[31211]: from='mgr.14116 172.21.15.37:0/3995008439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:56:49.826 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:49 smithi037 ceph-mon[31211]: from='mgr.14116 172.21.15.37:0/3995008439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:56:49.826 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:49 smithi037 ceph-mon[31211]: from='mgr.14116 172.21.15.37:0/3995008439' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T05:56:49.826 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:49 smithi037 ceph-mon[31211]: from='mgr.14116 172.21.15.37:0/3995008439' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T05:56:50.682 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:50 smithi037 ceph-mon[31211]: Found migration_current of "None". Setting to last migration. 2024-09-19T05:56:50.682 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:50 smithi037 ceph-mon[31211]: mgrmap e7: x(active, since 1.00535s) 2024-09-19T05:56:50.933 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout { 2024-09-19T05:56:50.933 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-19T05:56:50.933 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-19T05:56:50.933 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout } 2024-09-19T05:56:50.933 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:46.628+0000 7fd85a20c640 1 Processor -- start 2024-09-19T05:56:50.933 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:46.628+0000 7fd85a20c640 1 -- start start 2024-09-19T05:56:50.934 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:46.628+0000 7fd85a20c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd854107f50 0x7fd85410a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:56:50.934 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:46.628+0000 7fd85a20c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd85410a880 con 0x7fd854107f50 2024-09-19T05:56:50.934 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:46.629+0000 7fd8537fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd854107f50 0x7fd85410a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:56:50.934 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:46.629+0000 7fd8537fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd854107f50 0x7fd85410a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45600/0 (socket says 172.21.15.37:45600) 2024-09-19T05:56:50.934 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:46.629+0000 7fd8537fe640 1 -- 172.21.15.37:0/4085019336 learned_addr learned my addr 172.21.15.37:0/4085019336 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T05:56:50.934 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:46.629+0000 7fd8537fe640 1 -- 172.21.15.37:0/4085019336 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd85410aa00 con 0x7fd854107f50 2024-09-19T05:56:50.934 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:46.630+0000 7fd8537fe640 1 --2- 172.21.15.37:0/4085019336 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd854107f50 0x7fd85410a340 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd83c009820 tx=0x7fd83c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a93859083fdb8f14 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:56:50.934 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:46.630+0000 7fd8527fc640 1 -- 172.21.15.37:0/4085019336 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd83c037070 con 0x7fd854107f50 2024-09-19T05:56:50.934 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:46.630+0000 7fd8527fc640 1 -- 172.21.15.37:0/4085019336 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd83c032900 con 0x7fd854107f50 2024-09-19T05:56:50.934 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:46.630+0000 7fd8527fc640 1 -- 172.21.15.37:0/4085019336 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd83c030850 con 0x7fd854107f50 2024-09-19T05:56:50.935 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:46.630+0000 7fd85a20c640 1 -- 172.21.15.37:0/4085019336 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd854107f50 msgr2=0x7fd85410a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:56:50.935 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:46.630+0000 7fd85a20c640 1 --2- 172.21.15.37:0/4085019336 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd854107f50 0x7fd85410a340 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd83c009820 tx=0x7fd83c02a270 comp rx=0 tx=0).stop 2024-09-19T05:56:50.935 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:46.631+0000 7fd85a20c640 1 -- 172.21.15.37:0/4085019336 shutdown_connections 2024-09-19T05:56:50.935 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:46.631+0000 7fd85a20c640 1 --2- 172.21.15.37:0/4085019336 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd854107f50 0x7fd85410a340 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:56:50.935 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:46.631+0000 7fd85a20c640 1 -- 172.21.15.37:0/4085019336 >> 172.21.15.37:0/4085019336 conn(0x7fd854101af0 msgr2=0x7fd854103f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:56:50.935 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:46.631+0000 7fd85a20c640 1 -- 172.21.15.37:0/4085019336 shutdown_connections 2024-09-19T05:56:50.935 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:46.631+0000 7fd85a20c640 1 -- 172.21.15.37:0/4085019336 wait complete. 2024-09-19T05:56:50.935 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:46.631+0000 7fd85a20c640 1 Processor -- start 2024-09-19T05:56:50.935 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:46.631+0000 7fd85a20c640 1 -- start start 2024-09-19T05:56:50.935 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:46.632+0000 7fd85a20c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd854107f50 0x7fd85419d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:56:50.935 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:46.632+0000 7fd85a20c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd85410b9e0 con 0x7fd854107f50 2024-09-19T05:56:50.935 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:46.632+0000 7fd8537fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd854107f50 0x7fd85419d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:56:50.935 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:46.632+0000 7fd8537fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd854107f50 0x7fd85419d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45602/0 (socket says 172.21.15.37:45602) 2024-09-19T05:56:50.935 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:46.632+0000 7fd8537fe640 1 -- 172.21.15.37:0/466306467 learned_addr learned my addr 172.21.15.37:0/466306467 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T05:56:50.936 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:46.632+0000 7fd8537fe640 1 -- 172.21.15.37:0/466306467 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd85419dd30 con 0x7fd854107f50 2024-09-19T05:56:50.936 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:46.632+0000 7fd8537fe640 1 --2- 172.21.15.37:0/466306467 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd854107f50 0x7fd85419d7f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd83c032ce0 tx=0x7fd83c032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:56:50.936 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:46.632+0000 7fd850ff9640 1 -- 172.21.15.37:0/466306467 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd83c042070 con 0x7fd854107f50 2024-09-19T05:56:50.936 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:46.632+0000 7fd85a20c640 1 -- 172.21.15.37:0/466306467 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd85419dfc0 con 0x7fd854107f50 2024-09-19T05:56:50.936 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:46.632+0000 7fd850ff9640 1 -- 172.21.15.37:0/466306467 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd83c0308c0 con 0x7fd854107f50 2024-09-19T05:56:50.936 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:46.633+0000 7fd850ff9640 1 -- 172.21.15.37:0/466306467 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd83c037040 con 0x7fd854107f50 2024-09-19T05:56:50.936 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:46.633+0000 7fd85a20c640 1 -- 172.21.15.37:0/466306467 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8541a0cb0 con 0x7fd854107f50 2024-09-19T05:56:50.936 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:46.633+0000 7fd850ff9640 1 -- 172.21.15.37:0/466306467 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7fd83c045070 con 0x7fd854107f50 2024-09-19T05:56:50.936 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:46.634+0000 7fd850ff9640 1 --2- 172.21.15.37:0/466306467 >> [v2:172.21.15.37:6800/3277805697,v1:172.21.15.37:6801/3277805697] conn(0x7fd8400391b0 0x7fd84003b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:56:50.936 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:46.634+0000 7fd850ff9640 1 -- 172.21.15.37:0/466306467 --> [v2:172.21.15.37:6800/3277805697,v1:172.21.15.37:6801/3277805697] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fd84003bd80 con 0x7fd8400391b0 2024-09-19T05:56:50.937 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:46.634+0000 7fd850ff9640 1 -- 172.21.15.37:0/466306467 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd83c06c460 con 0x7fd854107f50 2024-09-19T05:56:50.937 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:46.634+0000 7fd852ffd640 1 -- 172.21.15.37:0/466306467 >> [v2:172.21.15.37:6800/3277805697,v1:172.21.15.37:6801/3277805697] conn(0x7fd8400391b0 msgr2=0x7fd84003b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.37:6800/3277805697 2024-09-19T05:56:50.937 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:46.634+0000 7fd852ffd640 1 --2- 172.21.15.37:0/466306467 >> [v2:172.21.15.37:6800/3277805697,v1:172.21.15.37:6801/3277805697] conn(0x7fd8400391b0 0x7fd84003b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:56:50.937 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:46.835+0000 7fd852ffd640 1 -- 172.21.15.37:0/466306467 >> [v2:172.21.15.37:6800/3277805697,v1:172.21.15.37:6801/3277805697] conn(0x7fd8400391b0 msgr2=0x7fd84003b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.37:6800/3277805697 2024-09-19T05:56:50.937 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:46.835+0000 7fd852ffd640 1 --2- 172.21.15.37:0/466306467 >> [v2:172.21.15.37:6800/3277805697,v1:172.21.15.37:6801/3277805697] conn(0x7fd8400391b0 0x7fd84003b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T05:56:50.937 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:47.236+0000 7fd852ffd640 1 -- 172.21.15.37:0/466306467 >> [v2:172.21.15.37:6800/3277805697,v1:172.21.15.37:6801/3277805697] conn(0x7fd8400391b0 msgr2=0x7fd84003b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.37:6800/3277805697 2024-09-19T05:56:50.937 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:47.236+0000 7fd852ffd640 1 --2- 172.21.15.37:0/466306467 >> [v2:172.21.15.37:6800/3277805697,v1:172.21.15.37:6801/3277805697] conn(0x7fd8400391b0 0x7fd84003b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T05:56:50.937 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:48.037+0000 7fd852ffd640 1 -- 172.21.15.37:0/466306467 >> [v2:172.21.15.37:6800/3277805697,v1:172.21.15.37:6801/3277805697] conn(0x7fd8400391b0 msgr2=0x7fd84003b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.37:6800/3277805697 2024-09-19T05:56:50.937 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:48.037+0000 7fd852ffd640 1 --2- 172.21.15.37:0/466306467 >> [v2:172.21.15.37:6800/3277805697,v1:172.21.15.37:6801/3277805697] conn(0x7fd8400391b0 0x7fd84003b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T05:56:50.937 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:49.336+0000 7fd850ff9640 1 -- 172.21.15.37:0/466306467 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mgrmap(e 6) ==== 46228+0+0 (secure 0 0 0) 0x7fd83c06af20 con 0x7fd854107f50 2024-09-19T05:56:50.937 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:49.337+0000 7fd850ff9640 1 -- 172.21.15.37:0/466306467 >> [v2:172.21.15.37:6800/3277805697,v1:172.21.15.37:6801/3277805697] conn(0x7fd8400391b0 msgr2=0x7fd84003b670 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T05:56:50.937 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:49.337+0000 7fd850ff9640 1 --2- 172.21.15.37:0/466306467 >> [v2:172.21.15.37:6800/3277805697,v1:172.21.15.37:6801/3277805697] conn(0x7fd8400391b0 0x7fd84003b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:56:50.937 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:50.337+0000 7fd850ff9640 1 -- 172.21.15.37:0/466306467 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 7) ==== 46355+0+0 (secure 0 0 0) 0x7fd83c03ba80 con 0x7fd854107f50 2024-09-19T05:56:50.938 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:50.337+0000 7fd850ff9640 1 --2- 172.21.15.37:0/466306467 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7fd84003cae0 0x7fd84003eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:56:50.938 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:50.337+0000 7fd850ff9640 1 -- 172.21.15.37:0/466306467 --> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fd83c03ee50 con 0x7fd84003cae0 2024-09-19T05:56:50.938 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:50.337+0000 7fd852ffd640 1 --2- 172.21.15.37:0/466306467 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7fd84003cae0 0x7fd84003eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:56:50.938 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:50.338+0000 7fd852ffd640 1 --2- 172.21.15.37:0/466306467 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7fd84003cae0 0x7fd84003eed0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fd844003980 tx=0x7fd844006e10 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:56:50.938 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:50.339+0000 7fd850ff9640 1 -- 172.21.15.37:0/466306467 <== mgr.14116 v2:172.21.15.37:6800/133577710 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7fd83c03ee50 con 0x7fd84003cae0 2024-09-19T05:56:50.938 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:50.351+0000 7fd85a20c640 1 -- 172.21.15.37:0/466306467 --> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7fd8541083b0 con 0x7fd84003cae0 2024-09-19T05:56:50.938 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:50.351+0000 7fd850ff9640 1 -- 172.21.15.37:0/466306467 <== mgr.14116 v2:172.21.15.37:6800/133577710 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7fd8541083b0 con 0x7fd84003cae0 2024-09-19T05:56:50.938 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:50.352+0000 7fd85a20c640 1 -- 172.21.15.37:0/466306467 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7fd84003cae0 msgr2=0x7fd84003eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:56:50.938 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:50.352+0000 7fd85a20c640 1 --2- 172.21.15.37:0/466306467 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7fd84003cae0 0x7fd84003eed0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fd844003980 tx=0x7fd844006e10 comp rx=0 tx=0).stop 2024-09-19T05:56:50.938 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:50.352+0000 7fd85a20c640 1 -- 172.21.15.37:0/466306467 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd854107f50 msgr2=0x7fd85419d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:56:50.938 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:50.352+0000 7fd85a20c640 1 --2- 172.21.15.37:0/466306467 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd854107f50 0x7fd85419d7f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd83c032ce0 tx=0x7fd83c032d10 comp rx=0 tx=0).stop 2024-09-19T05:56:50.938 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:50.352+0000 7fd85a20c640 1 -- 172.21.15.37:0/466306467 shutdown_connections 2024-09-19T05:56:50.938 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:50.352+0000 7fd85a20c640 1 --2- 172.21.15.37:0/466306467 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7fd84003cae0 0x7fd84003eed0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:56:50.939 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:50.352+0000 7fd85a20c640 1 --2- 172.21.15.37:0/466306467 >> [v2:172.21.15.37:6800/3277805697,v1:172.21.15.37:6801/3277805697] conn(0x7fd8400391b0 0x7fd84003b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:56:50.939 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:50.352+0000 7fd85a20c640 1 --2- 172.21.15.37:0/466306467 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd854107f50 0x7fd85419d7f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:56:50.939 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:50.352+0000 7fd85a20c640 1 -- 172.21.15.37:0/466306467 >> 172.21.15.37:0/466306467 conn(0x7fd854101af0 msgr2=0x7fd854102680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:56:50.939 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:50.352+0000 7fd85a20c640 1 -- 172.21.15.37:0/466306467 shutdown_connections 2024-09-19T05:56:50.939 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:50.352+0000 7fd85a20c640 1 -- 172.21.15.37:0/466306467 wait complete. 2024-09-19T05:56:50.939 INFO:teuthology.orchestra.run.smithi037.stdout:mgr epoch 5 is available 2024-09-19T05:56:50.939 INFO:teuthology.orchestra.run.smithi037.stdout:Setting orchestrator backend to cephadm... 2024-09-19T05:56:52.030 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:51 smithi037 ceph-mon[31211]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-19T05:56:52.031 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:51 smithi037 ceph-mon[31211]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-19T05:56:52.031 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:51 smithi037 ceph-mon[31211]: from='mgr.14116 172.21.15.37:0/3995008439' entity='mgr.x' 2024-09-19T05:56:52.031 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:51 smithi037 ceph-mon[31211]: from='mgr.14116 172.21.15.37:0/3995008439' entity='mgr.x' 2024-09-19T05:56:52.031 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:51 smithi037 ceph-mon[31211]: from='mgr.14116 172.21.15.37:0/3995008439' entity='mgr.x' 2024-09-19T05:56:52.031 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:51 smithi037 ceph-mon[31211]: from='mgr.14116 172.21.15.37:0/3995008439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:56:52.031 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:51 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:56:51.893+0000 7f1e2caa0640 -1 log_channel(cephadm) log [ERR] : [19/Sep/2024:05:56:51] ENGINE Error in HTTPServer.serve 2024-09-19T05:56:52.031 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:51 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: Traceback (most recent call last): 2024-09-19T05:56:52.031 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:51 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T05:56:52.031 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:51 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: self._connections.run(self.expiration_interval) 2024-09-19T05:56:52.032 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:51 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T05:56:52.032 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:51 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: self._run(expiration_interval) 2024-09-19T05:56:52.032 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:51 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T05:56:52.032 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:51 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T05:56:52.032 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:51 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T05:56:52.032 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:51 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T05:56:52.032 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:51 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T05:56:52.032 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:51 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: s = self.context.wrap_socket( 2024-09-19T05:56:52.032 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:51 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T05:56:52.032 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:51 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: return self.sslsocket_class._create( 2024-09-19T05:56:52.032 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:51 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T05:56:52.032 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:51 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: self.do_handshake() 2024-09-19T05:56:52.032 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:51 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T05:56:52.033 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:51 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: self._sslobj.do_handshake() 2024-09-19T05:56:52.033 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:51 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T05:56:52.033 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:51 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:56:52.038 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:51.313+0000 7f04a8856640 1 Processor -- start 2024-09-19T05:56:52.038 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:51.313+0000 7f04a8856640 1 -- start start 2024-09-19T05:56:52.038 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:51.314+0000 7f04a8856640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04a4107f70 0x7f04a410a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:56:52.038 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:51.314+0000 7f04a8856640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f04a4075920 con 0x7f04a4107f70 2024-09-19T05:56:52.038 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:51.314+0000 7f04a259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04a4107f70 0x7f04a410a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:56:52.038 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:51.314+0000 7f04a259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04a4107f70 0x7f04a410a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45668/0 (socket says 172.21.15.37:45668) 2024-09-19T05:56:52.038 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:51.314+0000 7f04a259c640 1 -- 172.21.15.37:0/1204016510 learned_addr learned my addr 172.21.15.37:0/1204016510 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T05:56:52.038 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:51.314+0000 7f04a259c640 1 -- 172.21.15.37:0/1204016510 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04a410a8a0 con 0x7f04a4107f70 2024-09-19T05:56:52.039 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:51.315+0000 7f04a259c640 1 --2- 172.21.15.37:0/1204016510 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04a4107f70 0x7f04a410a360 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0494009820 tx=0x7f049402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=553800caca9979b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:56:52.039 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:51.315+0000 7f04a159a640 1 -- 172.21.15.37:0/1204016510 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0494037070 con 0x7f04a4107f70 2024-09-19T05:56:52.039 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:51.315+0000 7f04a159a640 1 -- 172.21.15.37:0/1204016510 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0494032900 con 0x7f04a4107f70 2024-09-19T05:56:52.039 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:51.315+0000 7f04a159a640 1 -- 172.21.15.37:0/1204016510 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0494030850 con 0x7f04a4107f70 2024-09-19T05:56:52.039 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:51.315+0000 7f04a8856640 1 -- 172.21.15.37:0/1204016510 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04a4107f70 msgr2=0x7f04a410a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:56:52.039 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:51.315+0000 7f04a8856640 1 --2- 172.21.15.37:0/1204016510 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04a4107f70 0x7f04a410a360 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0494009820 tx=0x7f049402a270 comp rx=0 tx=0).stop 2024-09-19T05:56:52.039 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:51.316+0000 7f04a8856640 1 -- 172.21.15.37:0/1204016510 shutdown_connections 2024-09-19T05:56:52.039 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:51.316+0000 7f04a8856640 1 --2- 172.21.15.37:0/1204016510 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04a4107f70 0x7f04a410a360 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:56:52.039 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:51.316+0000 7f04a8856640 1 -- 172.21.15.37:0/1204016510 >> 172.21.15.37:0/1204016510 conn(0x7f04a4101af0 msgr2=0x7f04a4103f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:56:52.039 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:51.316+0000 7f04a8856640 1 -- 172.21.15.37:0/1204016510 shutdown_connections 2024-09-19T05:56:52.039 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:51.316+0000 7f04a8856640 1 -- 172.21.15.37:0/1204016510 wait complete. 2024-09-19T05:56:52.039 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:51.316+0000 7f04a8856640 1 Processor -- start 2024-09-19T05:56:52.039 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:51.317+0000 7f04a8856640 1 -- start start 2024-09-19T05:56:52.040 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:51.317+0000 7f04a8856640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04a4107f70 0x7f04a419b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:56:52.040 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:51.317+0000 7f04a8856640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f04a410b9a0 con 0x7f04a4107f70 2024-09-19T05:56:52.040 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:51.317+0000 7f04a259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04a4107f70 0x7f04a419b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:56:52.040 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:51.317+0000 7f04a259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04a4107f70 0x7f04a419b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45684/0 (socket says 172.21.15.37:45684) 2024-09-19T05:56:52.040 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:51.317+0000 7f04a259c640 1 -- 172.21.15.37:0/929983929 learned_addr learned my addr 172.21.15.37:0/929983929 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T05:56:52.040 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:51.317+0000 7f04a259c640 1 -- 172.21.15.37:0/929983929 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04a419bb10 con 0x7f04a4107f70 2024-09-19T05:56:52.040 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:51.317+0000 7f04a259c640 1 --2- 172.21.15.37:0/929983929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04a4107f70 0x7f04a419b5d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0494032ce0 tx=0x7f0494032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:56:52.040 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:51.317+0000 7f04937fe640 1 -- 172.21.15.37:0/929983929 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0494042070 con 0x7f04a4107f70 2024-09-19T05:56:52.040 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:51.318+0000 7f04a8856640 1 -- 172.21.15.37:0/929983929 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04a419bda0 con 0x7f04a4107f70 2024-09-19T05:56:52.040 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:51.318+0000 7f04937fe640 1 -- 172.21.15.37:0/929983929 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f04940308c0 con 0x7f04a4107f70 2024-09-19T05:56:52.040 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:51.318+0000 7f04937fe640 1 -- 172.21.15.37:0/929983929 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0494037040 con 0x7f04a4107f70 2024-09-19T05:56:52.040 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:51.318+0000 7f04a8856640 1 -- 172.21.15.37:0/929983929 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04a419ea90 con 0x7f04a4107f70 2024-09-19T05:56:52.041 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:51.318+0000 7f04937fe640 1 -- 172.21.15.37:0/929983929 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) ==== 46355+0+0 (secure 0 0 0) 0x7f0494045070 con 0x7f04a4107f70 2024-09-19T05:56:52.041 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:51.319+0000 7f04937fe640 1 --2- 172.21.15.37:0/929983929 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7f048c0390a0 0x7f048c03b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:56:52.041 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:51.319+0000 7f04a8856640 1 -- 172.21.15.37:0/929983929 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04a41083d0 con 0x7f04a4107f70 2024-09-19T05:56:52.041 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:51.319+0000 7f04937fe640 1 -- 172.21.15.37:0/929983929 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f049406c450 con 0x7f04a4107f70 2024-09-19T05:56:52.041 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:51.320+0000 7f04a1d9b640 1 --2- 172.21.15.37:0/929983929 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7f048c0390a0 0x7f048c03b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:56:52.041 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:51.320+0000 7f04a1d9b640 1 --2- 172.21.15.37:0/929983929 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7f048c0390a0 0x7f048c03b560 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f04980098c0 tx=0x7f0498006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:56:52.041 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:51.328+0000 7f04937fe640 1 -- 172.21.15.37:0/929983929 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f04940080c0 con 0x7f04a4107f70 2024-09-19T05:56:52.041 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:51.519+0000 7f04a8856640 1 -- 172.21.15.37:0/929983929 --> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f04a4102df0 con 0x7f048c0390a0 2024-09-19T05:56:52.041 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:51.524+0000 7f04937fe640 1 -- 172.21.15.37:0/929983929 <== mgr.14116 v2:172.21.15.37:6800/133577710 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f04a4102df0 con 0x7f048c0390a0 2024-09-19T05:56:52.041 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:51.526+0000 7f04a8856640 1 -- 172.21.15.37:0/929983929 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7f048c0390a0 msgr2=0x7f048c03b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:56:52.041 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:51.526+0000 7f04a8856640 1 --2- 172.21.15.37:0/929983929 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7f048c0390a0 0x7f048c03b560 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f04980098c0 tx=0x7f0498006db0 comp rx=0 tx=0).stop 2024-09-19T05:56:52.041 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:51.526+0000 7f04a8856640 1 -- 172.21.15.37:0/929983929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04a4107f70 msgr2=0x7f04a419b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:56:52.041 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:51.526+0000 7f04a8856640 1 --2- 172.21.15.37:0/929983929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04a4107f70 0x7f04a419b5d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0494032ce0 tx=0x7f0494032d10 comp rx=0 tx=0).stop 2024-09-19T05:56:52.042 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:51.527+0000 7f04a8856640 1 -- 172.21.15.37:0/929983929 shutdown_connections 2024-09-19T05:56:52.042 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:51.527+0000 7f04a8856640 1 --2- 172.21.15.37:0/929983929 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7f048c0390a0 0x7f048c03b560 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:56:52.042 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:51.527+0000 7f04a8856640 1 --2- 172.21.15.37:0/929983929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04a4107f70 0x7f04a419b5d0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:56:52.042 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:51.527+0000 7f04a8856640 1 -- 172.21.15.37:0/929983929 >> 172.21.15.37:0/929983929 conn(0x7f04a4101af0 msgr2=0x7f04a41026e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:56:52.042 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:51.527+0000 7f04a8856640 1 -- 172.21.15.37:0/929983929 shutdown_connections 2024-09-19T05:56:52.042 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:51.527+0000 7f04a8856640 1 -- 172.21.15.37:0/929983929 wait complete. 2024-09-19T05:56:52.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:52 smithi037 ceph-mon[31211]: from='client.14128 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:56:52.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:52 smithi037 ceph-mon[31211]: mgrmap e8: x(active, since 2s) 2024-09-19T05:56:52.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:52 smithi037 ceph-mon[31211]: [19/Sep/2024:05:56:51] ENGINE Bus STARTING 2024-09-19T05:56:52.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:52 smithi037 ceph-mon[31211]: [19/Sep/2024:05:56:51] ENGINE Serving on https://172.21.15.37:7150 2024-09-19T05:56:52.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:52 smithi037 ceph-mon[31211]: [19/Sep/2024:05:56:51] ENGINE Error in HTTPServer.serve 2024-09-19T05:56:52.824 INFO:journalctl@ceph.mon.a.smithi037.stdout: Traceback (most recent call last): 2024-09-19T05:56:52.824 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T05:56:52.824 INFO:journalctl@ceph.mon.a.smithi037.stdout: self._connections.run(self.expiration_interval) 2024-09-19T05:56:52.824 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T05:56:52.824 INFO:journalctl@ceph.mon.a.smithi037.stdout: self._run(expiration_interval) 2024-09-19T05:56:52.824 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T05:56:52.824 INFO:journalctl@ceph.mon.a.smithi037.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T05:56:52.825 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T05:56:52.825 INFO:journalctl@ceph.mon.a.smithi037.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T05:56:52.825 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T05:56:52.825 INFO:journalctl@ceph.mon.a.smithi037.stdout: s = self.context.wrap_socket( 2024-09-19T05:56:52.825 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T05:56:52.825 INFO:journalctl@ceph.mon.a.smithi037.stdout: return self.sslsocket_class._create( 2024-09-19T05:56:52.825 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T05:56:52.825 INFO:journalctl@ceph.mon.a.smithi037.stdout: self.do_handshake() 2024-09-19T05:56:52.825 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T05:56:52.825 INFO:journalctl@ceph.mon.a.smithi037.stdout: self._sslobj.do_handshake() 2024-09-19T05:56:52.825 INFO:journalctl@ceph.mon.a.smithi037.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T05:56:52.825 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:52 smithi037 ceph-mon[31211]: [19/Sep/2024:05:56:51] ENGINE Serving on http://172.21.15.37:8765 2024-09-19T05:56:52.825 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:52 smithi037 ceph-mon[31211]: [19/Sep/2024:05:56:51] ENGINE Bus STARTED 2024-09-19T05:56:52.826 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:52 smithi037 ceph-mon[31211]: from='mgr.14116 172.21.15.37:0/3995008439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:56:53.519 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-19T05:56:53.520 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:52.718+0000 7fcbc8d29640 1 Processor -- start 2024-09-19T05:56:53.520 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:52.718+0000 7fcbc8d29640 1 -- start start 2024-09-19T05:56:53.520 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:52.718+0000 7fcbc8d29640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbc4107510 0x7fcbc4107910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:56:53.520 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:52.718+0000 7fcbc8d29640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcbc4107ee0 con 0x7fcbc4107510 2024-09-19T05:56:53.520 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:52.719+0000 7fcbc259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbc4107510 0x7fcbc4107910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:56:53.520 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:52.719+0000 7fcbc259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbc4107510 0x7fcbc4107910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45700/0 (socket says 172.21.15.37:45700) 2024-09-19T05:56:53.520 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:52.719+0000 7fcbc259c640 1 -- 172.21.15.37:0/541482300 learned_addr learned my addr 172.21.15.37:0/541482300 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T05:56:53.520 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:52.719+0000 7fcbc259c640 1 -- 172.21.15.37:0/541482300 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbc41086c0 con 0x7fcbc4107510 2024-09-19T05:56:53.520 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:52.720+0000 7fcbc259c640 1 --2- 172.21.15.37:0/541482300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbc4107510 0x7fcbc4107910 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fcbb4009e80 tx=0x7fcbb402a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e51db5a06e8c65b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:56:53.520 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:52.720+0000 7fcbc159a640 1 -- 172.21.15.37:0/541482300 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbb4036070 con 0x7fcbc4107510 2024-09-19T05:56:53.520 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:52.720+0000 7fcbc159a640 1 -- 172.21.15.37:0/541482300 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcbb40318c0 con 0x7fcbc4107510 2024-09-19T05:56:53.520 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:52.720+0000 7fcbc159a640 1 -- 172.21.15.37:0/541482300 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbb4007ab0 con 0x7fcbc4107510 2024-09-19T05:56:53.521 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:52.720+0000 7fcbc8d29640 1 -- 172.21.15.37:0/541482300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbc4107510 msgr2=0x7fcbc4107910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:56:53.521 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:52.720+0000 7fcbc8d29640 1 --2- 172.21.15.37:0/541482300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbc4107510 0x7fcbc4107910 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fcbb4009e80 tx=0x7fcbb402a7a0 comp rx=0 tx=0).stop 2024-09-19T05:56:53.521 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:52.720+0000 7fcbc8d29640 1 -- 172.21.15.37:0/541482300 shutdown_connections 2024-09-19T05:56:53.521 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:52.720+0000 7fcbc8d29640 1 --2- 172.21.15.37:0/541482300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbc4107510 0x7fcbc4107910 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:56:53.521 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:52.720+0000 7fcbc8d29640 1 -- 172.21.15.37:0/541482300 >> 172.21.15.37:0/541482300 conn(0x7fcbc4102ce0 msgr2=0x7fcbc4105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:56:53.521 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:52.721+0000 7fcbc8d29640 1 -- 172.21.15.37:0/541482300 shutdown_connections 2024-09-19T05:56:53.521 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:52.721+0000 7fcbc8d29640 1 -- 172.21.15.37:0/541482300 wait complete. 2024-09-19T05:56:53.521 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:52.721+0000 7fcbc8d29640 1 Processor -- start 2024-09-19T05:56:53.521 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:52.721+0000 7fcbc8d29640 1 -- start start 2024-09-19T05:56:53.521 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:52.722+0000 7fcbc8d29640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbc4107510 0x7fcbc419d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:56:53.521 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:52.722+0000 7fcbc8d29640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcbc410ba70 con 0x7fcbc4107510 2024-09-19T05:56:53.522 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:52.722+0000 7fcbc259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbc4107510 0x7fcbc419d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:56:53.522 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:52.722+0000 7fcbc259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbc4107510 0x7fcbc419d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45708/0 (socket says 172.21.15.37:45708) 2024-09-19T05:56:53.522 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:52.722+0000 7fcbc259c640 1 -- 172.21.15.37:0/425962872 learned_addr learned my addr 172.21.15.37:0/425962872 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T05:56:53.522 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:52.722+0000 7fcbc259c640 1 -- 172.21.15.37:0/425962872 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbc419dc30 con 0x7fcbc4107510 2024-09-19T05:56:53.522 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:52.722+0000 7fcbc259c640 1 --2- 172.21.15.37:0/425962872 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbc4107510 0x7fcbc419d6f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcbb402acc0 tx=0x7fcbb4031ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:56:53.522 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:52.722+0000 7fcbbb7fe640 1 -- 172.21.15.37:0/425962872 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbb4036050 con 0x7fcbc4107510 2024-09-19T05:56:53.522 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:52.722+0000 7fcbbb7fe640 1 -- 172.21.15.37:0/425962872 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcbb4037040 con 0x7fcbc4107510 2024-09-19T05:56:53.522 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:52.722+0000 7fcbc8d29640 1 -- 172.21.15.37:0/425962872 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbc419dec0 con 0x7fcbc4107510 2024-09-19T05:56:53.522 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:52.722+0000 7fcbbb7fe640 1 -- 172.21.15.37:0/425962872 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbb403d8c0 con 0x7fcbc4107510 2024-09-19T05:56:53.522 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:52.723+0000 7fcbc8d29640 1 -- 172.21.15.37:0/425962872 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbc41a0bb0 con 0x7fcbc4107510 2024-09-19T05:56:53.522 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:52.723+0000 7fcbbb7fe640 1 -- 172.21.15.37:0/425962872 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fcbb4044020 con 0x7fcbc4107510 2024-09-19T05:56:53.522 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:52.724+0000 7fcbc8d29640 1 -- 172.21.15.37:0/425962872 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbc410bbf0 con 0x7fcbc4107510 2024-09-19T05:56:53.522 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:52.724+0000 7fcbbb7fe640 1 --2- 172.21.15.37:0/425962872 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7fcbb0039200 0x7fcbb003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:56:53.522 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:52.724+0000 7fcbbb7fe640 1 -- 172.21.15.37:0/425962872 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fcbb4042020 con 0x7fcbc4107510 2024-09-19T05:56:53.522 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:52.724+0000 7fcbc1d9b640 1 --2- 172.21.15.37:0/425962872 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7fcbb0039200 0x7fcbb003b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:56:53.523 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:52.724+0000 7fcbc1d9b640 1 --2- 172.21.15.37:0/425962872 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7fcbb0039200 0x7fcbb003b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcbac0098c0 tx=0x7fcbac006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:56:53.523 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:52.729+0000 7fcbbb7fe640 1 -- 172.21.15.37:0/425962872 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcbb404b020 con 0x7fcbc4107510 2024-09-19T05:56:53.523 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:52.910+0000 7fcbc8d29640 1 -- 172.21.15.37:0/425962872 --> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7fcbc4103ef0 con 0x7fcbb0039200 2024-09-19T05:56:53.523 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:52.911+0000 7fcbbb7fe640 1 -- 172.21.15.37:0/425962872 <== mgr.14116 v2:172.21.15.37:6800/133577710 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7fcbc4103ef0 con 0x7fcbb0039200 2024-09-19T05:56:53.523 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:52.913+0000 7fcbc8d29640 1 -- 172.21.15.37:0/425962872 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7fcbb0039200 msgr2=0x7fcbb003b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:56:53.523 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:52.913+0000 7fcbc8d29640 1 --2- 172.21.15.37:0/425962872 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7fcbb0039200 0x7fcbb003b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcbac0098c0 tx=0x7fcbac006db0 comp rx=0 tx=0).stop 2024-09-19T05:56:53.523 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:52.913+0000 7fcbc8d29640 1 -- 172.21.15.37:0/425962872 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbc4107510 msgr2=0x7fcbc419d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:56:53.523 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:52.913+0000 7fcbc8d29640 1 --2- 172.21.15.37:0/425962872 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbc4107510 0x7fcbc419d6f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcbb402acc0 tx=0x7fcbb4031ca0 comp rx=0 tx=0).stop 2024-09-19T05:56:53.523 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:52.913+0000 7fcbc8d29640 1 -- 172.21.15.37:0/425962872 shutdown_connections 2024-09-19T05:56:53.523 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:52.913+0000 7fcbc8d29640 1 --2- 172.21.15.37:0/425962872 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7fcbb0039200 0x7fcbb003b6c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:56:53.523 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:52.913+0000 7fcbc8d29640 1 --2- 172.21.15.37:0/425962872 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbc4107510 0x7fcbc419d6f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:56:53.523 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:52.913+0000 7fcbc8d29640 1 -- 172.21.15.37:0/425962872 >> 172.21.15.37:0/425962872 conn(0x7fcbc4102ce0 msgr2=0x7fcbc41037e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:56:53.523 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:52.913+0000 7fcbc8d29640 1 -- 172.21.15.37:0/425962872 shutdown_connections 2024-09-19T05:56:53.524 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:52.913+0000 7fcbc8d29640 1 -- 172.21.15.37:0/425962872 wait complete. 2024-09-19T05:56:53.524 INFO:teuthology.orchestra.run.smithi037.stdout:Generating ssh key... 2024-09-19T05:56:53.806 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:53 smithi037 ceph-mon[31211]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:56:54.324 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:54 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: Generating public/private rsa key pair. 2024-09-19T05:56:54.324 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:54 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: Your identification has been saved in /tmp/tmp5x47i0un/key 2024-09-19T05:56:54.324 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:54 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: Your public key has been saved in /tmp/tmp5x47i0un/key.pub 2024-09-19T05:56:54.324 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:54 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: The key fingerprint is: 2024-09-19T05:56:54.324 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:54 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: SHA256:emG3g3GVS6+mCO/jC7jFb3RlCF3FnfYSBDCvWZRO3R4 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968 2024-09-19T05:56:54.325 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:54 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: The key's randomart image is: 2024-09-19T05:56:54.325 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:54 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: +---[RSA 3072]----+ 2024-09-19T05:56:54.325 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:54 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: | .oo+Boo.| 2024-09-19T05:56:54.325 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:54 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: | . .+o.+Eo| 2024-09-19T05:56:54.325 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:54 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: | . +* .oo| 2024-09-19T05:56:54.325 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:54 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: | .*+o. o| 2024-09-19T05:56:54.325 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:54 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: | S =o. .. | 2024-09-19T05:56:54.325 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:54 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: | o o.*.. . | 2024-09-19T05:56:54.325 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:54 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: | . *.o.o o | 2024-09-19T05:56:54.325 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:54 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: | o *o. + | 2024-09-19T05:56:54.325 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:54 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: | . +Bo. | 2024-09-19T05:56:54.325 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:56:54 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: +----[SHA256]-----+ 2024-09-19T05:56:54.652 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:53.885+0000 7f727dd12640 1 Processor -- start 2024-09-19T05:56:54.652 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:53.885+0000 7f727dd12640 1 -- start start 2024-09-19T05:56:54.652 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:53.885+0000 7f727dd12640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72781063c0 0x7f72781067c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:56:54.653 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:53.885+0000 7f727dd12640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7278106d90 con 0x7f72781063c0 2024-09-19T05:56:54.653 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:53.885+0000 7f72777fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72781063c0 0x7f72781067c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:56:54.653 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:53.885+0000 7f72777fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72781063c0 0x7f72781067c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34868/0 (socket says 172.21.15.37:34868) 2024-09-19T05:56:54.653 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:53.885+0000 7f72777fe640 1 -- 172.21.15.37:0/2540711712 learned_addr learned my addr 172.21.15.37:0/2540711712 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T05:56:54.653 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:53.886+0000 7f72777fe640 1 -- 172.21.15.37:0/2540711712 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72781075c0 con 0x7f72781063c0 2024-09-19T05:56:54.653 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:53.886+0000 7f72777fe640 1 --2- 172.21.15.37:0/2540711712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72781063c0 0x7f72781067c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7268009820 tx=0x7f726802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7ebe8a1423e5af9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:56:54.653 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:53.887+0000 7f72767fc640 1 -- 172.21.15.37:0/2540711712 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7268037070 con 0x7f72781063c0 2024-09-19T05:56:54.653 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:53.887+0000 7f72767fc640 1 -- 172.21.15.37:0/2540711712 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7268032900 con 0x7f72781063c0 2024-09-19T05:56:54.653 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:53.887+0000 7f72767fc640 1 -- 172.21.15.37:0/2540711712 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7268030850 con 0x7f72781063c0 2024-09-19T05:56:54.653 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:53.887+0000 7f727dd12640 1 -- 172.21.15.37:0/2540711712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72781063c0 msgr2=0x7f72781067c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:56:54.653 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:53.887+0000 7f727dd12640 1 --2- 172.21.15.37:0/2540711712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72781063c0 0x7f72781067c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7268009820 tx=0x7f726802a270 comp rx=0 tx=0).stop 2024-09-19T05:56:54.653 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:53.887+0000 7f727dd12640 1 -- 172.21.15.37:0/2540711712 shutdown_connections 2024-09-19T05:56:54.654 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:53.887+0000 7f727dd12640 1 --2- 172.21.15.37:0/2540711712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72781063c0 0x7f72781067c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:56:54.654 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:53.887+0000 7f727dd12640 1 -- 172.21.15.37:0/2540711712 >> 172.21.15.37:0/2540711712 conn(0x7f7278101b90 msgr2=0x7f7278103fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:56:54.654 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:53.887+0000 7f727dd12640 1 -- 172.21.15.37:0/2540711712 shutdown_connections 2024-09-19T05:56:54.654 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:53.887+0000 7f727dd12640 1 -- 172.21.15.37:0/2540711712 wait complete. 2024-09-19T05:56:54.654 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:53.888+0000 7f727dd12640 1 Processor -- start 2024-09-19T05:56:54.654 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:53.888+0000 7f727dd12640 1 -- start start 2024-09-19T05:56:54.654 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:53.888+0000 7f727dd12640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72781063c0 0x7f727819b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:56:54.654 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:53.888+0000 7f727dd12640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f727810a970 con 0x7f72781063c0 2024-09-19T05:56:54.654 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:53.888+0000 7f72777fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72781063c0 0x7f727819b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:56:54.654 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:53.888+0000 7f72777fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72781063c0 0x7f727819b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34870/0 (socket says 172.21.15.37:34870) 2024-09-19T05:56:54.654 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:53.888+0000 7f72777fe640 1 -- 172.21.15.37:0/3137940077 learned_addr learned my addr 172.21.15.37:0/3137940077 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T05:56:54.654 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:53.889+0000 7f72777fe640 1 -- 172.21.15.37:0/3137940077 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f727819b9f0 con 0x7f72781063c0 2024-09-19T05:56:54.655 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:53.889+0000 7f72777fe640 1 --2- 172.21.15.37:0/3137940077 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72781063c0 0x7f727819b4b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7268009940 tx=0x7f7268032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:56:54.655 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:53.889+0000 7f7274ff9640 1 -- 172.21.15.37:0/3137940077 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7268042070 con 0x7f72781063c0 2024-09-19T05:56:54.655 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:53.889+0000 7f7274ff9640 1 -- 172.21.15.37:0/3137940077 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f72680308c0 con 0x7f72781063c0 2024-09-19T05:56:54.655 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:53.889+0000 7f727dd12640 1 -- 172.21.15.37:0/3137940077 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f727819bc80 con 0x7f72781063c0 2024-09-19T05:56:54.655 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:53.889+0000 7f7274ff9640 1 -- 172.21.15.37:0/3137940077 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7268037040 con 0x7f72781063c0 2024-09-19T05:56:54.655 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:53.889+0000 7f727dd12640 1 -- 172.21.15.37:0/3137940077 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f727819e970 con 0x7f72781063c0 2024-09-19T05:56:54.655 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:53.890+0000 7f7274ff9640 1 -- 172.21.15.37:0/3137940077 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f7268045070 con 0x7f72781063c0 2024-09-19T05:56:54.655 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:53.890+0000 7f727dd12640 1 -- 172.21.15.37:0/3137940077 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f727810aaf0 con 0x7f72781063c0 2024-09-19T05:56:54.655 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:53.890+0000 7f7274ff9640 1 --2- 172.21.15.37:0/3137940077 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7f7260039200 0x7f726003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:56:54.655 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:53.890+0000 7f7274ff9640 1 -- 172.21.15.37:0/3137940077 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f726806c320 con 0x7f72781063c0 2024-09-19T05:56:54.655 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:53.890+0000 7f7276ffd640 1 --2- 172.21.15.37:0/3137940077 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7f7260039200 0x7f726003b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:56:54.655 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:53.890+0000 7f7276ffd640 1 --2- 172.21.15.37:0/3137940077 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7f7260039200 0x7f726003b6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f726c0098c0 tx=0x7f726c006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:56:54.655 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:53.895+0000 7f7274ff9640 1 -- 172.21.15.37:0/3137940077 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7268045360 con 0x7f72781063c0 2024-09-19T05:56:54.656 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:54.070+0000 7f727dd12640 1 -- 172.21.15.37:0/3137940077 --> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f727802daa0 con 0x7f7260039200 2024-09-19T05:56:54.656 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:54.157+0000 7f7274ff9640 1 -- 172.21.15.37:0/3137940077 <== mgr.14116 v2:172.21.15.37:6800/133577710 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f727802daa0 con 0x7f7260039200 2024-09-19T05:56:54.656 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:54.159+0000 7f727dd12640 1 -- 172.21.15.37:0/3137940077 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7f7260039200 msgr2=0x7f726003b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:56:54.656 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:54.160+0000 7f727dd12640 1 --2- 172.21.15.37:0/3137940077 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7f7260039200 0x7f726003b6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f726c0098c0 tx=0x7f726c006db0 comp rx=0 tx=0).stop 2024-09-19T05:56:54.656 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:54.160+0000 7f727dd12640 1 -- 172.21.15.37:0/3137940077 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72781063c0 msgr2=0x7f727819b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:56:54.656 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:54.160+0000 7f727dd12640 1 --2- 172.21.15.37:0/3137940077 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72781063c0 0x7f727819b4b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7268009940 tx=0x7f7268032ce0 comp rx=0 tx=0).stop 2024-09-19T05:56:54.656 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:54.160+0000 7f727dd12640 1 -- 172.21.15.37:0/3137940077 shutdown_connections 2024-09-19T05:56:54.656 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:54.160+0000 7f727dd12640 1 --2- 172.21.15.37:0/3137940077 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7f7260039200 0x7f726003b6c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:56:54.656 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:54.160+0000 7f727dd12640 1 --2- 172.21.15.37:0/3137940077 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72781063c0 0x7f727819b4b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:56:54.656 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:54.160+0000 7f727dd12640 1 -- 172.21.15.37:0/3137940077 >> 172.21.15.37:0/3137940077 conn(0x7f7278101b90 msgr2=0x7f7278102a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:56:54.656 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:54.160+0000 7f727dd12640 1 -- 172.21.15.37:0/3137940077 shutdown_connections 2024-09-19T05:56:54.656 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:54.160+0000 7f727dd12640 1 -- 172.21.15.37:0/3137940077 wait complete. 2024-09-19T05:56:55.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:55 smithi037 ceph-mon[31211]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:56:55.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:55 smithi037 ceph-mon[31211]: Generating ssh key... 2024-09-19T05:56:55.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:55 smithi037 ceph-mon[31211]: from='mgr.14116 172.21.15.37:0/3995008439' entity='mgr.x' 2024-09-19T05:56:55.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:55 smithi037 ceph-mon[31211]: from='mgr.14116 172.21.15.37:0/3995008439' entity='mgr.x' 2024-09-19T05:56:55.775 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCL/GMcq0NvNZfARJ8RR5yLRtR6nfZiX3/lUKyHA+ILnGn0ukMB24P/MErQo8ckRZ6iNp2Q+I4ebYxhHRXE1woZeLS7bkDsNOn+H1GisGSZzVygW0IcCn2odt+j+w8liZOXDx1wjR+mPi4X7uOTJpSwCkzsa+FfdGpi3XnVMBNqEBOKYuN10MLLGXW5JZ/eqo/kC5K39/7YG/0AmyUKE80fHqIyswvy1Yf1jr2BxDcAvPpSdlWFjaskDxZxkyJK7cgTuhIX3KXqewfU6DMIN1oEvUFX46kQVzPvUOgvylpr3HZPszS44rBoJj/3DfF1jW2bD3oWFOqheQ74oINxWLtUCgQojocchl+kfXK7tETHnkXXbsscb2XkjN58KjOPpSHvQIYkVUIFL/e/YEkdb1K63OOxcd3SKjlVI9qOrNdQQhOi2K4UfWxQ2yt7rDZtEoVnPPjF3qN8U1X2BFp7L3qUSoX+u8M9x754qdnlp4FSKIWHTB2fhEkP8k2gWWPwyh0= ceph-b8c8bdae-764b-11ef-bceb-c7b262605968 2024-09-19T05:56:55.776 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:55.008+0000 7fe1a1f95640 1 Processor -- start 2024-09-19T05:56:55.776 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:55.008+0000 7fe1a1f95640 1 -- start start 2024-09-19T05:56:55.776 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:55.008+0000 7fe1a1f95640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe19c107510 0x7fe19c107910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:56:55.776 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:55.008+0000 7fe1a1f95640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe19c107ee0 con 0x7fe19c107510 2024-09-19T05:56:55.776 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:55.008+0000 7fe19b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe19c107510 0x7fe19c107910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:56:55.776 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:55.008+0000 7fe19b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe19c107510 0x7fe19c107910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34878/0 (socket says 172.21.15.37:34878) 2024-09-19T05:56:55.776 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:55.008+0000 7fe19b7fe640 1 -- 172.21.15.37:0/986694271 learned_addr learned my addr 172.21.15.37:0/986694271 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T05:56:55.776 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:55.009+0000 7fe19b7fe640 1 -- 172.21.15.37:0/986694271 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe19c1086c0 con 0x7fe19c107510 2024-09-19T05:56:55.776 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:55.009+0000 7fe19b7fe640 1 --2- 172.21.15.37:0/986694271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe19c107510 0x7fe19c107910 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe18c009820 tx=0x7fe18c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a06da99d7d811021 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:56:55.776 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:55.009+0000 7fe19a7fc640 1 -- 172.21.15.37:0/986694271 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe18c037070 con 0x7fe19c107510 2024-09-19T05:56:55.776 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:55.010+0000 7fe19a7fc640 1 -- 172.21.15.37:0/986694271 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe18c032900 con 0x7fe19c107510 2024-09-19T05:56:55.776 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:55.010+0000 7fe19a7fc640 1 -- 172.21.15.37:0/986694271 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe18c030850 con 0x7fe19c107510 2024-09-19T05:56:55.777 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:55.010+0000 7fe1a1f95640 1 -- 172.21.15.37:0/986694271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe19c107510 msgr2=0x7fe19c107910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:56:55.777 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:55.010+0000 7fe1a1f95640 1 --2- 172.21.15.37:0/986694271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe19c107510 0x7fe19c107910 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe18c009820 tx=0x7fe18c02a270 comp rx=0 tx=0).stop 2024-09-19T05:56:55.777 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:55.010+0000 7fe1a1f95640 1 -- 172.21.15.37:0/986694271 shutdown_connections 2024-09-19T05:56:55.777 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:55.010+0000 7fe1a1f95640 1 --2- 172.21.15.37:0/986694271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe19c107510 0x7fe19c107910 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:56:55.777 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:55.010+0000 7fe1a1f95640 1 -- 172.21.15.37:0/986694271 >> 172.21.15.37:0/986694271 conn(0x7fe19c102ce0 msgr2=0x7fe19c105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:56:55.777 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:55.010+0000 7fe1a1f95640 1 -- 172.21.15.37:0/986694271 shutdown_connections 2024-09-19T05:56:55.777 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:55.010+0000 7fe1a1f95640 1 -- 172.21.15.37:0/986694271 wait complete. 2024-09-19T05:56:55.777 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:55.011+0000 7fe1a1f95640 1 Processor -- start 2024-09-19T05:56:55.777 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:55.011+0000 7fe1a1f95640 1 -- start start 2024-09-19T05:56:55.777 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:55.011+0000 7fe1a1f95640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe19c107510 0x7fe19c07db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:56:55.777 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:55.011+0000 7fe1a1f95640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe19c10ba70 con 0x7fe19c107510 2024-09-19T05:56:55.777 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:55.011+0000 7fe19b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe19c107510 0x7fe19c07db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:56:55.777 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:55.011+0000 7fe19b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe19c107510 0x7fe19c07db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34890/0 (socket says 172.21.15.37:34890) 2024-09-19T05:56:55.778 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:55.011+0000 7fe19b7fe640 1 -- 172.21.15.37:0/2176080608 learned_addr learned my addr 172.21.15.37:0/2176080608 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T05:56:55.778 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:55.011+0000 7fe19b7fe640 1 -- 172.21.15.37:0/2176080608 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe19c07e080 con 0x7fe19c107510 2024-09-19T05:56:55.778 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:55.012+0000 7fe19b7fe640 1 --2- 172.21.15.37:0/2176080608 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe19c107510 0x7fe19c07db40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe18c0097f0 tx=0x7fe18c030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:56:55.778 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:55.012+0000 7fe198ff9640 1 -- 172.21.15.37:0/2176080608 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe18c037040 con 0x7fe19c107510 2024-09-19T05:56:55.778 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:55.012+0000 7fe198ff9640 1 -- 172.21.15.37:0/2176080608 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe18c040070 con 0x7fe19c107510 2024-09-19T05:56:55.778 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:55.012+0000 7fe1a1f95640 1 -- 172.21.15.37:0/2176080608 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe19c07c270 con 0x7fe19c107510 2024-09-19T05:56:55.778 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:55.012+0000 7fe198ff9640 1 -- 172.21.15.37:0/2176080608 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe18c03a390 con 0x7fe19c107510 2024-09-19T05:56:55.778 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:55.012+0000 7fe1a1f95640 1 -- 172.21.15.37:0/2176080608 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe19c07c750 con 0x7fe19c107510 2024-09-19T05:56:55.778 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:55.013+0000 7fe198ff9640 1 -- 172.21.15.37:0/2176080608 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fe18c03a630 con 0x7fe19c107510 2024-09-19T05:56:55.778 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:55.013+0000 7fe198ff9640 1 --2- 172.21.15.37:0/2176080608 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7fe1840391b0 0x7fe18403b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:56:55.778 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:55.013+0000 7fe1a1f95640 1 -- 172.21.15.37:0/2176080608 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe19c107990 con 0x7fe19c107510 2024-09-19T05:56:55.778 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:55.013+0000 7fe198ff9640 1 -- 172.21.15.37:0/2176080608 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fe18c06c9b0 con 0x7fe19c107510 2024-09-19T05:56:55.778 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:55.013+0000 7fe19affd640 1 --2- 172.21.15.37:0/2176080608 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7fe1840391b0 0x7fe18403b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:56:55.779 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:55.014+0000 7fe19affd640 1 --2- 172.21.15.37:0/2176080608 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7fe1840391b0 0x7fe18403b670 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe1900098c0 tx=0x7fe190006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:56:55.779 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:55.018+0000 7fe198ff9640 1 -- 172.21.15.37:0/2176080608 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe18c04a200 con 0x7fe19c107510 2024-09-19T05:56:55.779 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:55.195+0000 7fe1a1f95640 1 -- 172.21.15.37:0/2176080608 --> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7fe19c07d130 con 0x7fe1840391b0 2024-09-19T05:56:55.779 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:55.196+0000 7fe198ff9640 1 -- 172.21.15.37:0/2176080608 <== mgr.14116 v2:172.21.15.37:6800/133577710 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7fe19c07d130 con 0x7fe1840391b0 2024-09-19T05:56:55.779 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:55.197+0000 7fe1a1f95640 1 -- 172.21.15.37:0/2176080608 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7fe1840391b0 msgr2=0x7fe18403b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:56:55.779 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:55.197+0000 7fe1a1f95640 1 --2- 172.21.15.37:0/2176080608 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7fe1840391b0 0x7fe18403b670 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe1900098c0 tx=0x7fe190006db0 comp rx=0 tx=0).stop 2024-09-19T05:56:55.779 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:55.197+0000 7fe1a1f95640 1 -- 172.21.15.37:0/2176080608 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe19c107510 msgr2=0x7fe19c07db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:56:55.779 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:55.197+0000 7fe1a1f95640 1 --2- 172.21.15.37:0/2176080608 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe19c107510 0x7fe19c07db40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe18c0097f0 tx=0x7fe18c030d80 comp rx=0 tx=0).stop 2024-09-19T05:56:55.779 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:55.198+0000 7fe1a1f95640 1 -- 172.21.15.37:0/2176080608 shutdown_connections 2024-09-19T05:56:55.779 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:55.198+0000 7fe1a1f95640 1 --2- 172.21.15.37:0/2176080608 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7fe1840391b0 0x7fe18403b670 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:56:55.779 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:55.198+0000 7fe1a1f95640 1 --2- 172.21.15.37:0/2176080608 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe19c107510 0x7fe19c07db40 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:56:55.779 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:55.198+0000 7fe1a1f95640 1 -- 172.21.15.37:0/2176080608 >> 172.21.15.37:0/2176080608 conn(0x7fe19c102ce0 msgr2=0x7fe19c103820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:56:55.779 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:55.198+0000 7fe1a1f95640 1 -- 172.21.15.37:0/2176080608 shutdown_connections 2024-09-19T05:56:55.780 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:55.198+0000 7fe1a1f95640 1 -- 172.21.15.37:0/2176080608 wait complete. 2024-09-19T05:56:55.780 INFO:teuthology.orchestra.run.smithi037.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-19T05:56:55.780 INFO:teuthology.orchestra.run.smithi037.stdout:Adding key to root@localhost authorized_keys... 2024-09-19T05:56:55.780 INFO:teuthology.orchestra.run.smithi037.stdout:Adding host smithi037... 2024-09-19T05:56:56.378 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:56 smithi037 ceph-mon[31211]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:56:57.737 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:57 smithi037 ceph-mon[31211]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi037", "addr": "172.21.15.37", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:56:58.666 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:56:58 smithi037 ceph-mon[31211]: Deploying cephadm binary to smithi037 2024-09-19T05:57:00.874 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout Added host 'smithi037' with addr '172.21.15.37' 2024-09-19T05:57:00.874 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:56.185+0000 7fea1e377640 1 Processor -- start 2024-09-19T05:57:00.874 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:56.185+0000 7fea1e377640 1 -- start start 2024-09-19T05:57:00.875 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:56.185+0000 7fea1e377640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea18107510 0x7fea18107910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:57:00.875 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:56.185+0000 7fea1e377640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fea18107ee0 con 0x7fea18107510 2024-09-19T05:57:00.875 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:56.186+0000 7fea17fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea18107510 0x7fea18107910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:57:00.875 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:56.186+0000 7fea17fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea18107510 0x7fea18107910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34892/0 (socket says 172.21.15.37:34892) 2024-09-19T05:57:00.875 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:56.186+0000 7fea17fff640 1 -- 172.21.15.37:0/998715106 learned_addr learned my addr 172.21.15.37:0/998715106 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T05:57:00.875 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:56.186+0000 7fea17fff640 1 -- 172.21.15.37:0/998715106 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea181086c0 con 0x7fea18107510 2024-09-19T05:57:00.875 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:56.187+0000 7fea17fff640 1 --2- 172.21.15.37:0/998715106 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea18107510 0x7fea18107910 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fea08009820 tx=0x7fea0802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39ffd69faec8a90b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:57:00.875 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:56.187+0000 7fea177fe640 1 -- 172.21.15.37:0/998715106 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea08037070 con 0x7fea18107510 2024-09-19T05:57:00.875 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:56.187+0000 7fea177fe640 1 -- 172.21.15.37:0/998715106 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fea08032900 con 0x7fea18107510 2024-09-19T05:57:00.875 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:56.187+0000 7fea177fe640 1 -- 172.21.15.37:0/998715106 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea08030850 con 0x7fea18107510 2024-09-19T05:57:00.875 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:56.187+0000 7fea1e377640 1 -- 172.21.15.37:0/998715106 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea18107510 msgr2=0x7fea18107910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:57:00.875 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:56.187+0000 7fea1e377640 1 --2- 172.21.15.37:0/998715106 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea18107510 0x7fea18107910 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fea08009820 tx=0x7fea0802a270 comp rx=0 tx=0).stop 2024-09-19T05:57:00.876 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:56.188+0000 7fea1e377640 1 -- 172.21.15.37:0/998715106 shutdown_connections 2024-09-19T05:57:00.876 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:56.188+0000 7fea1e377640 1 --2- 172.21.15.37:0/998715106 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea18107510 0x7fea18107910 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:00.876 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:56.188+0000 7fea1e377640 1 -- 172.21.15.37:0/998715106 >> 172.21.15.37:0/998715106 conn(0x7fea18102ce0 msgr2=0x7fea18105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:57:00.876 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:56.188+0000 7fea1e377640 1 -- 172.21.15.37:0/998715106 shutdown_connections 2024-09-19T05:57:00.876 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:56.188+0000 7fea1e377640 1 -- 172.21.15.37:0/998715106 wait complete. 2024-09-19T05:57:00.876 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:56.188+0000 7fea1e377640 1 Processor -- start 2024-09-19T05:57:00.876 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:56.188+0000 7fea1e377640 1 -- start start 2024-09-19T05:57:00.876 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:56.188+0000 7fea1e377640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea18107510 0x7fea1819d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:57:00.876 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:56.188+0000 7fea1e377640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fea1810ba70 con 0x7fea18107510 2024-09-19T05:57:00.876 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:56.188+0000 7fea17fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea18107510 0x7fea1819d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:57:00.876 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:56.189+0000 7fea17fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea18107510 0x7fea1819d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34900/0 (socket says 172.21.15.37:34900) 2024-09-19T05:57:00.876 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:56.189+0000 7fea17fff640 1 -- 172.21.15.37:0/1975442880 learned_addr learned my addr 172.21.15.37:0/1975442880 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T05:57:00.876 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:56.189+0000 7fea17fff640 1 -- 172.21.15.37:0/1975442880 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea1819dc30 con 0x7fea18107510 2024-09-19T05:57:00.877 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:56.189+0000 7fea17fff640 1 --2- 172.21.15.37:0/1975442880 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea18107510 0x7fea1819d6f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fea080097f0 tx=0x7fea08030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:57:00.877 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:56.189+0000 7fea15ffb640 1 -- 172.21.15.37:0/1975442880 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea08037040 con 0x7fea18107510 2024-09-19T05:57:00.877 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:56.189+0000 7fea15ffb640 1 -- 172.21.15.37:0/1975442880 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fea08040070 con 0x7fea18107510 2024-09-19T05:57:00.877 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:56.189+0000 7fea15ffb640 1 -- 172.21.15.37:0/1975442880 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea0803a390 con 0x7fea18107510 2024-09-19T05:57:00.877 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:56.189+0000 7fea1e377640 1 -- 172.21.15.37:0/1975442880 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea1819dec0 con 0x7fea18107510 2024-09-19T05:57:00.877 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:56.189+0000 7fea1e377640 1 -- 172.21.15.37:0/1975442880 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea181a0bb0 con 0x7fea18107510 2024-09-19T05:57:00.877 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:56.190+0000 7fea15ffb640 1 -- 172.21.15.37:0/1975442880 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fea0803a630 con 0x7fea18107510 2024-09-19T05:57:00.877 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:56.191+0000 7fea1e377640 1 -- 172.21.15.37:0/1975442880 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea18107990 con 0x7fea18107510 2024-09-19T05:57:00.877 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:56.191+0000 7fea15ffb640 1 --2- 172.21.15.37:0/1975442880 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7fea040391b0 0x7fea0403b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:57:00.877 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:56.191+0000 7fea15ffb640 1 -- 172.21.15.37:0/1975442880 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fea0806c790 con 0x7fea18107510 2024-09-19T05:57:00.877 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:56.191+0000 7fea0ffff640 1 --2- 172.21.15.37:0/1975442880 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7fea040391b0 0x7fea0403b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:57:00.877 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:56.191+0000 7fea0ffff640 1 --2- 172.21.15.37:0/1975442880 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7fea040391b0 0x7fea0403b670 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fea000098c0 tx=0x7fea00006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:57:00.877 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:56.196+0000 7fea15ffb640 1 -- 172.21.15.37:0/1975442880 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fea08042310 con 0x7fea18107510 2024-09-19T05:57:00.878 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:56:56.376+0000 7fea1e377640 1 -- 172.21.15.37:0/1975442880 --> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi037", "addr": "172.21.15.37", "target": ["mon-mgr", ""]}) -- 0x7fea18103ef0 con 0x7fea040391b0 2024-09-19T05:57:00.878 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:00.303+0000 7fea15ffb640 1 -- 172.21.15.37:0/1975442880 <== mgr.14116 v2:172.21.15.37:6800/133577710 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7fea18103ef0 con 0x7fea040391b0 2024-09-19T05:57:00.878 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:00.305+0000 7fea1e377640 1 -- 172.21.15.37:0/1975442880 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7fea040391b0 msgr2=0x7fea0403b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:57:00.878 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:00.305+0000 7fea1e377640 1 --2- 172.21.15.37:0/1975442880 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7fea040391b0 0x7fea0403b670 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fea000098c0 tx=0x7fea00006db0 comp rx=0 tx=0).stop 2024-09-19T05:57:00.878 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:00.305+0000 7fea1e377640 1 -- 172.21.15.37:0/1975442880 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea18107510 msgr2=0x7fea1819d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:57:00.878 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:00.305+0000 7fea1e377640 1 --2- 172.21.15.37:0/1975442880 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea18107510 0x7fea1819d6f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fea080097f0 tx=0x7fea08030d80 comp rx=0 tx=0).stop 2024-09-19T05:57:00.878 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:00.305+0000 7fea1e377640 1 -- 172.21.15.37:0/1975442880 shutdown_connections 2024-09-19T05:57:00.878 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:00.305+0000 7fea1e377640 1 --2- 172.21.15.37:0/1975442880 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7fea040391b0 0x7fea0403b670 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:00.878 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:00.305+0000 7fea1e377640 1 --2- 172.21.15.37:0/1975442880 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea18107510 0x7fea1819d6f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:00.878 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:00.305+0000 7fea1e377640 1 -- 172.21.15.37:0/1975442880 >> 172.21.15.37:0/1975442880 conn(0x7fea18102ce0 msgr2=0x7fea181037e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:57:00.878 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:00.306+0000 7fea1e377640 1 -- 172.21.15.37:0/1975442880 shutdown_connections 2024-09-19T05:57:00.878 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:00.306+0000 7fea1e377640 1 -- 172.21.15.37:0/1975442880 wait complete. 2024-09-19T05:57:00.878 INFO:teuthology.orchestra.run.smithi037.stdout:Deploying unmanaged mon service... 2024-09-19T05:57:01.490 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:01 smithi037 ceph-mon[31211]: from='mgr.14116 172.21.15.37:0/3995008439' entity='mgr.x' 2024-09-19T05:57:01.490 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:01 smithi037 ceph-mon[31211]: Added host smithi037 2024-09-19T05:57:01.490 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:01 smithi037 ceph-mon[31211]: from='mgr.14116 172.21.15.37:0/3995008439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:57:02.084 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-19T05:57:02.084 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:01.301+0000 7fb2ee1c2640 1 Processor -- start 2024-09-19T05:57:02.084 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:01.301+0000 7fb2ee1c2640 1 -- start start 2024-09-19T05:57:02.084 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:01.301+0000 7fb2ee1c2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2e8107f90 0x7fb2e810a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:57:02.084 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:01.301+0000 7fb2ee1c2640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb2e807be20 con 0x7fb2e8107f90 2024-09-19T05:57:02.084 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:01.301+0000 7fb2e77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2e8107f90 0x7fb2e810a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:57:02.084 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:01.301+0000 7fb2e77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2e8107f90 0x7fb2e810a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34902/0 (socket says 172.21.15.37:34902) 2024-09-19T05:57:02.084 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:01.301+0000 7fb2e77fe640 1 -- 172.21.15.37:0/3246654892 learned_addr learned my addr 172.21.15.37:0/3246654892 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T05:57:02.084 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:01.302+0000 7fb2e77fe640 1 -- 172.21.15.37:0/3246654892 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2e810a8c0 con 0x7fb2e8107f90 2024-09-19T05:57:02.084 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:01.302+0000 7fb2e77fe640 1 --2- 172.21.15.37:0/3246654892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2e8107f90 0x7fb2e810a380 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb2d8009820 tx=0x7fb2d802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8437caef44fb4940 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:57:02.085 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:01.303+0000 7fb2e6ffd640 1 -- 172.21.15.37:0/3246654892 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2d8037070 con 0x7fb2e8107f90 2024-09-19T05:57:02.085 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:01.303+0000 7fb2e6ffd640 1 -- 172.21.15.37:0/3246654892 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb2d8032900 con 0x7fb2e8107f90 2024-09-19T05:57:02.085 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:01.303+0000 7fb2e6ffd640 1 -- 172.21.15.37:0/3246654892 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2d8030850 con 0x7fb2e8107f90 2024-09-19T05:57:02.085 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:01.304+0000 7fb2ee1c2640 1 -- 172.21.15.37:0/3246654892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2e8107f90 msgr2=0x7fb2e810a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:57:02.085 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:01.304+0000 7fb2ee1c2640 1 --2- 172.21.15.37:0/3246654892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2e8107f90 0x7fb2e810a380 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb2d8009820 tx=0x7fb2d802a270 comp rx=0 tx=0).stop 2024-09-19T05:57:02.085 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:01.304+0000 7fb2ee1c2640 1 -- 172.21.15.37:0/3246654892 shutdown_connections 2024-09-19T05:57:02.085 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:01.304+0000 7fb2ee1c2640 1 --2- 172.21.15.37:0/3246654892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2e8107f90 0x7fb2e810a380 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:02.085 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:01.304+0000 7fb2ee1c2640 1 -- 172.21.15.37:0/3246654892 >> 172.21.15.37:0/3246654892 conn(0x7fb2e8101b90 msgr2=0x7fb2e8103fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:57:02.085 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:01.304+0000 7fb2ee1c2640 1 -- 172.21.15.37:0/3246654892 shutdown_connections 2024-09-19T05:57:02.085 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:01.304+0000 7fb2ee1c2640 1 -- 172.21.15.37:0/3246654892 wait complete. 2024-09-19T05:57:02.085 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:01.305+0000 7fb2ee1c2640 1 Processor -- start 2024-09-19T05:57:02.085 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:01.305+0000 7fb2ee1c2640 1 -- start start 2024-09-19T05:57:02.086 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:01.305+0000 7fb2ee1c2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2e8107f90 0x7fb2e819b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:57:02.086 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:01.305+0000 7fb2ee1c2640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb2e810b900 con 0x7fb2e8107f90 2024-09-19T05:57:02.086 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:01.305+0000 7fb2e77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2e8107f90 0x7fb2e819b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:57:02.086 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:01.305+0000 7fb2e77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2e8107f90 0x7fb2e819b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34914/0 (socket says 172.21.15.37:34914) 2024-09-19T05:57:02.086 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:01.305+0000 7fb2e77fe640 1 -- 172.21.15.37:0/3133017248 learned_addr learned my addr 172.21.15.37:0/3133017248 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T05:57:02.086 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:01.305+0000 7fb2e77fe640 1 -- 172.21.15.37:0/3133017248 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2e819ba40 con 0x7fb2e8107f90 2024-09-19T05:57:02.086 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:01.305+0000 7fb2e77fe640 1 --2- 172.21.15.37:0/3133017248 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2e8107f90 0x7fb2e819b500 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb2d80097f0 tx=0x7fb2d8030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:57:02.086 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:01.306+0000 7fb2e57fa640 1 -- 172.21.15.37:0/3133017248 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2d8037040 con 0x7fb2e8107f90 2024-09-19T05:57:02.086 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:01.306+0000 7fb2e57fa640 1 -- 172.21.15.37:0/3133017248 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb2d8040070 con 0x7fb2e8107f90 2024-09-19T05:57:02.086 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:01.306+0000 7fb2ee1c2640 1 -- 172.21.15.37:0/3133017248 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2e819bcd0 con 0x7fb2e8107f90 2024-09-19T05:57:02.086 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:01.306+0000 7fb2e57fa640 1 -- 172.21.15.37:0/3133017248 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2d803a390 con 0x7fb2e8107f90 2024-09-19T05:57:02.086 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:01.306+0000 7fb2ee1c2640 1 -- 172.21.15.37:0/3133017248 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2e819e9c0 con 0x7fb2e8107f90 2024-09-19T05:57:02.086 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:01.307+0000 7fb2e57fa640 1 -- 172.21.15.37:0/3133017248 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fb2d803a5e0 con 0x7fb2e8107f90 2024-09-19T05:57:02.087 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:01.307+0000 7fb2ee1c2640 1 -- 172.21.15.37:0/3133017248 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2e81083f0 con 0x7fb2e8107f90 2024-09-19T05:57:02.087 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:01.307+0000 7fb2e57fa640 1 --2- 172.21.15.37:0/3133017248 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7fb2d4039200 0x7fb2d403b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:57:02.087 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:01.307+0000 7fb2e57fa640 1 -- 172.21.15.37:0/3133017248 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fb2d806c940 con 0x7fb2e8107f90 2024-09-19T05:57:02.087 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:01.307+0000 7fb2dffff640 1 --2- 172.21.15.37:0/3133017248 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7fb2d4039200 0x7fb2d403b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:57:02.087 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:01.307+0000 7fb2dffff640 1 --2- 172.21.15.37:0/3133017248 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7fb2d4039200 0x7fb2d403b6c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb2d00098c0 tx=0x7fb2d0006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:57:02.087 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:01.312+0000 7fb2e57fa640 1 -- 172.21.15.37:0/3133017248 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb2d8043760 con 0x7fb2e8107f90 2024-09-19T05:57:02.087 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:01.501+0000 7fb2ee1c2640 1 -- 172.21.15.37:0/3133017248 --> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7fb2e8102e50 con 0x7fb2d4039200 2024-09-19T05:57:02.087 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:01.507+0000 7fb2e57fa640 1 -- 172.21.15.37:0/3133017248 <== mgr.14116 v2:172.21.15.37:6800/133577710 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fb2e8102e50 con 0x7fb2d4039200 2024-09-19T05:57:02.087 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:01.509+0000 7fb2ee1c2640 1 -- 172.21.15.37:0/3133017248 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7fb2d4039200 msgr2=0x7fb2d403b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:57:02.087 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:01.509+0000 7fb2ee1c2640 1 --2- 172.21.15.37:0/3133017248 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7fb2d4039200 0x7fb2d403b6c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb2d00098c0 tx=0x7fb2d0006db0 comp rx=0 tx=0).stop 2024-09-19T05:57:02.087 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:01.509+0000 7fb2ee1c2640 1 -- 172.21.15.37:0/3133017248 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2e8107f90 msgr2=0x7fb2e819b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:57:02.087 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:01.509+0000 7fb2ee1c2640 1 --2- 172.21.15.37:0/3133017248 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2e8107f90 0x7fb2e819b500 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb2d80097f0 tx=0x7fb2d8030d80 comp rx=0 tx=0).stop 2024-09-19T05:57:02.087 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:01.509+0000 7fb2ee1c2640 1 -- 172.21.15.37:0/3133017248 shutdown_connections 2024-09-19T05:57:02.087 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:01.509+0000 7fb2ee1c2640 1 --2- 172.21.15.37:0/3133017248 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7fb2d4039200 0x7fb2d403b6c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:02.088 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:01.509+0000 7fb2ee1c2640 1 --2- 172.21.15.37:0/3133017248 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2e8107f90 0x7fb2e819b500 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:02.088 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:01.509+0000 7fb2ee1c2640 1 -- 172.21.15.37:0/3133017248 >> 172.21.15.37:0/3133017248 conn(0x7fb2e8101b90 msgr2=0x7fb2e8102740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:57:02.088 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:01.509+0000 7fb2ee1c2640 1 -- 172.21.15.37:0/3133017248 shutdown_connections 2024-09-19T05:57:02.088 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:01.509+0000 7fb2ee1c2640 1 -- 172.21.15.37:0/3133017248 wait complete. 2024-09-19T05:57:02.088 INFO:teuthology.orchestra.run.smithi037.stdout:Deploying unmanaged mgr service... 2024-09-19T05:57:02.629 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:02 smithi037 ceph-mon[31211]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:57:02.629 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:02 smithi037 ceph-mon[31211]: Saving service mon spec with placement count:5 2024-09-19T05:57:02.629 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:02 smithi037 ceph-mon[31211]: from='mgr.14116 172.21.15.37:0/3995008439' entity='mgr.x' 2024-09-19T05:57:03.275 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-19T05:57:03.275 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:02.424+0000 7fbb72364640 1 Processor -- start 2024-09-19T05:57:03.275 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:02.424+0000 7fbb72364640 1 -- start start 2024-09-19T05:57:03.275 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:02.424+0000 7fbb72364640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb6c07de00 0x7fbb6c07c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:57:03.275 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:02.424+0000 7fbb72364640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbb6c07c7f0 con 0x7fbb6c07de00 2024-09-19T05:57:03.275 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:02.424+0000 7fbb6bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb6c07de00 0x7fbb6c07c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:57:03.275 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:02.424+0000 7fbb6bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb6c07de00 0x7fbb6c07c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34926/0 (socket says 172.21.15.37:34926) 2024-09-19T05:57:03.276 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:02.424+0000 7fbb6bfff640 1 -- 172.21.15.37:0/3835200341 learned_addr learned my addr 172.21.15.37:0/3835200341 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T05:57:03.276 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:02.424+0000 7fbb6bfff640 1 -- 172.21.15.37:0/3835200341 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb6c07c970 con 0x7fbb6c07de00 2024-09-19T05:57:03.276 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:02.425+0000 7fbb6bfff640 1 --2- 172.21.15.37:0/3835200341 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb6c07de00 0x7fbb6c07c2b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c009820 tx=0x7fbb5c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=add01c73bcba551 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:57:03.276 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:02.425+0000 7fbb6affd640 1 -- 172.21.15.37:0/3835200341 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb5c037070 con 0x7fbb6c07de00 2024-09-19T05:57:03.276 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:02.425+0000 7fbb6affd640 1 -- 172.21.15.37:0/3835200341 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbb5c032900 con 0x7fbb6c07de00 2024-09-19T05:57:03.276 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:02.425+0000 7fbb6affd640 1 -- 172.21.15.37:0/3835200341 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb5c030850 con 0x7fbb6c07de00 2024-09-19T05:57:03.276 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:02.426+0000 7fbb72364640 1 -- 172.21.15.37:0/3835200341 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb6c07de00 msgr2=0x7fbb6c07c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:57:03.276 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:02.426+0000 7fbb72364640 1 --2- 172.21.15.37:0/3835200341 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb6c07de00 0x7fbb6c07c2b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c009820 tx=0x7fbb5c02a270 comp rx=0 tx=0).stop 2024-09-19T05:57:03.276 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:02.426+0000 7fbb72364640 1 -- 172.21.15.37:0/3835200341 shutdown_connections 2024-09-19T05:57:03.276 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:02.426+0000 7fbb72364640 1 --2- 172.21.15.37:0/3835200341 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb6c07de00 0x7fbb6c07c2b0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:03.276 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:02.426+0000 7fbb72364640 1 -- 172.21.15.37:0/3835200341 >> 172.21.15.37:0/3835200341 conn(0x7fbb6c102ce0 msgr2=0x7fbb6c105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:57:03.276 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:02.426+0000 7fbb72364640 1 -- 172.21.15.37:0/3835200341 shutdown_connections 2024-09-19T05:57:03.276 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:02.426+0000 7fbb72364640 1 -- 172.21.15.37:0/3835200341 wait complete. 2024-09-19T05:57:03.276 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:02.427+0000 7fbb72364640 1 Processor -- start 2024-09-19T05:57:03.276 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:02.427+0000 7fbb72364640 1 -- start start 2024-09-19T05:57:03.277 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:02.427+0000 7fbb72364640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb6c07de00 0x7fbb6c19d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:57:03.277 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:02.427+0000 7fbb72364640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbb6c10db40 con 0x7fbb6c07de00 2024-09-19T05:57:03.277 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:02.427+0000 7fbb6bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb6c07de00 0x7fbb6c19d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:57:03.277 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:02.427+0000 7fbb6bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb6c07de00 0x7fbb6c19d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34936/0 (socket says 172.21.15.37:34936) 2024-09-19T05:57:03.277 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:02.427+0000 7fbb6bfff640 1 -- 172.21.15.37:0/2264669795 learned_addr learned my addr 172.21.15.37:0/2264669795 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T05:57:03.277 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:02.428+0000 7fbb6bfff640 1 -- 172.21.15.37:0/2264669795 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb6c19dbf0 con 0x7fbb6c07de00 2024-09-19T05:57:03.277 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:02.428+0000 7fbb6bfff640 1 --2- 172.21.15.37:0/2264669795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb6c07de00 0x7fbb6c19d6b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c0097f0 tx=0x7fbb5c030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:57:03.277 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:02.428+0000 7fbb697fa640 1 -- 172.21.15.37:0/2264669795 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb5c037040 con 0x7fbb6c07de00 2024-09-19T05:57:03.277 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:02.428+0000 7fbb697fa640 1 -- 172.21.15.37:0/2264669795 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbb5c040070 con 0x7fbb6c07de00 2024-09-19T05:57:03.277 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:02.428+0000 7fbb72364640 1 -- 172.21.15.37:0/2264669795 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb6c19de80 con 0x7fbb6c07de00 2024-09-19T05:57:03.277 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:02.428+0000 7fbb72364640 1 -- 172.21.15.37:0/2264669795 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb6c1a0b70 con 0x7fbb6c07de00 2024-09-19T05:57:03.277 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:02.428+0000 7fbb697fa640 1 -- 172.21.15.37:0/2264669795 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb5c03a390 con 0x7fbb6c07de00 2024-09-19T05:57:03.277 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:02.429+0000 7fbb697fa640 1 -- 172.21.15.37:0/2264669795 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fbb5c03a5e0 con 0x7fbb6c07de00 2024-09-19T05:57:03.278 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:02.429+0000 7fbb72364640 1 -- 172.21.15.37:0/2264669795 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb6c07c330 con 0x7fbb6c07de00 2024-09-19T05:57:03.278 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:02.429+0000 7fbb697fa640 1 --2- 172.21.15.37:0/2264669795 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7fbb54039200 0x7fbb5403b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:57:03.278 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:02.429+0000 7fbb697fa640 1 -- 172.21.15.37:0/2264669795 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fbb5c06c820 con 0x7fbb6c07de00 2024-09-19T05:57:03.278 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:02.429+0000 7fbb6b7fe640 1 --2- 172.21.15.37:0/2264669795 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7fbb54039200 0x7fbb5403b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:57:03.278 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:02.430+0000 7fbb6b7fe640 1 --2- 172.21.15.37:0/2264669795 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7fbb54039200 0x7fbb5403b6c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fbb600098c0 tx=0x7fbb60006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:57:03.278 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:02.434+0000 7fbb697fa640 1 -- 172.21.15.37:0/2264669795 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbb5c042310 con 0x7fbb6c07de00 2024-09-19T05:57:03.278 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:02.626+0000 7fbb72364640 1 -- 172.21.15.37:0/2264669795 --> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7fbb6c103f80 con 0x7fbb54039200 2024-09-19T05:57:03.278 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:02.631+0000 7fbb697fa640 1 -- 172.21.15.37:0/2264669795 <== mgr.14116 v2:172.21.15.37:6800/133577710 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fbb6c103f80 con 0x7fbb54039200 2024-09-19T05:57:03.278 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:02.633+0000 7fbb72364640 1 -- 172.21.15.37:0/2264669795 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7fbb54039200 msgr2=0x7fbb5403b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:57:03.278 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:02.633+0000 7fbb72364640 1 --2- 172.21.15.37:0/2264669795 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7fbb54039200 0x7fbb5403b6c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fbb600098c0 tx=0x7fbb60006db0 comp rx=0 tx=0).stop 2024-09-19T05:57:03.278 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:02.633+0000 7fbb72364640 1 -- 172.21.15.37:0/2264669795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb6c07de00 msgr2=0x7fbb6c19d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:57:03.278 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:02.633+0000 7fbb72364640 1 --2- 172.21.15.37:0/2264669795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb6c07de00 0x7fbb6c19d6b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c0097f0 tx=0x7fbb5c030d80 comp rx=0 tx=0).stop 2024-09-19T05:57:03.278 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:02.633+0000 7fbb72364640 1 -- 172.21.15.37:0/2264669795 shutdown_connections 2024-09-19T05:57:03.278 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:02.633+0000 7fbb72364640 1 --2- 172.21.15.37:0/2264669795 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7fbb54039200 0x7fbb5403b6c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:03.279 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:02.633+0000 7fbb72364640 1 --2- 172.21.15.37:0/2264669795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb6c07de00 0x7fbb6c19d6b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:03.279 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:02.633+0000 7fbb72364640 1 -- 172.21.15.37:0/2264669795 >> 172.21.15.37:0/2264669795 conn(0x7fbb6c102ce0 msgr2=0x7fbb6c103870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:57:03.279 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:02.633+0000 7fbb72364640 1 -- 172.21.15.37:0/2264669795 shutdown_connections 2024-09-19T05:57:03.279 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:02.633+0000 7fbb72364640 1 -- 172.21.15.37:0/2264669795 wait complete. 2024-09-19T05:57:03.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:03 smithi037 ceph-mon[31211]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:57:03.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:03 smithi037 ceph-mon[31211]: Saving service mgr spec with placement count:2 2024-09-19T05:57:03.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:03 smithi037 ceph-mon[31211]: from='mgr.14116 172.21.15.37:0/3995008439' entity='mgr.x' 2024-09-19T05:57:04.971 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:04.072+0000 7f157b609640 1 Processor -- start 2024-09-19T05:57:04.971 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:04.072+0000 7f157b609640 1 -- start start 2024-09-19T05:57:04.972 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:04.072+0000 7f157b609640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1574107fb0 0x7f157410a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:57:04.972 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:04.072+0000 7f157b609640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f157407be00 con 0x7f1574107fb0 2024-09-19T05:57:04.972 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:04.072+0000 7f15793a5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1574107fb0 0x7f157410a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:57:04.972 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:04.072+0000 7f15793a5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1574107fb0 0x7f157410a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46660/0 (socket says 172.21.15.37:46660) 2024-09-19T05:57:04.972 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:04.072+0000 7f15793a5640 1 -- 172.21.15.37:0/772200756 learned_addr learned my addr 172.21.15.37:0/772200756 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T05:57:04.972 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:04.072+0000 7f15793a5640 1 -- 172.21.15.37:0/772200756 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f157410a8e0 con 0x7f1574107fb0 2024-09-19T05:57:04.972 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:04.073+0000 7f15793a5640 1 --2- 172.21.15.37:0/772200756 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1574107fb0 0x7f157410a3a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1570009820 tx=0x7f157002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2daaae400a81d0a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:57:04.972 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:04.073+0000 7f156bfff640 1 -- 172.21.15.37:0/772200756 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1570037070 con 0x7f1574107fb0 2024-09-19T05:57:04.972 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:04.073+0000 7f156bfff640 1 -- 172.21.15.37:0/772200756 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1570032900 con 0x7f1574107fb0 2024-09-19T05:57:04.972 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:04.073+0000 7f156bfff640 1 -- 172.21.15.37:0/772200756 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1570030850 con 0x7f1574107fb0 2024-09-19T05:57:04.972 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:04.074+0000 7f157b609640 1 -- 172.21.15.37:0/772200756 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1574107fb0 msgr2=0x7f157410a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:57:04.972 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:04.074+0000 7f157b609640 1 --2- 172.21.15.37:0/772200756 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1574107fb0 0x7f157410a3a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1570009820 tx=0x7f157002a270 comp rx=0 tx=0).stop 2024-09-19T05:57:04.972 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:04.074+0000 7f157b609640 1 -- 172.21.15.37:0/772200756 shutdown_connections 2024-09-19T05:57:04.973 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:04.074+0000 7f157b609640 1 --2- 172.21.15.37:0/772200756 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1574107fb0 0x7f157410a3a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:04.973 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:04.074+0000 7f157b609640 1 -- 172.21.15.37:0/772200756 >> 172.21.15.37:0/772200756 conn(0x7f1574101b90 msgr2=0x7f1574103fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:57:04.973 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:04.074+0000 7f157b609640 1 -- 172.21.15.37:0/772200756 shutdown_connections 2024-09-19T05:57:04.973 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:04.074+0000 7f157b609640 1 -- 172.21.15.37:0/772200756 wait complete. 2024-09-19T05:57:04.973 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:04.075+0000 7f157b609640 1 Processor -- start 2024-09-19T05:57:04.973 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:04.075+0000 7f157b609640 1 -- start start 2024-09-19T05:57:04.973 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:04.075+0000 7f157b609640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1574107fb0 0x7f157419b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:57:04.973 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:04.075+0000 7f157b609640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f157410b8c0 con 0x7f1574107fb0 2024-09-19T05:57:04.973 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:04.075+0000 7f15793a5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1574107fb0 0x7f157419b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:57:04.973 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:04.075+0000 7f15793a5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1574107fb0 0x7f157419b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46670/0 (socket says 172.21.15.37:46670) 2024-09-19T05:57:04.973 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:04.075+0000 7f15793a5640 1 -- 172.21.15.37:0/3179510649 learned_addr learned my addr 172.21.15.37:0/3179510649 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T05:57:04.973 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:04.075+0000 7f15793a5640 1 -- 172.21.15.37:0/3179510649 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f157419b9e0 con 0x7f1574107fb0 2024-09-19T05:57:04.973 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:04.075+0000 7f15793a5640 1 --2- 172.21.15.37:0/3179510649 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1574107fb0 0x7f157419b4a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1570032ce0 tx=0x7f1570032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:57:04.973 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:04.076+0000 7f156a7fc640 1 -- 172.21.15.37:0/3179510649 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1570042070 con 0x7f1574107fb0 2024-09-19T05:57:04.974 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:04.076+0000 7f156a7fc640 1 -- 172.21.15.37:0/3179510649 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f15700308c0 con 0x7f1574107fb0 2024-09-19T05:57:04.974 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:04.076+0000 7f156a7fc640 1 -- 172.21.15.37:0/3179510649 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1570037040 con 0x7f1574107fb0 2024-09-19T05:57:04.974 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:04.076+0000 7f157b609640 1 -- 172.21.15.37:0/3179510649 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f157419bc70 con 0x7f1574107fb0 2024-09-19T05:57:04.974 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:04.076+0000 7f157b609640 1 -- 172.21.15.37:0/3179510649 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f157419e960 con 0x7f1574107fb0 2024-09-19T05:57:04.974 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:04.077+0000 7f156a7fc640 1 -- 172.21.15.37:0/3179510649 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f1570045070 con 0x7f1574107fb0 2024-09-19T05:57:04.974 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:04.077+0000 7f157b609640 1 -- 172.21.15.37:0/3179510649 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1574108410 con 0x7f1574107fb0 2024-09-19T05:57:04.974 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:04.077+0000 7f156a7fc640 1 --2- 172.21.15.37:0/3179510649 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7f1560039200 0x7f156003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:57:04.974 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:04.077+0000 7f156a7fc640 1 -- 172.21.15.37:0/3179510649 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f157006c2b0 con 0x7f1574107fb0 2024-09-19T05:57:04.974 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:04.077+0000 7f1578ba4640 1 --2- 172.21.15.37:0/3179510649 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7f1560039200 0x7f156003b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:57:04.974 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:04.078+0000 7f1578ba4640 1 --2- 172.21.15.37:0/3179510649 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7f1560039200 0x7f156003b6c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f15640098c0 tx=0x7f1564006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:57:04.974 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:04.082+0000 7f156a7fc640 1 -- 172.21.15.37:0/3179510649 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f157004b170 con 0x7f1574107fb0 2024-09-19T05:57:04.974 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:04.258+0000 7f157b609640 1 -- 172.21.15.37:0/3179510649 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f157419efe0 con 0x7f1574107fb0 2024-09-19T05:57:04.974 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:04.260+0000 7f156a7fc640 1 -- 172.21.15.37:0/3179510649 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v6)=0 v6) ==== 142+0+0 (secure 0 0 0) 0x7f157003c780 con 0x7f1574107fb0 2024-09-19T05:57:04.974 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:04.262+0000 7f157b609640 1 -- 172.21.15.37:0/3179510649 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7f1560039200 msgr2=0x7f156003b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:57:04.975 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:04.262+0000 7f157b609640 1 --2- 172.21.15.37:0/3179510649 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7f1560039200 0x7f156003b6c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f15640098c0 tx=0x7f1564006db0 comp rx=0 tx=0).stop 2024-09-19T05:57:04.975 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:04.262+0000 7f157b609640 1 -- 172.21.15.37:0/3179510649 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1574107fb0 msgr2=0x7f157419b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:57:04.975 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:04.262+0000 7f157b609640 1 --2- 172.21.15.37:0/3179510649 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1574107fb0 0x7f157419b4a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1570032ce0 tx=0x7f1570032d10 comp rx=0 tx=0).stop 2024-09-19T05:57:04.975 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:04.262+0000 7f157b609640 1 -- 172.21.15.37:0/3179510649 shutdown_connections 2024-09-19T05:57:04.975 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:04.262+0000 7f157b609640 1 --2- 172.21.15.37:0/3179510649 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7f1560039200 0x7f156003b6c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:04.975 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:04.262+0000 7f157b609640 1 --2- 172.21.15.37:0/3179510649 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1574107fb0 0x7f157419b4a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:04.975 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:04.262+0000 7f157b609640 1 -- 172.21.15.37:0/3179510649 >> 172.21.15.37:0/3179510649 conn(0x7f1574101b90 msgr2=0x7f1574102740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:57:04.975 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:04.263+0000 7f157b609640 1 -- 172.21.15.37:0/3179510649 shutdown_connections 2024-09-19T05:57:04.975 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:04.263+0000 7f157b609640 1 -- 172.21.15.37:0/3179510649 wait complete. 2024-09-19T05:57:05.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:05 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/3179510649' entity='client.admin' 2024-09-19T05:57:05.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:05 smithi037 ceph-mon[31211]: from='mgr.14116 172.21.15.37:0/3995008439' entity='mgr.x' 2024-09-19T05:57:06.158 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:05.387+0000 7f5e4519d640 1 Processor -- start 2024-09-19T05:57:06.159 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:05.387+0000 7f5e4519d640 1 -- start start 2024-09-19T05:57:06.159 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:05.387+0000 7f5e4519d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e401052a0 0x7f5e401056a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:57:06.159 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:05.387+0000 7f5e4519d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5e40105c70 con 0x7f5e401052a0 2024-09-19T05:57:06.159 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:05.387+0000 7f5e3ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e401052a0 0x7f5e401056a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:57:06.159 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:05.387+0000 7f5e3ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e401052a0 0x7f5e401056a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46682/0 (socket says 172.21.15.37:46682) 2024-09-19T05:57:06.159 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:05.387+0000 7f5e3ffff640 1 -- 172.21.15.37:0/1236688735 learned_addr learned my addr 172.21.15.37:0/1236688735 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T05:57:06.159 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:05.388+0000 7f5e3ffff640 1 -- 172.21.15.37:0/1236688735 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e40106320 con 0x7f5e401052a0 2024-09-19T05:57:06.159 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:05.388+0000 7f5e3ffff640 1 --2- 172.21.15.37:0/1236688735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e401052a0 0x7f5e401056a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5e30009820 tx=0x7f5e3002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83fb72805248ebec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:57:06.159 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:05.388+0000 7f5e3effd640 1 -- 172.21.15.37:0/1236688735 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e30037070 con 0x7f5e401052a0 2024-09-19T05:57:06.159 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:05.388+0000 7f5e3effd640 1 -- 172.21.15.37:0/1236688735 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e30032920 con 0x7f5e401052a0 2024-09-19T05:57:06.159 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:05.388+0000 7f5e3effd640 1 -- 172.21.15.37:0/1236688735 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e30030810 con 0x7f5e401052a0 2024-09-19T05:57:06.160 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:05.389+0000 7f5e4519d640 1 -- 172.21.15.37:0/1236688735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e401052a0 msgr2=0x7f5e401056a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:57:06.160 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:05.389+0000 7f5e4519d640 1 --2- 172.21.15.37:0/1236688735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e401052a0 0x7f5e401056a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5e30009820 tx=0x7f5e3002a270 comp rx=0 tx=0).stop 2024-09-19T05:57:06.160 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:05.389+0000 7f5e4519d640 1 -- 172.21.15.37:0/1236688735 shutdown_connections 2024-09-19T05:57:06.160 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:05.389+0000 7f5e4519d640 1 --2- 172.21.15.37:0/1236688735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e401052a0 0x7f5e401056a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:06.160 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:05.389+0000 7f5e4519d640 1 -- 172.21.15.37:0/1236688735 >> 172.21.15.37:0/1236688735 conn(0x7f5e40100d60 msgr2=0x7f5e40103180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:57:06.160 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:05.389+0000 7f5e4519d640 1 -- 172.21.15.37:0/1236688735 shutdown_connections 2024-09-19T05:57:06.160 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:05.389+0000 7f5e4519d640 1 -- 172.21.15.37:0/1236688735 wait complete. 2024-09-19T05:57:06.160 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:05.390+0000 7f5e4519d640 1 Processor -- start 2024-09-19T05:57:06.160 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:05.390+0000 7f5e4519d640 1 -- start start 2024-09-19T05:57:06.160 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:05.390+0000 7f5e4519d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e401052a0 0x7f5e4019d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:57:06.161 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:05.390+0000 7f5e4519d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5e401076e0 con 0x7f5e401052a0 2024-09-19T05:57:06.161 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:05.390+0000 7f5e3ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e401052a0 0x7f5e4019d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:57:06.161 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:05.390+0000 7f5e3ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e401052a0 0x7f5e4019d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46696/0 (socket says 172.21.15.37:46696) 2024-09-19T05:57:06.161 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:05.390+0000 7f5e3ffff640 1 -- 172.21.15.37:0/1617021955 learned_addr learned my addr 172.21.15.37:0/1617021955 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T05:57:06.161 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:05.390+0000 7f5e3ffff640 1 -- 172.21.15.37:0/1617021955 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e4019dac0 con 0x7f5e401052a0 2024-09-19T05:57:06.161 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:05.391+0000 7f5e3ffff640 1 --2- 172.21.15.37:0/1617021955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e401052a0 0x7f5e4019d580 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5e30030420 tx=0x7f5e30032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:57:06.161 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:05.391+0000 7f5e3d7fa640 1 -- 172.21.15.37:0/1617021955 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e30037040 con 0x7f5e401052a0 2024-09-19T05:57:06.161 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:05.391+0000 7f5e3d7fa640 1 -- 172.21.15.37:0/1617021955 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e30040070 con 0x7f5e401052a0 2024-09-19T05:57:06.161 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:05.391+0000 7f5e4519d640 1 -- 172.21.15.37:0/1617021955 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e4019dd50 con 0x7f5e401052a0 2024-09-19T05:57:06.161 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:05.391+0000 7f5e3d7fa640 1 -- 172.21.15.37:0/1617021955 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e3003a6e0 con 0x7f5e401052a0 2024-09-19T05:57:06.161 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:05.391+0000 7f5e4519d640 1 -- 172.21.15.37:0/1617021955 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e401a0a40 con 0x7f5e401052a0 2024-09-19T05:57:06.161 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:05.392+0000 7f5e3d7fa640 1 -- 172.21.15.37:0/1617021955 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f5e3003a990 con 0x7f5e401052a0 2024-09-19T05:57:06.161 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:05.392+0000 7f5e3d7fa640 1 --2- 172.21.15.37:0/1617021955 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7f5e28039200 0x7f5e2803b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:57:06.162 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:05.392+0000 7f5e3d7fa640 1 -- 172.21.15.37:0/1617021955 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f5e3006c890 con 0x7f5e401052a0 2024-09-19T05:57:06.162 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:05.392+0000 7f5e4519d640 1 -- 172.21.15.37:0/1617021955 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e401056a0 con 0x7f5e401052a0 2024-09-19T05:57:06.162 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:05.392+0000 7f5e3f7fe640 1 --2- 172.21.15.37:0/1617021955 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7f5e28039200 0x7f5e2803b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:57:06.162 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:05.392+0000 7f5e3f7fe640 1 --2- 172.21.15.37:0/1617021955 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7f5e28039200 0x7f5e2803b6c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5e340098c0 tx=0x7f5e34006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:57:06.162 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:05.397+0000 7f5e3d7fa640 1 -- 172.21.15.37:0/1617021955 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5e30044c70 con 0x7f5e401052a0 2024-09-19T05:57:06.162 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:05.583+0000 7f5e4519d640 1 -- 172.21.15.37:0/1617021955 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f5e4002d980 con 0x7f5e401052a0 2024-09-19T05:57:06.162 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:05.586+0000 7f5e3d7fa640 1 -- 172.21.15.37:0/1617021955 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7f5e30042e30 con 0x7f5e401052a0 2024-09-19T05:57:06.162 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:05.588+0000 7f5e4519d640 1 -- 172.21.15.37:0/1617021955 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7f5e28039200 msgr2=0x7f5e2803b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:57:06.162 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:05.588+0000 7f5e4519d640 1 --2- 172.21.15.37:0/1617021955 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7f5e28039200 0x7f5e2803b6c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5e340098c0 tx=0x7f5e34006db0 comp rx=0 tx=0).stop 2024-09-19T05:57:06.162 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:05.588+0000 7f5e4519d640 1 -- 172.21.15.37:0/1617021955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e401052a0 msgr2=0x7f5e4019d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:57:06.162 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:05.588+0000 7f5e4519d640 1 --2- 172.21.15.37:0/1617021955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e401052a0 0x7f5e4019d580 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5e30030420 tx=0x7f5e30032670 comp rx=0 tx=0).stop 2024-09-19T05:57:06.162 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:05.588+0000 7f5e4519d640 1 -- 172.21.15.37:0/1617021955 shutdown_connections 2024-09-19T05:57:06.162 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:05.588+0000 7f5e4519d640 1 --2- 172.21.15.37:0/1617021955 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7f5e28039200 0x7f5e2803b6c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:06.163 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:05.588+0000 7f5e4519d640 1 --2- 172.21.15.37:0/1617021955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e401052a0 0x7f5e4019d580 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:06.163 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:05.588+0000 7f5e4519d640 1 -- 172.21.15.37:0/1617021955 >> 172.21.15.37:0/1617021955 conn(0x7f5e40100d60 msgr2=0x7f5e40193bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:57:06.163 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:05.589+0000 7f5e4519d640 1 -- 172.21.15.37:0/1617021955 shutdown_connections 2024-09-19T05:57:06.163 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:05.589+0000 7f5e4519d640 1 -- 172.21.15.37:0/1617021955 wait complete. 2024-09-19T05:57:06.163 INFO:teuthology.orchestra.run.smithi037.stdout:Enabling the dashboard module... 2024-09-19T05:57:06.792 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:06 smithi037 ceph-mon[31211]: from='mgr.14116 172.21.15.37:0/3995008439' entity='mgr.x' 2024-09-19T05:57:06.792 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:06 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/1617021955' entity='client.admin' 2024-09-19T05:57:07.811 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:07 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/2150695460' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-19T05:57:07.811 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:07 smithi037 ceph-mon[31211]: from='mgr.14116 172.21.15.37:0/3995008439' entity='mgr.x' 2024-09-19T05:57:07.811 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:57:07 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: ignoring --setuser ceph since I am not root 2024-09-19T05:57:07.811 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:57:07 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: ignoring --setgroup ceph since I am not root 2024-09-19T05:57:07.811 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:57:07 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:57:07.644+0000 7fafa95cd040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T05:57:07.811 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:57:07 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:57:07.704+0000 7fafa95cd040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T05:57:08.070 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:57:07 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:57:07.860+0000 7fafa95cd040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T05:57:08.070 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:57:07 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:57:07.929+0000 7fafa95cd040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T05:57:08.076 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:06.552+0000 7f8ee539c640 1 Processor -- start 2024-09-19T05:57:08.077 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:06.552+0000 7f8ee539c640 1 -- start start 2024-09-19T05:57:08.077 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:06.553+0000 7f8ee539c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ee0107fb0 0x7f8ee010a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:57:08.077 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:06.553+0000 7f8ee539c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee007be00 con 0x7f8ee0107fb0 2024-09-19T05:57:08.077 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:06.553+0000 7f8edeffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ee0107fb0 0x7f8ee010a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:57:08.077 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:06.553+0000 7f8edeffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ee0107fb0 0x7f8ee010a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46702/0 (socket says 172.21.15.37:46702) 2024-09-19T05:57:08.077 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:06.553+0000 7f8edeffd640 1 -- 172.21.15.37:0/1273060223 learned_addr learned my addr 172.21.15.37:0/1273060223 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T05:57:08.077 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:06.553+0000 7f8edeffd640 1 -- 172.21.15.37:0/1273060223 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ee010a8e0 con 0x7f8ee0107fb0 2024-09-19T05:57:08.077 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:06.554+0000 7f8edeffd640 1 --2- 172.21.15.37:0/1273060223 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ee0107fb0 0x7f8ee010a3a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8ed0009820 tx=0x7f8ed002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6c335a718e4af85 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:57:08.077 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:06.554+0000 7f8ede7fc640 1 -- 172.21.15.37:0/1273060223 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ed0037070 con 0x7f8ee0107fb0 2024-09-19T05:57:08.077 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:06.554+0000 7f8ede7fc640 1 -- 172.21.15.37:0/1273060223 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ed0032920 con 0x7f8ee0107fb0 2024-09-19T05:57:08.077 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:06.554+0000 7f8ede7fc640 1 -- 172.21.15.37:0/1273060223 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ed0030810 con 0x7f8ee0107fb0 2024-09-19T05:57:08.078 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:06.554+0000 7f8ee539c640 1 -- 172.21.15.37:0/1273060223 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ee0107fb0 msgr2=0x7f8ee010a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:57:08.078 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:06.554+0000 7f8ee539c640 1 --2- 172.21.15.37:0/1273060223 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ee0107fb0 0x7f8ee010a3a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8ed0009820 tx=0x7f8ed002a270 comp rx=0 tx=0).stop 2024-09-19T05:57:08.078 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:06.554+0000 7f8ee539c640 1 -- 172.21.15.37:0/1273060223 shutdown_connections 2024-09-19T05:57:08.078 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:06.554+0000 7f8ee539c640 1 --2- 172.21.15.37:0/1273060223 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ee0107fb0 0x7f8ee010a3a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:08.078 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:06.554+0000 7f8ee539c640 1 -- 172.21.15.37:0/1273060223 >> 172.21.15.37:0/1273060223 conn(0x7f8ee0101b90 msgr2=0x7f8ee0103fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:57:08.078 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:06.555+0000 7f8ee539c640 1 -- 172.21.15.37:0/1273060223 shutdown_connections 2024-09-19T05:57:08.078 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:06.555+0000 7f8ee539c640 1 -- 172.21.15.37:0/1273060223 wait complete. 2024-09-19T05:57:08.078 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:06.555+0000 7f8ee539c640 1 Processor -- start 2024-09-19T05:57:08.078 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:06.555+0000 7f8ee539c640 1 -- start start 2024-09-19T05:57:08.078 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:06.555+0000 7f8ee539c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ee0107fb0 0x7f8ee019b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:57:08.078 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:06.555+0000 7f8ee539c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee010b900 con 0x7f8ee0107fb0 2024-09-19T05:57:08.078 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:06.556+0000 7f8edeffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ee0107fb0 0x7f8ee019b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:57:08.078 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:06.556+0000 7f8edeffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ee0107fb0 0x7f8ee019b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46716/0 (socket says 172.21.15.37:46716) 2024-09-19T05:57:08.078 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:06.556+0000 7f8edeffd640 1 -- 172.21.15.37:0/2150695460 learned_addr learned my addr 172.21.15.37:0/2150695460 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T05:57:08.079 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:06.556+0000 7f8edeffd640 1 -- 172.21.15.37:0/2150695460 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ee019ba00 con 0x7f8ee0107fb0 2024-09-19T05:57:08.079 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:06.556+0000 7f8edeffd640 1 --2- 172.21.15.37:0/2150695460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ee0107fb0 0x7f8ee019b4c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8ed0030380 tx=0x7f8ed0032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:57:08.079 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:06.556+0000 7f8edcff9640 1 -- 172.21.15.37:0/2150695460 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ed0037040 con 0x7f8ee0107fb0 2024-09-19T05:57:08.079 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:06.556+0000 7f8ee539c640 1 -- 172.21.15.37:0/2150695460 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ee019bc90 con 0x7f8ee0107fb0 2024-09-19T05:57:08.079 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:06.556+0000 7f8edcff9640 1 -- 172.21.15.37:0/2150695460 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ed0040070 con 0x7f8ee0107fb0 2024-09-19T05:57:08.079 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:06.556+0000 7f8edcff9640 1 -- 172.21.15.37:0/2150695460 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ed003a7b0 con 0x7f8ee0107fb0 2024-09-19T05:57:08.079 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:06.556+0000 7f8ee539c640 1 -- 172.21.15.37:0/2150695460 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ee019e980 con 0x7f8ee0107fb0 2024-09-19T05:57:08.079 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:06.557+0000 7f8edcff9640 1 -- 172.21.15.37:0/2150695460 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f8ed003b420 con 0x7f8ee0107fb0 2024-09-19T05:57:08.079 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:06.557+0000 7f8ee539c640 1 -- 172.21.15.37:0/2150695460 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ee0108410 con 0x7f8ee0107fb0 2024-09-19T05:57:08.079 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:06.557+0000 7f8edcff9640 1 --2- 172.21.15.37:0/2150695460 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7f8ecc0391b0 0x7f8ecc03b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:57:08.079 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:06.557+0000 7f8edcff9640 1 -- 172.21.15.37:0/2150695460 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f8ed006c8e0 con 0x7f8ee0107fb0 2024-09-19T05:57:08.079 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:06.557+0000 7f8ed67fc640 1 --2- 172.21.15.37:0/2150695460 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7f8ecc0391b0 0x7f8ecc03b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:57:08.079 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:06.558+0000 7f8ed67fc640 1 --2- 172.21.15.37:0/2150695460 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7f8ecc0391b0 0x7f8ecc03b670 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8ec80098c0 tx=0x7f8ec8006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:57:08.080 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:06.562+0000 7f8edcff9640 1 -- 172.21.15.37:0/2150695460 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8ed0043360 con 0x7f8ee0107fb0 2024-09-19T05:57:08.080 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:06.790+0000 7f8ee539c640 1 -- 172.21.15.37:0/2150695460 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7f8ee019ef70 con 0x7f8ee0107fb0 2024-09-19T05:57:08.080 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:07.486+0000 7f8edcff9640 1 -- 172.21.15.37:0/2150695460 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7f8ed003b810 con 0x7f8ee0107fb0 2024-09-19T05:57:08.080 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:07.487+0000 7f8edcff9640 1 -- 172.21.15.37:0/2150695460 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7f8ed00313a0 con 0x7f8ee0107fb0 2024-09-19T05:57:08.080 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:07.489+0000 7f8ee539c640 1 -- 172.21.15.37:0/2150695460 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7f8ecc0391b0 msgr2=0x7f8ecc03b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:57:08.080 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:07.489+0000 7f8ee539c640 1 --2- 172.21.15.37:0/2150695460 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7f8ecc0391b0 0x7f8ecc03b670 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8ec80098c0 tx=0x7f8ec8006db0 comp rx=0 tx=0).stop 2024-09-19T05:57:08.080 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:07.489+0000 7f8ee539c640 1 -- 172.21.15.37:0/2150695460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ee0107fb0 msgr2=0x7f8ee019b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:57:08.080 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:07.489+0000 7f8ee539c640 1 --2- 172.21.15.37:0/2150695460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ee0107fb0 0x7f8ee019b4c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8ed0030380 tx=0x7f8ed0032670 comp rx=0 tx=0).stop 2024-09-19T05:57:08.080 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:07.489+0000 7f8ee539c640 1 -- 172.21.15.37:0/2150695460 shutdown_connections 2024-09-19T05:57:08.080 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:07.489+0000 7f8ee539c640 1 --2- 172.21.15.37:0/2150695460 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7f8ecc0391b0 0x7f8ecc03b670 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:08.080 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:07.489+0000 7f8ee539c640 1 --2- 172.21.15.37:0/2150695460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ee0107fb0 0x7f8ee019b4c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:08.080 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:07.489+0000 7f8ee539c640 1 -- 172.21.15.37:0/2150695460 >> 172.21.15.37:0/2150695460 conn(0x7f8ee0101b90 msgr2=0x7f8ee0102740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:57:08.080 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:07.489+0000 7f8ee539c640 1 -- 172.21.15.37:0/2150695460 shutdown_connections 2024-09-19T05:57:08.080 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:07.489+0000 7f8ee539c640 1 -- 172.21.15.37:0/2150695460 wait complete. 2024-09-19T05:57:08.323 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:57:08 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:57:08.084+0000 7fafa95cd040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T05:57:08.324 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:57:08 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:57:08.239+0000 7fafa95cd040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T05:57:08.650 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:08 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/2150695460' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-19T05:57:08.650 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:08 smithi037 ceph-mon[31211]: mgrmap e9: x(active, since 18s) 2024-09-19T05:57:08.650 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:57:08 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:57:08.583+0000 7fafa95cd040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T05:57:08.650 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:57:08 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:57:08.647+0000 7fafa95cd040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T05:57:09.074 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:57:08 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:57:08.846+0000 7fafa95cd040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T05:57:09.376 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout { 2024-09-19T05:57:09.376 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-19T05:57:09.376 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T05:57:09.376 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-19T05:57:09.376 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-19T05:57:09.376 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout } 2024-09-19T05:57:09.377 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:08.529+0000 7f4108803640 1 Processor -- start 2024-09-19T05:57:09.377 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:08.529+0000 7f4108803640 1 -- start start 2024-09-19T05:57:09.377 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:08.530+0000 7f4108803640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4104107f50 0x7f410410a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:57:09.377 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:08.530+0000 7f4108803640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f410407be40 con 0x7f4104107f50 2024-09-19T05:57:09.377 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:08.530+0000 7f410259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4104107f50 0x7f410410a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:57:09.377 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:08.530+0000 7f410259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4104107f50 0x7f410410a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46746/0 (socket says 172.21.15.37:46746) 2024-09-19T05:57:09.377 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:08.530+0000 7f410259c640 1 -- 172.21.15.37:0/2159152470 learned_addr learned my addr 172.21.15.37:0/2159152470 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T05:57:09.377 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:08.531+0000 7f410259c640 1 -- 172.21.15.37:0/2159152470 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f410410a880 con 0x7f4104107f50 2024-09-19T05:57:09.377 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:08.531+0000 7f410259c640 1 --2- 172.21.15.37:0/2159152470 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4104107f50 0x7f410410a340 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f40f4009820 tx=0x7f40f402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8215e3d5cdec6d31 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:57:09.377 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:08.532+0000 7f410159a640 1 -- 172.21.15.37:0/2159152470 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40f4037070 con 0x7f4104107f50 2024-09-19T05:57:09.377 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:08.532+0000 7f410159a640 1 -- 172.21.15.37:0/2159152470 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40f4032920 con 0x7f4104107f50 2024-09-19T05:57:09.378 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:08.532+0000 7f410159a640 1 -- 172.21.15.37:0/2159152470 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40f4030810 con 0x7f4104107f50 2024-09-19T05:57:09.378 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:08.533+0000 7f4108803640 1 -- 172.21.15.37:0/2159152470 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4104107f50 msgr2=0x7f410410a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:57:09.378 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:08.533+0000 7f4108803640 1 --2- 172.21.15.37:0/2159152470 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4104107f50 0x7f410410a340 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f40f4009820 tx=0x7f40f402a270 comp rx=0 tx=0).stop 2024-09-19T05:57:09.378 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:08.533+0000 7f4108803640 1 -- 172.21.15.37:0/2159152470 shutdown_connections 2024-09-19T05:57:09.378 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:08.533+0000 7f4108803640 1 --2- 172.21.15.37:0/2159152470 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4104107f50 0x7f410410a340 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:09.378 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:08.533+0000 7f4108803640 1 -- 172.21.15.37:0/2159152470 >> 172.21.15.37:0/2159152470 conn(0x7f4104101b70 msgr2=0x7f4104103f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:57:09.378 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:08.533+0000 7f4108803640 1 -- 172.21.15.37:0/2159152470 shutdown_connections 2024-09-19T05:57:09.378 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:08.533+0000 7f4108803640 1 -- 172.21.15.37:0/2159152470 wait complete. 2024-09-19T05:57:09.378 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:08.534+0000 7f4108803640 1 Processor -- start 2024-09-19T05:57:09.378 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:08.534+0000 7f4108803640 1 -- start start 2024-09-19T05:57:09.378 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:08.534+0000 7f4108803640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4104107f50 0x7f410419b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:57:09.378 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:08.534+0000 7f4108803640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f410410b900 con 0x7f4104107f50 2024-09-19T05:57:09.378 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:08.534+0000 7f410259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4104107f50 0x7f410419b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:57:09.378 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:08.534+0000 7f410259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4104107f50 0x7f410419b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46760/0 (socket says 172.21.15.37:46760) 2024-09-19T05:57:09.379 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:08.534+0000 7f410259c640 1 -- 172.21.15.37:0/2639085354 learned_addr learned my addr 172.21.15.37:0/2639085354 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T05:57:09.379 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:08.534+0000 7f410259c640 1 -- 172.21.15.37:0/2639085354 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f410419ba30 con 0x7f4104107f50 2024-09-19T05:57:09.379 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:08.535+0000 7f410259c640 1 --2- 172.21.15.37:0/2639085354 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4104107f50 0x7f410419b4f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f40f4030380 tx=0x7f40f4032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:57:09.379 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:08.535+0000 7f40f37fe640 1 -- 172.21.15.37:0/2639085354 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40f4037040 con 0x7f4104107f50 2024-09-19T05:57:09.379 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:08.535+0000 7f4108803640 1 -- 172.21.15.37:0/2639085354 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f410419bcc0 con 0x7f4104107f50 2024-09-19T05:57:09.379 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:08.535+0000 7f40f37fe640 1 -- 172.21.15.37:0/2639085354 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40f4040070 con 0x7f4104107f50 2024-09-19T05:57:09.379 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:08.535+0000 7f40f37fe640 1 -- 172.21.15.37:0/2639085354 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40f403a7b0 con 0x7f4104107f50 2024-09-19T05:57:09.379 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:08.535+0000 7f4108803640 1 -- 172.21.15.37:0/2639085354 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f410419e9b0 con 0x7f4104107f50 2024-09-19T05:57:09.379 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:08.536+0000 7f4108803640 1 -- 172.21.15.37:0/2639085354 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41041083b0 con 0x7f4104107f50 2024-09-19T05:57:09.379 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:08.536+0000 7f40f37fe640 1 -- 172.21.15.37:0/2639085354 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7f40f403b420 con 0x7f4104107f50 2024-09-19T05:57:09.379 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:08.536+0000 7f40f37fe640 1 --2- 172.21.15.37:0/2639085354 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7f40ec039260 0x7f40ec03b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:57:09.379 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:08.536+0000 7f40f37fe640 1 -- 172.21.15.37:0/2639085354 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f40f406c8f0 con 0x7f4104107f50 2024-09-19T05:57:09.379 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:08.536+0000 7f4101d9b640 1 -- 172.21.15.37:0/2639085354 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7f40ec039260 msgr2=0x7f40ec03b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.37:6800/133577710 2024-09-19T05:57:09.380 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:08.536+0000 7f4101d9b640 1 --2- 172.21.15.37:0/2639085354 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7f40ec039260 0x7f40ec03b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:57:09.380 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:08.541+0000 7f40f37fe640 1 -- 172.21.15.37:0/2639085354 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f40f404a200 con 0x7f4104107f50 2024-09-19T05:57:09.380 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:08.737+0000 7f4101d9b640 1 -- 172.21.15.37:0/2639085354 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7f40ec039260 msgr2=0x7f40ec03b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.37:6800/133577710 2024-09-19T05:57:09.380 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:08.737+0000 7f4101d9b640 1 --2- 172.21.15.37:0/2639085354 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7f40ec039260 0x7f40ec03b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T05:57:09.380 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:08.765+0000 7f4108803640 1 -- 172.21.15.37:0/2639085354 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f410419efa0 con 0x7f4104107f50 2024-09-19T05:57:09.380 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:08.765+0000 7f40f37fe640 1 -- 172.21.15.37:0/2639085354 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f40f4031e80 con 0x7f4104107f50 2024-09-19T05:57:09.380 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:08.767+0000 7f4108803640 1 -- 172.21.15.37:0/2639085354 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7f40ec039260 msgr2=0x7f40ec03b720 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T05:57:09.380 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:08.767+0000 7f4108803640 1 --2- 172.21.15.37:0/2639085354 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7f40ec039260 0x7f40ec03b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:09.380 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:08.767+0000 7f4108803640 1 -- 172.21.15.37:0/2639085354 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4104107f50 msgr2=0x7f410419b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:57:09.380 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:08.767+0000 7f4108803640 1 --2- 172.21.15.37:0/2639085354 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4104107f50 0x7f410419b4f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f40f4030380 tx=0x7f40f4032670 comp rx=0 tx=0).stop 2024-09-19T05:57:09.380 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:08.767+0000 7f4108803640 1 -- 172.21.15.37:0/2639085354 shutdown_connections 2024-09-19T05:57:09.380 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:08.767+0000 7f4108803640 1 --2- 172.21.15.37:0/2639085354 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7f40ec039260 0x7f40ec03b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:09.380 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:08.767+0000 7f4108803640 1 --2- 172.21.15.37:0/2639085354 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4104107f50 0x7f410419b4f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:09.380 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:08.767+0000 7f4108803640 1 -- 172.21.15.37:0/2639085354 >> 172.21.15.37:0/2639085354 conn(0x7f4104101b70 msgr2=0x7f4104102740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:57:09.381 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:08.767+0000 7f4108803640 1 -- 172.21.15.37:0/2639085354 shutdown_connections 2024-09-19T05:57:09.381 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:08.767+0000 7f4108803640 1 -- 172.21.15.37:0/2639085354 wait complete. 2024-09-19T05:57:09.381 INFO:teuthology.orchestra.run.smithi037.stdout:Waiting for the mgr to restart... 2024-09-19T05:57:09.381 INFO:teuthology.orchestra.run.smithi037.stdout:Waiting for mgr epoch 9... 2024-09-19T05:57:09.671 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:09 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/2639085354' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-19T05:57:09.959 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:57:09 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:57:09.786+0000 7fafa95cd040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T05:57:09.959 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:57:09 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:57:09.857+0000 7fafa95cd040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T05:57:10.722 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:57:10 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:57:10.600+0000 7fafa95cd040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T05:57:11.073 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:57:10 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:57:10.720+0000 7fafa95cd040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T05:57:11.074 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:57:10 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:57:10.868+0000 7fafa95cd040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T05:57:11.074 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:57:10 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:57:10.932+0000 7fafa95cd040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T05:57:11.388 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:57:11 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:57:11.087+0000 7fafa95cd040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T05:57:11.388 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:57:11 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:57:11.158+0000 7fafa95cd040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T05:57:11.388 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:57:11 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:57:11.220+0000 7fafa95cd040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T05:57:11.388 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:57:11 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:57:11.385+0000 7fafa95cd040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T05:57:11.673 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:57:11 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:57:11.453+0000 7fafa95cd040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T05:57:11.673 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:57:11 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:57:11.522+0000 7fafa95cd040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T05:57:11.673 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:57:11 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:57:11.608+0000 7fafa95cd040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T05:57:11.673 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:57:11 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:57:11.670+0000 7fafa95cd040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T05:57:12.073 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:57:11 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:57:11.732+0000 7fafa95cd040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T05:57:12.811 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:57:12 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:57:12.558+0000 7fafa95cd040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T05:57:12.811 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:12 smithi037 ceph-mon[31211]: Active manager daemon x restarted 2024-09-19T05:57:12.811 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:12 smithi037 ceph-mon[31211]: Activating manager daemon x 2024-09-19T05:57:12.811 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:12 smithi037 ceph-mon[31211]: osdmap e3: 0 total, 0 up, 0 in 2024-09-19T05:57:12.811 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:12 smithi037 ceph-mon[31211]: mgrmap e10: x(active, starting, since 0.00351309s) 2024-09-19T05:57:12.811 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:12 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T05:57:12.811 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:12 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T05:57:12.812 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:12 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T05:57:12.812 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:12 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T05:57:12.812 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:12 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T05:57:12.812 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:12 smithi037 ceph-mon[31211]: Manager daemon x is now available 2024-09-19T05:57:12.812 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:12 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:57:12.812 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:12 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T05:57:12.812 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:12 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T05:57:14.513 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout { 2024-09-19T05:57:14.513 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-19T05:57:14.513 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-19T05:57:14.513 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout } 2024-09-19T05:57:14.513 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:09.750+0000 7fb87faf9640 1 Processor -- start 2024-09-19T05:57:14.513 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:09.750+0000 7fb87faf9640 1 -- start start 2024-09-19T05:57:14.513 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:09.750+0000 7fb87faf9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb878107f10 0x7fb87810a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:57:14.513 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:09.750+0000 7fb87faf9640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb87810a840 con 0x7fb878107f10 2024-09-19T05:57:14.514 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:09.751+0000 7fb87d895640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb878107f10 0x7fb87810a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:57:14.514 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:09.751+0000 7fb87d895640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb878107f10 0x7fb87810a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46772/0 (socket says 172.21.15.37:46772) 2024-09-19T05:57:14.514 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:09.751+0000 7fb87d895640 1 -- 172.21.15.37:0/3526137166 learned_addr learned my addr 172.21.15.37:0/3526137166 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T05:57:14.514 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:09.751+0000 7fb87d895640 1 -- 172.21.15.37:0/3526137166 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb87810a9c0 con 0x7fb878107f10 2024-09-19T05:57:14.514 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:09.752+0000 7fb87d895640 1 --2- 172.21.15.37:0/3526137166 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb878107f10 0x7fb87810a300 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb874009820 tx=0x7fb87402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcbafdb4bde4cab2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:57:14.514 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:09.752+0000 7fb87c893640 1 -- 172.21.15.37:0/3526137166 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb874037070 con 0x7fb878107f10 2024-09-19T05:57:14.514 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:09.752+0000 7fb87c893640 1 -- 172.21.15.37:0/3526137166 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb874032920 con 0x7fb878107f10 2024-09-19T05:57:14.514 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:09.752+0000 7fb87c893640 1 -- 172.21.15.37:0/3526137166 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb874030810 con 0x7fb878107f10 2024-09-19T05:57:14.514 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:09.753+0000 7fb87faf9640 1 -- 172.21.15.37:0/3526137166 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb878107f10 msgr2=0x7fb87810a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:57:14.514 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:09.753+0000 7fb87faf9640 1 --2- 172.21.15.37:0/3526137166 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb878107f10 0x7fb87810a300 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb874009820 tx=0x7fb87402a270 comp rx=0 tx=0).stop 2024-09-19T05:57:14.514 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:09.753+0000 7fb87faf9640 1 -- 172.21.15.37:0/3526137166 shutdown_connections 2024-09-19T05:57:14.514 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:09.753+0000 7fb87faf9640 1 --2- 172.21.15.37:0/3526137166 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb878107f10 0x7fb87810a300 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:14.514 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:09.753+0000 7fb87faf9640 1 -- 172.21.15.37:0/3526137166 >> 172.21.15.37:0/3526137166 conn(0x7fb878101af0 msgr2=0x7fb878103f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:57:14.515 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:09.753+0000 7fb87faf9640 1 -- 172.21.15.37:0/3526137166 shutdown_connections 2024-09-19T05:57:14.515 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:09.753+0000 7fb87faf9640 1 -- 172.21.15.37:0/3526137166 wait complete. 2024-09-19T05:57:14.515 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:09.754+0000 7fb87faf9640 1 Processor -- start 2024-09-19T05:57:14.515 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:09.754+0000 7fb87faf9640 1 -- start start 2024-09-19T05:57:14.515 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:09.754+0000 7fb87faf9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb878107f10 0x7fb87819b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:57:14.515 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:09.754+0000 7fb87faf9640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb87810b9e0 con 0x7fb878107f10 2024-09-19T05:57:14.515 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:09.754+0000 7fb87d895640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb878107f10 0x7fb87819b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:57:14.515 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:09.754+0000 7fb87d895640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb878107f10 0x7fb87819b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46788/0 (socket says 172.21.15.37:46788) 2024-09-19T05:57:14.515 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:09.754+0000 7fb87d895640 1 -- 172.21.15.37:0/852314945 learned_addr learned my addr 172.21.15.37:0/852314945 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T05:57:14.515 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:09.754+0000 7fb87d895640 1 -- 172.21.15.37:0/852314945 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb87819bb10 con 0x7fb878107f10 2024-09-19T05:57:14.515 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:09.754+0000 7fb87d895640 1 --2- 172.21.15.37:0/852314945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb878107f10 0x7fb87819b5d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb874030380 tx=0x7fb874032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:57:14.515 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:09.754+0000 7fb86affd640 1 -- 172.21.15.37:0/852314945 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb874037040 con 0x7fb878107f10 2024-09-19T05:57:14.516 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:09.755+0000 7fb86affd640 1 -- 172.21.15.37:0/852314945 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb874040070 con 0x7fb878107f10 2024-09-19T05:57:14.516 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:09.755+0000 7fb87faf9640 1 -- 172.21.15.37:0/852314945 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb87819bda0 con 0x7fb878107f10 2024-09-19T05:57:14.516 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:09.755+0000 7fb86affd640 1 -- 172.21.15.37:0/852314945 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb87403a7b0 con 0x7fb878107f10 2024-09-19T05:57:14.516 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:09.755+0000 7fb87faf9640 1 -- 172.21.15.37:0/852314945 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb87819ea90 con 0x7fb878107f10 2024-09-19T05:57:14.516 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:09.755+0000 7fb86affd640 1 -- 172.21.15.37:0/852314945 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7fb87403aa30 con 0x7fb878107f10 2024-09-19T05:57:14.516 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:09.756+0000 7fb86affd640 1 --2- 172.21.15.37:0/852314945 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7fb864039200 0x7fb86403b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:57:14.516 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:09.756+0000 7fb86affd640 1 -- 172.21.15.37:0/852314945 --> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fb86403bdd0 con 0x7fb864039200 2024-09-19T05:57:14.516 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:09.756+0000 7fb87d094640 1 -- 172.21.15.37:0/852314945 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7fb864039200 msgr2=0x7fb86403b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.37:6800/133577710 2024-09-19T05:57:14.516 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:09.756+0000 7fb86affd640 1 -- 172.21.15.37:0/852314945 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fb87406c930 con 0x7fb878107f10 2024-09-19T05:57:14.516 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:09.756+0000 7fb87d094640 1 --2- 172.21.15.37:0/852314945 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7fb864039200 0x7fb86403b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:57:14.516 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:09.957+0000 7fb87d094640 1 -- 172.21.15.37:0/852314945 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7fb864039200 msgr2=0x7fb86403b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.37:6800/133577710 2024-09-19T05:57:14.516 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:09.957+0000 7fb87d094640 1 --2- 172.21.15.37:0/852314945 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7fb864039200 0x7fb86403b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T05:57:14.516 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:10.358+0000 7fb87d094640 1 -- 172.21.15.37:0/852314945 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7fb864039200 msgr2=0x7fb86403b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.37:6800/133577710 2024-09-19T05:57:14.517 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:10.358+0000 7fb87d094640 1 --2- 172.21.15.37:0/852314945 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7fb864039200 0x7fb86403b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T05:57:14.517 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:11.159+0000 7fb87d094640 1 -- 172.21.15.37:0/852314945 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7fb864039200 msgr2=0x7fb86403b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.37:6800/133577710 2024-09-19T05:57:14.517 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:11.159+0000 7fb87d094640 1 --2- 172.21.15.37:0/852314945 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7fb864039200 0x7fb86403b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T05:57:14.517 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:12.562+0000 7fb86affd640 1 -- 172.21.15.37:0/852314945 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mgrmap(e 10) ==== 46241+0+0 (secure 0 0 0) 0x7fb87406b3e0 con 0x7fb878107f10 2024-09-19T05:57:14.517 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:12.562+0000 7fb86affd640 1 -- 172.21.15.37:0/852314945 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7fb864039200 msgr2=0x7fb86403b6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T05:57:14.517 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:12.562+0000 7fb86affd640 1 --2- 172.21.15.37:0/852314945 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7fb864039200 0x7fb86403b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:14.517 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:13.563+0000 7fb86affd640 1 -- 172.21.15.37:0/852314945 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 11) ==== 46368+0+0 (secure 0 0 0) 0x7fb87403b420 con 0x7fb878107f10 2024-09-19T05:57:14.517 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:13.563+0000 7fb86affd640 1 --2- 172.21.15.37:0/852314945 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fb86403ccc0 0x7fb86403f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:57:14.517 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:13.564+0000 7fb86affd640 1 -- 172.21.15.37:0/852314945 --> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fb87400af30 con 0x7fb86403ccc0 2024-09-19T05:57:14.517 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:13.565+0000 7fb87d094640 1 --2- 172.21.15.37:0/852314945 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fb86403ccc0 0x7fb86403f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:57:14.517 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:13.566+0000 7fb87d094640 1 --2- 172.21.15.37:0/852314945 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fb86403ccc0 0x7fb86403f0b0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fb86c003980 tx=0x7fb86c006e10 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:57:14.517 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:13.568+0000 7fb86affd640 1 -- 172.21.15.37:0/852314945 <== mgr.14148 v2:172.21.15.37:6800/3797010169 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7fb87400af30 con 0x7fb86403ccc0 2024-09-19T05:57:14.518 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:13.576+0000 7fb87faf9640 1 -- 172.21.15.37:0/852314945 --> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7fb878108370 con 0x7fb86403ccc0 2024-09-19T05:57:14.518 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:13.577+0000 7fb86affd640 1 -- 172.21.15.37:0/852314945 <== mgr.14148 v2:172.21.15.37:6800/3797010169 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7fb878108370 con 0x7fb86403ccc0 2024-09-19T05:57:14.518 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:13.577+0000 7fb87faf9640 1 -- 172.21.15.37:0/852314945 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fb86403ccc0 msgr2=0x7fb86403f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:57:14.518 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:13.577+0000 7fb87faf9640 1 --2- 172.21.15.37:0/852314945 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fb86403ccc0 0x7fb86403f0b0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fb86c003980 tx=0x7fb86c006e10 comp rx=0 tx=0).stop 2024-09-19T05:57:14.518 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:13.577+0000 7fb87faf9640 1 -- 172.21.15.37:0/852314945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb878107f10 msgr2=0x7fb87819b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:57:14.518 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:13.577+0000 7fb87faf9640 1 --2- 172.21.15.37:0/852314945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb878107f10 0x7fb87819b5d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb874030380 tx=0x7fb874032670 comp rx=0 tx=0).stop 2024-09-19T05:57:14.518 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:13.577+0000 7fb87faf9640 1 -- 172.21.15.37:0/852314945 shutdown_connections 2024-09-19T05:57:14.518 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:13.577+0000 7fb87faf9640 1 --2- 172.21.15.37:0/852314945 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fb86403ccc0 0x7fb86403f0b0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:14.518 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:13.577+0000 7fb87faf9640 1 --2- 172.21.15.37:0/852314945 >> [v2:172.21.15.37:6800/133577710,v1:172.21.15.37:6801/133577710] conn(0x7fb864039200 0x7fb86403b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:14.519 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:13.577+0000 7fb87faf9640 1 --2- 172.21.15.37:0/852314945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb878107f10 0x7fb87819b5d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:14.519 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:13.577+0000 7fb87faf9640 1 -- 172.21.15.37:0/852314945 >> 172.21.15.37:0/852314945 conn(0x7fb878101af0 msgr2=0x7fb8781026a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:57:14.519 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:13.577+0000 7fb87faf9640 1 -- 172.21.15.37:0/852314945 shutdown_connections 2024-09-19T05:57:14.519 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:13.577+0000 7fb87faf9640 1 -- 172.21.15.37:0/852314945 wait complete. 2024-09-19T05:57:14.519 INFO:teuthology.orchestra.run.smithi037.stdout:mgr epoch 9 is available 2024-09-19T05:57:14.519 INFO:teuthology.orchestra.run.smithi037.stdout:Generating a dashboard self-signed certificate... 2024-09-19T05:57:14.758 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:14 smithi037 ceph-mon[31211]: mgrmap e11: x(active, since 1.00602s) 2024-09-19T05:57:14.758 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:14 smithi037 ceph-mon[31211]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-19T05:57:14.758 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:14 smithi037 ceph-mon[31211]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-19T05:57:14.758 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:14 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:57:15.793 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:57:15 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:57:15.490+0000 7faf0eed6640 -1 log_channel(cephadm) log [ERR] : [19/Sep/2024:05:57:15] ENGINE Error in HTTPServer.serve 2024-09-19T05:57:15.793 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:57:15 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: Traceback (most recent call last): 2024-09-19T05:57:15.793 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:57:15 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T05:57:15.793 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:57:15 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: self._connections.run(self.expiration_interval) 2024-09-19T05:57:15.793 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:57:15 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T05:57:15.794 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:57:15 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: self._run(expiration_interval) 2024-09-19T05:57:15.794 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:57:15 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T05:57:15.794 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:57:15 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T05:57:15.794 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:57:15 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T05:57:15.794 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:57:15 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T05:57:15.794 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:57:15 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T05:57:15.794 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:57:15 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: s = self.context.wrap_socket( 2024-09-19T05:57:15.794 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:57:15 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T05:57:15.794 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:57:15 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: return self.sslsocket_class._create( 2024-09-19T05:57:15.794 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:57:15 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T05:57:15.794 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:57:15 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: self.do_handshake() 2024-09-19T05:57:15.794 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:57:15 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T05:57:15.794 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:57:15 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: self._sslobj.do_handshake() 2024-09-19T05:57:15.794 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:57:15 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T05:57:15.795 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 05:57:15 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T05:57:15.800 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-19T05:57:15.800 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:14.944+0000 7f21e68e6640 1 Processor -- start 2024-09-19T05:57:15.800 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:14.944+0000 7f21e68e6640 1 -- start start 2024-09-19T05:57:15.801 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:14.945+0000 7f21e68e6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21e01074c0 0x7f21e01078c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:57:15.801 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:14.945+0000 7f21e68e6640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f21e0107e90 con 0x7f21e01074c0 2024-09-19T05:57:15.801 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:14.945+0000 7f21dffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21e01074c0 0x7f21e01078c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:57:15.801 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:14.945+0000 7f21dffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21e01074c0 0x7f21e01078c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47088/0 (socket says 172.21.15.37:47088) 2024-09-19T05:57:15.801 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:14.945+0000 7f21dffff640 1 -- 172.21.15.37:0/2963775414 learned_addr learned my addr 172.21.15.37:0/2963775414 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T05:57:15.801 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:14.945+0000 7f21dffff640 1 -- 172.21.15.37:0/2963775414 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21e01086c0 con 0x7f21e01074c0 2024-09-19T05:57:15.801 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:14.946+0000 7f21dffff640 1 --2- 172.21.15.37:0/2963775414 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21e01074c0 0x7f21e01078c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f21d0009820 tx=0x7f21d002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5008c0611cfa97bb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:57:15.801 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:14.946+0000 7f21deffd640 1 -- 172.21.15.37:0/2963775414 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21d0037070 con 0x7f21e01074c0 2024-09-19T05:57:15.801 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:14.946+0000 7f21deffd640 1 -- 172.21.15.37:0/2963775414 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f21d0032920 con 0x7f21e01074c0 2024-09-19T05:57:15.801 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:14.946+0000 7f21deffd640 1 -- 172.21.15.37:0/2963775414 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21d0030810 con 0x7f21e01074c0 2024-09-19T05:57:15.801 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:14.947+0000 7f21e68e6640 1 -- 172.21.15.37:0/2963775414 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21e01074c0 msgr2=0x7f21e01078c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:57:15.802 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:14.947+0000 7f21e68e6640 1 --2- 172.21.15.37:0/2963775414 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21e01074c0 0x7f21e01078c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f21d0009820 tx=0x7f21d002a270 comp rx=0 tx=0).stop 2024-09-19T05:57:15.802 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:14.947+0000 7f21e68e6640 1 -- 172.21.15.37:0/2963775414 shutdown_connections 2024-09-19T05:57:15.802 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:14.947+0000 7f21e68e6640 1 --2- 172.21.15.37:0/2963775414 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21e01074c0 0x7f21e01078c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:15.802 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:14.947+0000 7f21e68e6640 1 -- 172.21.15.37:0/2963775414 >> 172.21.15.37:0/2963775414 conn(0x7f21e0102c70 msgr2=0x7f21e0105090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:57:15.802 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:14.947+0000 7f21e68e6640 1 -- 172.21.15.37:0/2963775414 shutdown_connections 2024-09-19T05:57:15.802 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:14.947+0000 7f21e68e6640 1 -- 172.21.15.37:0/2963775414 wait complete. 2024-09-19T05:57:15.802 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:14.948+0000 7f21e68e6640 1 Processor -- start 2024-09-19T05:57:15.802 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:14.948+0000 7f21e68e6640 1 -- start start 2024-09-19T05:57:15.802 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:14.948+0000 7f21e68e6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21e01074c0 0x7f21e007ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:57:15.802 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:14.948+0000 7f21e68e6640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f21e010ba70 con 0x7f21e01074c0 2024-09-19T05:57:15.802 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:14.948+0000 7f21dffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21e01074c0 0x7f21e007ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:57:15.803 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:14.948+0000 7f21dffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21e01074c0 0x7f21e007ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47104/0 (socket says 172.21.15.37:47104) 2024-09-19T05:57:15.803 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:14.948+0000 7f21dffff640 1 -- 172.21.15.37:0/2261589699 learned_addr learned my addr 172.21.15.37:0/2261589699 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T05:57:15.803 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:14.949+0000 7f21dffff640 1 -- 172.21.15.37:0/2261589699 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21e007cf70 con 0x7f21e01074c0 2024-09-19T05:57:15.803 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:14.949+0000 7f21dffff640 1 --2- 172.21.15.37:0/2261589699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21e01074c0 0x7f21e007ca30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f21d00097f0 tx=0x7f21d00327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:57:15.803 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:14.949+0000 7f21dd7fa640 1 -- 172.21.15.37:0/2261589699 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21d0037040 con 0x7f21e01074c0 2024-09-19T05:57:15.803 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:14.949+0000 7f21dd7fa640 1 -- 172.21.15.37:0/2261589699 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f21d0030cc0 con 0x7f21e01074c0 2024-09-19T05:57:15.803 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:14.949+0000 7f21e68e6640 1 -- 172.21.15.37:0/2261589699 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21e007b160 con 0x7f21e01074c0 2024-09-19T05:57:15.803 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:14.949+0000 7f21dd7fa640 1 -- 172.21.15.37:0/2261589699 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21d003a640 con 0x7f21e01074c0 2024-09-19T05:57:15.803 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:14.949+0000 7f21e68e6640 1 -- 172.21.15.37:0/2261589699 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21e007b6a0 con 0x7f21e01074c0 2024-09-19T05:57:15.803 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:14.950+0000 7f21c6ffd640 1 -- 172.21.15.37:0/2261589699 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21c0005290 con 0x7f21e01074c0 2024-09-19T05:57:15.803 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:14.951+0000 7f21dd7fa640 1 -- 172.21.15.37:0/2261589699 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 11) ==== 46368+0+0 (secure 0 0 0) 0x7f21d003b3f0 con 0x7f21e01074c0 2024-09-19T05:57:15.803 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:14.951+0000 7f21dd7fa640 1 --2- 172.21.15.37:0/2261589699 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f21c8039140 0x7f21c803b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:57:15.803 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:14.951+0000 7f21dd7fa640 1 -- 172.21.15.37:0/2261589699 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f21d006cc50 con 0x7f21e01074c0 2024-09-19T05:57:15.803 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:14.952+0000 7f21df7fe640 1 --2- 172.21.15.37:0/2261589699 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f21c8039140 0x7f21c803b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:57:15.804 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:14.952+0000 7f21df7fe640 1 --2- 172.21.15.37:0/2261589699 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f21c8039140 0x7f21c803b600 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f21d40098c0 tx=0x7f21d4006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:57:15.804 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:14.956+0000 7f21dd7fa640 1 -- 172.21.15.37:0/2261589699 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f21d003b6e0 con 0x7f21e01074c0 2024-09-19T05:57:15.804 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:15.131+0000 7f21dd7fa640 1 -- 172.21.15.37:0/2261589699 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7f21d006b780 con 0x7f21e01074c0 2024-09-19T05:57:15.804 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:15.142+0000 7f21c6ffd640 1 -- 172.21.15.37:0/2261589699 --> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f21c0000bc0 con 0x7f21c8039140 2024-09-19T05:57:15.804 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:15.181+0000 7f21dd7fa640 1 -- 172.21.15.37:0/2261589699 <== mgr.14148 v2:172.21.15.37:6800/3797010169 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f21c0000bc0 con 0x7f21c8039140 2024-09-19T05:57:15.804 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:15.183+0000 7f21c6ffd640 1 -- 172.21.15.37:0/2261589699 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f21c8039140 msgr2=0x7f21c803b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:57:15.804 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:15.183+0000 7f21c6ffd640 1 --2- 172.21.15.37:0/2261589699 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f21c8039140 0x7f21c803b600 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f21d40098c0 tx=0x7f21d4006db0 comp rx=0 tx=0).stop 2024-09-19T05:57:15.804 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:15.183+0000 7f21c6ffd640 1 -- 172.21.15.37:0/2261589699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21e01074c0 msgr2=0x7f21e007ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:57:15.804 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:15.183+0000 7f21c6ffd640 1 --2- 172.21.15.37:0/2261589699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21e01074c0 0x7f21e007ca30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f21d00097f0 tx=0x7f21d00327b0 comp rx=0 tx=0).stop 2024-09-19T05:57:15.804 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:15.184+0000 7f21c6ffd640 1 -- 172.21.15.37:0/2261589699 shutdown_connections 2024-09-19T05:57:15.804 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:15.184+0000 7f21c6ffd640 1 --2- 172.21.15.37:0/2261589699 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f21c8039140 0x7f21c803b600 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:15.804 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:15.184+0000 7f21c6ffd640 1 --2- 172.21.15.37:0/2261589699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21e01074c0 0x7f21e007ca30 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:15.804 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:15.184+0000 7f21c6ffd640 1 -- 172.21.15.37:0/2261589699 >> 172.21.15.37:0/2261589699 conn(0x7f21e0102c70 msgr2=0x7f21e0103820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:57:15.805 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:15.184+0000 7f21c6ffd640 1 -- 172.21.15.37:0/2261589699 shutdown_connections 2024-09-19T05:57:15.805 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:15.184+0000 7f21c6ffd640 1 -- 172.21.15.37:0/2261589699 wait complete. 2024-09-19T05:57:15.805 INFO:teuthology.orchestra.run.smithi037.stdout:Creating initial admin user... 2024-09-19T05:57:16.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:15 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:57:16.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:15 smithi037 ceph-mon[31211]: mgrmap e12: x(active, since 2s) 2024-09-19T05:57:16.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:15 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:57:16.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:15 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:57:16.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:15 smithi037 ceph-mon[31211]: [19/Sep/2024:05:57:15] ENGINE Bus STARTING 2024-09-19T05:57:16.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:15 smithi037 ceph-mon[31211]: [19/Sep/2024:05:57:15] ENGINE Serving on http://172.21.15.37:8765 2024-09-19T05:57:16.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:15 smithi037 ceph-mon[31211]: [19/Sep/2024:05:57:15] ENGINE Serving on https://172.21.15.37:7150 2024-09-19T05:57:16.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:15 smithi037 ceph-mon[31211]: [19/Sep/2024:05:57:15] ENGINE Bus STARTED 2024-09-19T05:57:16.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:15 smithi037 ceph-mon[31211]: [19/Sep/2024:05:57:15] ENGINE Error in HTTPServer.serve 2024-09-19T05:57:16.074 INFO:journalctl@ceph.mon.a.smithi037.stdout: Traceback (most recent call last): 2024-09-19T05:57:16.074 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T05:57:16.074 INFO:journalctl@ceph.mon.a.smithi037.stdout: self._connections.run(self.expiration_interval) 2024-09-19T05:57:16.075 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T05:57:16.075 INFO:journalctl@ceph.mon.a.smithi037.stdout: self._run(expiration_interval) 2024-09-19T05:57:16.075 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T05:57:16.075 INFO:journalctl@ceph.mon.a.smithi037.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T05:57:16.075 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T05:57:16.075 INFO:journalctl@ceph.mon.a.smithi037.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T05:57:16.075 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T05:57:16.075 INFO:journalctl@ceph.mon.a.smithi037.stdout: s = self.context.wrap_socket( 2024-09-19T05:57:16.075 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T05:57:16.075 INFO:journalctl@ceph.mon.a.smithi037.stdout: return self.sslsocket_class._create( 2024-09-19T05:57:16.075 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T05:57:16.075 INFO:journalctl@ceph.mon.a.smithi037.stdout: self.do_handshake() 2024-09-19T05:57:16.075 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T05:57:16.076 INFO:journalctl@ceph.mon.a.smithi037.stdout: self._sslobj.do_handshake() 2024-09-19T05:57:16.076 INFO:journalctl@ceph.mon.a.smithi037.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T05:57:17.441 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$sDZ/lR/fxreY.PZWOBvc7eqWyZAuG28TxFCuXpSbG3CJVzXrVtGhC", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726725436, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-19T05:57:17.441 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:16.389+0000 7f36727a8640 1 Processor -- start 2024-09-19T05:57:17.441 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:16.389+0000 7f36727a8640 1 -- start start 2024-09-19T05:57:17.441 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:16.389+0000 7f36727a8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f366c107a00 0x7f366c107e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:57:17.441 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:16.389+0000 7f36727a8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f366c1083d0 con 0x7f366c107a00 2024-09-19T05:57:17.441 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:16.390+0000 7f366bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f366c107a00 0x7f366c107e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:57:17.441 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:16.390+0000 7f366bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f366c107a00 0x7f366c107e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47114/0 (socket says 172.21.15.37:47114) 2024-09-19T05:57:17.441 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:16.390+0000 7f366bfff640 1 -- 172.21.15.37:0/1505825080 learned_addr learned my addr 172.21.15.37:0/1505825080 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T05:57:17.441 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:16.390+0000 7f366bfff640 1 -- 172.21.15.37:0/1505825080 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f366c106660 con 0x7f366c107a00 2024-09-19T05:57:17.442 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:16.391+0000 7f366bfff640 1 --2- 172.21.15.37:0/1505825080 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f366c107a00 0x7f366c107e00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f365c009820 tx=0x7f365c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=905efad8d5d3ed5c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:57:17.442 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:16.391+0000 7f366affd640 1 -- 172.21.15.37:0/1505825080 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f365c037070 con 0x7f366c107a00 2024-09-19T05:57:17.442 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:16.391+0000 7f366affd640 1 -- 172.21.15.37:0/1505825080 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f365c032920 con 0x7f366c107a00 2024-09-19T05:57:17.442 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:16.391+0000 7f366affd640 1 -- 172.21.15.37:0/1505825080 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f365c030810 con 0x7f366c107a00 2024-09-19T05:57:17.442 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:16.391+0000 7f36727a8640 1 -- 172.21.15.37:0/1505825080 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f366c107a00 msgr2=0x7f366c107e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:57:17.442 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:16.391+0000 7f36727a8640 1 --2- 172.21.15.37:0/1505825080 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f366c107a00 0x7f366c107e00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f365c009820 tx=0x7f365c02a270 comp rx=0 tx=0).stop 2024-09-19T05:57:17.442 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:16.392+0000 7f36727a8640 1 -- 172.21.15.37:0/1505825080 shutdown_connections 2024-09-19T05:57:17.442 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:16.392+0000 7f36727a8640 1 --2- 172.21.15.37:0/1505825080 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f366c107a00 0x7f366c107e00 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:17.442 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:16.392+0000 7f36727a8640 1 -- 172.21.15.37:0/1505825080 >> 172.21.15.37:0/1505825080 conn(0x7f366c101360 msgr2=0x7f366c103780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:57:17.442 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:16.392+0000 7f36727a8640 1 -- 172.21.15.37:0/1505825080 shutdown_connections 2024-09-19T05:57:17.442 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:16.392+0000 7f36727a8640 1 -- 172.21.15.37:0/1505825080 wait complete. 2024-09-19T05:57:17.442 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:16.392+0000 7f36727a8640 1 Processor -- start 2024-09-19T05:57:17.442 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:16.392+0000 7f36727a8640 1 -- start start 2024-09-19T05:57:17.443 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:16.392+0000 7f36727a8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f366c107a00 0x7f366c19b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:57:17.443 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:16.392+0000 7f36727a8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f366c10aa20 con 0x7f366c107a00 2024-09-19T05:57:17.443 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:16.393+0000 7f366bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f366c107a00 0x7f366c19b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:57:17.443 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:16.393+0000 7f366bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f366c107a00 0x7f366c19b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47130/0 (socket says 172.21.15.37:47130) 2024-09-19T05:57:17.443 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:16.393+0000 7f366bfff640 1 -- 172.21.15.37:0/2500287682 learned_addr learned my addr 172.21.15.37:0/2500287682 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T05:57:17.443 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:16.393+0000 7f366bfff640 1 -- 172.21.15.37:0/2500287682 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f366c19baa0 con 0x7f366c107a00 2024-09-19T05:57:17.443 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:16.393+0000 7f366bfff640 1 --2- 172.21.15.37:0/2500287682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f366c107a00 0x7f366c19b560 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f365c030380 tx=0x7f365c032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:57:17.443 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:16.393+0000 7f36697fa640 1 -- 172.21.15.37:0/2500287682 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f365c037040 con 0x7f366c107a00 2024-09-19T05:57:17.443 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:16.393+0000 7f36697fa640 1 -- 172.21.15.37:0/2500287682 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f365c040070 con 0x7f366c107a00 2024-09-19T05:57:17.443 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:16.393+0000 7f36727a8640 1 -- 172.21.15.37:0/2500287682 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f366c19bd30 con 0x7f366c107a00 2024-09-19T05:57:17.444 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:16.393+0000 7f36697fa640 1 -- 172.21.15.37:0/2500287682 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f365c03a770 con 0x7f366c107a00 2024-09-19T05:57:17.444 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:16.393+0000 7f36727a8640 1 -- 172.21.15.37:0/2500287682 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f366c19ea20 con 0x7f366c107a00 2024-09-19T05:57:17.444 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:16.394+0000 7f36697fa640 1 -- 172.21.15.37:0/2500287682 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7f365c03b420 con 0x7f366c107a00 2024-09-19T05:57:17.444 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:16.394+0000 7f36727a8640 1 -- 172.21.15.37:0/2500287682 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f366c107e80 con 0x7f366c107a00 2024-09-19T05:57:17.444 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:16.394+0000 7f36697fa640 1 --2- 172.21.15.37:0/2500287682 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f3654039200 0x7f365403b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:57:17.444 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:16.395+0000 7f36697fa640 1 -- 172.21.15.37:0/2500287682 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f365c06ca80 con 0x7f366c107a00 2024-09-19T05:57:17.444 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:16.395+0000 7f366b7fe640 1 --2- 172.21.15.37:0/2500287682 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f3654039200 0x7f365403b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:57:17.444 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:16.395+0000 7f366b7fe640 1 --2- 172.21.15.37:0/2500287682 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f3654039200 0x7f365403b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f36600098c0 tx=0x7f3660006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:57:17.444 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:16.399+0000 7f36697fa640 1 -- 172.21.15.37:0/2500287682 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f365c06ee20 con 0x7f366c107a00 2024-09-19T05:57:17.444 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:16.600+0000 7f36727a8640 1 -- 172.21.15.37:0/2500287682 --> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f366c02d9b0 con 0x7f3654039200 2024-09-19T05:57:17.444 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:16.848+0000 7f36697fa640 1 -- 172.21.15.37:0/2500287682 <== mgr.14148 v2:172.21.15.37:6800/3797010169 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f366c02d9b0 con 0x7f3654039200 2024-09-19T05:57:17.444 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:16.850+0000 7f36727a8640 1 -- 172.21.15.37:0/2500287682 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f3654039200 msgr2=0x7f365403b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:57:17.444 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:16.850+0000 7f36727a8640 1 --2- 172.21.15.37:0/2500287682 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f3654039200 0x7f365403b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f36600098c0 tx=0x7f3660006db0 comp rx=0 tx=0).stop 2024-09-19T05:57:17.445 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:16.850+0000 7f36727a8640 1 -- 172.21.15.37:0/2500287682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f366c107a00 msgr2=0x7f366c19b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:57:17.445 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:16.850+0000 7f36727a8640 1 --2- 172.21.15.37:0/2500287682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f366c107a00 0x7f366c19b560 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f365c030380 tx=0x7f365c032670 comp rx=0 tx=0).stop 2024-09-19T05:57:17.445 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:16.850+0000 7f36727a8640 1 -- 172.21.15.37:0/2500287682 shutdown_connections 2024-09-19T05:57:17.445 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:16.850+0000 7f36727a8640 1 --2- 172.21.15.37:0/2500287682 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f3654039200 0x7f365403b6c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:17.445 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:16.850+0000 7f36727a8640 1 --2- 172.21.15.37:0/2500287682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f366c107a00 0x7f366c19b560 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:17.445 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:16.850+0000 7f36727a8640 1 -- 172.21.15.37:0/2500287682 >> 172.21.15.37:0/2500287682 conn(0x7f366c101360 msgr2=0x7f366c1022c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:57:17.445 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:16.850+0000 7f36727a8640 1 -- 172.21.15.37:0/2500287682 shutdown_connections 2024-09-19T05:57:17.445 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:16.850+0000 7f36727a8640 1 -- 172.21.15.37:0/2500287682 wait complete. 2024-09-19T05:57:17.445 INFO:teuthology.orchestra.run.smithi037.stdout:Fetching dashboard port number... 2024-09-19T05:57:18.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:17 smithi037 ceph-mon[31211]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:57:18.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:17 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:57:19.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:18 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/4204667195' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-19T05:57:19.095 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 8443 2024-09-19T05:57:19.095 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:18.291+0000 7fa9abbd2640 1 Processor -- start 2024-09-19T05:57:19.095 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:18.291+0000 7fa9abbd2640 1 -- start start 2024-09-19T05:57:19.095 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:18.291+0000 7fa9abbd2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9a4107f70 0x7fa9a410a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:57:19.095 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:18.291+0000 7fa9abbd2640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a407be40 con 0x7fa9a4107f70 2024-09-19T05:57:19.095 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:18.291+0000 7fa9a996e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9a4107f70 0x7fa9a410a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:57:19.095 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:18.291+0000 7fa9a996e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9a4107f70 0x7fa9a410a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47140/0 (socket says 172.21.15.37:47140) 2024-09-19T05:57:19.095 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:18.291+0000 7fa9a996e640 1 -- 172.21.15.37:0/1358987628 learned_addr learned my addr 172.21.15.37:0/1358987628 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T05:57:19.095 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:18.292+0000 7fa9a996e640 1 -- 172.21.15.37:0/1358987628 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9a410a8a0 con 0x7fa9a4107f70 2024-09-19T05:57:19.096 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:18.292+0000 7fa9a996e640 1 --2- 172.21.15.37:0/1358987628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9a4107f70 0x7fa9a410a360 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa9a0009820 tx=0x7fa9a002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31b20cc9fa03c6aa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:57:19.096 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:18.292+0000 7fa9a896c640 1 -- 172.21.15.37:0/1358987628 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9a0037070 con 0x7fa9a4107f70 2024-09-19T05:57:19.096 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:18.292+0000 7fa9a896c640 1 -- 172.21.15.37:0/1358987628 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa9a0032920 con 0x7fa9a4107f70 2024-09-19T05:57:19.096 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:18.293+0000 7fa9a896c640 1 -- 172.21.15.37:0/1358987628 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9a0030810 con 0x7fa9a4107f70 2024-09-19T05:57:19.096 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:18.293+0000 7fa9abbd2640 1 -- 172.21.15.37:0/1358987628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9a4107f70 msgr2=0x7fa9a410a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:57:19.096 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:18.293+0000 7fa9abbd2640 1 --2- 172.21.15.37:0/1358987628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9a4107f70 0x7fa9a410a360 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa9a0009820 tx=0x7fa9a002a270 comp rx=0 tx=0).stop 2024-09-19T05:57:19.096 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:18.293+0000 7fa9abbd2640 1 -- 172.21.15.37:0/1358987628 shutdown_connections 2024-09-19T05:57:19.096 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:18.293+0000 7fa9abbd2640 1 --2- 172.21.15.37:0/1358987628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9a4107f70 0x7fa9a410a360 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:19.096 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:18.293+0000 7fa9abbd2640 1 -- 172.21.15.37:0/1358987628 >> 172.21.15.37:0/1358987628 conn(0x7fa9a4101b90 msgr2=0x7fa9a4103fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:57:19.096 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:18.293+0000 7fa9abbd2640 1 -- 172.21.15.37:0/1358987628 shutdown_connections 2024-09-19T05:57:19.096 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:18.293+0000 7fa9abbd2640 1 -- 172.21.15.37:0/1358987628 wait complete. 2024-09-19T05:57:19.096 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:18.294+0000 7fa9abbd2640 1 Processor -- start 2024-09-19T05:57:19.097 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:18.294+0000 7fa9abbd2640 1 -- start start 2024-09-19T05:57:19.097 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:18.294+0000 7fa9abbd2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9a4107f70 0x7fa9a41077f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:57:19.097 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:18.294+0000 7fa9abbd2640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a410b920 con 0x7fa9a4107f70 2024-09-19T05:57:19.097 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:18.294+0000 7fa9a996e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9a4107f70 0x7fa9a41077f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:57:19.097 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:18.294+0000 7fa9a996e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9a4107f70 0x7fa9a41077f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47154/0 (socket says 172.21.15.37:47154) 2024-09-19T05:57:19.097 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:18.294+0000 7fa9a996e640 1 -- 172.21.15.37:0/4204667195 learned_addr learned my addr 172.21.15.37:0/4204667195 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T05:57:19.097 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:18.294+0000 7fa9a996e640 1 -- 172.21.15.37:0/4204667195 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9a4107d30 con 0x7fa9a4107f70 2024-09-19T05:57:19.097 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:18.294+0000 7fa9a996e640 1 --2- 172.21.15.37:0/4204667195 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9a4107f70 0x7fa9a41077f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa9a0030380 tx=0x7fa9a0032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:57:19.097 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:18.295+0000 7fa99affd640 1 -- 172.21.15.37:0/4204667195 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9a0037040 con 0x7fa9a4107f70 2024-09-19T05:57:19.097 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:18.295+0000 7fa99affd640 1 -- 172.21.15.37:0/4204667195 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa9a0040070 con 0x7fa9a4107f70 2024-09-19T05:57:19.097 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:18.295+0000 7fa9abbd2640 1 -- 172.21.15.37:0/4204667195 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9a4105f20 con 0x7fa9a4107f70 2024-09-19T05:57:19.097 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:18.295+0000 7fa99affd640 1 -- 172.21.15.37:0/4204667195 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9a003a7b0 con 0x7fa9a4107f70 2024-09-19T05:57:19.097 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:18.295+0000 7fa9abbd2640 1 -- 172.21.15.37:0/4204667195 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9a4106460 con 0x7fa9a4107f70 2024-09-19T05:57:19.097 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:18.296+0000 7fa99affd640 1 -- 172.21.15.37:0/4204667195 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7fa9a003bc00 con 0x7fa9a4107f70 2024-09-19T05:57:19.098 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:18.296+0000 7fa9abbd2640 1 -- 172.21.15.37:0/4204667195 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9a41083d0 con 0x7fa9a4107f70 2024-09-19T05:57:19.098 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:18.296+0000 7fa99affd640 1 --2- 172.21.15.37:0/4204667195 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fa990039260 0x7fa99003b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:57:19.098 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:18.296+0000 7fa99affd640 1 -- 172.21.15.37:0/4204667195 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fa9a006c9f0 con 0x7fa9a4107f70 2024-09-19T05:57:19.098 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:18.296+0000 7fa9a916d640 1 --2- 172.21.15.37:0/4204667195 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fa990039260 0x7fa99003b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:57:19.098 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:18.296+0000 7fa9a916d640 1 --2- 172.21.15.37:0/4204667195 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fa990039260 0x7fa99003b720 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa9940098c0 tx=0x7fa994006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:57:19.098 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:18.301+0000 7fa99affd640 1 -- 172.21.15.37:0/4204667195 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa9a0040220 con 0x7fa9a4107f70 2024-09-19T05:57:19.098 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:18.474+0000 7fa9abbd2640 1 -- 172.21.15.37:0/4204667195 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7fa9a41066e0 con 0x7fa9a4107f70 2024-09-19T05:57:19.098 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:18.475+0000 7fa99affd640 1 -- 172.21.15.37:0/4204667195 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7fa9a0042d80 con 0x7fa9a4107f70 2024-09-19T05:57:19.098 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:18.477+0000 7fa9abbd2640 1 -- 172.21.15.37:0/4204667195 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fa990039260 msgr2=0x7fa99003b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:57:19.098 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:18.477+0000 7fa9abbd2640 1 --2- 172.21.15.37:0/4204667195 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fa990039260 0x7fa99003b720 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa9940098c0 tx=0x7fa994006db0 comp rx=0 tx=0).stop 2024-09-19T05:57:19.098 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:18.477+0000 7fa9abbd2640 1 -- 172.21.15.37:0/4204667195 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9a4107f70 msgr2=0x7fa9a41077f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:57:19.098 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:18.477+0000 7fa9abbd2640 1 --2- 172.21.15.37:0/4204667195 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9a4107f70 0x7fa9a41077f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa9a0030380 tx=0x7fa9a0032670 comp rx=0 tx=0).stop 2024-09-19T05:57:19.098 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:18.477+0000 7fa9abbd2640 1 -- 172.21.15.37:0/4204667195 shutdown_connections 2024-09-19T05:57:19.099 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:18.477+0000 7fa9abbd2640 1 --2- 172.21.15.37:0/4204667195 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fa990039260 0x7fa99003b720 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:19.099 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:18.477+0000 7fa9abbd2640 1 --2- 172.21.15.37:0/4204667195 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9a4107f70 0x7fa9a41077f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:19.099 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:18.477+0000 7fa9abbd2640 1 -- 172.21.15.37:0/4204667195 >> 172.21.15.37:0/4204667195 conn(0x7fa9a4101b90 msgr2=0x7fa9a4102720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:57:19.099 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:18.477+0000 7fa9abbd2640 1 -- 172.21.15.37:0/4204667195 shutdown_connections 2024-09-19T05:57:19.099 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:18.477+0000 7fa9abbd2640 1 -- 172.21.15.37:0/4204667195 wait complete. 2024-09-19T05:57:19.103 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T05:57:19.103 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout disabled 2024-09-19T05:57:19.111 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T05:57:19.111 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout inactive 2024-09-19T05:57:19.111 INFO:teuthology.orchestra.run.smithi037.stdout:firewalld.service is not enabled 2024-09-19T05:57:19.111 INFO:teuthology.orchestra.run.smithi037.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-19T05:57:19.113 INFO:teuthology.orchestra.run.smithi037.stdout:Ceph Dashboard is now available at: 2024-09-19T05:57:19.113 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T05:57:19.113 INFO:teuthology.orchestra.run.smithi037.stdout: URL: https://smithi037.front.sepia.ceph.com:8443/ 2024-09-19T05:57:19.114 INFO:teuthology.orchestra.run.smithi037.stdout: User: admin 2024-09-19T05:57:19.114 INFO:teuthology.orchestra.run.smithi037.stdout: Password: 3f3ej27g4t 2024-09-19T05:57:19.114 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T05:57:19.114 INFO:teuthology.orchestra.run.smithi037.stdout:Saving cluster configuration to /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/config directory 2024-09-19T05:57:20.136 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:19 smithi037 ceph-mon[31211]: mgrmap e13: x(active, since 6s) 2024-09-19T05:57:20.136 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:19 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/1781194436' entity='client.admin' 2024-09-19T05:57:20.418 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:19.554+0000 7f3cc0a51640 1 Processor -- start 2024-09-19T05:57:20.419 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:19.554+0000 7f3cc0a51640 1 -- start start 2024-09-19T05:57:20.419 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:19.554+0000 7f3cc0a51640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cbc1057b0 0x7f3cbc105bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:57:20.419 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:19.554+0000 7f3cc0a51640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3cbc106180 con 0x7f3cbc1057b0 2024-09-19T05:57:20.419 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:19.554+0000 7f3cba59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cbc1057b0 0x7f3cbc105bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:57:20.419 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:19.555+0000 7f3cba59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cbc1057b0 0x7f3cbc105bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47168/0 (socket says 172.21.15.37:47168) 2024-09-19T05:57:20.419 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:19.555+0000 7f3cba59c640 1 -- 172.21.15.37:0/2723623881 learned_addr learned my addr 172.21.15.37:0/2723623881 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T05:57:20.419 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:19.555+0000 7f3cba59c640 1 -- 172.21.15.37:0/2723623881 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cbc108790 con 0x7f3cbc1057b0 2024-09-19T05:57:20.419 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:19.556+0000 7f3cba59c640 1 --2- 172.21.15.37:0/2723623881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cbc1057b0 0x7f3cbc105bb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3cac009820 tx=0x7f3cac02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71e87b11e42f864a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:57:20.419 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:19.556+0000 7f3cb959a640 1 -- 172.21.15.37:0/2723623881 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3cac037070 con 0x7f3cbc1057b0 2024-09-19T05:57:20.419 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:19.556+0000 7f3cb959a640 1 -- 172.21.15.37:0/2723623881 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3cac032920 con 0x7f3cbc1057b0 2024-09-19T05:57:20.419 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:19.556+0000 7f3cb959a640 1 -- 172.21.15.37:0/2723623881 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3cac030810 con 0x7f3cbc1057b0 2024-09-19T05:57:20.419 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:19.556+0000 7f3cc0a51640 1 -- 172.21.15.37:0/2723623881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cbc1057b0 msgr2=0x7f3cbc105bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:57:20.419 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:19.556+0000 7f3cc0a51640 1 --2- 172.21.15.37:0/2723623881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cbc1057b0 0x7f3cbc105bb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3cac009820 tx=0x7f3cac02a270 comp rx=0 tx=0).stop 2024-09-19T05:57:20.420 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:19.556+0000 7f3cc0a51640 1 -- 172.21.15.37:0/2723623881 shutdown_connections 2024-09-19T05:57:20.420 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:19.556+0000 7f3cc0a51640 1 --2- 172.21.15.37:0/2723623881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cbc1057b0 0x7f3cbc105bb0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:20.420 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:19.556+0000 7f3cc0a51640 1 -- 172.21.15.37:0/2723623881 >> 172.21.15.37:0/2723623881 conn(0x7f3cbc101360 msgr2=0x7f3cbc103780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:57:20.420 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:19.556+0000 7f3cc0a51640 1 -- 172.21.15.37:0/2723623881 shutdown_connections 2024-09-19T05:57:20.420 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:19.556+0000 7f3cc0a51640 1 -- 172.21.15.37:0/2723623881 wait complete. 2024-09-19T05:57:20.420 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:19.557+0000 7f3cc0a51640 1 Processor -- start 2024-09-19T05:57:20.420 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:19.557+0000 7f3cc0a51640 1 -- start start 2024-09-19T05:57:20.420 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:19.557+0000 7f3cc0a51640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cbc1057b0 0x7f3cbc19b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:57:20.420 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:19.557+0000 7f3cc0a51640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3cbc10b9c0 con 0x7f3cbc1057b0 2024-09-19T05:57:20.420 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:19.558+0000 7f3cba59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cbc1057b0 0x7f3cbc19b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:57:20.420 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:19.558+0000 7f3cba59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cbc1057b0 0x7f3cbc19b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47182/0 (socket says 172.21.15.37:47182) 2024-09-19T05:57:20.420 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:19.558+0000 7f3cba59c640 1 -- 172.21.15.37:0/1781194436 learned_addr learned my addr 172.21.15.37:0/1781194436 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T05:57:20.420 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:19.558+0000 7f3cba59c640 1 -- 172.21.15.37:0/1781194436 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cbc19ba80 con 0x7f3cbc1057b0 2024-09-19T05:57:20.421 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:19.558+0000 7f3cba59c640 1 --2- 172.21.15.37:0/1781194436 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cbc1057b0 0x7f3cbc19b540 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3cac030560 tx=0x7f3cac032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:57:20.421 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:19.558+0000 7f3cab7fe640 1 -- 172.21.15.37:0/1781194436 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3cac037040 con 0x7f3cbc1057b0 2024-09-19T05:57:20.421 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:19.558+0000 7f3cab7fe640 1 -- 172.21.15.37:0/1781194436 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3cac040070 con 0x7f3cbc1057b0 2024-09-19T05:57:20.421 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:19.558+0000 7f3cc0a51640 1 -- 172.21.15.37:0/1781194436 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cbc19bd10 con 0x7f3cbc1057b0 2024-09-19T05:57:20.421 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:19.558+0000 7f3cab7fe640 1 -- 172.21.15.37:0/1781194436 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3cac03a740 con 0x7f3cbc1057b0 2024-09-19T05:57:20.421 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:19.558+0000 7f3cc0a51640 1 -- 172.21.15.37:0/1781194436 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cbc19ea00 con 0x7f3cbc1057b0 2024-09-19T05:57:20.421 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:19.559+0000 7f3cab7fe640 1 -- 172.21.15.37:0/1781194436 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f3cac03b420 con 0x7f3cbc1057b0 2024-09-19T05:57:20.421 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:19.559+0000 7f3cc0a51640 1 -- 172.21.15.37:0/1781194436 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cbc105c30 con 0x7f3cbc1057b0 2024-09-19T05:57:20.421 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:19.559+0000 7f3cab7fe640 1 --2- 172.21.15.37:0/1781194436 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f3ca4039350 0x7f3ca403b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:57:20.422 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:19.559+0000 7f3cab7fe640 1 -- 172.21.15.37:0/1781194436 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f3cac06cac0 con 0x7f3cbc1057b0 2024-09-19T05:57:20.422 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:19.560+0000 7f3cb9d9b640 1 --2- 172.21.15.37:0/1781194436 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f3ca4039350 0x7f3ca403b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:57:20.422 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:19.560+0000 7f3cb9d9b640 1 --2- 172.21.15.37:0/1781194436 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f3ca4039350 0x7f3ca403b810 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3cb00098c0 tx=0x7f3cb0006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:57:20.422 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:19.564+0000 7f3cab7fe640 1 -- 172.21.15.37:0/1781194436 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3cac042b50 con 0x7f3cbc1057b0 2024-09-19T05:57:20.422 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:19.831+0000 7f3cc0a51640 1 -- 172.21.15.37:0/1781194436 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f3cbc19eff0 con 0x7f3cbc1057b0 2024-09-19T05:57:20.422 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:19.833+0000 7f3cab7fe640 1 -- 172.21.15.37:0/1781194436 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v27)=0 set mgr/dashboard/cluster/status v27) ==== 153+0+0 (secure 0 0 0) 0x7f3cac043360 con 0x7f3cbc1057b0 2024-09-19T05:57:20.422 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-19T05:57:20.422 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:19.835+0000 7f3cc0a51640 1 -- 172.21.15.37:0/1781194436 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f3ca4039350 msgr2=0x7f3ca403b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:57:20.422 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:19.835+0000 7f3cc0a51640 1 --2- 172.21.15.37:0/1781194436 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f3ca4039350 0x7f3ca403b810 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3cb00098c0 tx=0x7f3cb0006db0 comp rx=0 tx=0).stop 2024-09-19T05:57:20.422 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:19.835+0000 7f3cc0a51640 1 -- 172.21.15.37:0/1781194436 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cbc1057b0 msgr2=0x7f3cbc19b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:57:20.422 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:19.835+0000 7f3cc0a51640 1 --2- 172.21.15.37:0/1781194436 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cbc1057b0 0x7f3cbc19b540 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3cac030560 tx=0x7f3cac032670 comp rx=0 tx=0).stop 2024-09-19T05:57:20.422 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:19.835+0000 7f3cc0a51640 1 -- 172.21.15.37:0/1781194436 shutdown_connections 2024-09-19T05:57:20.422 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:19.835+0000 7f3cc0a51640 1 --2- 172.21.15.37:0/1781194436 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f3ca4039350 0x7f3ca403b810 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:20.422 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:19.835+0000 7f3cc0a51640 1 --2- 172.21.15.37:0/1781194436 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cbc1057b0 0x7f3cbc19b540 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:20.423 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:19.835+0000 7f3cc0a51640 1 -- 172.21.15.37:0/1781194436 >> 172.21.15.37:0/1781194436 conn(0x7f3cbc101360 msgr2=0x7f3cbc101f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:57:20.423 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:19.835+0000 7f3cc0a51640 1 -- 172.21.15.37:0/1781194436 shutdown_connections 2024-09-19T05:57:20.423 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-09-19T05:57:19.835+0000 7f3cc0a51640 1 -- 172.21.15.37:0/1781194436 wait complete. 2024-09-19T05:57:20.423 INFO:teuthology.orchestra.run.smithi037.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-19T05:57:20.423 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T05:57:20.423 INFO:teuthology.orchestra.run.smithi037.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-19T05:57:20.423 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T05:57:20.423 INFO:teuthology.orchestra.run.smithi037.stdout:Or, if you are only running a single cluster on this host: 2024-09-19T05:57:20.423 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T05:57:20.423 INFO:teuthology.orchestra.run.smithi037.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-19T05:57:20.423 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T05:57:20.423 INFO:teuthology.orchestra.run.smithi037.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-19T05:57:20.423 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T05:57:20.423 INFO:teuthology.orchestra.run.smithi037.stdout: ceph telemetry on 2024-09-19T05:57:20.424 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T05:57:20.424 INFO:teuthology.orchestra.run.smithi037.stdout:For more information see: 2024-09-19T05:57:20.424 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T05:57:20.424 INFO:teuthology.orchestra.run.smithi037.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-19T05:57:20.424 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T05:57:20.424 INFO:teuthology.orchestra.run.smithi037.stdout:Bootstrap complete. 2024-09-19T05:57:20.458 INFO:tasks.cephadm:Fetching config... 2024-09-19T05:57:20.459 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-19T05:57:20.459 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-19T05:57:20.475 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-19T05:57:20.475 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-19T05:57:20.475 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-19T05:57:20.532 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-19T05:57:20.532 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-19T05:57:20.532 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-19T05:57:20.599 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-19T05:57:20.599 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-19T05:57:20.599 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-19T05:57:20.655 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-19T05:57:20.655 DEBUG:teuthology.orchestra.run.smithi037:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCL/GMcq0NvNZfARJ8RR5yLRtR6nfZiX3/lUKyHA+ILnGn0ukMB24P/MErQo8ckRZ6iNp2Q+I4ebYxhHRXE1woZeLS7bkDsNOn+H1GisGSZzVygW0IcCn2odt+j+w8liZOXDx1wjR+mPi4X7uOTJpSwCkzsa+FfdGpi3XnVMBNqEBOKYuN10MLLGXW5JZ/eqo/kC5K39/7YG/0AmyUKE80fHqIyswvy1Yf1jr2BxDcAvPpSdlWFjaskDxZxkyJK7cgTuhIX3KXqewfU6DMIN1oEvUFX46kQVzPvUOgvylpr3HZPszS44rBoJj/3DfF1jW2bD3oWFOqheQ74oINxWLtUCgQojocchl+kfXK7tETHnkXXbsscb2XkjN58KjOPpSHvQIYkVUIFL/e/YEkdb1K63OOxcd3SKjlVI9qOrNdQQhOi2K4UfWxQ2yt7rDZtEoVnPPjF3qN8U1X2BFp7L3qUSoX+u8M9x754qdnlp4FSKIWHTB2fhEkP8k2gWWPwyh0= ceph-b8c8bdae-764b-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T05:57:20.732 INFO:teuthology.orchestra.run.smithi037.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCL/GMcq0NvNZfARJ8RR5yLRtR6nfZiX3/lUKyHA+ILnGn0ukMB24P/MErQo8ckRZ6iNp2Q+I4ebYxhHRXE1woZeLS7bkDsNOn+H1GisGSZzVygW0IcCn2odt+j+w8liZOXDx1wjR+mPi4X7uOTJpSwCkzsa+FfdGpi3XnVMBNqEBOKYuN10MLLGXW5JZ/eqo/kC5K39/7YG/0AmyUKE80fHqIyswvy1Yf1jr2BxDcAvPpSdlWFjaskDxZxkyJK7cgTuhIX3KXqewfU6DMIN1oEvUFX46kQVzPvUOgvylpr3HZPszS44rBoJj/3DfF1jW2bD3oWFOqheQ74oINxWLtUCgQojocchl+kfXK7tETHnkXXbsscb2XkjN58KjOPpSHvQIYkVUIFL/e/YEkdb1K63OOxcd3SKjlVI9qOrNdQQhOi2K4UfWxQ2yt7rDZtEoVnPPjF3qN8U1X2BFp7L3qUSoX+u8M9x754qdnlp4FSKIWHTB2fhEkP8k2gWWPwyh0= ceph-b8c8bdae-764b-11ef-bceb-c7b262605968 2024-09-19T05:57:20.744 DEBUG:teuthology.orchestra.run.smithi099:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCL/GMcq0NvNZfARJ8RR5yLRtR6nfZiX3/lUKyHA+ILnGn0ukMB24P/MErQo8ckRZ6iNp2Q+I4ebYxhHRXE1woZeLS7bkDsNOn+H1GisGSZzVygW0IcCn2odt+j+w8liZOXDx1wjR+mPi4X7uOTJpSwCkzsa+FfdGpi3XnVMBNqEBOKYuN10MLLGXW5JZ/eqo/kC5K39/7YG/0AmyUKE80fHqIyswvy1Yf1jr2BxDcAvPpSdlWFjaskDxZxkyJK7cgTuhIX3KXqewfU6DMIN1oEvUFX46kQVzPvUOgvylpr3HZPszS44rBoJj/3DfF1jW2bD3oWFOqheQ74oINxWLtUCgQojocchl+kfXK7tETHnkXXbsscb2XkjN58KjOPpSHvQIYkVUIFL/e/YEkdb1K63OOxcd3SKjlVI9qOrNdQQhOi2K4UfWxQ2yt7rDZtEoVnPPjF3qN8U1X2BFp7L3qUSoX+u8M9x754qdnlp4FSKIWHTB2fhEkP8k2gWWPwyh0= ceph-b8c8bdae-764b-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T05:57:20.785 INFO:teuthology.orchestra.run.smithi099.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCL/GMcq0NvNZfARJ8RR5yLRtR6nfZiX3/lUKyHA+ILnGn0ukMB24P/MErQo8ckRZ6iNp2Q+I4ebYxhHRXE1woZeLS7bkDsNOn+H1GisGSZzVygW0IcCn2odt+j+w8liZOXDx1wjR+mPi4X7uOTJpSwCkzsa+FfdGpi3XnVMBNqEBOKYuN10MLLGXW5JZ/eqo/kC5K39/7YG/0AmyUKE80fHqIyswvy1Yf1jr2BxDcAvPpSdlWFjaskDxZxkyJK7cgTuhIX3KXqewfU6DMIN1oEvUFX46kQVzPvUOgvylpr3HZPszS44rBoJj/3DfF1jW2bD3oWFOqheQ74oINxWLtUCgQojocchl+kfXK7tETHnkXXbsscb2XkjN58KjOPpSHvQIYkVUIFL/e/YEkdb1K63OOxcd3SKjlVI9qOrNdQQhOi2K4UfWxQ2yt7rDZtEoVnPPjF3qN8U1X2BFp7L3qUSoX+u8M9x754qdnlp4FSKIWHTB2fhEkP8k2gWWPwyh0= ceph-b8c8bdae-764b-11ef-bceb-c7b262605968 2024-09-19T05:57:20.797 DEBUG:teuthology.orchestra.run.smithi117:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCL/GMcq0NvNZfARJ8RR5yLRtR6nfZiX3/lUKyHA+ILnGn0ukMB24P/MErQo8ckRZ6iNp2Q+I4ebYxhHRXE1woZeLS7bkDsNOn+H1GisGSZzVygW0IcCn2odt+j+w8liZOXDx1wjR+mPi4X7uOTJpSwCkzsa+FfdGpi3XnVMBNqEBOKYuN10MLLGXW5JZ/eqo/kC5K39/7YG/0AmyUKE80fHqIyswvy1Yf1jr2BxDcAvPpSdlWFjaskDxZxkyJK7cgTuhIX3KXqewfU6DMIN1oEvUFX46kQVzPvUOgvylpr3HZPszS44rBoJj/3DfF1jW2bD3oWFOqheQ74oINxWLtUCgQojocchl+kfXK7tETHnkXXbsscb2XkjN58KjOPpSHvQIYkVUIFL/e/YEkdb1K63OOxcd3SKjlVI9qOrNdQQhOi2K4UfWxQ2yt7rDZtEoVnPPjF3qN8U1X2BFp7L3qUSoX+u8M9x754qdnlp4FSKIWHTB2fhEkP8k2gWWPwyh0= ceph-b8c8bdae-764b-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T05:57:20.839 INFO:teuthology.orchestra.run.smithi117.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCL/GMcq0NvNZfARJ8RR5yLRtR6nfZiX3/lUKyHA+ILnGn0ukMB24P/MErQo8ckRZ6iNp2Q+I4ebYxhHRXE1woZeLS7bkDsNOn+H1GisGSZzVygW0IcCn2odt+j+w8liZOXDx1wjR+mPi4X7uOTJpSwCkzsa+FfdGpi3XnVMBNqEBOKYuN10MLLGXW5JZ/eqo/kC5K39/7YG/0AmyUKE80fHqIyswvy1Yf1jr2BxDcAvPpSdlWFjaskDxZxkyJK7cgTuhIX3KXqewfU6DMIN1oEvUFX46kQVzPvUOgvylpr3HZPszS44rBoJj/3DfF1jW2bD3oWFOqheQ74oINxWLtUCgQojocchl+kfXK7tETHnkXXbsscb2XkjN58KjOPpSHvQIYkVUIFL/e/YEkdb1K63OOxcd3SKjlVI9qOrNdQQhOi2K4UfWxQ2yt7rDZtEoVnPPjF3qN8U1X2BFp7L3qUSoX+u8M9x754qdnlp4FSKIWHTB2fhEkP8k2gWWPwyh0= ceph-b8c8bdae-764b-11ef-bceb-c7b262605968 2024-09-19T05:57:20.852 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-19T05:57:21.109 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:57:21.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:21.555+0000 7f2157050640 1 -- 172.21.15.37:0/795797311 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2150100510 msgr2=0x7f2150100910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:57:21.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:21.555+0000 7f2157050640 1 --2- 172.21.15.37:0/795797311 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2150100510 0x7f2150100910 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2140009c20 tx=0x7f214002aa90 comp rx=0 tx=0).stop 2024-09-19T05:57:21.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:21.555+0000 7f2157050640 1 -- 172.21.15.37:0/795797311 shutdown_connections 2024-09-19T05:57:21.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:21.555+0000 7f2157050640 1 --2- 172.21.15.37:0/795797311 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2150100510 0x7f2150100910 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:21.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:21.555+0000 7f2157050640 1 -- 172.21.15.37:0/795797311 >> 172.21.15.37:0/795797311 conn(0x7f21500fbc80 msgr2=0x7f21500fe0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:57:21.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:21.555+0000 7f2157050640 1 -- 172.21.15.37:0/795797311 shutdown_connections 2024-09-19T05:57:21.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:21.555+0000 7f2157050640 1 -- 172.21.15.37:0/795797311 wait complete. 2024-09-19T05:57:21.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:21.556+0000 7f2157050640 1 Processor -- start 2024-09-19T05:57:21.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:21.556+0000 7f2157050640 1 -- start start 2024-09-19T05:57:21.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:21.556+0000 7f2157050640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2150100510 0x7f21500fdb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:57:21.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:21.556+0000 7f2157050640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2150106620 con 0x7f2150100510 2024-09-19T05:57:21.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:21.556+0000 7f2154dec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2150100510 0x7f21500fdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:57:21.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:21.556+0000 7f2154dec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2150100510 0x7f21500fdb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47198/0 (socket says 172.21.15.37:47198) 2024-09-19T05:57:21.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:21.556+0000 7f2154dec640 1 -- 172.21.15.37:0/3869914675 learned_addr learned my addr 172.21.15.37:0/3869914675 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T05:57:21.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:21.557+0000 7f2154dec640 1 -- 172.21.15.37:0/3869914675 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21500fe0a0 con 0x7f2150100510 2024-09-19T05:57:21.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:21.557+0000 7f2154dec640 1 --2- 172.21.15.37:0/3869914675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2150100510 0x7f21500fdb60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f214002f040 tx=0x7f214002e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:57:21.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:21.557+0000 7f214dffb640 1 -- 172.21.15.37:0/3869914675 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2140047070 con 0x7f2150100510 2024-09-19T05:57:21.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:21.557+0000 7f214dffb640 1 -- 172.21.15.37:0/3869914675 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2140003e50 con 0x7f2150100510 2024-09-19T05:57:21.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:21.557+0000 7f214dffb640 1 -- 172.21.15.37:0/3869914675 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2140033050 con 0x7f2150100510 2024-09-19T05:57:21.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:21.557+0000 7f2157050640 1 -- 172.21.15.37:0/3869914675 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21500fc290 con 0x7f2150100510 2024-09-19T05:57:21.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:21.557+0000 7f2157050640 1 -- 172.21.15.37:0/3869914675 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21500fc7d0 con 0x7f2150100510 2024-09-19T05:57:21.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:21.558+0000 7f214dffb640 1 -- 172.21.15.37:0/3869914675 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f214004a070 con 0x7f2150100510 2024-09-19T05:57:21.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:21.558+0000 7f2157050640 1 -- 172.21.15.37:0/3869914675 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2150106da0 con 0x7f2150100510 2024-09-19T05:57:21.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:21.558+0000 7f214dffb640 1 --2- 172.21.15.37:0/3869914675 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f213c0392a0 0x7f213c03b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:57:21.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:21.559+0000 7f214dffb640 1 -- 172.21.15.37:0/3869914675 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f214003e030 con 0x7f2150100510 2024-09-19T05:57:21.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:21.559+0000 7f214ffff640 1 --2- 172.21.15.37:0/3869914675 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f213c0392a0 0x7f213c03b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:57:21.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:21.559+0000 7f214ffff640 1 --2- 172.21.15.37:0/3869914675 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f213c0392a0 0x7f213c03b760 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f21380098c0 tx=0x7f2138006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:57:21.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:21.563+0000 7f214dffb640 1 -- 172.21.15.37:0/3869914675 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2140004260 con 0x7f2150100510 2024-09-19T05:57:21.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:21.742+0000 7f2157050640 1 -- 172.21.15.37:0/3869914675 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f2150190290 con 0x7f2150100510 2024-09-19T05:57:21.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:21.745+0000 7f214dffb640 1 -- 172.21.15.37:0/3869914675 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f214004ac60 con 0x7f2150100510 2024-09-19T05:57:21.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:21.747+0000 7f2157050640 1 -- 172.21.15.37:0/3869914675 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f213c0392a0 msgr2=0x7f213c03b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:57:21.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:21.747+0000 7f2157050640 1 --2- 172.21.15.37:0/3869914675 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f213c0392a0 0x7f213c03b760 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f21380098c0 tx=0x7f2138006db0 comp rx=0 tx=0).stop 2024-09-19T05:57:21.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:21.747+0000 7f2157050640 1 -- 172.21.15.37:0/3869914675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2150100510 msgr2=0x7f21500fdb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:57:21.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:21.747+0000 7f2157050640 1 --2- 172.21.15.37:0/3869914675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2150100510 0x7f21500fdb60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f214002f040 tx=0x7f214002e3c0 comp rx=0 tx=0).stop 2024-09-19T05:57:21.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:21.747+0000 7f2157050640 1 -- 172.21.15.37:0/3869914675 shutdown_connections 2024-09-19T05:57:21.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:21.747+0000 7f2157050640 1 --2- 172.21.15.37:0/3869914675 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f213c0392a0 0x7f213c03b760 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:21.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:21.747+0000 7f2157050640 1 --2- 172.21.15.37:0/3869914675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2150100510 0x7f21500fdb60 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:21.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:21.747+0000 7f2157050640 1 -- 172.21.15.37:0/3869914675 >> 172.21.15.37:0/3869914675 conn(0x7f21500fbc80 msgr2=0x7f215006a370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:57:21.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:21.747+0000 7f2157050640 1 -- 172.21.15.37:0/3869914675 shutdown_connections 2024-09-19T05:57:21.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:21.747+0000 7f2157050640 1 -- 172.21.15.37:0/3869914675 wait complete. 2024-09-19T05:57:22.322 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-19T05:57:22.322 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-19T05:57:22.792 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:57:23.024 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:22 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/3869914675' entity='client.admin' 2024-09-19T05:57:23.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:23.237+0000 7f8148672640 1 -- 172.21.15.37:0/1887731766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81400fff40 msgr2=0x7f8140100340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:57:23.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:23.237+0000 7f8148672640 1 --2- 172.21.15.37:0/1887731766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81400fff40 0x7f8140100340 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f813c009880 tx=0x7f813c02a5d0 comp rx=0 tx=0).stop 2024-09-19T05:57:23.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:23.237+0000 7f8148672640 1 -- 172.21.15.37:0/1887731766 shutdown_connections 2024-09-19T05:57:23.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:23.237+0000 7f8148672640 1 --2- 172.21.15.37:0/1887731766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81400fff40 0x7f8140100340 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:23.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:23.237+0000 7f8148672640 1 -- 172.21.15.37:0/1887731766 >> 172.21.15.37:0/1887731766 conn(0x7f81400fbcd0 msgr2=0x7f81400fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:57:23.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:23.237+0000 7f8148672640 1 -- 172.21.15.37:0/1887731766 shutdown_connections 2024-09-19T05:57:23.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:23.237+0000 7f8148672640 1 -- 172.21.15.37:0/1887731766 wait complete. 2024-09-19T05:57:23.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:23.238+0000 7f8148672640 1 Processor -- start 2024-09-19T05:57:23.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:23.238+0000 7f8148672640 1 -- start start 2024-09-19T05:57:23.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:23.238+0000 7f8148672640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81400fff40 0x7f8140198f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:57:23.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:23.238+0000 7f8148672640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f81401098d0 con 0x7f81400fff40 2024-09-19T05:57:23.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:23.238+0000 7f814640e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81400fff40 0x7f8140198f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:57:23.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:23.238+0000 7f814640e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81400fff40 0x7f8140198f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47222/0 (socket says 172.21.15.37:47222) 2024-09-19T05:57:23.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:23.238+0000 7f814640e640 1 -- 172.21.15.37:0/2001775259 learned_addr learned my addr 172.21.15.37:0/2001775259 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T05:57:23.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:23.239+0000 7f814640e640 1 -- 172.21.15.37:0/2001775259 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81401994c0 con 0x7f81400fff40 2024-09-19T05:57:23.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:23.239+0000 7f814640e640 1 --2- 172.21.15.37:0/2001775259 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81400fff40 0x7f8140198f80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f813c004f60 tx=0x7f813c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:57:23.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:23.239+0000 7f81377fe640 1 -- 172.21.15.37:0/2001775259 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f813c03f070 con 0x7f81400fff40 2024-09-19T05:57:23.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:23.239+0000 7f81377fe640 1 -- 172.21.15.37:0/2001775259 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f813c003ad0 con 0x7f81400fff40 2024-09-19T05:57:23.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:23.239+0000 7f8148672640 1 -- 172.21.15.37:0/2001775259 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8140199750 con 0x7f81400fff40 2024-09-19T05:57:23.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:23.239+0000 7f81377fe640 1 -- 172.21.15.37:0/2001775259 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f813c035030 con 0x7f81400fff40 2024-09-19T05:57:23.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:23.239+0000 7f8148672640 1 -- 172.21.15.37:0/2001775259 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f814019c440 con 0x7f81400fff40 2024-09-19T05:57:23.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:23.240+0000 7f81377fe640 1 -- 172.21.15.37:0/2001775259 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f813c042070 con 0x7f81400fff40 2024-09-19T05:57:23.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:23.240+0000 7f81377fe640 1 --2- 172.21.15.37:0/2001775259 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f812c039300 0x7f812c03b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:57:23.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:23.240+0000 7f8148672640 1 -- 172.21.15.37:0/2001775259 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f814010a050 con 0x7f81400fff40 2024-09-19T05:57:23.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:23.240+0000 7f81377fe640 1 -- 172.21.15.37:0/2001775259 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f813c06d030 con 0x7f81400fff40 2024-09-19T05:57:23.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:23.240+0000 7f8145c0d640 1 --2- 172.21.15.37:0/2001775259 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f812c039300 0x7f812c03b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:57:23.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:23.241+0000 7f8145c0d640 1 --2- 172.21.15.37:0/2001775259 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f812c039300 0x7f812c03b7c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f81300098c0 tx=0x7f8130006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:57:23.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:23.245+0000 7f81377fe640 1 -- 172.21.15.37:0/2001775259 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f813c04c350 con 0x7f81400fff40 2024-09-19T05:57:23.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:23.426+0000 7f8148672640 1 -- 172.21.15.37:0/2001775259 --> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f814002d830 con 0x7f812c039300 2024-09-19T05:57:23.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:23.430+0000 7f81377fe640 1 -- 172.21.15.37:0/2001775259 <== mgr.14148 v2:172.21.15.37:6800/3797010169 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f814002d830 con 0x7f812c039300 2024-09-19T05:57:23.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:23.432+0000 7f8148672640 1 -- 172.21.15.37:0/2001775259 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f812c039300 msgr2=0x7f812c03b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:57:23.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:23.432+0000 7f8148672640 1 --2- 172.21.15.37:0/2001775259 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f812c039300 0x7f812c03b7c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f81300098c0 tx=0x7f8130006db0 comp rx=0 tx=0).stop 2024-09-19T05:57:23.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:23.432+0000 7f8148672640 1 -- 172.21.15.37:0/2001775259 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81400fff40 msgr2=0x7f8140198f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:57:23.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:23.432+0000 7f8148672640 1 --2- 172.21.15.37:0/2001775259 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81400fff40 0x7f8140198f80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f813c004f60 tx=0x7f813c0048f0 comp rx=0 tx=0).stop 2024-09-19T05:57:23.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:23.432+0000 7f8148672640 1 -- 172.21.15.37:0/2001775259 shutdown_connections 2024-09-19T05:57:23.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:23.432+0000 7f8148672640 1 --2- 172.21.15.37:0/2001775259 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f812c039300 0x7f812c03b7c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:23.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:23.432+0000 7f8148672640 1 --2- 172.21.15.37:0/2001775259 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81400fff40 0x7f8140198f80 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:23.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:23.432+0000 7f8148672640 1 -- 172.21.15.37:0/2001775259 >> 172.21.15.37:0/2001775259 conn(0x7f81400fbcd0 msgr2=0x7f81400fc800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:57:23.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:23.432+0000 7f8148672640 1 -- 172.21.15.37:0/2001775259 shutdown_connections 2024-09-19T05:57:23.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:23.432+0000 7f8148672640 1 -- 172.21.15.37:0/2001775259 wait complete. 2024-09-19T05:57:24.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:23 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:57:24.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:23 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:57:24.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:23 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi037", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:57:24.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:23 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:57:24.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:23 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:57:24.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:23 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:57:24.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:23 smithi037 ceph-mon[31211]: from='client.14170 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:57:24.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:23 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:57:24.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:23 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:57:24.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:23 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:57:24.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:23 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:57:24.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:23 smithi037 ceph-mon[31211]: Updating smithi037:/etc/ceph/ceph.conf 2024-09-19T05:57:24.293 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi099 2024-09-19T05:57:24.293 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-19T05:57:24.293 DEBUG:teuthology.orchestra.run.smithi099:> dd of=/etc/ceph/ceph.conf 2024-09-19T05:57:24.313 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-19T05:57:24.313 DEBUG:teuthology.orchestra.run.smithi099:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T05:57:24.371 INFO:tasks.cephadm:Adding host smithi099 to orchestrator... 2024-09-19T05:57:24.372 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph orch host add smithi099 2024-09-19T05:57:24.620 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:57:25.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:25.020+0000 7f015583d640 1 -- 172.21.15.37:0/1899632162 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0150100320 msgr2=0x7f0150100700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:57:25.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:25.020+0000 7f015583d640 1 --2- 172.21.15.37:0/1899632162 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0150100320 0x7f0150100700 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0140009c10 tx=0x7f014002aa10 comp rx=0 tx=0).stop 2024-09-19T05:57:25.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:25.020+0000 7f015583d640 1 -- 172.21.15.37:0/1899632162 shutdown_connections 2024-09-19T05:57:25.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:25.020+0000 7f015583d640 1 --2- 172.21.15.37:0/1899632162 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0150100320 0x7f0150100700 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:25.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:25.020+0000 7f015583d640 1 -- 172.21.15.37:0/1899632162 >> 172.21.15.37:0/1899632162 conn(0x7f0150077310 msgr2=0x7f01500fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:57:25.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:25.020+0000 7f015583d640 1 -- 172.21.15.37:0/1899632162 shutdown_connections 2024-09-19T05:57:25.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:25.020+0000 7f015583d640 1 -- 172.21.15.37:0/1899632162 wait complete. 2024-09-19T05:57:25.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:25.020+0000 7f015583d640 1 Processor -- start 2024-09-19T05:57:25.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:25.020+0000 7f015583d640 1 -- start start 2024-09-19T05:57:25.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:25.020+0000 7f015583d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0150100320 0x7f0150199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:57:25.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:25.021+0000 7f015583d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f015010de80 con 0x7f0150100320 2024-09-19T05:57:25.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:25.021+0000 7f014effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0150100320 0x7f0150199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:57:25.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:25.021+0000 7f014effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0150100320 0x7f0150199390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59378/0 (socket says 172.21.15.37:59378) 2024-09-19T05:57:25.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:25.021+0000 7f014effd640 1 -- 172.21.15.37:0/1828459662 learned_addr learned my addr 172.21.15.37:0/1828459662 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T05:57:25.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:25.021+0000 7f014effd640 1 -- 172.21.15.37:0/1828459662 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01501998d0 con 0x7f0150100320 2024-09-19T05:57:25.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:25.021+0000 7f014effd640 1 --2- 172.21.15.37:0/1828459662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0150100320 0x7f0150199390 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0140005dd0 tx=0x7f0140030c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:57:25.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:25.021+0000 7f015483b640 1 -- 172.21.15.37:0/1828459662 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0140034070 con 0x7f0150100320 2024-09-19T05:57:25.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:25.021+0000 7f015583d640 1 -- 172.21.15.37:0/1828459662 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0150199b60 con 0x7f0150100320 2024-09-19T05:57:25.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:25.021+0000 7f015483b640 1 -- 172.21.15.37:0/1828459662 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f014002f8c0 con 0x7f0150100320 2024-09-19T05:57:25.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:25.021+0000 7f015483b640 1 -- 172.21.15.37:0/1828459662 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0140004520 con 0x7f0150100320 2024-09-19T05:57:25.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:25.021+0000 7f015583d640 1 -- 172.21.15.37:0/1828459662 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0150199f00 con 0x7f0150100320 2024-09-19T05:57:25.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:25.022+0000 7f015483b640 1 -- 172.21.15.37:0/1828459662 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f0140037020 con 0x7f0150100320 2024-09-19T05:57:25.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:25.022+0000 7f015483b640 1 --2- 172.21.15.37:0/1828459662 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f013c0392a0 0x7f013c03b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:57:25.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:25.022+0000 7f015483b640 1 -- 172.21.15.37:0/1828459662 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f014006d220 con 0x7f0150100320 2024-09-19T05:57:25.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:25.023+0000 7f015583d640 1 -- 172.21.15.37:0/1828459662 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0150069f30 con 0x7f0150100320 2024-09-19T05:57:25.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:25.023+0000 7f014e7fc640 1 --2- 172.21.15.37:0/1828459662 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f013c0392a0 0x7f013c03b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:57:25.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:25.023+0000 7f014e7fc640 1 --2- 172.21.15.37:0/1828459662 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f013c0392a0 0x7f013c03b760 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f01380098c0 tx=0x7f0138006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:57:25.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:25.028+0000 7f015483b640 1 -- 172.21.15.37:0/1828459662 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f014003f070 con 0x7f0150100320 2024-09-19T05:57:25.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:25.206+0000 7f015583d640 1 -- 172.21.15.37:0/1828459662 --> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi099", "target": ["mon-mgr", ""]}) -- 0x7f015019a6f0 con 0x7f013c0392a0 2024-09-19T05:57:25.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:25 smithi037 ceph-mon[31211]: Updating smithi037:/var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T05:57:25.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:25 smithi037 ceph-mon[31211]: Updating smithi037:/etc/ceph/ceph.client.admin.keyring 2024-09-19T05:57:25.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:25 smithi037 ceph-mon[31211]: Updating smithi037:/var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T05:57:25.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:25 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:57:25.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:25 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:57:25.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:25 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:57:26.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:26 smithi037 ceph-mon[31211]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi099", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:57:27.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:27 smithi037 ceph-mon[31211]: Deploying cephadm binary to smithi099 2024-09-19T05:57:29.052 INFO:teuthology.orchestra.run.smithi037.stdout:Added host 'smithi099' with addr '172.21.15.99' 2024-09-19T05:57:29.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:29.051+0000 7f015483b640 1 -- 172.21.15.37:0/1828459662 <== mgr.14148 v2:172.21.15.37:6800/3797010169 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f015019a6f0 con 0x7f013c0392a0 2024-09-19T05:57:29.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:29.054+0000 7f015583d640 1 -- 172.21.15.37:0/1828459662 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f013c0392a0 msgr2=0x7f013c03b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:57:29.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:29.054+0000 7f015583d640 1 --2- 172.21.15.37:0/1828459662 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f013c0392a0 0x7f013c03b760 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f01380098c0 tx=0x7f0138006db0 comp rx=0 tx=0).stop 2024-09-19T05:57:29.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:29.054+0000 7f015583d640 1 -- 172.21.15.37:0/1828459662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0150100320 msgr2=0x7f0150199390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:57:29.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:29.054+0000 7f015583d640 1 --2- 172.21.15.37:0/1828459662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0150100320 0x7f0150199390 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0140005dd0 tx=0x7f0140030c30 comp rx=0 tx=0).stop 2024-09-19T05:57:29.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:29.054+0000 7f015583d640 1 -- 172.21.15.37:0/1828459662 shutdown_connections 2024-09-19T05:57:29.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:29.054+0000 7f015583d640 1 --2- 172.21.15.37:0/1828459662 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f013c0392a0 0x7f013c03b760 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:29.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:29.054+0000 7f015583d640 1 --2- 172.21.15.37:0/1828459662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0150100320 0x7f0150199390 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:29.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:29.054+0000 7f015583d640 1 -- 172.21.15.37:0/1828459662 >> 172.21.15.37:0/1828459662 conn(0x7f0150077310 msgr2=0x7f01500fe310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:57:29.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:29.054+0000 7f015583d640 1 -- 172.21.15.37:0/1828459662 shutdown_connections 2024-09-19T05:57:29.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:29.054+0000 7f015583d640 1 -- 172.21.15.37:0/1828459662 wait complete. 2024-09-19T05:57:29.709 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-19T05:57:29.964 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:57:30.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:30 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:57:30.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:30 smithi037 ceph-mon[31211]: Added host smithi099 2024-09-19T05:57:30.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:30 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:57:30.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:30 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:57:30.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:30 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:57:30.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:30.419+0000 7f9c8904a640 1 -- 172.21.15.37:0/1065121496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c84102750 msgr2=0x7f9c84102b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:57:30.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:30.419+0000 7f9c8904a640 1 --2- 172.21.15.37:0/1065121496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c84102750 0x7f9c84102b30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9c74009880 tx=0x7f9c7402a670 comp rx=0 tx=0).stop 2024-09-19T05:57:30.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:30.419+0000 7f9c8904a640 1 -- 172.21.15.37:0/1065121496 shutdown_connections 2024-09-19T05:57:30.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:30.419+0000 7f9c8904a640 1 --2- 172.21.15.37:0/1065121496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c84102750 0x7f9c84102b30 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:30.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:30.419+0000 7f9c8904a640 1 -- 172.21.15.37:0/1065121496 >> 172.21.15.37:0/1065121496 conn(0x7f9c840fc1b0 msgr2=0x7f9c840fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:57:30.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:30.419+0000 7f9c8904a640 1 -- 172.21.15.37:0/1065121496 shutdown_connections 2024-09-19T05:57:30.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:30.419+0000 7f9c8904a640 1 -- 172.21.15.37:0/1065121496 wait complete. 2024-09-19T05:57:30.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:30.419+0000 7f9c8904a640 1 Processor -- start 2024-09-19T05:57:30.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:30.420+0000 7f9c8904a640 1 -- start start 2024-09-19T05:57:30.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:30.420+0000 7f9c8904a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c84102750 0x7f9c841971d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:57:30.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:30.420+0000 7f9c8904a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9c8410bcc0 con 0x7f9c84102750 2024-09-19T05:57:30.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:30.420+0000 7f9c82d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c84102750 0x7f9c841971d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:57:30.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:30.420+0000 7f9c82d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c84102750 0x7f9c841971d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59392/0 (socket says 172.21.15.37:59392) 2024-09-19T05:57:30.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:30.420+0000 7f9c82d9d640 1 -- 172.21.15.37:0/872588050 learned_addr learned my addr 172.21.15.37:0/872588050 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T05:57:30.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:30.420+0000 7f9c82d9d640 1 -- 172.21.15.37:0/872588050 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c84197710 con 0x7f9c84102750 2024-09-19T05:57:30.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:30.420+0000 7f9c82d9d640 1 --2- 172.21.15.37:0/872588050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c84102750 0x7f9c841971d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9c74009230 tx=0x7f9c74003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:57:30.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:30.421+0000 7f9c6bfff640 1 -- 172.21.15.37:0/872588050 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c7403f070 con 0x7f9c84102750 2024-09-19T05:57:30.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:30.421+0000 7f9c6bfff640 1 -- 172.21.15.37:0/872588050 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c7403bc80 con 0x7f9c84102750 2024-09-19T05:57:30.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:30.421+0000 7f9c6bfff640 1 -- 172.21.15.37:0/872588050 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c74035030 con 0x7f9c84102750 2024-09-19T05:57:30.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:30.421+0000 7f9c8904a640 1 -- 172.21.15.37:0/872588050 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c841979a0 con 0x7f9c84102750 2024-09-19T05:57:30.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:30.421+0000 7f9c8904a640 1 -- 172.21.15.37:0/872588050 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c84197e00 con 0x7f9c84102750 2024-09-19T05:57:30.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:30.422+0000 7f9c6bfff640 1 -- 172.21.15.37:0/872588050 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f9c74042070 con 0x7f9c84102750 2024-09-19T05:57:30.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:30.422+0000 7f9c8904a640 1 -- 172.21.15.37:0/872588050 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c8406a7b0 con 0x7f9c84102750 2024-09-19T05:57:30.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:30.422+0000 7f9c6bfff640 1 --2- 172.21.15.37:0/872588050 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f9c6c0392a0 0x7f9c6c03b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:57:30.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:30.422+0000 7f9c6bfff640 1 -- 172.21.15.37:0/872588050 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f9c7406cfe0 con 0x7f9c84102750 2024-09-19T05:57:30.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:30.422+0000 7f9c8259c640 1 --2- 172.21.15.37:0/872588050 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f9c6c0392a0 0x7f9c6c03b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:57:30.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:30.422+0000 7f9c8259c640 1 --2- 172.21.15.37:0/872588050 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f9c6c0392a0 0x7f9c6c03b760 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9c780098c0 tx=0x7f9c78006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:57:30.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:30.427+0000 7f9c6bfff640 1 -- 172.21.15.37:0/872588050 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9c7404c350 con 0x7f9c84102750 2024-09-19T05:57:30.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:30.610+0000 7f9c8904a640 1 -- 172.21.15.37:0/872588050 --> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9c84198530 con 0x7f9c6c0392a0 2024-09-19T05:57:30.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:30.611+0000 7f9c6bfff640 1 -- 172.21.15.37:0/872588050 <== mgr.14148 v2:172.21.15.37:6800/3797010169 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+159 (secure 0 0 0) 0x7f9c84198530 con 0x7f9c6c0392a0 2024-09-19T05:57:30.612 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T05:57:30.612 INFO:teuthology.orchestra.run.smithi037.stdout:[{"addr": "172.21.15.37", "hostname": "smithi037", "labels": [], "status": ""}, {"addr": "172.21.15.99", "hostname": "smithi099", "labels": [], "status": ""}] 2024-09-19T05:57:30.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:30.613+0000 7f9c8904a640 1 -- 172.21.15.37:0/872588050 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f9c6c0392a0 msgr2=0x7f9c6c03b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:57:30.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:30.613+0000 7f9c8904a640 1 --2- 172.21.15.37:0/872588050 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f9c6c0392a0 0x7f9c6c03b760 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9c780098c0 tx=0x7f9c78006db0 comp rx=0 tx=0).stop 2024-09-19T05:57:30.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:30.613+0000 7f9c8904a640 1 -- 172.21.15.37:0/872588050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c84102750 msgr2=0x7f9c841971d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:57:30.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:30.613+0000 7f9c8904a640 1 --2- 172.21.15.37:0/872588050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c84102750 0x7f9c841971d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9c74009230 tx=0x7f9c74003d40 comp rx=0 tx=0).stop 2024-09-19T05:57:30.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:30.613+0000 7f9c8904a640 1 -- 172.21.15.37:0/872588050 shutdown_connections 2024-09-19T05:57:30.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:30.613+0000 7f9c8904a640 1 --2- 172.21.15.37:0/872588050 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f9c6c0392a0 0x7f9c6c03b760 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:30.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:30.613+0000 7f9c8904a640 1 --2- 172.21.15.37:0/872588050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c84102750 0x7f9c841971d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:30.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:30.613+0000 7f9c8904a640 1 -- 172.21.15.37:0/872588050 >> 172.21.15.37:0/872588050 conn(0x7f9c840fc1b0 msgr2=0x7f9c84105510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:57:30.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:30.614+0000 7f9c8904a640 1 -- 172.21.15.37:0/872588050 shutdown_connections 2024-09-19T05:57:30.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:30.614+0000 7f9c8904a640 1 -- 172.21.15.37:0/872588050 wait complete. 2024-09-19T05:57:31.170 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi117 2024-09-19T05:57:31.170 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-19T05:57:31.171 DEBUG:teuthology.orchestra.run.smithi117:> dd of=/etc/ceph/ceph.conf 2024-09-19T05:57:31.189 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-19T05:57:31.189 DEBUG:teuthology.orchestra.run.smithi117:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T05:57:31.247 INFO:tasks.cephadm:Adding host smithi117 to orchestrator... 2024-09-19T05:57:31.248 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph orch host add smithi117 2024-09-19T05:57:31.505 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:57:31.738 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:31 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:57:31.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:31.933+0000 7ff049aaa640 1 -- 172.21.15.37:0/3346704240 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff044102750 msgr2=0x7ff044102b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:57:31.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:31.933+0000 7ff049aaa640 1 --2- 172.21.15.37:0/3346704240 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff044102750 0x7ff044102b30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff034009880 tx=0x7ff03402a670 comp rx=0 tx=0).stop 2024-09-19T05:57:31.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:31.933+0000 7ff049aaa640 1 -- 172.21.15.37:0/3346704240 shutdown_connections 2024-09-19T05:57:31.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:31.933+0000 7ff049aaa640 1 --2- 172.21.15.37:0/3346704240 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff044102750 0x7ff044102b30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:31.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:31.933+0000 7ff049aaa640 1 -- 172.21.15.37:0/3346704240 >> 172.21.15.37:0/3346704240 conn(0x7ff0440fc1b0 msgr2=0x7ff0440fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:57:31.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:31.933+0000 7ff049aaa640 1 -- 172.21.15.37:0/3346704240 shutdown_connections 2024-09-19T05:57:31.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:31.933+0000 7ff049aaa640 1 -- 172.21.15.37:0/3346704240 wait complete. 2024-09-19T05:57:31.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:31.934+0000 7ff049aaa640 1 Processor -- start 2024-09-19T05:57:31.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:31.934+0000 7ff049aaa640 1 -- start start 2024-09-19T05:57:31.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:31.934+0000 7ff049aaa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff044102750 0x7ff0441971d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:57:31.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:31.934+0000 7ff049aaa640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff04410bcc0 con 0x7ff044102750 2024-09-19T05:57:31.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:31.934+0000 7ff0437fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff044102750 0x7ff0441971d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:57:31.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:31.934+0000 7ff0437fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff044102750 0x7ff0441971d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59406/0 (socket says 172.21.15.37:59406) 2024-09-19T05:57:31.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:31.934+0000 7ff0437fe640 1 -- 172.21.15.37:0/2721820749 learned_addr learned my addr 172.21.15.37:0/2721820749 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T05:57:31.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:31.934+0000 7ff0437fe640 1 -- 172.21.15.37:0/2721820749 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff044197710 con 0x7ff044102750 2024-09-19T05:57:31.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:31.935+0000 7ff0437fe640 1 --2- 172.21.15.37:0/2721820749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff044102750 0x7ff0441971d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff034009230 tx=0x7ff034003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:57:31.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:31.935+0000 7ff040ff9640 1 -- 172.21.15.37:0/2721820749 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff03403f070 con 0x7ff044102750 2024-09-19T05:57:31.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:31.935+0000 7ff040ff9640 1 -- 172.21.15.37:0/2721820749 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff03403bd40 con 0x7ff044102750 2024-09-19T05:57:31.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:31.935+0000 7ff049aaa640 1 -- 172.21.15.37:0/2721820749 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0441979a0 con 0x7ff044102750 2024-09-19T05:57:31.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:31.935+0000 7ff040ff9640 1 -- 172.21.15.37:0/2721820749 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff034035030 con 0x7ff044102750 2024-09-19T05:57:31.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:31.935+0000 7ff049aaa640 1 -- 172.21.15.37:0/2721820749 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff044197e00 con 0x7ff044102750 2024-09-19T05:57:31.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:31.936+0000 7ff040ff9640 1 -- 172.21.15.37:0/2721820749 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7ff034042070 con 0x7ff044102750 2024-09-19T05:57:31.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:31.936+0000 7ff049aaa640 1 -- 172.21.15.37:0/2721820749 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff04406a7b0 con 0x7ff044102750 2024-09-19T05:57:31.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:31.936+0000 7ff040ff9640 1 --2- 172.21.15.37:0/2721820749 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7ff02c039300 0x7ff02c03b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:57:31.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:31.936+0000 7ff040ff9640 1 -- 172.21.15.37:0/2721820749 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7ff03406ced0 con 0x7ff044102750 2024-09-19T05:57:31.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:31.936+0000 7ff042ffd640 1 --2- 172.21.15.37:0/2721820749 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7ff02c039300 0x7ff02c03b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:57:31.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:31.937+0000 7ff042ffd640 1 --2- 172.21.15.37:0/2721820749 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7ff02c039300 0x7ff02c03b7c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff0380098c0 tx=0x7ff038006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:57:31.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:31.941+0000 7ff040ff9640 1 -- 172.21.15.37:0/2721820749 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff03403a8e0 con 0x7ff044102750 2024-09-19T05:57:32.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:32.121+0000 7ff049aaa640 1 -- 172.21.15.37:0/2721820749 --> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi117", "target": ["mon-mgr", ""]}) -- 0x7ff044198530 con 0x7ff02c039300 2024-09-19T05:57:32.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:32 smithi037 ceph-mon[31211]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T05:57:33.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:33 smithi037 ceph-mon[31211]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi117", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:57:33.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:33 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:57:33.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:33 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:57:33.825 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:33 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:57:33.825 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:33 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:57:33.825 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:33 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi099", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:57:33.825 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:33 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:57:33.825 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:33 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:57:34.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:34 smithi037 ceph-mon[31211]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:57:34.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:34 smithi037 ceph-mon[31211]: Updating smithi099:/etc/ceph/ceph.conf 2024-09-19T05:57:34.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:34 smithi037 ceph-mon[31211]: Deploying cephadm binary to smithi117 2024-09-19T05:57:34.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:34 smithi037 ceph-mon[31211]: Updating smithi099:/var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T05:57:34.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:34 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:57:34.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:34 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:57:34.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:34 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:57:35.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:35 smithi037 ceph-mon[31211]: Updating smithi099:/etc/ceph/ceph.client.admin.keyring 2024-09-19T05:57:35.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:35 smithi037 ceph-mon[31211]: Updating smithi099:/var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T05:57:35.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:35.952+0000 7ff040ff9640 1 -- 172.21.15.37:0/2721820749 <== mgr.14148 v2:172.21.15.37:6800/3797010169 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7ff044198530 con 0x7ff02c039300 2024-09-19T05:57:35.954 INFO:teuthology.orchestra.run.smithi037.stdout:Added host 'smithi117' with addr '172.21.15.117' 2024-09-19T05:57:35.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:35.955+0000 7ff049aaa640 1 -- 172.21.15.37:0/2721820749 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7ff02c039300 msgr2=0x7ff02c03b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:57:35.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:35.955+0000 7ff049aaa640 1 --2- 172.21.15.37:0/2721820749 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7ff02c039300 0x7ff02c03b7c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff0380098c0 tx=0x7ff038006db0 comp rx=0 tx=0).stop 2024-09-19T05:57:35.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:35.955+0000 7ff049aaa640 1 -- 172.21.15.37:0/2721820749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff044102750 msgr2=0x7ff0441971d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:57:35.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:35.955+0000 7ff049aaa640 1 --2- 172.21.15.37:0/2721820749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff044102750 0x7ff0441971d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff034009230 tx=0x7ff034003d80 comp rx=0 tx=0).stop 2024-09-19T05:57:35.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:35.955+0000 7ff049aaa640 1 -- 172.21.15.37:0/2721820749 shutdown_connections 2024-09-19T05:57:35.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:35.955+0000 7ff049aaa640 1 --2- 172.21.15.37:0/2721820749 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7ff02c039300 0x7ff02c03b7c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:35.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:35.955+0000 7ff049aaa640 1 --2- 172.21.15.37:0/2721820749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff044102750 0x7ff0441971d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:35.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:35.955+0000 7ff049aaa640 1 -- 172.21.15.37:0/2721820749 >> 172.21.15.37:0/2721820749 conn(0x7ff0440fc1b0 msgr2=0x7ff044105510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:57:35.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:35.955+0000 7ff049aaa640 1 -- 172.21.15.37:0/2721820749 shutdown_connections 2024-09-19T05:57:35.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:35.955+0000 7ff049aaa640 1 -- 172.21.15.37:0/2721820749 wait complete. 2024-09-19T05:57:36.517 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:36 smithi037 ceph-mon[31211]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:57:36.517 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:36 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:57:36.517 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:36 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:57:36.517 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:36 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:57:36.519 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-19T05:57:36.771 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:57:37.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:37.212+0000 7f00108ea640 1 -- 172.21.15.37:0/3341996228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f000c107640 msgr2=0x7f000c107a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:57:37.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:37.212+0000 7f00108ea640 1 --2- 172.21.15.37:0/3341996228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f000c107640 0x7f000c107a20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7efffc009880 tx=0x7efffc02a5d0 comp rx=0 tx=0).stop 2024-09-19T05:57:37.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:37.212+0000 7f00108ea640 1 -- 172.21.15.37:0/3341996228 shutdown_connections 2024-09-19T05:57:37.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:37.212+0000 7f00108ea640 1 --2- 172.21.15.37:0/3341996228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f000c107640 0x7f000c107a20 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:37.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:37.212+0000 7f00108ea640 1 -- 172.21.15.37:0/3341996228 >> 172.21.15.37:0/3341996228 conn(0x7f000c0fd230 msgr2=0x7f000c0ff650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:57:37.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:37.212+0000 7f00108ea640 1 -- 172.21.15.37:0/3341996228 shutdown_connections 2024-09-19T05:57:37.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:37.212+0000 7f00108ea640 1 -- 172.21.15.37:0/3341996228 wait complete. 2024-09-19T05:57:37.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:37.213+0000 7f00108ea640 1 Processor -- start 2024-09-19T05:57:37.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:37.213+0000 7f00108ea640 1 -- start start 2024-09-19T05:57:37.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:37.213+0000 7f00108ea640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f000c107640 0x7f000c199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:57:37.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:37.213+0000 7f00108ea640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f000c10bc70 con 0x7f000c107640 2024-09-19T05:57:37.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:37.213+0000 7f000a59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f000c107640 0x7f000c199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:57:37.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:37.213+0000 7f000a59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f000c107640 0x7f000c199300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41862/0 (socket says 172.21.15.37:41862) 2024-09-19T05:57:37.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:37.213+0000 7f000a59c640 1 -- 172.21.15.37:0/116074113 learned_addr learned my addr 172.21.15.37:0/116074113 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T05:57:37.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:37.214+0000 7f000a59c640 1 -- 172.21.15.37:0/116074113 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f000c199840 con 0x7f000c107640 2024-09-19T05:57:37.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:37.214+0000 7f000a59c640 1 --2- 172.21.15.37:0/116074113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f000c107640 0x7f000c199300 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7efffc009230 tx=0x7efffc003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:57:37.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:37.214+0000 7f00037fe640 1 -- 172.21.15.37:0/116074113 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efffc03f070 con 0x7f000c107640 2024-09-19T05:57:37.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:37.214+0000 7f00037fe640 1 -- 172.21.15.37:0/116074113 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efffc03bc80 con 0x7f000c107640 2024-09-19T05:57:37.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:37.214+0000 7f00108ea640 1 -- 172.21.15.37:0/116074113 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f000c199ad0 con 0x7f000c107640 2024-09-19T05:57:37.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:37.214+0000 7f00037fe640 1 -- 172.21.15.37:0/116074113 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efffc035030 con 0x7f000c107640 2024-09-19T05:57:37.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:37.214+0000 7f00108ea640 1 -- 172.21.15.37:0/116074113 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f000c19dbd0 con 0x7f000c107640 2024-09-19T05:57:37.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:37.215+0000 7f00037fe640 1 -- 172.21.15.37:0/116074113 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7efffc042070 con 0x7f000c107640 2024-09-19T05:57:37.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:37.215+0000 7f00037fe640 1 --2- 172.21.15.37:0/116074113 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7efff80392a0 0x7efff803b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:57:37.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:37.216+0000 7f00037fe640 1 -- 172.21.15.37:0/116074113 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7efffc0314c0 con 0x7f000c107640 2024-09-19T05:57:37.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:37.216+0000 7f0009d9b640 1 --2- 172.21.15.37:0/116074113 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7efff80392a0 0x7efff803b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:57:37.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:37.216+0000 7f00108ea640 1 -- 172.21.15.37:0/116074113 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f000c102cb0 con 0x7f000c107640 2024-09-19T05:57:37.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:37.216+0000 7f0009d9b640 1 --2- 172.21.15.37:0/116074113 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7efff80392a0 0x7efff803b760 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7efff40098c0 tx=0x7efff4006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:57:37.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:37.221+0000 7f00037fe640 1 -- 172.21.15.37:0/116074113 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7efffc04c350 con 0x7f000c107640 2024-09-19T05:57:37.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:37.414+0000 7f00108ea640 1 -- 172.21.15.37:0/116074113 --> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f000c19a660 con 0x7efff80392a0 2024-09-19T05:57:37.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:37.415+0000 7f00037fe640 1 -- 172.21.15.37:0/116074113 <== mgr.14148 v2:172.21.15.37:6800/3797010169 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+239 (secure 0 0 0) 0x7f000c19a660 con 0x7efff80392a0 2024-09-19T05:57:37.417 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T05:57:37.417 INFO:teuthology.orchestra.run.smithi037.stdout:[{"addr": "172.21.15.37", "hostname": "smithi037", "labels": [], "status": ""}, {"addr": "172.21.15.99", "hostname": "smithi099", "labels": [], "status": ""}, {"addr": "172.21.15.117", "hostname": "smithi117", "labels": [], "status": ""}] 2024-09-19T05:57:37.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:37.417+0000 7f00108ea640 1 -- 172.21.15.37:0/116074113 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7efff80392a0 msgr2=0x7efff803b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:57:37.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:37.417+0000 7f00108ea640 1 --2- 172.21.15.37:0/116074113 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7efff80392a0 0x7efff803b760 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7efff40098c0 tx=0x7efff4006db0 comp rx=0 tx=0).stop 2024-09-19T05:57:37.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:37.417+0000 7f00108ea640 1 -- 172.21.15.37:0/116074113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f000c107640 msgr2=0x7f000c199300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:57:37.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:37.417+0000 7f00108ea640 1 --2- 172.21.15.37:0/116074113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f000c107640 0x7f000c199300 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7efffc009230 tx=0x7efffc003d40 comp rx=0 tx=0).stop 2024-09-19T05:57:37.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:37.417+0000 7f00108ea640 1 -- 172.21.15.37:0/116074113 shutdown_connections 2024-09-19T05:57:37.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:37.417+0000 7f00108ea640 1 --2- 172.21.15.37:0/116074113 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7efff80392a0 0x7efff803b760 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:37.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:37.417+0000 7f00108ea640 1 --2- 172.21.15.37:0/116074113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f000c107640 0x7f000c199300 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:37.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:37.417+0000 7f00108ea640 1 -- 172.21.15.37:0/116074113 >> 172.21.15.37:0/116074113 conn(0x7f000c0fd230 msgr2=0x7f000c0fde00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:57:37.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:37.417+0000 7f00108ea640 1 -- 172.21.15.37:0/116074113 shutdown_connections 2024-09-19T05:57:37.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:37.417+0000 7f00108ea640 1 -- 172.21.15.37:0/116074113 wait complete. 2024-09-19T05:57:37.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:37 smithi037 ceph-mon[31211]: Added host smithi117 2024-09-19T05:57:37.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:37 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:57:37.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:37 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:57:38.093 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-19T05:57:38.094 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-19T05:57:38.346 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:57:38.722 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:38 smithi037 ceph-mon[31211]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:57:38.722 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:38 smithi037 ceph-mon[31211]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T05:57:38.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:38.804+0000 7eff6e3e9640 1 -- 172.21.15.37:0/2485053765 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff68107660 msgr2=0x7eff68107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:57:38.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:38.804+0000 7eff6e3e9640 1 --2- 172.21.15.37:0/2485053765 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff68107660 0x7eff68107a40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7eff58009880 tx=0x7eff5802a5d0 comp rx=0 tx=0).stop 2024-09-19T05:57:38.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:38.804+0000 7eff6e3e9640 1 -- 172.21.15.37:0/2485053765 shutdown_connections 2024-09-19T05:57:38.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:38.804+0000 7eff6e3e9640 1 --2- 172.21.15.37:0/2485053765 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff68107660 0x7eff68107a40 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:38.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:38.804+0000 7eff6e3e9640 1 -- 172.21.15.37:0/2485053765 >> 172.21.15.37:0/2485053765 conn(0x7eff680fd290 msgr2=0x7eff680ff6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:57:38.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:38.804+0000 7eff6e3e9640 1 -- 172.21.15.37:0/2485053765 shutdown_connections 2024-09-19T05:57:38.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:38.804+0000 7eff6e3e9640 1 -- 172.21.15.37:0/2485053765 wait complete. 2024-09-19T05:57:38.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:38.805+0000 7eff6e3e9640 1 Processor -- start 2024-09-19T05:57:38.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:38.805+0000 7eff6e3e9640 1 -- start start 2024-09-19T05:57:38.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:38.805+0000 7eff6e3e9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff68107660 0x7eff680744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:57:38.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:38.805+0000 7eff6e3e9640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7eff6810bc90 con 0x7eff68107660 2024-09-19T05:57:38.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:38.805+0000 7eff67fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff68107660 0x7eff680744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:57:38.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:38.805+0000 7eff67fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff68107660 0x7eff680744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41886/0 (socket says 172.21.15.37:41886) 2024-09-19T05:57:38.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:38.805+0000 7eff67fff640 1 -- 172.21.15.37:0/1090898984 learned_addr learned my addr 172.21.15.37:0/1090898984 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T05:57:38.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:38.805+0000 7eff67fff640 1 -- 172.21.15.37:0/1090898984 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff680763e0 con 0x7eff68107660 2024-09-19T05:57:38.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:38.806+0000 7eff67fff640 1 --2- 172.21.15.37:0/1090898984 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff68107660 0x7eff680744f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7eff58009230 tx=0x7eff58003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:57:38.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:38.806+0000 7eff657fa640 1 -- 172.21.15.37:0/1090898984 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff5803f070 con 0x7eff68107660 2024-09-19T05:57:38.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:38.806+0000 7eff657fa640 1 -- 172.21.15.37:0/1090898984 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff5803bc80 con 0x7eff68107660 2024-09-19T05:57:38.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:38.806+0000 7eff6e3e9640 1 -- 172.21.15.37:0/1090898984 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff68074a30 con 0x7eff68107660 2024-09-19T05:57:38.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:38.806+0000 7eff657fa640 1 -- 172.21.15.37:0/1090898984 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff58035030 con 0x7eff68107660 2024-09-19T05:57:38.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:38.806+0000 7eff6e3e9640 1 -- 172.21.15.37:0/1090898984 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff68074ef0 con 0x7eff68107660 2024-09-19T05:57:38.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:38.807+0000 7eff657fa640 1 -- 172.21.15.37:0/1090898984 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7eff58042070 con 0x7eff68107660 2024-09-19T05:57:38.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:38.807+0000 7eff6e3e9640 1 -- 172.21.15.37:0/1090898984 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff68102cd0 con 0x7eff68107660 2024-09-19T05:57:38.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:38.807+0000 7eff657fa640 1 --2- 172.21.15.37:0/1090898984 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7eff50039300 0x7eff5003b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:57:38.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:38.807+0000 7eff657fa640 1 -- 172.21.15.37:0/1090898984 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7eff5806d050 con 0x7eff68107660 2024-09-19T05:57:38.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:38.807+0000 7eff677fe640 1 --2- 172.21.15.37:0/1090898984 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7eff50039300 0x7eff5003b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:57:38.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:38.807+0000 7eff677fe640 1 --2- 172.21.15.37:0/1090898984 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7eff50039300 0x7eff5003b7c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7eff5c0098c0 tx=0x7eff5c006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:57:38.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:38.812+0000 7eff657fa640 1 -- 172.21.15.37:0/1090898984 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7eff58031d50 con 0x7eff68107660 2024-09-19T05:57:38.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:38.991+0000 7eff6e3e9640 1 -- 172.21.15.37:0/1090898984 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7eff68075a20 con 0x7eff68107660 2024-09-19T05:57:39.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:39.540+0000 7eff657fa640 1 -- 172.21.15.37:0/1090898984 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7eff5803a3c0 con 0x7eff68107660 2024-09-19T05:57:39.543 INFO:teuthology.orchestra.run.smithi037.stderr:adjusted tunables profile to default 2024-09-19T05:57:39.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:39.543+0000 7eff6e3e9640 1 -- 172.21.15.37:0/1090898984 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7eff50039300 msgr2=0x7eff5003b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:57:39.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:39.543+0000 7eff6e3e9640 1 --2- 172.21.15.37:0/1090898984 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7eff50039300 0x7eff5003b7c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7eff5c0098c0 tx=0x7eff5c006db0 comp rx=0 tx=0).stop 2024-09-19T05:57:39.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:39.543+0000 7eff6e3e9640 1 -- 172.21.15.37:0/1090898984 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff68107660 msgr2=0x7eff680744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:57:39.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:39.543+0000 7eff6e3e9640 1 --2- 172.21.15.37:0/1090898984 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff68107660 0x7eff680744f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7eff58009230 tx=0x7eff58003d40 comp rx=0 tx=0).stop 2024-09-19T05:57:39.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:39.543+0000 7eff6e3e9640 1 -- 172.21.15.37:0/1090898984 shutdown_connections 2024-09-19T05:57:39.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:39.543+0000 7eff6e3e9640 1 --2- 172.21.15.37:0/1090898984 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7eff50039300 0x7eff5003b7c0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:39.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:39.543+0000 7eff6e3e9640 1 --2- 172.21.15.37:0/1090898984 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff68107660 0x7eff680744f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:39.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:39.543+0000 7eff6e3e9640 1 -- 172.21.15.37:0/1090898984 >> 172.21.15.37:0/1090898984 conn(0x7eff680fd290 msgr2=0x7eff680febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:57:39.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:39.544+0000 7eff6e3e9640 1 -- 172.21.15.37:0/1090898984 shutdown_connections 2024-09-19T05:57:39.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:57:39.544+0000 7eff6e3e9640 1 -- 172.21.15.37:0/1090898984 wait complete. 2024-09-19T05:57:39.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:39 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/1090898984' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-19T05:57:40.154 INFO:tasks.cephadm:Adding mon.a on smithi037 2024-09-19T05:57:40.154 INFO:tasks.cephadm:Adding mon.b on smithi099 2024-09-19T05:57:40.154 INFO:tasks.cephadm:Adding mon.c on smithi117 2024-09-19T05:57:40.155 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph orch apply mon '3;smithi037:172.21.15.37=a;smithi099:172.21.15.99=b;smithi117:172.21.15.117=c' 2024-09-19T05:57:40.395 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T05:57:40.440 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T05:57:40.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:40 smithi037 ceph-mon[31211]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:57:40.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:40 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/1090898984' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-19T05:57:40.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:40 smithi037 ceph-mon[31211]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T05:57:40.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:40 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:57:40.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:40 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:57:40.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:40 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:57:40.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:40 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:57:40.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:40 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi117", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:57:40.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:40 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:57:40.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:40 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:57:40.951 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:40.934+0000 7fa42c623640 1 -- 172.21.15.117:0/1860248422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa424107580 msgr2=0x7fa424107960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:57:40.951 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:40.934+0000 7fa42c623640 1 --2- 172.21.15.117:0/1860248422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa424107580 0x7fa424107960 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa418009880 tx=0x7fa41802a5d0 comp rx=0 tx=0).stop 2024-09-19T05:57:40.951 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:40.934+0000 7fa42c623640 1 -- 172.21.15.117:0/1860248422 shutdown_connections 2024-09-19T05:57:40.951 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:40.934+0000 7fa42c623640 1 --2- 172.21.15.117:0/1860248422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa424107580 0x7fa424107960 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:40.951 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:40.934+0000 7fa42c623640 1 -- 172.21.15.117:0/1860248422 >> 172.21.15.117:0/1860248422 conn(0x7fa4240fb900 msgr2=0x7fa4240fdd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:57:40.951 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:40.934+0000 7fa42c623640 1 -- 172.21.15.117:0/1860248422 shutdown_connections 2024-09-19T05:57:40.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:40.934+0000 7fa42c623640 1 -- 172.21.15.117:0/1860248422 wait complete. 2024-09-19T05:57:40.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:40.935+0000 7fa42c623640 1 Processor -- start 2024-09-19T05:57:40.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:40.935+0000 7fa42c623640 1 -- start start 2024-09-19T05:57:40.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:40.935+0000 7fa42c623640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa424107580 0x7fa424197110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:57:40.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:40.935+0000 7fa42c623640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa42410bc40 con 0x7fa424107580 2024-09-19T05:57:40.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:40.935+0000 7fa42a3bf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa424107580 0x7fa424197110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:57:40.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:40.935+0000 7fa42a3bf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa424107580 0x7fa424197110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.117:53224/0 (socket says 172.21.15.117:53224) 2024-09-19T05:57:40.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:40.935+0000 7fa42a3bf640 1 -- 172.21.15.117:0/3724767889 learned_addr learned my addr 172.21.15.117:0/3724767889 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T05:57:40.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:40.936+0000 7fa42a3bf640 1 -- 172.21.15.117:0/3724767889 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa424197650 con 0x7fa424107580 2024-09-19T05:57:40.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:40.936+0000 7fa42a3bf640 1 --2- 172.21.15.117:0/3724767889 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa424107580 0x7fa424197110 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa418009230 tx=0x7fa418003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:57:40.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:40.936+0000 7fa4177fe640 1 -- 172.21.15.117:0/3724767889 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa41803f070 con 0x7fa424107580 2024-09-19T05:57:40.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:40.936+0000 7fa4177fe640 1 -- 172.21.15.117:0/3724767889 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa41803bc80 con 0x7fa424107580 2024-09-19T05:57:40.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:40.936+0000 7fa4177fe640 1 -- 172.21.15.117:0/3724767889 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa418035030 con 0x7fa424107580 2024-09-19T05:57:40.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:40.936+0000 7fa42c623640 1 -- 172.21.15.117:0/3724767889 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa424197940 con 0x7fa424107580 2024-09-19T05:57:40.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:40.936+0000 7fa42c623640 1 -- 172.21.15.117:0/3724767889 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa42419b9e0 con 0x7fa424107580 2024-09-19T05:57:40.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:40.937+0000 7fa4177fe640 1 -- 172.21.15.117:0/3724767889 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fa418042070 con 0x7fa424107580 2024-09-19T05:57:40.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:40.937+0000 7fa42c623640 1 -- 172.21.15.117:0/3724767889 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa424102df0 con 0x7fa424107580 2024-09-19T05:57:40.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:40.937+0000 7fa4177fe640 1 --2- 172.21.15.117:0/3724767889 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fa4100392a0 0x7fa41003b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:57:40.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:40.937+0000 7fa4177fe640 1 -- 172.21.15.117:0/3724767889 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fa41806cf80 con 0x7fa424107580 2024-09-19T05:57:40.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:40.938+0000 7fa429bbe640 1 --2- 172.21.15.117:0/3724767889 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fa4100392a0 0x7fa41003b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:57:40.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:40.938+0000 7fa429bbe640 1 --2- 172.21.15.117:0/3724767889 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fa4100392a0 0x7fa41003b760 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa4200098c0 tx=0x7fa420006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:57:40.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:40.942+0000 7fa4177fe640 1 -- 172.21.15.117:0/3724767889 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa418031e20 con 0x7fa424107580 2024-09-19T05:57:41.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:41.125+0000 7fa42c623640 1 -- 172.21.15.117:0/3724767889 --> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi037:172.21.15.37=a;smithi099:172.21.15.99=b;smithi117:172.21.15.117=c", "target": ["mon-mgr", ""]}) -- 0x7fa424198470 con 0x7fa4100392a0 2024-09-19T05:57:41.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:41.131+0000 7fa4177fe640 1 -- 172.21.15.117:0/3724767889 <== mgr.14148 v2:172.21.15.37:6800/3797010169 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fa424198470 con 0x7fa4100392a0 2024-09-19T05:57:41.132 INFO:teuthology.orchestra.run.smithi117.stdout:Scheduled mon update... 2024-09-19T05:57:41.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:41.132+0000 7fa42c623640 1 -- 172.21.15.117:0/3724767889 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fa4100392a0 msgr2=0x7fa41003b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:57:41.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:41.132+0000 7fa42c623640 1 --2- 172.21.15.117:0/3724767889 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fa4100392a0 0x7fa41003b760 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa4200098c0 tx=0x7fa420006db0 comp rx=0 tx=0).stop 2024-09-19T05:57:41.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:41.132+0000 7fa42c623640 1 -- 172.21.15.117:0/3724767889 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa424107580 msgr2=0x7fa424197110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:57:41.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:41.132+0000 7fa42c623640 1 --2- 172.21.15.117:0/3724767889 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa424107580 0x7fa424197110 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa418009230 tx=0x7fa418003d40 comp rx=0 tx=0).stop 2024-09-19T05:57:41.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:41.132+0000 7fa42c623640 1 -- 172.21.15.117:0/3724767889 shutdown_connections 2024-09-19T05:57:41.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:41.132+0000 7fa42c623640 1 --2- 172.21.15.117:0/3724767889 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fa4100392a0 0x7fa41003b760 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:41.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:41.132+0000 7fa42c623640 1 --2- 172.21.15.117:0/3724767889 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa424107580 0x7fa424197110 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:41.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:41.132+0000 7fa42c623640 1 -- 172.21.15.117:0/3724767889 >> 172.21.15.117:0/3724767889 conn(0x7fa4240fb900 msgr2=0x7fa4240fbce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:57:41.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:41.132+0000 7fa42c623640 1 -- 172.21.15.117:0/3724767889 shutdown_connections 2024-09-19T05:57:41.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:41.133+0000 7fa42c623640 1 -- 172.21.15.117:0/3724767889 wait complete. 2024-09-19T05:57:41.732 DEBUG:teuthology.orchestra.run.smithi099:mon.b> sudo journalctl -f -n 0 -u ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@mon.b.service 2024-09-19T05:57:41.735 DEBUG:teuthology.orchestra.run.smithi117:mon.c> sudo journalctl -f -n 0 -u ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@mon.c.service 2024-09-19T05:57:41.738 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T05:57:41.738 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T05:57:41.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:41 smithi037 ceph-mon[31211]: Updating smithi117:/etc/ceph/ceph.conf 2024-09-19T05:57:41.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:41 smithi037 ceph-mon[31211]: Updating smithi117:/var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T05:57:41.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:41 smithi037 ceph-mon[31211]: Updating smithi117:/etc/ceph/ceph.client.admin.keyring 2024-09-19T05:57:41.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:41 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:57:41.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:41 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:57:41.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:41 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:57:41.825 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:41 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:57:41.825 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:41 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:57:41.825 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:41 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:57:41.825 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:41 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:57:41.825 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:41 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:57:41.825 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:41 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T05:57:41.825 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:41 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:57:42.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:42 smithi037 ceph-mon[31211]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:57:42.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:42 smithi037 ceph-mon[31211]: Updating smithi117:/var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T05:57:42.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:42 smithi037 ceph-mon[31211]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi037:172.21.15.37=a;smithi099:172.21.15.99=b;smithi117:172.21.15.117=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:57:42.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:42 smithi037 ceph-mon[31211]: Saving service mon spec with placement smithi037:172.21.15.37=a;smithi099:172.21.15.99=b;smithi117:172.21.15.117=c;count:3 2024-09-19T05:57:42.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:42 smithi037 ceph-mon[31211]: Deploying daemon mon.c on smithi117 2024-09-19T05:57:43.631 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T05:57:44.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:44.522+0000 7fa6092ed640 1 -- 172.21.15.117:0/1455202215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa604107650 msgr2=0x7fa604107a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:57:44.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:44.522+0000 7fa6092ed640 1 --2- 172.21.15.117:0/1455202215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa604107650 0x7fa604107a30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa5f4009880 tx=0x7fa5f402a5d0 comp rx=0 tx=0).stop 2024-09-19T05:57:44.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:44.522+0000 7fa6092ed640 1 -- 172.21.15.117:0/1455202215 shutdown_connections 2024-09-19T05:57:44.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:44.522+0000 7fa6092ed640 1 --2- 172.21.15.117:0/1455202215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa604107650 0x7fa604107a30 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:44.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:44.522+0000 7fa6092ed640 1 -- 172.21.15.117:0/1455202215 >> 172.21.15.117:0/1455202215 conn(0x7fa6040fd260 msgr2=0x7fa6040ff680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:57:44.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:44.522+0000 7fa6092ed640 1 -- 172.21.15.117:0/1455202215 shutdown_connections 2024-09-19T05:57:44.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:44.522+0000 7fa6092ed640 1 -- 172.21.15.117:0/1455202215 wait complete. 2024-09-19T05:57:44.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:44.522+0000 7fa6092ed640 1 Processor -- start 2024-09-19T05:57:44.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:44.523+0000 7fa6092ed640 1 -- start start 2024-09-19T05:57:44.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:44.523+0000 7fa6092ed640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa604107650 0x7fa604197110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:57:44.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:44.523+0000 7fa6092ed640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa60410bc80 con 0x7fa604107650 2024-09-19T05:57:44.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:44.523+0000 7fa602ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa604107650 0x7fa604197110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:57:44.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:44.523+0000 7fa602ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa604107650 0x7fa604197110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.117:53232/0 (socket says 172.21.15.117:53232) 2024-09-19T05:57:44.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:44.523+0000 7fa602ffd640 1 -- 172.21.15.117:0/3797600841 learned_addr learned my addr 172.21.15.117:0/3797600841 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T05:57:44.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:44.523+0000 7fa602ffd640 1 -- 172.21.15.117:0/3797600841 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa604197650 con 0x7fa604107650 2024-09-19T05:57:44.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:44.524+0000 7fa602ffd640 1 --2- 172.21.15.117:0/3797600841 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa604107650 0x7fa604197110 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa5f4009230 tx=0x7fa5f4003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:57:44.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:44.524+0000 7fa5ebfff640 1 -- 172.21.15.117:0/3797600841 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5f403f070 con 0x7fa604107650 2024-09-19T05:57:44.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:44.524+0000 7fa5ebfff640 1 -- 172.21.15.117:0/3797600841 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa5f403bc80 con 0x7fa604107650 2024-09-19T05:57:44.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:44.524+0000 7fa6092ed640 1 -- 172.21.15.117:0/3797600841 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6041978e0 con 0x7fa604107650 2024-09-19T05:57:44.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:44.524+0000 7fa5ebfff640 1 -- 172.21.15.117:0/3797600841 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5f4035030 con 0x7fa604107650 2024-09-19T05:57:44.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:44.524+0000 7fa6092ed640 1 -- 172.21.15.117:0/3797600841 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa60419b9e0 con 0x7fa604107650 2024-09-19T05:57:44.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:44.525+0000 7fa5ebfff640 1 -- 172.21.15.117:0/3797600841 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fa5f4042070 con 0x7fa604107650 2024-09-19T05:57:44.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:44.525+0000 7fa6092ed640 1 -- 172.21.15.117:0/3797600841 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa604102cc0 con 0x7fa604107650 2024-09-19T05:57:44.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:44.525+0000 7fa5ebfff640 1 --2- 172.21.15.117:0/3797600841 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fa5ec0392a0 0x7fa5ec03b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:57:44.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:44.525+0000 7fa5ebfff640 1 -- 172.21.15.117:0/3797600841 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fa5f406dfc0 con 0x7fa604107650 2024-09-19T05:57:44.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:44.525+0000 7fa6027fc640 1 --2- 172.21.15.117:0/3797600841 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fa5ec0392a0 0x7fa5ec03b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:57:44.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:44.526+0000 7fa6027fc640 1 --2- 172.21.15.117:0/3797600841 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fa5ec0392a0 0x7fa5ec03b760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa5f80098c0 tx=0x7fa5f8006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:57:44.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:44.530+0000 7fa5ebfff640 1 -- 172.21.15.117:0/3797600841 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa5f404c350 con 0x7fa604107650 2024-09-19T05:57:44.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:44.780+0000 7fa6092ed640 1 -- 172.21.15.117:0/3797600841 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fa604107ab0 con 0x7fa604107650 2024-09-19T05:57:44.783 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:44.781+0000 7fa5ebfff640 1 -- 172.21.15.117:0/3797600841 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7fa5f404ad50 con 0x7fa604107650 2024-09-19T05:57:44.783 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T05:57:44.784 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":1,"fsid":"b8c8bdae-764b-11ef-bceb-c7b262605968","modified":"2024-09-19T05:56:19.390249Z","created":"2024-09-19T05:56:19.390249Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:3300","nonce":0},{"type":"v1","addr":"172.21.15.37:6789","nonce":0}]},"addr":"172.21.15.37:6789/0","public_addr":"172.21.15.37:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T05:57:44.784 INFO:teuthology.orchestra.run.smithi117.stderr:dumped monmap epoch 1 2024-09-19T05:57:44.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:44.783+0000 7fa6092ed640 1 -- 172.21.15.117:0/3797600841 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fa5ec0392a0 msgr2=0x7fa5ec03b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:57:44.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:44.783+0000 7fa6092ed640 1 --2- 172.21.15.117:0/3797600841 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fa5ec0392a0 0x7fa5ec03b760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa5f80098c0 tx=0x7fa5f8006db0 comp rx=0 tx=0).stop 2024-09-19T05:57:44.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:44.783+0000 7fa6092ed640 1 -- 172.21.15.117:0/3797600841 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa604107650 msgr2=0x7fa604197110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:57:44.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:44.783+0000 7fa6092ed640 1 --2- 172.21.15.117:0/3797600841 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa604107650 0x7fa604197110 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa5f4009230 tx=0x7fa5f4003d40 comp rx=0 tx=0).stop 2024-09-19T05:57:44.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:44.783+0000 7fa6092ed640 1 -- 172.21.15.117:0/3797600841 shutdown_connections 2024-09-19T05:57:44.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:44.783+0000 7fa6092ed640 1 --2- 172.21.15.117:0/3797600841 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fa5ec0392a0 0x7fa5ec03b760 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:44.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:44.783+0000 7fa6092ed640 1 --2- 172.21.15.117:0/3797600841 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa604107650 0x7fa604197110 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:44.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:44.783+0000 7fa6092ed640 1 -- 172.21.15.117:0/3797600841 >> 172.21.15.117:0/3797600841 conn(0x7fa6040fd260 msgr2=0x7fa6040fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:57:44.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:44.783+0000 7fa6092ed640 1 -- 172.21.15.117:0/3797600841 shutdown_connections 2024-09-19T05:57:44.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:44.783+0000 7fa6092ed640 1 -- 172.21.15.117:0/3797600841 wait complete. 2024-09-19T05:57:44.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:44 smithi037 ceph-mon[31211]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:57:45.288 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 systemd[1]: Starting Ceph mon.c for b8c8bdae-764b-11ef-bceb-c7b262605968... 2024-09-19T05:57:45.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:45 smithi037 ceph-mon[31211]: from='client.? 172.21.15.117:0/3797600841' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T05:57:45.832 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 podman[35031]: 2024-09-19 05:57:45.482635775 +0000 UTC m=+0.015734573 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T05:57:45.832 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 podman[35031]: 2024-09-19 05:57:45.591947855 +0000 UTC m=+0.125046643 container create c427aab2cd0b16ae97582a7c87ad6c896741552ed0e9cfbcd9155637fb324e4f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mon-c, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-19T05:57:45.832 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 podman[35031]: 2024-09-19 05:57:45.803139109 +0000 UTC m=+0.336237897 container init c427aab2cd0b16ae97582a7c87ad6c896741552ed0e9cfbcd9155637fb324e4f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mon-c, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T05:57:45.832 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 podman[35031]: 2024-09-19 05:57:45.806186952 +0000 UTC m=+0.339285740 container start c427aab2cd0b16ae97582a7c87ad6c896741552ed0e9cfbcd9155637fb324e4f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mon-c, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-19T05:57:45.832 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: set uid:gid to 167:167 (ceph:ceph) 2024-09-19T05:57:45.832 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable), process ceph-mon, pid 2 2024-09-19T05:57:45.832 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: pidfile_write: ignore empty --pid-file 2024-09-19T05:57:45.832 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: load: jerasure load: lrc 2024-09-19T05:57:46.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: RocksDB version: 7.9.2 2024-09-19T05:57:46.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Git sha 0 2024-09-19T05:57:46.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Compile date 2024-09-18 16:29:48 2024-09-19T05:57:46.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: DB SUMMARY 2024-09-19T05:57:46.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: DB Session ID: 0SI9RPJS1ZY3FKZWLWEC 2024-09-19T05:57:46.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: CURRENT file: CURRENT 2024-09-19T05:57:46.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: IDENTITY file: IDENTITY 2024-09-19T05:57:46.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-19T05:57:46.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-09-19T05:57:46.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-09-19T05:57:46.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.error_if_exists: 0 2024-09-19T05:57:46.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.create_if_missing: 0 2024-09-19T05:57:46.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.paranoid_checks: 1 2024-09-19T05:57:46.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-19T05:57:46.252 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-19T05:57:46.252 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-19T05:57:46.252 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.env: 0x55cfeda61940 2024-09-19T05:57:46.252 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.fs: PosixFileSystem 2024-09-19T05:57:46.252 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.info_log: 0x55cfeff916e0 2024-09-19T05:57:46.252 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.max_file_opening_threads: 16 2024-09-19T05:57:46.252 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.statistics: (nil) 2024-09-19T05:57:46.252 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.use_fsync: 0 2024-09-19T05:57:46.252 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.max_log_file_size: 0 2024-09-19T05:57:46.252 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-19T05:57:46.252 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-19T05:57:46.252 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.keep_log_file_num: 1000 2024-09-19T05:57:46.252 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.recycle_log_file_num: 0 2024-09-19T05:57:46.253 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.allow_fallocate: 1 2024-09-19T05:57:46.253 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.allow_mmap_reads: 0 2024-09-19T05:57:46.253 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.allow_mmap_writes: 0 2024-09-19T05:57:46.253 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.use_direct_reads: 0 2024-09-19T05:57:46.253 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-19T05:57:46.253 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.create_missing_column_families: 0 2024-09-19T05:57:46.253 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.db_log_dir: 2024-09-19T05:57:46.253 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.wal_dir: 2024-09-19T05:57:46.253 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-19T05:57:46.253 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-19T05:57:46.253 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-19T05:57:46.253 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-19T05:57:46.255 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-19T05:57:46.255 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-19T05:57:46.255 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.advise_random_on_open: 1 2024-09-19T05:57:46.255 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.db_write_buffer_size: 0 2024-09-19T05:57:46.255 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.write_buffer_manager: 0x55cfeffa0dc0 2024-09-19T05:57:46.255 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-19T05:57:46.255 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-19T05:57:46.255 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-19T05:57:46.256 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.rate_limiter: (nil) 2024-09-19T05:57:46.256 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-19T05:57:46.256 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.wal_recovery_mode: 2 2024-09-19T05:57:46.256 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.enable_thread_tracking: 0 2024-09-19T05:57:46.256 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.enable_pipelined_write: 0 2024-09-19T05:57:46.256 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.unordered_write: 0 2024-09-19T05:57:46.256 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-19T05:57:46.256 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-19T05:57:46.256 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-19T05:57:46.256 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-19T05:57:46.256 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.row_cache: None 2024-09-19T05:57:46.256 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.wal_filter: None 2024-09-19T05:57:46.257 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-19T05:57:46.257 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.allow_ingest_behind: 0 2024-09-19T05:57:46.257 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.two_write_queues: 0 2024-09-19T05:57:46.257 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.manual_wal_flush: 0 2024-09-19T05:57:46.257 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.wal_compression: 0 2024-09-19T05:57:46.257 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.atomic_flush: 0 2024-09-19T05:57:46.257 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-19T05:57:46.257 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-19T05:57:46.257 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-19T05:57:46.257 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.log_readahead_size: 0 2024-09-19T05:57:46.257 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-19T05:57:46.257 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.best_efforts_recovery: 0 2024-09-19T05:57:46.257 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-19T05:57:46.258 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-19T05:57:46.258 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.allow_data_in_errors: 0 2024-09-19T05:57:46.258 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.db_host_id: __hostname__ 2024-09-19T05:57:46.258 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-19T05:57:46.258 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.max_background_jobs: 2 2024-09-19T05:57:46.258 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.max_background_compactions: -1 2024-09-19T05:57:46.258 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.max_subcompactions: 1 2024-09-19T05:57:46.258 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-19T05:57:46.258 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-19T05:57:46.258 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-19T05:57:46.258 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.max_total_wal_size: 0 2024-09-19T05:57:46.258 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-19T05:57:46.258 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-19T05:57:46.258 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-19T05:57:46.259 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-19T05:57:46.259 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.max_open_files: -1 2024-09-19T05:57:46.259 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.bytes_per_sync: 0 2024-09-19T05:57:46.259 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-19T05:57:46.259 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-19T05:57:46.259 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.compaction_readahead_size: 0 2024-09-19T05:57:46.259 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.max_background_flushes: -1 2024-09-19T05:57:46.259 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Compression algorithms supported: 2024-09-19T05:57:46.259 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: kZSTD supported: 0 2024-09-19T05:57:46.259 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: kXpressCompression supported: 0 2024-09-19T05:57:46.259 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: kBZip2Compression supported: 0 2024-09-19T05:57:46.259 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-19T05:57:46.259 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: kLZ4Compression supported: 1 2024-09-19T05:57:46.260 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: kZlibCompression supported: 1 2024-09-19T05:57:46.260 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: kLZ4HCCompression supported: 1 2024-09-19T05:57:46.260 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: kSnappyCompression supported: 1 2024-09-19T05:57:46.260 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-19T05:57:46.260 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-19T05:57:46.260 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-09-19T05:57:46.260 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-19T05:57:46.260 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-19T05:57:46.260 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.merge_operator: 2024-09-19T05:57:46.261 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.compaction_filter: None 2024-09-19T05:57:46.261 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.compaction_filter_factory: None 2024-09-19T05:57:46.261 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.sst_partitioner_factory: None 2024-09-19T05:57:46.261 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-19T05:57:46.261 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-19T05:57:46.261 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55cfeff91320) 2024-09-19T05:57:46.261 INFO:journalctl@ceph.mon.c.smithi117.stdout: cache_index_and_filter_blocks: 1 2024-09-19T05:57:46.261 INFO:journalctl@ceph.mon.c.smithi117.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-19T05:57:46.261 INFO:journalctl@ceph.mon.c.smithi117.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-19T05:57:46.261 INFO:journalctl@ceph.mon.c.smithi117.stdout: pin_top_level_index_and_filter: 1 2024-09-19T05:57:46.261 INFO:journalctl@ceph.mon.c.smithi117.stdout: index_type: 0 2024-09-19T05:57:46.261 INFO:journalctl@ceph.mon.c.smithi117.stdout: data_block_index_type: 0 2024-09-19T05:57:46.261 INFO:journalctl@ceph.mon.c.smithi117.stdout: index_shortening: 1 2024-09-19T05:57:46.262 INFO:journalctl@ceph.mon.c.smithi117.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-19T05:57:46.262 INFO:journalctl@ceph.mon.c.smithi117.stdout: checksum: 4 2024-09-19T05:57:46.262 INFO:journalctl@ceph.mon.c.smithi117.stdout: no_block_cache: 0 2024-09-19T05:57:46.262 INFO:journalctl@ceph.mon.c.smithi117.stdout: block_cache: 0x55cfeff851f0 2024-09-19T05:57:46.262 INFO:journalctl@ceph.mon.c.smithi117.stdout: block_cache_name: BinnedLRUCache 2024-09-19T05:57:46.262 INFO:journalctl@ceph.mon.c.smithi117.stdout: block_cache_options: 2024-09-19T05:57:46.262 INFO:journalctl@ceph.mon.c.smithi117.stdout: capacity : 536870912 2024-09-19T05:57:46.262 INFO:journalctl@ceph.mon.c.smithi117.stdout: num_shard_bits : 4 2024-09-19T05:57:46.262 INFO:journalctl@ceph.mon.c.smithi117.stdout: strict_capacity_limit : 0 2024-09-19T05:57:46.262 INFO:journalctl@ceph.mon.c.smithi117.stdout: high_pri_pool_ratio: 0.000 2024-09-19T05:57:46.262 INFO:journalctl@ceph.mon.c.smithi117.stdout: block_cache_compressed: (nil) 2024-09-19T05:57:46.262 INFO:journalctl@ceph.mon.c.smithi117.stdout: persistent_cache: (nil) 2024-09-19T05:57:46.262 INFO:journalctl@ceph.mon.c.smithi117.stdout: block_size: 4096 2024-09-19T05:57:46.262 INFO:journalctl@ceph.mon.c.smithi117.stdout: block_size_deviation: 10 2024-09-19T05:57:46.262 INFO:journalctl@ceph.mon.c.smithi117.stdout: block_restart_interval: 16 2024-09-19T05:57:46.263 INFO:journalctl@ceph.mon.c.smithi117.stdout: index_block_restart_interval: 1 2024-09-19T05:57:46.263 INFO:journalctl@ceph.mon.c.smithi117.stdout: metadata_block_size: 4096 2024-09-19T05:57:46.263 INFO:journalctl@ceph.mon.c.smithi117.stdout: partition_filters: 0 2024-09-19T05:57:46.263 INFO:journalctl@ceph.mon.c.smithi117.stdout: use_delta_encoding: 1 2024-09-19T05:57:46.263 INFO:journalctl@ceph.mon.c.smithi117.stdout: filter_policy: bloomfilter 2024-09-19T05:57:46.263 INFO:journalctl@ceph.mon.c.smithi117.stdout: whole_key_filtering: 1 2024-09-19T05:57:46.263 INFO:journalctl@ceph.mon.c.smithi117.stdout: verify_compression: 0 2024-09-19T05:57:46.263 INFO:journalctl@ceph.mon.c.smithi117.stdout: read_amp_bytes_per_bit: 0 2024-09-19T05:57:46.263 INFO:journalctl@ceph.mon.c.smithi117.stdout: format_version: 5 2024-09-19T05:57:46.263 INFO:journalctl@ceph.mon.c.smithi117.stdout: enable_index_compression: 1 2024-09-19T05:57:46.263 INFO:journalctl@ceph.mon.c.smithi117.stdout: block_align: 0 2024-09-19T05:57:46.263 INFO:journalctl@ceph.mon.c.smithi117.stdout: max_auto_readahead_size: 262144 2024-09-19T05:57:46.264 INFO:journalctl@ceph.mon.c.smithi117.stdout: prepopulate_block_cache: 0 2024-09-19T05:57:46.264 INFO:journalctl@ceph.mon.c.smithi117.stdout: initial_auto_readahead_size: 8192 2024-09-19T05:57:46.264 INFO:journalctl@ceph.mon.c.smithi117.stdout: num_file_reads_for_auto_readahead: 2 2024-09-19T05:57:46.264 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.write_buffer_size: 33554432 2024-09-19T05:57:46.264 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.max_write_buffer_number: 2 2024-09-19T05:57:46.264 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.compression: NoCompression 2024-09-19T05:57:46.264 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.bottommost_compression: Disabled 2024-09-19T05:57:46.264 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.prefix_extractor: nullptr 2024-09-19T05:57:46.264 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-19T05:57:46.264 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.num_levels: 7 2024-09-19T05:57:46.264 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-19T05:57:46.264 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-19T05:57:46.265 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-19T05:57:46.265 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-19T05:57:46.265 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-19T05:57:46.265 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-19T05:57:46.265 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-19T05:57:46.265 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-19T05:57:46.265 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-19T05:57:46.265 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-19T05:57:46.265 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-19T05:57:46.265 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-19T05:57:46.265 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-19T05:57:46.265 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.compression_opts.level: 32767 2024-09-19T05:57:46.265 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.compression_opts.strategy: 0 2024-09-19T05:57:46.266 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-19T05:57:46.266 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-19T05:57:46.266 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-19T05:57:46.266 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-19T05:57:46.266 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.compression_opts.enabled: false 2024-09-19T05:57:46.266 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-19T05:57:46.266 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-19T05:57:46.266 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-19T05:57:46.266 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-19T05:57:46.266 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.target_file_size_base: 67108864 2024-09-19T05:57:46.266 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-19T05:57:46.266 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-19T05:57:46.266 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-19T05:57:46.266 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-19T05:57:46.267 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-19T05:57:46.267 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-19T05:57:46.267 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-19T05:57:46.267 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-19T05:57:46.267 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-19T05:57:46.267 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-19T05:57:46.267 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-19T05:57:46.267 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-19T05:57:46.267 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-19T05:57:46.267 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-19T05:57:46.267 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.arena_block_size: 1048576 2024-09-19T05:57:46.267 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-19T05:57:46.267 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-19T05:57:46.267 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.disable_auto_compactions: 0 2024-09-19T05:57:46.268 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-19T05:57:46.268 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-19T05:57:46.268 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-19T05:57:46.268 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-19T05:57:46.268 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-19T05:57:46.268 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-19T05:57:46.268 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-19T05:57:46.268 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-19T05:57:46.268 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-19T05:57:46.268 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-19T05:57:46.268 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-19T05:57:46.268 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.inplace_update_support: 0 2024-09-19T05:57:46.268 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-19T05:57:46.268 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-19T05:57:46.269 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-19T05:57:46.269 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-19T05:57:46.269 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.bloom_locality: 0 2024-09-19T05:57:46.269 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.max_successive_merges: 0 2024-09-19T05:57:46.269 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-19T05:57:46.269 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.paranoid_file_checks: 0 2024-09-19T05:57:46.269 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.force_consistency_checks: 1 2024-09-19T05:57:46.269 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.report_bg_io_stats: 0 2024-09-19T05:57:46.269 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.ttl: 2592000 2024-09-19T05:57:46.269 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-19T05:57:46.269 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-19T05:57:46.270 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-19T05:57:46.270 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.enable_blob_files: false 2024-09-19T05:57:46.270 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.min_blob_size: 0 2024-09-19T05:57:46.270 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.blob_file_size: 268435456 2024-09-19T05:57:46.270 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-19T05:57:46.270 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-19T05:57:46.270 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-19T05:57:46.270 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-19T05:57:46.270 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-19T05:57:46.270 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.blob_file_starting_level: 0 2024-09-19T05:57:46.270 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-19T05:57:46.270 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-19T05:57:46.270 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-19T05:57:46.270 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 2d735fe0-2c66-45da-bb39-2922baacc1ec 2024-09-19T05:57:46.271 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726725465832843, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-19T05:57:46.271 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-19T05:57:46.271 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726725465833243, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726725465, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "2d735fe0-2c66-45da-bb39-2922baacc1ec", "db_session_id": "0SI9RPJS1ZY3FKZWLWEC", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-19T05:57:46.271 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726725465833335, "job": 1, "event": "recovery_finished"} 2024-09-19T05:57:46.271 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-19T05:57:46.271 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-19T05:57:46.271 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55cfeffb2e00 2024-09-19T05:57:46.271 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: DB pointer 0x55cff00ae000 2024-09-19T05:57:46.271 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-19T05:57:46.271 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-19T05:57:46.271 INFO:journalctl@ceph.mon.c.smithi117.stdout: ** DB Stats ** 2024-09-19T05:57:46.272 INFO:journalctl@ceph.mon.c.smithi117.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T05:57:46.272 INFO:journalctl@ceph.mon.c.smithi117.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-19T05:57:46.272 INFO:journalctl@ceph.mon.c.smithi117.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T05:57:46.272 INFO:journalctl@ceph.mon.c.smithi117.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T05:57:46.272 INFO:journalctl@ceph.mon.c.smithi117.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-19T05:57:46.272 INFO:journalctl@ceph.mon.c.smithi117.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T05:57:46.272 INFO:journalctl@ceph.mon.c.smithi117.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T05:57:46.272 INFO:journalctl@ceph.mon.c.smithi117.stdout: 2024-09-19T05:57:46.272 INFO:journalctl@ceph.mon.c.smithi117.stdout: ** Compaction Stats [default] ** 2024-09-19T05:57:46.272 INFO:journalctl@ceph.mon.c.smithi117.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T05:57:46.272 INFO:journalctl@ceph.mon.c.smithi117.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-19T05:57:46.272 INFO:journalctl@ceph.mon.c.smithi117.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.1 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T05:57:46.272 INFO:journalctl@ceph.mon.c.smithi117.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.1 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T05:57:46.273 INFO:journalctl@ceph.mon.c.smithi117.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.1 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T05:57:46.273 INFO:journalctl@ceph.mon.c.smithi117.stdout: 2024-09-19T05:57:46.273 INFO:journalctl@ceph.mon.c.smithi117.stdout: ** Compaction Stats [default] ** 2024-09-19T05:57:46.273 INFO:journalctl@ceph.mon.c.smithi117.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T05:57:46.273 INFO:journalctl@ceph.mon.c.smithi117.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-19T05:57:46.273 INFO:journalctl@ceph.mon.c.smithi117.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.1 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T05:57:46.273 INFO:journalctl@ceph.mon.c.smithi117.stdout: 2024-09-19T05:57:46.273 INFO:journalctl@ceph.mon.c.smithi117.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-19T05:57:46.273 INFO:journalctl@ceph.mon.c.smithi117.stdout: 2024-09-19T05:57:46.273 INFO:journalctl@ceph.mon.c.smithi117.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T05:57:46.273 INFO:journalctl@ceph.mon.c.smithi117.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-19T05:57:46.273 INFO:journalctl@ceph.mon.c.smithi117.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-19T05:57:46.274 INFO:journalctl@ceph.mon.c.smithi117.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-19T05:57:46.274 INFO:journalctl@ceph.mon.c.smithi117.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-19T05:57:46.274 INFO:journalctl@ceph.mon.c.smithi117.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-19T05:57:46.274 INFO:journalctl@ceph.mon.c.smithi117.stdout: Cumulative compaction: 0.00 GB write, 0.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T05:57:46.274 INFO:journalctl@ceph.mon.c.smithi117.stdout: Interval compaction: 0.00 GB write, 0.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T05:57:46.274 INFO:journalctl@ceph.mon.c.smithi117.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-19T05:57:46.274 INFO:journalctl@ceph.mon.c.smithi117.stdout: Block cache BinnedLRUCache@0x55cfeff851f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-19T05:57:46.274 INFO:journalctl@ceph.mon.c.smithi117.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-19T05:57:46.274 INFO:journalctl@ceph.mon.c.smithi117.stdout: 2024-09-19T05:57:46.274 INFO:journalctl@ceph.mon.c.smithi117.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-19T05:57:46.274 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-19T05:57:46.274 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: using public_addr v2:172.21.15.117:0/0 -> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-19T05:57:46.274 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: starting mon.c rank -1 at public addrs [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] at bind addrs [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid b8c8bdae-764b-11ef-bceb-c7b262605968 2024-09-19T05:57:46.274 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: mon.c@-1(???) e0 preinit fsid b8c8bdae-764b-11ef-bceb-c7b262605968 2024-09-19T05:57:46.275 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: mon.c@-1(synchronizing).mds e1 new map 2024-09-19T05:57:46.275 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-19T05:57:46.275 INFO:journalctl@ceph.mon.c.smithi117.stdout: e1 2024-09-19T05:57:46.275 INFO:journalctl@ceph.mon.c.smithi117.stdout: btime 2024-09-19T05:56:22:522867+0000 2024-09-19T05:57:46.275 INFO:journalctl@ceph.mon.c.smithi117.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T05:57:46.275 INFO:journalctl@ceph.mon.c.smithi117.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T05:57:46.275 INFO:journalctl@ceph.mon.c.smithi117.stdout: legacy client fscid: -1 2024-09-19T05:57:46.275 INFO:journalctl@ceph.mon.c.smithi117.stdout: 2024-09-19T05:57:46.275 INFO:journalctl@ceph.mon.c.smithi117.stdout: No filesystems configured 2024-09-19T05:57:46.275 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-19T05:57:46.275 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-19T05:57:46.275 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-19T05:57:46.275 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-19T05:57:46.275 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-19T05:57:46.276 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-19T05:57:46.276 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-19T05:57:46.276 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T05:57:46.276 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T05:57:46.276 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T05:57:46.276 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:57:46.276 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T05:57:46.276 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/1090898984' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-19T05:57:46.276 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:57:46.276 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/1090898984' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-19T05:57:46.276 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T05:57:46.276 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:57:46.276 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:57:46.277 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:57:46.277 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:57:46.277 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi117", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:57:46.277 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:57:46.277 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:57:46.277 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: Updating smithi117:/etc/ceph/ceph.conf 2024-09-19T05:57:46.277 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: Updating smithi117:/var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T05:57:46.277 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: Updating smithi117:/etc/ceph/ceph.client.admin.keyring 2024-09-19T05:57:46.277 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:57:46.277 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:57:46.277 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:57:46.278 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:57:46.278 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:57:46.278 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:57:46.278 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:57:46.278 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:57:46.278 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T05:57:46.278 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:57:46.279 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:57:46.279 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: Updating smithi117:/var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T05:57:46.279 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi037:172.21.15.37=a;smithi099:172.21.15.99=b;smithi117:172.21.15.117=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:57:46.279 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: Saving service mon spec with placement smithi037:172.21.15.37=a;smithi099:172.21.15.99=b;smithi117:172.21.15.117=c;count:3 2024-09-19T05:57:46.279 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: Deploying daemon mon.c on smithi117 2024-09-19T05:57:46.279 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:57:46.279 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: from='client.? 172.21.15.117:0/3797600841' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T05:57:46.279 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 ceph-mon[35050]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-19T05:57:46.279 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 bash[35031]: c427aab2cd0b16ae97582a7c87ad6c896741552ed0e9cfbcd9155637fb324e4f 2024-09-19T05:57:46.279 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:45 smithi117 systemd[1]: Started Ceph mon.c for b8c8bdae-764b-11ef-bceb-c7b262605968. 2024-09-19T05:57:46.406 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T05:57:46.407 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T05:57:46.667 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T05:57:51.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:50 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T05:57:51.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:50 smithi117 ceph-mon[35050]: mon.a calling monitor election 2024-09-19T05:57:51.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:50 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:57:51.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:50 smithi117 ceph-mon[35050]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:57:51.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:50 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:57:51.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:50 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:57:51.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:50 smithi117 ceph-mon[35050]: mon.c calling monitor election 2024-09-19T05:57:51.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:50 smithi117 ceph-mon[35050]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:57:51.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:50 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:57:51.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:50 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:57:51.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:50 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:57:51.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:50 smithi117 ceph-mon[35050]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T05:57:51.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:50 smithi117 ceph-mon[35050]: monmap epoch 2 2024-09-19T05:57:51.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:50 smithi117 ceph-mon[35050]: fsid b8c8bdae-764b-11ef-bceb-c7b262605968 2024-09-19T05:57:51.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:50 smithi117 ceph-mon[35050]: last_changed 2024-09-19T05:57:45.859369+0000 2024-09-19T05:57:51.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:50 smithi117 ceph-mon[35050]: created 2024-09-19T05:56:19.390249+0000 2024-09-19T05:57:51.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:50 smithi117 ceph-mon[35050]: min_mon_release 19 (squid) 2024-09-19T05:57:51.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:50 smithi117 ceph-mon[35050]: election_strategy: 1 2024-09-19T05:57:51.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:50 smithi117 ceph-mon[35050]: 0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-19T05:57:51.252 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:50 smithi117 ceph-mon[35050]: 1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.c 2024-09-19T05:57:51.252 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:50 smithi117 ceph-mon[35050]: fsmap 2024-09-19T05:57:51.252 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:50 smithi117 ceph-mon[35050]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T05:57:51.252 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:50 smithi117 ceph-mon[35050]: mgrmap e13: x(active, since 38s) 2024-09-19T05:57:51.252 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:50 smithi117 ceph-mon[35050]: overall HEALTH_OK 2024-09-19T05:57:51.252 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:50 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:57:51.252 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:50 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:57:51.252 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:50 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:57:51.252 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:50 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T05:57:51.252 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:50 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:57:51.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:50 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T05:57:51.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:50 smithi037 ceph-mon[31211]: mon.a calling monitor election 2024-09-19T05:57:51.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:50 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:57:51.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:50 smithi037 ceph-mon[31211]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:57:51.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:50 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:57:51.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:50 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:57:51.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:50 smithi037 ceph-mon[31211]: mon.c calling monitor election 2024-09-19T05:57:51.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:50 smithi037 ceph-mon[31211]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:57:51.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:50 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:57:51.325 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:50 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:57:51.325 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:50 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:57:51.325 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:50 smithi037 ceph-mon[31211]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T05:57:51.325 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:50 smithi037 ceph-mon[31211]: monmap epoch 2 2024-09-19T05:57:51.325 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:50 smithi037 ceph-mon[31211]: fsid b8c8bdae-764b-11ef-bceb-c7b262605968 2024-09-19T05:57:51.325 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:50 smithi037 ceph-mon[31211]: last_changed 2024-09-19T05:57:45.859369+0000 2024-09-19T05:57:51.325 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:50 smithi037 ceph-mon[31211]: created 2024-09-19T05:56:19.390249+0000 2024-09-19T05:57:51.325 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:50 smithi037 ceph-mon[31211]: min_mon_release 19 (squid) 2024-09-19T05:57:51.325 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:50 smithi037 ceph-mon[31211]: election_strategy: 1 2024-09-19T05:57:51.325 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:50 smithi037 ceph-mon[31211]: 0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-19T05:57:51.325 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:50 smithi037 ceph-mon[31211]: 1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.c 2024-09-19T05:57:51.325 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:50 smithi037 ceph-mon[31211]: fsmap 2024-09-19T05:57:51.325 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:50 smithi037 ceph-mon[31211]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T05:57:51.326 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:50 smithi037 ceph-mon[31211]: mgrmap e13: x(active, since 38s) 2024-09-19T05:57:51.326 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:50 smithi037 ceph-mon[31211]: overall HEALTH_OK 2024-09-19T05:57:51.326 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:50 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:57:51.326 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:50 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:57:51.326 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:50 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:57:51.326 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:50 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T05:57:51.326 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:50 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:57:51.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:51.491+0000 7fc79c3cc640 1 -- 172.21.15.117:0/3168499578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc780003530 msgr2=0x7fc7800059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:57:51.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:51.491+0000 7fc79c3cc640 1 --2- 172.21.15.117:0/3168499578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc780003530 0x7fc7800059c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc794102af0 tx=0x7fc79002c490 comp rx=0 tx=0).stop 2024-09-19T05:57:51.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:51.491+0000 7fc79c3cc640 1 -- 172.21.15.117:0/3168499578 shutdown_connections 2024-09-19T05:57:51.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:51.491+0000 7fc79c3cc640 1 --2- 172.21.15.117:0/3168499578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc780003530 0x7fc7800059c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:51.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:51.491+0000 7fc79c3cc640 1 -- 172.21.15.117:0/3168499578 >> 172.21.15.117:0/3168499578 conn(0x7fc7940fd320 msgr2=0x7fc7940ff740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:57:51.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:51.491+0000 7fc79c3cc640 1 -- 172.21.15.117:0/3168499578 shutdown_connections 2024-09-19T05:57:51.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:51.491+0000 7fc79c3cc640 1 -- 172.21.15.117:0/3168499578 wait complete. 2024-09-19T05:57:51.496 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:51.492+0000 7fc79c3cc640 1 Processor -- start 2024-09-19T05:57:51.496 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:51.492+0000 7fc79c3cc640 1 -- start start 2024-09-19T05:57:51.496 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:51.493+0000 7fc79c3cc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc780003530 0x7fc7941972a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:57:51.496 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:51.493+0000 7fc79c3cc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7941977e0 0x7fc79419bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:57:51.496 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:51.493+0000 7fc79c3cc640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc794109780 con 0x7fc7941977e0 2024-09-19T05:57:51.496 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:51.493+0000 7fc79c3cc640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc794109600 con 0x7fc780003530 2024-09-19T05:57:51.496 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:51.493+0000 7fc79a168640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc780003530 0x7fc7941972a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:57:51.496 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:51.493+0000 7fc79a168640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc780003530 0x7fc7941972a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:49094/0 (socket says 172.21.15.117:49094) 2024-09-19T05:57:51.496 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:51.493+0000 7fc79a168640 1 -- 172.21.15.117:0/473046752 learned_addr learned my addr 172.21.15.117:0/473046752 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T05:57:51.496 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:51.493+0000 7fc799967640 1 --2- 172.21.15.117:0/473046752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7941977e0 0x7fc79419bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:57:51.496 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:51.493+0000 7fc79a168640 1 -- 172.21.15.117:0/473046752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc780003530 msgr2=0x7fc7941972a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-19T05:57:51.497 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:51.493+0000 7fc79a168640 1 -- 172.21.15.117:0/473046752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc780003530 msgr2=0x7fc7941972a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T05:57:51.497 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:51.493+0000 7fc79a168640 1 --2- 172.21.15.117:0/473046752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc780003530 0x7fc7941972a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T05:57:51.497 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:51.493+0000 7fc79a168640 1 --2- 172.21.15.117:0/473046752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc780003530 0x7fc7941972a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:57:51.497 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:51.493+0000 7fc799967640 1 -- 172.21.15.117:0/473046752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc780003530 msgr2=0x7fc7941972a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T05:57:51.497 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:51.493+0000 7fc799967640 1 --2- 172.21.15.117:0/473046752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc780003530 0x7fc7941972a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:51.497 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:51.493+0000 7fc799967640 1 -- 172.21.15.117:0/473046752 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc794197e00 con 0x7fc7941977e0 2024-09-19T05:57:51.497 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:51.494+0000 7fc799967640 1 --2- 172.21.15.117:0/473046752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7941977e0 0x7fc79419bb70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc78400b3d0 tx=0x7fc78400b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:57:51.497 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:51.494+0000 7fc78b7fe640 1 -- 172.21.15.117:0/473046752 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fc784011630 con 0x7fc7941977e0 2024-09-19T05:57:51.497 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:51.494+0000 7fc78b7fe640 1 -- 172.21.15.117:0/473046752 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc784011cb0 con 0x7fc7941977e0 2024-09-19T05:57:51.497 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:51.494+0000 7fc79c3cc640 1 -- 172.21.15.117:0/473046752 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc79419c0b0 con 0x7fc7941977e0 2024-09-19T05:57:51.497 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:51.494+0000 7fc78b7fe640 1 -- 172.21.15.117:0/473046752 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fc784010df0 con 0x7fc7941977e0 2024-09-19T05:57:51.497 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:51.494+0000 7fc79c3cc640 1 -- 172.21.15.117:0/473046752 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc79419c5f0 con 0x7fc7941977e0 2024-09-19T05:57:51.498 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:51.495+0000 7fc78b7fe640 1 -- 172.21.15.117:0/473046752 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fc784018020 con 0x7fc7941977e0 2024-09-19T05:57:51.498 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:51.495+0000 7fc79c3cc640 1 -- 172.21.15.117:0/473046752 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc794102da0 con 0x7fc7941977e0 2024-09-19T05:57:51.498 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:51.495+0000 7fc78b7fe640 1 --2- 172.21.15.117:0/473046752 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fc778039090 0x7fc77803b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:57:51.498 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:51.495+0000 7fc78b7fe640 1 -- 172.21.15.117:0/473046752 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fc78404bf60 con 0x7fc7941977e0 2024-09-19T05:57:51.498 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:51.496+0000 7fc79a168640 1 --2- 172.21.15.117:0/473046752 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fc778039090 0x7fc77803b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:57:51.498 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:51.496+0000 7fc79a168640 1 --2- 172.21.15.117:0/473046752 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fc778039090 0x7fc77803b550 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc790012c10 tx=0x7fc7900323a0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:57:51.502 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:51.501+0000 7fc78b7fe640 1 -- 172.21.15.117:0/473046752 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc78401f020 con 0x7fc7941977e0 2024-09-19T05:57:51.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:51.735+0000 7fc79c3cc640 1 -- 172.21.15.117:0/473046752 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fc794190f90 con 0x7fc7941977e0 2024-09-19T05:57:51.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:51.736+0000 7fc78b7fe640 1 -- 172.21.15.117:0/473046752 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7fc784018310 con 0x7fc7941977e0 2024-09-19T05:57:51.738 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T05:57:51.738 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":2,"fsid":"b8c8bdae-764b-11ef-bceb-c7b262605968","modified":"2024-09-19T05:57:45.859369Z","created":"2024-09-19T05:56:19.390249Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:3300","nonce":0},{"type":"v1","addr":"172.21.15.37:6789","nonce":0}]},"addr":"172.21.15.37:6789/0","public_addr":"172.21.15.37:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T05:57:51.738 INFO:teuthology.orchestra.run.smithi117.stderr:dumped monmap epoch 2 2024-09-19T05:57:51.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:51.738+0000 7fc79c3cc640 1 -- 172.21.15.117:0/473046752 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fc778039090 msgr2=0x7fc77803b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:57:51.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:51.738+0000 7fc79c3cc640 1 --2- 172.21.15.117:0/473046752 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fc778039090 0x7fc77803b550 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc790012c10 tx=0x7fc7900323a0 comp rx=0 tx=0).stop 2024-09-19T05:57:51.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:51.738+0000 7fc79c3cc640 1 -- 172.21.15.117:0/473046752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7941977e0 msgr2=0x7fc79419bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:57:51.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:51.738+0000 7fc79c3cc640 1 --2- 172.21.15.117:0/473046752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7941977e0 0x7fc79419bb70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc78400b3d0 tx=0x7fc78400b890 comp rx=0 tx=0).stop 2024-09-19T05:57:51.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:51.738+0000 7fc79c3cc640 1 -- 172.21.15.117:0/473046752 shutdown_connections 2024-09-19T05:57:51.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:51.738+0000 7fc79c3cc640 1 --2- 172.21.15.117:0/473046752 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fc778039090 0x7fc77803b550 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:51.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:51.738+0000 7fc79c3cc640 1 --2- 172.21.15.117:0/473046752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7941977e0 0x7fc79419bb70 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:51.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:51.738+0000 7fc79c3cc640 1 --2- 172.21.15.117:0/473046752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc780003530 0x7fc7941972a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:51.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:51.738+0000 7fc79c3cc640 1 -- 172.21.15.117:0/473046752 >> 172.21.15.117:0/473046752 conn(0x7fc7940fd320 msgr2=0x7fc7940ff250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:57:51.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:51.738+0000 7fc79c3cc640 1 -- 172.21.15.117:0/473046752 shutdown_connections 2024-09-19T05:57:51.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:51.738+0000 7fc79c3cc640 1 -- 172.21.15.117:0/473046752 wait complete. 2024-09-19T05:57:51.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:51 smithi117 ceph-mon[35050]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:57:52.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:51 smithi117 ceph-mon[35050]: Deploying daemon mon.b on smithi099 2024-09-19T05:57:52.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:51 smithi117 ceph-mon[35050]: from='client.? 172.21.15.117:0/473046752' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T05:57:52.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:51 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:57:52.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:51 smithi037 ceph-mon[31211]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:57:52.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:51 smithi037 ceph-mon[31211]: Deploying daemon mon.b on smithi099 2024-09-19T05:57:52.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:51 smithi037 ceph-mon[31211]: from='client.? 172.21.15.117:0/473046752' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T05:57:52.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:51 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:57:53.316 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T05:57:53.316 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T05:57:53.566 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T05:57:53.946 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:53 smithi117 ceph-mon[35050]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:57:54.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:54.024+0000 7f31169fe640 1 -- 172.21.15.117:0/2733198261 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3110107670 msgr2=0x7f3110107a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:57:54.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:54.024+0000 7f31169fe640 1 --2- 172.21.15.117:0/2733198261 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3110107670 0x7f3110107a50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3100009880 tx=0x7f310002a5d0 comp rx=0 tx=0).stop 2024-09-19T05:57:54.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:54.024+0000 7f31169fe640 1 -- 172.21.15.117:0/2733198261 shutdown_connections 2024-09-19T05:57:54.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:54.024+0000 7f31169fe640 1 --2- 172.21.15.117:0/2733198261 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3110107670 0x7f3110107a50 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:54.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:54.024+0000 7f31169fe640 1 -- 172.21.15.117:0/2733198261 >> 172.21.15.117:0/2733198261 conn(0x7f31100fd330 msgr2=0x7f31100ff750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:57:54.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:54.024+0000 7f31169fe640 1 -- 172.21.15.117:0/2733198261 shutdown_connections 2024-09-19T05:57:54.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:54.024+0000 7f31169fe640 1 -- 172.21.15.117:0/2733198261 wait complete. 2024-09-19T05:57:54.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:54.025+0000 7f31169fe640 1 Processor -- start 2024-09-19T05:57:54.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:54.025+0000 7f31169fe640 1 -- start start 2024-09-19T05:57:54.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:54.025+0000 7f31169fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3110107670 0x7f3110197460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:57:54.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:54.025+0000 7f31169fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31101979a0 0x7f311019bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:57:54.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:54.025+0000 7f31169fe640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f311010bd30 con 0x7f3110107670 2024-09-19T05:57:54.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:54.025+0000 7f31169fe640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f311010bbb0 con 0x7f31101979a0 2024-09-19T05:57:54.031 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:54.025+0000 7f310f7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31101979a0 0x7f311019bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:57:54.031 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:54.025+0000 7f310f7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31101979a0 0x7f311019bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:49106/0 (socket says 172.21.15.117:49106) 2024-09-19T05:57:54.031 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:54.025+0000 7f310f7fe640 1 -- 172.21.15.117:0/674634084 learned_addr learned my addr 172.21.15.117:0/674634084 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T05:57:54.031 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:54.025+0000 7f310ffff640 1 --2- 172.21.15.117:0/674634084 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3110107670 0x7f3110197460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:57:54.031 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:54.025+0000 7f310f7fe640 1 -- 172.21.15.117:0/674634084 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31101979a0 msgr2=0x7f311019bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-19T05:57:54.031 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:54.025+0000 7f310f7fe640 1 -- 172.21.15.117:0/674634084 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31101979a0 msgr2=0x7f311019bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T05:57:54.031 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:54.025+0000 7f310f7fe640 1 --2- 172.21.15.117:0/674634084 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31101979a0 0x7f311019bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T05:57:54.031 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:54.025+0000 7f310f7fe640 1 --2- 172.21.15.117:0/674634084 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31101979a0 0x7f311019bd30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:57:54.031 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:54.026+0000 7f310ffff640 1 -- 172.21.15.117:0/674634084 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31101979a0 msgr2=0x7f311019bd30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T05:57:54.031 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:54.026+0000 7f310ffff640 1 --2- 172.21.15.117:0/674634084 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31101979a0 0x7f311019bd30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:54.031 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:54.026+0000 7f310ffff640 1 -- 172.21.15.117:0/674634084 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3110197fc0 con 0x7f3110107670 2024-09-19T05:57:54.031 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:54.026+0000 7f310ffff640 1 --2- 172.21.15.117:0/674634084 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3110107670 0x7f3110197460 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3100005ab0 tx=0x7f3100032c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:57:54.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:54.026+0000 7f310d7fa640 1 -- 172.21.15.117:0/674634084 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f3100035070 con 0x7f3110107670 2024-09-19T05:57:54.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:54.026+0000 7f310d7fa640 1 -- 172.21.15.117:0/674634084 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3100032e40 con 0x7f3110107670 2024-09-19T05:57:54.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:54.026+0000 7f31169fe640 1 -- 172.21.15.117:0/674634084 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f311019c270 con 0x7f3110107670 2024-09-19T05:57:54.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:54.026+0000 7f310d7fa640 1 -- 172.21.15.117:0/674634084 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f310003bc10 con 0x7f3110107670 2024-09-19T05:57:54.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:54.026+0000 7f31169fe640 1 -- 172.21.15.117:0/674634084 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f311019c7b0 con 0x7f3110107670 2024-09-19T05:57:54.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:54.027+0000 7f310d7fa640 1 -- 172.21.15.117:0/674634084 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f3100042030 con 0x7f3110107670 2024-09-19T05:57:54.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:54.027+0000 7f31169fe640 1 -- 172.21.15.117:0/674634084 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3110102db0 con 0x7f3110107670 2024-09-19T05:57:54.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:54.027+0000 7f310d7fa640 1 --2- 172.21.15.117:0/674634084 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f30f8039040 0x7f30f803b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:57:54.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:54.027+0000 7f310d7fa640 1 -- 172.21.15.117:0/674634084 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f3100040070 con 0x7f3110107670 2024-09-19T05:57:54.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:54.027+0000 7f310f7fe640 1 --2- 172.21.15.117:0/674634084 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f30f8039040 0x7f30f803b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:57:54.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:54.028+0000 7f310f7fe640 1 --2- 172.21.15.117:0/674634084 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f30f8039040 0x7f30f803b500 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3104009100 tx=0x7f3104008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:57:54.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:54.032+0000 7f310d7fa640 1 -- 172.21.15.117:0/674634084 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f310003bdb0 con 0x7f3110107670 2024-09-19T05:57:54.265 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:54.263+0000 7f31169fe640 1 -- 172.21.15.117:0/674634084 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f311019ca60 con 0x7f3110107670 2024-09-19T05:57:54.266 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:54.264+0000 7f310d7fa640 1 -- 172.21.15.117:0/674634084 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f310003b460 con 0x7f3110107670 2024-09-19T05:57:54.266 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T05:57:54.266 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":2,"fsid":"b8c8bdae-764b-11ef-bceb-c7b262605968","modified":"2024-09-19T05:57:45.859369Z","created":"2024-09-19T05:56:19.390249Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:3300","nonce":0},{"type":"v1","addr":"172.21.15.37:6789","nonce":0}]},"addr":"172.21.15.37:6789/0","public_addr":"172.21.15.37:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T05:57:54.267 INFO:teuthology.orchestra.run.smithi117.stderr:dumped monmap epoch 2 2024-09-19T05:57:54.268 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:54.266+0000 7f31169fe640 1 -- 172.21.15.117:0/674634084 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f30f8039040 msgr2=0x7f30f803b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:57:54.268 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:54.266+0000 7f31169fe640 1 --2- 172.21.15.117:0/674634084 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f30f8039040 0x7f30f803b500 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3104009100 tx=0x7f3104008040 comp rx=0 tx=0).stop 2024-09-19T05:57:54.268 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:54.266+0000 7f31169fe640 1 -- 172.21.15.117:0/674634084 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3110107670 msgr2=0x7f3110197460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:57:54.268 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:54.266+0000 7f31169fe640 1 --2- 172.21.15.117:0/674634084 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3110107670 0x7f3110197460 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3100005ab0 tx=0x7f3100032c50 comp rx=0 tx=0).stop 2024-09-19T05:57:54.269 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:54.267+0000 7f31169fe640 1 -- 172.21.15.117:0/674634084 shutdown_connections 2024-09-19T05:57:54.269 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:54.267+0000 7f31169fe640 1 --2- 172.21.15.117:0/674634084 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f30f8039040 0x7f30f803b500 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:54.269 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:54.267+0000 7f31169fe640 1 --2- 172.21.15.117:0/674634084 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31101979a0 0x7f311019bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:54.269 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:54.267+0000 7f31169fe640 1 --2- 172.21.15.117:0/674634084 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3110107670 0x7f3110197460 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:57:54.269 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:54.267+0000 7f31169fe640 1 -- 172.21.15.117:0/674634084 >> 172.21.15.117:0/674634084 conn(0x7f31100fd330 msgr2=0x7f31100fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:57:54.269 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:54.267+0000 7f31169fe640 1 -- 172.21.15.117:0/674634084 shutdown_connections 2024-09-19T05:57:54.269 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:57:54.267+0000 7f31169fe640 1 -- 172.21.15.117:0/674634084 wait complete. 2024-09-19T05:57:54.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:53 smithi037 ceph-mon[31211]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:57:54.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:57:54 smithi099 systemd[1]: Started Ceph mon.b for b8c8bdae-764b-11ef-bceb-c7b262605968. 2024-09-19T05:57:55.836 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T05:57:55.836 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T05:57:56.085 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T05:58:00.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:59 smithi037 ceph-mon[31211]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:58:00.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:59 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T05:58:00.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:59 smithi037 ceph-mon[31211]: mon.c calling monitor election 2024-09-19T05:58:00.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:59 smithi037 ceph-mon[31211]: mon.a calling monitor election 2024-09-19T05:58:00.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:59 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:58:00.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:59 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:58:00.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:59 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:58:00.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:59 smithi037 ceph-mon[31211]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:58:00.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:59 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:58:00.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:59 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:58:00.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:59 smithi037 ceph-mon[31211]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:58:00.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:59 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:58:00.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:59 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:58:00.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:59 smithi037 ceph-mon[31211]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T05:58:00.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:59 smithi037 ceph-mon[31211]: monmap epoch 3 2024-09-19T05:58:00.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:59 smithi037 ceph-mon[31211]: fsid b8c8bdae-764b-11ef-bceb-c7b262605968 2024-09-19T05:58:00.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:59 smithi037 ceph-mon[31211]: last_changed 2024-09-19T05:57:54.738340+0000 2024-09-19T05:58:00.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:59 smithi037 ceph-mon[31211]: created 2024-09-19T05:56:19.390249+0000 2024-09-19T05:58:00.076 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:59 smithi037 ceph-mon[31211]: min_mon_release 19 (squid) 2024-09-19T05:58:00.076 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:59 smithi037 ceph-mon[31211]: election_strategy: 1 2024-09-19T05:58:00.076 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:59 smithi037 ceph-mon[31211]: 0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-19T05:58:00.076 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:59 smithi037 ceph-mon[31211]: 1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.c 2024-09-19T05:58:00.076 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:59 smithi037 ceph-mon[31211]: 2: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.b 2024-09-19T05:58:00.076 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:59 smithi037 ceph-mon[31211]: fsmap 2024-09-19T05:58:00.076 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:59 smithi037 ceph-mon[31211]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T05:58:00.076 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:59 smithi037 ceph-mon[31211]: mgrmap e13: x(active, since 47s) 2024-09-19T05:58:00.076 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:59 smithi037 ceph-mon[31211]: overall HEALTH_OK 2024-09-19T05:58:00.076 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:59 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:00.076 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:59 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:00.076 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:59 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:00.076 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:57:59 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:00.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:00.089+0000 7f5fcfc1d640 1 -- 172.21.15.117:0/1604299783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5fb4003530 msgr2=0x7f5fb40059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:00.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:00.089+0000 7f5fcfc1d640 1 --2- 172.21.15.117:0/1604299783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5fb4003530 0x7f5fb40059c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5fc806aa60 tx=0x7f5fb802c3f0 comp rx=0 tx=0).stop 2024-09-19T05:58:00.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:00.089+0000 7f5fcfc1d640 1 -- 172.21.15.117:0/1604299783 shutdown_connections 2024-09-19T05:58:00.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:00.089+0000 7f5fcfc1d640 1 --2- 172.21.15.117:0/1604299783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5fb4003530 0x7f5fb40059c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:00.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:00.089+0000 7f5fcfc1d640 1 -- 172.21.15.117:0/1604299783 >> 172.21.15.117:0/1604299783 conn(0x7f5fc80fc220 msgr2=0x7f5fc80fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:58:00.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:00.089+0000 7f5fcfc1d640 1 -- 172.21.15.117:0/1604299783 shutdown_connections 2024-09-19T05:58:00.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:00.090+0000 7f5fcfc1d640 1 -- 172.21.15.117:0/1604299783 wait complete. 2024-09-19T05:58:00.093 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:00.090+0000 7f5fcfc1d640 1 Processor -- start 2024-09-19T05:58:00.093 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:00.090+0000 7f5fcfc1d640 1 -- start start 2024-09-19T05:58:00.093 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:00.090+0000 7f5fcfc1d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5fb4003530 0x7f5fc81a3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:00.093 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:00.090+0000 7f5fcfc1d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5fc81a3b70 0x7f5fc819d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:00.093 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:59 smithi117 ceph-mon[35050]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:58:00.093 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:59 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T05:58:00.093 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:59 smithi117 ceph-mon[35050]: mon.c calling monitor election 2024-09-19T05:58:00.093 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:59 smithi117 ceph-mon[35050]: mon.a calling monitor election 2024-09-19T05:58:00.093 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:59 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:58:00.094 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:59 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:58:00.094 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:59 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:58:00.094 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:59 smithi117 ceph-mon[35050]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:58:00.094 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:59 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:58:00.094 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:59 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:58:00.094 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:59 smithi117 ceph-mon[35050]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:58:00.094 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:59 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:58:00.094 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:59 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:58:00.094 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:59 smithi117 ceph-mon[35050]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T05:58:00.094 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:59 smithi117 ceph-mon[35050]: monmap epoch 3 2024-09-19T05:58:00.094 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:59 smithi117 ceph-mon[35050]: fsid b8c8bdae-764b-11ef-bceb-c7b262605968 2024-09-19T05:58:00.094 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:59 smithi117 ceph-mon[35050]: last_changed 2024-09-19T05:57:54.738340+0000 2024-09-19T05:58:00.094 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:59 smithi117 ceph-mon[35050]: created 2024-09-19T05:56:19.390249+0000 2024-09-19T05:58:00.095 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:59 smithi117 ceph-mon[35050]: min_mon_release 19 (squid) 2024-09-19T05:58:00.095 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:59 smithi117 ceph-mon[35050]: election_strategy: 1 2024-09-19T05:58:00.095 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:59 smithi117 ceph-mon[35050]: 0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-19T05:58:00.095 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:59 smithi117 ceph-mon[35050]: 1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.c 2024-09-19T05:58:00.095 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:59 smithi117 ceph-mon[35050]: 2: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.b 2024-09-19T05:58:00.095 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:59 smithi117 ceph-mon[35050]: fsmap 2024-09-19T05:58:00.095 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:59 smithi117 ceph-mon[35050]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T05:58:00.095 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:59 smithi117 ceph-mon[35050]: mgrmap e13: x(active, since 47s) 2024-09-19T05:58:00.095 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:59 smithi117 ceph-mon[35050]: overall HEALTH_OK 2024-09-19T05:58:00.095 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:59 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:00.095 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:59 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:00.095 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:59 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:00.095 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:57:59 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:00.097 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:00.090+0000 7f5fcfc1d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fc819dcf0 0x7f5fc819e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:00.097 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:00.091+0000 7f5fcfc1d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc810fd30 con 0x7f5fc81a3b70 2024-09-19T05:58:00.098 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:00.091+0000 7f5fcfc1d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc810fbb0 con 0x7f5fb4003530 2024-09-19T05:58:00.098 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:00.091+0000 7f5fcfc1d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc810feb0 con 0x7f5fc819dcf0 2024-09-19T05:58:00.098 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:00.091+0000 7f5fce1ba640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fc819dcf0 0x7f5fc819e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:00.098 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:00.091+0000 7f5fcd9b9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5fb4003530 0x7f5fc81a3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:00.098 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:00.091+0000 7f5fcd9b9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5fb4003530 0x7f5fc81a3630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.117:49394/0 (socket says 172.21.15.117:49394) 2024-09-19T05:58:00.098 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:00.091+0000 7f5fce1ba640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fc819dcf0 0x7f5fc819e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:58990/0 (socket says 172.21.15.117:58990) 2024-09-19T05:58:00.098 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:00.091+0000 7f5fcd9b9640 1 -- 172.21.15.117:0/3522908069 learned_addr learned my addr 172.21.15.117:0/3522908069 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T05:58:00.098 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:00.091+0000 7f5fcd9b9640 1 -- 172.21.15.117:0/3522908069 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5fb4003530 msgr2=0x7f5fc81a3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-19T05:58:00.098 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:00.091+0000 7f5fce1ba640 1 -- 172.21.15.117:0/3522908069 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fc819dcf0 msgr2=0x7f5fc819e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-19T05:58:00.098 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:00.091+0000 7f5fcd9b9640 1 -- 172.21.15.117:0/3522908069 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5fb4003530 msgr2=0x7f5fc81a3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T05:58:00.098 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:00.091+0000 7f5fce1ba640 1 -- 172.21.15.117:0/3522908069 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fc819dcf0 msgr2=0x7f5fc819e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T05:58:00.098 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:00.091+0000 7f5fcd9b9640 1 --2- 172.21.15.117:0/3522908069 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5fb4003530 0x7f5fc81a3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T05:58:00.098 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:00.091+0000 7f5fce1ba640 1 --2- 172.21.15.117:0/3522908069 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fc819dcf0 0x7f5fc819e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T05:58:00.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:00.091+0000 7f5fcd9b9640 1 --2- 172.21.15.117:0/3522908069 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5fb4003530 0x7f5fc81a3630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:58:00.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:00.091+0000 7f5fcd1b8640 1 --2- 172.21.15.117:0/3522908069 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5fc81a3b70 0x7f5fc819d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:00.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:00.091+0000 7f5fce1ba640 1 --2- 172.21.15.117:0/3522908069 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fc819dcf0 0x7f5fc819e170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:58:00.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:00.091+0000 7f5fcd1b8640 1 -- 172.21.15.117:0/3522908069 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fc819dcf0 msgr2=0x7f5fc819e170 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T05:58:00.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:00.091+0000 7f5fcd1b8640 1 --2- 172.21.15.117:0/3522908069 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fc819dcf0 0x7f5fc819e170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:00.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:00.091+0000 7f5fcd1b8640 1 -- 172.21.15.117:0/3522908069 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5fb4003530 msgr2=0x7f5fc81a3630 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T05:58:00.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:00.091+0000 7f5fcd1b8640 1 --2- 172.21.15.117:0/3522908069 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5fb4003530 0x7f5fc81a3630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:00.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:00.091+0000 7f5fcd1b8640 1 -- 172.21.15.117:0/3522908069 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fc81aa490 con 0x7f5fc81a3b70 2024-09-19T05:58:00.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:00.091+0000 7f5fcd1b8640 1 --2- 172.21.15.117:0/3522908069 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5fc81a3b70 0x7f5fc819d7b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5fc400b450 tx=0x7f5fc400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:00.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:00.092+0000 7f5fbeffd640 1 -- 172.21.15.117:0/3522908069 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc4004230 con 0x7f5fc81a3b70 2024-09-19T05:58:00.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:00.092+0000 7f5fbeffd640 1 -- 172.21.15.117:0/3522908069 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5fc40043d0 con 0x7f5fc81a3b70 2024-09-19T05:58:00.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:00.092+0000 7f5fcfc1d640 1 -- 172.21.15.117:0/3522908069 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fc81aa6c0 con 0x7f5fc81a3b70 2024-09-19T05:58:00.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:00.092+0000 7f5fbeffd640 1 -- 172.21.15.117:0/3522908069 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc4003cb0 con 0x7f5fc81a3b70 2024-09-19T05:58:00.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:00.092+0000 7f5fcfc1d640 1 -- 172.21.15.117:0/3522908069 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fc81aac50 con 0x7f5fc81a3b70 2024-09-19T05:58:00.100 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:00.093+0000 7f5fcfc1d640 1 -- 172.21.15.117:0/3522908069 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fc806ad10 con 0x7f5fc81a3b70 2024-09-19T05:58:00.100 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:00.093+0000 7f5fbeffd640 1 -- 172.21.15.117:0/3522908069 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f5fc400f050 con 0x7f5fc81a3b70 2024-09-19T05:58:00.100 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:00.093+0000 7f5fbeffd640 1 --2- 172.21.15.117:0/3522908069 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f5fac039730 0x7f5fac03bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:00.100 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:00.093+0000 7f5fbeffd640 1 -- 172.21.15.117:0/3522908069 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f5fc404c320 con 0x7f5fc81a3b70 2024-09-19T05:58:00.100 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:00.093+0000 7f5fcd9b9640 1 --2- 172.21.15.117:0/3522908069 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f5fac039730 0x7f5fac03bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:00.100 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:00.094+0000 7f5fcd9b9640 1 --2- 172.21.15.117:0/3522908069 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f5fac039730 0x7f5fac03bbf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5fb8014a90 tx=0x7f5fb8005f60 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:00.100 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:00.098+0000 7f5fbeffd640 1 -- 172.21.15.117:0/3522908069 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5fc400d040 con 0x7f5fc81a3b70 2024-09-19T05:58:00.352 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:00.350+0000 7f5fcfc1d640 1 -- 172.21.15.117:0/3522908069 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f5fc81aaf70 con 0x7f5fc81a3b70 2024-09-19T05:58:00.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:00.351+0000 7f5fbeffd640 1 -- 172.21.15.117:0/3522908069 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1279 (secure 0 0 0) 0x7f5fc400d540 con 0x7f5fc81a3b70 2024-09-19T05:58:00.353 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T05:58:00.353 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":3,"fsid":"b8c8bdae-764b-11ef-bceb-c7b262605968","modified":"2024-09-19T05:57:54.738340Z","created":"2024-09-19T05:56:19.390249Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:3300","nonce":0},{"type":"v1","addr":"172.21.15.37:6789","nonce":0}]},"addr":"172.21.15.37:6789/0","public_addr":"172.21.15.37:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:3300","nonce":0},{"type":"v1","addr":"172.21.15.99:6789","nonce":0}]},"addr":"172.21.15.99:6789/0","public_addr":"172.21.15.99:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T05:58:00.353 INFO:teuthology.orchestra.run.smithi117.stderr:dumped monmap epoch 3 2024-09-19T05:58:00.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:00.353+0000 7f5fcfc1d640 1 -- 172.21.15.117:0/3522908069 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f5fac039730 msgr2=0x7f5fac03bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:00.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:00.353+0000 7f5fcfc1d640 1 --2- 172.21.15.117:0/3522908069 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f5fac039730 0x7f5fac03bbf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5fb8014a90 tx=0x7f5fb8005f60 comp rx=0 tx=0).stop 2024-09-19T05:58:00.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:00.353+0000 7f5fcfc1d640 1 -- 172.21.15.117:0/3522908069 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5fc81a3b70 msgr2=0x7f5fc819d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:00.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:00.353+0000 7f5fcfc1d640 1 --2- 172.21.15.117:0/3522908069 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5fc81a3b70 0x7f5fc819d7b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5fc400b450 tx=0x7f5fc400b910 comp rx=0 tx=0).stop 2024-09-19T05:58:00.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:00.353+0000 7f5fcfc1d640 1 -- 172.21.15.117:0/3522908069 shutdown_connections 2024-09-19T05:58:00.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:00.353+0000 7f5fcfc1d640 1 --2- 172.21.15.117:0/3522908069 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f5fac039730 0x7f5fac03bbf0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:00.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:00.353+0000 7f5fcfc1d640 1 --2- 172.21.15.117:0/3522908069 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5fc819dcf0 0x7f5fc819e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:00.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:00.353+0000 7f5fcfc1d640 1 --2- 172.21.15.117:0/3522908069 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5fc81a3b70 0x7f5fc819d7b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:00.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:00.353+0000 7f5fcfc1d640 1 --2- 172.21.15.117:0/3522908069 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5fb4003530 0x7f5fc81a3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:00.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:00.353+0000 7f5fcfc1d640 1 -- 172.21.15.117:0/3522908069 >> 172.21.15.117:0/3522908069 conn(0x7f5fc80fc220 msgr2=0x7f5fc80fe200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:58:00.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:00.353+0000 7f5fcfc1d640 1 -- 172.21.15.117:0/3522908069 shutdown_connections 2024-09-19T05:58:00.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:00.353+0000 7f5fcfc1d640 1 -- 172.21.15.117:0/3522908069 wait complete. 2024-09-19T05:58:01.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:00 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:58:01.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:00 smithi037 ceph-mon[31211]: from='client.? 172.21.15.117:0/3522908069' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T05:58:01.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:00 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:58:01.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:00 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:01.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:00 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:01.100 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:00 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:58:01.100 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:00 smithi117 ceph-mon[35050]: from='client.? 172.21.15.117:0/3522908069' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T05:58:01.100 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:00 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:58:01.100 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:00 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:01.100 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:00 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:01.446 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-19T05:58:01.446 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-19T05:58:01.704 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:58:02.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:01 smithi099 ceph-mon[35300]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:58:02.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:01 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T05:58:02.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:01 smithi099 ceph-mon[35300]: mon.c calling monitor election 2024-09-19T05:58:02.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:01 smithi099 ceph-mon[35300]: mon.a calling monitor election 2024-09-19T05:58:02.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:01 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:58:02.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:01 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:58:02.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:01 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:58:02.190 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:01 smithi099 ceph-mon[35300]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:58:02.190 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:01 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:58:02.190 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:01 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:58:02.190 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:01 smithi099 ceph-mon[35300]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:58:02.190 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:01 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:58:02.190 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:01 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:58:02.190 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:01 smithi099 ceph-mon[35300]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T05:58:02.190 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:01 smithi099 ceph-mon[35300]: monmap epoch 3 2024-09-19T05:58:02.190 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:01 smithi099 ceph-mon[35300]: fsid b8c8bdae-764b-11ef-bceb-c7b262605968 2024-09-19T05:58:02.190 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:01 smithi099 ceph-mon[35300]: last_changed 2024-09-19T05:57:54.738340+0000 2024-09-19T05:58:02.190 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:01 smithi099 ceph-mon[35300]: created 2024-09-19T05:56:19.390249+0000 2024-09-19T05:58:02.190 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:01 smithi099 ceph-mon[35300]: min_mon_release 19 (squid) 2024-09-19T05:58:02.190 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:01 smithi099 ceph-mon[35300]: election_strategy: 1 2024-09-19T05:58:02.190 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:01 smithi099 ceph-mon[35300]: 0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-19T05:58:02.190 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:01 smithi099 ceph-mon[35300]: 1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.c 2024-09-19T05:58:02.191 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:01 smithi099 ceph-mon[35300]: 2: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.b 2024-09-19T05:58:02.191 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:01 smithi099 ceph-mon[35300]: fsmap 2024-09-19T05:58:02.191 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:01 smithi099 ceph-mon[35300]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T05:58:02.191 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:01 smithi099 ceph-mon[35300]: mgrmap e13: x(active, since 47s) 2024-09-19T05:58:02.191 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:01 smithi099 ceph-mon[35300]: overall HEALTH_OK 2024-09-19T05:58:02.191 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:01 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:02.191 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:01 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:02.191 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:01 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:02.191 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:01 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:02.191 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:01 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:58:02.191 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:01 smithi099 ceph-mon[35300]: from='client.? 172.21.15.117:0/3522908069' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T05:58:02.191 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:01 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:58:02.191 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:01 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:02.191 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:01 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:02.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:02.203+0000 7fd6246cd640 1 -- 172.21.15.37:0/2426545262 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd61c102730 msgr2=0x7fd61c102b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:02.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:02.203+0000 7fd6246cd640 1 --2- 172.21.15.37:0/2426545262 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd61c102730 0x7fd61c102b10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd618009810 tx=0x7fd61802a540 comp rx=0 tx=0).stop 2024-09-19T05:58:02.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:02.203+0000 7fd6246cd640 1 -- 172.21.15.37:0/2426545262 shutdown_connections 2024-09-19T05:58:02.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:02.203+0000 7fd6246cd640 1 --2- 172.21.15.37:0/2426545262 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd61c102730 0x7fd61c102b10 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:02.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:02.203+0000 7fd6246cd640 1 -- 172.21.15.37:0/2426545262 >> 172.21.15.37:0/2426545262 conn(0x7fd61c077310 msgr2=0x7fd61c0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:58:02.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:02.203+0000 7fd6246cd640 1 -- 172.21.15.37:0/2426545262 shutdown_connections 2024-09-19T05:58:02.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:02.203+0000 7fd6246cd640 1 -- 172.21.15.37:0/2426545262 wait complete. 2024-09-19T05:58:02.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:02.204+0000 7fd6246cd640 1 Processor -- start 2024-09-19T05:58:02.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:02.204+0000 7fd6246cd640 1 -- start start 2024-09-19T05:58:02.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:02.204+0000 7fd6246cd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd61c102730 0x7fd61c197350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:02.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:02.204+0000 7fd6246cd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd61c197890 0x7fd61c19bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:02.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:02.204+0000 7fd6246cd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd61c19c160 0x7fd61c19c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:02.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:02.204+0000 7fd6246cd640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd61c10bc30 con 0x7fd61c102730 2024-09-19T05:58:02.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:02.204+0000 7fd6246cd640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fd61c10bab0 con 0x7fd61c19c160 2024-09-19T05:58:02.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:02.204+0000 7fd6246cd640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd61c10bdb0 con 0x7fd61c197890 2024-09-19T05:58:02.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:02.204+0000 7fd622469640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd61c102730 0x7fd61c197350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:02.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:02.204+0000 7fd622469640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd61c102730 0x7fd61c197350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42966/0 (socket says 172.21.15.37:42966) 2024-09-19T05:58:02.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:02.204+0000 7fd622469640 1 -- 172.21.15.37:0/2630890950 learned_addr learned my addr 172.21.15.37:0/2630890950 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T05:58:02.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:02.204+0000 7fd621c68640 1 --2- 172.21.15.37:0/2630890950 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd61c197890 0x7fd61c19bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:02.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:02.204+0000 7fd622c6a640 1 --2- 172.21.15.37:0/2630890950 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd61c19c160 0x7fd61c19c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:02.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:02.205+0000 7fd622469640 1 -- 172.21.15.37:0/2630890950 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd61c197890 msgr2=0x7fd61c19bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:02.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:02.205+0000 7fd622469640 1 --2- 172.21.15.37:0/2630890950 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd61c197890 0x7fd61c19bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:02.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:02.205+0000 7fd622469640 1 -- 172.21.15.37:0/2630890950 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd61c19c160 msgr2=0x7fd61c19c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:02.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:02.205+0000 7fd622469640 1 --2- 172.21.15.37:0/2630890950 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd61c19c160 0x7fd61c19c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:02.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:02.205+0000 7fd622469640 1 -- 172.21.15.37:0/2630890950 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd61c1a3ed0 con 0x7fd61c102730 2024-09-19T05:58:02.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:02.205+0000 7fd622c6a640 1 --2- 172.21.15.37:0/2630890950 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd61c19c160 0x7fd61c19c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:58:02.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:02.205+0000 7fd622469640 1 --2- 172.21.15.37:0/2630890950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd61c102730 0x7fd61c197350 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd6180307a0 tx=0x7fd6180307d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:02.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:02.205+0000 7fd6137fe640 1 -- 172.21.15.37:0/2630890950 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd618040070 con 0x7fd61c102730 2024-09-19T05:58:02.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:02.205+0000 7fd6137fe640 1 -- 172.21.15.37:0/2630890950 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd618004c70 con 0x7fd61c102730 2024-09-19T05:58:02.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:02.205+0000 7fd6246cd640 1 -- 172.21.15.37:0/2630890950 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd61c1a40a0 con 0x7fd61c102730 2024-09-19T05:58:02.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:02.205+0000 7fd6137fe640 1 -- 172.21.15.37:0/2630890950 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd61802f570 con 0x7fd61c102730 2024-09-19T05:58:02.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:02.205+0000 7fd6246cd640 1 -- 172.21.15.37:0/2630890950 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd61c1a4550 con 0x7fd61c102730 2024-09-19T05:58:02.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:02.206+0000 7fd6137fe640 1 -- 172.21.15.37:0/2630890950 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fd618039040 con 0x7fd61c102730 2024-09-19T05:58:02.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:02.206+0000 7fd6137fe640 1 --2- 172.21.15.37:0/2630890950 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fd608039730 0x7fd60803bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:02.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:02.206+0000 7fd6137fe640 1 -- 172.21.15.37:0/2630890950 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fd61806da80 con 0x7fd61c102730 2024-09-19T05:58:02.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:02.206+0000 7fd6246cd640 1 -- 172.21.15.37:0/2630890950 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd61c069f90 con 0x7fd61c102730 2024-09-19T05:58:02.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:02.207+0000 7fd621c68640 1 --2- 172.21.15.37:0/2630890950 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fd608039730 0x7fd60803bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:02.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:02.207+0000 7fd621c68640 1 --2- 172.21.15.37:0/2630890950 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fd608039730 0x7fd60803bbf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd60c009950 tx=0x7fd60c008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:02.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:02.211+0000 7fd6137fe640 1 -- 172.21.15.37:0/2630890950 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd618053020 con 0x7fd61c102730 2024-09-19T05:58:02.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:02.391+0000 7fd6246cd640 1 -- 172.21.15.37:0/2630890950 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7fd61c102b10 con 0x7fd61c102730 2024-09-19T05:58:02.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:02.392+0000 7fd6137fe640 1 -- 172.21.15.37:0/2630890950 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+273 (secure 0 0 0) 0x7fd61c102b10 con 0x7fd61c102730 2024-09-19T05:58:02.394 INFO:teuthology.orchestra.run.smithi037.stdout:# minimal ceph.conf for b8c8bdae-764b-11ef-bceb-c7b262605968 2024-09-19T05:58:02.394 INFO:teuthology.orchestra.run.smithi037.stdout:[global] 2024-09-19T05:58:02.394 INFO:teuthology.orchestra.run.smithi037.stdout: fsid = b8c8bdae-764b-11ef-bceb-c7b262605968 2024-09-19T05:58:02.394 INFO:teuthology.orchestra.run.smithi037.stdout: mon_host = [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-19T05:58:02.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:02.394+0000 7fd6246cd640 1 -- 172.21.15.37:0/2630890950 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fd608039730 msgr2=0x7fd60803bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:02.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:02.394+0000 7fd6246cd640 1 --2- 172.21.15.37:0/2630890950 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fd608039730 0x7fd60803bbf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd60c009950 tx=0x7fd60c008040 comp rx=0 tx=0).stop 2024-09-19T05:58:02.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:02.394+0000 7fd6246cd640 1 -- 172.21.15.37:0/2630890950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd61c102730 msgr2=0x7fd61c197350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:02.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:02.394+0000 7fd6246cd640 1 --2- 172.21.15.37:0/2630890950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd61c102730 0x7fd61c197350 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd6180307a0 tx=0x7fd6180307d0 comp rx=0 tx=0).stop 2024-09-19T05:58:02.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:02.394+0000 7fd6246cd640 1 -- 172.21.15.37:0/2630890950 shutdown_connections 2024-09-19T05:58:02.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:02.394+0000 7fd6246cd640 1 --2- 172.21.15.37:0/2630890950 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fd608039730 0x7fd60803bbf0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:02.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:02.394+0000 7fd6246cd640 1 --2- 172.21.15.37:0/2630890950 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd61c19c160 0x7fd61c19c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:02.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:02.394+0000 7fd6246cd640 1 --2- 172.21.15.37:0/2630890950 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd61c197890 0x7fd61c19bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:02.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:02.394+0000 7fd6246cd640 1 --2- 172.21.15.37:0/2630890950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd61c102730 0x7fd61c197350 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:02.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:02.394+0000 7fd6246cd640 1 -- 172.21.15.37:0/2630890950 >> 172.21.15.37:0/2630890950 conn(0x7fd61c077310 msgr2=0x7fd61c1035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:58:02.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:02.394+0000 7fd6246cd640 1 -- 172.21.15.37:0/2630890950 shutdown_connections 2024-09-19T05:58:02.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:02.394+0000 7fd6246cd640 1 -- 172.21.15.37:0/2630890950 wait complete. 2024-09-19T05:58:02.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:02 smithi117 ceph-mon[35050]: mon.b calling monitor election 2024-09-19T05:58:02.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:02 smithi117 ceph-mon[35050]: mon.b calling monitor election 2024-09-19T05:58:02.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:02 smithi117 ceph-mon[35050]: mon.c calling monitor election 2024-09-19T05:58:02.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:02 smithi117 ceph-mon[35050]: mon.a calling monitor election 2024-09-19T05:58:02.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:02 smithi117 ceph-mon[35050]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T05:58:02.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:02 smithi117 ceph-mon[35050]: monmap epoch 3 2024-09-19T05:58:02.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:02 smithi117 ceph-mon[35050]: fsid b8c8bdae-764b-11ef-bceb-c7b262605968 2024-09-19T05:58:02.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:02 smithi117 ceph-mon[35050]: last_changed 2024-09-19T05:57:54.738340+0000 2024-09-19T05:58:02.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:02 smithi117 ceph-mon[35050]: created 2024-09-19T05:56:19.390249+0000 2024-09-19T05:58:02.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:02 smithi117 ceph-mon[35050]: min_mon_release 19 (squid) 2024-09-19T05:58:02.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:02 smithi117 ceph-mon[35050]: election_strategy: 1 2024-09-19T05:58:02.751 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:02 smithi117 ceph-mon[35050]: 0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-19T05:58:02.751 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:02 smithi117 ceph-mon[35050]: 1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.c 2024-09-19T05:58:02.751 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:02 smithi117 ceph-mon[35050]: 2: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.b 2024-09-19T05:58:02.751 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:02 smithi117 ceph-mon[35050]: fsmap 2024-09-19T05:58:02.751 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:02 smithi117 ceph-mon[35050]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T05:58:02.751 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:02 smithi117 ceph-mon[35050]: mgrmap e13: x(active, since 49s) 2024-09-19T05:58:02.751 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:02 smithi117 ceph-mon[35050]: overall HEALTH_OK 2024-09-19T05:58:02.751 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:02 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/2630890950' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:58:02.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:02 smithi037 ceph-mon[31211]: mon.b calling monitor election 2024-09-19T05:58:02.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:02 smithi037 ceph-mon[31211]: mon.b calling monitor election 2024-09-19T05:58:02.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:02 smithi037 ceph-mon[31211]: mon.c calling monitor election 2024-09-19T05:58:02.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:02 smithi037 ceph-mon[31211]: mon.a calling monitor election 2024-09-19T05:58:02.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:02 smithi037 ceph-mon[31211]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T05:58:02.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:02 smithi037 ceph-mon[31211]: monmap epoch 3 2024-09-19T05:58:02.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:02 smithi037 ceph-mon[31211]: fsid b8c8bdae-764b-11ef-bceb-c7b262605968 2024-09-19T05:58:02.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:02 smithi037 ceph-mon[31211]: last_changed 2024-09-19T05:57:54.738340+0000 2024-09-19T05:58:02.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:02 smithi037 ceph-mon[31211]: created 2024-09-19T05:56:19.390249+0000 2024-09-19T05:58:02.825 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:02 smithi037 ceph-mon[31211]: min_mon_release 19 (squid) 2024-09-19T05:58:02.825 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:02 smithi037 ceph-mon[31211]: election_strategy: 1 2024-09-19T05:58:02.825 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:02 smithi037 ceph-mon[31211]: 0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-19T05:58:02.825 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:02 smithi037 ceph-mon[31211]: 1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.c 2024-09-19T05:58:02.825 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:02 smithi037 ceph-mon[31211]: 2: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.b 2024-09-19T05:58:02.825 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:02 smithi037 ceph-mon[31211]: fsmap 2024-09-19T05:58:02.825 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:02 smithi037 ceph-mon[31211]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T05:58:02.825 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:02 smithi037 ceph-mon[31211]: mgrmap e13: x(active, since 49s) 2024-09-19T05:58:02.825 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:02 smithi037 ceph-mon[31211]: overall HEALTH_OK 2024-09-19T05:58:02.825 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:02 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/2630890950' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:58:02.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:02 smithi099 ceph-mon[35300]: mon.b calling monitor election 2024-09-19T05:58:02.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:02 smithi099 ceph-mon[35300]: mon.b calling monitor election 2024-09-19T05:58:02.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:02 smithi099 ceph-mon[35300]: mon.c calling monitor election 2024-09-19T05:58:02.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:02 smithi099 ceph-mon[35300]: mon.a calling monitor election 2024-09-19T05:58:02.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:02 smithi099 ceph-mon[35300]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T05:58:02.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:02 smithi099 ceph-mon[35300]: monmap epoch 3 2024-09-19T05:58:02.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:02 smithi099 ceph-mon[35300]: fsid b8c8bdae-764b-11ef-bceb-c7b262605968 2024-09-19T05:58:02.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:02 smithi099 ceph-mon[35300]: last_changed 2024-09-19T05:57:54.738340+0000 2024-09-19T05:58:02.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:02 smithi099 ceph-mon[35300]: created 2024-09-19T05:56:19.390249+0000 2024-09-19T05:58:02.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:02 smithi099 ceph-mon[35300]: min_mon_release 19 (squid) 2024-09-19T05:58:02.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:02 smithi099 ceph-mon[35300]: election_strategy: 1 2024-09-19T05:58:02.940 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:02 smithi099 ceph-mon[35300]: 0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-19T05:58:02.940 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:02 smithi099 ceph-mon[35300]: 1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.c 2024-09-19T05:58:02.940 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:02 smithi099 ceph-mon[35300]: 2: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.b 2024-09-19T05:58:02.940 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:02 smithi099 ceph-mon[35300]: fsmap 2024-09-19T05:58:02.940 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:02 smithi099 ceph-mon[35300]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T05:58:02.940 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:02 smithi099 ceph-mon[35300]: mgrmap e13: x(active, since 49s) 2024-09-19T05:58:02.940 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:02 smithi099 ceph-mon[35300]: overall HEALTH_OK 2024-09-19T05:58:02.940 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:02 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/2630890950' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:58:03.063 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-19T05:58:03.063 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-19T05:58:03.063 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T05:58:03.091 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-19T05:58:03.091 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T05:58:03.157 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-19T05:58:03.157 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T05:58:03.185 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-19T05:58:03.185 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T05:58:03.250 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-19T05:58:03.250 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T05:58:03.283 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-19T05:58:03.283 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T05:58:03.353 INFO:tasks.cephadm:Adding mgr.x on smithi037 2024-09-19T05:58:03.354 INFO:tasks.cephadm:Adding mgr.y on smithi099 2024-09-19T05:58:03.354 INFO:tasks.cephadm:Adding mgr.z on smithi117 2024-09-19T05:58:03.354 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph orch apply mgr '3;smithi037=x;smithi099=y;smithi117=z' 2024-09-19T05:58:03.635 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T05:58:03.673 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:03 smithi037 ceph-mon[31211]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:58:03.673 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:03 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:03.673 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:03 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:58:03.868 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:03 smithi117 ceph-mon[35050]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:58:03.868 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:03 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:03.868 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:03 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:58:03.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:03 smithi099 ceph-mon[35300]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:58:03.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:03 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:03.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:03 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:58:04.080 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:04.051+0000 7f28684e8640 1 -- 172.21.15.117:0/3585370680 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28601005f0 msgr2=0x7f28601009f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:04.080 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:04.051+0000 7f28684e8640 1 --2- 172.21.15.117:0/3585370680 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28601005f0 0x7f28601009f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2854009880 tx=0x7f285402a5d0 comp rx=0 tx=0).stop 2024-09-19T05:58:04.080 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:04.051+0000 7f28684e8640 1 -- 172.21.15.117:0/3585370680 shutdown_connections 2024-09-19T05:58:04.080 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:04.051+0000 7f28684e8640 1 --2- 172.21.15.117:0/3585370680 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28601005f0 0x7f28601009f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:04.080 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:04.051+0000 7f28684e8640 1 -- 172.21.15.117:0/3585370680 >> 172.21.15.117:0/3585370680 conn(0x7f28600fbda0 msgr2=0x7f28600fe1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:58:04.080 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:04.051+0000 7f28684e8640 1 -- 172.21.15.117:0/3585370680 shutdown_connections 2024-09-19T05:58:04.080 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:04.051+0000 7f28684e8640 1 -- 172.21.15.117:0/3585370680 wait complete. 2024-09-19T05:58:04.080 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:04.052+0000 7f28684e8640 1 Processor -- start 2024-09-19T05:58:04.080 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:04.052+0000 7f28684e8640 1 -- start start 2024-09-19T05:58:04.080 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:04.052+0000 7f28684e8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28601005f0 0x7f286006af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:04.081 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:04.052+0000 7f28684e8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2860199d10 0x7f286019c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:04.081 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:04.052+0000 7f28684e8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f286019c640 0x7f286019eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:04.081 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:04.052+0000 7f28684e8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2860106700 con 0x7f286019c640 2024-09-19T05:58:04.081 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:04.052+0000 7f28684e8640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f2860106580 con 0x7f2860199d10 2024-09-19T05:58:04.081 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:04.052+0000 7f28684e8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2860106880 con 0x7f28601005f0 2024-09-19T05:58:04.081 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:04.052+0000 7f2866284640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28601005f0 0x7f286006af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:04.081 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:04.052+0000 7f2866284640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28601005f0 0x7f286006af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:58998/0 (socket says 172.21.15.117:58998) 2024-09-19T05:58:04.081 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:04.052+0000 7f2866284640 1 -- 172.21.15.117:0/1768343866 learned_addr learned my addr 172.21.15.117:0/1768343866 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T05:58:04.081 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:04.052+0000 7f2865a83640 1 --2- 172.21.15.117:0/1768343866 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2860199d10 0x7f286019c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:04.081 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:04.053+0000 7f2866a85640 1 --2- 172.21.15.117:0/1768343866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f286019c640 0x7f286019eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:04.081 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:04.053+0000 7f2866284640 1 -- 172.21.15.117:0/1768343866 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2860199d10 msgr2=0x7f286019c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:04.081 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:04.053+0000 7f2866284640 1 --2- 172.21.15.117:0/1768343866 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2860199d10 0x7f286019c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:04.081 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:04.053+0000 7f2866284640 1 -- 172.21.15.117:0/1768343866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f286019c640 msgr2=0x7f286019eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:04.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:04.053+0000 7f2866284640 1 --2- 172.21.15.117:0/1768343866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f286019c640 0x7f286019eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:04.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:04.053+0000 7f2866284640 1 -- 172.21.15.117:0/1768343866 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f286019f410 con 0x7f28601005f0 2024-09-19T05:58:04.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:04.053+0000 7f2866284640 1 --2- 172.21.15.117:0/1768343866 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28601005f0 0x7f286006af90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2854005ab0 tx=0x7f2854032d00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:04.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:04.053+0000 7f28537fe640 1 -- 172.21.15.117:0/1768343866 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f285403f030 con 0x7f28601005f0 2024-09-19T05:58:04.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:04.053+0000 7f28537fe640 1 -- 172.21.15.117:0/1768343866 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2854003ce0 con 0x7f28601005f0 2024-09-19T05:58:04.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:04.053+0000 7f28684e8640 1 -- 172.21.15.117:0/1768343866 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f286019f640 con 0x7f28601005f0 2024-09-19T05:58:04.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:04.053+0000 7f28537fe640 1 -- 172.21.15.117:0/1768343866 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2854035070 con 0x7f28601005f0 2024-09-19T05:58:04.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:04.053+0000 7f28684e8640 1 -- 172.21.15.117:0/1768343866 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f286019fbf0 con 0x7f28601005f0 2024-09-19T05:58:04.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:04.054+0000 7f28537fe640 1 -- 172.21.15.117:0/1768343866 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f2854042030 con 0x7f28601005f0 2024-09-19T05:58:04.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:04.054+0000 7f28684e8640 1 -- 172.21.15.117:0/1768343866 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f286018f4c0 con 0x7f28601005f0 2024-09-19T05:58:04.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:04.054+0000 7f28537fe640 1 --2- 172.21.15.117:0/1768343866 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f284c039730 0x7f284c03bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:04.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:04.054+0000 7f28537fe640 1 -- 172.21.15.117:0/1768343866 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f285406caa0 con 0x7f28601005f0 2024-09-19T05:58:04.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:04.054+0000 7f2865a83640 1 --2- 172.21.15.117:0/1768343866 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f284c039730 0x7f284c03bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:04.083 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:04.055+0000 7f2865a83640 1 --2- 172.21.15.117:0/1768343866 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f284c039730 0x7f284c03bbf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f286006b510 tx=0x7f285c009190 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:04.083 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:04.059+0000 7f28537fe640 1 -- 172.21.15.117:0/1768343866 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f285403bdc0 con 0x7f28601005f0 2024-09-19T05:58:04.241 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:04.238+0000 7f28684e8640 1 -- 172.21.15.117:0/1768343866 --> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi037=x;smithi099=y;smithi117=z", "target": ["mon-mgr", ""]}) -- 0x7f28600626c0 con 0x7f284c039730 2024-09-19T05:58:04.246 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:04.243+0000 7f28537fe640 1 -- 172.21.15.117:0/1768343866 <== mgr.14148 v2:172.21.15.37:6800/3797010169 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f28600626c0 con 0x7f284c039730 2024-09-19T05:58:04.246 INFO:teuthology.orchestra.run.smithi117.stdout:Scheduled mgr update... 2024-09-19T05:58:04.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:04.246+0000 7f28684e8640 1 -- 172.21.15.117:0/1768343866 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f284c039730 msgr2=0x7f284c03bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:04.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:04.246+0000 7f28684e8640 1 --2- 172.21.15.117:0/1768343866 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f284c039730 0x7f284c03bbf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f286006b510 tx=0x7f285c009190 comp rx=0 tx=0).stop 2024-09-19T05:58:04.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:04.246+0000 7f28684e8640 1 -- 172.21.15.117:0/1768343866 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28601005f0 msgr2=0x7f286006af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:04.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:04.246+0000 7f28684e8640 1 --2- 172.21.15.117:0/1768343866 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28601005f0 0x7f286006af90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2854005ab0 tx=0x7f2854032d00 comp rx=0 tx=0).stop 2024-09-19T05:58:04.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:04.246+0000 7f28684e8640 1 -- 172.21.15.117:0/1768343866 shutdown_connections 2024-09-19T05:58:04.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:04.246+0000 7f28684e8640 1 --2- 172.21.15.117:0/1768343866 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f284c039730 0x7f284c03bbf0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:04.250 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:04.246+0000 7f28684e8640 1 --2- 172.21.15.117:0/1768343866 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2860199d10 0x7f286019c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:04.250 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:04.246+0000 7f28684e8640 1 --2- 172.21.15.117:0/1768343866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f286019c640 0x7f286019eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:04.250 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:04.246+0000 7f28684e8640 1 --2- 172.21.15.117:0/1768343866 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28601005f0 0x7f286006af90 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:04.250 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:04.246+0000 7f28684e8640 1 -- 172.21.15.117:0/1768343866 >> 172.21.15.117:0/1768343866 conn(0x7f28600fbda0 msgr2=0x7f28600fc850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:58:04.250 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:04.246+0000 7f28684e8640 1 -- 172.21.15.117:0/1768343866 shutdown_connections 2024-09-19T05:58:04.250 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:58:04.246+0000 7f28684e8640 1 -- 172.21.15.117:0/1768343866 wait complete. 2024-09-19T05:58:04.817 DEBUG:teuthology.orchestra.run.smithi099:mgr.y> sudo journalctl -f -n 0 -u ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@mgr.y.service 2024-09-19T05:58:04.820 DEBUG:teuthology.orchestra.run.smithi117:mgr.z> sudo journalctl -f -n 0 -u ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@mgr.z.service 2024-09-19T05:58:04.822 INFO:tasks.cephadm:Deploying OSDs... 2024-09-19T05:58:04.823 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-19T05:58:04.823 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T05:58:04.844 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T05:58:04.844 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_1 2024-09-19T05:58:04.904 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T05:58:04.904 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T05:58:04.904 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-19T05:58:04.904 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T05:58:04.904 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T05:58:04.904 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2024-09-19 05:57:21.286214899 +0000 2024-09-19T05:58:04.904 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-09-19 05:52:38.330645657 +0000 2024-09-19T05:58:04.904 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-09-19 05:52:38.330645657 +0000 2024-09-19T05:58:04.904 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2024-09-19 05:52:38.330645657 +0000 2024-09-19T05:58:04.905 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T05:58:04.975 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2024-09-19T05:58:04.975 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2024-09-19T05:58:04.975 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000280711 s, 1.8 MB/s 2024-09-19T05:58:04.977 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T05:58:04.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:04 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:05.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:04 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:05.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:04 smithi117 ceph-mon[35050]: Reconfiguring mon.b (monmap changed)... 2024-09-19T05:58:05.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:04 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T05:58:05.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:04 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T05:58:05.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:04 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:58:05.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:04 smithi117 ceph-mon[35050]: Reconfiguring daemon mon.b on smithi099 2024-09-19T05:58:05.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:04 smithi117 ceph-mon[35050]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi037=x;smithi099=y;smithi117=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:58:05.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:04 smithi117 ceph-mon[35050]: Saving service mgr spec with placement smithi037=x;smithi099=y;smithi117=z;count:3 2024-09-19T05:58:05.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:04 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:05.038 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_2 2024-09-19T05:58:05.096 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T05:58:05.096 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T05:58:05.096 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-19T05:58:05.096 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T05:58:05.097 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T05:58:05.097 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2024-09-19 05:57:21.321214400 +0000 2024-09-19T05:58:05.097 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-09-19 05:52:38.676640722 +0000 2024-09-19T05:58:05.097 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-09-19 05:52:38.676640722 +0000 2024-09-19T05:58:05.097 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2024-09-19 05:52:38.676640722 +0000 2024-09-19T05:58:05.097 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T05:58:05.164 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2024-09-19T05:58:05.164 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2024-09-19T05:58:05.164 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000213676 s, 2.4 MB/s 2024-09-19T05:58:05.166 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T05:58:05.224 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_3 2024-09-19T05:58:05.282 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T05:58:05.282 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T05:58:05.282 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-19T05:58:05.282 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T05:58:05.282 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T05:58:05.282 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2024-09-19 05:57:21.359213858 +0000 2024-09-19T05:58:05.282 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-09-19 05:52:39.031635658 +0000 2024-09-19T05:58:05.282 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-09-19 05:52:39.031635658 +0000 2024-09-19T05:58:05.282 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2024-09-19 05:52:39.031635658 +0000 2024-09-19T05:58:05.283 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T05:58:05.325 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:04 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:05.325 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:04 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:05.325 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:04 smithi037 ceph-mon[31211]: Reconfiguring mon.b (monmap changed)... 2024-09-19T05:58:05.325 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:04 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T05:58:05.325 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:04 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T05:58:05.325 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:04 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:58:05.325 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:04 smithi037 ceph-mon[31211]: Reconfiguring daemon mon.b on smithi099 2024-09-19T05:58:05.325 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:04 smithi037 ceph-mon[31211]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi037=x;smithi099=y;smithi117=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:58:05.325 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:04 smithi037 ceph-mon[31211]: Saving service mgr spec with placement smithi037=x;smithi099=y;smithi117=z;count:3 2024-09-19T05:58:05.325 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:04 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:05.341 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:04 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:05.342 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:04 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:05.342 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:04 smithi099 ceph-mon[35300]: Reconfiguring mon.b (monmap changed)... 2024-09-19T05:58:05.342 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:04 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T05:58:05.342 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:04 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T05:58:05.342 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:04 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:58:05.342 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:04 smithi099 ceph-mon[35300]: Reconfiguring daemon mon.b on smithi099 2024-09-19T05:58:05.342 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:04 smithi099 ceph-mon[35300]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi037=x;smithi099=y;smithi117=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:58:05.342 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:04 smithi099 ceph-mon[35300]: Saving service mgr spec with placement smithi037=x;smithi099=y;smithi117=z;count:3 2024-09-19T05:58:05.342 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:04 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:05.347 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2024-09-19T05:58:05.347 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2024-09-19T05:58:05.347 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000218155 s, 2.3 MB/s 2024-09-19T05:58:05.349 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T05:58:05.407 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_4 2024-09-19T05:58:05.463 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T05:58:05.463 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T05:58:05.464 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-19T05:58:05.464 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T05:58:05.464 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T05:58:05.464 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2024-09-19 05:57:21.400213273 +0000 2024-09-19T05:58:05.464 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-09-19 05:52:39.370630823 +0000 2024-09-19T05:58:05.464 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-09-19 05:52:39.370630823 +0000 2024-09-19T05:58:05.464 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2024-09-19 05:52:39.370630823 +0000 2024-09-19T05:58:05.464 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T05:58:05.528 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2024-09-19T05:58:05.529 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2024-09-19T05:58:05.529 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000187918 s, 2.7 MB/s 2024-09-19T05:58:05.530 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T05:58:05.588 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-19T05:58:05.588 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T05:58:05.604 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T05:58:05.605 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_1 2024-09-19T05:58:05.660 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T05:58:05.660 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T05:58:05.660 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-19T05:58:05.660 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T05:58:05.660 INFO:teuthology.orchestra.run.smithi099.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T05:58:05.661 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-09-19 05:57:54.198227376 +0000 2024-09-19T05:58:05.661 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-09-19 05:52:51.180187371 +0000 2024-09-19T05:58:05.661 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-09-19 05:52:51.180187371 +0000 2024-09-19T05:58:05.661 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: 2024-09-19 05:52:51.180187371 +0000 2024-09-19T05:58:05.661 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T05:58:05.724 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-09-19T05:58:05.725 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-09-19T05:58:05.725 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000365526 s, 1.4 MB/s 2024-09-19T05:58:05.727 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T05:58:05.785 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_2 2024-09-19T05:58:05.840 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T05:58:05.840 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T05:58:05.841 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-19T05:58:05.841 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T05:58:05.841 INFO:teuthology.orchestra.run.smithi099.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T05:58:05.841 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-09-19 05:57:54.199227353 +0000 2024-09-19T05:58:05.841 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-09-19 05:52:51.510179334 +0000 2024-09-19T05:58:05.841 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-09-19 05:52:51.510179334 +0000 2024-09-19T05:58:05.841 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: 2024-09-19 05:52:51.510179334 +0000 2024-09-19T05:58:05.841 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T05:58:05.904 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-09-19T05:58:05.904 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-09-19T05:58:05.904 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000200533 s, 2.6 MB/s 2024-09-19T05:58:05.905 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T05:58:05.962 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_3 2024-09-19T05:58:06.018 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T05:58:06.018 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T05:58:06.018 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-19T05:58:06.018 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T05:58:06.018 INFO:teuthology.orchestra.run.smithi099.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T05:58:06.018 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-09-19 05:57:54.199227353 +0000 2024-09-19T05:58:06.018 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-09-19 05:52:51.835171419 +0000 2024-09-19T05:58:06.018 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-09-19 05:52:51.835171419 +0000 2024-09-19T05:58:06.018 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: 2024-09-19 05:52:51.835171419 +0000 2024-09-19T05:58:06.018 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T05:58:06.080 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-09-19T05:58:06.080 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-09-19T05:58:06.081 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000196539 s, 2.6 MB/s 2024-09-19T05:58:06.082 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T05:58:06.138 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_4 2024-09-19T05:58:06.193 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T05:58:06.194 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T05:58:06.194 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-19T05:58:06.194 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T05:58:06.194 INFO:teuthology.orchestra.run.smithi099.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T05:58:06.194 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-09-19 05:57:54.199227353 +0000 2024-09-19T05:58:06.194 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-09-19 05:52:52.160163504 +0000 2024-09-19T05:58:06.194 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-09-19 05:52:52.160163504 +0000 2024-09-19T05:58:06.194 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: 2024-09-19 05:52:52.160163504 +0000 2024-09-19T05:58:06.194 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T05:58:06.256 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-09-19T05:58:06.257 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-09-19T05:58:06.257 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000207071 s, 2.5 MB/s 2024-09-19T05:58:06.258 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T05:58:06.315 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-19T05:58:06.315 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T05:58:06.332 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T05:58:06.332 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_1 2024-09-19T05:58:06.387 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T05:58:06.387 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T05:58:06.387 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-19T05:58:06.387 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T05:58:06.387 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T05:58:06.387 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-09-19 05:57:44.927366457 +0000 2024-09-19T05:58:06.387 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-09-19 05:52:49.915972566 +0000 2024-09-19T05:58:06.387 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-09-19 05:52:49.915972566 +0000 2024-09-19T05:58:06.387 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: 2024-09-19 05:52:49.915972566 +0000 2024-09-19T05:58:06.387 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T05:58:06.431 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:06 smithi117 ceph-mon[35050]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:58:06.431 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:06 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:06.431 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:06 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:06.431 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:06 smithi117 ceph-mon[35050]: Reconfiguring mon.c (monmap changed)... 2024-09-19T05:58:06.431 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:06 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T05:58:06.431 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:06 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T05:58:06.431 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:06 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:58:06.431 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:06 smithi117 ceph-mon[35050]: Reconfiguring daemon mon.c on smithi117 2024-09-19T05:58:06.438 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:06 smithi099 ceph-mon[35300]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:58:06.438 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:06 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:06.438 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:06 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:06.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:06 smithi099 ceph-mon[35300]: Reconfiguring mon.c (monmap changed)... 2024-09-19T05:58:06.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:06 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T05:58:06.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:06 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T05:58:06.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:06 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:58:06.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:06 smithi099 ceph-mon[35300]: Reconfiguring daemon mon.c on smithi117 2024-09-19T05:58:06.453 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-09-19T05:58:06.453 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-09-19T05:58:06.454 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000273131 s, 1.9 MB/s 2024-09-19T05:58:06.455 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T05:58:06.511 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_2 2024-09-19T05:58:06.567 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T05:58:06.567 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T05:58:06.567 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-09-19T05:58:06.567 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T05:58:06.567 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T05:58:06.567 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-09-19 05:57:44.927366457 +0000 2024-09-19T05:58:06.567 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-09-19 05:52:50.242965677 +0000 2024-09-19T05:58:06.567 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-09-19 05:52:50.242965677 +0000 2024-09-19T05:58:06.567 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: 2024-09-19 05:52:50.242965677 +0000 2024-09-19T05:58:06.567 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T05:58:06.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:06 smithi037 ceph-mon[31211]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:58:06.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:06 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:06.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:06 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:06.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:06 smithi037 ceph-mon[31211]: Reconfiguring mon.c (monmap changed)... 2024-09-19T05:58:06.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:06 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T05:58:06.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:06 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T05:58:06.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:06 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:58:06.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:06 smithi037 ceph-mon[31211]: Reconfiguring daemon mon.c on smithi117 2024-09-19T05:58:06.630 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-09-19T05:58:06.630 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-09-19T05:58:06.630 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.00021254 s, 2.4 MB/s 2024-09-19T05:58:06.631 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T05:58:06.687 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_3 2024-09-19T05:58:06.743 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T05:58:06.743 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T05:58:06.743 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-19T05:58:06.743 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T05:58:06.744 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T05:58:06.744 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-09-19 05:57:44.927366457 +0000 2024-09-19T05:58:06.744 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-09-19 05:52:50.578958598 +0000 2024-09-19T05:58:06.744 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-09-19 05:52:50.578958598 +0000 2024-09-19T05:58:06.744 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: 2024-09-19 05:52:50.578958598 +0000 2024-09-19T05:58:06.744 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T05:58:06.808 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-09-19T05:58:06.808 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-09-19T05:58:06.808 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000183258 s, 2.8 MB/s 2024-09-19T05:58:06.809 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T05:58:06.865 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_4 2024-09-19T05:58:06.920 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T05:58:06.920 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T05:58:06.920 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-19T05:58:06.920 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T05:58:06.921 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T05:58:06.921 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-09-19 05:57:44.928366437 +0000 2024-09-19T05:58:06.921 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-09-19 05:52:50.912951561 +0000 2024-09-19T05:58:06.921 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-09-19 05:52:50.912951561 +0000 2024-09-19T05:58:06.921 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: 2024-09-19 05:52:50.912951561 +0000 2024-09-19T05:58:06.921 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T05:58:06.984 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-09-19T05:58:06.984 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-09-19T05:58:06.984 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.00022877 s, 2.2 MB/s 2024-09-19T05:58:06.985 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T05:58:07.041 INFO:tasks.cephadm:Deploying osd.0 on smithi037 with /dev/vg_nvme/lv_4... 2024-09-19T05:58:07.041 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T05:58:07.304 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:58:07.726 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:07 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:07.726 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:07 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:07.726 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:07 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:58:07.726 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:07 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:58:07.727 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:07 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:58:07.727 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:07 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:07.727 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:07 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T05:58:07.727 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:07 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T05:58:07.727 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:07 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T05:58:07.727 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:07 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:58:07.727 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:07 smithi037 ceph-mon[31211]: Deploying daemon mgr.z on smithi117 2024-09-19T05:58:07.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:07 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:07.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:07 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:07.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:07 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:58:07.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:07 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:58:07.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:07 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:58:07.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:07 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:07.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:07 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T05:58:07.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:07 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T05:58:07.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:07 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T05:58:07.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:07 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:58:07.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:07 smithi117 ceph-mon[35050]: Deploying daemon mgr.z on smithi117 2024-09-19T05:58:07.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:07 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:07.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:07 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:07.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:07 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:58:07.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:07 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:58:07.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:07 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:58:07.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:07 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:07.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:07 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T05:58:07.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:07 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T05:58:07.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:07 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T05:58:07.940 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:07 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:58:07.940 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:07 smithi099 ceph-mon[35300]: Deploying daemon mgr.z on smithi117 2024-09-19T05:58:08.641 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:08 smithi037 ceph-mon[31211]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:58:08.787 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:08 smithi117 ceph-mon[35050]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:58:08.788 INFO:journalctl@ceph.mgr.z.smithi117.stdout:Sep 19 05:58:08 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-z[36865]: 2024-09-19T05:58:08.724+0000 7f551d3bd040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T05:58:08.788 INFO:journalctl@ceph.mgr.z.smithi117.stdout:Sep 19 05:58:08 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-z[36865]: 2024-09-19T05:58:08.784+0000 7f551d3bd040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T05:58:08.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:08 smithi099 ceph-mon[35300]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:58:09.146 INFO:journalctl@ceph.mgr.z.smithi117.stdout:Sep 19 05:58:08 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-z[36865]: 2024-09-19T05:58:08.932+0000 7f551d3bd040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T05:58:09.146 INFO:journalctl@ceph.mgr.z.smithi117.stdout:Sep 19 05:58:09 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-z[36865]: 2024-09-19T05:58:08.998+0000 7f551d3bd040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T05:58:09.146 INFO:journalctl@ceph.mgr.z.smithi117.stdout:Sep 19 05:58:09 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-z[36865]: 2024-09-19T05:58:09.143+0000 7f551d3bd040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T05:58:09.500 INFO:journalctl@ceph.mgr.z.smithi117.stdout:Sep 19 05:58:09 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-z[36865]: 2024-09-19T05:58:09.282+0000 7f551d3bd040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T05:58:09.665 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T05:58:09.694 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi037:vg_nvme/lv_4 2024-09-19T05:58:09.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:09 smithi037 ceph-mon[31211]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:58:09.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:09 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:09.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:09 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:09.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:09 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:09.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:09 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T05:58:09.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:09 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T05:58:09.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:09 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T05:58:09.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:09 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:58:09.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:09 smithi037 ceph-mon[31211]: Deploying daemon mgr.y on smithi099 2024-09-19T05:58:09.875 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:09 smithi099 ceph-mon[35300]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:58:09.875 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:09 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:09.875 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:09 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:09.875 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:09 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:09.875 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:09 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T05:58:09.875 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:09 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T05:58:09.875 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:09 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T05:58:09.875 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:09 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:58:09.875 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:09 smithi099 ceph-mon[35300]: Deploying daemon mgr.y on smithi099 2024-09-19T05:58:09.949 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:58:10.000 INFO:journalctl@ceph.mgr.z.smithi117.stdout:Sep 19 05:58:09 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-z[36865]: 2024-09-19T05:58:09.593+0000 7f551d3bd040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T05:58:10.000 INFO:journalctl@ceph.mgr.z.smithi117.stdout:Sep 19 05:58:09 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-z[36865]: 2024-09-19T05:58:09.653+0000 7f551d3bd040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T05:58:10.000 INFO:journalctl@ceph.mgr.z.smithi117.stdout:Sep 19 05:58:09 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-z[36865]: 2024-09-19T05:58:09.838+0000 7f551d3bd040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T05:58:10.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:09 smithi117 ceph-mon[35050]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:58:10.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:09 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:10.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:09 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:10.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:09 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:10.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:09 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T05:58:10.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:09 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T05:58:10.001 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:09 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T05:58:10.001 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:09 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:58:10.001 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:09 smithi117 ceph-mon[35050]: Deploying daemon mgr.y on smithi099 2024-09-19T05:58:10.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:10.381+0000 7f0d6de49640 1 -- 172.21.15.37:0/682253768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d68105090 msgr2=0x7f0d68107480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:10.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:10.381+0000 7f0d6de49640 1 --2- 172.21.15.37:0/682253768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d68105090 0x7f0d68107480 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c009900 tx=0x7f0d5c02a410 comp rx=0 tx=0).stop 2024-09-19T05:58:10.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:10.381+0000 7f0d6de49640 1 -- 172.21.15.37:0/682253768 shutdown_connections 2024-09-19T05:58:10.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:10.381+0000 7f0d6de49640 1 --2- 172.21.15.37:0/682253768 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d681079c0 0x7f0d68109db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:10.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:10.381+0000 7f0d6de49640 1 --2- 172.21.15.37:0/682253768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d68105090 0x7f0d68107480 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:10.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:10.381+0000 7f0d6de49640 1 --2- 172.21.15.37:0/682253768 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d68102760 0x7f0d68104b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:10.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:10.381+0000 7f0d6de49640 1 -- 172.21.15.37:0/682253768 >> 172.21.15.37:0/682253768 conn(0x7f0d680fc2a0 msgr2=0x7f0d680fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:58:10.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:10.381+0000 7f0d6de49640 1 -- 172.21.15.37:0/682253768 shutdown_connections 2024-09-19T05:58:10.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:10.381+0000 7f0d6de49640 1 -- 172.21.15.37:0/682253768 wait complete. 2024-09-19T05:58:10.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:10.382+0000 7f0d6de49640 1 Processor -- start 2024-09-19T05:58:10.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:10.382+0000 7f0d6de49640 1 -- start start 2024-09-19T05:58:10.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:10.383+0000 7f0d6de49640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d68102760 0x7f0d68197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:10.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:10.383+0000 7f0d6de49640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d68105090 0x7f0d68198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:10.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:10.383+0000 7f0d6de49640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d681079c0 0x7f0d6819f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:10.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:10.383+0000 7f0d6de49640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0d6810d8a0 con 0x7f0d68102760 2024-09-19T05:58:10.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:10.383+0000 7f0d6de49640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f0d6810d720 con 0x7f0d681079c0 2024-09-19T05:58:10.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:10.383+0000 7f0d6de49640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0d6810da20 con 0x7f0d68105090 2024-09-19T05:58:10.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:10.383+0000 7f0d677fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d68102760 0x7f0d68197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:10.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:10.383+0000 7f0d677fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d68102760 0x7f0d68197f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56804/0 (socket says 172.21.15.37:56804) 2024-09-19T05:58:10.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:10.383+0000 7f0d677fe640 1 -- 172.21.15.37:0/3076936330 learned_addr learned my addr 172.21.15.37:0/3076936330 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T05:58:10.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:10.383+0000 7f0d66ffd640 1 --2- 172.21.15.37:0/3076936330 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d68105090 0x7f0d68198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:10.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:10.383+0000 7f0d67fff640 1 --2- 172.21.15.37:0/3076936330 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d681079c0 0x7f0d6819f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:10.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:10.383+0000 7f0d677fe640 1 -- 172.21.15.37:0/3076936330 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d68105090 msgr2=0x7f0d68198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:10.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:10.383+0000 7f0d677fe640 1 --2- 172.21.15.37:0/3076936330 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d68105090 0x7f0d68198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:10.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:10.383+0000 7f0d677fe640 1 -- 172.21.15.37:0/3076936330 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d681079c0 msgr2=0x7f0d6819f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:10.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:10.383+0000 7f0d677fe640 1 --2- 172.21.15.37:0/3076936330 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d681079c0 0x7f0d6819f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:10.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:10.383+0000 7f0d677fe640 1 -- 172.21.15.37:0/3076936330 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d6819fb80 con 0x7f0d68102760 2024-09-19T05:58:10.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:10.383+0000 7f0d677fe640 1 --2- 172.21.15.37:0/3076936330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d68102760 0x7f0d68197f50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0d5800ea60 tx=0x7f0d5800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:10.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:10.383+0000 7f0d64ff9640 1 -- 172.21.15.37:0/3076936330 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d5800cde0 con 0x7f0d68102760 2024-09-19T05:58:10.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:10.383+0000 7f0d64ff9640 1 -- 172.21.15.37:0/3076936330 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d580035f0 con 0x7f0d68102760 2024-09-19T05:58:10.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:10.383+0000 7f0d6de49640 1 -- 172.21.15.37:0/3076936330 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d6819fe70 con 0x7f0d68102760 2024-09-19T05:58:10.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:10.384+0000 7f0d64ff9640 1 -- 172.21.15.37:0/3076936330 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d58010670 con 0x7f0d68102760 2024-09-19T05:58:10.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:10.384+0000 7f0d6de49640 1 -- 172.21.15.37:0/3076936330 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d681a02c0 con 0x7f0d68102760 2024-09-19T05:58:10.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:10.384+0000 7f0d64ff9640 1 -- 172.21.15.37:0/3076936330 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f0d580037a0 con 0x7f0d68102760 2024-09-19T05:58:10.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:10.385+0000 7f0d6de49640 1 -- 172.21.15.37:0/3076936330 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d680fdd90 con 0x7f0d68102760 2024-09-19T05:58:10.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:10.385+0000 7f0d64ff9640 1 --2- 172.21.15.37:0/3076936330 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f0d50039500 0x7f0d5003b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:10.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:10.385+0000 7f0d64ff9640 1 -- 172.21.15.37:0/3076936330 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f0d5804c9f0 con 0x7f0d68102760 2024-09-19T05:58:10.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:10.385+0000 7f0d66ffd640 1 --2- 172.21.15.37:0/3076936330 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f0d50039500 0x7f0d5003b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:10.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:10.385+0000 7f0d66ffd640 1 --2- 172.21.15.37:0/3076936330 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f0d50039500 0x7f0d5003b9c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c005ab0 tx=0x7f0d5c000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:10.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:10.390+0000 7f0d64ff9640 1 -- 172.21.15.37:0/3076936330 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0d580071c0 con 0x7f0d68102760 2024-09-19T05:58:10.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:10.574+0000 7f0d6de49640 1 -- 172.21.15.37:0/3076936330 --> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f0d68062630 con 0x7f0d50039500 2024-09-19T05:58:10.889 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:10 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:58:10.889 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:10 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:58:10.889 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:10 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:58:11.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:10 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:58:11.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:10 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:58:11.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:10 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:58:11.000 INFO:journalctl@ceph.mgr.z.smithi117.stdout:Sep 19 05:58:10 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-z[36865]: 2024-09-19T05:58:10.717+0000 7f551d3bd040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T05:58:11.000 INFO:journalctl@ceph.mgr.z.smithi117.stdout:Sep 19 05:58:10 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-z[36865]: 2024-09-19T05:58:10.784+0000 7f551d3bd040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T05:58:11.067 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:10 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:58:11.067 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:10 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:58:11.067 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:10 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:58:11.339 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Sep 19 05:58:11 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-y[36656]: 2024-09-19T05:58:11.181+0000 7f2bf4dfa040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T05:58:11.339 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Sep 19 05:58:11 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-y[36656]: 2024-09-19T05:58:11.336+0000 7f2bf4dfa040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T05:58:11.688 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Sep 19 05:58:11 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-y[36656]: 2024-09-19T05:58:11.405+0000 7f2bf4dfa040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T05:58:11.689 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Sep 19 05:58:11 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-y[36656]: 2024-09-19T05:58:11.564+0000 7f2bf4dfa040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T05:58:11.797 INFO:journalctl@ceph.mgr.z.smithi117.stdout:Sep 19 05:58:11 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-z[36865]: 2024-09-19T05:58:11.518+0000 7f551d3bd040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T05:58:11.797 INFO:journalctl@ceph.mgr.z.smithi117.stdout:Sep 19 05:58:11 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-z[36865]: 2024-09-19T05:58:11.651+0000 7f551d3bd040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T05:58:11.797 INFO:journalctl@ceph.mgr.z.smithi117.stdout:Sep 19 05:58:11 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-z[36865]: 2024-09-19T05:58:11.794+0000 7f551d3bd040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T05:58:11.990 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Sep 19 05:58:11 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-y[36656]: 2024-09-19T05:58:11.718+0000 7f2bf4dfa040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T05:58:12.086 INFO:journalctl@ceph.mgr.z.smithi117.stdout:Sep 19 05:58:11 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-z[36865]: 2024-09-19T05:58:11.858+0000 7f551d3bd040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T05:58:12.087 INFO:journalctl@ceph.mgr.z.smithi117.stdout:Sep 19 05:58:12 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-z[36865]: 2024-09-19T05:58:12.015+0000 7f551d3bd040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T05:58:12.087 INFO:journalctl@ceph.mgr.z.smithi117.stdout:Sep 19 05:58:12 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-z[36865]: 2024-09-19T05:58:12.083+0000 7f551d3bd040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T05:58:12.302 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:12 smithi099 ceph-mon[35300]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:58:12.306 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:12 smithi099 ceph-mon[35300]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:58:12.306 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:12 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:12.306 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:12 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:12.306 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:12 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:12.306 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:12 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:12.306 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:12 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:58:12.306 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Sep 19 05:58:12 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-y[36656]: 2024-09-19T05:58:12.042+0000 7f2bf4dfa040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T05:58:12.307 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Sep 19 05:58:12 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-y[36656]: 2024-09-19T05:58:12.103+0000 7f2bf4dfa040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T05:58:12.380 INFO:journalctl@ceph.mgr.z.smithi117.stdout:Sep 19 05:58:12 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-z[36865]: 2024-09-19T05:58:12.143+0000 7f551d3bd040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T05:58:12.380 INFO:journalctl@ceph.mgr.z.smithi117.stdout:Sep 19 05:58:12 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-z[36865]: 2024-09-19T05:58:12.311+0000 7f551d3bd040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T05:58:12.380 INFO:journalctl@ceph.mgr.z.smithi117.stdout:Sep 19 05:58:12 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-z[36865]: 2024-09-19T05:58:12.377+0000 7f551d3bd040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T05:58:12.380 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:12 smithi117 ceph-mon[35050]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:58:12.380 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:12 smithi117 ceph-mon[35050]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:58:12.380 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:12 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:12.380 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:12 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:12.380 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:12 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:12.380 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:12 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:12.380 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:12 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:58:12.478 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:12 smithi037 ceph-mon[31211]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:58:12.478 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:12 smithi037 ceph-mon[31211]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:58:12.478 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:12 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:12.479 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:12 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:12.479 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:12 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:12.479 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:12 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:12.479 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:12 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:58:12.653 INFO:journalctl@ceph.mgr.z.smithi117.stdout:Sep 19 05:58:12 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-z[36865]: 2024-09-19T05:58:12.447+0000 7f551d3bd040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T05:58:12.653 INFO:journalctl@ceph.mgr.z.smithi117.stdout:Sep 19 05:58:12 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-z[36865]: 2024-09-19T05:58:12.530+0000 7f551d3bd040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T05:58:12.653 INFO:journalctl@ceph.mgr.z.smithi117.stdout:Sep 19 05:58:12 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-z[36865]: 2024-09-19T05:58:12.590+0000 7f551d3bd040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T05:58:12.653 INFO:journalctl@ceph.mgr.z.smithi117.stdout:Sep 19 05:58:12 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-z[36865]: 2024-09-19T05:58:12.650+0000 7f551d3bd040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T05:58:12.688 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Sep 19 05:58:12 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-y[36656]: 2024-09-19T05:58:12.299+0000 7f2bf4dfa040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T05:58:13.391 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:13 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:13.391 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:13 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:13.391 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:13 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:13.391 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:13 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:13.391 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:13 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:58:13.391 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:13 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:58:13.392 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:13 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:13.392 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:13 smithi037 ceph-mon[31211]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T05:58:13.392 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:13 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T05:58:13.392 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:13 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T05:58:13.392 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:13 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:58:13.392 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:13 smithi037 ceph-mon[31211]: Reconfiguring daemon mgr.x on smithi037 2024-09-19T05:58:13.392 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:13 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:13.392 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:13 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/2189746455' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "455bc11d-2b6e-4a0c-90d9-8ab4ef4f9e02"}]: dispatch 2024-09-19T05:58:13.392 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:13 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/2189746455' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "455bc11d-2b6e-4a0c-90d9-8ab4ef4f9e02"}]': finished 2024-09-19T05:58:13.392 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:13 smithi037 ceph-mon[31211]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T05:58:13.392 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:13 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T05:58:13.438 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Sep 19 05:58:13 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-y[36656]: 2024-09-19T05:58:13.184+0000 7f2bf4dfa040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T05:58:13.439 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Sep 19 05:58:13 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-y[36656]: 2024-09-19T05:58:13.249+0000 7f2bf4dfa040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T05:58:13.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:13 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:13.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:13 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:13.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:13 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:13.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:13 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:13.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:13 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:58:13.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:13 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:58:13.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:13 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:13.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:13 smithi099 ceph-mon[35300]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T05:58:13.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:13 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T05:58:13.440 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:13 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T05:58:13.440 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:13 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:58:13.440 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:13 smithi099 ceph-mon[35300]: Reconfiguring daemon mgr.x on smithi037 2024-09-19T05:58:13.440 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:13 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:13.440 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:13 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/2189746455' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "455bc11d-2b6e-4a0c-90d9-8ab4ef4f9e02"}]: dispatch 2024-09-19T05:58:13.440 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:13 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/2189746455' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "455bc11d-2b6e-4a0c-90d9-8ab4ef4f9e02"}]': finished 2024-09-19T05:58:13.440 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:13 smithi099 ceph-mon[35300]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T05:58:13.440 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:13 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T05:58:13.750 INFO:journalctl@ceph.mgr.z.smithi117.stdout:Sep 19 05:58:13 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-z[36865]: 2024-09-19T05:58:13.440+0000 7f551d3bd040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T05:58:13.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:13 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:13.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:13 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:13.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:13 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:13.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:13 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:13.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:13 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:58:13.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:13 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:58:13.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:13 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:13.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:13 smithi117 ceph-mon[35050]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T05:58:13.751 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:13 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T05:58:13.751 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:13 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T05:58:13.751 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:13 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:58:13.751 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:13 smithi117 ceph-mon[35050]: Reconfiguring daemon mgr.x on smithi037 2024-09-19T05:58:13.751 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:13 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:13.751 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:13 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/2189746455' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "455bc11d-2b6e-4a0c-90d9-8ab4ef4f9e02"}]: dispatch 2024-09-19T05:58:13.751 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:13 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/2189746455' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "455bc11d-2b6e-4a0c-90d9-8ab4ef4f9e02"}]': finished 2024-09-19T05:58:13.751 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:13 smithi117 ceph-mon[35050]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T05:58:13.751 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:13 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T05:58:14.215 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Sep 19 05:58:13 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-y[36656]: 2024-09-19T05:58:13.961+0000 7f2bf4dfa040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T05:58:14.216 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Sep 19 05:58:14 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-y[36656]: 2024-09-19T05:58:14.075+0000 7f2bf4dfa040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T05:58:14.216 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Sep 19 05:58:14 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-y[36656]: 2024-09-19T05:58:14.213+0000 7f2bf4dfa040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T05:58:14.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:14.309+0000 7f0d64ff9640 1 -- 172.21.15.37:0/3076936330 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 14) ==== 92408+0+0 (secure 0 0 0) 0x7f0d58021950 con 0x7f0d68102760 2024-09-19T05:58:14.494 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:14 smithi099 ceph-mon[35300]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:58:14.494 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:14 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/2329284565' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:58:14.494 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:14 smithi099 ceph-mon[35300]: Standby manager daemon z started 2024-09-19T05:58:14.494 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:14 smithi099 ceph-mon[35300]: from='mgr.? 172.21.15.117:0/235431205' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T05:58:14.494 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:14 smithi099 ceph-mon[35300]: from='mgr.? 172.21.15.117:0/235431205' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T05:58:14.494 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:14 smithi099 ceph-mon[35300]: from='mgr.? 172.21.15.117:0/235431205' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T05:58:14.494 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:14 smithi099 ceph-mon[35300]: from='mgr.? 172.21.15.117:0/235431205' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T05:58:14.495 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Sep 19 05:58:14 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-y[36656]: 2024-09-19T05:58:14.274+0000 7f2bf4dfa040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T05:58:14.495 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Sep 19 05:58:14 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-y[36656]: 2024-09-19T05:58:14.424+0000 7f2bf4dfa040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T05:58:14.495 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Sep 19 05:58:14 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-y[36656]: 2024-09-19T05:58:14.492+0000 7f2bf4dfa040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T05:58:14.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:14 smithi037 ceph-mon[31211]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:58:14.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:14 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/2329284565' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:58:14.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:14 smithi037 ceph-mon[31211]: Standby manager daemon z started 2024-09-19T05:58:14.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:14 smithi037 ceph-mon[31211]: from='mgr.? 172.21.15.117:0/235431205' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T05:58:14.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:14 smithi037 ceph-mon[31211]: from='mgr.? 172.21.15.117:0/235431205' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T05:58:14.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:14 smithi037 ceph-mon[31211]: from='mgr.? 172.21.15.117:0/235431205' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T05:58:14.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:14 smithi037 ceph-mon[31211]: from='mgr.? 172.21.15.117:0/235431205' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T05:58:14.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:14 smithi117 ceph-mon[35050]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:58:14.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:14 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/2329284565' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:58:14.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:14 smithi117 ceph-mon[35050]: Standby manager daemon z started 2024-09-19T05:58:14.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:14 smithi117 ceph-mon[35050]: from='mgr.? 172.21.15.117:0/235431205' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T05:58:14.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:14 smithi117 ceph-mon[35050]: from='mgr.? 172.21.15.117:0/235431205' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T05:58:14.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:14 smithi117 ceph-mon[35050]: from='mgr.? 172.21.15.117:0/235431205' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T05:58:14.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:14 smithi117 ceph-mon[35050]: from='mgr.? 172.21.15.117:0/235431205' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T05:58:14.778 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Sep 19 05:58:14 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-y[36656]: 2024-09-19T05:58:14.552+0000 7f2bf4dfa040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T05:58:14.779 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Sep 19 05:58:14 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-y[36656]: 2024-09-19T05:58:14.712+0000 7f2bf4dfa040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T05:58:14.779 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Sep 19 05:58:14 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-y[36656]: 2024-09-19T05:58:14.777+0000 7f2bf4dfa040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T05:58:15.043 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Sep 19 05:58:14 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-y[36656]: 2024-09-19T05:58:14.843+0000 7f2bf4dfa040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T05:58:15.043 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Sep 19 05:58:14 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-y[36656]: 2024-09-19T05:58:14.924+0000 7f2bf4dfa040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T05:58:15.044 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Sep 19 05:58:14 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-y[36656]: 2024-09-19T05:58:14.982+0000 7f2bf4dfa040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T05:58:15.044 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Sep 19 05:58:15 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-y[36656]: 2024-09-19T05:58:15.041+0000 7f2bf4dfa040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T05:58:15.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:15 smithi037 ceph-mon[31211]: mgrmap e14: x(active, since 61s), standbys: z 2024-09-19T05:58:15.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:15 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T05:58:15.688 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:15 smithi099 ceph-mon[35300]: mgrmap e14: x(active, since 61s), standbys: z 2024-09-19T05:58:15.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:15 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T05:58:15.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:15 smithi117 ceph-mon[35050]: mgrmap e14: x(active, since 61s), standbys: z 2024-09-19T05:58:15.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:15 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T05:58:16.189 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Sep 19 05:58:15 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-y[36656]: 2024-09-19T05:58:15.824+0000 7f2bf4dfa040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T05:58:16.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:16.319+0000 7f0d64ff9640 1 -- 172.21.15.37:0/3076936330 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7f0d5800f3c0 con 0x7f0d68102760 2024-09-19T05:58:16.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:16 smithi037 ceph-mon[31211]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:58:16.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:16 smithi037 ceph-mon[31211]: Standby manager daemon y started 2024-09-19T05:58:16.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:16 smithi037 ceph-mon[31211]: from='mgr.? 172.21.15.99:0/377262328' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T05:58:16.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:16 smithi037 ceph-mon[31211]: from='mgr.? 172.21.15.99:0/377262328' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T05:58:16.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:16 smithi037 ceph-mon[31211]: from='mgr.? 172.21.15.99:0/377262328' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T05:58:16.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:16 smithi037 ceph-mon[31211]: from='mgr.? 172.21.15.99:0/377262328' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T05:58:16.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:16 smithi099 ceph-mon[35300]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:58:16.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:16 smithi099 ceph-mon[35300]: Standby manager daemon y started 2024-09-19T05:58:16.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:16 smithi099 ceph-mon[35300]: from='mgr.? 172.21.15.99:0/377262328' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T05:58:16.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:16 smithi099 ceph-mon[35300]: from='mgr.? 172.21.15.99:0/377262328' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T05:58:16.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:16 smithi099 ceph-mon[35300]: from='mgr.? 172.21.15.99:0/377262328' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T05:58:16.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:16 smithi099 ceph-mon[35300]: from='mgr.? 172.21.15.99:0/377262328' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T05:58:16.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:16 smithi117 ceph-mon[35050]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:58:16.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:16 smithi117 ceph-mon[35050]: Standby manager daemon y started 2024-09-19T05:58:16.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:16 smithi117 ceph-mon[35050]: from='mgr.? 172.21.15.99:0/377262328' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T05:58:16.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:16 smithi117 ceph-mon[35050]: from='mgr.? 172.21.15.99:0/377262328' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T05:58:16.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:16 smithi117 ceph-mon[35050]: from='mgr.? 172.21.15.99:0/377262328' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T05:58:16.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:16 smithi117 ceph-mon[35050]: from='mgr.? 172.21.15.99:0/377262328' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T05:58:17.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:17 smithi037 ceph-mon[31211]: mgrmap e15: x(active, since 63s), standbys: z, y 2024-09-19T05:58:17.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:17 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T05:58:17.688 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:17 smithi099 ceph-mon[35300]: mgrmap e15: x(active, since 63s), standbys: z, y 2024-09-19T05:58:17.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:17 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T05:58:17.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:17 smithi117 ceph-mon[35050]: mgrmap e15: x(active, since 63s), standbys: z, y 2024-09-19T05:58:17.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:17 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T05:58:18.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:18 smithi037 ceph-mon[31211]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:58:18.688 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:18 smithi099 ceph-mon[35300]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:58:18.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:18 smithi117 ceph-mon[35050]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:58:20.131 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:19 smithi037 ceph-mon[31211]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:58:20.131 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:19 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:20.131 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:19 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:20.131 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:19 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:58:20.132 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:19 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:58:20.132 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:19 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:58:20.132 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:19 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:20.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:19 smithi099 ceph-mon[35300]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:58:20.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:19 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:20.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:19 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:20.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:19 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:58:20.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:19 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:58:20.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:19 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:58:20.190 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:19 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:20.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:19 smithi117 ceph-mon[35050]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:58:20.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:19 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:20.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:19 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:20.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:19 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:58:20.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:19 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:58:20.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:19 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:58:20.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:19 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:22.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:21 smithi037 ceph-mon[31211]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:58:22.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:21 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T05:58:22.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:21 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:58:22.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:21 smithi037 ceph-mon[31211]: Deploying daemon osd.0 on smithi037 2024-09-19T05:58:22.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:21 smithi099 ceph-mon[35300]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:58:22.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:21 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T05:58:22.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:21 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:58:22.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:21 smithi099 ceph-mon[35300]: Deploying daemon osd.0 on smithi037 2024-09-19T05:58:22.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:21 smithi117 ceph-mon[35050]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:58:22.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:21 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T05:58:22.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:21 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:58:22.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:21 smithi117 ceph-mon[35050]: Deploying daemon osd.0 on smithi037 2024-09-19T05:58:24.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:23 smithi099 ceph-mon[35300]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:58:24.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:23 smithi117 ceph-mon[35050]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:58:24.252 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:23 smithi037 ceph-mon[31211]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:58:26.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:25 smithi099 ceph-mon[35300]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:58:26.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:25 smithi117 ceph-mon[35050]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:58:26.278 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:25 smithi037 ceph-mon[31211]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:58:28.152 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:27 smithi037 ceph-mon[31211]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:58:28.152 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:27 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:58:28.152 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:27 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:28.152 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:27 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:28.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:27 smithi099 ceph-mon[35300]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:58:28.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:27 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:58:28.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:27 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:28.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:27 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:28.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:27 smithi117 ceph-mon[35050]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:58:28.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:27 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:58:28.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:27 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:28.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:27 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:30.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:29 smithi037 ceph-mon[31211]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:58:30.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:29 smithi099 ceph-mon[35300]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:58:30.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:29 smithi117 ceph-mon[35050]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:58:31.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:30 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:31.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:30 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:31.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:30 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:58:31.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:30 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:58:31.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:30 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:31.289 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:30 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:31.289 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:30 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:31.290 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:30 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:58:31.290 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:30 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:58:31.290 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:30 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:31.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:30 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:31.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:30 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:31.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:30 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:58:31.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:30 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:58:31.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:30 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:31.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:31.592+0000 7f0d64ff9640 1 -- 172.21.15.37:0/3076936330 <== mgr.14148 v2:172.21.15.37:6800/3797010169 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f0d68062630 con 0x7f0d50039500 2024-09-19T05:58:31.594 INFO:teuthology.orchestra.run.smithi037.stdout:Created osd(s) 0 on host 'smithi037' 2024-09-19T05:58:31.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:31.595+0000 7f0d6de49640 1 -- 172.21.15.37:0/3076936330 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f0d50039500 msgr2=0x7f0d5003b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:31.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:31.595+0000 7f0d6de49640 1 --2- 172.21.15.37:0/3076936330 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f0d50039500 0x7f0d5003b9c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c005ab0 tx=0x7f0d5c000bc0 comp rx=0 tx=0).stop 2024-09-19T05:58:31.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:31.595+0000 7f0d6de49640 1 -- 172.21.15.37:0/3076936330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d68102760 msgr2=0x7f0d68197f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:31.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:31.595+0000 7f0d6de49640 1 --2- 172.21.15.37:0/3076936330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d68102760 0x7f0d68197f50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0d5800ea60 tx=0x7f0d5800ef20 comp rx=0 tx=0).stop 2024-09-19T05:58:31.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:31.595+0000 7f0d6de49640 1 -- 172.21.15.37:0/3076936330 shutdown_connections 2024-09-19T05:58:31.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:31.595+0000 7f0d6de49640 1 --2- 172.21.15.37:0/3076936330 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f0d50039500 0x7f0d5003b9c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:31.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:31.595+0000 7f0d6de49640 1 --2- 172.21.15.37:0/3076936330 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d681079c0 0x7f0d6819f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:31.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:31.595+0000 7f0d6de49640 1 --2- 172.21.15.37:0/3076936330 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d68105090 0x7f0d68198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:31.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:31.595+0000 7f0d6de49640 1 --2- 172.21.15.37:0/3076936330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d68102760 0x7f0d68197f50 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:31.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:31.595+0000 7f0d6de49640 1 -- 172.21.15.37:0/3076936330 >> 172.21.15.37:0/3076936330 conn(0x7f0d680fc2a0 msgr2=0x7f0d681030e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:58:31.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:31.595+0000 7f0d6de49640 1 -- 172.21.15.37:0/3076936330 shutdown_connections 2024-09-19T05:58:31.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:58:31.595+0000 7f0d6de49640 1 -- 172.21.15.37:0/3076936330 wait complete. 2024-09-19T05:58:32.186 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:31 smithi037 ceph-mon[31211]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:58:32.186 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:31 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:58:32.186 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:31 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:32.186 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:31 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:32.213 DEBUG:teuthology.orchestra.run.smithi037:osd.0> sudo journalctl -f -n 0 -u ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@osd.0.service 2024-09-19T05:58:32.216 INFO:tasks.cephadm:Deploying osd.1 on smithi099 with /dev/vg_nvme/lv_4... 2024-09-19T05:58:32.216 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T05:58:32.240 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:31 smithi099 ceph-mon[35300]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:58:32.240 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:31 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:58:32.240 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:31 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:32.240 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:31 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:32.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:31 smithi117 ceph-mon[35050]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:58:32.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:31 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:58:32.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:31 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:32.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:31 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:32.455 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T05:58:33.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:32 smithi037 ceph-mon[31211]: from='osd.0 [v2:172.21.15.37:6802/1783875173,v1:172.21.15.37:6803/1783875173]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T05:58:33.075 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 19 05:58:32 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-0[42785]: 2024-09-19T05:58:32.729+0000 7fe558335640 -1 osd.0 0 log_to_monitors true 2024-09-19T05:58:33.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:32 smithi099 ceph-mon[35300]: from='osd.0 [v2:172.21.15.37:6802/1783875173,v1:172.21.15.37:6803/1783875173]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T05:58:33.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:32 smithi117 ceph-mon[35050]: from='osd.0 [v2:172.21.15.37:6802/1783875173,v1:172.21.15.37:6803/1783875173]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T05:58:34.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:33 smithi099 ceph-mon[35300]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:58:34.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:33 smithi099 ceph-mon[35300]: from='osd.0 [v2:172.21.15.37:6802/1783875173,v1:172.21.15.37:6803/1783875173]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T05:58:34.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:33 smithi099 ceph-mon[35300]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T05:58:34.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:33 smithi099 ceph-mon[35300]: from='osd.0 [v2:172.21.15.37:6802/1783875173,v1:172.21.15.37:6803/1783875173]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-09-19T05:58:34.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:33 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T05:58:34.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:33 smithi117 ceph-mon[35050]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:58:34.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:33 smithi117 ceph-mon[35050]: from='osd.0 [v2:172.21.15.37:6802/1783875173,v1:172.21.15.37:6803/1783875173]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T05:58:34.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:33 smithi117 ceph-mon[35050]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T05:58:34.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:33 smithi117 ceph-mon[35050]: from='osd.0 [v2:172.21.15.37:6802/1783875173,v1:172.21.15.37:6803/1783875173]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-09-19T05:58:34.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:33 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T05:58:34.316 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:33 smithi037 ceph-mon[31211]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:58:34.316 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:33 smithi037 ceph-mon[31211]: from='osd.0 [v2:172.21.15.37:6802/1783875173,v1:172.21.15.37:6803/1783875173]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T05:58:34.317 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:33 smithi037 ceph-mon[31211]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T05:58:34.317 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:33 smithi037 ceph-mon[31211]: from='osd.0 [v2:172.21.15.37:6802/1783875173,v1:172.21.15.37:6803/1783875173]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-09-19T05:58:34.317 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:33 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T05:58:34.317 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 19 05:58:33 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-0[42785]: 2024-09-19T05:58:33.987+0000 7fe5542b8640 -1 osd.0 0 waiting for initial osdmap 2024-09-19T05:58:34.317 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 19 05:58:33 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-0[42785]: 2024-09-19T05:58:33.990+0000 7fe5500e0640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T05:58:34.831 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T05:58:34.857 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi099:vg_nvme/lv_4 2024-09-19T05:58:35.144 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T05:58:35.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:34 smithi099 ceph-mon[35300]: from='osd.0 [v2:172.21.15.37:6802/1783875173,v1:172.21.15.37:6803/1783875173]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-09-19T05:58:35.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:34 smithi099 ceph-mon[35300]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T05:58:35.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:34 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T05:58:35.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:34 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T05:58:35.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:34 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:35.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:34 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:35.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:34 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:58:35.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:34 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:35.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:34 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:58:35.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:34 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:58:35.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:34 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:35.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:34 smithi117 ceph-mon[35050]: from='osd.0 [v2:172.21.15.37:6802/1783875173,v1:172.21.15.37:6803/1783875173]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-09-19T05:58:35.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:34 smithi117 ceph-mon[35050]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T05:58:35.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:34 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T05:58:35.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:34 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T05:58:35.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:34 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:35.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:34 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:35.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:34 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:58:35.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:34 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:35.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:34 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:58:35.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:34 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:58:35.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:34 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:35.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:34 smithi037 ceph-mon[31211]: from='osd.0 [v2:172.21.15.37:6802/1783875173,v1:172.21.15.37:6803/1783875173]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-09-19T05:58:35.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:34 smithi037 ceph-mon[31211]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T05:58:35.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:34 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T05:58:35.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:34 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T05:58:35.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:34 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:35.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:34 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:35.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:34 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:58:35.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:34 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:35.325 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:34 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:58:35.325 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:34 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:58:35.325 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:34 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:35.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:58:35.632+0000 7fc4408af640 1 -- 172.21.15.99:0/4164046225 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc43c1078c0 msgr2=0x7fc43c109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:35.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:58:35.632+0000 7fc4408af640 1 --2- 172.21.15.99:0/4164046225 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc43c1078c0 0x7fc43c109d10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc434009900 tx=0x7fc43402a410 comp rx=0 tx=0).stop 2024-09-19T05:58:35.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:58:35.632+0000 7fc4408af640 1 -- 172.21.15.99:0/4164046225 shutdown_connections 2024-09-19T05:58:35.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:58:35.632+0000 7fc4408af640 1 --2- 172.21.15.99:0/4164046225 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc43c1078c0 0x7fc43c109d10 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:35.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:58:35.632+0000 7fc4408af640 1 --2- 172.21.15.99:0/4164046225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc43c104f90 0x7fc43c107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:35.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:58:35.632+0000 7fc4408af640 1 --2- 172.21.15.99:0/4164046225 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc43c102660 0x7fc43c104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:35.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:58:35.632+0000 7fc4408af640 1 -- 172.21.15.99:0/4164046225 >> 172.21.15.99:0/4164046225 conn(0x7fc43c0fc280 msgr2=0x7fc43c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:58:35.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:58:35.632+0000 7fc4408af640 1 -- 172.21.15.99:0/4164046225 shutdown_connections 2024-09-19T05:58:35.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:58:35.632+0000 7fc4408af640 1 -- 172.21.15.99:0/4164046225 wait complete. 2024-09-19T05:58:35.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:58:35.633+0000 7fc4408af640 1 Processor -- start 2024-09-19T05:58:35.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:58:35.633+0000 7fc4408af640 1 -- start start 2024-09-19T05:58:35.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:58:35.633+0000 7fc4408af640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc43c102660 0x7fc43c197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:35.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:58:35.633+0000 7fc4408af640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc43c104f90 0x7fc43c198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:35.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:58:35.633+0000 7fc4408af640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc43c1078c0 0x7fc43c19f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:35.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:58:35.633+0000 7fc4408af640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc43c10d880 con 0x7fc43c102660 2024-09-19T05:58:35.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:58:35.633+0000 7fc4408af640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc43c10d700 con 0x7fc43c1078c0 2024-09-19T05:58:35.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:58:35.633+0000 7fc4408af640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc43c10da00 con 0x7fc43c104f90 2024-09-19T05:58:35.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:58:35.633+0000 7fc43ad9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc43c1078c0 0x7fc43c19f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:35.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:58:35.633+0000 7fc43a59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc43c102660 0x7fc43c197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:35.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:58:35.633+0000 7fc43ad9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc43c1078c0 0x7fc43c19f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60614/0 (socket says 172.21.15.99:60614) 2024-09-19T05:58:35.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:58:35.633+0000 7fc43ad9d640 1 -- 172.21.15.99:0/1909934171 learned_addr learned my addr 172.21.15.99:0/1909934171 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T05:58:35.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:58:35.633+0000 7fc43a59c640 1 --2- 172.21.15.99:0/1909934171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc43c102660 0x7fc43c197ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.99:48346/0 (socket says 172.21.15.99:48346) 2024-09-19T05:58:35.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:58:35.633+0000 7fc439d9b640 1 --2- 172.21.15.99:0/1909934171 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc43c104f90 0x7fc43c198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:35.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:58:35.633+0000 7fc43ad9d640 1 -- 172.21.15.99:0/1909934171 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc43c104f90 msgr2=0x7fc43c198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:35.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:58:35.633+0000 7fc43ad9d640 1 --2- 172.21.15.99:0/1909934171 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc43c104f90 0x7fc43c198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:35.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:58:35.633+0000 7fc43ad9d640 1 -- 172.21.15.99:0/1909934171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc43c102660 msgr2=0x7fc43c197ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:35.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:58:35.633+0000 7fc43ad9d640 1 --2- 172.21.15.99:0/1909934171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc43c102660 0x7fc43c197ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:35.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:58:35.633+0000 7fc43ad9d640 1 -- 172.21.15.99:0/1909934171 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc43c19fb00 con 0x7fc43c1078c0 2024-09-19T05:58:35.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:58:35.633+0000 7fc43a59c640 1 --2- 172.21.15.99:0/1909934171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc43c102660 0x7fc43c197ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:58:35.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:58:35.634+0000 7fc43ad9d640 1 --2- 172.21.15.99:0/1909934171 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc43c1078c0 0x7fc43c19f490 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc4340314e0 tx=0x7fc434004360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:35.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:58:35.634+0000 7fc4337fe640 1 -- 172.21.15.99:0/1909934171 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc43403f030 con 0x7fc43c1078c0 2024-09-19T05:58:35.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:58:35.634+0000 7fc4337fe640 1 -- 172.21.15.99:0/1909934171 <== mon.2 v2:172.21.15.99:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc434003ce0 con 0x7fc43c1078c0 2024-09-19T05:58:35.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:58:35.634+0000 7fc4408af640 1 -- 172.21.15.99:0/1909934171 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc43c19fd90 con 0x7fc43c1078c0 2024-09-19T05:58:35.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:58:35.634+0000 7fc4337fe640 1 -- 172.21.15.99:0/1909934171 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc434035070 con 0x7fc43c1078c0 2024-09-19T05:58:35.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:58:35.634+0000 7fc4408af640 1 -- 172.21.15.99:0/1909934171 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc43c1a0210 con 0x7fc43c1078c0 2024-09-19T05:58:35.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:58:35.635+0000 7fc4408af640 1 -- 172.21.15.99:0/1909934171 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc43c0fdd70 con 0x7fc43c1078c0 2024-09-19T05:58:35.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:58:35.636+0000 7fc4337fe640 1 -- 172.21.15.99:0/1909934171 <== mon.2 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7fc434042030 con 0x7fc43c1078c0 2024-09-19T05:58:35.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:58:35.637+0000 7fc4337fe640 1 --2- 172.21.15.99:0/1909934171 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fc4280a31e0 0x7fc4280a56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:58:35.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:58:35.637+0000 7fc4337fe640 1 -- 172.21.15.99:0/1909934171 <== mon.2 v2:172.21.15.99:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1767+0+0 (secure 0 0 0) 0x7fc4340ee3b0 con 0x7fc43c1078c0 2024-09-19T05:58:35.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:58:35.637+0000 7fc43a59c640 1 --2- 172.21.15.99:0/1909934171 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fc4280a31e0 0x7fc4280a56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:58:35.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:58:35.637+0000 7fc43a59c640 1 --2- 172.21.15.99:0/1909934171 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fc4280a31e0 0x7fc4280a56a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc42c005c40 tx=0x7fc42c00a570 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:58:35.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:58:35.641+0000 7fc4337fe640 1 -- 172.21.15.99:0/1909934171 <== mon.2 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc4340bc4f0 con 0x7fc43c1078c0 2024-09-19T05:58:35.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:58:35.815+0000 7fc4408af640 1 -- 172.21.15.99:0/1909934171 --> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fc43c062630 con 0x7fc4280a31e0 2024-09-19T05:58:36.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:35 smithi099 ceph-mon[35300]: purged_snaps scrub starts 2024-09-19T05:58:36.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:35 smithi099 ceph-mon[35300]: purged_snaps scrub ok 2024-09-19T05:58:36.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:35 smithi099 ceph-mon[35300]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:58:36.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:35 smithi099 ceph-mon[35300]: Detected new or changed devices on smithi037 2024-09-19T05:58:36.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:35 smithi099 ceph-mon[35300]: Adjusting osd_memory_target on smithi037 to 17092M 2024-09-19T05:58:36.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:35 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T05:58:36.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:35 smithi099 ceph-mon[35300]: osd.0 [v2:172.21.15.37:6802/1783875173,v1:172.21.15.37:6803/1783875173] boot 2024-09-19T05:58:36.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:35 smithi099 ceph-mon[35300]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T05:58:36.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:35 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T05:58:36.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:35 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:58:36.190 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:35 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:58:36.190 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:35 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:58:36.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:35 smithi117 ceph-mon[35050]: purged_snaps scrub starts 2024-09-19T05:58:36.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:35 smithi117 ceph-mon[35050]: purged_snaps scrub ok 2024-09-19T05:58:36.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:35 smithi117 ceph-mon[35050]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:58:36.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:35 smithi117 ceph-mon[35050]: Detected new or changed devices on smithi037 2024-09-19T05:58:36.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:35 smithi117 ceph-mon[35050]: Adjusting osd_memory_target on smithi037 to 17092M 2024-09-19T05:58:36.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:35 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T05:58:36.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:35 smithi117 ceph-mon[35050]: osd.0 [v2:172.21.15.37:6802/1783875173,v1:172.21.15.37:6803/1783875173] boot 2024-09-19T05:58:36.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:35 smithi117 ceph-mon[35050]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T05:58:36.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:35 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T05:58:36.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:35 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:58:36.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:35 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:58:36.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:35 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:58:36.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:35 smithi037 ceph-mon[31211]: purged_snaps scrub starts 2024-09-19T05:58:36.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:35 smithi037 ceph-mon[31211]: purged_snaps scrub ok 2024-09-19T05:58:36.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:35 smithi037 ceph-mon[31211]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:58:36.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:35 smithi037 ceph-mon[31211]: Detected new or changed devices on smithi037 2024-09-19T05:58:36.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:35 smithi037 ceph-mon[31211]: Adjusting osd_memory_target on smithi037 to 17092M 2024-09-19T05:58:36.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:35 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T05:58:36.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:35 smithi037 ceph-mon[31211]: osd.0 [v2:172.21.15.37:6802/1783875173,v1:172.21.15.37:6803/1783875173] boot 2024-09-19T05:58:36.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:35 smithi037 ceph-mon[31211]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T05:58:36.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:35 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T05:58:36.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:35 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:58:36.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:35 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:58:36.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:35 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:58:37.290 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:37 smithi099 ceph-mon[35300]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:58:37.290 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:37 smithi099 ceph-mon[35300]: osdmap e9: 1 total, 1 up, 1 in 2024-09-19T05:58:37.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:37 smithi037 ceph-mon[31211]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:58:37.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:37 smithi037 ceph-mon[31211]: osdmap e9: 1 total, 1 up, 1 in 2024-09-19T05:58:37.499 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:37 smithi117 ceph-mon[35050]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:58:37.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:37 smithi117 ceph-mon[35050]: osdmap e9: 1 total, 1 up, 1 in 2024-09-19T05:58:38.298 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:38 smithi099 ceph-mon[35300]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:58:38.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:38 smithi037 ceph-mon[31211]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:58:38.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:38 smithi117 ceph-mon[35050]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:58:39.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:39 smithi037 ceph-mon[31211]: from='client.? 172.21.15.99:0/3079808760' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3505c162-c342-479d-8ea2-15b7a9d625cd"}]: dispatch 2024-09-19T05:58:39.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:39 smithi037 ceph-mon[31211]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3505c162-c342-479d-8ea2-15b7a9d625cd"}]: dispatch 2024-09-19T05:58:39.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:39 smithi037 ceph-mon[31211]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3505c162-c342-479d-8ea2-15b7a9d625cd"}]': finished 2024-09-19T05:58:39.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:39 smithi037 ceph-mon[31211]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T05:58:39.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:39 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T05:58:39.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:39 smithi037 ceph-mon[31211]: from='client.? 172.21.15.99:0/4053871811' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:58:39.438 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:39 smithi099 ceph-mon[35300]: from='client.? 172.21.15.99:0/3079808760' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3505c162-c342-479d-8ea2-15b7a9d625cd"}]: dispatch 2024-09-19T05:58:39.438 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:39 smithi099 ceph-mon[35300]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3505c162-c342-479d-8ea2-15b7a9d625cd"}]: dispatch 2024-09-19T05:58:39.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:39 smithi099 ceph-mon[35300]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3505c162-c342-479d-8ea2-15b7a9d625cd"}]': finished 2024-09-19T05:58:39.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:39 smithi099 ceph-mon[35300]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T05:58:39.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:39 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T05:58:39.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:39 smithi099 ceph-mon[35300]: from='client.? 172.21.15.99:0/4053871811' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:58:39.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:39 smithi117 ceph-mon[35050]: from='client.? 172.21.15.99:0/3079808760' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3505c162-c342-479d-8ea2-15b7a9d625cd"}]: dispatch 2024-09-19T05:58:39.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:39 smithi117 ceph-mon[35050]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3505c162-c342-479d-8ea2-15b7a9d625cd"}]: dispatch 2024-09-19T05:58:39.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:39 smithi117 ceph-mon[35050]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3505c162-c342-479d-8ea2-15b7a9d625cd"}]': finished 2024-09-19T05:58:39.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:39 smithi117 ceph-mon[35050]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T05:58:39.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:39 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T05:58:39.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:39 smithi117 ceph-mon[35050]: from='client.? 172.21.15.99:0/4053871811' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:58:40.438 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:40 smithi099 ceph-mon[35300]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:58:40.499 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:40 smithi117 ceph-mon[35050]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:58:40.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:40 smithi037 ceph-mon[31211]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:58:42.376 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:42 smithi037 ceph-mon[31211]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:58:42.438 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:42 smithi099 ceph-mon[35300]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:58:42.499 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:42 smithi117 ceph-mon[35050]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:58:44.382 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:44 smithi099 ceph-mon[35300]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:58:44.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:44 smithi117 ceph-mon[35050]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:58:44.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:44 smithi037 ceph-mon[31211]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:58:46.320 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:46 smithi099 ceph-mon[35300]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:58:46.499 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:46 smithi117 ceph-mon[35050]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:58:46.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:46 smithi037 ceph-mon[31211]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:58:47.424 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:47 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T05:58:47.424 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:47 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:58:47.424 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:47 smithi099 ceph-mon[35300]: Deploying daemon osd.1 on smithi099 2024-09-19T05:58:47.499 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:47 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T05:58:47.499 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:47 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:58:47.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:47 smithi117 ceph-mon[35050]: Deploying daemon osd.1 on smithi099 2024-09-19T05:58:47.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:47 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T05:58:47.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:47 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:58:47.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:47 smithi037 ceph-mon[31211]: Deploying daemon osd.1 on smithi099 2024-09-19T05:58:48.235 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:48 smithi099 ceph-mon[35300]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:58:48.499 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:48 smithi117 ceph-mon[35050]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:58:48.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:48 smithi037 ceph-mon[31211]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:58:50.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:50 smithi099 ceph-mon[35300]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:58:50.499 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:50 smithi117 ceph-mon[35050]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:58:50.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:50 smithi037 ceph-mon[31211]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:58:52.303 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:52 smithi099 ceph-mon[35300]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:58:52.428 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:52 smithi037 ceph-mon[31211]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:58:52.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:52 smithi117 ceph-mon[35050]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:58:53.255 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:53 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:58:53.255 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:53 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:53.255 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:53 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:53.499 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:53 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:58:53.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:53 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:53.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:53 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:53.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:53 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:58:53.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:53 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:53.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:53 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:54.782 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:54 smithi099 ceph-mon[35300]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:58:54.782 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:54 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:54.783 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:54 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:54.783 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:54 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:58:54.783 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:54 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:58:54.783 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:54 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:54.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:54 smithi037 ceph-mon[31211]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:58:54.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:54 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:54.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:54 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:54.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:54 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:58:54.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:54 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:58:54.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:54 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:55.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:54 smithi117 ceph-mon[35050]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:58:55.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:54 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:55.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:54 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:55.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:54 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:58:55.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:54 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:58:55.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:54 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:56.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:58:56.547+0000 7fc4337fe640 1 -- 172.21.15.99:0/1909934171 <== mgr.14148 v2:172.21.15.37:6800/3797010169 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fc43c062630 con 0x7fc4280a31e0 2024-09-19T05:58:56.553 INFO:teuthology.orchestra.run.smithi099.stdout:Created osd(s) 1 on host 'smithi099' 2024-09-19T05:58:56.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:58:56.550+0000 7fc4408af640 1 -- 172.21.15.99:0/1909934171 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fc4280a31e0 msgr2=0x7fc4280a56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:56.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:58:56.550+0000 7fc4408af640 1 --2- 172.21.15.99:0/1909934171 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fc4280a31e0 0x7fc4280a56a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc42c005c40 tx=0x7fc42c00a570 comp rx=0 tx=0).stop 2024-09-19T05:58:56.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:58:56.550+0000 7fc4408af640 1 -- 172.21.15.99:0/1909934171 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc43c1078c0 msgr2=0x7fc43c19f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:58:56.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:58:56.550+0000 7fc4408af640 1 --2- 172.21.15.99:0/1909934171 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc43c1078c0 0x7fc43c19f490 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc4340314e0 tx=0x7fc434004360 comp rx=0 tx=0).stop 2024-09-19T05:58:56.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:58:56.550+0000 7fc4408af640 1 -- 172.21.15.99:0/1909934171 shutdown_connections 2024-09-19T05:58:56.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:58:56.550+0000 7fc4408af640 1 --2- 172.21.15.99:0/1909934171 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fc4280a31e0 0x7fc4280a56a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:56.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:58:56.550+0000 7fc4408af640 1 --2- 172.21.15.99:0/1909934171 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc43c1078c0 0x7fc43c19f490 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:56.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:58:56.550+0000 7fc4408af640 1 --2- 172.21.15.99:0/1909934171 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc43c104f90 0x7fc43c198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:56.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:58:56.550+0000 7fc4408af640 1 --2- 172.21.15.99:0/1909934171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc43c102660 0x7fc43c197ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:58:56.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:58:56.550+0000 7fc4408af640 1 -- 172.21.15.99:0/1909934171 >> 172.21.15.99:0/1909934171 conn(0x7fc43c0fc280 msgr2=0x7fc43c102f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:58:56.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:58:56.550+0000 7fc4408af640 1 -- 172.21.15.99:0/1909934171 shutdown_connections 2024-09-19T05:58:56.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:58:56.550+0000 7fc4408af640 1 -- 172.21.15.99:0/1909934171 wait complete. 2024-09-19T05:58:56.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:56 smithi037 ceph-mon[31211]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:58:56.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:56 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:58:56.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:56 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:56.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:56 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:56.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:56 smithi099 ceph-mon[35300]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:58:56.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:56 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:58:56.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:56 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:56.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:56 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:56.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:56 smithi117 ceph-mon[35050]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:58:57.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:56 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:58:57.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:56 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:57.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:56 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:58:57.246 DEBUG:teuthology.orchestra.run.smithi099:osd.1> sudo journalctl -f -n 0 -u ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@osd.1.service 2024-09-19T05:58:57.248 INFO:tasks.cephadm:Deploying osd.2 on smithi117 with /dev/vg_nvme/lv_4... 2024-09-19T05:58:57.248 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T05:58:57.499 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T05:58:58.681 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:58 smithi117 ceph-mon[35050]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:58:58.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:58 smithi037 ceph-mon[31211]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:58:58.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:58 smithi099 ceph-mon[35300]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:58:58.940 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 05:58:58 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-1[39739]: 2024-09-19T05:58:58.635+0000 7fe4f58c1640 -1 osd.1 0 log_to_monitors true 2024-09-19T05:58:59.713 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T05:58:59.738 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:59 smithi117 ceph-mon[35050]: from='osd.1 [v2:172.21.15.99:6800/3414373360,v1:172.21.15.99:6801/3414373360]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T05:58:59.738 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:58:59 smithi117 ceph-mon[35050]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T05:58:59.739 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi117:vg_nvme/lv_4 2024-09-19T05:58:59.769 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:59 smithi099 ceph-mon[35300]: from='osd.1 [v2:172.21.15.99:6800/3414373360,v1:172.21.15.99:6801/3414373360]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T05:58:59.769 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:58:59 smithi099 ceph-mon[35300]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T05:58:59.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:59 smithi037 ceph-mon[31211]: from='osd.1 [v2:172.21.15.99:6800/3414373360,v1:172.21.15.99:6801/3414373360]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T05:58:59.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:58:59 smithi037 ceph-mon[31211]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T05:58:59.992 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T05:59:00.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:59:00.411+0000 7f3b910d0640 1 -- 172.21.15.117:0/2760969087 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b8c102690 msgr2=0x7f3b8c108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:59:00.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:59:00.411+0000 7f3b910d0640 1 --2- 172.21.15.117:0/2760969087 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b8c102690 0x7f3b8c108f20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3b84009ca0 tx=0x7f3b8402a8c0 comp rx=0 tx=0).stop 2024-09-19T05:59:00.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:59:00.411+0000 7f3b910d0640 1 -- 172.21.15.117:0/2760969087 shutdown_connections 2024-09-19T05:59:00.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:59:00.411+0000 7f3b910d0640 1 --2- 172.21.15.117:0/2760969087 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b8c102690 0x7f3b8c108f20 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:00.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:59:00.411+0000 7f3b910d0640 1 --2- 172.21.15.117:0/2760969087 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b8c101cd0 0x7f3b8c102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:00.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:59:00.411+0000 7f3b910d0640 1 --2- 172.21.15.117:0/2760969087 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3b8c100ad0 0x7f3b8c100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:00.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:59:00.411+0000 7f3b910d0640 1 -- 172.21.15.117:0/2760969087 >> 172.21.15.117:0/2760969087 conn(0x7f3b8c0fc280 msgr2=0x7f3b8c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:59:00.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:59:00.412+0000 7f3b910d0640 1 -- 172.21.15.117:0/2760969087 shutdown_connections 2024-09-19T05:59:00.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:59:00.412+0000 7f3b910d0640 1 -- 172.21.15.117:0/2760969087 wait complete. 2024-09-19T05:59:00.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:59:00.412+0000 7f3b910d0640 1 Processor -- start 2024-09-19T05:59:00.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:59:00.412+0000 7f3b910d0640 1 -- start start 2024-09-19T05:59:00.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:59:00.413+0000 7f3b910d0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b8c100ad0 0x7f3b8c104b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:59:00.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:59:00.413+0000 7f3b910d0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b8c101cd0 0x7f3b8c1031a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:59:00.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:59:00.413+0000 7f3b910d0640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3b8c102690 0x7f3b8c1036e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:59:00.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:59:00.413+0000 7f3b910d0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3b8c10c750 con 0x7f3b8c100ad0 2024-09-19T05:59:00.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:59:00.413+0000 7f3b910d0640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f3b8c10c5d0 con 0x7f3b8c102690 2024-09-19T05:59:00.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:59:00.413+0000 7f3b910d0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3b8c10c8d0 con 0x7f3b8c101cd0 2024-09-19T05:59:00.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:59:00.413+0000 7f3b8a59c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b8c101cd0 0x7f3b8c1031a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:59:00.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:59:00.413+0000 7f3b8a59c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b8c101cd0 0x7f3b8c1031a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:42092/0 (socket says 172.21.15.117:42092) 2024-09-19T05:59:00.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:59:00.413+0000 7f3b8a59c640 1 -- 172.21.15.117:0/2666107795 learned_addr learned my addr 172.21.15.117:0/2666107795 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T05:59:00.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:59:00.413+0000 7f3b8ad9d640 1 --2- 172.21.15.117:0/2666107795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b8c100ad0 0x7f3b8c104b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:59:00.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:59:00.413+0000 7f3b8b59e640 1 --2- 172.21.15.117:0/2666107795 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3b8c102690 0x7f3b8c1036e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:59:00.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:59:00.413+0000 7f3b8a59c640 1 -- 172.21.15.117:0/2666107795 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3b8c102690 msgr2=0x7f3b8c1036e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:59:00.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:59:00.413+0000 7f3b8a59c640 1 --2- 172.21.15.117:0/2666107795 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3b8c102690 0x7f3b8c1036e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:00.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:59:00.413+0000 7f3b8a59c640 1 -- 172.21.15.117:0/2666107795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b8c100ad0 msgr2=0x7f3b8c104b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:59:00.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:59:00.413+0000 7f3b8a59c640 1 --2- 172.21.15.117:0/2666107795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b8c100ad0 0x7f3b8c104b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:00.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:59:00.413+0000 7f3b8a59c640 1 -- 172.21.15.117:0/2666107795 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b8c103fa0 con 0x7f3b8c101cd0 2024-09-19T05:59:00.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:59:00.413+0000 7f3b8a59c640 1 --2- 172.21.15.117:0/2666107795 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b8c101cd0 0x7f3b8c1031a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c00c890 tx=0x7f3b7c00cd50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:59:00.423 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:59:00.414+0000 7f3b73fff640 1 -- 172.21.15.117:0/2666107795 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c004220 con 0x7f3b8c101cd0 2024-09-19T05:59:00.423 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:59:00.414+0000 7f3b73fff640 1 -- 172.21.15.117:0/2666107795 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b7c0043c0 con 0x7f3b8c101cd0 2024-09-19T05:59:00.423 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:59:00.414+0000 7f3b910d0640 1 -- 172.21.15.117:0/2666107795 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b8c1a1fd0 con 0x7f3b8c101cd0 2024-09-19T05:59:00.423 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:59:00.414+0000 7f3b73fff640 1 -- 172.21.15.117:0/2666107795 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c004a00 con 0x7f3b8c101cd0 2024-09-19T05:59:00.423 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:59:00.414+0000 7f3b910d0640 1 -- 172.21.15.117:0/2666107795 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b8c1a2480 con 0x7f3b8c101cd0 2024-09-19T05:59:00.423 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:59:00.415+0000 7f3b910d0640 1 -- 172.21.15.117:0/2666107795 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b8c100ed0 con 0x7f3b8c101cd0 2024-09-19T05:59:00.423 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:59:00.416+0000 7f3b73fff640 1 -- 172.21.15.117:0/2666107795 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7f3b7c0079b0 con 0x7f3b8c101cd0 2024-09-19T05:59:00.423 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:59:00.416+0000 7f3b73fff640 1 --2- 172.21.15.117:0/2666107795 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f3b740a31b0 0x7f3b740a5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:59:00.423 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:59:00.417+0000 7f3b73fff640 1 -- 172.21.15.117:0/2666107795 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 1903+0+0 (secure 0 0 0) 0x7f3b7c0cdeb0 con 0x7f3b8c101cd0 2024-09-19T05:59:00.423 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:59:00.417+0000 7f3b8ad9d640 1 --2- 172.21.15.117:0/2666107795 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f3b740a31b0 0x7f3b740a5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:59:00.423 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:59:00.417+0000 7f3b8ad9d640 1 --2- 172.21.15.117:0/2666107795 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f3b740a31b0 0x7f3b740a5670 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3b80005fd0 tx=0x7f3b8000b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:59:00.424 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:59:00.420+0000 7f3b73fff640 1 -- 172.21.15.117:0/2666107795 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3b7c014030 con 0x7f3b8c101cd0 2024-09-19T05:59:00.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:59:00.600+0000 7f3b910d0640 1 -- 172.21.15.117:0/2666107795 --> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f3b8c06a680 con 0x7f3b740a31b0 2024-09-19T05:59:00.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:00 smithi117 ceph-mon[35050]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:59:00.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:00 smithi117 ceph-mon[35050]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T05:59:00.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:00 smithi117 ceph-mon[35050]: from='osd.1 [v2:172.21.15.99:6800/3414373360,v1:172.21.15.99:6801/3414373360]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-19T05:59:00.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:00 smithi117 ceph-mon[35050]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T05:59:00.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:00 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T05:59:00.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:00 smithi117 ceph-mon[35050]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-19T05:59:00.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:00 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:00.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:00 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:00.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:00 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:59:00.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:00 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:00.751 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:00 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:59:00.751 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:00 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:59:00.751 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:00 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:00.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:00 smithi037 ceph-mon[31211]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:59:00.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:00 smithi037 ceph-mon[31211]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T05:59:00.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:00 smithi037 ceph-mon[31211]: from='osd.1 [v2:172.21.15.99:6800/3414373360,v1:172.21.15.99:6801/3414373360]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-19T05:59:00.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:00 smithi037 ceph-mon[31211]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T05:59:00.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:00 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T05:59:00.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:00 smithi037 ceph-mon[31211]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-19T05:59:00.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:00 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:00.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:00 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:00.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:00 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:59:00.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:00 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:00.825 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:00 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:59:00.825 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:00 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:59:00.825 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:00 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:00.939 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 05:59:00 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-1[39739]: 2024-09-19T05:59:00.569+0000 7fe4f1844640 -1 osd.1 0 waiting for initial osdmap 2024-09-19T05:59:00.939 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 05:59:00 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-1[39739]: 2024-09-19T05:59:00.572+0000 7fe4ed66c640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T05:59:00.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:00 smithi099 ceph-mon[35300]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:59:00.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:00 smithi099 ceph-mon[35300]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T05:59:00.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:00 smithi099 ceph-mon[35300]: from='osd.1 [v2:172.21.15.99:6800/3414373360,v1:172.21.15.99:6801/3414373360]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-19T05:59:00.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:00 smithi099 ceph-mon[35300]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T05:59:00.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:00 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T05:59:00.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:00 smithi099 ceph-mon[35300]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-19T05:59:00.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:00 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:00.940 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:00 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:00.940 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:00 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:59:00.940 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:00 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:00.940 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:00 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:59:00.940 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:00 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:59:00.940 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:00 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:01.903 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:01 smithi117 ceph-mon[35050]: Detected new or changed devices on smithi099 2024-09-19T05:59:01.903 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:01 smithi117 ceph-mon[35050]: Adjusting osd_memory_target on smithi099 to 17088M 2024-09-19T05:59:01.903 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:01 smithi117 ceph-mon[35050]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-09-19T05:59:01.903 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:01 smithi117 ceph-mon[35050]: osdmap e12: 2 total, 1 up, 2 in 2024-09-19T05:59:01.903 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:01 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T05:59:01.904 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:01 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T05:59:01.904 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:01 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:59:01.904 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:01 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:59:01.904 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:01 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:59:01.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:01 smithi099 ceph-mon[35300]: Detected new or changed devices on smithi099 2024-09-19T05:59:01.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:01 smithi099 ceph-mon[35300]: Adjusting osd_memory_target on smithi099 to 17088M 2024-09-19T05:59:01.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:01 smithi099 ceph-mon[35300]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-09-19T05:59:01.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:01 smithi099 ceph-mon[35300]: osdmap e12: 2 total, 1 up, 2 in 2024-09-19T05:59:01.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:01 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T05:59:01.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:01 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T05:59:01.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:01 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:59:01.940 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:01 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:59:01.940 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:01 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:59:02.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:01 smithi037 ceph-mon[31211]: Detected new or changed devices on smithi099 2024-09-19T05:59:02.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:01 smithi037 ceph-mon[31211]: Adjusting osd_memory_target on smithi099 to 17088M 2024-09-19T05:59:02.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:01 smithi037 ceph-mon[31211]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-09-19T05:59:02.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:01 smithi037 ceph-mon[31211]: osdmap e12: 2 total, 1 up, 2 in 2024-09-19T05:59:02.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:01 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T05:59:02.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:01 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T05:59:02.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:01 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:59:02.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:01 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:59:02.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:01 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:59:02.870 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:02 smithi117 ceph-mon[35050]: purged_snaps scrub starts 2024-09-19T05:59:02.871 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:02 smithi117 ceph-mon[35050]: purged_snaps scrub ok 2024-09-19T05:59:02.871 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:02 smithi117 ceph-mon[35050]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:59:02.871 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:02 smithi117 ceph-mon[35050]: from='client.24160 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:59:02.871 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:02 smithi117 ceph-mon[35050]: osd.1 [v2:172.21.15.99:6800/3414373360,v1:172.21.15.99:6801/3414373360] boot 2024-09-19T05:59:02.871 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:02 smithi117 ceph-mon[35050]: osdmap e13: 2 total, 2 up, 2 in 2024-09-19T05:59:02.871 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:02 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T05:59:02.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:02 smithi099 ceph-mon[35300]: purged_snaps scrub starts 2024-09-19T05:59:02.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:02 smithi099 ceph-mon[35300]: purged_snaps scrub ok 2024-09-19T05:59:02.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:02 smithi099 ceph-mon[35300]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:59:02.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:02 smithi099 ceph-mon[35300]: from='client.24160 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:59:02.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:02 smithi099 ceph-mon[35300]: osd.1 [v2:172.21.15.99:6800/3414373360,v1:172.21.15.99:6801/3414373360] boot 2024-09-19T05:59:02.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:02 smithi099 ceph-mon[35300]: osdmap e13: 2 total, 2 up, 2 in 2024-09-19T05:59:02.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:02 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T05:59:03.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:02 smithi037 ceph-mon[31211]: purged_snaps scrub starts 2024-09-19T05:59:03.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:02 smithi037 ceph-mon[31211]: purged_snaps scrub ok 2024-09-19T05:59:03.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:02 smithi037 ceph-mon[31211]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:59:03.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:02 smithi037 ceph-mon[31211]: from='client.24160 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:59:03.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:02 smithi037 ceph-mon[31211]: osd.1 [v2:172.21.15.99:6800/3414373360,v1:172.21.15.99:6801/3414373360] boot 2024-09-19T05:59:03.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:02 smithi037 ceph-mon[31211]: osdmap e13: 2 total, 2 up, 2 in 2024-09-19T05:59:03.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:02 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T05:59:03.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:03 smithi099 ceph-mon[35300]: pgmap v58: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:59:03.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:03 smithi099 ceph-mon[35300]: osdmap e14: 2 total, 2 up, 2 in 2024-09-19T05:59:03.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:03 smithi099 ceph-mon[35300]: from='client.? 172.21.15.117:0/2934925177' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "736ec67f-b5e7-43f0-9303-0c88878ead6d"}]: dispatch 2024-09-19T05:59:03.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:03 smithi099 ceph-mon[35300]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "736ec67f-b5e7-43f0-9303-0c88878ead6d"}]: dispatch 2024-09-19T05:59:03.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:03 smithi099 ceph-mon[35300]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "736ec67f-b5e7-43f0-9303-0c88878ead6d"}]': finished 2024-09-19T05:59:03.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:03 smithi099 ceph-mon[35300]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T05:59:03.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:03 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T05:59:03.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:03 smithi099 ceph-mon[35300]: from='client.? 172.21.15.117:0/2675988998' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:59:03.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:03 smithi117 ceph-mon[35050]: pgmap v58: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:59:04.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:03 smithi117 ceph-mon[35050]: osdmap e14: 2 total, 2 up, 2 in 2024-09-19T05:59:04.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:03 smithi117 ceph-mon[35050]: from='client.? 172.21.15.117:0/2934925177' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "736ec67f-b5e7-43f0-9303-0c88878ead6d"}]: dispatch 2024-09-19T05:59:04.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:03 smithi117 ceph-mon[35050]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "736ec67f-b5e7-43f0-9303-0c88878ead6d"}]: dispatch 2024-09-19T05:59:04.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:03 smithi117 ceph-mon[35050]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "736ec67f-b5e7-43f0-9303-0c88878ead6d"}]': finished 2024-09-19T05:59:04.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:03 smithi117 ceph-mon[35050]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T05:59:04.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:03 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T05:59:04.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:03 smithi117 ceph-mon[35050]: from='client.? 172.21.15.117:0/2675988998' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:59:04.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:03 smithi037 ceph-mon[31211]: pgmap v58: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:59:04.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:03 smithi037 ceph-mon[31211]: osdmap e14: 2 total, 2 up, 2 in 2024-09-19T05:59:04.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:03 smithi037 ceph-mon[31211]: from='client.? 172.21.15.117:0/2934925177' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "736ec67f-b5e7-43f0-9303-0c88878ead6d"}]: dispatch 2024-09-19T05:59:04.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:03 smithi037 ceph-mon[31211]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "736ec67f-b5e7-43f0-9303-0c88878ead6d"}]: dispatch 2024-09-19T05:59:04.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:03 smithi037 ceph-mon[31211]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "736ec67f-b5e7-43f0-9303-0c88878ead6d"}]': finished 2024-09-19T05:59:04.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:03 smithi037 ceph-mon[31211]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T05:59:04.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:03 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T05:59:04.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:03 smithi037 ceph-mon[31211]: from='client.? 172.21.15.117:0/2675988998' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:59:05.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:05 smithi099 ceph-mon[35300]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:59:05.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:05 smithi117 ceph-mon[35050]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:59:06.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:05 smithi037 ceph-mon[31211]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:59:07.749 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:07 smithi117 ceph-mon[35050]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:59:07.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:07 smithi099 ceph-mon[35300]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:59:08.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:07 smithi037 ceph-mon[31211]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:59:09.882 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:09 smithi117 ceph-mon[35050]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:59:09.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:09 smithi099 ceph-mon[35300]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:59:10.076 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:09 smithi037 ceph-mon[31211]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:59:11.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:11 smithi099 ceph-mon[35300]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:59:11.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:11 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T05:59:11.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:11 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:59:11.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:11 smithi099 ceph-mon[35300]: Deploying daemon osd.2 on smithi117 2024-09-19T05:59:12.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:11 smithi117 ceph-mon[35050]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:59:12.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:11 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T05:59:12.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:11 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:59:12.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:11 smithi117 ceph-mon[35050]: Deploying daemon osd.2 on smithi117 2024-09-19T05:59:12.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:11 smithi037 ceph-mon[31211]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:59:12.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:11 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T05:59:12.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:11 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:59:12.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:11 smithi037 ceph-mon[31211]: Deploying daemon osd.2 on smithi117 2024-09-19T05:59:13.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:13 smithi099 ceph-mon[35300]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:59:13.986 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:13 smithi117 ceph-mon[35050]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:59:14.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:13 smithi037 ceph-mon[31211]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:59:15.900 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:15 smithi117 ceph-mon[35050]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:59:15.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:15 smithi099 ceph-mon[35300]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:59:16.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:15 smithi037 ceph-mon[31211]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:59:17.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:17 smithi117 ceph-mon[35050]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:59:17.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:17 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:59:17.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:17 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:17.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:17 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:17.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:17 smithi099 ceph-mon[35300]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:59:17.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:17 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:59:17.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:17 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:17.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:17 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:18.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:17 smithi037 ceph-mon[31211]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:59:18.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:17 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:59:18.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:17 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:18.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:17 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:20.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:20 smithi037 ceph-mon[31211]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:59:20.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:20 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:20.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:20 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:20.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:20 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:59:20.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:20 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:59:20.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:20 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:20.438 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:20 smithi099 ceph-mon[35300]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:59:20.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:20 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:20.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:20 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:20.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:20 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:59:20.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:20 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:59:20.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:20 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:20.457 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:20 smithi117 ceph-mon[35050]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:59:20.457 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:20 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:20.457 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:20 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:20.457 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:20 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:59:20.457 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:20 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:59:20.457 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:20 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:21.107 INFO:teuthology.orchestra.run.smithi117.stdout:Created osd(s) 2 on host 'smithi117' 2024-09-19T05:59:21.108 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:59:21.105+0000 7f3b73fff640 1 -- 172.21.15.117:0/2666107795 <== mgr.14148 v2:172.21.15.37:6800/3797010169 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f3b8c06a680 con 0x7f3b740a31b0 2024-09-19T05:59:21.109 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:59:21.107+0000 7f3b910d0640 1 -- 172.21.15.117:0/2666107795 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f3b740a31b0 msgr2=0x7f3b740a5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:59:21.109 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:59:21.107+0000 7f3b910d0640 1 --2- 172.21.15.117:0/2666107795 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f3b740a31b0 0x7f3b740a5670 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3b80005fd0 tx=0x7f3b8000b390 comp rx=0 tx=0).stop 2024-09-19T05:59:21.109 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:59:21.107+0000 7f3b910d0640 1 -- 172.21.15.117:0/2666107795 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b8c101cd0 msgr2=0x7f3b8c1031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:59:21.110 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:59:21.107+0000 7f3b910d0640 1 --2- 172.21.15.117:0/2666107795 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b8c101cd0 0x7f3b8c1031a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c00c890 tx=0x7f3b7c00cd50 comp rx=0 tx=0).stop 2024-09-19T05:59:21.110 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:59:21.107+0000 7f3b910d0640 1 -- 172.21.15.117:0/2666107795 shutdown_connections 2024-09-19T05:59:21.110 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:59:21.107+0000 7f3b910d0640 1 --2- 172.21.15.117:0/2666107795 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f3b740a31b0 0x7f3b740a5670 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:21.110 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:59:21.107+0000 7f3b910d0640 1 --2- 172.21.15.117:0/2666107795 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3b8c102690 0x7f3b8c1036e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:21.110 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:59:21.107+0000 7f3b910d0640 1 --2- 172.21.15.117:0/2666107795 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b8c101cd0 0x7f3b8c1031a0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:21.110 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:59:21.107+0000 7f3b910d0640 1 --2- 172.21.15.117:0/2666107795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b8c100ad0 0x7f3b8c104b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:21.110 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:59:21.107+0000 7f3b910d0640 1 -- 172.21.15.117:0/2666107795 >> 172.21.15.117:0/2666107795 conn(0x7f3b8c0fc280 msgr2=0x7f3b8c069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:59:21.110 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:59:21.108+0000 7f3b910d0640 1 -- 172.21.15.117:0/2666107795 shutdown_connections 2024-09-19T05:59:21.110 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T05:59:21.108+0000 7f3b910d0640 1 -- 172.21.15.117:0/2666107795 wait complete. 2024-09-19T05:59:21.752 DEBUG:teuthology.orchestra.run.smithi117:osd.2> sudo journalctl -f -n 0 -u ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@osd.2.service 2024-09-19T05:59:21.754 INFO:tasks.cephadm:Deploying osd.3 on smithi037 with /dev/vg_nvme/lv_3... 2024-09-19T05:59:21.754 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T05:59:22.008 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:59:22.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:22 smithi117 ceph-mon[35050]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:59:22.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:22 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:59:22.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:22 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:22.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:22 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:22.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:22 smithi037 ceph-mon[31211]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:59:22.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:22 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:59:22.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:22 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:22.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:22 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:22.438 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:22 smithi099 ceph-mon[35300]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:59:22.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:22 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:59:22.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:22 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:22.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:22 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:23.129 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:23 smithi117 ceph-mon[35050]: from='osd.2 [v2:172.21.15.117:6800/3794943081,v1:172.21.15.117:6801/3794943081]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T05:59:23.129 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:23 smithi117 ceph-mon[35050]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T05:59:23.129 INFO:journalctl@ceph.osd.2.smithi117.stdout:Sep 19 05:59:22 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-2[40027]: 2024-09-19T05:59:22.838+0000 7fe02c67f640 -1 osd.2 0 log_to_monitors true 2024-09-19T05:59:23.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:23 smithi037 ceph-mon[31211]: from='osd.2 [v2:172.21.15.117:6800/3794943081,v1:172.21.15.117:6801/3794943081]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T05:59:23.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:23 smithi037 ceph-mon[31211]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T05:59:23.438 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:23 smithi099 ceph-mon[35300]: from='osd.2 [v2:172.21.15.117:6800/3794943081,v1:172.21.15.117:6801/3794943081]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T05:59:23.438 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:23 smithi099 ceph-mon[35300]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T05:59:24.160 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:24 smithi037 ceph-mon[31211]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:59:24.160 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:24 smithi037 ceph-mon[31211]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T05:59:24.160 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:24 smithi037 ceph-mon[31211]: from='osd.2 [v2:172.21.15.117:6800/3794943081,v1:172.21.15.117:6801/3794943081]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-19T05:59:24.160 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:24 smithi037 ceph-mon[31211]: osdmap e16: 3 total, 2 up, 3 in 2024-09-19T05:59:24.160 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:24 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T05:59:24.160 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:24 smithi037 ceph-mon[31211]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-19T05:59:24.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:24 smithi099 ceph-mon[35300]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:59:24.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:24 smithi099 ceph-mon[35300]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T05:59:24.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:24 smithi099 ceph-mon[35300]: from='osd.2 [v2:172.21.15.117:6800/3794943081,v1:172.21.15.117:6801/3794943081]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-19T05:59:24.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:24 smithi099 ceph-mon[35300]: osdmap e16: 3 total, 2 up, 3 in 2024-09-19T05:59:24.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:24 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T05:59:24.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:24 smithi099 ceph-mon[35300]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-19T05:59:24.442 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T05:59:24.470 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi037:vg_nvme/lv_3 2024-09-19T05:59:24.500 INFO:journalctl@ceph.osd.2.smithi117.stdout:Sep 19 05:59:24 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-2[40027]: 2024-09-19T05:59:24.063+0000 7fe028602640 -1 osd.2 0 waiting for initial osdmap 2024-09-19T05:59:24.500 INFO:journalctl@ceph.osd.2.smithi117.stdout:Sep 19 05:59:24 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-2[40027]: 2024-09-19T05:59:24.067+0000 7fe02442a640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T05:59:24.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:24 smithi117 ceph-mon[35050]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:59:24.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:24 smithi117 ceph-mon[35050]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T05:59:24.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:24 smithi117 ceph-mon[35050]: from='osd.2 [v2:172.21.15.117:6800/3794943081,v1:172.21.15.117:6801/3794943081]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-19T05:59:24.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:24 smithi117 ceph-mon[35050]: osdmap e16: 3 total, 2 up, 3 in 2024-09-19T05:59:24.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:24 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T05:59:24.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:24 smithi117 ceph-mon[35050]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-19T05:59:24.739 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:59:25.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:59:25.210+0000 7f57f785b640 1 -- 172.21.15.37:0/1080031138 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57f0102e10 msgr2=0x7f57f0103290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:59:25.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:59:25.210+0000 7f57f785b640 1 --2- 172.21.15.37:0/1080031138 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57f0102e10 0x7f57f0103290 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f57e0009900 tx=0x7f57e002a410 comp rx=0 tx=0).stop 2024-09-19T05:59:25.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:59:25.211+0000 7f57f785b640 1 -- 172.21.15.37:0/1080031138 shutdown_connections 2024-09-19T05:59:25.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:59:25.211+0000 7f57f785b640 1 --2- 172.21.15.37:0/1080031138 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f57f01037d0 0x7f57f010a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:25.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:59:25.211+0000 7f57f785b640 1 --2- 172.21.15.37:0/1080031138 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57f0102e10 0x7f57f0103290 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:25.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:59:25.211+0000 7f57f785b640 1 --2- 172.21.15.37:0/1080031138 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57f0101c10 0x7f57f0102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:25.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:59:25.211+0000 7f57f785b640 1 -- 172.21.15.37:0/1080031138 >> 172.21.15.37:0/1080031138 conn(0x7f57f00fd3c0 msgr2=0x7f57f00ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:59:25.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:59:25.211+0000 7f57f785b640 1 -- 172.21.15.37:0/1080031138 shutdown_connections 2024-09-19T05:59:25.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:59:25.211+0000 7f57f785b640 1 -- 172.21.15.37:0/1080031138 wait complete. 2024-09-19T05:59:25.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:59:25.211+0000 7f57f785b640 1 Processor -- start 2024-09-19T05:59:25.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:59:25.211+0000 7f57f785b640 1 -- start start 2024-09-19T05:59:25.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:59:25.212+0000 7f57f785b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f57f0101c10 0x7f57f0197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:59:25.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:59:25.212+0000 7f57f785b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57f0102e10 0x7f57f01983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:59:25.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:59:25.212+0000 7f57f785b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57f01037d0 0x7f57f019f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:59:25.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:59:25.212+0000 7f57f785b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f57f010d870 con 0x7f57f0102e10 2024-09-19T05:59:25.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:59:25.212+0000 7f57f785b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f57f010d6f0 con 0x7f57f0101c10 2024-09-19T05:59:25.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:59:25.212+0000 7f57f785b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f57f010d9f0 con 0x7f57f01037d0 2024-09-19T05:59:25.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:59:25.212+0000 7f57f4df6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57f0102e10 0x7f57f01983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:59:25.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:59:25.212+0000 7f57f4df6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57f0102e10 0x7f57f01983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36316/0 (socket says 172.21.15.37:36316) 2024-09-19T05:59:25.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:59:25.212+0000 7f57f4df6640 1 -- 172.21.15.37:0/496351735 learned_addr learned my addr 172.21.15.37:0/496351735 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T05:59:25.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:59:25.212+0000 7f57f5df8640 1 --2- 172.21.15.37:0/496351735 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57f01037d0 0x7f57f019f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:59:25.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:59:25.212+0000 7f57f55f7640 1 --2- 172.21.15.37:0/496351735 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f57f0101c10 0x7f57f0197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:59:25.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:59:25.212+0000 7f57f4df6640 1 -- 172.21.15.37:0/496351735 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57f01037d0 msgr2=0x7f57f019f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:59:25.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:59:25.212+0000 7f57f4df6640 1 --2- 172.21.15.37:0/496351735 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57f01037d0 0x7f57f019f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:25.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:59:25.212+0000 7f57f4df6640 1 -- 172.21.15.37:0/496351735 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f57f0101c10 msgr2=0x7f57f0197eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:59:25.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:59:25.212+0000 7f57f4df6640 1 --2- 172.21.15.37:0/496351735 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f57f0101c10 0x7f57f0197eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:25.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:59:25.212+0000 7f57f4df6640 1 -- 172.21.15.37:0/496351735 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57f019fae0 con 0x7f57f0102e10 2024-09-19T05:59:25.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:59:25.212+0000 7f57f55f7640 1 --2- 172.21.15.37:0/496351735 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f57f0101c10 0x7f57f0197eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:59:25.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:59:25.212+0000 7f57f4df6640 1 --2- 172.21.15.37:0/496351735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57f0102e10 0x7f57f01983f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f57e0009230 tx=0x7f57e0004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:59:25.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:59:25.212+0000 7f57e67fc640 1 -- 172.21.15.37:0/496351735 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e003f030 con 0x7f57f0102e10 2024-09-19T05:59:25.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:59:25.213+0000 7f57e67fc640 1 -- 172.21.15.37:0/496351735 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57e0003ce0 con 0x7f57f0102e10 2024-09-19T05:59:25.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:59:25.213+0000 7f57f785b640 1 -- 172.21.15.37:0/496351735 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57f019fd70 con 0x7f57f0102e10 2024-09-19T05:59:25.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:59:25.213+0000 7f57e67fc640 1 -- 172.21.15.37:0/496351735 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e0035070 con 0x7f57f0102e10 2024-09-19T05:59:25.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:59:25.213+0000 7f57f785b640 1 -- 172.21.15.37:0/496351735 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57f01a0240 con 0x7f57f0102e10 2024-09-19T05:59:25.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:59:25.214+0000 7f57f785b640 1 -- 172.21.15.37:0/496351735 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57f0108fb0 con 0x7f57f0102e10 2024-09-19T05:59:25.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:59:25.215+0000 7f57e67fc640 1 -- 172.21.15.37:0/496351735 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7f57e0042030 con 0x7f57f0102e10 2024-09-19T05:59:25.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:59:25.216+0000 7f57e67fc640 1 --2- 172.21.15.37:0/496351735 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f57dc0a3260 0x7f57dc0a5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:59:25.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:59:25.216+0000 7f57e67fc640 1 -- 172.21.15.37:0/496351735 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2851+0+0 (secure 0 0 0) 0x7f57e00eec50 con 0x7f57f0102e10 2024-09-19T05:59:25.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:59:25.216+0000 7f57f55f7640 1 --2- 172.21.15.37:0/496351735 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f57dc0a3260 0x7f57dc0a5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:59:25.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:59:25.216+0000 7f57f55f7640 1 --2- 172.21.15.37:0/496351735 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f57dc0a3260 0x7f57dc0a5720 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f57ec005d00 tx=0x7f57ec005c90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:59:25.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:59:25.219+0000 7f57e67fc640 1 -- 172.21.15.37:0/496351735 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f57e00bcfa0 con 0x7f57f0102e10 2024-09-19T05:59:25.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:25 smithi117 ceph-mon[35050]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]': finished 2024-09-19T05:59:25.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:25 smithi117 ceph-mon[35050]: osdmap e17: 3 total, 2 up, 3 in 2024-09-19T05:59:25.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:25 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T05:59:25.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:25 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T05:59:25.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:25 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:25.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:25 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:25.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:25 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:59:25.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:25 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:25.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:25 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:59:25.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:25 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:59:25.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:25 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:25.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:25 smithi037 ceph-mon[31211]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]': finished 2024-09-19T05:59:25.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:25 smithi037 ceph-mon[31211]: osdmap e17: 3 total, 2 up, 3 in 2024-09-19T05:59:25.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:25 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T05:59:25.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:25 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T05:59:25.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:25 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:25.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:25 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:25.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:25 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:59:25.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:25 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:25.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:25 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:59:25.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:25 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:59:25.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:25 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:25.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:59:25.409+0000 7f57f785b640 1 -- 172.21.15.37:0/496351735 --> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f57f0062630 con 0x7f57dc0a3260 2024-09-19T05:59:25.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:25 smithi099 ceph-mon[35300]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]': finished 2024-09-19T05:59:25.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:25 smithi099 ceph-mon[35300]: osdmap e17: 3 total, 2 up, 3 in 2024-09-19T05:59:25.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:25 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T05:59:25.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:25 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T05:59:25.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:25 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:25.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:25 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:25.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:25 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:59:25.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:25 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:25.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:25 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:59:25.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:25 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:59:25.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:25 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:26.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:26 smithi037 ceph-mon[31211]: purged_snaps scrub starts 2024-09-19T05:59:26.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:26 smithi037 ceph-mon[31211]: purged_snaps scrub ok 2024-09-19T05:59:26.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:26 smithi037 ceph-mon[31211]: Detected new or changed devices on smithi117 2024-09-19T05:59:26.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:26 smithi037 ceph-mon[31211]: Adjusting osd_memory_target on smithi117 to 17088M 2024-09-19T05:59:26.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:26 smithi037 ceph-mon[31211]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:59:26.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:26 smithi037 ceph-mon[31211]: osd.2 [v2:172.21.15.117:6800/3794943081,v1:172.21.15.117:6801/3794943081] boot 2024-09-19T05:59:26.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:26 smithi037 ceph-mon[31211]: osdmap e18: 3 total, 3 up, 3 in 2024-09-19T05:59:26.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:26 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T05:59:26.325 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:26 smithi037 ceph-mon[31211]: from='client.14277 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:59:26.325 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:26 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:59:26.325 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:26 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:59:26.325 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:26 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:59:26.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:26 smithi099 ceph-mon[35300]: purged_snaps scrub starts 2024-09-19T05:59:26.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:26 smithi099 ceph-mon[35300]: purged_snaps scrub ok 2024-09-19T05:59:26.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:26 smithi099 ceph-mon[35300]: Detected new or changed devices on smithi117 2024-09-19T05:59:26.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:26 smithi099 ceph-mon[35300]: Adjusting osd_memory_target on smithi117 to 17088M 2024-09-19T05:59:26.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:26 smithi099 ceph-mon[35300]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:59:26.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:26 smithi099 ceph-mon[35300]: osd.2 [v2:172.21.15.117:6800/3794943081,v1:172.21.15.117:6801/3794943081] boot 2024-09-19T05:59:26.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:26 smithi099 ceph-mon[35300]: osdmap e18: 3 total, 3 up, 3 in 2024-09-19T05:59:26.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:26 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T05:59:26.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:26 smithi099 ceph-mon[35300]: from='client.14277 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:59:26.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:26 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:59:26.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:26 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:59:26.440 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:26 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:59:26.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:26 smithi117 ceph-mon[35050]: purged_snaps scrub starts 2024-09-19T05:59:26.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:26 smithi117 ceph-mon[35050]: purged_snaps scrub ok 2024-09-19T05:59:26.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:26 smithi117 ceph-mon[35050]: Detected new or changed devices on smithi117 2024-09-19T05:59:26.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:26 smithi117 ceph-mon[35050]: Adjusting osd_memory_target on smithi117 to 17088M 2024-09-19T05:59:26.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:26 smithi117 ceph-mon[35050]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:59:26.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:26 smithi117 ceph-mon[35050]: osd.2 [v2:172.21.15.117:6800/3794943081,v1:172.21.15.117:6801/3794943081] boot 2024-09-19T05:59:26.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:26 smithi117 ceph-mon[35050]: osdmap e18: 3 total, 3 up, 3 in 2024-09-19T05:59:26.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:26 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T05:59:26.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:26 smithi117 ceph-mon[35050]: from='client.14277 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:59:26.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:26 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:59:26.501 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:26 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:59:26.501 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:26 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:59:27.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:27 smithi037 ceph-mon[31211]: osdmap e19: 3 total, 3 up, 3 in 2024-09-19T05:59:27.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:27 smithi037 ceph-mon[31211]: pgmap v76: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:59:27.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:27 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T05:59:27.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:27 smithi099 ceph-mon[35300]: osdmap e19: 3 total, 3 up, 3 in 2024-09-19T05:59:27.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:27 smithi099 ceph-mon[35300]: pgmap v76: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:59:27.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:27 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T05:59:28.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:27 smithi117 ceph-mon[35050]: osdmap e19: 3 total, 3 up, 3 in 2024-09-19T05:59:28.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:27 smithi117 ceph-mon[35050]: pgmap v76: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:59:28.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:27 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T05:59:28.589 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 19 05:59:28 smithi037 sudo[47358]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T05:59:28.589 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 19 05:59:28 smithi037 sudo[47358]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T05:59:28.589 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 19 05:59:28 smithi037 sudo[47358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T05:59:28.589 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 19 05:59:28 smithi037 sudo[47358]: pam_unix(sudo:session): session closed for user root 2024-09-19T05:59:28.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:28 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T05:59:28.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:28 smithi099 ceph-mon[35300]: osdmap e20: 3 total, 3 up, 3 in 2024-09-19T05:59:28.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:28 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T05:59:28.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:28 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/26709736' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3f784ef7-0cc1-4c86-a03a-b8f13396c835"}]: dispatch 2024-09-19T05:59:28.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:28 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T05:59:28.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:28 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/26709736' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3f784ef7-0cc1-4c86-a03a-b8f13396c835"}]': finished 2024-09-19T05:59:28.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:28 smithi099 ceph-mon[35300]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T05:59:28.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:28 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T05:59:28.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:28 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/3591876387' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:59:29.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:28 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T05:59:29.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:28 smithi117 ceph-mon[35050]: osdmap e20: 3 total, 3 up, 3 in 2024-09-19T05:59:29.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:28 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T05:59:29.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:28 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/26709736' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3f784ef7-0cc1-4c86-a03a-b8f13396c835"}]: dispatch 2024-09-19T05:59:29.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:28 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T05:59:29.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:28 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/26709736' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3f784ef7-0cc1-4c86-a03a-b8f13396c835"}]': finished 2024-09-19T05:59:29.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:28 smithi117 ceph-mon[35050]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T05:59:29.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:28 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T05:59:29.001 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:28 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/3591876387' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:59:29.074 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 19 05:59:28 smithi037 sudo[47407]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T05:59:29.074 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 19 05:59:28 smithi037 sudo[47407]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T05:59:29.074 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 19 05:59:28 smithi037 sudo[47407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T05:59:29.074 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 19 05:59:28 smithi037 sudo[47407]: pam_unix(sudo:session): session closed for user root 2024-09-19T05:59:29.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:28 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T05:59:29.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:28 smithi037 ceph-mon[31211]: osdmap e20: 3 total, 3 up, 3 in 2024-09-19T05:59:29.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:28 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T05:59:29.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:28 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/26709736' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3f784ef7-0cc1-4c86-a03a-b8f13396c835"}]: dispatch 2024-09-19T05:59:29.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:28 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T05:59:29.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:28 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/26709736' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3f784ef7-0cc1-4c86-a03a-b8f13396c835"}]': finished 2024-09-19T05:59:29.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:28 smithi037 ceph-mon[31211]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T05:59:29.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:28 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T05:59:29.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:28 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/3591876387' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:59:29.315 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 05:59:29 smithi099 sudo[43740]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T05:59:29.315 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 05:59:29 smithi099 sudo[43740]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T05:59:29.315 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 05:59:29 smithi099 sudo[43740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T05:59:29.315 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 05:59:29 smithi099 sudo[43740]: pam_unix(sudo:session): session closed for user root 2024-09-19T05:59:29.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:59:29.597+0000 7f57e67fc640 1 -- 172.21.15.37:0/496351735 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f57e00b8f10 con 0x7f57f0102e10 2024-09-19T05:59:29.689 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 05:59:29 smithi099 sudo[43743]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T05:59:29.689 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 05:59:29 smithi099 sudo[43743]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T05:59:29.689 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 05:59:29 smithi099 sudo[43743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T05:59:29.689 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 05:59:29 smithi099 sudo[43743]: pam_unix(sudo:session): session closed for user root 2024-09-19T05:59:29.841 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:29 smithi117 ceph-mon[35050]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:59:29.841 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:29 smithi117 ceph-mon[35050]: osdmap e22: 4 total, 3 up, 4 in 2024-09-19T05:59:29.841 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:29 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T05:59:29.842 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:29 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:29.842 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:29 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:29.842 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:29 smithi117 ceph-mon[35050]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T05:59:29.842 INFO:journalctl@ceph.osd.2.smithi117.stdout:Sep 19 05:59:29 smithi117 sudo[43655]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T05:59:29.842 INFO:journalctl@ceph.osd.2.smithi117.stdout:Sep 19 05:59:29 smithi117 sudo[43655]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T05:59:29.842 INFO:journalctl@ceph.osd.2.smithi117.stdout:Sep 19 05:59:29 smithi117 sudo[43655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T05:59:29.842 INFO:journalctl@ceph.osd.2.smithi117.stdout:Sep 19 05:59:29 smithi117 sudo[43655]: pam_unix(sudo:session): session closed for user root 2024-09-19T05:59:30.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:29 smithi037 ceph-mon[31211]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:59:30.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:29 smithi037 ceph-mon[31211]: osdmap e22: 4 total, 3 up, 4 in 2024-09-19T05:59:30.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:29 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T05:59:30.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:29 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:30.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:29 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:30.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:29 smithi037 ceph-mon[31211]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T05:59:30.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:29 smithi099 ceph-mon[35300]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:59:30.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:29 smithi099 ceph-mon[35300]: osdmap e22: 4 total, 3 up, 4 in 2024-09-19T05:59:30.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:29 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T05:59:30.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:29 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:30.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:29 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:30.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:29 smithi099 ceph-mon[35300]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T05:59:30.250 INFO:journalctl@ceph.osd.2.smithi117.stdout:Sep 19 05:59:29 smithi117 sudo[43658]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T05:59:30.250 INFO:journalctl@ceph.osd.2.smithi117.stdout:Sep 19 05:59:29 smithi117 sudo[43658]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T05:59:30.250 INFO:journalctl@ceph.osd.2.smithi117.stdout:Sep 19 05:59:29 smithi117 sudo[43658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T05:59:30.250 INFO:journalctl@ceph.osd.2.smithi117.stdout:Sep 19 05:59:29 smithi117 sudo[43658]: pam_unix(sudo:session): session closed for user root 2024-09-19T05:59:30.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:30 smithi037 sudo[47782]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T05:59:30.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:30 smithi037 sudo[47782]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T05:59:30.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:30 smithi037 sudo[47782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T05:59:30.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:30 smithi037 sudo[47782]: pam_unix(sudo:session): session closed for user root 2024-09-19T05:59:31.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:30 smithi037 sudo[47787]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T05:59:31.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:30 smithi037 sudo[47787]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T05:59:31.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:30 smithi037 sudo[47787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T05:59:31.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:30 smithi037 sudo[47787]: pam_unix(sudo:session): session closed for user root 2024-09-19T05:59:31.255 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:31 smithi117 sudo[43661]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T05:59:31.255 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:31 smithi117 sudo[43661]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T05:59:31.255 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:31 smithi117 sudo[43661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T05:59:31.255 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:31 smithi117 sudo[43661]: pam_unix(sudo:session): session closed for user root 2024-09-19T05:59:31.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:31 smithi117 sudo[43664]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T05:59:31.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:31 smithi117 sudo[43664]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T05:59:31.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:31 smithi117 sudo[43664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T05:59:31.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:31 smithi117 sudo[43664]: pam_unix(sudo:session): session closed for user root 2024-09-19T05:59:31.751 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:31 smithi099 sudo[43746]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T05:59:31.751 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:31 smithi099 sudo[43746]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T05:59:31.751 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:31 smithi099 sudo[43746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T05:59:31.751 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:31 smithi099 sudo[43746]: pam_unix(sudo:session): session closed for user root 2024-09-19T05:59:32.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:31 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:32.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:31 smithi037 ceph-mon[31211]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T05:59:32.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:31 smithi037 ceph-mon[31211]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T05:59:32.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:31 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T05:59:32.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:31 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:59:32.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:31 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:59:32.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:31 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T05:59:32.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:31 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:59:32.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:31 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:59:32.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:31 smithi099 sudo[43749]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T05:59:32.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:31 smithi099 sudo[43749]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T05:59:32.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:31 smithi099 sudo[43749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T05:59:32.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:31 smithi099 sudo[43749]: pam_unix(sudo:session): session closed for user root 2024-09-19T05:59:32.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:31 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:32.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:31 smithi099 ceph-mon[35300]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T05:59:32.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:31 smithi099 ceph-mon[35300]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T05:59:32.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:31 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T05:59:32.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:31 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:59:32.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:31 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:59:32.190 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:31 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T05:59:32.190 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:31 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:59:32.190 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:31 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:59:32.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:31 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:32.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:31 smithi117 ceph-mon[35050]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T05:59:32.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:31 smithi117 ceph-mon[35050]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T05:59:32.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:31 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T05:59:32.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:31 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:59:32.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:31 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:59:32.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:31 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T05:59:32.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:31 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:59:32.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:31 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:59:32.994 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:32 smithi037 ceph-mon[31211]: pgmap v81: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:59:32.994 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:32 smithi037 ceph-mon[31211]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T05:59:32.994 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:32 smithi037 ceph-mon[31211]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T05:59:32.994 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:32 smithi037 ceph-mon[31211]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T05:59:32.994 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:32 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T05:59:32.994 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:32 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:59:32.994 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:32 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:59:32.995 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:32 smithi037 ceph-mon[31211]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T05:59:33.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:32 smithi099 ceph-mon[35300]: pgmap v81: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:59:33.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:32 smithi099 ceph-mon[35300]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T05:59:33.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:32 smithi099 ceph-mon[35300]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T05:59:33.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:32 smithi099 ceph-mon[35300]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T05:59:33.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:32 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T05:59:33.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:32 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:59:33.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:32 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:59:33.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:32 smithi099 ceph-mon[35300]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T05:59:33.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:32 smithi117 ceph-mon[35050]: pgmap v81: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:59:33.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:32 smithi117 ceph-mon[35050]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T05:59:33.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:32 smithi117 ceph-mon[35050]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T05:59:33.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:32 smithi117 ceph-mon[35050]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T05:59:33.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:32 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T05:59:33.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:32 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:59:33.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:32 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:59:33.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:32 smithi117 ceph-mon[35050]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T05:59:33.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:33 smithi099 ceph-mon[35300]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:59:34.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:33 smithi037 ceph-mon[31211]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:59:34.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:33 smithi117 ceph-mon[35050]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:59:36.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:35 smithi037 ceph-mon[31211]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:59:36.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:35 smithi099 ceph-mon[35300]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:59:36.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:35 smithi117 ceph-mon[35050]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:59:37.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:36 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T05:59:37.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:36 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:59:37.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:36 smithi037 ceph-mon[31211]: Deploying daemon osd.3 on smithi037 2024-09-19T05:59:37.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:36 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T05:59:37.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:36 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:59:37.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:36 smithi099 ceph-mon[35300]: Deploying daemon osd.3 on smithi037 2024-09-19T05:59:37.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:36 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T05:59:37.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:36 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:59:37.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:36 smithi117 ceph-mon[35050]: Deploying daemon osd.3 on smithi037 2024-09-19T05:59:37.903 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:37 smithi037 ceph-mon[31211]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:59:38.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:37 smithi099 ceph-mon[35300]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:59:38.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:37 smithi117 ceph-mon[35050]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:59:40.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:39 smithi037 ceph-mon[31211]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:59:40.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:39 smithi099 ceph-mon[35300]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:59:40.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:39 smithi117 ceph-mon[35050]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:59:41.993 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:41 smithi037 ceph-mon[31211]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:59:42.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:41 smithi099 ceph-mon[35300]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:59:42.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:41 smithi117 ceph-mon[35050]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:59:44.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:43 smithi037 ceph-mon[31211]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:59:44.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:43 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:59:44.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:43 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:44.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:43 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:44.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:43 smithi099 ceph-mon[35300]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:59:44.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:43 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:59:44.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:43 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:44.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:43 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:44.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:43 smithi117 ceph-mon[35050]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:59:44.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:43 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:59:44.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:43 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:44.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:43 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:46.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:45 smithi037 ceph-mon[31211]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:59:46.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:45 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:46.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:45 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:46.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:45 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:59:46.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:45 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:59:46.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:45 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:46.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:45 smithi099 ceph-mon[35300]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:59:46.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:45 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:46.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:45 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:46.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:45 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:59:46.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:45 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:59:46.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:45 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:46.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:45 smithi117 ceph-mon[35050]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:59:46.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:45 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:46.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:45 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:46.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:45 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:59:46.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:45 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:59:46.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:45 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:46.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:59:46.980+0000 7f57e67fc640 1 -- 172.21.15.37:0/496351735 <== mgr.14148 v2:172.21.15.37:6800/3797010169 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f57f0062630 con 0x7f57dc0a3260 2024-09-19T05:59:46.981 INFO:teuthology.orchestra.run.smithi037.stdout:Created osd(s) 3 on host 'smithi037' 2024-09-19T05:59:46.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:59:46.983+0000 7f57f785b640 1 -- 172.21.15.37:0/496351735 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f57dc0a3260 msgr2=0x7f57dc0a5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:59:46.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:59:46.983+0000 7f57f785b640 1 --2- 172.21.15.37:0/496351735 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f57dc0a3260 0x7f57dc0a5720 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f57ec005d00 tx=0x7f57ec005c90 comp rx=0 tx=0).stop 2024-09-19T05:59:46.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:59:46.983+0000 7f57f785b640 1 -- 172.21.15.37:0/496351735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57f0102e10 msgr2=0x7f57f01983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:59:46.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:59:46.983+0000 7f57f785b640 1 --2- 172.21.15.37:0/496351735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57f0102e10 0x7f57f01983f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f57e0009230 tx=0x7f57e0004360 comp rx=0 tx=0).stop 2024-09-19T05:59:46.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:59:46.983+0000 7f57f785b640 1 -- 172.21.15.37:0/496351735 shutdown_connections 2024-09-19T05:59:46.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:59:46.983+0000 7f57f785b640 1 --2- 172.21.15.37:0/496351735 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f57dc0a3260 0x7f57dc0a5720 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:46.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:59:46.983+0000 7f57f785b640 1 --2- 172.21.15.37:0/496351735 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57f01037d0 0x7f57f019f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:46.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:59:46.983+0000 7f57f785b640 1 --2- 172.21.15.37:0/496351735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57f0102e10 0x7f57f01983f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:46.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:59:46.983+0000 7f57f785b640 1 --2- 172.21.15.37:0/496351735 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f57f0101c10 0x7f57f0197eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:46.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:59:46.983+0000 7f57f785b640 1 -- 172.21.15.37:0/496351735 >> 172.21.15.37:0/496351735 conn(0x7f57f00fd3c0 msgr2=0x7f57f0106180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:59:46.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:59:46.983+0000 7f57f785b640 1 -- 172.21.15.37:0/496351735 shutdown_connections 2024-09-19T05:59:46.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T05:59:46.983+0000 7f57f785b640 1 -- 172.21.15.37:0/496351735 wait complete. 2024-09-19T05:59:47.599 DEBUG:teuthology.orchestra.run.smithi037:osd.3> sudo journalctl -f -n 0 -u ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@osd.3.service 2024-09-19T05:59:47.601 INFO:tasks.cephadm:Deploying osd.4 on smithi099 with /dev/vg_nvme/lv_3... 2024-09-19T05:59:47.601 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T05:59:47.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:47 smithi037 ceph-mon[31211]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:59:47.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:47 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:59:47.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:47 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:47.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:47 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:47.852 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T05:59:47.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:47 smithi099 ceph-mon[35300]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:59:47.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:47 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:59:47.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:47 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:47.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:47 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:48.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:47 smithi117 ceph-mon[35050]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:59:48.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:47 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:59:48.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:47 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:48.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:47 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:48.794 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 19 05:59:48 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-3[49369]: 2024-09-19T05:59:48.499+0000 7f6c3fe86640 -1 osd.3 0 log_to_monitors true 2024-09-19T05:59:48.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:48 smithi099 ceph-mon[35300]: from='osd.3 [v2:172.21.15.37:6810/2121011955,v1:172.21.15.37:6811/2121011955]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T05:59:49.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:48 smithi037 ceph-mon[31211]: from='osd.3 [v2:172.21.15.37:6810/2121011955,v1:172.21.15.37:6811/2121011955]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T05:59:49.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:48 smithi117 ceph-mon[35050]: from='osd.3 [v2:172.21.15.37:6810/2121011955,v1:172.21.15.37:6811/2121011955]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T05:59:49.945 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:49 smithi099 ceph-mon[35300]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:59:49.945 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:49 smithi099 ceph-mon[35300]: from='osd.3 [v2:172.21.15.37:6810/2121011955,v1:172.21.15.37:6811/2121011955]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T05:59:49.945 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:49 smithi099 ceph-mon[35300]: osdmap e23: 4 total, 3 up, 4 in 2024-09-19T05:59:49.945 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:49 smithi099 ceph-mon[35300]: from='osd.3 [v2:172.21.15.37:6810/2121011955,v1:172.21.15.37:6811/2121011955]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-09-19T05:59:49.946 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:49 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T05:59:50.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:49 smithi037 ceph-mon[31211]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:59:50.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:49 smithi037 ceph-mon[31211]: from='osd.3 [v2:172.21.15.37:6810/2121011955,v1:172.21.15.37:6811/2121011955]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T05:59:50.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:49 smithi037 ceph-mon[31211]: osdmap e23: 4 total, 3 up, 4 in 2024-09-19T05:59:50.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:49 smithi037 ceph-mon[31211]: from='osd.3 [v2:172.21.15.37:6810/2121011955,v1:172.21.15.37:6811/2121011955]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-09-19T05:59:50.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:49 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T05:59:50.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:49 smithi117 ceph-mon[35050]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:59:50.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:49 smithi117 ceph-mon[35050]: from='osd.3 [v2:172.21.15.37:6810/2121011955,v1:172.21.15.37:6811/2121011955]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T05:59:50.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:49 smithi117 ceph-mon[35050]: osdmap e23: 4 total, 3 up, 4 in 2024-09-19T05:59:50.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:49 smithi117 ceph-mon[35050]: from='osd.3 [v2:172.21.15.37:6810/2121011955,v1:172.21.15.37:6811/2121011955]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-09-19T05:59:50.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:49 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T05:59:50.664 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T05:59:50.690 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi099:vg_nvme/lv_3 2024-09-19T05:59:50.811 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 19 05:59:50 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-3[49369]: 2024-09-19T05:59:50.455+0000 7f6c3be09640 -1 osd.3 0 waiting for initial osdmap 2024-09-19T05:59:50.811 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 19 05:59:50 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-3[49369]: 2024-09-19T05:59:50.460+0000 7f6c33c29640 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T05:59:50.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:50 smithi099 ceph-mon[35300]: from='osd.3 [v2:172.21.15.37:6810/2121011955,v1:172.21.15.37:6811/2121011955]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-09-19T05:59:50.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:50 smithi099 ceph-mon[35300]: osdmap e24: 4 total, 3 up, 4 in 2024-09-19T05:59:50.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:50 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T05:59:50.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:50 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T05:59:50.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:50 smithi099 ceph-mon[35300]: from='osd.3 [v2:172.21.15.37:6810/2121011955,v1:172.21.15.37:6811/2121011955]' entity='osd.3' 2024-09-19T05:59:50.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:50 smithi099 ceph-mon[35300]: Detected new or changed devices on smithi037 2024-09-19T05:59:50.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:50 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:50.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:50 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:50.940 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:50 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:59:50.940 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:50 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:59:50.940 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:50 smithi099 ceph-mon[35300]: Adjusting osd_memory_target on smithi037 to 8546M 2024-09-19T05:59:50.940 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:50 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:50.940 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:50 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:59:50.940 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:50 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:59:50.940 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:50 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:50.940 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T05:59:51.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:50 smithi037 ceph-mon[31211]: from='osd.3 [v2:172.21.15.37:6810/2121011955,v1:172.21.15.37:6811/2121011955]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-09-19T05:59:51.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:50 smithi037 ceph-mon[31211]: osdmap e24: 4 total, 3 up, 4 in 2024-09-19T05:59:51.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:50 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T05:59:51.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:50 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T05:59:51.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:50 smithi037 ceph-mon[31211]: from='osd.3 [v2:172.21.15.37:6810/2121011955,v1:172.21.15.37:6811/2121011955]' entity='osd.3' 2024-09-19T05:59:51.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:50 smithi037 ceph-mon[31211]: Detected new or changed devices on smithi037 2024-09-19T05:59:51.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:50 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:51.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:50 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:51.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:50 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:59:51.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:50 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:59:51.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:50 smithi037 ceph-mon[31211]: Adjusting osd_memory_target on smithi037 to 8546M 2024-09-19T05:59:51.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:50 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:51.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:50 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:59:51.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:50 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:59:51.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:50 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:51.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:50 smithi117 ceph-mon[35050]: from='osd.3 [v2:172.21.15.37:6810/2121011955,v1:172.21.15.37:6811/2121011955]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-09-19T05:59:51.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:50 smithi117 ceph-mon[35050]: osdmap e24: 4 total, 3 up, 4 in 2024-09-19T05:59:51.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:50 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T05:59:51.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:50 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T05:59:51.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:50 smithi117 ceph-mon[35050]: from='osd.3 [v2:172.21.15.37:6810/2121011955,v1:172.21.15.37:6811/2121011955]' entity='osd.3' 2024-09-19T05:59:51.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:50 smithi117 ceph-mon[35050]: Detected new or changed devices on smithi037 2024-09-19T05:59:51.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:50 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:51.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:50 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:51.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:50 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:59:51.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:50 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:59:51.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:50 smithi117 ceph-mon[35050]: Adjusting osd_memory_target on smithi037 to 8546M 2024-09-19T05:59:51.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:50 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:51.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:50 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:59:51.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:50 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:59:51.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:50 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T05:59:51.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:59:51.453+0000 7f9c7dfe0640 1 -- 172.21.15.99:0/1932616328 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c78101c00 msgr2=0x7f9c78102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:59:51.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:59:51.453+0000 7f9c7dfe0640 1 --2- 172.21.15.99:0/1932616328 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c78101c00 0x7f9c78102000 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9c68009900 tx=0x7f9c6802a410 comp rx=0 tx=0).stop 2024-09-19T05:59:51.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:59:51.453+0000 7f9c7dfe0640 1 -- 172.21.15.99:0/1932616328 shutdown_connections 2024-09-19T05:59:51.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:59:51.453+0000 7f9c7dfe0640 1 --2- 172.21.15.99:0/1932616328 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c781037c0 0x7f9c7810a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:51.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:59:51.453+0000 7f9c7dfe0640 1 --2- 172.21.15.99:0/1932616328 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c78102e00 0x7f9c78103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:51.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:59:51.453+0000 7f9c7dfe0640 1 --2- 172.21.15.99:0/1932616328 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c78101c00 0x7f9c78102000 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:51.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:59:51.453+0000 7f9c7dfe0640 1 -- 172.21.15.99:0/1932616328 >> 172.21.15.99:0/1932616328 conn(0x7f9c780fd390 msgr2=0x7f9c780ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:59:51.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:59:51.453+0000 7f9c7dfe0640 1 -- 172.21.15.99:0/1932616328 shutdown_connections 2024-09-19T05:59:51.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:59:51.453+0000 7f9c7dfe0640 1 -- 172.21.15.99:0/1932616328 wait complete. 2024-09-19T05:59:51.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:59:51.454+0000 7f9c7dfe0640 1 Processor -- start 2024-09-19T05:59:51.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:59:51.454+0000 7f9c7dfe0640 1 -- start start 2024-09-19T05:59:51.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:59:51.454+0000 7f9c7dfe0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c78101c00 0x7f9c78197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:59:51.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:59:51.454+0000 7f9c7dfe0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c78102e00 0x7f9c78198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:59:51.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:59:51.454+0000 7f9c7dfe0640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c781037c0 0x7f9c7819f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:59:51.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:59:51.454+0000 7f9c7dfe0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9c7810d8b0 con 0x7f9c78101c00 2024-09-19T05:59:51.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:59:51.454+0000 7f9c7dfe0640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f9c7810d730 con 0x7f9c781037c0 2024-09-19T05:59:51.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:59:51.454+0000 7f9c7dfe0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9c7810da30 con 0x7f9c78102e00 2024-09-19T05:59:51.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:59:51.455+0000 7f9c77fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c781037c0 0x7f9c7819f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:59:51.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:59:51.455+0000 7f9c77fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c781037c0 0x7f9c7819f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35226/0 (socket says 172.21.15.99:35226) 2024-09-19T05:59:51.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:59:51.455+0000 7f9c77fff640 1 -- 172.21.15.99:0/1426337355 learned_addr learned my addr 172.21.15.99:0/1426337355 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T05:59:51.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:59:51.455+0000 7f9c777fe640 1 --2- 172.21.15.99:0/1426337355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c78101c00 0x7f9c78197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:59:51.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:59:51.455+0000 7f9c76ffd640 1 --2- 172.21.15.99:0/1426337355 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c78102e00 0x7f9c78198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:59:51.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:59:51.455+0000 7f9c77fff640 1 -- 172.21.15.99:0/1426337355 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c78102e00 msgr2=0x7f9c78198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:59:51.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:59:51.455+0000 7f9c77fff640 1 --2- 172.21.15.99:0/1426337355 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c78102e00 0x7f9c78198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:51.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:59:51.455+0000 7f9c77fff640 1 -- 172.21.15.99:0/1426337355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c78101c00 msgr2=0x7f9c78197ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:59:51.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:59:51.455+0000 7f9c77fff640 1 --2- 172.21.15.99:0/1426337355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c78101c00 0x7f9c78197ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:59:51.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:59:51.455+0000 7f9c77fff640 1 -- 172.21.15.99:0/1426337355 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c7819fb00 con 0x7f9c781037c0 2024-09-19T05:59:51.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:59:51.455+0000 7f9c76ffd640 1 --2- 172.21.15.99:0/1426337355 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c78102e00 0x7f9c78198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:59:51.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:59:51.455+0000 7f9c77fff640 1 --2- 172.21.15.99:0/1426337355 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c781037c0 0x7f9c7819f490 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9c7000cce0 tx=0x7f9c7000a620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:59:51.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:59:51.455+0000 7f9c74ff9640 1 -- 172.21.15.99:0/1426337355 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c7000f450 con 0x7f9c781037c0 2024-09-19T05:59:51.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:59:51.455+0000 7f9c7dfe0640 1 -- 172.21.15.99:0/1426337355 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c7819fdf0 con 0x7f9c781037c0 2024-09-19T05:59:51.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:59:51.455+0000 7f9c74ff9640 1 -- 172.21.15.99:0/1426337355 <== mon.2 v2:172.21.15.99:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c7000fad0 con 0x7f9c781037c0 2024-09-19T05:59:51.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:59:51.455+0000 7f9c74ff9640 1 -- 172.21.15.99:0/1426337355 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c70018c10 con 0x7f9c781037c0 2024-09-19T05:59:51.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:59:51.455+0000 7f9c7dfe0640 1 -- 172.21.15.99:0/1426337355 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c781a0250 con 0x7f9c781037c0 2024-09-19T05:59:51.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:59:51.456+0000 7f9c7dfe0640 1 -- 172.21.15.99:0/1426337355 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c78108fa0 con 0x7f9c781037c0 2024-09-19T05:59:51.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:59:51.457+0000 7f9c74ff9640 1 -- 172.21.15.99:0/1426337355 <== mon.2 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f9c7000f5f0 con 0x7f9c781037c0 2024-09-19T05:59:51.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:59:51.458+0000 7f9c74ff9640 1 --2- 172.21.15.99:0/1426337355 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f9c600a3270 0x7f9c600a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:59:51.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:59:51.458+0000 7f9c74ff9640 1 -- 172.21.15.99:0/1426337355 <== mon.2 v2:172.21.15.99:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 3702+0+0 (secure 0 0 0) 0x7f9c700cee50 con 0x7f9c781037c0 2024-09-19T05:59:51.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:59:51.458+0000 7f9c777fe640 1 --2- 172.21.15.99:0/1426337355 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f9c600a3270 0x7f9c600a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:59:51.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:59:51.459+0000 7f9c777fe640 1 --2- 172.21.15.99:0/1426337355 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f9c600a3270 0x7f9c600a5730 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9c6802aa00 tx=0x7f9c68031400 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:59:51.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:59:51.462+0000 7f9c74ff9640 1 -- 172.21.15.99:0/1426337355 <== mon.2 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9c70014030 con 0x7f9c781037c0 2024-09-19T05:59:51.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T05:59:51.636+0000 7f9c7dfe0640 1 -- 172.21.15.99:0/1426337355 --> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f9c78062630 con 0x7f9c600a3270 2024-09-19T05:59:51.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:51 smithi099 ceph-mon[35300]: purged_snaps scrub starts 2024-09-19T05:59:51.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:51 smithi099 ceph-mon[35300]: purged_snaps scrub ok 2024-09-19T05:59:51.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:51 smithi099 ceph-mon[35300]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:59:51.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:51 smithi099 ceph-mon[35300]: osd.3 [v2:172.21.15.37:6810/2121011955,v1:172.21.15.37:6811/2121011955] boot 2024-09-19T05:59:51.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:51 smithi099 ceph-mon[35300]: osdmap e25: 4 total, 4 up, 4 in 2024-09-19T05:59:51.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:51 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T05:59:51.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:51 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:59:51.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:51 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:59:51.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:51 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:59:51.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:51 smithi099 ceph-mon[35300]: osdmap e26: 4 total, 4 up, 4 in 2024-09-19T05:59:52.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:51 smithi117 ceph-mon[35050]: purged_snaps scrub starts 2024-09-19T05:59:52.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:51 smithi117 ceph-mon[35050]: purged_snaps scrub ok 2024-09-19T05:59:52.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:51 smithi117 ceph-mon[35050]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:59:52.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:51 smithi117 ceph-mon[35050]: osd.3 [v2:172.21.15.37:6810/2121011955,v1:172.21.15.37:6811/2121011955] boot 2024-09-19T05:59:52.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:51 smithi117 ceph-mon[35050]: osdmap e25: 4 total, 4 up, 4 in 2024-09-19T05:59:52.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:51 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T05:59:52.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:51 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:59:52.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:51 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:59:52.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:51 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:59:52.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:51 smithi117 ceph-mon[35050]: osdmap e26: 4 total, 4 up, 4 in 2024-09-19T05:59:52.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:51 smithi037 ceph-mon[31211]: purged_snaps scrub starts 2024-09-19T05:59:52.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:51 smithi037 ceph-mon[31211]: purged_snaps scrub ok 2024-09-19T05:59:52.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:51 smithi037 ceph-mon[31211]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:59:52.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:51 smithi037 ceph-mon[31211]: osd.3 [v2:172.21.15.37:6810/2121011955,v1:172.21.15.37:6811/2121011955] boot 2024-09-19T05:59:52.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:51 smithi037 ceph-mon[31211]: osdmap e25: 4 total, 4 up, 4 in 2024-09-19T05:59:52.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:51 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T05:59:52.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:51 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:59:52.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:51 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:59:52.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:51 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:59:52.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:51 smithi037 ceph-mon[31211]: osdmap e26: 4 total, 4 up, 4 in 2024-09-19T05:59:52.896 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:52 smithi099 ceph-mon[35300]: from='client.24221 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:59:53.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:52 smithi037 ceph-mon[31211]: from='client.24221 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:59:53.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:52 smithi117 ceph-mon[35050]: from='client.24221 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:59:54.152 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:53 smithi099 ceph-mon[35300]: pgmap v96: 1 pgs: 1 remapped+peering; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-19T05:59:54.152 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:53 smithi099 ceph-mon[35300]: osdmap e27: 4 total, 4 up, 4 in 2024-09-19T05:59:54.217 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:53 smithi117 ceph-mon[35050]: pgmap v96: 1 pgs: 1 remapped+peering; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-19T05:59:54.217 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:53 smithi117 ceph-mon[35050]: osdmap e27: 4 total, 4 up, 4 in 2024-09-19T05:59:54.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:53 smithi037 ceph-mon[31211]: pgmap v96: 1 pgs: 1 remapped+peering; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-19T05:59:54.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:53 smithi037 ceph-mon[31211]: osdmap e27: 4 total, 4 up, 4 in 2024-09-19T05:59:55.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:54 smithi099 ceph-mon[35300]: osdmap e28: 4 total, 4 up, 4 in 2024-09-19T05:59:55.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:54 smithi099 ceph-mon[35300]: from='client.? 172.21.15.99:0/1172986229' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d7c16e7f-f599-419b-b4a2-fd6c1cafa0d8"}]: dispatch 2024-09-19T05:59:55.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:54 smithi099 ceph-mon[35300]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d7c16e7f-f599-419b-b4a2-fd6c1cafa0d8"}]: dispatch 2024-09-19T05:59:55.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:54 smithi099 ceph-mon[35300]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d7c16e7f-f599-419b-b4a2-fd6c1cafa0d8"}]': finished 2024-09-19T05:59:55.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:54 smithi099 ceph-mon[35300]: osdmap e29: 5 total, 4 up, 5 in 2024-09-19T05:59:55.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:54 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T05:59:55.190 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:54 smithi099 ceph-mon[35300]: from='client.? 172.21.15.99:0/3377005219' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:59:55.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:54 smithi117 ceph-mon[35050]: osdmap e28: 4 total, 4 up, 4 in 2024-09-19T05:59:55.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:54 smithi117 ceph-mon[35050]: from='client.? 172.21.15.99:0/1172986229' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d7c16e7f-f599-419b-b4a2-fd6c1cafa0d8"}]: dispatch 2024-09-19T05:59:55.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:54 smithi117 ceph-mon[35050]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d7c16e7f-f599-419b-b4a2-fd6c1cafa0d8"}]: dispatch 2024-09-19T05:59:55.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:54 smithi117 ceph-mon[35050]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d7c16e7f-f599-419b-b4a2-fd6c1cafa0d8"}]': finished 2024-09-19T05:59:55.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:54 smithi117 ceph-mon[35050]: osdmap e29: 5 total, 4 up, 5 in 2024-09-19T05:59:55.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:54 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T05:59:55.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:54 smithi117 ceph-mon[35050]: from='client.? 172.21.15.99:0/3377005219' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:59:55.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:54 smithi037 ceph-mon[31211]: osdmap e28: 4 total, 4 up, 4 in 2024-09-19T05:59:55.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:54 smithi037 ceph-mon[31211]: from='client.? 172.21.15.99:0/1172986229' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d7c16e7f-f599-419b-b4a2-fd6c1cafa0d8"}]: dispatch 2024-09-19T05:59:55.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:54 smithi037 ceph-mon[31211]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d7c16e7f-f599-419b-b4a2-fd6c1cafa0d8"}]: dispatch 2024-09-19T05:59:55.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:54 smithi037 ceph-mon[31211]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d7c16e7f-f599-419b-b4a2-fd6c1cafa0d8"}]': finished 2024-09-19T05:59:55.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:54 smithi037 ceph-mon[31211]: osdmap e29: 5 total, 4 up, 5 in 2024-09-19T05:59:55.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:54 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T05:59:55.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:54 smithi037 ceph-mon[31211]: from='client.? 172.21.15.99:0/3377005219' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:59:56.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:55 smithi099 ceph-mon[35300]: pgmap v100: 1 pgs: 1 remapped+peering; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-19T05:59:56.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:55 smithi117 ceph-mon[35050]: pgmap v100: 1 pgs: 1 remapped+peering; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-19T05:59:56.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:55 smithi037 ceph-mon[31211]: pgmap v100: 1 pgs: 1 remapped+peering; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-19T05:59:58.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:57 smithi099 ceph-mon[35300]: pgmap v101: 1 pgs: 1 remapped+peering; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-19T05:59:58.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:57 smithi117 ceph-mon[35050]: pgmap v101: 1 pgs: 1 remapped+peering; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-19T05:59:58.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:57 smithi037 ceph-mon[31211]: pgmap v101: 1 pgs: 1 remapped+peering; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:00:00.141 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 05:59:59 smithi099 ceph-mon[35300]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T06:00:00.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 05:59:59 smithi117 ceph-mon[35050]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T06:00:00.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 05:59:59 smithi037 ceph-mon[31211]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T06:00:01.057 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:00 smithi099 ceph-mon[35300]: overall HEALTH_OK 2024-09-19T06:00:01.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:00 smithi117 ceph-mon[35050]: overall HEALTH_OK 2024-09-19T06:00:01.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:00 smithi037 ceph-mon[31211]: overall HEALTH_OK 2024-09-19T06:00:02.011 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:01 smithi099 ceph-mon[35300]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-19T06:00:02.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:01 smithi117 ceph-mon[35050]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-19T06:00:02.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:01 smithi037 ceph-mon[31211]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-19T06:00:03.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:02 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T06:00:03.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:02 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:00:03.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:02 smithi099 ceph-mon[35300]: Deploying daemon osd.4 on smithi099 2024-09-19T06:00:03.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:02 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T06:00:03.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:02 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:00:03.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:02 smithi117 ceph-mon[35050]: Deploying daemon osd.4 on smithi099 2024-09-19T06:00:03.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:02 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T06:00:03.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:02 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:00:03.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:02 smithi037 ceph-mon[31211]: Deploying daemon osd.4 on smithi099 2024-09-19T06:00:03.977 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:03 smithi099 ceph-mon[35300]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-19T06:00:04.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:03 smithi117 ceph-mon[35050]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-19T06:00:04.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:03 smithi037 ceph-mon[31211]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-19T06:00:06.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:05 smithi099 ceph-mon[35300]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-19T06:00:06.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:05 smithi117 ceph-mon[35050]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-19T06:00:06.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:05 smithi037 ceph-mon[31211]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-19T06:00:08.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:07 smithi099 ceph-mon[35300]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T06:00:08.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:07 smithi117 ceph-mon[35050]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T06:00:08.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:07 smithi037 ceph-mon[31211]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T06:00:09.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:08 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:00:09.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:08 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:00:09.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:08 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:00:09.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:08 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:00:09.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:08 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:00:09.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:08 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:00:09.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:08 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:00:09.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:08 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:00:09.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:08 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:00:10.180 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:10 smithi099 ceph-mon[35300]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T06:00:10.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:10 smithi117 ceph-mon[35050]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T06:00:10.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:10 smithi037 ceph-mon[31211]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T06:00:11.246 INFO:teuthology.orchestra.run.smithi099.stdout:Created osd(s) 4 on host 'smithi099' 2024-09-19T06:00:11.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:00:11.243+0000 7f9c74ff9640 1 -- 172.21.15.99:0/1426337355 <== mgr.14148 v2:172.21.15.37:6800/3797010169 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9c78062630 con 0x7f9c600a3270 2024-09-19T06:00:11.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:00:11.245+0000 7f9c7dfe0640 1 -- 172.21.15.99:0/1426337355 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f9c600a3270 msgr2=0x7f9c600a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:00:11.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:00:11.245+0000 7f9c7dfe0640 1 --2- 172.21.15.99:0/1426337355 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f9c600a3270 0x7f9c600a5730 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9c6802aa00 tx=0x7f9c68031400 comp rx=0 tx=0).stop 2024-09-19T06:00:11.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:00:11.245+0000 7f9c7dfe0640 1 -- 172.21.15.99:0/1426337355 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c781037c0 msgr2=0x7f9c7819f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:00:11.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:00:11.245+0000 7f9c7dfe0640 1 --2- 172.21.15.99:0/1426337355 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c781037c0 0x7f9c7819f490 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9c7000cce0 tx=0x7f9c7000a620 comp rx=0 tx=0).stop 2024-09-19T06:00:11.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:00:11.245+0000 7f9c7dfe0640 1 -- 172.21.15.99:0/1426337355 shutdown_connections 2024-09-19T06:00:11.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:00:11.245+0000 7f9c7dfe0640 1 --2- 172.21.15.99:0/1426337355 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f9c600a3270 0x7f9c600a5730 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:00:11.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:00:11.245+0000 7f9c7dfe0640 1 --2- 172.21.15.99:0/1426337355 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c781037c0 0x7f9c7819f490 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:00:11.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:00:11.245+0000 7f9c7dfe0640 1 --2- 172.21.15.99:0/1426337355 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c78102e00 0x7f9c78198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:00:11.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:00:11.245+0000 7f9c7dfe0640 1 --2- 172.21.15.99:0/1426337355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c78101c00 0x7f9c78197ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:00:11.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:00:11.245+0000 7f9c7dfe0640 1 -- 172.21.15.99:0/1426337355 >> 172.21.15.99:0/1426337355 conn(0x7f9c780fd390 msgr2=0x7f9c78106170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:00:11.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:00:11.245+0000 7f9c7dfe0640 1 -- 172.21.15.99:0/1426337355 shutdown_connections 2024-09-19T06:00:11.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:00:11.245+0000 7f9c7dfe0640 1 -- 172.21.15.99:0/1426337355 wait complete. 2024-09-19T06:00:11.851 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:11 smithi099 ceph-mon[35300]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:00:11.851 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:11 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:00:11.851 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:11 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:00:11.851 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:11 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:00:11.852 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:11 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:00:11.852 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:11 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:00:11.852 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:11 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:00:11.852 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:11 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:00:11.852 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:11 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:00:11.879 DEBUG:teuthology.orchestra.run.smithi099:osd.4> sudo journalctl -f -n 0 -u ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@osd.4.service 2024-09-19T06:00:11.881 INFO:tasks.cephadm:Deploying osd.5 on smithi117 with /dev/vg_nvme/lv_3... 2024-09-19T06:00:11.881 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T06:00:11.909 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:11 smithi117 ceph-mon[35050]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:00:11.909 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:11 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:00:11.909 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:11 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:00:11.910 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:11 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:00:11.910 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:11 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:00:11.910 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:11 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:00:11.910 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:11 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:00:11.910 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:11 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:00:11.910 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:11 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:00:12.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:11 smithi037 ceph-mon[31211]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:00:12.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:11 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:00:12.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:11 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:00:12.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:11 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:00:12.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:11 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:00:12.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:11 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:00:12.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:11 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:00:12.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:11 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:00:12.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:11 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:00:12.132 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:00:13.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:13 smithi117 ceph-mon[35050]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:00:13.890 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:13 smithi037 ceph-mon[31211]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:00:13.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:13 smithi099 ceph-mon[35300]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:00:14.439 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 19 06:00:13 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-4[46526]: 2024-09-19T06:00:13.993+0000 7f7f370f0640 -1 osd.4 0 log_to_monitors true 2024-09-19T06:00:14.566 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:00:14.592 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi117:vg_nvme/lv_3 2024-09-19T06:00:14.881 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:00:14.884 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:14 smithi117 ceph-mon[35050]: from='osd.4 [v2:172.21.15.99:6808/1881025735,v1:172.21.15.99:6809/1881025735]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T06:00:14.884 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:14 smithi117 ceph-mon[35050]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T06:00:14.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:14 smithi099 ceph-mon[35300]: from='osd.4 [v2:172.21.15.99:6808/1881025735,v1:172.21.15.99:6809/1881025735]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T06:00:14.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:14 smithi099 ceph-mon[35300]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T06:00:15.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:14 smithi037 ceph-mon[31211]: from='osd.4 [v2:172.21.15.99:6808/1881025735,v1:172.21.15.99:6809/1881025735]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T06:00:15.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:14 smithi037 ceph-mon[31211]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T06:00:15.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:00:15.325+0000 7f2d2425e640 1 -- 172.21.15.117:0/538591441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d1c101c10 msgr2=0x7f2d1c102010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:00:15.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:00:15.325+0000 7f2d2425e640 1 --2- 172.21.15.117:0/538591441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d1c101c10 0x7f2d1c102010 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2d18009900 tx=0x7f2d1802a410 comp rx=0 tx=0).stop 2024-09-19T06:00:15.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:00:15.325+0000 7f2d2425e640 1 -- 172.21.15.117:0/538591441 shutdown_connections 2024-09-19T06:00:15.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:00:15.325+0000 7f2d2425e640 1 --2- 172.21.15.117:0/538591441 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2d1c1037d0 0x7f2d1c10a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:00:15.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:00:15.325+0000 7f2d2425e640 1 --2- 172.21.15.117:0/538591441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d1c102e10 0x7f2d1c103290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:00:15.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:00:15.325+0000 7f2d2425e640 1 --2- 172.21.15.117:0/538591441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d1c101c10 0x7f2d1c102010 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:00:15.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:00:15.325+0000 7f2d2425e640 1 -- 172.21.15.117:0/538591441 >> 172.21.15.117:0/538591441 conn(0x7f2d1c0fd3c0 msgr2=0x7f2d1c0ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:00:15.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:00:15.325+0000 7f2d2425e640 1 -- 172.21.15.117:0/538591441 shutdown_connections 2024-09-19T06:00:15.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:00:15.325+0000 7f2d2425e640 1 -- 172.21.15.117:0/538591441 wait complete. 2024-09-19T06:00:15.330 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:00:15.326+0000 7f2d2425e640 1 Processor -- start 2024-09-19T06:00:15.330 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:00:15.326+0000 7f2d2425e640 1 -- start start 2024-09-19T06:00:15.330 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:00:15.326+0000 7f2d2425e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2d1c101c10 0x7f2d1c197ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:00:15.330 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:00:15.326+0000 7f2d2425e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d1c102e10 0x7f2d1c198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:00:15.330 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:00:15.326+0000 7f2d2425e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d1c1037d0 0x7f2d1c19f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:00:15.330 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:00:15.326+0000 7f2d2425e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2d1c10d870 con 0x7f2d1c102e10 2024-09-19T06:00:15.330 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:00:15.326+0000 7f2d2425e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f2d1c10d6f0 con 0x7f2d1c101c10 2024-09-19T06:00:15.330 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:00:15.326+0000 7f2d2425e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2d1c10d9f0 con 0x7f2d1c1037d0 2024-09-19T06:00:15.330 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:00:15.326+0000 7f2d227fb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d1c1037d0 0x7f2d1c19f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:00:15.330 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:00:15.326+0000 7f2d227fb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d1c1037d0 0x7f2d1c19f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:40984/0 (socket says 172.21.15.117:40984) 2024-09-19T06:00:15.330 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:00:15.326+0000 7f2d217f9640 1 --2- 172.21.15.117:0/1042438052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d1c102e10 0x7f2d1c198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:00:15.330 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:00:15.326+0000 7f2d227fb640 1 -- 172.21.15.117:0/1042438052 learned_addr learned my addr 172.21.15.117:0/1042438052 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T06:00:15.330 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:00:15.326+0000 7f2d21ffa640 1 --2- 172.21.15.117:0/1042438052 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2d1c101c10 0x7f2d1c197ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:00:15.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:00:15.327+0000 7f2d217f9640 1 -- 172.21.15.117:0/1042438052 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d1c1037d0 msgr2=0x7f2d1c19f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:00:15.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:00:15.327+0000 7f2d217f9640 1 --2- 172.21.15.117:0/1042438052 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d1c1037d0 0x7f2d1c19f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:00:15.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:00:15.327+0000 7f2d217f9640 1 -- 172.21.15.117:0/1042438052 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2d1c101c10 msgr2=0x7f2d1c197ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:00:15.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:00:15.327+0000 7f2d217f9640 1 --2- 172.21.15.117:0/1042438052 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2d1c101c10 0x7f2d1c197ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:00:15.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:00:15.327+0000 7f2d217f9640 1 -- 172.21.15.117:0/1042438052 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d1c19fb20 con 0x7f2d1c102e10 2024-09-19T06:00:15.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:00:15.327+0000 7f2d227fb640 1 --2- 172.21.15.117:0/1042438052 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d1c1037d0 0x7f2d1c19f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:00:15.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:00:15.327+0000 7f2d217f9640 1 --2- 172.21.15.117:0/1042438052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d1c102e10 0x7f2d1c198430 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c00d6d0 tx=0x7f2d0c00db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:00:15.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:00:15.327+0000 7f2d12ffd640 1 -- 172.21.15.117:0/1042438052 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d0c017070 con 0x7f2d1c102e10 2024-09-19T06:00:15.332 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:00:15.327+0000 7f2d2425e640 1 -- 172.21.15.117:0/1042438052 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d1c19fe10 con 0x7f2d1c102e10 2024-09-19T06:00:15.332 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:00:15.327+0000 7f2d12ffd640 1 -- 172.21.15.117:0/1042438052 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d0c009820 con 0x7f2d1c102e10 2024-09-19T06:00:15.332 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:00:15.327+0000 7f2d12ffd640 1 -- 172.21.15.117:0/1042438052 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d0c004d00 con 0x7f2d1c102e10 2024-09-19T06:00:15.332 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:00:15.327+0000 7f2d2425e640 1 -- 172.21.15.117:0/1042438052 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d1c1a02c0 con 0x7f2d1c102e10 2024-09-19T06:00:15.332 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:00:15.328+0000 7f2d2425e640 1 -- 172.21.15.117:0/1042438052 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d1c109080 con 0x7f2d1c102e10 2024-09-19T06:00:15.332 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:00:15.329+0000 7f2d12ffd640 1 -- 172.21.15.117:0/1042438052 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f2d0c0099d0 con 0x7f2d1c102e10 2024-09-19T06:00:15.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:00:15.330+0000 7f2d12ffd640 1 --2- 172.21.15.117:0/1042438052 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f2d080a3270 0x7f2d080a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:00:15.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:00:15.330+0000 7f2d12ffd640 1 -- 172.21.15.117:0/1042438052 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 3805+0+0 (secure 0 0 0) 0x7f2d0c0ce2d0 con 0x7f2d1c102e10 2024-09-19T06:00:15.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:00:15.330+0000 7f2d21ffa640 1 --2- 172.21.15.117:0/1042438052 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f2d080a3270 0x7f2d080a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:00:15.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:00:15.331+0000 7f2d21ffa640 1 --2- 172.21.15.117:0/1042438052 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f2d080a3270 0x7f2d080a5730 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2d18005ab0 tx=0x7f2d18000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:00:15.335 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:00:15.334+0000 7f2d12ffd640 1 -- 172.21.15.117:0/1042438052 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2d0c09baa0 con 0x7f2d1c102e10 2024-09-19T06:00:15.518 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:00:15.516+0000 7f2d2425e640 1 -- 172.21.15.117:0/1042438052 --> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f2d1c062630 con 0x7f2d080a3270 2024-09-19T06:00:15.903 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:15 smithi117 ceph-mon[35050]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:00:15.903 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:15 smithi117 ceph-mon[35050]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T06:00:15.903 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:15 smithi117 ceph-mon[35050]: from='osd.4 [v2:172.21.15.99:6808/1881025735,v1:172.21.15.99:6809/1881025735]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-19T06:00:15.904 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:15 smithi117 ceph-mon[35050]: osdmap e30: 5 total, 4 up, 5 in 2024-09-19T06:00:15.904 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:15 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:00:15.904 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:15 smithi117 ceph-mon[35050]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-19T06:00:15.904 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:15 smithi117 ceph-mon[35050]: Detected new or changed devices on smithi099 2024-09-19T06:00:15.904 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:15 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:00:15.904 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:15 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:00:15.904 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:15 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:00:15.904 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:15 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:00:15.904 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:15 smithi117 ceph-mon[35050]: Adjusting osd_memory_target on smithi099 to 8544M 2024-09-19T06:00:15.904 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:15 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:00:15.904 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:15 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:00:15.904 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:15 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:00:15.905 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:15 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:00:15.905 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:15 smithi117 ceph-mon[35050]: from='client.14337 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:00:15.905 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:15 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:00:15.905 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:15 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:00:15.905 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:15 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:00:15.938 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 19 06:00:15 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-4[46526]: 2024-09-19T06:00:15.650+0000 7f7f33073640 -1 osd.4 0 waiting for initial osdmap 2024-09-19T06:00:15.939 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 19 06:00:15 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-4[46526]: 2024-09-19T06:00:15.656+0000 7f7f2ee9b640 -1 osd.4 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:00:15.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:15 smithi099 ceph-mon[35300]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:00:15.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:15 smithi099 ceph-mon[35300]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T06:00:15.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:15 smithi099 ceph-mon[35300]: from='osd.4 [v2:172.21.15.99:6808/1881025735,v1:172.21.15.99:6809/1881025735]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-19T06:00:15.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:15 smithi099 ceph-mon[35300]: osdmap e30: 5 total, 4 up, 5 in 2024-09-19T06:00:15.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:15 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:00:15.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:15 smithi099 ceph-mon[35300]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-19T06:00:15.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:15 smithi099 ceph-mon[35300]: Detected new or changed devices on smithi099 2024-09-19T06:00:15.940 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:15 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:00:15.940 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:15 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:00:15.940 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:15 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:00:15.940 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:15 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:00:15.940 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:15 smithi099 ceph-mon[35300]: Adjusting osd_memory_target on smithi099 to 8544M 2024-09-19T06:00:15.940 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:15 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:00:15.940 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:15 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:00:15.940 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:15 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:00:15.940 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:15 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:00:15.940 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:15 smithi099 ceph-mon[35300]: from='client.14337 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:00:15.940 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:15 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:00:15.940 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:15 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:00:15.940 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:15 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:00:16.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:15 smithi037 ceph-mon[31211]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:00:16.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:15 smithi037 ceph-mon[31211]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T06:00:16.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:15 smithi037 ceph-mon[31211]: from='osd.4 [v2:172.21.15.99:6808/1881025735,v1:172.21.15.99:6809/1881025735]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-19T06:00:16.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:15 smithi037 ceph-mon[31211]: osdmap e30: 5 total, 4 up, 5 in 2024-09-19T06:00:16.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:15 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:00:16.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:15 smithi037 ceph-mon[31211]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-19T06:00:16.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:15 smithi037 ceph-mon[31211]: Detected new or changed devices on smithi099 2024-09-19T06:00:16.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:15 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:00:16.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:15 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:00:16.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:15 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:00:16.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:15 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:00:16.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:15 smithi037 ceph-mon[31211]: Adjusting osd_memory_target on smithi099 to 8544M 2024-09-19T06:00:16.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:15 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:00:16.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:15 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:00:16.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:15 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:00:16.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:15 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:00:16.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:15 smithi037 ceph-mon[31211]: from='client.14337 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:00:16.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:15 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:00:16.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:15 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:00:16.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:15 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:00:16.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:16 smithi099 ceph-mon[35300]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-09-19T06:00:16.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:16 smithi099 ceph-mon[35300]: osdmap e31: 5 total, 4 up, 5 in 2024-09-19T06:00:16.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:16 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:00:16.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:16 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:00:16.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:16 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:00:16.964 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:16 smithi117 ceph-mon[35050]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-09-19T06:00:16.964 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:16 smithi117 ceph-mon[35050]: osdmap e31: 5 total, 4 up, 5 in 2024-09-19T06:00:16.964 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:16 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:00:16.965 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:16 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:00:16.965 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:16 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:00:17.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:16 smithi037 ceph-mon[31211]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-09-19T06:00:17.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:16 smithi037 ceph-mon[31211]: osdmap e31: 5 total, 4 up, 5 in 2024-09-19T06:00:17.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:16 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:00:17.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:16 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:00:17.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:16 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:00:17.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:17 smithi099 ceph-mon[35300]: purged_snaps scrub starts 2024-09-19T06:00:17.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:17 smithi099 ceph-mon[35300]: purged_snaps scrub ok 2024-09-19T06:00:17.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:17 smithi099 ceph-mon[35300]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:00:17.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:17 smithi099 ceph-mon[35300]: osd.4 [v2:172.21.15.99:6808/1881025735,v1:172.21.15.99:6809/1881025735] boot 2024-09-19T06:00:17.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:17 smithi099 ceph-mon[35300]: osdmap e32: 5 total, 5 up, 5 in 2024-09-19T06:00:17.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:17 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:00:18.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:17 smithi117 ceph-mon[35050]: purged_snaps scrub starts 2024-09-19T06:00:18.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:17 smithi117 ceph-mon[35050]: purged_snaps scrub ok 2024-09-19T06:00:18.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:17 smithi117 ceph-mon[35050]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:00:18.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:17 smithi117 ceph-mon[35050]: osd.4 [v2:172.21.15.99:6808/1881025735,v1:172.21.15.99:6809/1881025735] boot 2024-09-19T06:00:18.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:17 smithi117 ceph-mon[35050]: osdmap e32: 5 total, 5 up, 5 in 2024-09-19T06:00:18.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:17 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:00:18.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:17 smithi037 ceph-mon[31211]: purged_snaps scrub starts 2024-09-19T06:00:18.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:17 smithi037 ceph-mon[31211]: purged_snaps scrub ok 2024-09-19T06:00:18.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:17 smithi037 ceph-mon[31211]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:00:18.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:17 smithi037 ceph-mon[31211]: osd.4 [v2:172.21.15.99:6808/1881025735,v1:172.21.15.99:6809/1881025735] boot 2024-09-19T06:00:18.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:17 smithi037 ceph-mon[31211]: osdmap e32: 5 total, 5 up, 5 in 2024-09-19T06:00:18.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:17 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:00:18.749 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:18 smithi117 ceph-mon[35050]: osdmap e33: 5 total, 5 up, 5 in 2024-09-19T06:00:18.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:18 smithi117 ceph-mon[35050]: from='client.? 172.21.15.117:0/3730338696' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2f499ab4-3d09-4f96-a709-b4229865c690"}]: dispatch 2024-09-19T06:00:18.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:18 smithi117 ceph-mon[35050]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2f499ab4-3d09-4f96-a709-b4229865c690"}]: dispatch 2024-09-19T06:00:18.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:18 smithi117 ceph-mon[35050]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2f499ab4-3d09-4f96-a709-b4229865c690"}]': finished 2024-09-19T06:00:18.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:18 smithi117 ceph-mon[35050]: osdmap e34: 6 total, 5 up, 6 in 2024-09-19T06:00:18.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:18 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:00:18.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:18 smithi117 ceph-mon[35050]: from='client.? 172.21.15.117:0/1762100915' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:00:18.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:18 smithi099 ceph-mon[35300]: osdmap e33: 5 total, 5 up, 5 in 2024-09-19T06:00:18.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:18 smithi099 ceph-mon[35300]: from='client.? 172.21.15.117:0/3730338696' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2f499ab4-3d09-4f96-a709-b4229865c690"}]: dispatch 2024-09-19T06:00:18.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:18 smithi099 ceph-mon[35300]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2f499ab4-3d09-4f96-a709-b4229865c690"}]: dispatch 2024-09-19T06:00:18.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:18 smithi099 ceph-mon[35300]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2f499ab4-3d09-4f96-a709-b4229865c690"}]': finished 2024-09-19T06:00:18.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:18 smithi099 ceph-mon[35300]: osdmap e34: 6 total, 5 up, 6 in 2024-09-19T06:00:18.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:18 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:00:18.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:18 smithi099 ceph-mon[35300]: from='client.? 172.21.15.117:0/1762100915' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:00:19.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:18 smithi037 ceph-mon[31211]: osdmap e33: 5 total, 5 up, 5 in 2024-09-19T06:00:19.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:18 smithi037 ceph-mon[31211]: from='client.? 172.21.15.117:0/3730338696' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2f499ab4-3d09-4f96-a709-b4229865c690"}]: dispatch 2024-09-19T06:00:19.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:18 smithi037 ceph-mon[31211]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2f499ab4-3d09-4f96-a709-b4229865c690"}]: dispatch 2024-09-19T06:00:19.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:18 smithi037 ceph-mon[31211]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2f499ab4-3d09-4f96-a709-b4229865c690"}]': finished 2024-09-19T06:00:19.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:18 smithi037 ceph-mon[31211]: osdmap e34: 6 total, 5 up, 6 in 2024-09-19T06:00:19.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:18 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:00:19.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:18 smithi037 ceph-mon[31211]: from='client.? 172.21.15.117:0/1762100915' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:00:20.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:19 smithi099 ceph-mon[35300]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:00:20.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:19 smithi117 ceph-mon[35050]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:00:20.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:19 smithi037 ceph-mon[31211]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:00:22.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:21 smithi117 ceph-mon[35050]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:00:22.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:21 smithi037 ceph-mon[31211]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:00:22.438 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:21 smithi099 ceph-mon[35300]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:00:24.229 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:23 smithi117 ceph-mon[35050]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:00:24.241 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:23 smithi099 ceph-mon[35300]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:00:24.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:23 smithi037 ceph-mon[31211]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:00:26.093 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:25 smithi117 ceph-mon[35050]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:00:26.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:25 smithi037 ceph-mon[31211]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:00:26.438 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:25 smithi099 ceph-mon[35300]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:00:27.156 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:26 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T06:00:27.156 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:26 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:00:27.156 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:26 smithi117 ceph-mon[35050]: Deploying daemon osd.5 on smithi117 2024-09-19T06:00:27.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:26 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T06:00:27.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:26 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:00:27.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:26 smithi037 ceph-mon[31211]: Deploying daemon osd.5 on smithi117 2024-09-19T06:00:27.438 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:26 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T06:00:27.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:26 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:00:27.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:26 smithi099 ceph-mon[35300]: Deploying daemon osd.5 on smithi117 2024-09-19T06:00:28.058 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:27 smithi117 ceph-mon[35050]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:00:28.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:27 smithi037 ceph-mon[31211]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:00:28.438 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:27 smithi099 ceph-mon[35300]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:00:30.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:29 smithi117 ceph-mon[35050]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:00:30.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:29 smithi037 ceph-mon[31211]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:00:30.438 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:29 smithi099 ceph-mon[35300]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:00:32.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:31 smithi117 ceph-mon[35050]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:00:32.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:31 smithi037 ceph-mon[31211]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:00:32.438 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:31 smithi099 ceph-mon[35300]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:00:33.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:32 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:00:33.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:32 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:00:33.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:32 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:00:33.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:32 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:00:33.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:32 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:00:33.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:32 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:00:33.438 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:32 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:00:33.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:32 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:00:33.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:32 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:00:33.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:33 smithi117 ceph-mon[35050]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:00:34.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:33 smithi037 ceph-mon[31211]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:00:34.438 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:33 smithi099 ceph-mon[35300]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:00:36.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:36 smithi117 ceph-mon[35050]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:00:36.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:36 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:00:36.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:36 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:00:36.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:36 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:00:36.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:36 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:00:36.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:36 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:00:36.530 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:36 smithi099 ceph-mon[35300]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:00:36.530 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:36 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:00:36.530 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:36 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:00:36.530 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:36 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:00:36.531 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:36 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:00:36.531 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:36 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:00:36.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:36 smithi037 ceph-mon[31211]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:00:36.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:36 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:00:36.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:36 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:00:36.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:36 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:00:36.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:36 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:00:36.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:36 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:00:36.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:00:36.575+0000 7f2d12ffd640 1 -- 172.21.15.117:0/1042438052 <== mgr.14148 v2:172.21.15.37:6800/3797010169 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f2d1c062630 con 0x7f2d080a3270 2024-09-19T06:00:36.577 INFO:teuthology.orchestra.run.smithi117.stdout:Created osd(s) 5 on host 'smithi117' 2024-09-19T06:00:36.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:00:36.577+0000 7f2d2425e640 1 -- 172.21.15.117:0/1042438052 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f2d080a3270 msgr2=0x7f2d080a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:00:36.580 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:00:36.577+0000 7f2d2425e640 1 --2- 172.21.15.117:0/1042438052 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f2d080a3270 0x7f2d080a5730 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2d18005ab0 tx=0x7f2d18000bc0 comp rx=0 tx=0).stop 2024-09-19T06:00:36.580 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:00:36.577+0000 7f2d2425e640 1 -- 172.21.15.117:0/1042438052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d1c102e10 msgr2=0x7f2d1c198430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:00:36.580 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:00:36.577+0000 7f2d2425e640 1 --2- 172.21.15.117:0/1042438052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d1c102e10 0x7f2d1c198430 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c00d6d0 tx=0x7f2d0c00db90 comp rx=0 tx=0).stop 2024-09-19T06:00:36.580 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:00:36.577+0000 7f2d2425e640 1 -- 172.21.15.117:0/1042438052 shutdown_connections 2024-09-19T06:00:36.580 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:00:36.577+0000 7f2d2425e640 1 --2- 172.21.15.117:0/1042438052 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f2d080a3270 0x7f2d080a5730 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:00:36.580 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:00:36.577+0000 7f2d2425e640 1 --2- 172.21.15.117:0/1042438052 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d1c1037d0 0x7f2d1c19f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:00:36.580 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:00:36.577+0000 7f2d2425e640 1 --2- 172.21.15.117:0/1042438052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d1c102e10 0x7f2d1c198430 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:00:36.580 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:00:36.577+0000 7f2d2425e640 1 --2- 172.21.15.117:0/1042438052 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2d1c101c10 0x7f2d1c197ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:00:36.580 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:00:36.577+0000 7f2d2425e640 1 -- 172.21.15.117:0/1042438052 >> 172.21.15.117:0/1042438052 conn(0x7f2d1c0fd3c0 msgr2=0x7f2d1c106250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:00:36.580 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:00:36.577+0000 7f2d2425e640 1 -- 172.21.15.117:0/1042438052 shutdown_connections 2024-09-19T06:00:36.580 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:00:36.577+0000 7f2d2425e640 1 -- 172.21.15.117:0/1042438052 wait complete. 2024-09-19T06:00:37.201 DEBUG:teuthology.orchestra.run.smithi117:osd.5> sudo journalctl -f -n 0 -u ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@osd.5.service 2024-09-19T06:00:37.203 INFO:tasks.cephadm:Deploying osd.6 on smithi037 with /dev/vg_nvme/lv_2... 2024-09-19T06:00:37.204 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T06:00:37.426 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:37 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:00:37.426 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:37 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:00:37.426 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:37 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:00:37.472 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:00:37.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:37 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:00:37.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:37 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:00:37.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:37 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:00:37.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:37 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:00:37.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:37 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:00:37.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:37 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:00:38.629 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:38 smithi117 ceph-mon[35050]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:00:38.629 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:38 smithi117 ceph-mon[35050]: from='osd.5 [v2:172.21.15.117:6808/1141976511,v1:172.21.15.117:6809/1141976511]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T06:00:38.629 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:38 smithi117 ceph-mon[35050]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T06:00:38.629 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:00:38 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-5[46498]: 2024-09-19T06:00:38.393+0000 7fdf7ee51640 -1 osd.5 0 log_to_monitors true 2024-09-19T06:00:38.913 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:38 smithi037 ceph-mon[31211]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:00:38.913 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:38 smithi037 ceph-mon[31211]: from='osd.5 [v2:172.21.15.117:6808/1141976511,v1:172.21.15.117:6809/1141976511]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T06:00:38.913 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:38 smithi037 ceph-mon[31211]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T06:00:38.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:38 smithi099 ceph-mon[35300]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:00:38.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:38 smithi099 ceph-mon[35300]: from='osd.5 [v2:172.21.15.117:6808/1141976511,v1:172.21.15.117:6809/1141976511]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T06:00:38.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:38 smithi099 ceph-mon[35300]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T06:00:39.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:39 smithi037 ceph-mon[31211]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T06:00:39.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:39 smithi037 ceph-mon[31211]: from='osd.5 [v2:172.21.15.117:6808/1141976511,v1:172.21.15.117:6809/1141976511]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-19T06:00:39.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:39 smithi037 ceph-mon[31211]: osdmap e35: 6 total, 5 up, 6 in 2024-09-19T06:00:39.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:39 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:00:39.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:39 smithi037 ceph-mon[31211]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-19T06:00:39.873 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:39 smithi117 ceph-mon[35050]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T06:00:39.873 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:39 smithi117 ceph-mon[35050]: from='osd.5 [v2:172.21.15.117:6808/1141976511,v1:172.21.15.117:6809/1141976511]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-19T06:00:39.873 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:39 smithi117 ceph-mon[35050]: osdmap e35: 6 total, 5 up, 6 in 2024-09-19T06:00:39.873 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:39 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:00:39.873 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:39 smithi117 ceph-mon[35050]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-19T06:00:39.873 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:00:39 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-5[46498]: 2024-09-19T06:00:39.590+0000 7fdf7add4640 -1 osd.5 0 waiting for initial osdmap 2024-09-19T06:00:39.873 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:00:39 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-5[46498]: 2024-09-19T06:00:39.596+0000 7fdf76bfc640 -1 osd.5 36 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:00:39.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:39 smithi099 ceph-mon[35300]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T06:00:39.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:39 smithi099 ceph-mon[35300]: from='osd.5 [v2:172.21.15.117:6808/1141976511,v1:172.21.15.117:6809/1141976511]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-19T06:00:39.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:39 smithi099 ceph-mon[35300]: osdmap e35: 6 total, 5 up, 6 in 2024-09-19T06:00:39.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:39 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:00:39.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:39 smithi099 ceph-mon[35300]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-19T06:00:40.236 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T06:00:40.263 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi037:vg_nvme/lv_2 2024-09-19T06:00:40.519 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:00:40.796 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:40 smithi037 ceph-mon[31211]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:00:40.797 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:40 smithi037 ceph-mon[31211]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]': finished 2024-09-19T06:00:40.797 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:40 smithi037 ceph-mon[31211]: osdmap e36: 6 total, 5 up, 6 in 2024-09-19T06:00:40.797 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:40 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:00:40.797 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:40 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:00:40.797 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:40 smithi037 ceph-mon[31211]: Detected new or changed devices on smithi117 2024-09-19T06:00:40.797 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:40 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:00:40.797 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:40 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:00:40.797 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:40 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:00:40.797 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:40 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:00:40.797 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:40 smithi037 ceph-mon[31211]: Adjusting osd_memory_target on smithi117 to 8544M 2024-09-19T06:00:40.797 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:40 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:00:40.797 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:40 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:00:40.798 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:40 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:00:40.798 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:40 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:00:40.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:40 smithi099 ceph-mon[35300]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:00:40.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:40 smithi099 ceph-mon[35300]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]': finished 2024-09-19T06:00:40.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:40 smithi099 ceph-mon[35300]: osdmap e36: 6 total, 5 up, 6 in 2024-09-19T06:00:40.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:40 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:00:40.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:40 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:00:40.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:40 smithi099 ceph-mon[35300]: Detected new or changed devices on smithi117 2024-09-19T06:00:40.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:40 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:00:40.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:40 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:00:40.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:40 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:00:40.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:40 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:00:40.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:40 smithi099 ceph-mon[35300]: Adjusting osd_memory_target on smithi117 to 8544M 2024-09-19T06:00:40.940 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:40 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:00:40.940 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:40 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:00:40.940 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:40 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:00:40.940 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:40 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:00:41.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:40 smithi117 ceph-mon[35050]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:00:41.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:40 smithi117 ceph-mon[35050]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]': finished 2024-09-19T06:00:41.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:40 smithi117 ceph-mon[35050]: osdmap e36: 6 total, 5 up, 6 in 2024-09-19T06:00:41.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:40 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:00:41.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:40 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:00:41.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:40 smithi117 ceph-mon[35050]: Detected new or changed devices on smithi117 2024-09-19T06:00:41.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:40 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:00:41.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:40 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:00:41.001 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:40 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:00:41.001 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:40 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:00:41.001 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:40 smithi117 ceph-mon[35050]: Adjusting osd_memory_target on smithi117 to 8544M 2024-09-19T06:00:41.001 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:40 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:00:41.001 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:40 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:00:41.001 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:40 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:00:41.001 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:40 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:00:41.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:00:41.003+0000 7fda5a1bf640 1 -- 172.21.15.37:0/1539874233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda54101c00 msgr2=0x7fda54102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:00:41.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:00:41.003+0000 7fda5a1bf640 1 --2- 172.21.15.37:0/1539874233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda54101c00 0x7fda54102000 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fda44009900 tx=0x7fda4402a410 comp rx=0 tx=0).stop 2024-09-19T06:00:41.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:00:41.003+0000 7fda5a1bf640 1 -- 172.21.15.37:0/1539874233 shutdown_connections 2024-09-19T06:00:41.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:00:41.003+0000 7fda5a1bf640 1 --2- 172.21.15.37:0/1539874233 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda541037c0 0x7fda5410a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:00:41.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:00:41.003+0000 7fda5a1bf640 1 --2- 172.21.15.37:0/1539874233 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda54102e00 0x7fda54103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:00:41.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:00:41.003+0000 7fda5a1bf640 1 --2- 172.21.15.37:0/1539874233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda54101c00 0x7fda54102000 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:00:41.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:00:41.003+0000 7fda5a1bf640 1 -- 172.21.15.37:0/1539874233 >> 172.21.15.37:0/1539874233 conn(0x7fda540fd390 msgr2=0x7fda540ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:00:41.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:00:41.003+0000 7fda5a1bf640 1 -- 172.21.15.37:0/1539874233 shutdown_connections 2024-09-19T06:00:41.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:00:41.003+0000 7fda5a1bf640 1 -- 172.21.15.37:0/1539874233 wait complete. 2024-09-19T06:00:41.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:00:41.004+0000 7fda5a1bf640 1 Processor -- start 2024-09-19T06:00:41.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:00:41.004+0000 7fda5a1bf640 1 -- start start 2024-09-19T06:00:41.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:00:41.004+0000 7fda5a1bf640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda54101c00 0x7fda54075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:00:41.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:00:41.004+0000 7fda5a1bf640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda54102e00 0x7fda540745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:00:41.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:00:41.005+0000 7fda5a1bf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda541037c0 0x7fda54074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:00:41.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:00:41.005+0000 7fda5a1bf640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fda5410d880 con 0x7fda541037c0 2024-09-19T06:00:41.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:00:41.005+0000 7fda5a1bf640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fda5410d700 con 0x7fda54102e00 2024-09-19T06:00:41.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:00:41.005+0000 7fda5a1bf640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fda5410da00 con 0x7fda54101c00 2024-09-19T06:00:41.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:00:41.005+0000 7fda53fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda541037c0 0x7fda54074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:00:41.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:00:41.005+0000 7fda53fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda541037c0 0x7fda54074b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53232/0 (socket says 172.21.15.37:53232) 2024-09-19T06:00:41.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:00:41.005+0000 7fda53fff640 1 -- 172.21.15.37:0/3123695409 learned_addr learned my addr 172.21.15.37:0/3123695409 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:00:41.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:00:41.005+0000 7fda537fe640 1 --2- 172.21.15.37:0/3123695409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda54101c00 0x7fda54075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:00:41.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:00:41.005+0000 7fda52ffd640 1 --2- 172.21.15.37:0/3123695409 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda54102e00 0x7fda540745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:00:41.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:00:41.005+0000 7fda53fff640 1 -- 172.21.15.37:0/3123695409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda54101c00 msgr2=0x7fda54075f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:00:41.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:00:41.005+0000 7fda53fff640 1 --2- 172.21.15.37:0/3123695409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda54101c00 0x7fda54075f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:00:41.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:00:41.005+0000 7fda53fff640 1 -- 172.21.15.37:0/3123695409 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda54102e00 msgr2=0x7fda540745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:00:41.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:00:41.005+0000 7fda53fff640 1 --2- 172.21.15.37:0/3123695409 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda54102e00 0x7fda540745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:00:41.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:00:41.005+0000 7fda53fff640 1 -- 172.21.15.37:0/3123695409 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda540753e0 con 0x7fda541037c0 2024-09-19T06:00:41.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:00:41.005+0000 7fda52ffd640 1 --2- 172.21.15.37:0/3123695409 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda54102e00 0x7fda540745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:00:41.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:00:41.005+0000 7fda53fff640 1 --2- 172.21.15.37:0/3123695409 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda541037c0 0x7fda54074b20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fda4c009fd0 tx=0x7fda4c00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:00:41.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:00:41.005+0000 7fda50ff9640 1 -- 172.21.15.37:0/3123695409 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda4c017070 con 0x7fda541037c0 2024-09-19T06:00:41.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:00:41.005+0000 7fda50ff9640 1 -- 172.21.15.37:0/3123695409 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda4c003e50 con 0x7fda541037c0 2024-09-19T06:00:41.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:00:41.005+0000 7fda50ff9640 1 -- 172.21.15.37:0/3123695409 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda4c0106c0 con 0x7fda541037c0 2024-09-19T06:00:41.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:00:41.005+0000 7fda5a1bf640 1 -- 172.21.15.37:0/3123695409 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda541a20a0 con 0x7fda541037c0 2024-09-19T06:00:41.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:00:41.005+0000 7fda5a1bf640 1 -- 172.21.15.37:0/3123695409 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda541a2560 con 0x7fda541037c0 2024-09-19T06:00:41.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:00:41.007+0000 7fda5a1bf640 1 -- 172.21.15.37:0/3123695409 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda54108ff0 con 0x7fda541037c0 2024-09-19T06:00:41.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:00:41.008+0000 7fda50ff9640 1 -- 172.21.15.37:0/3123695409 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fda4c003970 con 0x7fda541037c0 2024-09-19T06:00:41.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:00:41.008+0000 7fda50ff9640 1 --2- 172.21.15.37:0/3123695409 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fda400a3240 0x7fda400a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:00:41.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:00:41.009+0000 7fda537fe640 1 --2- 172.21.15.37:0/3123695409 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fda400a3240 0x7fda400a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:00:41.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:00:41.009+0000 7fda50ff9640 1 -- 172.21.15.37:0/3123695409 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4566+0+0 (secure 0 0 0) 0x7fda4c0ce7e0 con 0x7fda541037c0 2024-09-19T06:00:41.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:00:41.009+0000 7fda537fe640 1 --2- 172.21.15.37:0/3123695409 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fda400a3240 0x7fda400a5700 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fda44005ab0 tx=0x7fda44000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:00:41.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:00:41.013+0000 7fda50ff9640 1 -- 172.21.15.37:0/3123695409 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fda4c09c3a0 con 0x7fda541037c0 2024-09-19T06:00:41.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:00:41.199+0000 7fda5a1bf640 1 -- 172.21.15.37:0/3123695409 --> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fda54062630 con 0x7fda400a3240 2024-09-19T06:00:41.852 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:41 smithi037 ceph-mon[31211]: purged_snaps scrub starts 2024-09-19T06:00:41.852 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:41 smithi037 ceph-mon[31211]: purged_snaps scrub ok 2024-09-19T06:00:41.852 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:41 smithi037 ceph-mon[31211]: osd.5 [v2:172.21.15.117:6808/1141976511,v1:172.21.15.117:6809/1141976511] boot 2024-09-19T06:00:41.852 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:41 smithi037 ceph-mon[31211]: osdmap e37: 6 total, 6 up, 6 in 2024-09-19T06:00:41.852 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:41 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:00:41.852 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:41 smithi037 ceph-mon[31211]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:00:41.852 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:41 smithi037 ceph-mon[31211]: from='client.14358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:00:41.852 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:41 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:00:41.852 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:41 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:00:41.852 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:41 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:00:41.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:41 smithi099 ceph-mon[35300]: purged_snaps scrub starts 2024-09-19T06:00:41.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:41 smithi099 ceph-mon[35300]: purged_snaps scrub ok 2024-09-19T06:00:41.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:41 smithi099 ceph-mon[35300]: osd.5 [v2:172.21.15.117:6808/1141976511,v1:172.21.15.117:6809/1141976511] boot 2024-09-19T06:00:41.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:41 smithi099 ceph-mon[35300]: osdmap e37: 6 total, 6 up, 6 in 2024-09-19T06:00:41.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:41 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:00:41.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:41 smithi099 ceph-mon[35300]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:00:41.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:41 smithi099 ceph-mon[35300]: from='client.14358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:00:41.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:41 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:00:41.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:41 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:00:41.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:41 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:00:42.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:41 smithi117 ceph-mon[35050]: purged_snaps scrub starts 2024-09-19T06:00:42.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:41 smithi117 ceph-mon[35050]: purged_snaps scrub ok 2024-09-19T06:00:42.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:41 smithi117 ceph-mon[35050]: osd.5 [v2:172.21.15.117:6808/1141976511,v1:172.21.15.117:6809/1141976511] boot 2024-09-19T06:00:42.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:41 smithi117 ceph-mon[35050]: osdmap e37: 6 total, 6 up, 6 in 2024-09-19T06:00:42.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:41 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:00:42.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:41 smithi117 ceph-mon[35050]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:00:42.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:41 smithi117 ceph-mon[35050]: from='client.14358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:00:42.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:41 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:00:42.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:41 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:00:42.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:41 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:00:42.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:42 smithi099 ceph-mon[35300]: osdmap e38: 6 total, 6 up, 6 in 2024-09-19T06:00:42.941 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:42 smithi037 ceph-mon[31211]: osdmap e38: 6 total, 6 up, 6 in 2024-09-19T06:00:42.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:42 smithi117 ceph-mon[35050]: osdmap e38: 6 total, 6 up, 6 in 2024-09-19T06:00:43.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:43 smithi037 ceph-mon[31211]: pgmap v134: 1 pgs: 1 remapped+peering; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:00:43.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:43 smithi037 ceph-mon[31211]: osdmap e39: 6 total, 6 up, 6 in 2024-09-19T06:00:43.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:43 smithi099 ceph-mon[35300]: pgmap v134: 1 pgs: 1 remapped+peering; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:00:43.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:43 smithi099 ceph-mon[35300]: osdmap e39: 6 total, 6 up, 6 in 2024-09-19T06:00:43.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:43 smithi117 ceph-mon[35050]: pgmap v134: 1 pgs: 1 remapped+peering; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:00:44.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:43 smithi117 ceph-mon[35050]: osdmap e39: 6 total, 6 up, 6 in 2024-09-19T06:00:44.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:44 smithi099 ceph-mon[35300]: osdmap e40: 6 total, 6 up, 6 in 2024-09-19T06:00:44.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:44 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/1662126225' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "10f7fd72-1ae8-4efd-a448-75f4b5054be3"}]: dispatch 2024-09-19T06:00:44.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:44 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/1662126225' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "10f7fd72-1ae8-4efd-a448-75f4b5054be3"}]': finished 2024-09-19T06:00:44.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:44 smithi099 ceph-mon[35300]: osdmap e41: 7 total, 6 up, 7 in 2024-09-19T06:00:44.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:44 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:00:44.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:44 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/3768130165' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:00:45.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:44 smithi117 ceph-mon[35050]: osdmap e40: 6 total, 6 up, 6 in 2024-09-19T06:00:45.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:44 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/1662126225' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "10f7fd72-1ae8-4efd-a448-75f4b5054be3"}]: dispatch 2024-09-19T06:00:45.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:44 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/1662126225' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "10f7fd72-1ae8-4efd-a448-75f4b5054be3"}]': finished 2024-09-19T06:00:45.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:44 smithi117 ceph-mon[35050]: osdmap e41: 7 total, 6 up, 7 in 2024-09-19T06:00:45.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:44 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:00:45.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:44 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/3768130165' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:00:45.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:44 smithi037 ceph-mon[31211]: osdmap e40: 6 total, 6 up, 6 in 2024-09-19T06:00:45.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:44 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/1662126225' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "10f7fd72-1ae8-4efd-a448-75f4b5054be3"}]: dispatch 2024-09-19T06:00:45.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:44 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/1662126225' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "10f7fd72-1ae8-4efd-a448-75f4b5054be3"}]': finished 2024-09-19T06:00:45.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:44 smithi037 ceph-mon[31211]: osdmap e41: 7 total, 6 up, 7 in 2024-09-19T06:00:45.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:44 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:00:45.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:44 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/3768130165' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:00:45.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:45 smithi099 ceph-mon[35300]: pgmap v137: 1 pgs: 1 remapped+peering; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:00:45.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:45 smithi117 ceph-mon[35050]: pgmap v137: 1 pgs: 1 remapped+peering; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:00:46.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:45 smithi037 ceph-mon[31211]: pgmap v137: 1 pgs: 1 remapped+peering; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:00:47.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:47 smithi099 ceph-mon[35300]: pgmap v138: 1 pgs: 1 remapped+peering; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:00:48.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:47 smithi117 ceph-mon[35050]: pgmap v138: 1 pgs: 1 remapped+peering; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:00:48.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:47 smithi037 ceph-mon[31211]: pgmap v138: 1 pgs: 1 remapped+peering; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:00:49.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:49 smithi099 ceph-mon[35300]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T06:00:49.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:49 smithi117 ceph-mon[35050]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T06:00:50.007 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:49 smithi037 ceph-mon[31211]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T06:00:51.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:51 smithi037 ceph-mon[31211]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T06:00:51.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:51 smithi117 ceph-mon[35050]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T06:00:52.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:51 smithi099 ceph-mon[35300]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T06:00:52.772 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:52 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T06:00:52.772 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:52 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:00:52.772 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:52 smithi037 ceph-mon[31211]: Deploying daemon osd.6 on smithi037 2024-09-19T06:00:53.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:52 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T06:00:53.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:52 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:00:53.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:52 smithi117 ceph-mon[35050]: Deploying daemon osd.6 on smithi037 2024-09-19T06:00:53.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:52 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T06:00:53.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:52 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:00:53.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:52 smithi099 ceph-mon[35300]: Deploying daemon osd.6 on smithi037 2024-09-19T06:00:53.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:53 smithi037 ceph-mon[31211]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-19T06:00:53.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:53 smithi117 ceph-mon[35050]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-19T06:00:54.090 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:53 smithi099 ceph-mon[35300]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-19T06:00:55.805 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:55 smithi037 ceph-mon[31211]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-19T06:00:56.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:55 smithi117 ceph-mon[35050]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-19T06:00:56.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:55 smithi099 ceph-mon[35300]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-19T06:00:57.997 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:57 smithi037 ceph-mon[31211]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T06:00:57.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:57 smithi117 ceph-mon[35050]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T06:00:58.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:57 smithi099 ceph-mon[35300]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T06:00:59.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:58 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:00:59.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:58 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:00:59.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:00:58 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:00:59.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:58 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:00:59.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:58 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:00:59.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:00:58 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:00:59.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:58 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:00:59.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:58 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:00:59.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:00:58 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:00.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:00 smithi037 ceph-mon[31211]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T06:01:00.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:00 smithi099 ceph-mon[35300]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T06:01:00.749 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:00 smithi117 ceph-mon[35050]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T06:01:02.314 INFO:teuthology.orchestra.run.smithi037.stdout:Created osd(s) 6 on host 'smithi037' 2024-09-19T06:01:02.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:01:02.313+0000 7fda50ff9640 1 -- 172.21.15.37:0/3123695409 <== mgr.14148 v2:172.21.15.37:6800/3797010169 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fda54062630 con 0x7fda400a3240 2024-09-19T06:01:02.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:01:02.317+0000 7fda5a1bf640 1 -- 172.21.15.37:0/3123695409 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fda400a3240 msgr2=0x7fda400a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:01:02.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:01:02.317+0000 7fda5a1bf640 1 --2- 172.21.15.37:0/3123695409 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fda400a3240 0x7fda400a5700 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fda44005ab0 tx=0x7fda44000bc0 comp rx=0 tx=0).stop 2024-09-19T06:01:02.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:01:02.317+0000 7fda5a1bf640 1 -- 172.21.15.37:0/3123695409 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda541037c0 msgr2=0x7fda54074b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:01:02.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:01:02.317+0000 7fda5a1bf640 1 --2- 172.21.15.37:0/3123695409 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda541037c0 0x7fda54074b20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fda4c009fd0 tx=0x7fda4c00b260 comp rx=0 tx=0).stop 2024-09-19T06:01:02.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:01:02.317+0000 7fda5a1bf640 1 -- 172.21.15.37:0/3123695409 shutdown_connections 2024-09-19T06:01:02.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:01:02.317+0000 7fda5a1bf640 1 --2- 172.21.15.37:0/3123695409 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fda400a3240 0x7fda400a5700 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:01:02.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:01:02.317+0000 7fda5a1bf640 1 --2- 172.21.15.37:0/3123695409 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda54102e00 0x7fda540745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:01:02.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:01:02.317+0000 7fda5a1bf640 1 --2- 172.21.15.37:0/3123695409 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda541037c0 0x7fda54074b20 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:01:02.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:01:02.317+0000 7fda5a1bf640 1 --2- 172.21.15.37:0/3123695409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda54101c00 0x7fda54075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:01:02.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:01:02.317+0000 7fda5a1bf640 1 -- 172.21.15.37:0/3123695409 >> 172.21.15.37:0/3123695409 conn(0x7fda540fd390 msgr2=0x7fda541061c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:01:02.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:01:02.317+0000 7fda5a1bf640 1 -- 172.21.15.37:0/3123695409 shutdown_connections 2024-09-19T06:01:02.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:01:02.317+0000 7fda5a1bf640 1 -- 172.21.15.37:0/3123695409 wait complete. 2024-09-19T06:01:02.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:02 smithi037 ceph-mon[31211]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:01:02.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:02 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:02.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:02 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:02.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:02 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:01:02.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:02 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:01:02.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:02 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:02.688 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:02 smithi099 ceph-mon[35300]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:01:02.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:02 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:02.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:02 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:02.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:02 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:01:02.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:02 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:01:02.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:02 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:02.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:02 smithi117 ceph-mon[35050]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:01:02.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:02 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:02.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:02 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:02.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:02 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:01:02.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:02 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:01:02.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:02 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:03.010 DEBUG:teuthology.orchestra.run.smithi037:osd.6> sudo journalctl -f -n 0 -u ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@osd.6.service 2024-09-19T06:01:03.012 INFO:tasks.cephadm:Deploying osd.7 on smithi099 with /dev/vg_nvme/lv_2... 2024-09-19T06:01:03.012 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T06:01:03.268 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T06:01:03.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:03 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:01:03.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:03 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:03.558 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:03 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:03.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:03 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:01:03.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:03 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:03.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:03 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:03.643 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:03 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:01:03.644 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:03 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:03.644 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:03 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:04.363 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:04 smithi037 ceph-mon[31211]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:01:04.364 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:04 smithi037 ceph-mon[31211]: from='osd.6 [v2:172.21.15.37:6818/770433145,v1:172.21.15.37:6819/770433145]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T06:01:04.364 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 19 06:01:04 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-6[55831]: 2024-09-19T06:01:04.085+0000 7fa043a20640 -1 osd.6 0 log_to_monitors true 2024-09-19T06:01:04.499 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:04 smithi117 ceph-mon[35050]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:01:04.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:04 smithi117 ceph-mon[35050]: from='osd.6 [v2:172.21.15.37:6818/770433145,v1:172.21.15.37:6819/770433145]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T06:01:04.579 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:04 smithi099 ceph-mon[35300]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:01:04.580 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:04 smithi099 ceph-mon[35300]: from='osd.6 [v2:172.21.15.37:6818/770433145,v1:172.21.15.37:6819/770433145]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T06:01:05.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:05 smithi099 ceph-mon[35300]: from='osd.6 [v2:172.21.15.37:6818/770433145,v1:172.21.15.37:6819/770433145]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T06:01:05.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:05 smithi099 ceph-mon[35300]: osdmap e42: 7 total, 6 up, 7 in 2024-09-19T06:01:05.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:05 smithi099 ceph-mon[35300]: from='osd.6 [v2:172.21.15.37:6818/770433145,v1:172.21.15.37:6819/770433145]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-09-19T06:01:05.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:05 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:01:05.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:05 smithi099 ceph-mon[35300]: from='osd.6 [v2:172.21.15.37:6818/770433145,v1:172.21.15.37:6819/770433145]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-09-19T06:01:05.574 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 19 06:01:05 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-6[55831]: 2024-09-19T06:01:05.321+0000 7fa03f9a3640 -1 osd.6 0 waiting for initial osdmap 2024-09-19T06:01:05.574 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 19 06:01:05 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-6[55831]: 2024-09-19T06:01:05.329+0000 7fa03b7cb640 -1 osd.6 43 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:01:05.575 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:05 smithi037 ceph-mon[31211]: from='osd.6 [v2:172.21.15.37:6818/770433145,v1:172.21.15.37:6819/770433145]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T06:01:05.575 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:05 smithi037 ceph-mon[31211]: osdmap e42: 7 total, 6 up, 7 in 2024-09-19T06:01:05.575 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:05 smithi037 ceph-mon[31211]: from='osd.6 [v2:172.21.15.37:6818/770433145,v1:172.21.15.37:6819/770433145]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-09-19T06:01:05.575 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:05 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:01:05.575 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:05 smithi037 ceph-mon[31211]: from='osd.6 [v2:172.21.15.37:6818/770433145,v1:172.21.15.37:6819/770433145]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-09-19T06:01:05.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:05 smithi117 ceph-mon[35050]: from='osd.6 [v2:172.21.15.37:6818/770433145,v1:172.21.15.37:6819/770433145]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T06:01:05.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:05 smithi117 ceph-mon[35050]: osdmap e42: 7 total, 6 up, 7 in 2024-09-19T06:01:05.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:05 smithi117 ceph-mon[35050]: from='osd.6 [v2:172.21.15.37:6818/770433145,v1:172.21.15.37:6819/770433145]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-09-19T06:01:05.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:05 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:01:05.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:05 smithi117 ceph-mon[35050]: from='osd.6 [v2:172.21.15.37:6818/770433145,v1:172.21.15.37:6819/770433145]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-09-19T06:01:05.880 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:01:05.907 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi099:vg_nvme/lv_2 2024-09-19T06:01:06.166 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T06:01:06.546 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:06 smithi099 ceph-mon[35300]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:01:06.547 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:06 smithi099 ceph-mon[35300]: osdmap e43: 7 total, 6 up, 7 in 2024-09-19T06:01:06.547 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:06 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:01:06.547 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:06 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:01:06.547 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:06 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:06.547 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:06 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:06.547 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:06 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:01:06.547 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:06 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:01:06.547 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:06 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:01:06.547 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:06 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:06.547 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:06 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:01:06.547 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:06 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:01:06.547 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:06 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:06.547 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:06 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:01:06.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:01:06.627+0000 7f26e4860640 1 -- 172.21.15.99:0/1255071990 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f26e0101d10 msgr2=0x7f26e0102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:01:06.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:01:06.627+0000 7f26e4860640 1 --2- 172.21.15.99:0/1255071990 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f26e0101d10 0x7f26e0102190 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f26c8009900 tx=0x7f26c802a410 comp rx=0 tx=0).stop 2024-09-19T06:01:06.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:01:06.627+0000 7f26e4860640 1 -- 172.21.15.99:0/1255071990 shutdown_connections 2024-09-19T06:01:06.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:01:06.627+0000 7f26e4860640 1 --2- 172.21.15.99:0/1255071990 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f26e0101d10 0x7f26e0102190 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:01:06.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:01:06.627+0000 7f26e4860640 1 --2- 172.21.15.99:0/1255071990 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26e01026d0 0x7f26e0108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:01:06.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:01:06.627+0000 7f26e4860640 1 --2- 172.21.15.99:0/1255071990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26e0100b10 0x7f26e0100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:01:06.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:01:06.627+0000 7f26e4860640 1 -- 172.21.15.99:0/1255071990 >> 172.21.15.99:0/1255071990 conn(0x7f26e00fc2a0 msgr2=0x7f26e00fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:01:06.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:01:06.627+0000 7f26e4860640 1 -- 172.21.15.99:0/1255071990 shutdown_connections 2024-09-19T06:01:06.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:01:06.627+0000 7f26e4860640 1 -- 172.21.15.99:0/1255071990 wait complete. 2024-09-19T06:01:06.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:01:06.628+0000 7f26e4860640 1 Processor -- start 2024-09-19T06:01:06.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:01:06.628+0000 7f26e4860640 1 -- start start 2024-09-19T06:01:06.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:01:06.629+0000 7f26e4860640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26e0100b10 0x7f26e0197e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:01:06.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:01:06.629+0000 7f26e4860640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26e0101d10 0x7f26e0198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:01:06.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:01:06.629+0000 7f26e4860640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f26e01026d0 0x7f26e019f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:01:06.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:01:06.629+0000 7f26e4860640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f26e010d920 con 0x7f26e0100b10 2024-09-19T06:01:06.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:01:06.629+0000 7f26e4860640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f26e010d7a0 con 0x7f26e01026d0 2024-09-19T06:01:06.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:01:06.629+0000 7f26e4860640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f26e010daa0 con 0x7f26e0101d10 2024-09-19T06:01:06.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:01:06.629+0000 7f26ded9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f26e01026d0 0x7f26e019f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:01:06.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:01:06.629+0000 7f26ded9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f26e01026d0 0x7f26e019f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:57722/0 (socket says 172.21.15.99:57722) 2024-09-19T06:01:06.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:01:06.629+0000 7f26ded9d640 1 -- 172.21.15.99:0/3872851503 learned_addr learned my addr 172.21.15.99:0/3872851503 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:01:06.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:01:06.629+0000 7f26de59c640 1 --2- 172.21.15.99:0/3872851503 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26e0100b10 0x7f26e0197e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:01:06.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:01:06.629+0000 7f26ddd9b640 1 --2- 172.21.15.99:0/3872851503 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26e0101d10 0x7f26e0198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:01:06.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:01:06.629+0000 7f26ded9d640 1 -- 172.21.15.99:0/3872851503 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26e0101d10 msgr2=0x7f26e0198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:01:06.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:01:06.629+0000 7f26ded9d640 1 --2- 172.21.15.99:0/3872851503 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26e0101d10 0x7f26e0198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:01:06.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:01:06.629+0000 7f26ded9d640 1 -- 172.21.15.99:0/3872851503 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26e0100b10 msgr2=0x7f26e0197e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:01:06.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:01:06.629+0000 7f26ded9d640 1 --2- 172.21.15.99:0/3872851503 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26e0100b10 0x7f26e0197e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:01:06.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:01:06.629+0000 7f26ded9d640 1 -- 172.21.15.99:0/3872851503 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26e019fa70 con 0x7f26e01026d0 2024-09-19T06:01:06.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:01:06.629+0000 7f26ded9d640 1 --2- 172.21.15.99:0/3872851503 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f26e01026d0 0x7f26e019f400 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f26d800eaa0 tx=0x7f26d800ef60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:01:06.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:01:06.629+0000 7f26d77fe640 1 -- 172.21.15.99:0/3872851503 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26d800cdb0 con 0x7f26e01026d0 2024-09-19T06:01:06.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:01:06.629+0000 7f26d77fe640 1 -- 172.21.15.99:0/3872851503 <== mon.2 v2:172.21.15.99:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f26d8005020 con 0x7f26e01026d0 2024-09-19T06:01:06.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:01:06.629+0000 7f26e4860640 1 -- 172.21.15.99:0/3872851503 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26e019fd60 con 0x7f26e01026d0 2024-09-19T06:01:06.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:01:06.629+0000 7f26d77fe640 1 -- 172.21.15.99:0/3872851503 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26d80116b0 con 0x7f26e01026d0 2024-09-19T06:01:06.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:01:06.629+0000 7f26e4860640 1 -- 172.21.15.99:0/3872851503 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26e01a0210 con 0x7f26e01026d0 2024-09-19T06:01:06.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:01:06.630+0000 7f26e4860640 1 -- 172.21.15.99:0/3872851503 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26e0107e40 con 0x7f26e01026d0 2024-09-19T06:01:06.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:01:06.632+0000 7f26d77fe640 1 -- 172.21.15.99:0/3872851503 <== mon.2 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f26d8005560 con 0x7f26e01026d0 2024-09-19T06:01:06.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:01:06.632+0000 7f26d77fe640 1 --2- 172.21.15.99:0/3872851503 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f26cc0a3270 0x7f26cc0a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:01:06.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:01:06.632+0000 7f26d77fe640 1 -- 172.21.15.99:0/3872851503 <== mon.2 v2:172.21.15.99:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 4965+0+0 (secure 0 0 0) 0x7f26d80cf1b0 con 0x7f26e01026d0 2024-09-19T06:01:06.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:01:06.633+0000 7f26de59c640 1 --2- 172.21.15.99:0/3872851503 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f26cc0a3270 0x7f26cc0a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:01:06.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:01:06.633+0000 7f26de59c640 1 --2- 172.21.15.99:0/3872851503 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f26cc0a3270 0x7f26cc0a5730 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f26e0101b70 tx=0x7f26d0005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:01:06.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:01:06.636+0000 7f26d77fe640 1 -- 172.21.15.99:0/3872851503 <== mon.2 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f26d8016030 con 0x7f26e01026d0 2024-09-19T06:01:06.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:06 smithi117 ceph-mon[35050]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:01:06.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:06 smithi117 ceph-mon[35050]: osdmap e43: 7 total, 6 up, 7 in 2024-09-19T06:01:06.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:06 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:01:06.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:06 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:01:06.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:06 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:06.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:06 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:06.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:06 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:01:06.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:06 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:01:06.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:06 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:01:06.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:06 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:06.751 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:06 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:01:06.751 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:06 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:01:06.751 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:06 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:06.751 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:06 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:01:06.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:01:06.812+0000 7f26e4860640 1 -- 172.21.15.99:0/3872851503 --> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f26e0062630 con 0x7f26cc0a3270 2024-09-19T06:01:06.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:06 smithi037 ceph-mon[31211]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:01:06.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:06 smithi037 ceph-mon[31211]: osdmap e43: 7 total, 6 up, 7 in 2024-09-19T06:01:06.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:06 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:01:06.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:06 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:01:06.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:06 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:06.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:06 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:06.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:06 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:01:06.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:06 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:01:06.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:06 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:01:06.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:06 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:06.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:06 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:01:06.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:06 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:01:06.825 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:06 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:06.825 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:06 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:01:07.542 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:07 smithi099 ceph-mon[35300]: purged_snaps scrub starts 2024-09-19T06:01:07.542 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:07 smithi099 ceph-mon[35300]: purged_snaps scrub ok 2024-09-19T06:01:07.542 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:07 smithi099 ceph-mon[35300]: Detected new or changed devices on smithi037 2024-09-19T06:01:07.542 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:07 smithi099 ceph-mon[35300]: Adjusting osd_memory_target on smithi037 to 5697M 2024-09-19T06:01:07.542 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:07 smithi099 ceph-mon[35300]: osd.6 [v2:172.21.15.37:6818/770433145,v1:172.21.15.37:6819/770433145] boot 2024-09-19T06:01:07.542 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:07 smithi099 ceph-mon[35300]: osdmap e44: 7 total, 7 up, 7 in 2024-09-19T06:01:07.542 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:07 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:01:07.542 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:07 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:01:07.543 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:07 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:01:07.543 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:07 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:01:07.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:07 smithi117 ceph-mon[35050]: purged_snaps scrub starts 2024-09-19T06:01:07.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:07 smithi117 ceph-mon[35050]: purged_snaps scrub ok 2024-09-19T06:01:07.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:07 smithi117 ceph-mon[35050]: Detected new or changed devices on smithi037 2024-09-19T06:01:07.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:07 smithi117 ceph-mon[35050]: Adjusting osd_memory_target on smithi037 to 5697M 2024-09-19T06:01:07.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:07 smithi117 ceph-mon[35050]: osd.6 [v2:172.21.15.37:6818/770433145,v1:172.21.15.37:6819/770433145] boot 2024-09-19T06:01:07.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:07 smithi117 ceph-mon[35050]: osdmap e44: 7 total, 7 up, 7 in 2024-09-19T06:01:07.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:07 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:01:07.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:07 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:01:07.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:07 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:01:07.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:07 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:01:07.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:07 smithi037 ceph-mon[31211]: purged_snaps scrub starts 2024-09-19T06:01:07.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:07 smithi037 ceph-mon[31211]: purged_snaps scrub ok 2024-09-19T06:01:07.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:07 smithi037 ceph-mon[31211]: Detected new or changed devices on smithi037 2024-09-19T06:01:07.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:07 smithi037 ceph-mon[31211]: Adjusting osd_memory_target on smithi037 to 5697M 2024-09-19T06:01:07.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:07 smithi037 ceph-mon[31211]: osd.6 [v2:172.21.15.37:6818/770433145,v1:172.21.15.37:6819/770433145] boot 2024-09-19T06:01:07.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:07 smithi037 ceph-mon[31211]: osdmap e44: 7 total, 7 up, 7 in 2024-09-19T06:01:07.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:07 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:01:07.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:07 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:01:07.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:07 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:01:07.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:07 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:01:08.562 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:08 smithi099 ceph-mon[35300]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:01:08.563 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:08 smithi099 ceph-mon[35300]: from='client.24275 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:01:08.563 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:08 smithi099 ceph-mon[35300]: osdmap e45: 7 total, 7 up, 7 in 2024-09-19T06:01:08.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:08 smithi117 ceph-mon[35050]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:01:08.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:08 smithi117 ceph-mon[35050]: from='client.24275 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:01:08.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:08 smithi117 ceph-mon[35050]: osdmap e45: 7 total, 7 up, 7 in 2024-09-19T06:01:08.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:08 smithi037 ceph-mon[31211]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:01:08.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:08 smithi037 ceph-mon[31211]: from='client.24275 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:01:08.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:08 smithi037 ceph-mon[31211]: osdmap e45: 7 total, 7 up, 7 in 2024-09-19T06:01:09.664 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:09 smithi099 ceph-mon[35300]: from='client.? 172.21.15.99:0/4014964861' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7199a267-c486-417c-b530-3ff03fc9eb1e"}]: dispatch 2024-09-19T06:01:09.665 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:09 smithi099 ceph-mon[35300]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7199a267-c486-417c-b530-3ff03fc9eb1e"}]: dispatch 2024-09-19T06:01:09.665 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:09 smithi099 ceph-mon[35300]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7199a267-c486-417c-b530-3ff03fc9eb1e"}]': finished 2024-09-19T06:01:09.665 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:09 smithi099 ceph-mon[35300]: osdmap e46: 8 total, 7 up, 8 in 2024-09-19T06:01:09.665 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:09 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:01:09.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:09 smithi117 ceph-mon[35050]: from='client.? 172.21.15.99:0/4014964861' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7199a267-c486-417c-b530-3ff03fc9eb1e"}]: dispatch 2024-09-19T06:01:09.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:09 smithi117 ceph-mon[35050]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7199a267-c486-417c-b530-3ff03fc9eb1e"}]: dispatch 2024-09-19T06:01:09.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:09 smithi117 ceph-mon[35050]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7199a267-c486-417c-b530-3ff03fc9eb1e"}]': finished 2024-09-19T06:01:09.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:09 smithi117 ceph-mon[35050]: osdmap e46: 8 total, 7 up, 8 in 2024-09-19T06:01:09.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:09 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:01:09.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:09 smithi037 ceph-mon[31211]: from='client.? 172.21.15.99:0/4014964861' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7199a267-c486-417c-b530-3ff03fc9eb1e"}]: dispatch 2024-09-19T06:01:09.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:09 smithi037 ceph-mon[31211]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7199a267-c486-417c-b530-3ff03fc9eb1e"}]: dispatch 2024-09-19T06:01:09.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:09 smithi037 ceph-mon[31211]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7199a267-c486-417c-b530-3ff03fc9eb1e"}]': finished 2024-09-19T06:01:09.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:09 smithi037 ceph-mon[31211]: osdmap e46: 8 total, 7 up, 8 in 2024-09-19T06:01:09.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:09 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:01:10.688 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:10 smithi099 ceph-mon[35300]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:01:10.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:10 smithi099 ceph-mon[35300]: from='client.? 172.21.15.99:0/3758317825' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:01:10.749 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:10 smithi117 ceph-mon[35050]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:01:10.749 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:10 smithi117 ceph-mon[35050]: from='client.? 172.21.15.99:0/3758317825' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:01:10.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:10 smithi037 ceph-mon[31211]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:01:10.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:10 smithi037 ceph-mon[31211]: from='client.? 172.21.15.99:0/3758317825' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:01:12.688 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:12 smithi099 ceph-mon[35300]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:01:12.749 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:12 smithi117 ceph-mon[35050]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:01:12.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:12 smithi037 ceph-mon[31211]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:01:14.570 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:14 smithi099 ceph-mon[35300]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:01:14.626 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:14 smithi037 ceph-mon[31211]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:01:14.749 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:14 smithi117 ceph-mon[35050]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:01:16.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:16 smithi099 ceph-mon[35300]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:01:16.749 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:16 smithi117 ceph-mon[35050]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:01:16.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:16 smithi037 ceph-mon[31211]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:01:18.433 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:18 smithi099 ceph-mon[35300]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:01:18.433 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:18 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T06:01:18.433 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:18 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:01:18.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:18 smithi117 ceph-mon[35050]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:01:18.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:18 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T06:01:18.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:18 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:01:18.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:18 smithi037 ceph-mon[31211]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:01:18.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:18 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T06:01:18.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:18 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:01:19.561 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:19 smithi099 ceph-mon[35300]: Deploying daemon osd.7 on smithi099 2024-09-19T06:01:19.749 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:19 smithi117 ceph-mon[35050]: Deploying daemon osd.7 on smithi099 2024-09-19T06:01:19.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:19 smithi037 ceph-mon[31211]: Deploying daemon osd.7 on smithi099 2024-09-19T06:01:20.438 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:20 smithi099 ceph-mon[35300]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:01:20.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:20 smithi117 ceph-mon[35050]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:01:20.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:20 smithi037 ceph-mon[31211]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:01:22.669 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:22 smithi099 ceph-mon[35300]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:01:22.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:22 smithi117 ceph-mon[35050]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:01:22.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:22 smithi037 ceph-mon[31211]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:01:24.688 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:24 smithi099 ceph-mon[35300]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:01:24.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:24 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:01:24.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:24 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:24.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:24 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:24.749 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:24 smithi117 ceph-mon[35050]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:01:24.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:24 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:01:24.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:24 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:24.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:24 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:24.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:24 smithi037 ceph-mon[31211]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:01:24.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:24 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:01:24.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:24 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:24.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:24 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:26.650 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:26 smithi099 ceph-mon[35300]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:01:26.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:26 smithi117 ceph-mon[35050]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:01:26.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:26 smithi037 ceph-mon[31211]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:01:27.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:01:27.413+0000 7f26d77fe640 1 -- 172.21.15.99:0/3872851503 <== mgr.14148 v2:172.21.15.37:6800/3797010169 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f26e0062630 con 0x7f26cc0a3270 2024-09-19T06:01:27.415 INFO:teuthology.orchestra.run.smithi099.stdout:Created osd(s) 7 on host 'smithi099' 2024-09-19T06:01:27.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:01:27.417+0000 7f26e4860640 1 -- 172.21.15.99:0/3872851503 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f26cc0a3270 msgr2=0x7f26cc0a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:01:27.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:01:27.417+0000 7f26e4860640 1 --2- 172.21.15.99:0/3872851503 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f26cc0a3270 0x7f26cc0a5730 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f26e0101b70 tx=0x7f26d0005f90 comp rx=0 tx=0).stop 2024-09-19T06:01:27.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:01:27.417+0000 7f26e4860640 1 -- 172.21.15.99:0/3872851503 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f26e01026d0 msgr2=0x7f26e019f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:01:27.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:01:27.417+0000 7f26e4860640 1 --2- 172.21.15.99:0/3872851503 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f26e01026d0 0x7f26e019f400 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f26d800eaa0 tx=0x7f26d800ef60 comp rx=0 tx=0).stop 2024-09-19T06:01:27.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:01:27.417+0000 7f26e4860640 1 -- 172.21.15.99:0/3872851503 shutdown_connections 2024-09-19T06:01:27.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:01:27.417+0000 7f26e4860640 1 --2- 172.21.15.99:0/3872851503 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f26cc0a3270 0x7f26cc0a5730 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:01:27.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:01:27.417+0000 7f26e4860640 1 --2- 172.21.15.99:0/3872851503 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f26e01026d0 0x7f26e019f400 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:01:27.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:01:27.417+0000 7f26e4860640 1 --2- 172.21.15.99:0/3872851503 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26e0101d10 0x7f26e0198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:01:27.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:01:27.417+0000 7f26e4860640 1 --2- 172.21.15.99:0/3872851503 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26e0100b10 0x7f26e0197e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:01:27.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:01:27.417+0000 7f26e4860640 1 -- 172.21.15.99:0/3872851503 >> 172.21.15.99:0/3872851503 conn(0x7f26e00fc2a0 msgr2=0x7f26e0105010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:01:27.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:01:27.417+0000 7f26e4860640 1 -- 172.21.15.99:0/3872851503 shutdown_connections 2024-09-19T06:01:27.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:01:27.417+0000 7f26e4860640 1 -- 172.21.15.99:0/3872851503 wait complete. 2024-09-19T06:01:27.645 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:27 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:27.646 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:27 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:27.646 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:27 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:01:27.646 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:27 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:01:27.646 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:27 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:27.749 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:27 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:27.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:27 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:27.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:27 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:01:27.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:27 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:01:27.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:27 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:27.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:27 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:27.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:27 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:27.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:27 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:01:27.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:27 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:01:27.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:27 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:28.087 DEBUG:teuthology.orchestra.run.smithi099:osd.7> sudo journalctl -f -n 0 -u ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@osd.7.service 2024-09-19T06:01:28.089 INFO:tasks.cephadm:Deploying osd.8 on smithi117 with /dev/vg_nvme/lv_2... 2024-09-19T06:01:28.089 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T06:01:28.340 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:01:28.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:28 smithi099 ceph-mon[35300]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:01:28.618 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:28 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:01:28.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:28 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:28.619 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:28 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:28.711 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:28 smithi117 ceph-mon[35050]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:01:28.711 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:28 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:01:28.711 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:28 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:28.711 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:28 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:28.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:28 smithi037 ceph-mon[31211]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:01:28.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:28 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:01:28.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:28 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:28.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:28 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:29.614 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:29 smithi099 ceph-mon[35300]: from='osd.7 [v2:172.21.15.99:6816/1694360992,v1:172.21.15.99:6817/1694360992]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T06:01:29.614 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:29 smithi099 ceph-mon[35300]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T06:01:29.614 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 06:01:29 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-7[53481]: 2024-09-19T06:01:29.372+0000 7f5c989bf640 -1 osd.7 0 log_to_monitors true 2024-09-19T06:01:29.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:29 smithi117 ceph-mon[35050]: from='osd.7 [v2:172.21.15.99:6816/1694360992,v1:172.21.15.99:6817/1694360992]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T06:01:29.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:29 smithi117 ceph-mon[35050]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T06:01:29.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:29 smithi037 ceph-mon[31211]: from='osd.7 [v2:172.21.15.99:6816/1694360992,v1:172.21.15.99:6817/1694360992]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T06:01:29.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:29 smithi037 ceph-mon[31211]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T06:01:30.647 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:30 smithi099 ceph-mon[35300]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:01:30.647 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:30 smithi099 ceph-mon[35300]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T06:01:30.647 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:30 smithi099 ceph-mon[35300]: osdmap e47: 8 total, 7 up, 8 in 2024-09-19T06:01:30.647 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:30 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:01:30.647 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:30 smithi099 ceph-mon[35300]: from='osd.7 [v2:172.21.15.99:6816/1694360992,v1:172.21.15.99:6817/1694360992]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-19T06:01:30.647 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:30 smithi099 ceph-mon[35300]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-19T06:01:30.728 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:30 smithi117 ceph-mon[35050]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:01:30.728 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:30 smithi117 ceph-mon[35050]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T06:01:30.728 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:30 smithi117 ceph-mon[35050]: osdmap e47: 8 total, 7 up, 8 in 2024-09-19T06:01:30.728 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:30 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:01:30.728 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:30 smithi117 ceph-mon[35050]: from='osd.7 [v2:172.21.15.99:6816/1694360992,v1:172.21.15.99:6817/1694360992]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-19T06:01:30.728 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:30 smithi117 ceph-mon[35050]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-19T06:01:30.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:30 smithi037 ceph-mon[31211]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:01:30.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:30 smithi037 ceph-mon[31211]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T06:01:30.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:30 smithi037 ceph-mon[31211]: osdmap e47: 8 total, 7 up, 8 in 2024-09-19T06:01:30.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:30 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:01:30.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:30 smithi037 ceph-mon[31211]: from='osd.7 [v2:172.21.15.99:6816/1694360992,v1:172.21.15.99:6817/1694360992]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-19T06:01:30.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:30 smithi037 ceph-mon[31211]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-19T06:01:30.901 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:01:30.929 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi117:vg_nvme/lv_2 2024-09-19T06:01:31.186 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:01:31.408 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 06:01:31 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-7[53481]: 2024-09-19T06:01:31.073+0000 7f5c94942640 -1 osd.7 0 waiting for initial osdmap 2024-09-19T06:01:31.408 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 06:01:31 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-7[53481]: 2024-09-19T06:01:31.083+0000 7f5c8c762640 -1 osd.7 48 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:01:31.586 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:31 smithi117 ceph-mon[35050]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-09-19T06:01:31.586 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:31 smithi117 ceph-mon[35050]: osdmap e48: 8 total, 7 up, 8 in 2024-09-19T06:01:31.586 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:31 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:01:31.586 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:31 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:01:31.586 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:31 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:31.587 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:31 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:31.587 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:31 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:01:31.587 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:31 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:01:31.587 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:31 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:01:31.587 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:31 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:31.587 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:31 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:01:31.587 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:31 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:01:31.587 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:31 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:31.587 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:31 smithi117 ceph-mon[35050]: from='osd.7 ' entity='osd.7' 2024-09-19T06:01:31.587 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:31 smithi117 ceph-mon[35050]: osd.7 [v2:172.21.15.99:6816/1694360992,v1:172.21.15.99:6817/1694360992] boot 2024-09-19T06:01:31.587 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:31 smithi117 ceph-mon[35050]: osdmap e49: 8 total, 8 up, 8 in 2024-09-19T06:01:31.588 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:31 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:01:31.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:01:31.667+0000 7fcb2f31c640 1 -- 172.21.15.117:0/812800360 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb2810e1e0 msgr2=0x7fcb281105d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:01:31.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:01:31.667+0000 7fcb2f31c640 1 --2- 172.21.15.117:0/812800360 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb2810e1e0 0x7fcb281105d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fcb20009ca0 tx=0x7fcb2002a8c0 comp rx=0 tx=0).stop 2024-09-19T06:01:31.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:01:31.667+0000 7fcb2f31c640 1 -- 172.21.15.117:0/812800360 shutdown_connections 2024-09-19T06:01:31.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:01:31.667+0000 7fcb2f31c640 1 --2- 172.21.15.117:0/812800360 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb2810e1e0 0x7fcb281105d0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:01:31.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:01:31.667+0000 7fcb2f31c640 1 --2- 172.21.15.117:0/812800360 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb28074c50 0x7fcb280750b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:01:31.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:01:31.667+0000 7fcb2f31c640 1 --2- 172.21.15.117:0/812800360 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcb28076220 0x7fcb28074680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:01:31.687 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:01:31.667+0000 7fcb2f31c640 1 -- 172.21.15.117:0/812800360 >> 172.21.15.117:0/812800360 conn(0x7fcb280fd390 msgr2=0x7fcb280ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:01:31.687 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:01:31.667+0000 7fcb2f31c640 1 -- 172.21.15.117:0/812800360 shutdown_connections 2024-09-19T06:01:31.687 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:01:31.667+0000 7fcb2f31c640 1 -- 172.21.15.117:0/812800360 wait complete. 2024-09-19T06:01:31.687 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:01:31.668+0000 7fcb2f31c640 1 Processor -- start 2024-09-19T06:01:31.687 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:01:31.668+0000 7fcb2f31c640 1 -- start start 2024-09-19T06:01:31.687 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:01:31.668+0000 7fcb2f31c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb28074c50 0x7fcb2819e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:01:31.687 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:01:31.668+0000 7fcb2f31c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcb28076220 0x7fcb2819e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:01:31.687 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:01:31.668+0000 7fcb2f31c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb2810e1e0 0x7fcb281a5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:01:31.687 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:01:31.668+0000 7fcb2f31c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcb28113ea0 con 0x7fcb28074c50 2024-09-19T06:01:31.687 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:01:31.668+0000 7fcb2f31c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fcb28113d20 con 0x7fcb28076220 2024-09-19T06:01:31.687 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:01:31.668+0000 7fcb2f31c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fcb28114020 con 0x7fcb2810e1e0 2024-09-19T06:01:31.687 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:01:31.668+0000 7fcb2d8b9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb2810e1e0 0x7fcb281a5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:01:31.687 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:01:31.668+0000 7fcb2d8b9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb2810e1e0 0x7fcb281a5a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:48850/0 (socket says 172.21.15.117:48850) 2024-09-19T06:01:31.688 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:01:31.668+0000 7fcb2d8b9640 1 -- 172.21.15.117:0/209575296 learned_addr learned my addr 172.21.15.117:0/209575296 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T06:01:31.688 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:01:31.668+0000 7fcb2d0b8640 1 --2- 172.21.15.117:0/209575296 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb28074c50 0x7fcb2819e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:01:31.688 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:01:31.668+0000 7fcb2c8b7640 1 --2- 172.21.15.117:0/209575296 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcb28076220 0x7fcb2819e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:01:31.688 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:01:31.668+0000 7fcb2d8b9640 1 -- 172.21.15.117:0/209575296 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcb28076220 msgr2=0x7fcb2819e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:01:31.688 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:01:31.668+0000 7fcb2d8b9640 1 --2- 172.21.15.117:0/209575296 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcb28076220 0x7fcb2819e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:01:31.688 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:01:31.669+0000 7fcb2d8b9640 1 -- 172.21.15.117:0/209575296 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb28074c50 msgr2=0x7fcb2819e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:01:31.688 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:01:31.669+0000 7fcb2d8b9640 1 --2- 172.21.15.117:0/209575296 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb28074c50 0x7fcb2819e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:01:31.688 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:01:31.669+0000 7fcb2d8b9640 1 -- 172.21.15.117:0/209575296 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb281a60c0 con 0x7fcb2810e1e0 2024-09-19T06:01:31.688 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:01:31.669+0000 7fcb2c8b7640 1 --2- 172.21.15.117:0/209575296 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcb28076220 0x7fcb2819e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:01:31.688 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:01:31.669+0000 7fcb2d8b9640 1 --2- 172.21.15.117:0/209575296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb2810e1e0 0x7fcb281a5a50 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fcb20005e30 tx=0x7fcb20031ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:01:31.688 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:01:31.669+0000 7fcb1e7fc640 1 -- 172.21.15.117:0/209575296 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb20003c30 con 0x7fcb2810e1e0 2024-09-19T06:01:31.689 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:01:31.669+0000 7fcb2f31c640 1 -- 172.21.15.117:0/209575296 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb281a6350 con 0x7fcb2810e1e0 2024-09-19T06:01:31.689 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:01:31.669+0000 7fcb1e7fc640 1 -- 172.21.15.117:0/209575296 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb20003dd0 con 0x7fcb2810e1e0 2024-09-19T06:01:31.689 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:01:31.669+0000 7fcb1e7fc640 1 -- 172.21.15.117:0/209575296 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb2002fde0 con 0x7fcb2810e1e0 2024-09-19T06:01:31.689 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:01:31.669+0000 7fcb2f31c640 1 -- 172.21.15.117:0/209575296 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb281a68e0 con 0x7fcb2810e1e0 2024-09-19T06:01:31.689 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:01:31.670+0000 7fcb2f31c640 1 -- 172.21.15.117:0/209575296 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb28103b80 con 0x7fcb2810e1e0 2024-09-19T06:01:31.689 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:01:31.671+0000 7fcb1e7fc640 1 -- 172.21.15.117:0/209575296 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fcb20004050 con 0x7fcb2810e1e0 2024-09-19T06:01:31.689 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:01:31.672+0000 7fcb1e7fc640 1 --2- 172.21.15.117:0/209575296 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fcb140a3270 0x7fcb140a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:01:31.689 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:01:31.672+0000 7fcb1e7fc640 1 -- 172.21.15.117:0/209575296 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5430+0+0 (secure 0 0 0) 0x7fcb200f0000 con 0x7fcb2810e1e0 2024-09-19T06:01:31.689 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:01:31.672+0000 7fcb2d0b8640 1 --2- 172.21.15.117:0/209575296 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fcb140a3270 0x7fcb140a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:01:31.689 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:01:31.672+0000 7fcb2d0b8640 1 --2- 172.21.15.117:0/209575296 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fcb140a3270 0x7fcb140a5730 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcb24005fd0 tx=0x7fcb2400b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:01:31.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:01:31.676+0000 7fcb1e7fc640 1 -- 172.21.15.117:0/209575296 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcb200bd860 con 0x7fcb2810e1e0 2024-09-19T06:01:31.690 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:31 smithi099 ceph-mon[35300]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-09-19T06:01:31.690 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:31 smithi099 ceph-mon[35300]: osdmap e48: 8 total, 7 up, 8 in 2024-09-19T06:01:31.690 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:31 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:01:31.690 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:31 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:01:31.691 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:31 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:31.691 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:31 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:31.691 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:31 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:01:31.691 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:31 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:01:31.691 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:31 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:01:31.691 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:31 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:31.691 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:31 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:01:31.691 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:31 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:01:31.691 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:31 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:31.692 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:31 smithi099 ceph-mon[35300]: from='osd.7 ' entity='osd.7' 2024-09-19T06:01:31.692 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:31 smithi099 ceph-mon[35300]: osd.7 [v2:172.21.15.99:6816/1694360992,v1:172.21.15.99:6817/1694360992] boot 2024-09-19T06:01:31.692 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:31 smithi099 ceph-mon[35300]: osdmap e49: 8 total, 8 up, 8 in 2024-09-19T06:01:31.692 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:31 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:01:31.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:31 smithi037 ceph-mon[31211]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-09-19T06:01:31.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:31 smithi037 ceph-mon[31211]: osdmap e48: 8 total, 7 up, 8 in 2024-09-19T06:01:31.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:31 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:01:31.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:31 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:01:31.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:31 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:31.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:31 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:31.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:31 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:01:31.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:31 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:01:31.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:31 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:01:31.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:31 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:31.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:31 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:01:31.825 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:31 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:01:31.825 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:31 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:31.825 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:31 smithi037 ceph-mon[31211]: from='osd.7 ' entity='osd.7' 2024-09-19T06:01:31.825 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:31 smithi037 ceph-mon[31211]: osd.7 [v2:172.21.15.99:6816/1694360992,v1:172.21.15.99:6817/1694360992] boot 2024-09-19T06:01:31.825 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:31 smithi037 ceph-mon[31211]: osdmap e49: 8 total, 8 up, 8 in 2024-09-19T06:01:31.825 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:31 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:01:31.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:01:31.852+0000 7fcb2f31c640 1 -- 172.21.15.117:0/209575296 --> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fcb28062630 con 0x7fcb140a3270 2024-09-19T06:01:32.522 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:32 smithi117 ceph-mon[35050]: purged_snaps scrub starts 2024-09-19T06:01:32.522 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:32 smithi117 ceph-mon[35050]: purged_snaps scrub ok 2024-09-19T06:01:32.522 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:32 smithi117 ceph-mon[35050]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:01:32.522 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:32 smithi117 ceph-mon[35050]: Detected new or changed devices on smithi099 2024-09-19T06:01:32.522 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:32 smithi117 ceph-mon[35050]: Adjusting osd_memory_target on smithi099 to 5696M 2024-09-19T06:01:32.522 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:32 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:01:32.522 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:32 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:01:32.523 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:32 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:01:32.523 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:32 smithi117 ceph-mon[35050]: osdmap e50: 8 total, 8 up, 8 in 2024-09-19T06:01:32.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:32 smithi099 ceph-mon[35300]: purged_snaps scrub starts 2024-09-19T06:01:32.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:32 smithi099 ceph-mon[35300]: purged_snaps scrub ok 2024-09-19T06:01:32.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:32 smithi099 ceph-mon[35300]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:01:32.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:32 smithi099 ceph-mon[35300]: Detected new or changed devices on smithi099 2024-09-19T06:01:32.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:32 smithi099 ceph-mon[35300]: Adjusting osd_memory_target on smithi099 to 5696M 2024-09-19T06:01:32.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:32 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:01:32.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:32 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:01:32.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:32 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:01:32.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:32 smithi099 ceph-mon[35300]: osdmap e50: 8 total, 8 up, 8 in 2024-09-19T06:01:32.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:32 smithi037 ceph-mon[31211]: purged_snaps scrub starts 2024-09-19T06:01:32.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:32 smithi037 ceph-mon[31211]: purged_snaps scrub ok 2024-09-19T06:01:32.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:32 smithi037 ceph-mon[31211]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:01:32.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:32 smithi037 ceph-mon[31211]: Detected new or changed devices on smithi099 2024-09-19T06:01:32.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:32 smithi037 ceph-mon[31211]: Adjusting osd_memory_target on smithi099 to 5696M 2024-09-19T06:01:32.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:32 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:01:32.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:32 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:01:32.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:32 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:01:32.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:32 smithi037 ceph-mon[31211]: osdmap e50: 8 total, 8 up, 8 in 2024-09-19T06:01:33.467 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:33 smithi117 ceph-mon[35050]: from='client.24283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:01:33.468 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:33 smithi117 ceph-mon[35050]: osdmap e51: 8 total, 8 up, 8 in 2024-09-19T06:01:33.688 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:33 smithi099 ceph-mon[35300]: from='client.24283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:01:33.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:33 smithi099 ceph-mon[35300]: osdmap e51: 8 total, 8 up, 8 in 2024-09-19T06:01:33.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:33 smithi037 ceph-mon[31211]: from='client.24283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:01:33.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:33 smithi037 ceph-mon[31211]: osdmap e51: 8 total, 8 up, 8 in 2024-09-19T06:01:34.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:34 smithi099 ceph-mon[35300]: pgmap v170: 1 pgs: 1 remapped; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:01:34.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:34 smithi099 ceph-mon[35300]: from='client.? 172.21.15.117:0/1809991974' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8d5bb83c-62eb-4ded-8a16-e8d57ab102c9"}]: dispatch 2024-09-19T06:01:34.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:34 smithi099 ceph-mon[35300]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8d5bb83c-62eb-4ded-8a16-e8d57ab102c9"}]: dispatch 2024-09-19T06:01:34.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:34 smithi099 ceph-mon[35300]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8d5bb83c-62eb-4ded-8a16-e8d57ab102c9"}]': finished 2024-09-19T06:01:34.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:34 smithi099 ceph-mon[35300]: osdmap e52: 9 total, 8 up, 9 in 2024-09-19T06:01:34.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:34 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:01:34.713 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:34 smithi117 ceph-mon[35050]: pgmap v170: 1 pgs: 1 remapped; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:01:34.714 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:34 smithi117 ceph-mon[35050]: from='client.? 172.21.15.117:0/1809991974' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8d5bb83c-62eb-4ded-8a16-e8d57ab102c9"}]: dispatch 2024-09-19T06:01:34.714 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:34 smithi117 ceph-mon[35050]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8d5bb83c-62eb-4ded-8a16-e8d57ab102c9"}]: dispatch 2024-09-19T06:01:34.714 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:34 smithi117 ceph-mon[35050]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8d5bb83c-62eb-4ded-8a16-e8d57ab102c9"}]': finished 2024-09-19T06:01:34.714 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:34 smithi117 ceph-mon[35050]: osdmap e52: 9 total, 8 up, 9 in 2024-09-19T06:01:34.714 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:34 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:01:34.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:34 smithi037 ceph-mon[31211]: pgmap v170: 1 pgs: 1 remapped; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:01:34.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:34 smithi037 ceph-mon[31211]: from='client.? 172.21.15.117:0/1809991974' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8d5bb83c-62eb-4ded-8a16-e8d57ab102c9"}]: dispatch 2024-09-19T06:01:34.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:34 smithi037 ceph-mon[31211]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8d5bb83c-62eb-4ded-8a16-e8d57ab102c9"}]: dispatch 2024-09-19T06:01:34.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:34 smithi037 ceph-mon[31211]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8d5bb83c-62eb-4ded-8a16-e8d57ab102c9"}]': finished 2024-09-19T06:01:34.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:34 smithi037 ceph-mon[31211]: osdmap e52: 9 total, 8 up, 9 in 2024-09-19T06:01:34.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:34 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:01:35.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:35 smithi099 ceph-mon[35300]: from='client.? 172.21.15.117:0/4174342650' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:01:35.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:35 smithi099 ceph-mon[35300]: osdmap e53: 9 total, 8 up, 9 in 2024-09-19T06:01:35.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:35 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:01:35.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:35 smithi117 ceph-mon[35050]: from='client.? 172.21.15.117:0/4174342650' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:01:35.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:35 smithi117 ceph-mon[35050]: osdmap e53: 9 total, 8 up, 9 in 2024-09-19T06:01:35.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:35 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:01:35.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:35 smithi037 ceph-mon[31211]: from='client.? 172.21.15.117:0/4174342650' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:01:35.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:35 smithi037 ceph-mon[31211]: osdmap e53: 9 total, 8 up, 9 in 2024-09-19T06:01:35.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:35 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:01:36.688 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:36 smithi099 ceph-mon[35300]: pgmap v173: 1 pgs: 1 remapped; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:01:36.749 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:36 smithi117 ceph-mon[35050]: pgmap v173: 1 pgs: 1 remapped; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:01:36.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:36 smithi037 ceph-mon[31211]: pgmap v173: 1 pgs: 1 remapped; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:01:38.688 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:38 smithi099 ceph-mon[35300]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:01:38.749 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:38 smithi117 ceph-mon[35050]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:01:38.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:38 smithi037 ceph-mon[31211]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:01:40.499 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:40 smithi117 ceph-mon[35050]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:01:40.688 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:40 smithi099 ceph-mon[35300]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:01:40.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:40 smithi037 ceph-mon[31211]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:01:42.690 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:42 smithi099 ceph-mon[35300]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:01:42.691 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:42 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T06:01:42.691 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:42 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:01:42.696 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:42 smithi117 ceph-mon[35050]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:01:42.696 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:42 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T06:01:42.696 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:42 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:01:42.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:42 smithi037 ceph-mon[31211]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:01:42.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:42 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T06:01:42.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:42 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:01:43.707 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:43 smithi117 ceph-mon[35050]: Deploying daemon osd.8 on smithi117 2024-09-19T06:01:43.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:43 smithi037 ceph-mon[31211]: Deploying daemon osd.8 on smithi117 2024-09-19T06:01:43.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:43 smithi099 ceph-mon[35300]: Deploying daemon osd.8 on smithi117 2024-09-19T06:01:44.658 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:44 smithi117 ceph-mon[35050]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:01:44.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:44 smithi037 ceph-mon[31211]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:01:44.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:44 smithi099 ceph-mon[35300]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:01:46.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:46 smithi117 ceph-mon[35050]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:01:46.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:46 smithi037 ceph-mon[31211]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:01:46.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:46 smithi099 ceph-mon[35300]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:01:48.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:48 smithi117 ceph-mon[35050]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:01:48.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:48 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:01:48.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:48 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:48.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:48 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:48.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:48 smithi037 ceph-mon[31211]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:01:48.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:48 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:01:48.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:48 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:48.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:48 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:48.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:48 smithi099 ceph-mon[35300]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:01:48.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:48 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:01:48.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:48 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:48.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:48 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:50.755 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:50 smithi117 ceph-mon[35050]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:01:50.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:50 smithi037 ceph-mon[31211]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:01:50.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:50 smithi099 ceph-mon[35300]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:01:51.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:51 smithi117 ceph-mon[35050]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:01:51.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:51 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:51.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:51 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:51.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:51 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:01:51.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:51 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:01:51.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:51 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:51.839 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:01:51.837+0000 7fcb1e7fc640 1 -- 172.21.15.117:0/209575296 <== mgr.14148 v2:172.21.15.37:6800/3797010169 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fcb28062630 con 0x7fcb140a3270 2024-09-19T06:01:51.839 INFO:teuthology.orchestra.run.smithi117.stdout:Created osd(s) 8 on host 'smithi117' 2024-09-19T06:01:51.841 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:01:51.839+0000 7fcb2f31c640 1 -- 172.21.15.117:0/209575296 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fcb140a3270 msgr2=0x7fcb140a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:01:51.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:01:51.839+0000 7fcb2f31c640 1 --2- 172.21.15.117:0/209575296 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fcb140a3270 0x7fcb140a5730 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcb24005fd0 tx=0x7fcb2400b390 comp rx=0 tx=0).stop 2024-09-19T06:01:51.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:01:51.839+0000 7fcb2f31c640 1 -- 172.21.15.117:0/209575296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb2810e1e0 msgr2=0x7fcb281a5a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:01:51.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:01:51.839+0000 7fcb2f31c640 1 --2- 172.21.15.117:0/209575296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb2810e1e0 0x7fcb281a5a50 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fcb20005e30 tx=0x7fcb20031ee0 comp rx=0 tx=0).stop 2024-09-19T06:01:51.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:01:51.839+0000 7fcb2f31c640 1 -- 172.21.15.117:0/209575296 shutdown_connections 2024-09-19T06:01:51.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:01:51.839+0000 7fcb2f31c640 1 --2- 172.21.15.117:0/209575296 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fcb140a3270 0x7fcb140a5730 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:01:51.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:01:51.839+0000 7fcb2f31c640 1 --2- 172.21.15.117:0/209575296 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcb28076220 0x7fcb2819e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:01:51.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:01:51.839+0000 7fcb2f31c640 1 --2- 172.21.15.117:0/209575296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb2810e1e0 0x7fcb281a5a50 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:01:51.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:01:51.839+0000 7fcb2f31c640 1 --2- 172.21.15.117:0/209575296 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb28074c50 0x7fcb2819e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:01:51.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:01:51.840+0000 7fcb2f31c640 1 -- 172.21.15.117:0/209575296 >> 172.21.15.117:0/209575296 conn(0x7fcb280fd390 msgr2=0x7fcb280ff780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:01:51.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:01:51.840+0000 7fcb2f31c640 1 -- 172.21.15.117:0/209575296 shutdown_connections 2024-09-19T06:01:51.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:01:51.840+0000 7fcb2f31c640 1 -- 172.21.15.117:0/209575296 wait complete. 2024-09-19T06:01:52.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:51 smithi037 ceph-mon[31211]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:01:52.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:51 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:52.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:51 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:52.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:51 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:01:52.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:51 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:01:52.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:51 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:52.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:51 smithi099 ceph-mon[35300]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:01:52.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:51 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:52.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:51 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:52.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:51 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:01:52.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:51 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:01:52.190 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:51 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:52.510 DEBUG:teuthology.orchestra.run.smithi117:osd.8> sudo journalctl -f -n 0 -u ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@osd.8.service 2024-09-19T06:01:52.513 INFO:tasks.cephadm:Deploying osd.9 on smithi037 with /dev/vg_nvme/lv_1... 2024-09-19T06:01:52.513 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T06:01:52.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:52 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:01:52.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:52 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:52.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:52 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:52.782 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:01:52.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:52 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:01:52.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:52 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:52.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:52 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:53.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:52 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:01:53.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:52 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:53.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:52 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:53.944 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:53 smithi117 ceph-mon[35050]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:01:53.944 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:01:53 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:01:53.860+0000 7f7927e26640 -1 osd.8 0 log_to_monitors true 2024-09-19T06:01:54.090 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:53 smithi099 ceph-mon[35300]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:01:54.230 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:53 smithi037 ceph-mon[31211]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:01:55.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:54 smithi117 ceph-mon[35050]: from='osd.8 [v2:172.21.15.117:6816/2005866772,v1:172.21.15.117:6817/2005866772]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T06:01:55.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:54 smithi117 ceph-mon[35050]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T06:01:55.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:54 smithi037 ceph-mon[31211]: from='osd.8 [v2:172.21.15.117:6816/2005866772,v1:172.21.15.117:6817/2005866772]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T06:01:55.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:54 smithi037 ceph-mon[31211]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T06:01:55.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:54 smithi099 ceph-mon[35300]: from='osd.8 [v2:172.21.15.117:6816/2005866772,v1:172.21.15.117:6817/2005866772]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T06:01:55.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:54 smithi099 ceph-mon[35300]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T06:01:55.625 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T06:01:55.653 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi037:vg_nvme/lv_1 2024-09-19T06:01:55.926 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:01:56.048 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:55 smithi037 ceph-mon[31211]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:01:56.048 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:55 smithi037 ceph-mon[31211]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T06:01:56.049 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:55 smithi037 ceph-mon[31211]: from='osd.8 [v2:172.21.15.117:6816/2005866772,v1:172.21.15.117:6817/2005866772]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-19T06:01:56.049 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:55 smithi037 ceph-mon[31211]: osdmap e54: 9 total, 8 up, 9 in 2024-09-19T06:01:56.049 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:55 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:01:56.049 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:55 smithi037 ceph-mon[31211]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-19T06:01:56.049 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:55 smithi037 ceph-mon[31211]: Detected new or changed devices on smithi117 2024-09-19T06:01:56.049 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:55 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:56.049 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:55 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:56.049 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:55 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:01:56.049 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:55 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:01:56.049 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:55 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:01:56.049 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:55 smithi037 ceph-mon[31211]: Adjusting osd_memory_target on smithi117 to 5696M 2024-09-19T06:01:56.049 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:55 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:56.049 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:55 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:01:56.050 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:55 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:01:56.050 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:55 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:56.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:55 smithi099 ceph-mon[35300]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:01:56.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:55 smithi099 ceph-mon[35300]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T06:01:56.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:55 smithi099 ceph-mon[35300]: from='osd.8 [v2:172.21.15.117:6816/2005866772,v1:172.21.15.117:6817/2005866772]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-19T06:01:56.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:55 smithi099 ceph-mon[35300]: osdmap e54: 9 total, 8 up, 9 in 2024-09-19T06:01:56.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:55 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:01:56.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:55 smithi099 ceph-mon[35300]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-19T06:01:56.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:55 smithi099 ceph-mon[35300]: Detected new or changed devices on smithi117 2024-09-19T06:01:56.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:55 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:56.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:55 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:56.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:55 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:01:56.190 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:55 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:01:56.190 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:55 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:01:56.190 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:55 smithi099 ceph-mon[35300]: Adjusting osd_memory_target on smithi117 to 5696M 2024-09-19T06:01:56.190 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:55 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:56.190 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:55 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:01:56.190 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:55 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:01:56.190 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:55 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:56.250 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:01:55 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:01:55.849+0000 7f7923da9640 -1 osd.8 0 waiting for initial osdmap 2024-09-19T06:01:56.250 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:01:55 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:01:55.858+0000 7f791fbd1640 -1 osd.8 55 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:01:56.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:55 smithi117 ceph-mon[35050]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:01:56.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:55 smithi117 ceph-mon[35050]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T06:01:56.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:55 smithi117 ceph-mon[35050]: from='osd.8 [v2:172.21.15.117:6816/2005866772,v1:172.21.15.117:6817/2005866772]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-19T06:01:56.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:55 smithi117 ceph-mon[35050]: osdmap e54: 9 total, 8 up, 9 in 2024-09-19T06:01:56.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:55 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:01:56.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:55 smithi117 ceph-mon[35050]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-19T06:01:56.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:55 smithi117 ceph-mon[35050]: Detected new or changed devices on smithi117 2024-09-19T06:01:56.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:55 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:56.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:55 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:56.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:55 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:01:56.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:55 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:01:56.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:55 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:01:56.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:55 smithi117 ceph-mon[35050]: Adjusting osd_memory_target on smithi117 to 5696M 2024-09-19T06:01:56.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:55 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:56.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:55 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:01:56.252 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:55 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:01:56.252 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:55 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:01:56.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:01:56.435+0000 7f0a1da0e640 1 -- 172.21.15.37:0/3320461540 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a181026c0 msgr2=0x7f0a18108f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:01:56.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:01:56.435+0000 7f0a1da0e640 1 --2- 172.21.15.37:0/3320461540 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a181026c0 0x7f0a18108f50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0a10009ca0 tx=0x7f0a1002a8c0 comp rx=0 tx=0).stop 2024-09-19T06:01:56.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:01:56.435+0000 7f0a1da0e640 1 -- 172.21.15.37:0/3320461540 shutdown_connections 2024-09-19T06:01:56.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:01:56.435+0000 7f0a1da0e640 1 --2- 172.21.15.37:0/3320461540 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a18101d00 0x7f0a18102180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:01:56.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:01:56.435+0000 7f0a1da0e640 1 --2- 172.21.15.37:0/3320461540 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a181026c0 0x7f0a18108f50 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:01:56.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:01:56.435+0000 7f0a1da0e640 1 --2- 172.21.15.37:0/3320461540 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a18100b00 0x7f0a18100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:01:56.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:01:56.435+0000 7f0a1da0e640 1 -- 172.21.15.37:0/3320461540 >> 172.21.15.37:0/3320461540 conn(0x7f0a180fc270 msgr2=0x7f0a180fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:01:56.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:01:56.436+0000 7f0a1da0e640 1 -- 172.21.15.37:0/3320461540 shutdown_connections 2024-09-19T06:01:56.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:01:56.436+0000 7f0a1da0e640 1 -- 172.21.15.37:0/3320461540 wait complete. 2024-09-19T06:01:56.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:01:56.436+0000 7f0a1da0e640 1 Processor -- start 2024-09-19T06:01:56.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:01:56.436+0000 7f0a1da0e640 1 -- start start 2024-09-19T06:01:56.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:01:56.437+0000 7f0a1da0e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a18100b00 0x7f0a18198100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:01:56.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:01:56.437+0000 7f0a1da0e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a18101d00 0x7f0a18198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:01:56.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:01:56.437+0000 7f0a1da0e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a181026c0 0x7f0a1819f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:01:56.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:01:56.437+0000 7f0a1da0e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0a1810d990 con 0x7f0a18101d00 2024-09-19T06:01:56.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:01:56.437+0000 7f0a1da0e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f0a1810d810 con 0x7f0a18100b00 2024-09-19T06:01:56.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:01:56.437+0000 7f0a1da0e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0a1810db10 con 0x7f0a181026c0 2024-09-19T06:01:56.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:01:56.437+0000 7f0a0e7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a18101d00 0x7f0a18198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:01:56.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:01:56.437+0000 7f0a0e7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a18101d00 0x7f0a18198640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56234/0 (socket says 172.21.15.37:56234) 2024-09-19T06:01:56.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:01:56.437+0000 7f0a16ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a18100b00 0x7f0a18198100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:01:56.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:01:56.437+0000 7f0a0e7fc640 1 -- 172.21.15.37:0/1027955229 learned_addr learned my addr 172.21.15.37:0/1027955229 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:01:56.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:01:56.437+0000 7f0a177fe640 1 --2- 172.21.15.37:0/1027955229 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a181026c0 0x7f0a1819f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:01:56.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:01:56.437+0000 7f0a0e7fc640 1 -- 172.21.15.37:0/1027955229 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a181026c0 msgr2=0x7f0a1819f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:01:56.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:01:56.437+0000 7f0a0e7fc640 1 --2- 172.21.15.37:0/1027955229 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a181026c0 0x7f0a1819f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:01:56.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:01:56.437+0000 7f0a0e7fc640 1 -- 172.21.15.37:0/1027955229 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a18100b00 msgr2=0x7f0a18198100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:01:56.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:01:56.437+0000 7f0a0e7fc640 1 --2- 172.21.15.37:0/1027955229 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a18100b00 0x7f0a18198100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:01:56.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:01:56.437+0000 7f0a0e7fc640 1 -- 172.21.15.37:0/1027955229 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a1819fd30 con 0x7f0a18101d00 2024-09-19T06:01:56.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:01:56.437+0000 7f0a16ffd640 1 --2- 172.21.15.37:0/1027955229 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a18100b00 0x7f0a18198100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:01:56.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:01:56.437+0000 7f0a177fe640 1 --2- 172.21.15.37:0/1027955229 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a181026c0 0x7f0a1819f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:01:56.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:01:56.437+0000 7f0a0e7fc640 1 --2- 172.21.15.37:0/1027955229 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a18101d00 0x7f0a18198640 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0a0000b4a0 tx=0x7f0a0000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:01:56.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:01:56.438+0000 7f0a1ca0c640 1 -- 172.21.15.37:0/1027955229 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a00015020 con 0x7f0a18101d00 2024-09-19T06:01:56.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:01:56.438+0000 7f0a1da0e640 1 -- 172.21.15.37:0/1027955229 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a1819ffc0 con 0x7f0a18101d00 2024-09-19T06:01:56.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:01:56.438+0000 7f0a1ca0c640 1 -- 172.21.15.37:0/1027955229 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a00011d10 con 0x7f0a18101d00 2024-09-19T06:01:56.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:01:56.438+0000 7f0a1ca0c640 1 -- 172.21.15.37:0/1027955229 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a0000f2e0 con 0x7f0a18101d00 2024-09-19T06:01:56.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:01:56.438+0000 7f0a1da0e640 1 -- 172.21.15.37:0/1027955229 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a181a05a0 con 0x7f0a18101d00 2024-09-19T06:01:56.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:01:56.439+0000 7f0a1da0e640 1 -- 172.21.15.37:0/1027955229 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a18108040 con 0x7f0a18101d00 2024-09-19T06:01:56.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:01:56.441+0000 7f0a1ca0c640 1 -- 172.21.15.37:0/1027955229 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f0a00018020 con 0x7f0a18101d00 2024-09-19T06:01:56.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:01:56.442+0000 7f0a1ca0c640 1 --2- 172.21.15.37:0/1027955229 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f0a040a3270 0x7f0a040a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:01:56.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:01:56.442+0000 7f0a16ffd640 1 --2- 172.21.15.37:0/1027955229 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f0a040a3270 0x7f0a040a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:01:56.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:01:56.442+0000 7f0a1ca0c640 1 -- 172.21.15.37:0/1027955229 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5549+0+0 (secure 0 0 0) 0x7f0a000ce7b0 con 0x7f0a18101d00 2024-09-19T06:01:56.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:01:56.442+0000 7f0a16ffd640 1 --2- 172.21.15.37:0/1027955229 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f0a040a3270 0x7f0a040a5730 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0a18101b60 tx=0x7f0a08009110 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:01:56.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:01:56.446+0000 7f0a1ca0c640 1 -- 172.21.15.37:0/1027955229 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0a0001f020 con 0x7f0a18101d00 2024-09-19T06:01:56.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:01:56.631+0000 7f0a1da0e640 1 -- 172.21.15.37:0/1027955229 --> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f0a18062630 con 0x7f0a040a3270 2024-09-19T06:01:57.069 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:56 smithi037 ceph-mon[31211]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]': finished 2024-09-19T06:01:57.069 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:56 smithi037 ceph-mon[31211]: osdmap e55: 9 total, 8 up, 9 in 2024-09-19T06:01:57.069 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:56 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:01:57.069 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:56 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:01:57.069 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:56 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:01:57.069 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:56 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:01:57.070 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:56 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:01:57.070 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:56 smithi037 ceph-mon[31211]: osd.8 [v2:172.21.15.117:6816/2005866772,v1:172.21.15.117:6817/2005866772] boot 2024-09-19T06:01:57.070 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:56 smithi037 ceph-mon[31211]: osdmap e56: 9 total, 9 up, 9 in 2024-09-19T06:01:57.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:56 smithi099 ceph-mon[35300]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]': finished 2024-09-19T06:01:57.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:56 smithi099 ceph-mon[35300]: osdmap e55: 9 total, 8 up, 9 in 2024-09-19T06:01:57.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:56 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:01:57.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:56 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:01:57.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:56 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:01:57.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:56 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:01:57.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:56 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:01:57.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:56 smithi099 ceph-mon[35300]: osd.8 [v2:172.21.15.117:6816/2005866772,v1:172.21.15.117:6817/2005866772] boot 2024-09-19T06:01:57.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:56 smithi099 ceph-mon[35300]: osdmap e56: 9 total, 9 up, 9 in 2024-09-19T06:01:57.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:56 smithi117 ceph-mon[35050]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]': finished 2024-09-19T06:01:57.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:56 smithi117 ceph-mon[35050]: osdmap e55: 9 total, 8 up, 9 in 2024-09-19T06:01:57.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:56 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:01:57.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:56 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:01:57.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:56 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:01:57.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:56 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:01:57.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:56 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:01:57.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:56 smithi117 ceph-mon[35050]: osd.8 [v2:172.21.15.117:6816/2005866772,v1:172.21.15.117:6817/2005866772] boot 2024-09-19T06:01:57.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:56 smithi117 ceph-mon[35050]: osdmap e56: 9 total, 9 up, 9 in 2024-09-19T06:01:58.122 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:57 smithi037 ceph-mon[31211]: purged_snaps scrub starts 2024-09-19T06:01:58.122 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:57 smithi037 ceph-mon[31211]: purged_snaps scrub ok 2024-09-19T06:01:58.122 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:57 smithi037 ceph-mon[31211]: pgmap v187: 1 pgs: 1 peering; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:01:58.122 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:57 smithi037 ceph-mon[31211]: from='client.14409 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:01:58.122 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:57 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:01:58.122 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:57 smithi037 ceph-mon[31211]: osdmap e57: 9 total, 9 up, 9 in 2024-09-19T06:01:58.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:57 smithi099 ceph-mon[35300]: purged_snaps scrub starts 2024-09-19T06:01:58.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:57 smithi099 ceph-mon[35300]: purged_snaps scrub ok 2024-09-19T06:01:58.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:57 smithi099 ceph-mon[35300]: pgmap v187: 1 pgs: 1 peering; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:01:58.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:57 smithi099 ceph-mon[35300]: from='client.14409 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:01:58.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:57 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:01:58.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:57 smithi099 ceph-mon[35300]: osdmap e57: 9 total, 9 up, 9 in 2024-09-19T06:01:58.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:57 smithi117 ceph-mon[35050]: purged_snaps scrub starts 2024-09-19T06:01:58.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:57 smithi117 ceph-mon[35050]: purged_snaps scrub ok 2024-09-19T06:01:58.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:57 smithi117 ceph-mon[35050]: pgmap v187: 1 pgs: 1 peering; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:01:58.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:57 smithi117 ceph-mon[35050]: from='client.14409 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:01:58.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:57 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:01:58.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:57 smithi117 ceph-mon[35050]: osdmap e57: 9 total, 9 up, 9 in 2024-09-19T06:01:59.688 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:59 smithi037 ceph-mon[31211]: osdmap e58: 9 total, 9 up, 9 in 2024-09-19T06:01:59.688 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:59 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/2520114418' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "04b6203d-a10c-4a55-8e59-b30012dee02b"}]: dispatch 2024-09-19T06:01:59.688 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:59 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/2520114418' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "04b6203d-a10c-4a55-8e59-b30012dee02b"}]': finished 2024-09-19T06:01:59.688 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:59 smithi037 ceph-mon[31211]: osdmap e59: 10 total, 9 up, 10 in 2024-09-19T06:01:59.688 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:01:59 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:01:59.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:59 smithi099 ceph-mon[35300]: osdmap e58: 9 total, 9 up, 9 in 2024-09-19T06:01:59.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:59 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/2520114418' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "04b6203d-a10c-4a55-8e59-b30012dee02b"}]: dispatch 2024-09-19T06:01:59.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:59 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/2520114418' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "04b6203d-a10c-4a55-8e59-b30012dee02b"}]': finished 2024-09-19T06:01:59.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:59 smithi099 ceph-mon[35300]: osdmap e59: 10 total, 9 up, 10 in 2024-09-19T06:01:59.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:01:59 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:01:59.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:59 smithi117 ceph-mon[35050]: osdmap e58: 9 total, 9 up, 9 in 2024-09-19T06:01:59.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:59 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/2520114418' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "04b6203d-a10c-4a55-8e59-b30012dee02b"}]: dispatch 2024-09-19T06:01:59.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:59 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/2520114418' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "04b6203d-a10c-4a55-8e59-b30012dee02b"}]': finished 2024-09-19T06:01:59.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:59 smithi117 ceph-mon[35050]: osdmap e59: 10 total, 9 up, 10 in 2024-09-19T06:01:59.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:01:59 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:02:00.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:00 smithi099 ceph-mon[35300]: pgmap v191: 1 pgs: 1 peering; 577 KiB data, 252 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:02:00.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:00 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/1008868624' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:02:00.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:00 smithi099 ceph-mon[35300]: osdmap e60: 10 total, 9 up, 10 in 2024-09-19T06:02:00.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:00 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:02:00.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:00 smithi117 ceph-mon[35050]: pgmap v191: 1 pgs: 1 peering; 577 KiB data, 252 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:02:00.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:00 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/1008868624' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:02:00.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:00 smithi117 ceph-mon[35050]: osdmap e60: 10 total, 9 up, 10 in 2024-09-19T06:02:00.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:00 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:02:00.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:00 smithi037 ceph-mon[31211]: pgmap v191: 1 pgs: 1 peering; 577 KiB data, 252 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:02:00.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:00 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/1008868624' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:02:00.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:00 smithi037 ceph-mon[31211]: osdmap e60: 10 total, 9 up, 10 in 2024-09-19T06:02:00.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:00 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:02:02.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:02 smithi099 ceph-mon[35300]: pgmap v194: 1 pgs: 1 peering; 577 KiB data, 252 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:02:02.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:02 smithi117 ceph-mon[35050]: pgmap v194: 1 pgs: 1 peering; 577 KiB data, 252 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:02:02.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:02 smithi037 ceph-mon[31211]: pgmap v194: 1 pgs: 1 peering; 577 KiB data, 252 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:02:04.534 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:04 smithi037 ceph-mon[31211]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 804 GiB / 805 GiB avail; 110 KiB/s, 0 objects/s recovering 2024-09-19T06:02:04.688 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:04 smithi099 ceph-mon[35300]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 804 GiB / 805 GiB avail; 110 KiB/s, 0 objects/s recovering 2024-09-19T06:02:04.707 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:04 smithi117 ceph-mon[35050]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 804 GiB / 805 GiB avail; 110 KiB/s, 0 objects/s recovering 2024-09-19T06:02:06.688 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:06 smithi099 ceph-mon[35300]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 804 GiB / 805 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-09-19T06:02:06.749 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:06 smithi117 ceph-mon[35050]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 804 GiB / 805 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-09-19T06:02:06.770 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:06 smithi037 ceph-mon[31211]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 804 GiB / 805 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-09-19T06:02:08.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:08 smithi037 ceph-mon[31211]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T06:02:08.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:08 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T06:02:08.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:08 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:02:08.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:08 smithi099 ceph-mon[35300]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T06:02:08.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:08 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T06:02:08.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:08 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:02:08.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:08 smithi117 ceph-mon[35050]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T06:02:08.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:08 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T06:02:08.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:08 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:02:09.688 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:09 smithi099 ceph-mon[35300]: Deploying daemon osd.9 on smithi037 2024-09-19T06:02:09.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:09 smithi117 ceph-mon[35050]: Deploying daemon osd.9 on smithi037 2024-09-19T06:02:09.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:09 smithi037 ceph-mon[31211]: Deploying daemon osd.9 on smithi037 2024-09-19T06:02:10.566 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:10 smithi037 ceph-mon[31211]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-19T06:02:10.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:10 smithi099 ceph-mon[35300]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-19T06:02:10.749 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:10 smithi117 ceph-mon[35050]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-19T06:02:12.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:12 smithi099 ceph-mon[35300]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 804 GiB / 805 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-19T06:02:12.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:12 smithi117 ceph-mon[35050]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 804 GiB / 805 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-19T06:02:12.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:12 smithi037 ceph-mon[31211]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 804 GiB / 805 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-19T06:02:14.545 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:14 smithi037 ceph-mon[31211]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T06:02:14.688 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:14 smithi099 ceph-mon[35300]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T06:02:14.749 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:14 smithi117 ceph-mon[35050]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T06:02:15.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:15 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:02:15.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:15 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:02:15.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:15 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:02:15.746 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:15 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:02:15.746 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:15 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:02:15.746 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:15 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:02:15.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:15 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:02:15.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:15 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:02:15.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:15 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:02:16.688 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:16 smithi099 ceph-mon[35300]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:02:16.715 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:16 smithi037 ceph-mon[31211]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:02:16.749 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:16 smithi117 ceph-mon[35050]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:02:18.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:02:18.133+0000 7f0a1ca0c640 1 -- 172.21.15.37:0/1027955229 <== mgr.14148 v2:172.21.15.37:6800/3797010169 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f0a18062630 con 0x7f0a040a3270 2024-09-19T06:02:18.136 INFO:teuthology.orchestra.run.smithi037.stdout:Created osd(s) 9 on host 'smithi037' 2024-09-19T06:02:18.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:02:18.135+0000 7f0a1da0e640 1 -- 172.21.15.37:0/1027955229 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f0a040a3270 msgr2=0x7f0a040a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:18.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:02:18.135+0000 7f0a1da0e640 1 --2- 172.21.15.37:0/1027955229 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f0a040a3270 0x7f0a040a5730 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0a18101b60 tx=0x7f0a08009110 comp rx=0 tx=0).stop 2024-09-19T06:02:18.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:02:18.135+0000 7f0a1da0e640 1 -- 172.21.15.37:0/1027955229 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a18101d00 msgr2=0x7f0a18198640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:18.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:02:18.135+0000 7f0a1da0e640 1 --2- 172.21.15.37:0/1027955229 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a18101d00 0x7f0a18198640 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0a0000b4a0 tx=0x7f0a0000b8a0 comp rx=0 tx=0).stop 2024-09-19T06:02:18.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:02:18.136+0000 7f0a1da0e640 1 -- 172.21.15.37:0/1027955229 shutdown_connections 2024-09-19T06:02:18.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:02:18.136+0000 7f0a1da0e640 1 --2- 172.21.15.37:0/1027955229 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f0a040a3270 0x7f0a040a5730 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:18.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:02:18.136+0000 7f0a1da0e640 1 --2- 172.21.15.37:0/1027955229 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a181026c0 0x7f0a1819f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:18.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:02:18.136+0000 7f0a1da0e640 1 --2- 172.21.15.37:0/1027955229 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a18101d00 0x7f0a18198640 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:18.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:02:18.136+0000 7f0a1da0e640 1 --2- 172.21.15.37:0/1027955229 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a18100b00 0x7f0a18198100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:18.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:02:18.136+0000 7f0a1da0e640 1 -- 172.21.15.37:0/1027955229 >> 172.21.15.37:0/1027955229 conn(0x7f0a180fc270 msgr2=0x7f0a18105210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:02:18.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:02:18.136+0000 7f0a1da0e640 1 -- 172.21.15.37:0/1027955229 shutdown_connections 2024-09-19T06:02:18.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:02:18.136+0000 7f0a1da0e640 1 -- 172.21.15.37:0/1027955229 wait complete. 2024-09-19T06:02:18.688 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:18 smithi099 ceph-mon[35300]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:02:18.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:18 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:02:18.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:18 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:02:18.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:18 smithi117 ceph-mon[35050]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:02:18.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:18 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:02:18.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:18 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:02:18.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:18 smithi037 ceph-mon[31211]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:02:18.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:18 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:02:18.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:18 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:02:18.899 DEBUG:teuthology.orchestra.run.smithi037:osd.9> sudo journalctl -f -n 0 -u ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@osd.9.service 2024-09-19T06:02:18.902 INFO:tasks.cephadm:Deploying osd.10 on smithi099 with /dev/vg_nvme/lv_1... 2024-09-19T06:02:18.902 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T06:02:19.159 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T06:02:20.437 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:20 smithi099 ceph-mon[35300]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:02:20.438 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:20 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:02:20.438 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:20 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:02:20.472 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:20 smithi037 ceph-mon[31211]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:02:20.472 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:20 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:02:20.472 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:20 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:02:20.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:20 smithi117 ceph-mon[35050]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:02:20.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:20 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:02:20.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:20 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:02:20.798 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:02:20 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:02:20.469+0000 7f5915c21640 -1 osd.9 0 log_to_monitors true 2024-09-19T06:02:21.336 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:21 smithi099 ceph-mon[35300]: from='osd.9 [v2:172.21.15.37:6826/1398779376,v1:172.21.15.37:6827/1398779376]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T06:02:21.376 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:21 smithi037 ceph-mon[31211]: from='osd.9 [v2:172.21.15.37:6826/1398779376,v1:172.21.15.37:6827/1398779376]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T06:02:21.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:21 smithi117 ceph-mon[35050]: from='osd.9 [v2:172.21.15.37:6826/1398779376,v1:172.21.15.37:6827/1398779376]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T06:02:21.631 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:02:21.658 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi099:vg_nvme/lv_1 2024-09-19T06:02:21.921 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T06:02:22.264 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:02:22 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:02:22.104+0000 7f5911ba4640 -1 osd.9 0 waiting for initial osdmap 2024-09-19T06:02:22.264 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:02:22 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:02:22.120+0000 7f590d9cc640 -1 osd.9 62 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:02:22.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:22 smithi037 ceph-mon[31211]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:02:22.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:22 smithi037 ceph-mon[31211]: from='osd.9 [v2:172.21.15.37:6826/1398779376,v1:172.21.15.37:6827/1398779376]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T06:02:22.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:22 smithi037 ceph-mon[31211]: osdmap e61: 10 total, 9 up, 10 in 2024-09-19T06:02:22.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:22 smithi037 ceph-mon[31211]: from='osd.9 [v2:172.21.15.37:6826/1398779376,v1:172.21.15.37:6827/1398779376]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-09-19T06:02:22.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:22 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:02:22.323 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:22 smithi099 ceph-mon[35300]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:02:22.323 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:22 smithi099 ceph-mon[35300]: from='osd.9 [v2:172.21.15.37:6826/1398779376,v1:172.21.15.37:6827/1398779376]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T06:02:22.324 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:22 smithi099 ceph-mon[35300]: osdmap e61: 10 total, 9 up, 10 in 2024-09-19T06:02:22.324 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:22 smithi099 ceph-mon[35300]: from='osd.9 [v2:172.21.15.37:6826/1398779376,v1:172.21.15.37:6827/1398779376]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-09-19T06:02:22.324 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:22 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:02:22.401 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:22 smithi117 ceph-mon[35050]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:02:22.401 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:22 smithi117 ceph-mon[35050]: from='osd.9 [v2:172.21.15.37:6826/1398779376,v1:172.21.15.37:6827/1398779376]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T06:02:22.401 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:22 smithi117 ceph-mon[35050]: osdmap e61: 10 total, 9 up, 10 in 2024-09-19T06:02:22.401 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:22 smithi117 ceph-mon[35050]: from='osd.9 [v2:172.21.15.37:6826/1398779376,v1:172.21.15.37:6827/1398779376]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-09-19T06:02:22.401 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:22 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:02:22.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:02:22.406+0000 7f74c7da5640 1 -- 172.21.15.99:0/3559033688 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f74c0076220 msgr2=0x7f74c0074680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:22.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:02:22.406+0000 7f74c7da5640 1 --2- 172.21.15.99:0/3559033688 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f74c0076220 0x7f74c0074680 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f74b0009ca0 tx=0x7f74b002a8c0 comp rx=0 tx=0).stop 2024-09-19T06:02:22.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:02:22.406+0000 7f74c7da5640 1 -- 172.21.15.99:0/3559033688 shutdown_connections 2024-09-19T06:02:22.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:02:22.406+0000 7f74c7da5640 1 --2- 172.21.15.99:0/3559033688 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f74c0109a80 0x7f74c010bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:22.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:02:22.406+0000 7f74c7da5640 1 --2- 172.21.15.99:0/3559033688 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74c0074c50 0x7f74c00750b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:22.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:02:22.406+0000 7f74c7da5640 1 --2- 172.21.15.99:0/3559033688 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f74c0076220 0x7f74c0074680 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:22.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:02:22.406+0000 7f74c7da5640 1 -- 172.21.15.99:0/3559033688 >> 172.21.15.99:0/3559033688 conn(0x7f74c00fd3b0 msgr2=0x7f74c00ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:02:22.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:02:22.406+0000 7f74c7da5640 1 -- 172.21.15.99:0/3559033688 shutdown_connections 2024-09-19T06:02:22.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:02:22.406+0000 7f74c7da5640 1 -- 172.21.15.99:0/3559033688 wait complete. 2024-09-19T06:02:22.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:02:22.406+0000 7f74c7da5640 1 Processor -- start 2024-09-19T06:02:22.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:02:22.406+0000 7f74c7da5640 1 -- start start 2024-09-19T06:02:22.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:02:22.407+0000 7f74c7da5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74c0074c50 0x7f74c019a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:22.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:02:22.407+0000 7f74c7da5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f74c0076220 0x7f74c019a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:22.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:02:22.407+0000 7f74c7da5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f74c0109a80 0x7f74c01a16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:22.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:02:22.407+0000 7f74c7da5640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f74c010fa80 con 0x7f74c0074c50 2024-09-19T06:02:22.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:02:22.407+0000 7f74c7da5640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f74c010f900 con 0x7f74c0109a80 2024-09-19T06:02:22.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:02:22.407+0000 7f74c7da5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f74c010fc00 con 0x7f74c0076220 2024-09-19T06:02:22.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:02:22.407+0000 7f74c6342640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f74c0109a80 0x7f74c01a16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:22.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:02:22.407+0000 7f74c6342640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f74c0109a80 0x7f74c01a16c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56166/0 (socket says 172.21.15.99:56166) 2024-09-19T06:02:22.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:02:22.407+0000 7f74c6342640 1 -- 172.21.15.99:0/981300172 learned_addr learned my addr 172.21.15.99:0/981300172 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:02:22.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:02:22.407+0000 7f74c5b41640 1 --2- 172.21.15.99:0/981300172 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74c0074c50 0x7f74c019a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:22.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:02:22.407+0000 7f74c5340640 1 --2- 172.21.15.99:0/981300172 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f74c0076220 0x7f74c019a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:22.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:02:22.407+0000 7f74c6342640 1 -- 172.21.15.99:0/981300172 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f74c0076220 msgr2=0x7f74c019a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:22.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:02:22.407+0000 7f74c6342640 1 --2- 172.21.15.99:0/981300172 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f74c0076220 0x7f74c019a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:22.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:02:22.407+0000 7f74c6342640 1 -- 172.21.15.99:0/981300172 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74c0074c50 msgr2=0x7f74c019a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:22.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:02:22.407+0000 7f74c6342640 1 --2- 172.21.15.99:0/981300172 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74c0074c50 0x7f74c019a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:22.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:02:22.407+0000 7f74c6342640 1 -- 172.21.15.99:0/981300172 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74c01a1d30 con 0x7f74c0109a80 2024-09-19T06:02:22.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:02:22.407+0000 7f74c6342640 1 --2- 172.21.15.99:0/981300172 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f74c0109a80 0x7f74c01a16c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f74b800d750 tx=0x7f74b800dc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:02:22.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:02:22.407+0000 7f74beffd640 1 -- 172.21.15.99:0/981300172 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74b8017070 con 0x7f74c0109a80 2024-09-19T06:02:22.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:02:22.407+0000 7f74beffd640 1 -- 172.21.15.99:0/981300172 <== mon.2 v2:172.21.15.99:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f74b8005500 con 0x7f74c0109a80 2024-09-19T06:02:22.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:02:22.407+0000 7f74c7da5640 1 -- 172.21.15.99:0/981300172 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74c01a1fc0 con 0x7f74c0109a80 2024-09-19T06:02:22.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:02:22.407+0000 7f74beffd640 1 -- 172.21.15.99:0/981300172 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74b8004d90 con 0x7f74c0109a80 2024-09-19T06:02:22.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:02:22.407+0000 7f74c7da5640 1 -- 172.21.15.99:0/981300172 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74c01a24d0 con 0x7f74c0109a80 2024-09-19T06:02:22.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:02:22.408+0000 7f74c7da5640 1 -- 172.21.15.99:0/981300172 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74c0108800 con 0x7f74c0109a80 2024-09-19T06:02:22.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:02:22.409+0000 7f74beffd640 1 -- 172.21.15.99:0/981300172 <== mon.2 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f74b8004f30 con 0x7f74c0109a80 2024-09-19T06:02:22.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:02:22.410+0000 7f74beffd640 1 --2- 172.21.15.99:0/981300172 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f74a80a3270 0x7f74a80a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:22.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:02:22.411+0000 7f74c5b41640 1 --2- 172.21.15.99:0/981300172 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f74a80a3270 0x7f74a80a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:22.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:02:22.411+0000 7f74beffd640 1 -- 172.21.15.99:0/981300172 <== mon.2 v2:172.21.15.99:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5981+0+0 (secure 0 0 0) 0x7f74b80ce980 con 0x7f74c0109a80 2024-09-19T06:02:22.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:02:22.411+0000 7f74c5b41640 1 --2- 172.21.15.99:0/981300172 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f74a80a3270 0x7f74a80a5730 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f74b0006010 tx=0x7f74b0000f40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:02:22.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:02:22.415+0000 7f74beffd640 1 -- 172.21.15.99:0/981300172 <== mon.2 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f74b809b8d0 con 0x7f74c0109a80 2024-09-19T06:02:22.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:02:22.590+0000 7f74c7da5640 1 -- 172.21.15.99:0/981300172 --> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f74c0062630 con 0x7f74a80a3270 2024-09-19T06:02:23.285 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:23 smithi099 ceph-mon[35300]: from='osd.9 [v2:172.21.15.37:6826/1398779376,v1:172.21.15.37:6827/1398779376]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-09-19T06:02:23.285 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:23 smithi099 ceph-mon[35300]: osdmap e62: 10 total, 9 up, 10 in 2024-09-19T06:02:23.285 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:23 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:02:23.285 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:23 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:02:23.286 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:23 smithi099 ceph-mon[35300]: from='client.24344 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:02:23.286 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:23 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:02:23.286 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:23 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:02:23.286 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:23 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:02:23.286 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:23 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:02:23.286 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:23 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:02:23.286 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:23 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:02:23.286 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:23 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:02:23.286 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:23 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:02:23.286 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:23 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:02:23.286 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:23 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:02:23.287 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:23 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:02:23.287 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:23 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:02:23.287 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:23 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:02:23.287 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:23 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:02:23.287 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:23 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:02:23.287 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:23 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:02:23.287 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:23 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:02:23.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:23 smithi117 ceph-mon[35050]: from='osd.9 [v2:172.21.15.37:6826/1398779376,v1:172.21.15.37:6827/1398779376]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-09-19T06:02:23.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:23 smithi117 ceph-mon[35050]: osdmap e62: 10 total, 9 up, 10 in 2024-09-19T06:02:23.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:23 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:02:23.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:23 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:02:23.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:23 smithi117 ceph-mon[35050]: from='client.24344 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:02:23.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:23 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:02:23.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:23 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:02:23.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:23 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:02:23.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:23 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:02:23.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:23 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:02:23.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:23 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:02:23.501 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:23 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:02:23.501 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:23 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:02:23.501 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:23 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:02:23.501 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:23 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:02:23.501 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:23 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:02:23.501 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:23 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:02:23.501 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:23 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:02:23.501 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:23 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:02:23.501 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:23 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:02:23.501 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:23 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:02:23.501 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:23 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:02:23.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:23 smithi037 ceph-mon[31211]: from='osd.9 [v2:172.21.15.37:6826/1398779376,v1:172.21.15.37:6827/1398779376]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-09-19T06:02:23.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:23 smithi037 ceph-mon[31211]: osdmap e62: 10 total, 9 up, 10 in 2024-09-19T06:02:23.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:23 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:02:23.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:23 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:02:23.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:23 smithi037 ceph-mon[31211]: from='client.24344 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:02:23.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:23 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:02:23.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:23 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:02:23.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:23 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:02:23.575 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:23 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:02:23.575 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:23 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:02:23.575 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:23 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:02:23.575 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:23 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:02:23.575 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:23 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:02:23.575 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:23 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:02:23.575 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:23 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:02:23.575 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:23 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:02:23.575 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:23 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:02:23.575 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:23 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:02:23.575 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:23 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:02:23.575 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:23 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:02:23.575 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:23 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:02:23.576 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:23 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:02:24.397 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:24 smithi099 ceph-mon[35300]: purged_snaps scrub starts 2024-09-19T06:02:24.397 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:24 smithi099 ceph-mon[35300]: purged_snaps scrub ok 2024-09-19T06:02:24.397 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:24 smithi099 ceph-mon[35300]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:02:24.397 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:24 smithi099 ceph-mon[35300]: Detected new or changed devices on smithi037 2024-09-19T06:02:24.397 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:24 smithi099 ceph-mon[35300]: Adjusting osd_memory_target on smithi037 to 4273M 2024-09-19T06:02:24.397 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:24 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:02:24.397 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:24 smithi099 ceph-mon[35300]: osd.9 [v2:172.21.15.37:6826/1398779376,v1:172.21.15.37:6827/1398779376] boot 2024-09-19T06:02:24.397 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:24 smithi099 ceph-mon[35300]: osdmap e63: 10 total, 10 up, 10 in 2024-09-19T06:02:24.397 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:24 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:02:24.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:24 smithi117 ceph-mon[35050]: purged_snaps scrub starts 2024-09-19T06:02:24.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:24 smithi117 ceph-mon[35050]: purged_snaps scrub ok 2024-09-19T06:02:24.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:24 smithi117 ceph-mon[35050]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:02:24.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:24 smithi117 ceph-mon[35050]: Detected new or changed devices on smithi037 2024-09-19T06:02:24.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:24 smithi117 ceph-mon[35050]: Adjusting osd_memory_target on smithi037 to 4273M 2024-09-19T06:02:24.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:24 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:02:24.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:24 smithi117 ceph-mon[35050]: osd.9 [v2:172.21.15.37:6826/1398779376,v1:172.21.15.37:6827/1398779376] boot 2024-09-19T06:02:24.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:24 smithi117 ceph-mon[35050]: osdmap e63: 10 total, 10 up, 10 in 2024-09-19T06:02:24.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:24 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:02:24.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:24 smithi037 ceph-mon[31211]: purged_snaps scrub starts 2024-09-19T06:02:24.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:24 smithi037 ceph-mon[31211]: purged_snaps scrub ok 2024-09-19T06:02:24.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:24 smithi037 ceph-mon[31211]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:02:24.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:24 smithi037 ceph-mon[31211]: Detected new or changed devices on smithi037 2024-09-19T06:02:24.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:24 smithi037 ceph-mon[31211]: Adjusting osd_memory_target on smithi037 to 4273M 2024-09-19T06:02:24.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:24 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:02:24.575 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:24 smithi037 ceph-mon[31211]: osd.9 [v2:172.21.15.37:6826/1398779376,v1:172.21.15.37:6827/1398779376] boot 2024-09-19T06:02:24.575 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:24 smithi037 ceph-mon[31211]: osdmap e63: 10 total, 10 up, 10 in 2024-09-19T06:02:24.575 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:24 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:02:25.390 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:25 smithi099 ceph-mon[35300]: osdmap e64: 10 total, 10 up, 10 in 2024-09-19T06:02:25.499 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:25 smithi117 ceph-mon[35050]: osdmap e64: 10 total, 10 up, 10 in 2024-09-19T06:02:25.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:25 smithi037 ceph-mon[31211]: osdmap e64: 10 total, 10 up, 10 in 2024-09-19T06:02:26.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:26 smithi037 ceph-mon[31211]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:02:26.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:26 smithi037 ceph-mon[31211]: from='client.? 172.21.15.99:0/1287258119' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bbf8ff4b-29cd-4d56-a30e-ff2de3555f78"}]: dispatch 2024-09-19T06:02:26.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:26 smithi037 ceph-mon[31211]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bbf8ff4b-29cd-4d56-a30e-ff2de3555f78"}]: dispatch 2024-09-19T06:02:26.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:26 smithi037 ceph-mon[31211]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bbf8ff4b-29cd-4d56-a30e-ff2de3555f78"}]': finished 2024-09-19T06:02:26.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:26 smithi037 ceph-mon[31211]: osdmap e65: 11 total, 10 up, 11 in 2024-09-19T06:02:26.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:26 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:02:26.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:26 smithi037 ceph-mon[31211]: from='client.? 172.21.15.99:0/123528826' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:02:26.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:26 smithi099 ceph-mon[35300]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:02:26.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:26 smithi099 ceph-mon[35300]: from='client.? 172.21.15.99:0/1287258119' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bbf8ff4b-29cd-4d56-a30e-ff2de3555f78"}]: dispatch 2024-09-19T06:02:26.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:26 smithi099 ceph-mon[35300]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bbf8ff4b-29cd-4d56-a30e-ff2de3555f78"}]: dispatch 2024-09-19T06:02:26.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:26 smithi099 ceph-mon[35300]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bbf8ff4b-29cd-4d56-a30e-ff2de3555f78"}]': finished 2024-09-19T06:02:26.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:26 smithi099 ceph-mon[35300]: osdmap e65: 11 total, 10 up, 11 in 2024-09-19T06:02:26.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:26 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:02:26.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:26 smithi099 ceph-mon[35300]: from='client.? 172.21.15.99:0/123528826' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:02:26.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:26 smithi117 ceph-mon[35050]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:02:26.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:26 smithi117 ceph-mon[35050]: from='client.? 172.21.15.99:0/1287258119' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bbf8ff4b-29cd-4d56-a30e-ff2de3555f78"}]: dispatch 2024-09-19T06:02:26.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:26 smithi117 ceph-mon[35050]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bbf8ff4b-29cd-4d56-a30e-ff2de3555f78"}]: dispatch 2024-09-19T06:02:26.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:26 smithi117 ceph-mon[35050]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bbf8ff4b-29cd-4d56-a30e-ff2de3555f78"}]': finished 2024-09-19T06:02:26.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:26 smithi117 ceph-mon[35050]: osdmap e65: 11 total, 10 up, 11 in 2024-09-19T06:02:26.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:26 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:02:26.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:26 smithi117 ceph-mon[35050]: from='client.? 172.21.15.99:0/123528826' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:02:28.438 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:28 smithi099 ceph-mon[35300]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:02:28.499 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:28 smithi117 ceph-mon[35050]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:02:28.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:28 smithi037 ceph-mon[31211]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:02:30.301 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:30 smithi099 ceph-mon[35300]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:02:30.499 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:30 smithi117 ceph-mon[35050]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:02:30.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:30 smithi037 ceph-mon[31211]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:02:32.399 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:32 smithi099 ceph-mon[35300]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:02:32.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:32 smithi117 ceph-mon[35050]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:02:32.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:32 smithi037 ceph-mon[31211]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:02:34.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:34 smithi099 ceph-mon[35300]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:02:34.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:34 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T06:02:34.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:34 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:02:34.499 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:34 smithi117 ceph-mon[35050]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:02:34.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:34 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T06:02:34.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:34 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:02:34.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:34 smithi037 ceph-mon[31211]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:02:34.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:34 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T06:02:34.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:34 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:02:35.438 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:35 smithi099 ceph-mon[35300]: Deploying daemon osd.10 on smithi099 2024-09-19T06:02:35.499 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:35 smithi117 ceph-mon[35050]: Deploying daemon osd.10 on smithi099 2024-09-19T06:02:35.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:35 smithi037 ceph-mon[31211]: Deploying daemon osd.10 on smithi099 2024-09-19T06:02:36.438 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:36 smithi099 ceph-mon[35300]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:02:36.499 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:36 smithi117 ceph-mon[35050]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:02:36.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:36 smithi037 ceph-mon[31211]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:02:38.246 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:38 smithi099 ceph-mon[35300]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:02:38.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:38 smithi117 ceph-mon[35050]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:02:38.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:38 smithi037 ceph-mon[31211]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:02:40.284 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:40 smithi099 ceph-mon[35300]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:02:40.284 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:40 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:02:40.284 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:40 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:02:40.284 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:40 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:02:40.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:40 smithi117 ceph-mon[35050]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:02:40.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:40 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:02:40.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:40 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:02:40.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:40 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:02:40.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:40 smithi037 ceph-mon[31211]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:02:40.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:40 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:02:40.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:40 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:02:40.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:40 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:02:42.359 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:42 smithi099 ceph-mon[35300]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:02:42.499 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:42 smithi117 ceph-mon[35050]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:02:42.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:42 smithi037 ceph-mon[31211]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:02:43.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:02:43.007+0000 7f74beffd640 1 -- 172.21.15.99:0/981300172 <== mgr.14148 v2:172.21.15.37:6800/3797010169 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f74c0062630 con 0x7f74a80a3270 2024-09-19T06:02:43.009 INFO:teuthology.orchestra.run.smithi099.stdout:Created osd(s) 10 on host 'smithi099' 2024-09-19T06:02:43.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:02:43.009+0000 7f74c7da5640 1 -- 172.21.15.99:0/981300172 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f74a80a3270 msgr2=0x7f74a80a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:43.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:02:43.009+0000 7f74c7da5640 1 --2- 172.21.15.99:0/981300172 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f74a80a3270 0x7f74a80a5730 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f74b0006010 tx=0x7f74b0000f40 comp rx=0 tx=0).stop 2024-09-19T06:02:43.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:02:43.009+0000 7f74c7da5640 1 -- 172.21.15.99:0/981300172 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f74c0109a80 msgr2=0x7f74c01a16c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:43.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:02:43.009+0000 7f74c7da5640 1 --2- 172.21.15.99:0/981300172 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f74c0109a80 0x7f74c01a16c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f74b800d750 tx=0x7f74b800dc10 comp rx=0 tx=0).stop 2024-09-19T06:02:43.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:02:43.009+0000 7f74c7da5640 1 -- 172.21.15.99:0/981300172 shutdown_connections 2024-09-19T06:02:43.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:02:43.009+0000 7f74c7da5640 1 --2- 172.21.15.99:0/981300172 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f74a80a3270 0x7f74a80a5730 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:43.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:02:43.009+0000 7f74c7da5640 1 --2- 172.21.15.99:0/981300172 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f74c0109a80 0x7f74c01a16c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:43.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:02:43.009+0000 7f74c7da5640 1 --2- 172.21.15.99:0/981300172 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f74c0076220 0x7f74c019a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:43.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:02:43.009+0000 7f74c7da5640 1 --2- 172.21.15.99:0/981300172 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74c0074c50 0x7f74c019a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:43.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:02:43.009+0000 7f74c7da5640 1 -- 172.21.15.99:0/981300172 >> 172.21.15.99:0/981300172 conn(0x7f74c00fd3b0 msgr2=0x7f74c01059d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:02:43.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:02:43.009+0000 7f74c7da5640 1 -- 172.21.15.99:0/981300172 shutdown_connections 2024-09-19T06:02:43.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:02:43.009+0000 7f74c7da5640 1 -- 172.21.15.99:0/981300172 wait complete. 2024-09-19T06:02:43.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:43 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:02:43.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:43 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:02:43.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:43 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:02:43.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:43 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:02:43.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:43 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:02:43.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:43 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:02:43.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:43 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:02:43.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:43 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:02:43.639 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:43 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:02:43.639 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:43 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:02:43.639 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:43 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:02:43.639 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:43 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:02:43.639 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:43 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:02:43.639 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:43 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:02:43.639 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:43 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:02:43.639 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:43 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:02:43.665 DEBUG:teuthology.orchestra.run.smithi099:osd.10> sudo journalctl -f -n 0 -u ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@osd.10.service 2024-09-19T06:02:43.668 INFO:tasks.cephadm:Deploying osd.11 on smithi117 with /dev/vg_nvme/lv_1... 2024-09-19T06:02:43.668 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T06:02:43.697 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:43 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:02:43.697 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:43 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:02:43.697 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:43 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:02:43.697 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:43 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:02:43.697 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:43 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:02:43.697 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:43 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:02:43.697 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:43 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:02:43.697 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:43 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:02:43.921 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:02:44.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:44 smithi037 ceph-mon[31211]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:02:44.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:44 smithi099 ceph-mon[35300]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:02:44.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:44 smithi117 ceph-mon[35050]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:02:45.320 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:45 smithi117 ceph-mon[35050]: from='osd.10 [v2:172.21.15.99:6824/2200957302,v1:172.21.15.99:6825/2200957302]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T06:02:45.320 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:45 smithi117 ceph-mon[35050]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T06:02:45.342 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:45 smithi099 ceph-mon[35300]: from='osd.10 [v2:172.21.15.99:6824/2200957302,v1:172.21.15.99:6825/2200957302]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T06:02:45.342 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:45 smithi099 ceph-mon[35300]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T06:02:45.343 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:02:45 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:02:45.084+0000 7fc1715d6640 -1 osd.10 0 log_to_monitors true 2024-09-19T06:02:45.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:45 smithi037 ceph-mon[31211]: from='osd.10 [v2:172.21.15.99:6824/2200957302,v1:172.21.15.99:6825/2200957302]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T06:02:45.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:45 smithi037 ceph-mon[31211]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T06:02:46.438 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:46 smithi099 ceph-mon[35300]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:02:46.438 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:46 smithi099 ceph-mon[35300]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T06:02:46.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:46 smithi099 ceph-mon[35300]: osdmap e66: 11 total, 10 up, 11 in 2024-09-19T06:02:46.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:46 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:02:46.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:46 smithi099 ceph-mon[35300]: from='osd.10 [v2:172.21.15.99:6824/2200957302,v1:172.21.15.99:6825/2200957302]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-19T06:02:46.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:46 smithi099 ceph-mon[35300]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-19T06:02:46.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:46 smithi037 ceph-mon[31211]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:02:46.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:46 smithi037 ceph-mon[31211]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T06:02:46.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:46 smithi037 ceph-mon[31211]: osdmap e66: 11 total, 10 up, 11 in 2024-09-19T06:02:46.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:46 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:02:46.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:46 smithi037 ceph-mon[31211]: from='osd.10 [v2:172.21.15.99:6824/2200957302,v1:172.21.15.99:6825/2200957302]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-19T06:02:46.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:46 smithi037 ceph-mon[31211]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-19T06:02:46.578 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:46 smithi117 ceph-mon[35050]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:02:46.578 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:46 smithi117 ceph-mon[35050]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T06:02:46.578 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:46 smithi117 ceph-mon[35050]: osdmap e66: 11 total, 10 up, 11 in 2024-09-19T06:02:46.578 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:46 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:02:46.578 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:46 smithi117 ceph-mon[35050]: from='osd.10 [v2:172.21.15.99:6824/2200957302,v1:172.21.15.99:6825/2200957302]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-19T06:02:46.578 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:46 smithi117 ceph-mon[35050]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-19T06:02:46.581 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:02:46.608 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi117:vg_nvme/lv_1 2024-09-19T06:02:46.902 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:02:47.313 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:02:46 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:02:46.966+0000 7fc16d559640 -1 osd.10 0 waiting for initial osdmap 2024-09-19T06:02:47.313 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:02:46 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:02:46.977+0000 7fc165379640 -1 osd.10 67 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:02:47.364 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:02:47.350+0000 7fe395de1640 1 -- 172.21.15.117:0/3065459137 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3901078c0 msgr2=0x7fe390109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:47.364 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:02:47.350+0000 7fe395de1640 1 --2- 172.21.15.117:0/3065459137 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3901078c0 0x7fe390109d10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe388009ca0 tx=0x7fe38802a8c0 comp rx=0 tx=0).stop 2024-09-19T06:02:47.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:02:47.350+0000 7fe395de1640 1 -- 172.21.15.117:0/3065459137 shutdown_connections 2024-09-19T06:02:47.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:02:47.350+0000 7fe395de1640 1 --2- 172.21.15.117:0/3065459137 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe390104f90 0x7fe390107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:47.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:02:47.350+0000 7fe395de1640 1 --2- 172.21.15.117:0/3065459137 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3901078c0 0x7fe390109d10 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:47.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:02:47.350+0000 7fe395de1640 1 --2- 172.21.15.117:0/3065459137 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe390102660 0x7fe390104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:47.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:02:47.350+0000 7fe395de1640 1 -- 172.21.15.117:0/3065459137 >> 172.21.15.117:0/3065459137 conn(0x7fe3900fc280 msgr2=0x7fe3900fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:02:47.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:02:47.350+0000 7fe395de1640 1 -- 172.21.15.117:0/3065459137 shutdown_connections 2024-09-19T06:02:47.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:02:47.350+0000 7fe395de1640 1 -- 172.21.15.117:0/3065459137 wait complete. 2024-09-19T06:02:47.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:02:47.351+0000 7fe395de1640 1 Processor -- start 2024-09-19T06:02:47.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:02:47.351+0000 7fe395de1640 1 -- start start 2024-09-19T06:02:47.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:02:47.351+0000 7fe395de1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe390102660 0x7fe390101fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:47.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:02:47.351+0000 7fe395de1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe390104f90 0x7fe390100610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:47.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:02:47.351+0000 7fe395de1640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3901078c0 0x7fe390100b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:47.366 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:02:47.351+0000 7fe395de1640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe39010d860 con 0x7fe390104f90 2024-09-19T06:02:47.366 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:02:47.351+0000 7fe395de1640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fe39010d6e0 con 0x7fe3901078c0 2024-09-19T06:02:47.366 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:02:47.351+0000 7fe395de1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe39010d9e0 con 0x7fe390102660 2024-09-19T06:02:47.366 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:02:47.351+0000 7fe38f7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe390102660 0x7fe390101fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:47.366 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:02:47.351+0000 7fe38f7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe390102660 0x7fe390101fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:36362/0 (socket says 172.21.15.117:36362) 2024-09-19T06:02:47.366 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:02:47.351+0000 7fe38f7fe640 1 -- 172.21.15.117:0/3386442042 learned_addr learned my addr 172.21.15.117:0/3386442042 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T06:02:47.366 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:02:47.351+0000 7fe38effd640 1 --2- 172.21.15.117:0/3386442042 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe390104f90 0x7fe390100610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:47.366 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:02:47.351+0000 7fe38ffff640 1 --2- 172.21.15.117:0/3386442042 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3901078c0 0x7fe390100b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:47.366 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:02:47.351+0000 7fe38f7fe640 1 -- 172.21.15.117:0/3386442042 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3901078c0 msgr2=0x7fe390100b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:47.366 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:02:47.351+0000 7fe38f7fe640 1 --2- 172.21.15.117:0/3386442042 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3901078c0 0x7fe390100b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:47.366 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:02:47.351+0000 7fe38f7fe640 1 -- 172.21.15.117:0/3386442042 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe390104f90 msgr2=0x7fe390100610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:47.366 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:02:47.351+0000 7fe38f7fe640 1 --2- 172.21.15.117:0/3386442042 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe390104f90 0x7fe390100610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:47.366 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:02:47.351+0000 7fe38f7fe640 1 -- 172.21.15.117:0/3386442042 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe390101410 con 0x7fe390102660 2024-09-19T06:02:47.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:02:47.352+0000 7fe38f7fe640 1 --2- 172.21.15.117:0/3386442042 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe390102660 0x7fe390101fc0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe38000c890 tx=0x7fe38000cd50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:02:47.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:02:47.352+0000 7fe38cff9640 1 -- 172.21.15.117:0/3386442042 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe380004220 con 0x7fe390102660 2024-09-19T06:02:47.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:02:47.352+0000 7fe38cff9640 1 -- 172.21.15.117:0/3386442042 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3800043c0 con 0x7fe390102660 2024-09-19T06:02:47.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:02:47.352+0000 7fe395de1640 1 -- 172.21.15.117:0/3386442042 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3901a1fe0 con 0x7fe390102660 2024-09-19T06:02:47.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:02:47.352+0000 7fe38cff9640 1 -- 172.21.15.117:0/3386442042 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3800049e0 con 0x7fe390102660 2024-09-19T06:02:47.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:02:47.352+0000 7fe395de1640 1 -- 172.21.15.117:0/3386442042 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3901a2440 con 0x7fe390102660 2024-09-19T06:02:47.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:02:47.353+0000 7fe395de1640 1 -- 172.21.15.117:0/3386442042 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3900fdd70 con 0x7fe390102660 2024-09-19T06:02:47.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:02:47.354+0000 7fe38cff9640 1 -- 172.21.15.117:0/3386442042 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fe3800079b0 con 0x7fe390102660 2024-09-19T06:02:47.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:02:47.355+0000 7fe38cff9640 1 --2- 172.21.15.117:0/3386442042 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fe37c0a3240 0x7fe37c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:47.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:02:47.355+0000 7fe38cff9640 1 -- 172.21.15.117:0/3386442042 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6727+0+0 (secure 0 0 0) 0x7fe3800cf3f0 con 0x7fe390102660 2024-09-19T06:02:47.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:02:47.355+0000 7fe38effd640 1 --2- 172.21.15.117:0/3386442042 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fe37c0a3240 0x7fe37c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:47.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:02:47.355+0000 7fe38effd640 1 --2- 172.21.15.117:0/3386442042 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fe37c0a3240 0x7fe37c0a5700 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe390101d40 tx=0x7fe37800a4c0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:02:47.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:02:47.359+0000 7fe38cff9640 1 -- 172.21.15.117:0/3386442042 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe380014030 con 0x7fe390102660 2024-09-19T06:02:47.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:47 smithi117 ceph-mon[35050]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-09-19T06:02:47.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:47 smithi117 ceph-mon[35050]: osdmap e67: 11 total, 10 up, 11 in 2024-09-19T06:02:47.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:47 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:02:47.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:47 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:02:47.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:47 smithi117 ceph-mon[35050]: Detected new or changed devices on smithi099 2024-09-19T06:02:47.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:47 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:02:47.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:47 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:02:47.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:47 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:02:47.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:47 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:02:47.501 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:47 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:02:47.501 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:47 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:02:47.501 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:47 smithi117 ceph-mon[35050]: Adjusting osd_memory_target on smithi099 to 4272M 2024-09-19T06:02:47.501 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:47 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:02:47.501 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:47 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:02:47.501 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:47 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:02:47.501 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:47 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:02:47.501 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:47 smithi117 ceph-mon[35050]: from='osd.10 ' entity='osd.10' 2024-09-19T06:02:47.543 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:02:47.542+0000 7fe395de1640 1 -- 172.21.15.117:0/3386442042 --> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fe390062630 con 0x7fe37c0a3240 2024-09-19T06:02:47.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:47 smithi037 ceph-mon[31211]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-09-19T06:02:47.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:47 smithi037 ceph-mon[31211]: osdmap e67: 11 total, 10 up, 11 in 2024-09-19T06:02:47.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:47 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:02:47.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:47 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:02:47.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:47 smithi037 ceph-mon[31211]: Detected new or changed devices on smithi099 2024-09-19T06:02:47.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:47 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:02:47.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:47 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:02:47.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:47 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:02:47.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:47 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:02:47.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:47 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:02:47.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:47 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:02:47.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:47 smithi037 ceph-mon[31211]: Adjusting osd_memory_target on smithi099 to 4272M 2024-09-19T06:02:47.575 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:47 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:02:47.575 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:47 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:02:47.575 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:47 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:02:47.575 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:47 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:02:47.575 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:47 smithi037 ceph-mon[31211]: from='osd.10 ' entity='osd.10' 2024-09-19T06:02:47.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:47 smithi099 ceph-mon[35300]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-09-19T06:02:47.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:47 smithi099 ceph-mon[35300]: osdmap e67: 11 total, 10 up, 11 in 2024-09-19T06:02:47.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:47 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:02:47.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:47 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:02:47.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:47 smithi099 ceph-mon[35300]: Detected new or changed devices on smithi099 2024-09-19T06:02:47.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:47 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:02:47.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:47 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:02:47.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:47 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:02:47.690 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:47 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:02:47.690 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:47 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:02:47.690 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:47 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:02:47.690 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:47 smithi099 ceph-mon[35300]: Adjusting osd_memory_target on smithi099 to 4272M 2024-09-19T06:02:47.690 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:47 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:02:47.690 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:47 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:02:47.690 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:47 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:02:47.690 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:47 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:02:47.690 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:47 smithi099 ceph-mon[35300]: from='osd.10 ' entity='osd.10' 2024-09-19T06:02:48.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:48 smithi117 ceph-mon[35050]: purged_snaps scrub starts 2024-09-19T06:02:48.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:48 smithi117 ceph-mon[35050]: purged_snaps scrub ok 2024-09-19T06:02:48.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:48 smithi117 ceph-mon[35050]: pgmap v224: 1 pgs: 1 peering; 577 KiB data, 280 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:02:48.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:48 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:02:48.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:48 smithi117 ceph-mon[35050]: osd.10 [v2:172.21.15.99:6824/2200957302,v1:172.21.15.99:6825/2200957302] boot 2024-09-19T06:02:48.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:48 smithi117 ceph-mon[35050]: osdmap e68: 11 total, 11 up, 11 in 2024-09-19T06:02:48.501 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:48 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:02:48.501 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:48 smithi117 ceph-mon[35050]: osdmap e69: 11 total, 11 up, 11 in 2024-09-19T06:02:48.501 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:48 smithi117 ceph-mon[35050]: from='client.24352 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:02:48.501 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:48 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:02:48.501 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:48 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:02:48.501 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:48 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:02:48.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:48 smithi037 ceph-mon[31211]: purged_snaps scrub starts 2024-09-19T06:02:48.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:48 smithi037 ceph-mon[31211]: purged_snaps scrub ok 2024-09-19T06:02:48.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:48 smithi037 ceph-mon[31211]: pgmap v224: 1 pgs: 1 peering; 577 KiB data, 280 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:02:48.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:48 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:02:48.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:48 smithi037 ceph-mon[31211]: osd.10 [v2:172.21.15.99:6824/2200957302,v1:172.21.15.99:6825/2200957302] boot 2024-09-19T06:02:48.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:48 smithi037 ceph-mon[31211]: osdmap e68: 11 total, 11 up, 11 in 2024-09-19T06:02:48.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:48 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:02:48.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:48 smithi037 ceph-mon[31211]: osdmap e69: 11 total, 11 up, 11 in 2024-09-19T06:02:48.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:48 smithi037 ceph-mon[31211]: from='client.24352 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:02:48.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:48 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:02:48.575 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:48 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:02:48.575 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:48 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:02:48.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:48 smithi099 ceph-mon[35300]: purged_snaps scrub starts 2024-09-19T06:02:48.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:48 smithi099 ceph-mon[35300]: purged_snaps scrub ok 2024-09-19T06:02:48.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:48 smithi099 ceph-mon[35300]: pgmap v224: 1 pgs: 1 peering; 577 KiB data, 280 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:02:48.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:48 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:02:48.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:48 smithi099 ceph-mon[35300]: osd.10 [v2:172.21.15.99:6824/2200957302,v1:172.21.15.99:6825/2200957302] boot 2024-09-19T06:02:48.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:48 smithi099 ceph-mon[35300]: osdmap e68: 11 total, 11 up, 11 in 2024-09-19T06:02:48.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:48 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:02:48.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:48 smithi099 ceph-mon[35300]: osdmap e69: 11 total, 11 up, 11 in 2024-09-19T06:02:48.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:48 smithi099 ceph-mon[35300]: from='client.24352 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:02:48.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:48 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:02:48.690 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:48 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:02:48.690 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:48 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:02:49.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:49 smithi117 ceph-mon[35050]: osdmap e70: 11 total, 11 up, 11 in 2024-09-19T06:02:49.688 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:49 smithi099 ceph-mon[35300]: osdmap e70: 11 total, 11 up, 11 in 2024-09-19T06:02:49.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:49 smithi037 ceph-mon[31211]: osdmap e70: 11 total, 11 up, 11 in 2024-09-19T06:02:50.499 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:50 smithi117 ceph-mon[35050]: pgmap v228: 1 pgs: 1 peering; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:02:50.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:50 smithi117 ceph-mon[35050]: osdmap e71: 11 total, 11 up, 11 in 2024-09-19T06:02:50.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:50 smithi117 ceph-mon[35050]: from='client.? 172.21.15.117:0/2349802017' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "041d54f4-a274-47b5-a467-0ce86efd363b"}]: dispatch 2024-09-19T06:02:50.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:50 smithi117 ceph-mon[35050]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "041d54f4-a274-47b5-a467-0ce86efd363b"}]: dispatch 2024-09-19T06:02:50.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:50 smithi117 ceph-mon[35050]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "041d54f4-a274-47b5-a467-0ce86efd363b"}]': finished 2024-09-19T06:02:50.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:50 smithi117 ceph-mon[35050]: osdmap e72: 12 total, 11 up, 12 in 2024-09-19T06:02:50.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:50 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:02:50.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:50 smithi099 ceph-mon[35300]: pgmap v228: 1 pgs: 1 peering; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:02:50.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:50 smithi099 ceph-mon[35300]: osdmap e71: 11 total, 11 up, 11 in 2024-09-19T06:02:50.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:50 smithi099 ceph-mon[35300]: from='client.? 172.21.15.117:0/2349802017' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "041d54f4-a274-47b5-a467-0ce86efd363b"}]: dispatch 2024-09-19T06:02:50.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:50 smithi099 ceph-mon[35300]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "041d54f4-a274-47b5-a467-0ce86efd363b"}]: dispatch 2024-09-19T06:02:50.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:50 smithi099 ceph-mon[35300]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "041d54f4-a274-47b5-a467-0ce86efd363b"}]': finished 2024-09-19T06:02:50.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:50 smithi099 ceph-mon[35300]: osdmap e72: 12 total, 11 up, 12 in 2024-09-19T06:02:50.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:50 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:02:50.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:50 smithi037 ceph-mon[31211]: pgmap v228: 1 pgs: 1 peering; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:02:50.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:50 smithi037 ceph-mon[31211]: osdmap e71: 11 total, 11 up, 11 in 2024-09-19T06:02:50.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:50 smithi037 ceph-mon[31211]: from='client.? 172.21.15.117:0/2349802017' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "041d54f4-a274-47b5-a467-0ce86efd363b"}]: dispatch 2024-09-19T06:02:50.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:50 smithi037 ceph-mon[31211]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "041d54f4-a274-47b5-a467-0ce86efd363b"}]: dispatch 2024-09-19T06:02:50.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:50 smithi037 ceph-mon[31211]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "041d54f4-a274-47b5-a467-0ce86efd363b"}]': finished 2024-09-19T06:02:50.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:50 smithi037 ceph-mon[31211]: osdmap e72: 12 total, 11 up, 12 in 2024-09-19T06:02:50.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:50 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:02:51.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:51 smithi099 ceph-mon[35300]: from='client.? 172.21.15.117:0/3171745876' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:02:51.749 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:51 smithi117 ceph-mon[35050]: from='client.? 172.21.15.117:0/3171745876' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:02:51.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:51 smithi037 ceph-mon[31211]: from='client.? 172.21.15.117:0/3171745876' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:02:52.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:52 smithi099 ceph-mon[35300]: pgmap v231: 1 pgs: 1 peering; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:02:52.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:52 smithi117 ceph-mon[35050]: pgmap v231: 1 pgs: 1 peering; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:02:52.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:52 smithi037 ceph-mon[31211]: pgmap v231: 1 pgs: 1 peering; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:02:54.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:54 smithi099 ceph-mon[35300]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail; 110 KiB/s, 0 objects/s recovering 2024-09-19T06:02:54.733 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:54 smithi117 ceph-mon[35050]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail; 110 KiB/s, 0 objects/s recovering 2024-09-19T06:02:54.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:54 smithi037 ceph-mon[31211]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail; 110 KiB/s, 0 objects/s recovering 2024-09-19T06:02:56.602 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:56 smithi117 ceph-mon[35050]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-09-19T06:02:56.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:56 smithi099 ceph-mon[35300]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-09-19T06:02:56.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:56 smithi037 ceph-mon[31211]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-09-19T06:02:58.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:58 smithi099 ceph-mon[35300]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T06:02:58.749 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:58 smithi117 ceph-mon[35050]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T06:02:58.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:58 smithi037 ceph-mon[31211]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T06:02:59.663 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:59 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T06:02:59.663 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:59 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:02:59.663 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:02:59 smithi117 ceph-mon[35050]: Deploying daemon osd.11 on smithi117 2024-09-19T06:02:59.688 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:59 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T06:02:59.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:59 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:02:59.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:02:59 smithi099 ceph-mon[35300]: Deploying daemon osd.11 on smithi117 2024-09-19T06:02:59.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:59 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T06:02:59.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:59 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:02:59.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:02:59 smithi037 ceph-mon[31211]: Deploying daemon osd.11 on smithi117 2024-09-19T06:03:00.576 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:00 smithi117 ceph-mon[35050]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-19T06:03:00.688 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:00 smithi099 ceph-mon[35300]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-19T06:03:00.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:00 smithi037 ceph-mon[31211]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-19T06:03:02.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:02 smithi099 ceph-mon[35300]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-19T06:03:02.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:02 smithi117 ceph-mon[35050]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-19T06:03:02.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:02 smithi037 ceph-mon[31211]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-19T06:03:04.749 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:04 smithi117 ceph-mon[35050]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T06:03:04.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:04 smithi037 ceph-mon[31211]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T06:03:04.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:04 smithi099 ceph-mon[35300]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T06:03:05.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:05 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:03:05.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:05 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:05.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:05 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:05.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:05 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:03:05.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:05 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:05.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:05 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:05.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:05 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:03:05.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:05 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:05.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:05 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:06.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:06 smithi037 ceph-mon[31211]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:03:06.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:06 smithi099 ceph-mon[35300]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:03:06.943 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:06 smithi117 ceph-mon[35050]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:03:07.932 INFO:teuthology.orchestra.run.smithi117.stdout:Created osd(s) 11 on host 'smithi117' 2024-09-19T06:03:07.932 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:03:07.929+0000 7fe38cff9640 1 -- 172.21.15.117:0/3386442042 <== mgr.14148 v2:172.21.15.37:6800/3797010169 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fe390062630 con 0x7fe37c0a3240 2024-09-19T06:03:07.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:03:07.932+0000 7fe395de1640 1 -- 172.21.15.117:0/3386442042 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fe37c0a3240 msgr2=0x7fe37c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:07.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:03:07.932+0000 7fe395de1640 1 --2- 172.21.15.117:0/3386442042 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fe37c0a3240 0x7fe37c0a5700 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe390101d40 tx=0x7fe37800a4c0 comp rx=0 tx=0).stop 2024-09-19T06:03:07.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:03:07.932+0000 7fe395de1640 1 -- 172.21.15.117:0/3386442042 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe390102660 msgr2=0x7fe390101fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:07.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:03:07.932+0000 7fe395de1640 1 --2- 172.21.15.117:0/3386442042 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe390102660 0x7fe390101fc0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe38000c890 tx=0x7fe38000cd50 comp rx=0 tx=0).stop 2024-09-19T06:03:07.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:03:07.932+0000 7fe395de1640 1 -- 172.21.15.117:0/3386442042 shutdown_connections 2024-09-19T06:03:07.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:03:07.932+0000 7fe395de1640 1 --2- 172.21.15.117:0/3386442042 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fe37c0a3240 0x7fe37c0a5700 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:07.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:03:07.932+0000 7fe395de1640 1 --2- 172.21.15.117:0/3386442042 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3901078c0 0x7fe390100b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:07.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:03:07.932+0000 7fe395de1640 1 --2- 172.21.15.117:0/3386442042 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe390104f90 0x7fe390100610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:07.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:03:07.932+0000 7fe395de1640 1 --2- 172.21.15.117:0/3386442042 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe390102660 0x7fe390101fc0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:07.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:03:07.932+0000 7fe395de1640 1 -- 172.21.15.117:0/3386442042 >> 172.21.15.117:0/3386442042 conn(0x7fe3900fc280 msgr2=0x7fe390102f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:03:07.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:03:07.932+0000 7fe395de1640 1 -- 172.21.15.117:0/3386442042 shutdown_connections 2024-09-19T06:03:07.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:03:07.932+0000 7fe395de1640 1 -- 172.21.15.117:0/3386442042 wait complete. 2024-09-19T06:03:08.582 DEBUG:teuthology.orchestra.run.smithi117:osd.11> sudo journalctl -f -n 0 -u ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@osd.11.service 2024-09-19T06:03:08.584 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-19T06:03:08.585 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T06:03:08.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:08 smithi037 ceph-mon[31211]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:03:08.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:08 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:08.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:08 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:08.855 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:03:08.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:08 smithi099 ceph-mon[35300]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:03:08.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:08 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:08.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:08 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:08.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:08 smithi117 ceph-mon[35050]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:03:09.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:08 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:09.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:08 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:09.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:09.475+0000 7f73cd1ac640 1 -- 172.21.15.37:0/493444251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73c8100290 msgr2=0x7f73c8100690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:09.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:09.475+0000 7f73cd1ac640 1 --2- 172.21.15.37:0/493444251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73c8100290 0x7f73c8100690 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f73b800aa10 tx=0x7f73b802b720 comp rx=0 tx=0).stop 2024-09-19T06:03:09.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:09.475+0000 7f73cd1ac640 1 -- 172.21.15.37:0/493444251 shutdown_connections 2024-09-19T06:03:09.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:09.475+0000 7f73cd1ac640 1 --2- 172.21.15.37:0/493444251 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f73c8101490 0x7f73c8101910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:09.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:09.475+0000 7f73cd1ac640 1 --2- 172.21.15.37:0/493444251 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73c8101e50 0x7f73c81086e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:09.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:09.475+0000 7f73cd1ac640 1 --2- 172.21.15.37:0/493444251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73c8100290 0x7f73c8100690 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:09.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:09.475+0000 7f73cd1ac640 1 -- 172.21.15.37:0/493444251 >> 172.21.15.37:0/493444251 conn(0x7f73c80fba40 msgr2=0x7f73c80fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:03:09.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:09.475+0000 7f73cd1ac640 1 -- 172.21.15.37:0/493444251 shutdown_connections 2024-09-19T06:03:09.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:09.475+0000 7f73cd1ac640 1 -- 172.21.15.37:0/493444251 wait complete. 2024-09-19T06:03:09.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:09.476+0000 7f73cd1ac640 1 Processor -- start 2024-09-19T06:03:09.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:09.476+0000 7f73cd1ac640 1 -- start start 2024-09-19T06:03:09.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:09.476+0000 7f73cd1ac640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73c8100290 0x7f73c8197ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:09.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:09.476+0000 7f73cd1ac640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73c8101490 0x7f73c8198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:09.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:09.476+0000 7f73cd1ac640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f73c8101e50 0x7f73c819f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:09.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:09.476+0000 7f73cd1ac640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f73c810b6f0 con 0x7f73c8101490 2024-09-19T06:03:09.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:09.476+0000 7f73cd1ac640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f73c810b570 con 0x7f73c8101e50 2024-09-19T06:03:09.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:09.476+0000 7f73cd1ac640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f73c810b870 con 0x7f73c8100290 2024-09-19T06:03:09.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:09.476+0000 7f73c659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73c8101490 0x7f73c8198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:09.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:09.476+0000 7f73c6d9d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73c8100290 0x7f73c8197ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:09.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:09.476+0000 7f73c659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73c8101490 0x7f73c8198530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58300/0 (socket says 172.21.15.37:58300) 2024-09-19T06:03:09.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:09.476+0000 7f73c659c640 1 -- 172.21.15.37:0/991480203 learned_addr learned my addr 172.21.15.37:0/991480203 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:03:09.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:09.476+0000 7f73c6d9d640 1 --2- 172.21.15.37:0/991480203 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73c8100290 0x7f73c8197ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.37:38172/0 (socket says 172.21.15.37:38172) 2024-09-19T06:03:09.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:09.476+0000 7f73c759e640 1 --2- 172.21.15.37:0/991480203 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f73c8101e50 0x7f73c819f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:09.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:09.477+0000 7f73c659c640 1 -- 172.21.15.37:0/991480203 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73c8100290 msgr2=0x7f73c8197ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:09.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:09.477+0000 7f73c659c640 1 --2- 172.21.15.37:0/991480203 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73c8100290 0x7f73c8197ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:09.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:09.477+0000 7f73c659c640 1 -- 172.21.15.37:0/991480203 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f73c8101e50 msgr2=0x7f73c819f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:09.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:09.477+0000 7f73c659c640 1 --2- 172.21.15.37:0/991480203 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f73c8101e50 0x7f73c819f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:09.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:09.477+0000 7f73c659c640 1 -- 172.21.15.37:0/991480203 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73c819fc20 con 0x7f73c8101490 2024-09-19T06:03:09.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:09.477+0000 7f73c759e640 1 --2- 172.21.15.37:0/991480203 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f73c8101e50 0x7f73c819f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:03:09.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:09.477+0000 7f73c659c640 1 --2- 172.21.15.37:0/991480203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73c8101490 0x7f73c8198530 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f73bc00b4a0 tx=0x7f73bc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:03:09.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:09.477+0000 7f73affff640 1 -- 172.21.15.37:0/991480203 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73bc014070 con 0x7f73c8101490 2024-09-19T06:03:09.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:09.477+0000 7f73affff640 1 -- 172.21.15.37:0/991480203 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73bc010af0 con 0x7f73c8101490 2024-09-19T06:03:09.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:09.477+0000 7f73cd1ac640 1 -- 172.21.15.37:0/991480203 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73c819ff10 con 0x7f73c8101490 2024-09-19T06:03:09.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:09.477+0000 7f73affff640 1 -- 172.21.15.37:0/991480203 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73bc017d10 con 0x7f73c8101490 2024-09-19T06:03:09.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:09.477+0000 7f73cd1ac640 1 -- 172.21.15.37:0/991480203 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73c81a0490 con 0x7f73c8101490 2024-09-19T06:03:09.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:09.478+0000 7f73cd1ac640 1 -- 172.21.15.37:0/991480203 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73c8107780 con 0x7f73c8101490 2024-09-19T06:03:09.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:09.479+0000 7f73affff640 1 -- 172.21.15.37:0/991480203 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f73bc017070 con 0x7f73c8101490 2024-09-19T06:03:09.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:09.480+0000 7f73affff640 1 --2- 172.21.15.37:0/991480203 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f73b00a32f0 0x7f73b00a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:09.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:09.480+0000 7f73c6d9d640 1 --2- 172.21.15.37:0/991480203 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f73b00a32f0 0x7f73b00a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:09.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:09.480+0000 7f73affff640 1 -- 172.21.15.37:0/991480203 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6809+0+0 (secure 0 0 0) 0x7f73bc0ce680 con 0x7f73c8101490 2024-09-19T06:03:09.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:09.481+0000 7f73c6d9d640 1 --2- 172.21.15.37:0/991480203 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f73b00a32f0 0x7f73b00a57b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f73b800a340 tx=0x7f73b80306c0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:03:09.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:09.485+0000 7f73affff640 1 -- 172.21.15.37:0/991480203 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f73bc09b8e0 con 0x7f73c8101490 2024-09-19T06:03:09.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:09.665+0000 7f73cd1ac640 1 -- 172.21.15.37:0/991480203 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f73c8062df0 con 0x7f73c8101490 2024-09-19T06:03:09.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:09.666+0000 7f73affff640 1 -- 172.21.15.37:0/991480203 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v72) ==== 74+0+133 (secure 0 0 0) 0x7f73bc0b9e20 con 0x7f73c8101490 2024-09-19T06:03:09.668 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T06:03:09.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:09.668+0000 7f73cd1ac640 1 -- 172.21.15.37:0/991480203 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f73b00a32f0 msgr2=0x7f73b00a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:09.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:09.668+0000 7f73cd1ac640 1 --2- 172.21.15.37:0/991480203 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f73b00a32f0 0x7f73b00a57b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f73b800a340 tx=0x7f73b80306c0 comp rx=0 tx=0).stop 2024-09-19T06:03:09.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:09.668+0000 7f73cd1ac640 1 -- 172.21.15.37:0/991480203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73c8101490 msgr2=0x7f73c8198530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:09.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:09.668+0000 7f73cd1ac640 1 --2- 172.21.15.37:0/991480203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73c8101490 0x7f73c8198530 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f73bc00b4a0 tx=0x7f73bc00b960 comp rx=0 tx=0).stop 2024-09-19T06:03:09.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:09.668+0000 7f73cd1ac640 1 -- 172.21.15.37:0/991480203 shutdown_connections 2024-09-19T06:03:09.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:09.668+0000 7f73cd1ac640 1 --2- 172.21.15.37:0/991480203 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f73b00a32f0 0x7f73b00a57b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:09.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:09.668+0000 7f73cd1ac640 1 --2- 172.21.15.37:0/991480203 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f73c8101e50 0x7f73c819f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:09.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:09.668+0000 7f73cd1ac640 1 --2- 172.21.15.37:0/991480203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73c8101490 0x7f73c8198530 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:09.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:09.668+0000 7f73cd1ac640 1 --2- 172.21.15.37:0/991480203 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73c8100290 0x7f73c8197ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:09.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:09.668+0000 7f73cd1ac640 1 -- 172.21.15.37:0/991480203 >> 172.21.15.37:0/991480203 conn(0x7f73c80fba40 msgr2=0x7f73c8104950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:03:09.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:09.668+0000 7f73cd1ac640 1 -- 172.21.15.37:0/991480203 shutdown_connections 2024-09-19T06:03:09.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:09.668+0000 7f73cd1ac640 1 -- 172.21.15.37:0/991480203 wait complete. 2024-09-19T06:03:09.965 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:09 smithi037 ceph-mon[31211]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:03:09.965 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:09 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:09.966 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:09 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:09.966 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:09 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/991480203' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T06:03:10.136 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:09 smithi117 ceph-mon[35050]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:03:10.136 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:09 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:10.136 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:09 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:10.136 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:09 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/991480203' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T06:03:10.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:09 smithi099 ceph-mon[35300]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:03:10.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:09 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:10.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:09 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:10.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:09 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/991480203' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T06:03:10.436 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:03:10 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:03:10.355+0000 7fa3f0310640 -1 osd.11 0 log_to_monitors true 2024-09-19T06:03:10.462 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":72,"num_osds":12,"num_up_osds":11,"osd_up_since":1726725767,"num_in_osds":12,"osd_in_since":1726725769,"num_remapped_pgs":0} 2024-09-19T06:03:11.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:10 smithi037 ceph-mon[31211]: from='osd.11 [v2:172.21.15.117:6824/1354423136,v1:172.21.15.117:6825/1354423136]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T06:03:11.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:10 smithi037 ceph-mon[31211]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T06:03:11.136 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:10 smithi117 ceph-mon[35050]: from='osd.11 [v2:172.21.15.117:6824/1354423136,v1:172.21.15.117:6825/1354423136]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T06:03:11.136 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:10 smithi117 ceph-mon[35050]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T06:03:11.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:10 smithi099 ceph-mon[35300]: from='osd.11 [v2:172.21.15.117:6824/1354423136,v1:172.21.15.117:6825/1354423136]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T06:03:11.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:10 smithi099 ceph-mon[35300]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T06:03:11.464 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T06:03:11.726 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:03:11.787 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:03:11 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:03:11.773+0000 7fa3ec293640 -1 osd.11 0 waiting for initial osdmap 2024-09-19T06:03:11.787 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:03:11 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:03:11.785+0000 7fa3e80bb640 -1 osd.11 74 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:03:11.787 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:11 smithi117 ceph-mon[35050]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:03:11.787 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:11 smithi117 ceph-mon[35050]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T06:03:11.788 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:11 smithi117 ceph-mon[35050]: osdmap e73: 12 total, 11 up, 12 in 2024-09-19T06:03:11.788 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:11 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:03:11.788 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:11 smithi117 ceph-mon[35050]: from='osd.11 [v2:172.21.15.117:6824/1354423136,v1:172.21.15.117:6825/1354423136]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-19T06:03:11.788 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:11 smithi117 ceph-mon[35050]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-19T06:03:12.024 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:11 smithi037 ceph-mon[31211]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:03:12.024 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:11 smithi037 ceph-mon[31211]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T06:03:12.024 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:11 smithi037 ceph-mon[31211]: osdmap e73: 12 total, 11 up, 12 in 2024-09-19T06:03:12.024 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:11 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:03:12.024 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:11 smithi037 ceph-mon[31211]: from='osd.11 [v2:172.21.15.117:6824/1354423136,v1:172.21.15.117:6825/1354423136]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-19T06:03:12.024 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:11 smithi037 ceph-mon[31211]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-19T06:03:12.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:11 smithi099 ceph-mon[35300]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:03:12.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:11 smithi099 ceph-mon[35300]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T06:03:12.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:11 smithi099 ceph-mon[35300]: osdmap e73: 12 total, 11 up, 12 in 2024-09-19T06:03:12.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:11 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:03:12.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:11 smithi099 ceph-mon[35300]: from='osd.11 [v2:172.21.15.117:6824/1354423136,v1:172.21.15.117:6825/1354423136]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-19T06:03:12.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:11 smithi099 ceph-mon[35300]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-19T06:03:12.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:12.242+0000 7f8c44e58640 1 -- 172.21.15.37:0/2211914804 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c401026a0 msgr2=0x7f8c40104a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:12.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:12.242+0000 7f8c44e58640 1 --2- 172.21.15.37:0/2211914804 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c401026a0 0x7f8c40104a90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8c30009900 tx=0x7f8c3002a3f0 comp rx=0 tx=0).stop 2024-09-19T06:03:12.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:12.242+0000 7f8c44e58640 1 -- 172.21.15.37:0/2211914804 shutdown_connections 2024-09-19T06:03:12.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:12.242+0000 7f8c44e58640 1 --2- 172.21.15.37:0/2211914804 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c40107900 0x7f8c40109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:12.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:12.242+0000 7f8c44e58640 1 --2- 172.21.15.37:0/2211914804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c40104fd0 0x7f8c401073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:12.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:12.242+0000 7f8c44e58640 1 --2- 172.21.15.37:0/2211914804 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c401026a0 0x7f8c40104a90 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:12.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:12.242+0000 7f8c44e58640 1 -- 172.21.15.37:0/2211914804 >> 172.21.15.37:0/2211914804 conn(0x7f8c400fc2a0 msgr2=0x7f8c400fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:03:12.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:12.243+0000 7f8c44e58640 1 -- 172.21.15.37:0/2211914804 shutdown_connections 2024-09-19T06:03:12.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:12.243+0000 7f8c44e58640 1 -- 172.21.15.37:0/2211914804 wait complete. 2024-09-19T06:03:12.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:12.243+0000 7f8c44e58640 1 Processor -- start 2024-09-19T06:03:12.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:12.244+0000 7f8c44e58640 1 -- start start 2024-09-19T06:03:12.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:12.244+0000 7f8c44e58640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c401026a0 0x7f8c40197fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:12.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:12.244+0000 7f8c44e58640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c40104fd0 0x7f8c401984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:12.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:12.244+0000 7f8c44e58640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c40107900 0x7f8c4019f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:12.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:12.244+0000 7f8c44e58640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8c4010d940 con 0x7f8c401026a0 2024-09-19T06:03:12.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:12.244+0000 7f8c44e58640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f8c4010d7c0 con 0x7f8c40104fd0 2024-09-19T06:03:12.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:12.244+0000 7f8c44e58640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8c4010dac0 con 0x7f8c40107900 2024-09-19T06:03:12.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:12.244+0000 7f8c3e59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c401026a0 0x7f8c40197fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:12.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:12.245+0000 7f8c3e59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c401026a0 0x7f8c40197fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58308/0 (socket says 172.21.15.37:58308) 2024-09-19T06:03:12.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:12.245+0000 7f8c3e59c640 1 -- 172.21.15.37:0/3507212595 learned_addr learned my addr 172.21.15.37:0/3507212595 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:03:12.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:12.245+0000 7f8c3ed9d640 1 --2- 172.21.15.37:0/3507212595 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c40107900 0x7f8c4019f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:12.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:12.245+0000 7f8c3dd9b640 1 --2- 172.21.15.37:0/3507212595 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c40104fd0 0x7f8c401984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:12.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:12.245+0000 7f8c3ed9d640 1 -- 172.21.15.37:0/3507212595 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c40104fd0 msgr2=0x7f8c401984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:12.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:12.245+0000 7f8c3ed9d640 1 --2- 172.21.15.37:0/3507212595 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c40104fd0 0x7f8c401984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:12.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:12.245+0000 7f8c3ed9d640 1 -- 172.21.15.37:0/3507212595 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c401026a0 msgr2=0x7f8c40197fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:12.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:12.245+0000 7f8c3ed9d640 1 --2- 172.21.15.37:0/3507212595 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c401026a0 0x7f8c40197fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:12.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:12.245+0000 7f8c3ed9d640 1 -- 172.21.15.37:0/3507212595 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c4019fbd0 con 0x7f8c40107900 2024-09-19T06:03:12.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:12.245+0000 7f8c3e59c640 1 --2- 172.21.15.37:0/3507212595 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c401026a0 0x7f8c40197fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:03:12.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:12.245+0000 7f8c3ed9d640 1 --2- 172.21.15.37:0/3507212595 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c40107900 0x7f8c4019f560 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8c3800be20 tx=0x7f8c3800bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:03:12.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:12.245+0000 7f8c2f7fe640 1 -- 172.21.15.37:0/3507212595 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c38019070 con 0x7f8c40107900 2024-09-19T06:03:12.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:12.246+0000 7f8c44e58640 1 -- 172.21.15.37:0/3507212595 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c4019fec0 con 0x7f8c40107900 2024-09-19T06:03:12.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:12.246+0000 7f8c2f7fe640 1 -- 172.21.15.37:0/3507212595 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8c38014920 con 0x7f8c40107900 2024-09-19T06:03:12.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:12.246+0000 7f8c2f7fe640 1 -- 172.21.15.37:0/3507212595 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c38012920 con 0x7f8c40107900 2024-09-19T06:03:12.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:12.246+0000 7f8c44e58640 1 -- 172.21.15.37:0/3507212595 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c401a03f0 con 0x7f8c40107900 2024-09-19T06:03:12.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:12.246+0000 7f8c44e58640 1 -- 172.21.15.37:0/3507212595 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c400fdd90 con 0x7f8c40107900 2024-09-19T06:03:12.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:12.248+0000 7f8c2f7fe640 1 -- 172.21.15.37:0/3507212595 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f8c3801c070 con 0x7f8c40107900 2024-09-19T06:03:12.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:12.248+0000 7f8c2f7fe640 1 --2- 172.21.15.37:0/3507212595 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f8c280a3270 0x7f8c280a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:12.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:12.249+0000 7f8c3e59c640 1 --2- 172.21.15.37:0/3507212595 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f8c280a3270 0x7f8c280a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:12.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:12.249+0000 7f8c2f7fe640 1 -- 172.21.15.37:0/3507212595 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6847+0+0 (secure 0 0 0) 0x7f8c380cee60 con 0x7f8c40107900 2024-09-19T06:03:12.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:12.249+0000 7f8c3e59c640 1 --2- 172.21.15.37:0/3507212595 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f8c280a3270 0x7f8c280a5730 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8c30031440 tx=0x7f8c300315b0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:03:12.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:12.252+0000 7f8c2f7fe640 1 -- 172.21.15.37:0/3507212595 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8c3809ba90 con 0x7f8c40107900 2024-09-19T06:03:12.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:12.427+0000 7f8c44e58640 1 -- 172.21.15.37:0/3507212595 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f8c4002d9c0 con 0x7f8c40107900 2024-09-19T06:03:12.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:12.427+0000 7f8c2f7fe640 1 -- 172.21.15.37:0/3507212595 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v74) ==== 74+0+133 (secure 0 0 0) 0x7f8c3809fd90 con 0x7f8c40107900 2024-09-19T06:03:12.430 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T06:03:12.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:12.429+0000 7f8c44e58640 1 -- 172.21.15.37:0/3507212595 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f8c280a3270 msgr2=0x7f8c280a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:12.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:12.429+0000 7f8c44e58640 1 --2- 172.21.15.37:0/3507212595 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f8c280a3270 0x7f8c280a5730 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8c30031440 tx=0x7f8c300315b0 comp rx=0 tx=0).stop 2024-09-19T06:03:12.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:12.430+0000 7f8c44e58640 1 -- 172.21.15.37:0/3507212595 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c40107900 msgr2=0x7f8c4019f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:12.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:12.430+0000 7f8c44e58640 1 --2- 172.21.15.37:0/3507212595 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c40107900 0x7f8c4019f560 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8c3800be20 tx=0x7f8c3800bf10 comp rx=0 tx=0).stop 2024-09-19T06:03:12.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:12.430+0000 7f8c44e58640 1 -- 172.21.15.37:0/3507212595 shutdown_connections 2024-09-19T06:03:12.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:12.430+0000 7f8c44e58640 1 --2- 172.21.15.37:0/3507212595 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f8c280a3270 0x7f8c280a5730 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:12.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:12.430+0000 7f8c44e58640 1 --2- 172.21.15.37:0/3507212595 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c40104fd0 0x7f8c401984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:12.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:12.430+0000 7f8c44e58640 1 --2- 172.21.15.37:0/3507212595 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c40107900 0x7f8c4019f560 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:12.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:12.430+0000 7f8c44e58640 1 --2- 172.21.15.37:0/3507212595 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c401026a0 0x7f8c40197fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:12.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:12.430+0000 7f8c44e58640 1 -- 172.21.15.37:0/3507212595 >> 172.21.15.37:0/3507212595 conn(0x7f8c400fc2a0 msgr2=0x7f8c40103040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:03:12.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:12.430+0000 7f8c44e58640 1 -- 172.21.15.37:0/3507212595 shutdown_connections 2024-09-19T06:03:12.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:12.430+0000 7f8c44e58640 1 -- 172.21.15.37:0/3507212595 wait complete. 2024-09-19T06:03:13.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:12 smithi037 ceph-mon[31211]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]': finished 2024-09-19T06:03:13.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:12 smithi037 ceph-mon[31211]: osdmap e74: 12 total, 11 up, 12 in 2024-09-19T06:03:13.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:12 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:03:13.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:12 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:03:13.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:12 smithi037 ceph-mon[31211]: Detected new or changed devices on smithi117 2024-09-19T06:03:13.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:12 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:13.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:12 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:13.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:12 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:03:13.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:12 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:03:13.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:12 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:03:13.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:12 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:03:13.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:12 smithi037 ceph-mon[31211]: Adjusting osd_memory_target on smithi117 to 4272M 2024-09-19T06:03:13.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:12 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:13.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:12 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:13.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:12 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:03:13.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:12 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:13.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:12 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:03:13.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:12 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:13.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:12 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:03:13.076 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:12 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:13.076 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:12 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/3507212595' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T06:03:13.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:12 smithi099 ceph-mon[35300]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]': finished 2024-09-19T06:03:13.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:12 smithi099 ceph-mon[35300]: osdmap e74: 12 total, 11 up, 12 in 2024-09-19T06:03:13.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:12 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:03:13.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:12 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:03:13.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:12 smithi099 ceph-mon[35300]: Detected new or changed devices on smithi117 2024-09-19T06:03:13.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:12 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:13.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:12 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:13.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:12 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:03:13.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:12 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:03:13.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:12 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:03:13.190 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:12 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:03:13.190 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:12 smithi099 ceph-mon[35300]: Adjusting osd_memory_target on smithi117 to 4272M 2024-09-19T06:03:13.190 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:12 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:13.190 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:12 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:13.190 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:12 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:03:13.190 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:12 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:13.190 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:12 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:03:13.190 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:12 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:13.190 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:12 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:03:13.190 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:12 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:13.190 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:12 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/3507212595' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T06:03:13.233 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":74,"num_osds":12,"num_up_osds":11,"osd_up_since":1726725767,"num_in_osds":12,"osd_in_since":1726725769,"num_remapped_pgs":0} 2024-09-19T06:03:13.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:12 smithi117 ceph-mon[35050]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]': finished 2024-09-19T06:03:13.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:12 smithi117 ceph-mon[35050]: osdmap e74: 12 total, 11 up, 12 in 2024-09-19T06:03:13.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:12 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:03:13.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:12 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:03:13.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:12 smithi117 ceph-mon[35050]: Detected new or changed devices on smithi117 2024-09-19T06:03:13.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:12 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:13.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:12 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:13.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:12 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:03:13.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:12 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:03:13.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:12 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:03:13.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:12 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:03:13.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:12 smithi117 ceph-mon[35050]: Adjusting osd_memory_target on smithi117 to 4272M 2024-09-19T06:03:13.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:12 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:13.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:12 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:13.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:12 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:03:13.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:12 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:13.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:12 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:03:13.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:12 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:13.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:12 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:03:13.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:12 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:13.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:12 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/3507212595' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T06:03:14.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:13 smithi037 ceph-mon[31211]: purged_snaps scrub starts 2024-09-19T06:03:14.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:13 smithi037 ceph-mon[31211]: purged_snaps scrub ok 2024-09-19T06:03:14.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:13 smithi037 ceph-mon[31211]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:03:14.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:13 smithi037 ceph-mon[31211]: osd.11 [v2:172.21.15.117:6824/1354423136,v1:172.21.15.117:6825/1354423136] boot 2024-09-19T06:03:14.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:13 smithi037 ceph-mon[31211]: osdmap e75: 12 total, 12 up, 12 in 2024-09-19T06:03:14.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:13 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:03:14.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:13 smithi099 ceph-mon[35300]: purged_snaps scrub starts 2024-09-19T06:03:14.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:13 smithi099 ceph-mon[35300]: purged_snaps scrub ok 2024-09-19T06:03:14.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:13 smithi099 ceph-mon[35300]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:03:14.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:13 smithi099 ceph-mon[35300]: osd.11 [v2:172.21.15.117:6824/1354423136,v1:172.21.15.117:6825/1354423136] boot 2024-09-19T06:03:14.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:13 smithi099 ceph-mon[35300]: osdmap e75: 12 total, 12 up, 12 in 2024-09-19T06:03:14.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:13 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:03:14.234 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T06:03:14.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:13 smithi117 ceph-mon[35050]: purged_snaps scrub starts 2024-09-19T06:03:14.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:13 smithi117 ceph-mon[35050]: purged_snaps scrub ok 2024-09-19T06:03:14.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:13 smithi117 ceph-mon[35050]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:03:14.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:13 smithi117 ceph-mon[35050]: osd.11 [v2:172.21.15.117:6824/1354423136,v1:172.21.15.117:6825/1354423136] boot 2024-09-19T06:03:14.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:13 smithi117 ceph-mon[35050]: osdmap e75: 12 total, 12 up, 12 in 2024-09-19T06:03:14.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:13 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:03:14.504 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:03:15.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:15 smithi037 ceph-mon[31211]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T06:03:15.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:15.011+0000 7fbd5cbd8640 1 -- 172.21.15.37:0/1681003151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd58107920 msgr2=0x7fbd58109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:15.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:15.011+0000 7fbd5cbd8640 1 --2- 172.21.15.37:0/1681003151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd58107920 0x7fbd58109d10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbd50009ca0 tx=0x7fbd5002a8c0 comp rx=0 tx=0).stop 2024-09-19T06:03:15.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:15.011+0000 7fbd5cbd8640 1 -- 172.21.15.37:0/1681003151 shutdown_connections 2024-09-19T06:03:15.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:15.011+0000 7fbd5cbd8640 1 --2- 172.21.15.37:0/1681003151 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd58104ff0 0x7fbd581073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:15.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:15.011+0000 7fbd5cbd8640 1 --2- 172.21.15.37:0/1681003151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd58107920 0x7fbd58109d10 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:15.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:15.011+0000 7fbd5cbd8640 1 --2- 172.21.15.37:0/1681003151 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd581026c0 0x7fbd58104ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:15.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:15.011+0000 7fbd5cbd8640 1 -- 172.21.15.37:0/1681003151 >> 172.21.15.37:0/1681003151 conn(0x7fbd580fc280 msgr2=0x7fbd580fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:03:15.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:15.011+0000 7fbd5cbd8640 1 -- 172.21.15.37:0/1681003151 shutdown_connections 2024-09-19T06:03:15.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:15.011+0000 7fbd5cbd8640 1 -- 172.21.15.37:0/1681003151 wait complete. 2024-09-19T06:03:15.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:15.012+0000 7fbd5cbd8640 1 Processor -- start 2024-09-19T06:03:15.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:15.012+0000 7fbd5cbd8640 1 -- start start 2024-09-19T06:03:15.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:15.012+0000 7fbd5cbd8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd581026c0 0x7fbd58102020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:15.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:15.012+0000 7fbd5cbd8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd58104ff0 0x7fbd58100670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:15.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:15.013+0000 7fbd5cbd8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd58107920 0x7fbd58100bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:15.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:15.013+0000 7fbd5cbd8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbd5810d880 con 0x7fbd581026c0 2024-09-19T06:03:15.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:15.013+0000 7fbd5cbd8640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fbd5810d700 con 0x7fbd58104ff0 2024-09-19T06:03:15.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:15.013+0000 7fbd5cbd8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbd5810da00 con 0x7fbd58107920 2024-09-19T06:03:15.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:15.013+0000 7fbd5659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd581026c0 0x7fbd58102020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:15.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:15.013+0000 7fbd5659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd581026c0 0x7fbd58102020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54310/0 (socket says 172.21.15.37:54310) 2024-09-19T06:03:15.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:15.013+0000 7fbd5659c640 1 -- 172.21.15.37:0/2647812631 learned_addr learned my addr 172.21.15.37:0/2647812631 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:03:15.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:15.013+0000 7fbd55d9b640 1 --2- 172.21.15.37:0/2647812631 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd58104ff0 0x7fbd58100670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:15.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:15.013+0000 7fbd56d9d640 1 --2- 172.21.15.37:0/2647812631 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd58107920 0x7fbd58100bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:15.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:15.013+0000 7fbd5659c640 1 -- 172.21.15.37:0/2647812631 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd58107920 msgr2=0x7fbd58100bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:15.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:15.013+0000 7fbd5659c640 1 --2- 172.21.15.37:0/2647812631 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd58107920 0x7fbd58100bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:15.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:15.013+0000 7fbd5659c640 1 -- 172.21.15.37:0/2647812631 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd58104ff0 msgr2=0x7fbd58100670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:15.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:15.013+0000 7fbd5659c640 1 --2- 172.21.15.37:0/2647812631 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd58104ff0 0x7fbd58100670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:15.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:15.013+0000 7fbd5659c640 1 -- 172.21.15.37:0/2647812631 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd58101470 con 0x7fbd581026c0 2024-09-19T06:03:15.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:15.013+0000 7fbd56d9d640 1 --2- 172.21.15.37:0/2647812631 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd58107920 0x7fbd58100bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:03:15.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:15.013+0000 7fbd5659c640 1 --2- 172.21.15.37:0/2647812631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd581026c0 0x7fbd58102020 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbd4800d770 tx=0x7fbd4800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:03:15.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:15.013+0000 7fbd477fe640 1 -- 172.21.15.37:0/2647812631 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd48017070 con 0x7fbd581026c0 2024-09-19T06:03:15.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:15.013+0000 7fbd477fe640 1 -- 172.21.15.37:0/2647812631 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbd48005500 con 0x7fbd581026c0 2024-09-19T06:03:15.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:15.013+0000 7fbd5cbd8640 1 -- 172.21.15.37:0/2647812631 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd581a2070 con 0x7fbd581026c0 2024-09-19T06:03:15.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:15.013+0000 7fbd477fe640 1 -- 172.21.15.37:0/2647812631 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd48004e00 con 0x7fbd581026c0 2024-09-19T06:03:15.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:15.013+0000 7fbd5cbd8640 1 -- 172.21.15.37:0/2647812631 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd581a2530 con 0x7fbd581026c0 2024-09-19T06:03:15.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:15.015+0000 7fbd5cbd8640 1 -- 172.21.15.37:0/2647812631 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd580fdd70 con 0x7fbd581026c0 2024-09-19T06:03:15.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:15.016+0000 7fbd477fe640 1 -- 172.21.15.37:0/2647812631 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fbd48010460 con 0x7fbd581026c0 2024-09-19T06:03:15.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:15.016+0000 7fbd477fe640 1 --2- 172.21.15.37:0/2647812631 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fbd400a3240 0x7fbd400a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:15.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:15.017+0000 7fbd477fe640 1 -- 172.21.15.37:0/2647812631 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fbd480ceef0 con 0x7fbd581026c0 2024-09-19T06:03:15.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:15.017+0000 7fbd55d9b640 1 --2- 172.21.15.37:0/2647812631 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fbd400a3240 0x7fbd400a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:15.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:15.017+0000 7fbd55d9b640 1 --2- 172.21.15.37:0/2647812631 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fbd400a3240 0x7fbd400a5700 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbd58101da0 tx=0x7fbd4c00b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:03:15.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:15.021+0000 7fbd477fe640 1 -- 172.21.15.37:0/2647812631 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbd4809c0b0 con 0x7fbd581026c0 2024-09-19T06:03:15.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:15.196+0000 7fbd5cbd8640 1 -- 172.21.15.37:0/2647812631 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fbd58062df0 con 0x7fbd581026c0 2024-09-19T06:03:15.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:15.197+0000 7fbd477fe640 1 -- 172.21.15.37:0/2647812631 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v76) ==== 74+0+133 (secure 0 0 0) 0x7fbd4809b9b0 con 0x7fbd581026c0 2024-09-19T06:03:15.198 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T06:03:15.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:15.199+0000 7fbd5cbd8640 1 -- 172.21.15.37:0/2647812631 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fbd400a3240 msgr2=0x7fbd400a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:15.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:15.199+0000 7fbd5cbd8640 1 --2- 172.21.15.37:0/2647812631 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fbd400a3240 0x7fbd400a5700 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbd58101da0 tx=0x7fbd4c00b410 comp rx=0 tx=0).stop 2024-09-19T06:03:15.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:15.199+0000 7fbd5cbd8640 1 -- 172.21.15.37:0/2647812631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd581026c0 msgr2=0x7fbd58102020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:15.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:15.199+0000 7fbd5cbd8640 1 --2- 172.21.15.37:0/2647812631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd581026c0 0x7fbd58102020 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbd4800d770 tx=0x7fbd4800dc30 comp rx=0 tx=0).stop 2024-09-19T06:03:15.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:15.199+0000 7fbd5cbd8640 1 -- 172.21.15.37:0/2647812631 shutdown_connections 2024-09-19T06:03:15.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:15.199+0000 7fbd5cbd8640 1 --2- 172.21.15.37:0/2647812631 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fbd400a3240 0x7fbd400a5700 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:15.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:15.199+0000 7fbd5cbd8640 1 --2- 172.21.15.37:0/2647812631 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd58104ff0 0x7fbd58100670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:15.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:15.199+0000 7fbd5cbd8640 1 --2- 172.21.15.37:0/2647812631 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd58107920 0x7fbd58100bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:15.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:15.199+0000 7fbd5cbd8640 1 --2- 172.21.15.37:0/2647812631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd581026c0 0x7fbd58102020 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:15.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:15.199+0000 7fbd5cbd8640 1 -- 172.21.15.37:0/2647812631 >> 172.21.15.37:0/2647812631 conn(0x7fbd580fc280 msgr2=0x7fbd58102f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:03:15.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:15.199+0000 7fbd5cbd8640 1 -- 172.21.15.37:0/2647812631 shutdown_connections 2024-09-19T06:03:15.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:15.199+0000 7fbd5cbd8640 1 -- 172.21.15.37:0/2647812631 wait complete. 2024-09-19T06:03:15.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:15 smithi099 ceph-mon[35300]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T06:03:15.499 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:15 smithi117 ceph-mon[35050]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T06:03:15.913 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":76,"num_osds":12,"num_up_osds":12,"osd_up_since":1726725792,"num_in_osds":12,"osd_in_since":1726725769,"num_remapped_pgs":0} 2024-09-19T06:03:15.913 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T06:03:16.177 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:03:16.298 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:16 smithi037 ceph-mon[31211]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:03:16.298 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:16 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/2647812631' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T06:03:16.438 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:16 smithi099 ceph-mon[35300]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:03:16.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:16 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/2647812631' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T06:03:16.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:16 smithi117 ceph-mon[35050]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:03:16.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:16 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/2647812631' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T06:03:16.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:16.662+0000 7fbcd0651640 1 -- 172.21.15.37:0/2097808711 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbcc8102d90 msgr2=0x7fbcc8103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:16.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:16.662+0000 7fbcd0651640 1 --2- 172.21.15.37:0/2097808711 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbcc8102d90 0x7fbcc8103170 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbcb8009cd0 tx=0x7fbcb802a8e0 comp rx=0 tx=0).stop 2024-09-19T06:03:16.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:16.662+0000 7fbcd0651640 1 -- 172.21.15.37:0/2097808711 shutdown_connections 2024-09-19T06:03:16.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:16.662+0000 7fbcd0651640 1 --2- 172.21.15.37:0/2097808711 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbcc8108290 0x7fbcc810ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:16.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:16.662+0000 7fbcd0651640 1 --2- 172.21.15.37:0/2097808711 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbcc8103740 0x7fbcc8107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:16.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:16.662+0000 7fbcd0651640 1 --2- 172.21.15.37:0/2097808711 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbcc8102d90 0x7fbcc8103170 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:16.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:16.662+0000 7fbcd0651640 1 -- 172.21.15.37:0/2097808711 >> 172.21.15.37:0/2097808711 conn(0x7fbcc80fc7d0 msgr2=0x7fbcc80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:03:16.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:16.662+0000 7fbcd0651640 1 -- 172.21.15.37:0/2097808711 shutdown_connections 2024-09-19T06:03:16.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:16.662+0000 7fbcd0651640 1 -- 172.21.15.37:0/2097808711 wait complete. 2024-09-19T06:03:16.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:16.663+0000 7fbcd0651640 1 Processor -- start 2024-09-19T06:03:16.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:16.663+0000 7fbcd0651640 1 -- start start 2024-09-19T06:03:16.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:16.663+0000 7fbcd0651640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbcc8102d90 0x7fbcc8198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:16.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:16.663+0000 7fbcd0651640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbcc8103740 0x7fbcc8198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:16.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:16.663+0000 7fbcd0651640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbcc8108290 0x7fbcc819ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:16.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:16.663+0000 7fbcd0651640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc81120d0 con 0x7fbcc8103740 2024-09-19T06:03:16.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:16.663+0000 7fbcd0651640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc8111f50 con 0x7fbcc8108290 2024-09-19T06:03:16.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:16.663+0000 7fbcd0651640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc8112250 con 0x7fbcc8102d90 2024-09-19T06:03:16.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:16.663+0000 7fbccdbec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbcc8103740 0x7fbcc8198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:16.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:16.663+0000 7fbccdbec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbcc8103740 0x7fbcc8198ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54326/0 (socket says 172.21.15.37:54326) 2024-09-19T06:03:16.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:16.663+0000 7fbccdbec640 1 -- 172.21.15.37:0/1528764366 learned_addr learned my addr 172.21.15.37:0/1528764366 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:03:16.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:16.663+0000 7fbcce3ed640 1 --2- 172.21.15.37:0/1528764366 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbcc8102d90 0x7fbcc8198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:16.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:16.663+0000 7fbccebee640 1 --2- 172.21.15.37:0/1528764366 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbcc8108290 0x7fbcc819ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:16.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:16.663+0000 7fbccdbec640 1 -- 172.21.15.37:0/1528764366 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbcc8102d90 msgr2=0x7fbcc8198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:16.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:16.663+0000 7fbccdbec640 1 --2- 172.21.15.37:0/1528764366 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbcc8102d90 0x7fbcc8198570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:16.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:16.663+0000 7fbccdbec640 1 -- 172.21.15.37:0/1528764366 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbcc8108290 msgr2=0x7fbcc819ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:16.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:16.663+0000 7fbccdbec640 1 --2- 172.21.15.37:0/1528764366 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbcc8108290 0x7fbcc819ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:16.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:16.664+0000 7fbccdbec640 1 -- 172.21.15.37:0/1528764366 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcc819d520 con 0x7fbcc8103740 2024-09-19T06:03:16.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:16.664+0000 7fbccebee640 1 --2- 172.21.15.37:0/1528764366 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbcc8108290 0x7fbcc819ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:03:16.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:16.664+0000 7fbccdbec640 1 --2- 172.21.15.37:0/1528764366 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbcc8103740 0x7fbcc8198ab0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc00c970 tx=0x7fbcbc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:03:16.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:16.664+0000 7fbcc77fe640 1 -- 172.21.15.37:0/1528764366 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcbc014070 con 0x7fbcc8103740 2024-09-19T06:03:16.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:16.664+0000 7fbcc77fe640 1 -- 172.21.15.37:0/1528764366 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbcbc004440 con 0x7fbcc8103740 2024-09-19T06:03:16.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:16.664+0000 7fbcc77fe640 1 -- 172.21.15.37:0/1528764366 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcbc00f450 con 0x7fbcc8103740 2024-09-19T06:03:16.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:16.664+0000 7fbcd0651640 1 -- 172.21.15.37:0/1528764366 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcc819d810 con 0x7fbcc8103740 2024-09-19T06:03:16.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:16.664+0000 7fbcd0651640 1 -- 172.21.15.37:0/1528764366 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcc81a50f0 con 0x7fbcc8103740 2024-09-19T06:03:16.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:16.665+0000 7fbcd0651640 1 -- 172.21.15.37:0/1528764366 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcc806a7f0 con 0x7fbcc8103740 2024-09-19T06:03:16.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:16.666+0000 7fbcc77fe640 1 -- 172.21.15.37:0/1528764366 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fbcbc017070 con 0x7fbcc8103740 2024-09-19T06:03:16.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:16.667+0000 7fbcc77fe640 1 --2- 172.21.15.37:0/1528764366 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fbcb00a32c0 0x7fbcb00a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:16.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:16.667+0000 7fbcc77fe640 1 -- 172.21.15.37:0/1528764366 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fbcbc0cf790 con 0x7fbcc8103740 2024-09-19T06:03:16.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:16.667+0000 7fbcce3ed640 1 --2- 172.21.15.37:0/1528764366 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fbcb00a32c0 0x7fbcb00a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:16.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:16.667+0000 7fbcce3ed640 1 --2- 172.21.15.37:0/1528764366 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fbcb00a32c0 0x7fbcb00a5780 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbcb8006010 tx=0x7fbcb8009800 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:03:16.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:16.670+0000 7fbcc77fe640 1 -- 172.21.15.37:0/1528764366 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbcbc01e020 con 0x7fbcc8103740 2024-09-19T06:03:16.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:16.847+0000 7fbcd0651640 1 -- 172.21.15.37:0/1528764366 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbcc810a2d0 con 0x7fbcc8103740 2024-09-19T06:03:16.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:16.848+0000 7fbcc77fe640 1 -- 172.21.15.37:0/1528764366 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+18456 (secure 0 0 0) 0x7fbcbc09c930 con 0x7fbcc8103740 2024-09-19T06:03:16.850 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T06:03:16.850 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":76,"fsid":"b8c8bdae-764b-11ef-bceb-c7b262605968","created":"2024-09-19T05:56:22.523060+0000","modified":"2024-09-19T06:03:13.999854+0000","last_up_change":"2024-09-19T06:03:12.771014+0000","last_in_change":"2024-09-19T06:02:49.926626+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:59:27.062607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"455bc11d-2b6e-4a0c-90d9-8ab4ef4f9e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1783875173},{"type":"v1","addr":"172.21.15.37:6803","nonce":1783875173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1783875173},{"type":"v1","addr":"172.21.15.37:6805","nonce":1783875173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1783875173},{"type":"v1","addr":"172.21.15.37:6809","nonce":1783875173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1783875173},{"type":"v1","addr":"172.21.15.37:6807","nonce":1783875173}]},"public_addr":"172.21.15.37:6803/1783875173","cluster_addr":"172.21.15.37:6805/1783875173","heartbeat_back_addr":"172.21.15.37:6809/1783875173","heartbeat_front_addr":"172.21.15.37:6807/1783875173","state":["exists","up"]},{"osd":1,"uuid":"3505c162-c342-479d-8ea2-15b7a9d625cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":3414373360},{"type":"v1","addr":"172.21.15.99:6801","nonce":3414373360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":3414373360},{"type":"v1","addr":"172.21.15.99:6803","nonce":3414373360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":3414373360},{"type":"v1","addr":"172.21.15.99:6807","nonce":3414373360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":3414373360},{"type":"v1","addr":"172.21.15.99:6805","nonce":3414373360}]},"public_addr":"172.21.15.99:6801/3414373360","cluster_addr":"172.21.15.99:6803/3414373360","heartbeat_back_addr":"172.21.15.99:6807/3414373360","heartbeat_front_addr":"172.21.15.99:6805/3414373360","state":["exists","up"]},{"osd":2,"uuid":"736ec67f-b5e7-43f0-9303-0c88878ead6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3794943081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3794943081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3794943081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3794943081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3794943081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3794943081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3794943081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3794943081}]},"public_addr":"172.21.15.117:6801/3794943081","cluster_addr":"172.21.15.117:6803/3794943081","heartbeat_back_addr":"172.21.15.117:6807/3794943081","heartbeat_front_addr":"172.21.15.117:6805/3794943081","state":["exists","up"]},{"osd":3,"uuid":"3f784ef7-0cc1-4c86-a03a-b8f13396c835","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2121011955},{"type":"v1","addr":"172.21.15.37:6811","nonce":2121011955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2121011955},{"type":"v1","addr":"172.21.15.37:6813","nonce":2121011955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2121011955},{"type":"v1","addr":"172.21.15.37:6817","nonce":2121011955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2121011955},{"type":"v1","addr":"172.21.15.37:6815","nonce":2121011955}]},"public_addr":"172.21.15.37:6811/2121011955","cluster_addr":"172.21.15.37:6813/2121011955","heartbeat_back_addr":"172.21.15.37:6817/2121011955","heartbeat_front_addr":"172.21.15.37:6815/2121011955","state":["exists","up"]},{"osd":4,"uuid":"d7c16e7f-f599-419b-b4a2-fd6c1cafa0d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":1881025735},{"type":"v1","addr":"172.21.15.99:6809","nonce":1881025735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1881025735},{"type":"v1","addr":"172.21.15.99:6811","nonce":1881025735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1881025735},{"type":"v1","addr":"172.21.15.99:6815","nonce":1881025735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":1881025735},{"type":"v1","addr":"172.21.15.99:6813","nonce":1881025735}]},"public_addr":"172.21.15.99:6809/1881025735","cluster_addr":"172.21.15.99:6811/1881025735","heartbeat_back_addr":"172.21.15.99:6815/1881025735","heartbeat_front_addr":"172.21.15.99:6813/1881025735","state":["exists","up"]},{"osd":5,"uuid":"2f499ab4-3d09-4f96-a709-b4229865c690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1141976511},{"type":"v1","addr":"172.21.15.117:6809","nonce":1141976511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1141976511},{"type":"v1","addr":"172.21.15.117:6811","nonce":1141976511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1141976511},{"type":"v1","addr":"172.21.15.117:6815","nonce":1141976511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1141976511},{"type":"v1","addr":"172.21.15.117:6813","nonce":1141976511}]},"public_addr":"172.21.15.117:6809/1141976511","cluster_addr":"172.21.15.117:6811/1141976511","heartbeat_back_addr":"172.21.15.117:6815/1141976511","heartbeat_front_addr":"172.21.15.117:6813/1141976511","state":["exists","up"]},{"osd":6,"uuid":"10f7fd72-1ae8-4efd-a448-75f4b5054be3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":770433145},{"type":"v1","addr":"172.21.15.37:6819","nonce":770433145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":770433145},{"type":"v1","addr":"172.21.15.37:6821","nonce":770433145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":770433145},{"type":"v1","addr":"172.21.15.37:6825","nonce":770433145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":770433145},{"type":"v1","addr":"172.21.15.37:6823","nonce":770433145}]},"public_addr":"172.21.15.37:6819/770433145","cluster_addr":"172.21.15.37:6821/770433145","heartbeat_back_addr":"172.21.15.37:6825/770433145","heartbeat_front_addr":"172.21.15.37:6823/770433145","state":["exists","up"]},{"osd":7,"uuid":"7199a267-c486-417c-b530-3ff03fc9eb1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1694360992},{"type":"v1","addr":"172.21.15.99:6817","nonce":1694360992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1694360992},{"type":"v1","addr":"172.21.15.99:6819","nonce":1694360992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":1694360992},{"type":"v1","addr":"172.21.15.99:6823","nonce":1694360992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":1694360992},{"type":"v1","addr":"172.21.15.99:6821","nonce":1694360992}]},"public_addr":"172.21.15.99:6817/1694360992","cluster_addr":"172.21.15.99:6819/1694360992","heartbeat_back_addr":"172.21.15.99:6823/1694360992","heartbeat_front_addr":"172.21.15.99:6821/1694360992","state":["exists","up"]},{"osd":8,"uuid":"8d5bb83c-62eb-4ded-8a16-e8d57ab102c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2005866772},{"type":"v1","addr":"172.21.15.117:6817","nonce":2005866772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2005866772},{"type":"v1","addr":"172.21.15.117:6819","nonce":2005866772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2005866772},{"type":"v1","addr":"172.21.15.117:6823","nonce":2005866772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2005866772},{"type":"v1","addr":"172.21.15.117:6821","nonce":2005866772}]},"public_addr":"172.21.15.117:6817/2005866772","cluster_addr":"172.21.15.117:6819/2005866772","heartbeat_back_addr":"172.21.15.117:6823/2005866772","heartbeat_front_addr":"172.21.15.117:6821/2005866772","state":["exists","up"]},{"osd":9,"uuid":"04b6203d-a10c-4a55-8e59-b30012dee02b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1398779376},{"type":"v1","addr":"172.21.15.37:6827","nonce":1398779376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1398779376},{"type":"v1","addr":"172.21.15.37:6829","nonce":1398779376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1398779376},{"type":"v1","addr":"172.21.15.37:6833","nonce":1398779376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1398779376},{"type":"v1","addr":"172.21.15.37:6831","nonce":1398779376}]},"public_addr":"172.21.15.37:6827/1398779376","cluster_addr":"172.21.15.37:6829/1398779376","heartbeat_back_addr":"172.21.15.37:6833/1398779376","heartbeat_front_addr":"172.21.15.37:6831/1398779376","state":["exists","up"]},{"osd":10,"uuid":"bbf8ff4b-29cd-4d56-a30e-ff2de3555f78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2200957302},{"type":"v1","addr":"172.21.15.99:6825","nonce":2200957302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2200957302},{"type":"v1","addr":"172.21.15.99:6827","nonce":2200957302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2200957302},{"type":"v1","addr":"172.21.15.99:6831","nonce":2200957302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2200957302},{"type":"v1","addr":"172.21.15.99:6829","nonce":2200957302}]},"public_addr":"172.21.15.99:6825/2200957302","cluster_addr":"172.21.15.99:6827/2200957302","heartbeat_back_addr":"172.21.15.99:6831/2200957302","heartbeat_front_addr":"172.21.15.99:6829/2200957302","state":["exists","up"]},{"osd":11,"uuid":"041d54f4-a274-47b5-a467-0ce86efd363b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":1354423136},{"type":"v1","addr":"172.21.15.117:6825","nonce":1354423136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":1354423136},{"type":"v1","addr":"172.21.15.117:6827","nonce":1354423136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":1354423136},{"type":"v1","addr":"172.21.15.117:6831","nonce":1354423136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":1354423136},{"type":"v1","addr":"172.21.15.117:6829","nonce":1354423136}]},"public_addr":"172.21.15.117:6825/1354423136","cluster_addr":"172.21.15.117:6827/1354423136","heartbeat_back_addr":"172.21.15.117:6831/1354423136","heartbeat_front_addr":"172.21.15.117:6829/1354423136","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:58:33.697099+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:58:59.641549+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:59:23.811178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:59:49.550214+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:00:15.034610+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:00:39.399651+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:01:05.106379+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:01:30.375956+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:01:54.881549+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:02:21.519316+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:02:46.125918+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:03:11.310862+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6801/133577710":"2024-09-20T05:57:12.560771+0000","172.21.15.37:6800/133577710":"2024-09-20T05:57:12.560771+0000","172.21.15.37:0/2877363162":"2024-09-20T05:57:12.560771+0000","172.21.15.37:0/1053171617":"2024-09-20T05:57:12.560771+0000","172.21.15.37:6800/3277805697":"2024-09-20T05:56:49.335334+0000","172.21.15.37:0/1280697705":"2024-09-20T05:56:49.335334+0000","172.21.15.37:0/1106526058":"2024-09-20T05:57:12.560771+0000","172.21.15.37:0/1978184693":"2024-09-20T05:56:49.335334+0000","172.21.15.37:6801/3277805697":"2024-09-20T05:56:49.335334+0000","172.21.15.37:0/3650338877":"2024-09-20T05:56:49.335334+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:03:16.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:16.851+0000 7fbcd0651640 1 -- 172.21.15.37:0/1528764366 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fbcb00a32c0 msgr2=0x7fbcb00a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:16.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:16.851+0000 7fbcd0651640 1 --2- 172.21.15.37:0/1528764366 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fbcb00a32c0 0x7fbcb00a5780 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbcb8006010 tx=0x7fbcb8009800 comp rx=0 tx=0).stop 2024-09-19T06:03:16.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:16.851+0000 7fbcd0651640 1 -- 172.21.15.37:0/1528764366 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbcc8103740 msgr2=0x7fbcc8198ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:16.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:16.851+0000 7fbcd0651640 1 --2- 172.21.15.37:0/1528764366 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbcc8103740 0x7fbcc8198ab0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc00c970 tx=0x7fbcbc00ce30 comp rx=0 tx=0).stop 2024-09-19T06:03:16.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:16.851+0000 7fbcd0651640 1 -- 172.21.15.37:0/1528764366 shutdown_connections 2024-09-19T06:03:16.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:16.851+0000 7fbcd0651640 1 --2- 172.21.15.37:0/1528764366 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fbcb00a32c0 0x7fbcb00a5780 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:16.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:16.851+0000 7fbcd0651640 1 --2- 172.21.15.37:0/1528764366 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbcc8108290 0x7fbcc819ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:16.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:16.851+0000 7fbcd0651640 1 --2- 172.21.15.37:0/1528764366 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbcc8103740 0x7fbcc8198ab0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:16.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:16.851+0000 7fbcd0651640 1 --2- 172.21.15.37:0/1528764366 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbcc8102d90 0x7fbcc8198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:16.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:16.851+0000 7fbcd0651640 1 -- 172.21.15.37:0/1528764366 >> 172.21.15.37:0/1528764366 conn(0x7fbcc80fc7d0 msgr2=0x7fbcc8106370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:03:16.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:16.851+0000 7fbcd0651640 1 -- 172.21.15.37:0/1528764366 shutdown_connections 2024-09-19T06:03:16.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:16.851+0000 7fbcd0651640 1 -- 172.21.15.37:0/1528764366 wait complete. 2024-09-19T06:03:17.168 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:17 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/1528764366' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:03:17.438 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:17 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/1528764366' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:03:17.499 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:17 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/1528764366' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:03:17.624 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T05:59:27.062607+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T06:03:17.625 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-19T06:03:17.886 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:03:18.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:18 smithi037 ceph-mon[31211]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:03:18.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:18.348+0000 7ff89d69f640 1 -- 172.21.15.37:0/53207408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff898100e20 msgr2=0x7ff898101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:18.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:18.348+0000 7ff89d69f640 1 --2- 172.21.15.37:0/53207408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff898100e20 0x7ff898101200 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff888009ca0 tx=0x7ff88802a950 comp rx=0 tx=0).stop 2024-09-19T06:03:18.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:18.349+0000 7ff89d69f640 1 -- 172.21.15.37:0/53207408 shutdown_connections 2024-09-19T06:03:18.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:18.349+0000 7ff89d69f640 1 --2- 172.21.15.37:0/53207408 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff898102570 0x7ff8981029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:18.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:18.349+0000 7ff89d69f640 1 --2- 172.21.15.37:0/53207408 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff898102ef0 0x7ff89810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:18.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:18.349+0000 7ff89d69f640 1 --2- 172.21.15.37:0/53207408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff898100e20 0x7ff898101200 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:18.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:18.349+0000 7ff89d69f640 1 -- 172.21.15.37:0/53207408 >> 172.21.15.37:0/53207408 conn(0x7ff8980fc7d0 msgr2=0x7ff8980febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:03:18.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:18.349+0000 7ff89d69f640 1 -- 172.21.15.37:0/53207408 shutdown_connections 2024-09-19T06:03:18.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:18.349+0000 7ff89d69f640 1 -- 172.21.15.37:0/53207408 wait complete. 2024-09-19T06:03:18.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:18.349+0000 7ff89d69f640 1 Processor -- start 2024-09-19T06:03:18.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:18.349+0000 7ff89d69f640 1 -- start start 2024-09-19T06:03:18.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:18.350+0000 7ff89d69f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff898100e20 0x7ff898199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:18.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:18.350+0000 7ff89d69f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff898102570 0x7ff898199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:18.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:18.350+0000 7ff89d69f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff898102ef0 0x7ff8981a43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:18.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:18.350+0000 7ff89d69f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff898110f80 con 0x7ff898102ef0 2024-09-19T06:03:18.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:18.350+0000 7ff89d69f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff898110e00 con 0x7ff898100e20 2024-09-19T06:03:18.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:18.350+0000 7ff89d69f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff898111100 con 0x7ff898102570 2024-09-19T06:03:18.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:18.350+0000 7ff8977fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff898102ef0 0x7ff8981a43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:18.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:18.350+0000 7ff8977fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff898102ef0 0x7ff8981a43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54332/0 (socket says 172.21.15.37:54332) 2024-09-19T06:03:18.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:18.350+0000 7ff8977fe640 1 -- 172.21.15.37:0/2381450640 learned_addr learned my addr 172.21.15.37:0/2381450640 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:03:18.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:18.350+0000 7ff8967fc640 1 --2- 172.21.15.37:0/2381450640 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff898102570 0x7ff898199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:18.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:18.350+0000 7ff896ffd640 1 --2- 172.21.15.37:0/2381450640 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff898100e20 0x7ff898199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:18.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:18.350+0000 7ff8977fe640 1 -- 172.21.15.37:0/2381450640 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff898102570 msgr2=0x7ff898199890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:18.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:18.350+0000 7ff8977fe640 1 --2- 172.21.15.37:0/2381450640 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff898102570 0x7ff898199890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:18.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:18.350+0000 7ff8977fe640 1 -- 172.21.15.37:0/2381450640 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff898100e20 msgr2=0x7ff898199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:18.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:18.350+0000 7ff8977fe640 1 --2- 172.21.15.37:0/2381450640 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff898100e20 0x7ff898199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:18.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:18.350+0000 7ff8977fe640 1 -- 172.21.15.37:0/2381450640 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8981a4910 con 0x7ff898102ef0 2024-09-19T06:03:18.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:18.350+0000 7ff8977fe640 1 --2- 172.21.15.37:0/2381450640 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff898102ef0 0x7ff8981a43d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff89000c970 tx=0x7ff89000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:03:18.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:18.350+0000 7ff87ffff640 1 -- 172.21.15.37:0/2381450640 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff890007bb0 con 0x7ff898102ef0 2024-09-19T06:03:18.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:18.350+0000 7ff87ffff640 1 -- 172.21.15.37:0/2381450640 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff890007d50 con 0x7ff898102ef0 2024-09-19T06:03:18.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:18.350+0000 7ff89d69f640 1 -- 172.21.15.37:0/2381450640 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8981a4ae0 con 0x7ff898102ef0 2024-09-19T06:03:18.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:18.350+0000 7ff87ffff640 1 -- 172.21.15.37:0/2381450640 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff89000f450 con 0x7ff898102ef0 2024-09-19T06:03:18.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:18.351+0000 7ff89d69f640 1 -- 172.21.15.37:0/2381450640 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8981a5020 con 0x7ff898102ef0 2024-09-19T06:03:18.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:18.351+0000 7ff89d69f640 1 -- 172.21.15.37:0/2381450640 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff898101200 con 0x7ff898102ef0 2024-09-19T06:03:18.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:18.353+0000 7ff87ffff640 1 -- 172.21.15.37:0/2381450640 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7ff890004f00 con 0x7ff898102ef0 2024-09-19T06:03:18.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:18.353+0000 7ff87ffff640 1 --2- 172.21.15.37:0/2381450640 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7ff8800a32c0 0x7ff8800a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:18.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:18.353+0000 7ff896ffd640 1 --2- 172.21.15.37:0/2381450640 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7ff8800a32c0 0x7ff8800a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:18.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:18.353+0000 7ff87ffff640 1 -- 172.21.15.37:0/2381450640 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7ff8900cf3f0 con 0x7ff898102ef0 2024-09-19T06:03:18.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:18.354+0000 7ff896ffd640 1 --2- 172.21.15.37:0/2381450640 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7ff8800a32c0 0x7ff8800a5780 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff888000f80 tx=0x7ff888004a40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:03:18.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:18.357+0000 7ff87ffff640 1 -- 172.21.15.37:0/2381450640 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff890014030 con 0x7ff898102ef0 2024-09-19T06:03:18.438 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:18 smithi099 ceph-mon[35300]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:03:18.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:18 smithi117 ceph-mon[35050]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:03:18.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:18.530+0000 7ff89d69f640 1 -- 172.21.15.37:0/2381450640 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff898109090 con 0x7ff898102ef0 2024-09-19T06:03:18.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:18.530+0000 7ff87ffff640 1 -- 172.21.15.37:0/2381450640 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v76) ==== 93+0+10 (secure 0 0 0) 0x7ff89009bf40 con 0x7ff898102ef0 2024-09-19T06:03:18.532 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-09-19T06:03:18.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:18.532+0000 7ff89d69f640 1 -- 172.21.15.37:0/2381450640 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7ff8800a32c0 msgr2=0x7ff8800a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:18.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:18.532+0000 7ff89d69f640 1 --2- 172.21.15.37:0/2381450640 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7ff8800a32c0 0x7ff8800a5780 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff888000f80 tx=0x7ff888004a40 comp rx=0 tx=0).stop 2024-09-19T06:03:18.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:18.532+0000 7ff89d69f640 1 -- 172.21.15.37:0/2381450640 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff898102ef0 msgr2=0x7ff8981a43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:18.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:18.532+0000 7ff89d69f640 1 --2- 172.21.15.37:0/2381450640 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff898102ef0 0x7ff8981a43d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff89000c970 tx=0x7ff89000ce30 comp rx=0 tx=0).stop 2024-09-19T06:03:18.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:18.532+0000 7ff89d69f640 1 -- 172.21.15.37:0/2381450640 shutdown_connections 2024-09-19T06:03:18.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:18.532+0000 7ff89d69f640 1 --2- 172.21.15.37:0/2381450640 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7ff8800a32c0 0x7ff8800a5780 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:18.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:18.532+0000 7ff89d69f640 1 --2- 172.21.15.37:0/2381450640 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff898102ef0 0x7ff8981a43d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:18.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:18.532+0000 7ff89d69f640 1 --2- 172.21.15.37:0/2381450640 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff898102570 0x7ff898199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:18.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:18.532+0000 7ff89d69f640 1 --2- 172.21.15.37:0/2381450640 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff898100e20 0x7ff898199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:18.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:18.532+0000 7ff89d69f640 1 -- 172.21.15.37:0/2381450640 >> 172.21.15.37:0/2381450640 conn(0x7ff8980fc7d0 msgr2=0x7ff8980febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:03:18.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:18.533+0000 7ff89d69f640 1 -- 172.21.15.37:0/2381450640 shutdown_connections 2024-09-19T06:03:18.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:18.533+0000 7ff89d69f640 1 -- 172.21.15.37:0/2381450640 wait complete. 2024-09-19T06:03:19.312 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:19 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/2381450640' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T06:03:19.348 INFO:tasks.cephadm:Adding mds.a on smithi037 2024-09-19T06:03:19.349 INFO:tasks.cephadm:Adding mds.d on smithi037 2024-09-19T06:03:19.349 INFO:tasks.cephadm:Adding mds.g on smithi037 2024-09-19T06:03:19.349 INFO:tasks.cephadm:Adding mds.j on smithi037 2024-09-19T06:03:19.349 INFO:tasks.cephadm:Adding mds.b on smithi099 2024-09-19T06:03:19.349 INFO:tasks.cephadm:Adding mds.e on smithi099 2024-09-19T06:03:19.349 INFO:tasks.cephadm:Adding mds.h on smithi099 2024-09-19T06:03:19.349 INFO:tasks.cephadm:Adding mds.k on smithi099 2024-09-19T06:03:19.349 INFO:tasks.cephadm:Adding mds.c on smithi117 2024-09-19T06:03:19.349 INFO:tasks.cephadm:Adding mds.f on smithi117 2024-09-19T06:03:19.349 INFO:tasks.cephadm:Adding mds.i on smithi117 2024-09-19T06:03:19.349 INFO:tasks.cephadm:Adding mds.l on smithi117 2024-09-19T06:03:19.350 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph orch apply mds all '12;smithi037=a;smithi037=d;smithi037=g;smithi037=j;smithi099=b;smithi099=e;smithi099=h;smithi099=k;smithi117=c;smithi117=f;smithi117=i;smithi117=l' 2024-09-19T06:03:19.378 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:19 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/2381450640' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T06:03:19.438 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:19 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/2381450640' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T06:03:19.607 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:03:20.098 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:03:20.080+0000 7f3cc3f2d640 1 -- 172.21.15.117:0/127125673 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cbc101cd0 msgr2=0x7f3cbc102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:20.098 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:03:20.080+0000 7f3cc3f2d640 1 --2- 172.21.15.117:0/127125673 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cbc101cd0 0x7f3cbc102150 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3cac009900 tx=0x7f3cac02a410 comp rx=0 tx=0).stop 2024-09-19T06:03:20.098 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:03:20.080+0000 7f3cc3f2d640 1 -- 172.21.15.117:0/127125673 shutdown_connections 2024-09-19T06:03:20.098 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:03:20.080+0000 7f3cc3f2d640 1 --2- 172.21.15.117:0/127125673 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cbc102690 0x7f3cbc108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:20.098 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:03:20.080+0000 7f3cc3f2d640 1 --2- 172.21.15.117:0/127125673 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cbc101cd0 0x7f3cbc102150 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:20.098 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:03:20.080+0000 7f3cc3f2d640 1 --2- 172.21.15.117:0/127125673 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3cbc100ad0 0x7f3cbc100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:20.098 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:03:20.080+0000 7f3cc3f2d640 1 -- 172.21.15.117:0/127125673 >> 172.21.15.117:0/127125673 conn(0x7f3cbc0fc280 msgr2=0x7f3cbc0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:03:20.098 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:03:20.081+0000 7f3cc3f2d640 1 -- 172.21.15.117:0/127125673 shutdown_connections 2024-09-19T06:03:20.098 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:03:20.081+0000 7f3cc3f2d640 1 -- 172.21.15.117:0/127125673 wait complete. 2024-09-19T06:03:20.098 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:03:20.081+0000 7f3cc3f2d640 1 Processor -- start 2024-09-19T06:03:20.098 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:03:20.081+0000 7f3cc3f2d640 1 -- start start 2024-09-19T06:03:20.098 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:03:20.081+0000 7f3cc3f2d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cbc100ad0 0x7f3cbc104a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:20.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:03:20.081+0000 7f3cc3f2d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3cbc101cd0 0x7f3cbc1030b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:20.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:03:20.081+0000 7f3cc3f2d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cbc102690 0x7f3cbc1035f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:20.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:03:20.081+0000 7f3cc3f2d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3cbc10c730 con 0x7f3cbc102690 2024-09-19T06:03:20.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:03:20.081+0000 7f3cc3f2d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f3cbc10c5b0 con 0x7f3cbc101cd0 2024-09-19T06:03:20.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:03:20.081+0000 7f3cc3f2d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3cbc10c8b0 con 0x7f3cbc100ad0 2024-09-19T06:03:20.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:03:20.081+0000 7f3cc1cc9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cbc100ad0 0x7f3cbc104a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:20.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:03:20.081+0000 7f3cc1cc9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cbc100ad0 0x7f3cbc104a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:33706/0 (socket says 172.21.15.117:33706) 2024-09-19T06:03:20.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:03:20.081+0000 7f3cc1cc9640 1 -- 172.21.15.117:0/705231114 learned_addr learned my addr 172.21.15.117:0/705231114 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T06:03:20.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:03:20.082+0000 7f3cc14c8640 1 --2- 172.21.15.117:0/705231114 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3cbc101cd0 0x7f3cbc1030b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:20.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:03:20.082+0000 7f3cc24ca640 1 --2- 172.21.15.117:0/705231114 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cbc102690 0x7f3cbc1035f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:20.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:03:20.082+0000 7f3cc1cc9640 1 -- 172.21.15.117:0/705231114 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3cbc101cd0 msgr2=0x7f3cbc1030b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:20.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:03:20.082+0000 7f3cc1cc9640 1 --2- 172.21.15.117:0/705231114 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3cbc101cd0 0x7f3cbc1030b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:20.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:03:20.082+0000 7f3cc1cc9640 1 -- 172.21.15.117:0/705231114 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cbc102690 msgr2=0x7f3cbc1035f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:20.100 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:03:20.082+0000 7f3cc1cc9640 1 --2- 172.21.15.117:0/705231114 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cbc102690 0x7f3cbc1035f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:20.100 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:03:20.082+0000 7f3cc1cc9640 1 -- 172.21.15.117:0/705231114 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cbc103eb0 con 0x7f3cbc100ad0 2024-09-19T06:03:20.100 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:03:20.082+0000 7f3cc24ca640 1 --2- 172.21.15.117:0/705231114 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cbc102690 0x7f3cbc1035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:03:20.100 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:03:20.082+0000 7f3cc1cc9640 1 --2- 172.21.15.117:0/705231114 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cbc100ad0 0x7f3cbc104a60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3cb800c970 tx=0x7f3cb800ce30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:03:20.100 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:03:20.082+0000 7f3cb2ffd640 1 -- 172.21.15.117:0/705231114 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb8007c10 con 0x7f3cbc100ad0 2024-09-19T06:03:20.100 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:03:20.082+0000 7f3cc3f2d640 1 -- 172.21.15.117:0/705231114 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cbc1a1fd0 con 0x7f3cbc100ad0 2024-09-19T06:03:20.100 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:03:20.082+0000 7f3cb2ffd640 1 -- 172.21.15.117:0/705231114 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3cb8007db0 con 0x7f3cbc100ad0 2024-09-19T06:03:20.100 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:03:20.082+0000 7f3cb2ffd640 1 -- 172.21.15.117:0/705231114 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb800f8a0 con 0x7f3cbc100ad0 2024-09-19T06:03:20.100 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:03:20.082+0000 7f3cc3f2d640 1 -- 172.21.15.117:0/705231114 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cbc1a23c0 con 0x7f3cbc100ad0 2024-09-19T06:03:20.100 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:03:20.083+0000 7f3cc3f2d640 1 -- 172.21.15.117:0/705231114 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cbc1a26b0 con 0x7f3cbc100ad0 2024-09-19T06:03:20.100 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:03:20.085+0000 7f3cb2ffd640 1 -- 172.21.15.117:0/705231114 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f3cb800fa60 con 0x7f3cbc100ad0 2024-09-19T06:03:20.100 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:03:20.086+0000 7f3cb2ffd640 1 --2- 172.21.15.117:0/705231114 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f3ca80a3240 0x7f3ca80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:20.100 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:03:20.086+0000 7f3cb2ffd640 1 -- 172.21.15.117:0/705231114 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f3cb80cfb10 con 0x7f3cbc100ad0 2024-09-19T06:03:20.101 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:03:20.086+0000 7f3cc14c8640 1 --2- 172.21.15.117:0/705231114 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f3ca80a3240 0x7f3ca80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:20.101 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:03:20.087+0000 7f3cc14c8640 1 --2- 172.21.15.117:0/705231114 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f3ca80a3240 0x7f3ca80a5700 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3cac0314e0 tx=0x7f3cac000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:03:20.101 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:03:20.090+0000 7f3cb2ffd640 1 -- 172.21.15.117:0/705231114 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3cb809cd60 con 0x7f3cbc100ad0 2024-09-19T06:03:20.252 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:20 smithi117 ceph-mon[35050]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:03:20.277 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:03:20.275+0000 7f3cc3f2d640 1 -- 172.21.15.117:0/705231114 --> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi037=a;smithi037=d;smithi037=g;smithi037=j;smithi099=b;smithi099=e;smithi099=h;smithi099=k;smithi117=c;smithi117=f;smithi117=i;smithi117=l", "target": ["mon-mgr", ""]}) -- 0x7f3cbc0fe4b0 con 0x7f3ca80a3240 2024-09-19T06:03:20.284 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:03:20.283+0000 7f3cb2ffd640 1 -- 172.21.15.117:0/705231114 <== mgr.14148 v2:172.21.15.37:6800/3797010169 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f3cbc0fe4b0 con 0x7f3ca80a3240 2024-09-19T06:03:20.285 INFO:teuthology.orchestra.run.smithi117.stdout:Scheduled mds.all update... 2024-09-19T06:03:20.286 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:03:20.285+0000 7f3cc3f2d640 1 -- 172.21.15.117:0/705231114 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f3ca80a3240 msgr2=0x7f3ca80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:20.287 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:03:20.285+0000 7f3cc3f2d640 1 --2- 172.21.15.117:0/705231114 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f3ca80a3240 0x7f3ca80a5700 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3cac0314e0 tx=0x7f3cac000bc0 comp rx=0 tx=0).stop 2024-09-19T06:03:20.287 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:03:20.285+0000 7f3cc3f2d640 1 -- 172.21.15.117:0/705231114 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cbc100ad0 msgr2=0x7f3cbc104a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:20.287 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:03:20.285+0000 7f3cc3f2d640 1 --2- 172.21.15.117:0/705231114 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cbc100ad0 0x7f3cbc104a60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3cb800c970 tx=0x7f3cb800ce30 comp rx=0 tx=0).stop 2024-09-19T06:03:20.287 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:03:20.285+0000 7f3cc3f2d640 1 -- 172.21.15.117:0/705231114 shutdown_connections 2024-09-19T06:03:20.287 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:03:20.285+0000 7f3cc3f2d640 1 --2- 172.21.15.117:0/705231114 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f3ca80a3240 0x7f3ca80a5700 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:20.287 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:03:20.285+0000 7f3cc3f2d640 1 --2- 172.21.15.117:0/705231114 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3cbc101cd0 0x7f3cbc1030b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:20.287 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:03:20.285+0000 7f3cc3f2d640 1 --2- 172.21.15.117:0/705231114 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cbc102690 0x7f3cbc1035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:20.287 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:03:20.285+0000 7f3cc3f2d640 1 --2- 172.21.15.117:0/705231114 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cbc100ad0 0x7f3cbc104a60 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:20.287 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:03:20.285+0000 7f3cc3f2d640 1 -- 172.21.15.117:0/705231114 >> 172.21.15.117:0/705231114 conn(0x7f3cbc0fc280 msgr2=0x7f3cbc0fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:03:20.287 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:03:20.285+0000 7f3cc3f2d640 1 -- 172.21.15.117:0/705231114 shutdown_connections 2024-09-19T06:03:20.287 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:03:20.285+0000 7f3cc3f2d640 1 -- 172.21.15.117:0/705231114 wait complete. 2024-09-19T06:03:20.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:20 smithi037 ceph-mon[31211]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:03:20.438 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:20 smithi099 ceph-mon[35300]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:03:20.949 DEBUG:teuthology.orchestra.run.smithi037:mds.a> sudo journalctl -f -n 0 -u ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@mds.a.service 2024-09-19T06:03:20.952 DEBUG:teuthology.orchestra.run.smithi037:mds.d> sudo journalctl -f -n 0 -u ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@mds.d.service 2024-09-19T06:03:20.996 DEBUG:teuthology.orchestra.run.smithi037:mds.g> sudo journalctl -f -n 0 -u ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@mds.g.service 2024-09-19T06:03:21.038 DEBUG:teuthology.orchestra.run.smithi037:mds.j> sudo journalctl -f -n 0 -u ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@mds.j.service 2024-09-19T06:03:21.081 DEBUG:teuthology.orchestra.run.smithi099:mds.b> sudo journalctl -f -n 0 -u ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@mds.b.service 2024-09-19T06:03:21.084 DEBUG:teuthology.orchestra.run.smithi099:mds.e> sudo journalctl -f -n 0 -u ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@mds.e.service 2024-09-19T06:03:21.128 DEBUG:teuthology.orchestra.run.smithi099:mds.h> sudo journalctl -f -n 0 -u ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@mds.h.service 2024-09-19T06:03:21.170 DEBUG:teuthology.orchestra.run.smithi099:mds.k> sudo journalctl -f -n 0 -u ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@mds.k.service 2024-09-19T06:03:21.213 DEBUG:teuthology.orchestra.run.smithi117:mds.c> sudo journalctl -f -n 0 -u ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@mds.c.service 2024-09-19T06:03:21.216 DEBUG:teuthology.orchestra.run.smithi117:mds.f> sudo journalctl -f -n 0 -u ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@mds.f.service 2024-09-19T06:03:21.259 DEBUG:teuthology.orchestra.run.smithi117:mds.i> sudo journalctl -f -n 0 -u ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@mds.i.service 2024-09-19T06:03:21.302 DEBUG:teuthology.orchestra.run.smithi117:mds.l> sudo journalctl -f -n 0 -u ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@mds.l.service 2024-09-19T06:03:21.345 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-19T06:03:21.346 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:03:21.388 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:21 smithi117 ceph-mon[35050]: from='client.24400 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi037=a;smithi037=d;smithi037=g;smithi037=j;smithi099=b;smithi099=e;smithi099=h;smithi099=k;smithi117=c;smithi117=f;smithi117=i;smithi117=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:03:21.388 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:21 smithi117 ceph-mon[35050]: Saving service mds.all spec with placement smithi037=a;smithi037=d;smithi037=g;smithi037=j;smithi099=b;smithi099=e;smithi099=h;smithi099=k;smithi117=c;smithi117=f;smithi117=i;smithi117=l;count:12 2024-09-19T06:03:21.388 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:21 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:21.388 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:21 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:03:21.389 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:21 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:21.389 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:21 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:03:21.389 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:21 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:21.389 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:21 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:03:21.389 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:21 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:03:21.389 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:21 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:21.438 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:21 smithi099 ceph-mon[35300]: from='client.24400 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi037=a;smithi037=d;smithi037=g;smithi037=j;smithi099=b;smithi099=e;smithi099=h;smithi099=k;smithi117=c;smithi117=f;smithi117=i;smithi117=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:03:21.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:21 smithi099 ceph-mon[35300]: Saving service mds.all spec with placement smithi037=a;smithi037=d;smithi037=g;smithi037=j;smithi099=b;smithi099=e;smithi099=h;smithi099=k;smithi117=c;smithi117=f;smithi117=i;smithi117=l;count:12 2024-09-19T06:03:21.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:21 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:21.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:21 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:03:21.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:21 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:21.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:21 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:03:21.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:21 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:21.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:21 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:03:21.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:21 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:03:21.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:21 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:21.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:21 smithi037 ceph-mon[31211]: from='client.24400 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi037=a;smithi037=d;smithi037=g;smithi037=j;smithi099=b;smithi099=e;smithi099=h;smithi099=k;smithi117=c;smithi117=f;smithi117=i;smithi117=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:03:21.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:21 smithi037 ceph-mon[31211]: Saving service mds.all spec with placement smithi037=a;smithi037=d;smithi037=g;smithi037=j;smithi099=b;smithi099=e;smithi099=h;smithi099=k;smithi117=c;smithi117=f;smithi117=i;smithi117=l;count:12 2024-09-19T06:03:21.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:21 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:21.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:21 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:03:21.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:21 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:21.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:21 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:03:21.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:21 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:21.575 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:21 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:03:21.575 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:21 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:03:21.575 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:21 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:21.605 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:03:22.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:22.080+0000 7f7845dd7640 1 -- 172.21.15.37:0/2342558689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7840103660 msgr2=0x7f784010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:22.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:22.080+0000 7f7845dd7640 1 --2- 172.21.15.37:0/2342558689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7840103660 0x7f784010bb50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7828009900 tx=0x7f782802a480 comp rx=0 tx=0).stop 2024-09-19T06:03:22.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:22.080+0000 7f7845dd7640 1 -- 172.21.15.37:0/2342558689 shutdown_connections 2024-09-19T06:03:22.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:22.080+0000 7f7845dd7640 1 --2- 172.21.15.37:0/2342558689 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f784010c170 0x7f784010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:22.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:22.080+0000 7f7845dd7640 1 --2- 172.21.15.37:0/2342558689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7840103660 0x7f784010bb50 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:22.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:22.080+0000 7f7845dd7640 1 --2- 172.21.15.37:0/2342558689 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7840102d40 0x7f7840103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:22.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:22.080+0000 7f7845dd7640 1 -- 172.21.15.37:0/2342558689 >> 172.21.15.37:0/2342558689 conn(0x7f78400fc7a0 msgr2=0x7f78400febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:03:22.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:22.080+0000 7f7845dd7640 1 -- 172.21.15.37:0/2342558689 shutdown_connections 2024-09-19T06:03:22.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:22.080+0000 7f7845dd7640 1 -- 172.21.15.37:0/2342558689 wait complete. 2024-09-19T06:03:22.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:22.081+0000 7f7845dd7640 1 Processor -- start 2024-09-19T06:03:22.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:22.081+0000 7f7845dd7640 1 -- start start 2024-09-19T06:03:22.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:22.081+0000 7f7845dd7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7840102d40 0x7f78401984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:22.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:22.081+0000 7f7845dd7640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7840103660 0x7f7840198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:22.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:22.081+0000 7f7845dd7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f784010c170 0x7f784019cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:22.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:22.081+0000 7f7845dd7640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7840111fc0 con 0x7f784010c170 2024-09-19T06:03:22.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:22.081+0000 7f7845dd7640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f7840111e40 con 0x7f7840103660 2024-09-19T06:03:22.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:22.081+0000 7f7845dd7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7840112140 con 0x7f7840102d40 2024-09-19T06:03:22.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:22.082+0000 7f783f7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7840102d40 0x7f78401984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:22.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:22.081+0000 7f783ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f784010c170 0x7f784019cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:22.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:22.082+0000 7f783f7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7840102d40 0x7f78401984c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.37:55396/0 (socket says 172.21.15.37:55396) 2024-09-19T06:03:22.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:22.082+0000 7f783f7fe640 1 -- 172.21.15.37:0/1446077670 learned_addr learned my addr 172.21.15.37:0/1446077670 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:03:22.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:22.082+0000 7f7836ffd640 1 --2- 172.21.15.37:0/1446077670 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7840103660 0x7f7840198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:22.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:22.082+0000 7f783f7fe640 1 -- 172.21.15.37:0/1446077670 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7840103660 msgr2=0x7f7840198a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:22.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:22.082+0000 7f783f7fe640 1 --2- 172.21.15.37:0/1446077670 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7840103660 0x7f7840198a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:22.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:22.082+0000 7f783f7fe640 1 -- 172.21.15.37:0/1446077670 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f784010c170 msgr2=0x7f784019cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:22.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:22.082+0000 7f783f7fe640 1 --2- 172.21.15.37:0/1446077670 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f784010c170 0x7f784019cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:22.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:22.082+0000 7f783f7fe640 1 -- 172.21.15.37:0/1446077670 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f784019d470 con 0x7f7840102d40 2024-09-19T06:03:22.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:22.082+0000 7f783ffff640 1 --2- 172.21.15.37:0/1446077670 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f784010c170 0x7f784019cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:03:22.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:22.082+0000 7f7836ffd640 1 --2- 172.21.15.37:0/1446077670 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7840103660 0x7f7840198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:03:22.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:22.082+0000 7f783f7fe640 1 --2- 172.21.15.37:0/1446077670 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7840102d40 0x7f78401984c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f783000e9f0 tx=0x7f783000edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:03:22.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:22.082+0000 7f783d7fa640 1 -- 172.21.15.37:0/1446077670 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f783000cd80 con 0x7f7840102d40 2024-09-19T06:03:22.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:22.082+0000 7f7845dd7640 1 -- 172.21.15.37:0/1446077670 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f784019d760 con 0x7f7840102d40 2024-09-19T06:03:22.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:22.082+0000 7f783d7fa640 1 -- 172.21.15.37:0/1446077670 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7830005500 con 0x7f7840102d40 2024-09-19T06:03:22.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:22.082+0000 7f783d7fa640 1 -- 172.21.15.37:0/1446077670 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7830010690 con 0x7f7840102d40 2024-09-19T06:03:22.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:22.082+0000 7f7845dd7640 1 -- 172.21.15.37:0/1446077670 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78401a5040 con 0x7f7840102d40 2024-09-19T06:03:22.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:22.083+0000 7f7845dd7640 1 -- 172.21.15.37:0/1446077670 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7840103120 con 0x7f7840102d40 2024-09-19T06:03:22.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:22.085+0000 7f783d7fa640 1 -- 172.21.15.37:0/1446077670 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f78300046c0 con 0x7f7840102d40 2024-09-19T06:03:22.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:22.085+0000 7f783d7fa640 1 --2- 172.21.15.37:0/1446077670 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f782c0a3240 0x7f782c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:22.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:22.086+0000 7f7836ffd640 1 --2- 172.21.15.37:0/1446077670 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f782c0a3240 0x7f782c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:22.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:22.086+0000 7f783d7fa640 1 -- 172.21.15.37:0/1446077670 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f78300cfbd0 con 0x7f7840102d40 2024-09-19T06:03:22.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:22.086+0000 7f7836ffd640 1 --2- 172.21.15.37:0/1446077670 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f782c0a3240 0x7f782c0a5700 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7828000c00 tx=0x7f7828005a40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:03:22.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:22.088+0000 7f783d7fa640 1 -- 172.21.15.37:0/1446077670 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7830054210 con 0x7f7840102d40 2024-09-19T06:03:22.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:22.303+0000 7f7845dd7640 1 -- 172.21.15.37:0/1446077670 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7840199820 con 0x7f7840102d40 2024-09-19T06:03:22.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:22.304+0000 7f783d7fa640 1 -- 172.21.15.37:0/1446077670 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f7840199820 con 0x7f7840102d40 2024-09-19T06:03:22.305 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T06:03:22.305 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":1,"btime":"2024-09-19T05:56:22:522867+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-19T06:03:22.305 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 1 2024-09-19T06:03:22.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:22.306+0000 7f7845dd7640 1 -- 172.21.15.37:0/1446077670 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f782c0a3240 msgr2=0x7f782c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:22.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:22.306+0000 7f7845dd7640 1 --2- 172.21.15.37:0/1446077670 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f782c0a3240 0x7f782c0a5700 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7828000c00 tx=0x7f7828005a40 comp rx=0 tx=0).stop 2024-09-19T06:03:22.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:22.306+0000 7f7845dd7640 1 -- 172.21.15.37:0/1446077670 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7840102d40 msgr2=0x7f78401984c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:22.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:22.306+0000 7f7845dd7640 1 --2- 172.21.15.37:0/1446077670 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7840102d40 0x7f78401984c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f783000e9f0 tx=0x7f783000edf0 comp rx=0 tx=0).stop 2024-09-19T06:03:22.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:22.306+0000 7f7845dd7640 1 -- 172.21.15.37:0/1446077670 shutdown_connections 2024-09-19T06:03:22.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:22.306+0000 7f7845dd7640 1 --2- 172.21.15.37:0/1446077670 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f782c0a3240 0x7f782c0a5700 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:22.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:22.306+0000 7f7845dd7640 1 --2- 172.21.15.37:0/1446077670 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7840103660 0x7f7840198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:22.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:22.306+0000 7f7845dd7640 1 --2- 172.21.15.37:0/1446077670 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f784010c170 0x7f784019cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:22.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:22.306+0000 7f7845dd7640 1 --2- 172.21.15.37:0/1446077670 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7840102d40 0x7f78401984c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:22.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:22.306+0000 7f7845dd7640 1 -- 172.21.15.37:0/1446077670 >> 172.21.15.37:0/1446077670 conn(0x7f78400fc7a0 msgr2=0x7f78400fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:03:22.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:22.306+0000 7f7845dd7640 1 -- 172.21.15.37:0/1446077670 shutdown_connections 2024-09-19T06:03:22.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:22.306+0000 7f7845dd7640 1 -- 172.21.15.37:0/1446077670 wait complete. 2024-09-19T06:03:22.425 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:22 smithi117 ceph-mon[35050]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:03:22.426 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:22 smithi117 ceph-mon[35050]: Deploying daemon mds.l on smithi117 2024-09-19T06:03:22.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:22 smithi037 ceph-mon[31211]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:03:22.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:22 smithi037 ceph-mon[31211]: Deploying daemon mds.l on smithi117 2024-09-19T06:03:22.688 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:22 smithi099 ceph-mon[35300]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:03:22.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:22 smithi099 ceph-mon[35300]: Deploying daemon mds.l on smithi117 2024-09-19T06:03:22.750 INFO:journalctl@ceph.mds.l.smithi117.stdout:Sep 19 06:03:22 smithi117 systemd[1]: Starting Ceph mds.l for b8c8bdae-764b-11ef-bceb-c7b262605968... 2024-09-19T06:03:23.082 INFO:journalctl@ceph.mds.l.smithi117.stdout:Sep 19 06:03:22 smithi117 podman[63922]: 2024-09-19 06:03:22.715287714 +0000 UTC m=+0.015619253 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:03:23.082 INFO:journalctl@ceph.mds.l.smithi117.stdout:Sep 19 06:03:22 smithi117 podman[63922]: 2024-09-19 06:03:22.819224835 +0000 UTC m=+0.119556362 container create 3fac02c7c848114e246314bc790f9ee2f03991d833f470c7d0397f7ebdff9bc6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-l, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731) 2024-09-19T06:03:23.082 INFO:journalctl@ceph.mds.l.smithi117.stdout:Sep 19 06:03:23 smithi117 podman[63922]: 2024-09-19 06:03:23.055261126 +0000 UTC m=+0.355592653 container init 3fac02c7c848114e246314bc790f9ee2f03991d833f470c7d0397f7ebdff9bc6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-l, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-19T06:03:23.082 INFO:journalctl@ceph.mds.l.smithi117.stdout:Sep 19 06:03:23 smithi117 podman[63922]: 2024-09-19 06:03:23.058098742 +0000 UTC m=+0.358430269 container start 3fac02c7c848114e246314bc790f9ee2f03991d833f470c7d0397f7ebdff9bc6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-l, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-19T06:03:23.499 INFO:journalctl@ceph.mds.l.smithi117.stdout:Sep 19 06:03:23 smithi117 ceph-mds[63941]: -- 172.21.15.117:0/1403645656 <== mon.1 v2:172.21.15.117:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b5fd741860 con 0x55b5fd71f400 2024-09-19T06:03:23.500 INFO:journalctl@ceph.mds.l.smithi117.stdout:Sep 19 06:03:23 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-l[63937]: starting mds.l at 2024-09-19T06:03:23.500 INFO:journalctl@ceph.mds.l.smithi117.stdout:Sep 19 06:03:23 smithi117 bash[63922]: 3fac02c7c848114e246314bc790f9ee2f03991d833f470c7d0397f7ebdff9bc6 2024-09-19T06:03:23.500 INFO:journalctl@ceph.mds.l.smithi117.stdout:Sep 19 06:03:23 smithi117 systemd[1]: Started Ceph mds.l for b8c8bdae-764b-11ef-bceb-c7b262605968. 2024-09-19T06:03:23.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:23 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/1446077670' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:03:23.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:23 smithi117 ceph-mon[35050]: mds.? [v2:172.21.15.117:6832/3898668400,v1:172.21.15.117:6833/3898668400] up:boot 2024-09-19T06:03:23.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:23 smithi117 ceph-mon[35050]: fsmap 1 up:standby 2024-09-19T06:03:23.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:23 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T06:03:23.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:23 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:23.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:23 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:23.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:23 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:23.501 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:23 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:03:23.501 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:23 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:03:23.501 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:23 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:23.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:23 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/1446077670' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:03:23.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:23 smithi037 ceph-mon[31211]: mds.? [v2:172.21.15.117:6832/3898668400,v1:172.21.15.117:6833/3898668400] up:boot 2024-09-19T06:03:23.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:23 smithi037 ceph-mon[31211]: fsmap 1 up:standby 2024-09-19T06:03:23.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:23 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T06:03:23.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:23 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:23.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:23 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:23.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:23 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:23.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:23 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:03:23.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:23 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:03:23.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:23 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:23.644 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:23 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/1446077670' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:03:23.644 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:23 smithi099 ceph-mon[35300]: mds.? [v2:172.21.15.117:6832/3898668400,v1:172.21.15.117:6833/3898668400] up:boot 2024-09-19T06:03:23.644 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:23 smithi099 ceph-mon[35300]: fsmap 1 up:standby 2024-09-19T06:03:23.644 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:23 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T06:03:23.644 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:23 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:23.644 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:23 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:23.645 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:23 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:23.645 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:23 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:03:23.645 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:23 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:03:23.645 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:23 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:24.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:24 smithi037 ceph-mon[31211]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:03:24.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:24 smithi037 ceph-mon[31211]: Deploying daemon mds.k on smithi099 2024-09-19T06:03:24.688 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:24 smithi099 ceph-mon[35300]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:03:24.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:24 smithi099 ceph-mon[35300]: Deploying daemon mds.k on smithi099 2024-09-19T06:03:24.749 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:24 smithi117 ceph-mon[35050]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:03:24.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:24 smithi117 ceph-mon[35050]: Deploying daemon mds.k on smithi099 2024-09-19T06:03:25.133 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:03:25.303 INFO:journalctl@ceph.mds.k.smithi099.stdout:Sep 19 06:03:25 smithi099 systemd[1]: Starting Ceph mds.k for b8c8bdae-764b-11ef-bceb-c7b262605968... 2024-09-19T06:03:25.400 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:03:25.561 INFO:journalctl@ceph.mds.k.smithi099.stdout:Sep 19 06:03:25 smithi099 podman[64418]: 2024-09-19 06:03:25.455703043 +0000 UTC m=+0.110949077 container create 10770bcb93c1eaf897560e43809c8be1078a73ff60d739d2c03b70a146bc0e43 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-k, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-19T06:03:25.561 INFO:journalctl@ceph.mds.k.smithi099.stdout:Sep 19 06:03:25 smithi099 podman[64418]: 2024-09-19 06:03:25.361047948 +0000 UTC m=+0.016293998 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:03:25.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:25.902+0000 7fe43f1fe640 1 -- 172.21.15.37:0/4267701350 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe438106a80 msgr2=0x7fe438106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:25.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:25.902+0000 7fe43f1fe640 1 --2- 172.21.15.37:0/4267701350 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe438106a80 0x7fe438106e60 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe42c009930 tx=0x7fe42c02a420 comp rx=0 tx=0).stop 2024-09-19T06:03:25.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:25.902+0000 7fe43f1fe640 1 -- 172.21.15.37:0/4267701350 shutdown_connections 2024-09-19T06:03:25.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:25.902+0000 7fe43f1fe640 1 --2- 172.21.15.37:0/4267701350 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe438100a80 0x7fe438100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:25.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:25.902+0000 7fe43f1fe640 1 --2- 172.21.15.37:0/4267701350 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe438101420 0x7fe43810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:25.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:25.902+0000 7fe43f1fe640 1 --2- 172.21.15.37:0/4267701350 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe438106a80 0x7fe438106e60 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:25.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:25.902+0000 7fe43f1fe640 1 -- 172.21.15.37:0/4267701350 >> 172.21.15.37:0/4267701350 conn(0x7fe4380fc7a0 msgr2=0x7fe4380febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:03:25.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:25.902+0000 7fe43f1fe640 1 -- 172.21.15.37:0/4267701350 shutdown_connections 2024-09-19T06:03:25.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:25.902+0000 7fe43f1fe640 1 -- 172.21.15.37:0/4267701350 wait complete. 2024-09-19T06:03:25.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:25.902+0000 7fe43f1fe640 1 Processor -- start 2024-09-19T06:03:25.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:25.902+0000 7fe43f1fe640 1 -- start start 2024-09-19T06:03:25.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:25.903+0000 7fe43f1fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe438100a80 0x7fe438102650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:25.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:25.903+0000 7fe43f1fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe438101420 0x7fe438102b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:25.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:25.903+0000 7fe43f1fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe438106a80 0x7fe4381030d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:25.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:25.903+0000 7fe43f1fe640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe438110ed0 con 0x7fe438100a80 2024-09-19T06:03:25.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:25.903+0000 7fe43f1fe640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fe438110d50 con 0x7fe438101420 2024-09-19T06:03:25.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:25.903+0000 7fe43f1fe640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe438111050 con 0x7fe438106a80 2024-09-19T06:03:25.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:25.903+0000 7fe43cf9a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe438100a80 0x7fe438102650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:25.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:25.903+0000 7fe43cf9a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe438100a80 0x7fe438102650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43230/0 (socket says 172.21.15.37:43230) 2024-09-19T06:03:25.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:25.903+0000 7fe43cf9a640 1 -- 172.21.15.37:0/1189889971 learned_addr learned my addr 172.21.15.37:0/1189889971 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:03:25.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:25.903+0000 7fe437fff640 1 --2- 172.21.15.37:0/1189889971 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe438101420 0x7fe438102b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:25.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:25.903+0000 7fe43d79b640 1 --2- 172.21.15.37:0/1189889971 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe438106a80 0x7fe4381030d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:25.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:25.903+0000 7fe437fff640 1 -- 172.21.15.37:0/1189889971 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe438106a80 msgr2=0x7fe4381030d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:25.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:25.903+0000 7fe437fff640 1 --2- 172.21.15.37:0/1189889971 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe438106a80 0x7fe4381030d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:25.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:25.903+0000 7fe437fff640 1 -- 172.21.15.37:0/1189889971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe438100a80 msgr2=0x7fe438102650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:25.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:25.903+0000 7fe437fff640 1 --2- 172.21.15.37:0/1189889971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe438100a80 0x7fe438102650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:25.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:25.903+0000 7fe437fff640 1 -- 172.21.15.37:0/1189889971 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4381a6910 con 0x7fe438101420 2024-09-19T06:03:25.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:25.903+0000 7fe43cf9a640 1 --2- 172.21.15.37:0/1189889971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe438100a80 0x7fe438102650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:03:25.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:25.903+0000 7fe43d79b640 1 --2- 172.21.15.37:0/1189889971 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe438106a80 0x7fe4381030d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:03:25.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:25.903+0000 7fe437fff640 1 --2- 172.21.15.37:0/1189889971 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe438101420 0x7fe438102b90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe42400e9f0 tx=0x7fe42400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:03:25.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:25.904+0000 7fe435ffb640 1 -- 172.21.15.37:0/1189889971 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe42400ccc0 con 0x7fe438101420 2024-09-19T06:03:25.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:25.904+0000 7fe43f1fe640 1 -- 172.21.15.37:0/1189889971 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4381a6c00 con 0x7fe438101420 2024-09-19T06:03:25.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:25.904+0000 7fe435ffb640 1 -- 172.21.15.37:0/1189889971 <== mon.2 v2:172.21.15.99:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe424010910 con 0x7fe438101420 2024-09-19T06:03:25.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:25.904+0000 7fe435ffb640 1 -- 172.21.15.37:0/1189889971 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe424018960 con 0x7fe438101420 2024-09-19T06:03:25.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:25.904+0000 7fe43f1fe640 1 -- 172.21.15.37:0/1189889971 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4381a7140 con 0x7fe438101420 2024-09-19T06:03:25.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:25.905+0000 7fe43f1fe640 1 -- 172.21.15.37:0/1189889971 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe438100ee0 con 0x7fe438101420 2024-09-19T06:03:25.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:25.906+0000 7fe435ffb640 1 -- 172.21.15.37:0/1189889971 <== mon.2 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fe424010430 con 0x7fe438101420 2024-09-19T06:03:25.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:25.907+0000 7fe435ffb640 1 --2- 172.21.15.37:0/1189889971 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fe4280a3240 0x7fe4280a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:25.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:25.907+0000 7fe43cf9a640 1 --2- 172.21.15.37:0/1189889971 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fe4280a3240 0x7fe4280a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:25.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:25.907+0000 7fe435ffb640 1 -- 172.21.15.37:0/1189889971 <== mon.2 v2:172.21.15.99:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fe4240cf970 con 0x7fe438101420 2024-09-19T06:03:25.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:25.907+0000 7fe43cf9a640 1 --2- 172.21.15.37:0/1189889971 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fe4280a3240 0x7fe4280a5700 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe42c000c00 tx=0x7fe42c031510 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:03:25.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:25.911+0000 7fe435ffb640 1 -- 172.21.15.37:0/1189889971 <== mon.2 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe42409ca90 con 0x7fe438101420 2024-09-19T06:03:25.938 INFO:journalctl@ceph.mds.k.smithi099.stdout:Sep 19 06:03:25 smithi099 podman[64418]: 2024-09-19 06:03:25.675180234 +0000 UTC m=+0.330426291 container init 10770bcb93c1eaf897560e43809c8be1078a73ff60d739d2c03b70a146bc0e43 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-k, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-19T06:03:25.939 INFO:journalctl@ceph.mds.k.smithi099.stdout:Sep 19 06:03:25 smithi099 podman[64418]: 2024-09-19 06:03:25.678140452 +0000 UTC m=+0.333386495 container start 10770bcb93c1eaf897560e43809c8be1078a73ff60d739d2c03b70a146bc0e43 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-k, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-19T06:03:25.939 INFO:journalctl@ceph.mds.k.smithi099.stdout:Sep 19 06:03:25 smithi099 ceph-mds[64445]: -- 172.21.15.99:0/1233299259 <== mon.2 v2:172.21.15.99:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5560aa6b1860 con 0x5560aa68f400 2024-09-19T06:03:25.939 INFO:journalctl@ceph.mds.k.smithi099.stdout:Sep 19 06:03:25 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-k[64441]: starting mds.k at 2024-09-19T06:03:25.939 INFO:journalctl@ceph.mds.k.smithi099.stdout:Sep 19 06:03:25 smithi099 bash[64418]: 10770bcb93c1eaf897560e43809c8be1078a73ff60d739d2c03b70a146bc0e43 2024-09-19T06:03:25.939 INFO:journalctl@ceph.mds.k.smithi099.stdout:Sep 19 06:03:25 smithi099 systemd[1]: Started Ceph mds.k for b8c8bdae-764b-11ef-bceb-c7b262605968. 2024-09-19T06:03:26.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:26.134+0000 7fe43f1fe640 1 -- 172.21.15.37:0/1189889971 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe4381a7400 con 0x7fe438101420 2024-09-19T06:03:26.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:26.134+0000 7fe435ffb640 1 -- 172.21.15.37:0/1189889971 <== mon.2 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1438 (secure 0 0 0) 0x7fe42409c390 con 0x7fe438101420 2024-09-19T06:03:26.137 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T06:03:26.137 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":2,"btime":"2024-09-19T06:03:23:085801+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3898668400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3898668400},{"type":"v1","addr":"172.21.15.117:6833","nonce":3898668400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-19T06:03:26.137 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 2 2024-09-19T06:03:26.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:26.137+0000 7fe43f1fe640 1 -- 172.21.15.37:0/1189889971 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fe4280a3240 msgr2=0x7fe4280a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:26.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:26.137+0000 7fe43f1fe640 1 --2- 172.21.15.37:0/1189889971 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fe4280a3240 0x7fe4280a5700 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe42c000c00 tx=0x7fe42c031510 comp rx=0 tx=0).stop 2024-09-19T06:03:26.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:26.137+0000 7fe43f1fe640 1 -- 172.21.15.37:0/1189889971 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe438101420 msgr2=0x7fe438102b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:26.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:26.137+0000 7fe43f1fe640 1 --2- 172.21.15.37:0/1189889971 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe438101420 0x7fe438102b90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe42400e9f0 tx=0x7fe42400eeb0 comp rx=0 tx=0).stop 2024-09-19T06:03:26.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:26.137+0000 7fe43f1fe640 1 -- 172.21.15.37:0/1189889971 shutdown_connections 2024-09-19T06:03:26.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:26.137+0000 7fe43f1fe640 1 --2- 172.21.15.37:0/1189889971 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fe4280a3240 0x7fe4280a5700 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:26.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:26.137+0000 7fe43f1fe640 1 --2- 172.21.15.37:0/1189889971 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe438101420 0x7fe438102b90 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:26.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:26.137+0000 7fe43f1fe640 1 --2- 172.21.15.37:0/1189889971 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe438106a80 0x7fe4381030d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:26.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:26.137+0000 7fe43f1fe640 1 --2- 172.21.15.37:0/1189889971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe438100a80 0x7fe438102650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:26.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:26.137+0000 7fe43f1fe640 1 -- 172.21.15.37:0/1189889971 >> 172.21.15.37:0/1189889971 conn(0x7fe4380fc7a0 msgr2=0x7fe43806a810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:03:26.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:26.137+0000 7fe43f1fe640 1 -- 172.21.15.37:0/1189889971 shutdown_connections 2024-09-19T06:03:26.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:26.137+0000 7fe43f1fe640 1 -- 172.21.15.37:0/1189889971 wait complete. 2024-09-19T06:03:26.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:26 smithi037 ceph-mon[31211]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:03:26.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:26 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:26.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:26 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:26.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:26 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:26.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:26 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:03:26.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:26 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:03:26.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:26 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:26.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:26 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/1189889971' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:03:26.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:26 smithi099 ceph-mon[35300]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:03:26.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:26 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:26.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:26 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:26.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:26 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:26.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:26 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:03:26.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:26 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:03:26.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:26 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:26.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:26 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/1189889971' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:03:26.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:26 smithi117 ceph-mon[35050]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:03:26.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:26 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:26.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:26 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:26.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:26 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:26.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:26 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:03:26.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:26 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:03:26.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:26 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:26.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:26 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/1189889971' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:03:27.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:27 smithi037 ceph-mon[31211]: Deploying daemon mds.j on smithi037 2024-09-19T06:03:27.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:27 smithi037 ceph-mon[31211]: mds.? [v2:172.21.15.99:6832/866590207,v1:172.21.15.99:6833/866590207] up:boot 2024-09-19T06:03:27.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:27 smithi037 ceph-mon[31211]: fsmap 2 up:standby 2024-09-19T06:03:27.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:27 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T06:03:27.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:27 smithi099 ceph-mon[35300]: Deploying daemon mds.j on smithi037 2024-09-19T06:03:27.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:27 smithi099 ceph-mon[35300]: mds.? [v2:172.21.15.99:6832/866590207,v1:172.21.15.99:6833/866590207] up:boot 2024-09-19T06:03:27.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:27 smithi099 ceph-mon[35300]: fsmap 2 up:standby 2024-09-19T06:03:27.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:27 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T06:03:27.749 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:27 smithi117 ceph-mon[35050]: Deploying daemon mds.j on smithi037 2024-09-19T06:03:27.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:27 smithi117 ceph-mon[35050]: mds.? [v2:172.21.15.99:6832/866590207,v1:172.21.15.99:6833/866590207] up:boot 2024-09-19T06:03:27.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:27 smithi117 ceph-mon[35050]: fsmap 2 up:standby 2024-09-19T06:03:27.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:27 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T06:03:28.384 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:28 smithi037 ceph-mon[31211]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:03:28.688 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:28 smithi099 ceph-mon[35300]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:03:28.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:28 smithi117 ceph-mon[35050]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:03:28.799 INFO:journalctl@ceph.mds.j.smithi037.stdout:Sep 19 06:03:28 smithi037 systemd[1]: Starting Ceph mds.j for b8c8bdae-764b-11ef-bceb-c7b262605968... 2024-09-19T06:03:28.983 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:03:29.056 INFO:journalctl@ceph.mds.j.smithi037.stdout:Sep 19 06:03:28 smithi037 podman[67912]: 2024-09-19 06:03:28.700931462 +0000 UTC m=+0.016631261 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:03:29.056 INFO:journalctl@ceph.mds.j.smithi037.stdout:Sep 19 06:03:28 smithi037 podman[67912]: 2024-09-19 06:03:28.827574762 +0000 UTC m=+0.143274542 container create 6a8c6eb360b5322af80a4289c800b97434b2ea6a5894c9961c4353481b08b845 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-j, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:03:29.056 INFO:journalctl@ceph.mds.j.smithi037.stdout:Sep 19 06:03:29 smithi037 podman[67912]: 2024-09-19 06:03:29.055169654 +0000 UTC m=+0.370869445 container init 6a8c6eb360b5322af80a4289c800b97434b2ea6a5894c9961c4353481b08b845 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-j, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:03:29.252 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:03:29.324 INFO:journalctl@ceph.mds.j.smithi037.stdout:Sep 19 06:03:29 smithi037 podman[67912]: 2024-09-19 06:03:29.058427461 +0000 UTC m=+0.374127251 container start 6a8c6eb360b5322af80a4289c800b97434b2ea6a5894c9961c4353481b08b845 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-j, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-19T06:03:29.324 INFO:journalctl@ceph.mds.j.smithi037.stdout:Sep 19 06:03:29 smithi037 ceph-mds[67949]: -- 172.21.15.37:0/1365427862 <== mon.0 v2:172.21.15.37:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559d21909860 con 0x559d218e7000 2024-09-19T06:03:29.324 INFO:journalctl@ceph.mds.j.smithi037.stdout:Sep 19 06:03:29 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-j[67927]: starting mds.j at 2024-09-19T06:03:29.324 INFO:journalctl@ceph.mds.j.smithi037.stdout:Sep 19 06:03:29 smithi037 bash[67912]: 6a8c6eb360b5322af80a4289c800b97434b2ea6a5894c9961c4353481b08b845 2024-09-19T06:03:29.324 INFO:journalctl@ceph.mds.j.smithi037.stdout:Sep 19 06:03:29 smithi037 systemd[1]: Started Ceph mds.j for b8c8bdae-764b-11ef-bceb-c7b262605968. 2024-09-19T06:03:29.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:29.760+0000 7f597ba0b640 1 -- 172.21.15.37:0/598745763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5974100350 msgr2=0x7f5974100730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:29.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:29.760+0000 7f597ba0b640 1 --2- 172.21.15.37:0/598745763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5974100350 0x7f5974100730 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5964009930 tx=0x7f596402a420 comp rx=0 tx=0).stop 2024-09-19T06:03:29.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:29.760+0000 7f597ba0b640 1 -- 172.21.15.37:0/598745763 shutdown_connections 2024-09-19T06:03:29.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:29.760+0000 7f597ba0b640 1 --2- 172.21.15.37:0/598745763 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5974100d00 0x7f5974106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:29.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:29.760+0000 7f597ba0b640 1 --2- 172.21.15.37:0/598745763 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5974106f50 0x7f597410eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:29.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:29.760+0000 7f597ba0b640 1 --2- 172.21.15.37:0/598745763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5974100350 0x7f5974100730 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:29.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:29.760+0000 7f597ba0b640 1 -- 172.21.15.37:0/598745763 >> 172.21.15.37:0/598745763 conn(0x7f5974077210 msgr2=0x7f59740fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:03:29.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:29.760+0000 7f597ba0b640 1 -- 172.21.15.37:0/598745763 shutdown_connections 2024-09-19T06:03:29.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:29.760+0000 7f597ba0b640 1 -- 172.21.15.37:0/598745763 wait complete. 2024-09-19T06:03:29.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:29.761+0000 7f597ba0b640 1 Processor -- start 2024-09-19T06:03:29.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:29.761+0000 7f597ba0b640 1 -- start start 2024-09-19T06:03:29.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:29.761+0000 7f597ba0b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5974100350 0x7f59741984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:29.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:29.761+0000 7f597ba0b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5974100d00 0x7f59741989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:29.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:29.761+0000 7f597ba0b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5974106f50 0x7f597419cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:29.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:29.761+0000 7f597ba0b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5974111fa0 con 0x7f5974106f50 2024-09-19T06:03:29.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:29.761+0000 7f597ba0b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f5974111e20 con 0x7f5974100350 2024-09-19T06:03:29.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:29.761+0000 7f597ba0b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5974112120 con 0x7f5974100d00 2024-09-19T06:03:29.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:29.762+0000 7f5979fa8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5974106f50 0x7f597419cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:29.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:29.762+0000 7f5979fa8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5974106f50 0x7f597419cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43268/0 (socket says 172.21.15.37:43268) 2024-09-19T06:03:29.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:29.762+0000 7f5979fa8640 1 -- 172.21.15.37:0/3550467701 learned_addr learned my addr 172.21.15.37:0/3550467701 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:03:29.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:29.762+0000 7f5978fa6640 1 --2- 172.21.15.37:0/3550467701 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5974100d00 0x7f59741989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:29.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:29.762+0000 7f59797a7640 1 --2- 172.21.15.37:0/3550467701 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5974100350 0x7f59741984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:29.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:29.762+0000 7f5979fa8640 1 -- 172.21.15.37:0/3550467701 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5974100d00 msgr2=0x7f59741989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:29.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:29.762+0000 7f5979fa8640 1 --2- 172.21.15.37:0/3550467701 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5974100d00 0x7f59741989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:29.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:29.762+0000 7f5979fa8640 1 -- 172.21.15.37:0/3550467701 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5974100350 msgr2=0x7f59741984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:29.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:29.762+0000 7f5979fa8640 1 --2- 172.21.15.37:0/3550467701 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5974100350 0x7f59741984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:29.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:29.762+0000 7f5979fa8640 1 -- 172.21.15.37:0/3550467701 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f597419d450 con 0x7f5974106f50 2024-09-19T06:03:29.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:29.762+0000 7f5979fa8640 1 --2- 172.21.15.37:0/3550467701 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5974106f50 0x7f597419cd70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f596c00d750 tx=0x7f596c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:03:29.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:29.762+0000 7f59727fc640 1 -- 172.21.15.37:0/3550467701 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f596c017070 con 0x7f5974106f50 2024-09-19T06:03:29.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:29.762+0000 7f597ba0b640 1 -- 172.21.15.37:0/3550467701 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f597419d740 con 0x7f5974106f50 2024-09-19T06:03:29.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:29.762+0000 7f59727fc640 1 -- 172.21.15.37:0/3550467701 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f596c005500 con 0x7f5974106f50 2024-09-19T06:03:29.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:29.762+0000 7f59727fc640 1 -- 172.21.15.37:0/3550467701 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f596c004d90 con 0x7f5974106f50 2024-09-19T06:03:29.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:29.762+0000 7f597ba0b640 1 -- 172.21.15.37:0/3550467701 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59741a5020 con 0x7f5974106f50 2024-09-19T06:03:29.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:29.763+0000 7f597ba0b640 1 -- 172.21.15.37:0/3550467701 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5974100730 con 0x7f5974106f50 2024-09-19T06:03:29.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:29.765+0000 7f59727fc640 1 -- 172.21.15.37:0/3550467701 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f596c004f30 con 0x7f5974106f50 2024-09-19T06:03:29.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:29.765+0000 7f59727fc640 1 --2- 172.21.15.37:0/3550467701 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f595c0a3240 0x7f595c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:29.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:29.765+0000 7f59797a7640 1 --2- 172.21.15.37:0/3550467701 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f595c0a3240 0x7f595c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:29.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:29.765+0000 7f59727fc640 1 -- 172.21.15.37:0/3550467701 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f596c0cf130 con 0x7f5974106f50 2024-09-19T06:03:29.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:29.766+0000 7f59797a7640 1 --2- 172.21.15.37:0/3550467701 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f595c0a3240 0x7f595c0a5700 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5964009900 tx=0x7f59640058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:03:29.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:29.769+0000 7f59727fc640 1 -- 172.21.15.37:0/3550467701 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f596c09bca0 con 0x7f5974106f50 2024-09-19T06:03:29.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:29.996+0000 7f597ba0b640 1 -- 172.21.15.37:0/3550467701 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5974199800 con 0x7f5974106f50 2024-09-19T06:03:29.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:29.996+0000 7f59727fc640 1 -- 172.21.15.37:0/3550467701 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3085 (secure 0 0 0) 0x7f596c09ffa0 con 0x7f5974106f50 2024-09-19T06:03:29.999 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T06:03:29.999 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":4,"btime":"2024-09-19T06:03:29:312581+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14514,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2864247978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2864247978},{"type":"v1","addr":"172.21.15.37:6835","nonce":2864247978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6833/866590207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":866590207},{"type":"v1","addr":"172.21.15.99:6833","nonce":866590207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3898668400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3898668400},{"type":"v1","addr":"172.21.15.117:6833","nonce":3898668400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-19T06:03:29.999 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 4 2024-09-19T06:03:30.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:29.998+0000 7f597ba0b640 1 -- 172.21.15.37:0/3550467701 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f595c0a3240 msgr2=0x7f595c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:30.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:29.998+0000 7f597ba0b640 1 --2- 172.21.15.37:0/3550467701 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f595c0a3240 0x7f595c0a5700 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5964009900 tx=0x7f59640058d0 comp rx=0 tx=0).stop 2024-09-19T06:03:30.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:29.998+0000 7f597ba0b640 1 -- 172.21.15.37:0/3550467701 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5974106f50 msgr2=0x7f597419cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:30.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:29.998+0000 7f597ba0b640 1 --2- 172.21.15.37:0/3550467701 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5974106f50 0x7f597419cd70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f596c00d750 tx=0x7f596c00dc10 comp rx=0 tx=0).stop 2024-09-19T06:03:30.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:29.998+0000 7f597ba0b640 1 -- 172.21.15.37:0/3550467701 shutdown_connections 2024-09-19T06:03:30.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:29.998+0000 7f597ba0b640 1 --2- 172.21.15.37:0/3550467701 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f595c0a3240 0x7f595c0a5700 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:30.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:29.998+0000 7f597ba0b640 1 --2- 172.21.15.37:0/3550467701 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5974106f50 0x7f597419cd70 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:30.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:29.998+0000 7f597ba0b640 1 --2- 172.21.15.37:0/3550467701 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5974100d00 0x7f59741989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:30.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:29.998+0000 7f597ba0b640 1 --2- 172.21.15.37:0/3550467701 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5974100350 0x7f59741984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:30.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:29.998+0000 7f597ba0b640 1 -- 172.21.15.37:0/3550467701 >> 172.21.15.37:0/3550467701 conn(0x7f5974077210 msgr2=0x7f59740fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:03:30.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:29.999+0000 7f597ba0b640 1 -- 172.21.15.37:0/3550467701 shutdown_connections 2024-09-19T06:03:30.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:29.999+0000 7f597ba0b640 1 -- 172.21.15.37:0/3550467701 wait complete. 2024-09-19T06:03:30.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:30 smithi117 ceph-mon[35050]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:03:30.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:30 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:30.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:30 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:30.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:30 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:30.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:30 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:03:30.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:30 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:03:30.501 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:30 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:30.501 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:30 smithi117 ceph-mon[35050]: Deploying daemon mds.d on smithi037 2024-09-19T06:03:30.501 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:30 smithi117 ceph-mon[35050]: mds.? [v2:172.21.15.37:6834/2864247978,v1:172.21.15.37:6835/2864247978] up:boot 2024-09-19T06:03:30.501 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:30 smithi117 ceph-mon[35050]: fsmap 3 up:standby 2024-09-19T06:03:30.501 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:30 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T06:03:30.501 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:30 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/3550467701' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:03:30.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:30 smithi037 ceph-mon[31211]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:03:30.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:30 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:30.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:30 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:30.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:30 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:30.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:30 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:03:30.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:30 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:03:30.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:30 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:30.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:30 smithi037 ceph-mon[31211]: Deploying daemon mds.d on smithi037 2024-09-19T06:03:30.575 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:30 smithi037 ceph-mon[31211]: mds.? [v2:172.21.15.37:6834/2864247978,v1:172.21.15.37:6835/2864247978] up:boot 2024-09-19T06:03:30.575 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:30 smithi037 ceph-mon[31211]: fsmap 3 up:standby 2024-09-19T06:03:30.575 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:30 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T06:03:30.575 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:30 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/3550467701' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:03:30.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:30 smithi099 ceph-mon[35300]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:03:30.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:30 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:30.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:30 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:30.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:30 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:30.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:30 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:03:30.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:30 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:03:30.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:30 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:30.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:30 smithi099 ceph-mon[35300]: Deploying daemon mds.d on smithi037 2024-09-19T06:03:30.690 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:30 smithi099 ceph-mon[35300]: mds.? [v2:172.21.15.37:6834/2864247978,v1:172.21.15.37:6835/2864247978] up:boot 2024-09-19T06:03:30.690 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:30 smithi099 ceph-mon[35300]: fsmap 3 up:standby 2024-09-19T06:03:30.690 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:30 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T06:03:30.690 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:30 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/3550467701' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:03:32.499 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:32 smithi117 ceph-mon[35050]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:03:32.545 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:32 smithi037 ceph-mon[31211]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:03:32.546 INFO:journalctl@ceph.mds.d.smithi037.stdout:Sep 19 06:03:32 smithi037 systemd[1]: Starting Ceph mds.d for b8c8bdae-764b-11ef-bceb-c7b262605968... 2024-09-19T06:03:32.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:32 smithi099 ceph-mon[35300]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:03:32.823 INFO:journalctl@ceph.mds.d.smithi037.stdout:Sep 19 06:03:32 smithi037 podman[68326]: 2024-09-19 06:03:32.446768869 +0000 UTC m=+0.016575687 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:03:32.823 INFO:journalctl@ceph.mds.d.smithi037.stdout:Sep 19 06:03:32 smithi037 podman[68326]: 2024-09-19 06:03:32.569443739 +0000 UTC m=+0.139250589 container create a98194e40add48c39e3aaa43823778463220799546c550dadbd4ba75b4d11ced (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-d, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-19T06:03:32.823 INFO:journalctl@ceph.mds.d.smithi037.stdout:Sep 19 06:03:32 smithi037 podman[68326]: 2024-09-19 06:03:32.822197524 +0000 UTC m=+0.392004340 container init a98194e40add48c39e3aaa43823778463220799546c550dadbd4ba75b4d11ced (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-d, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, ceph=True, org.label-schema.license=GPLv2) 2024-09-19T06:03:33.074 INFO:journalctl@ceph.mds.d.smithi037.stdout:Sep 19 06:03:32 smithi037 podman[68326]: 2024-09-19 06:03:32.825293758 +0000 UTC m=+0.395100562 container start a98194e40add48c39e3aaa43823778463220799546c550dadbd4ba75b4d11ced (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-d, RELEASE=squid-2f599a4, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:03:33.074 INFO:journalctl@ceph.mds.d.smithi037.stdout:Sep 19 06:03:32 smithi037 ceph-mds[68345]: -- 172.21.15.37:0/1043762529 <== mon.0 v2:172.21.15.37:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5646d8d5d860 con 0x5646d8d3a800 2024-09-19T06:03:33.074 INFO:journalctl@ceph.mds.d.smithi037.stdout:Sep 19 06:03:32 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-d[68341]: starting mds.d at 2024-09-19T06:03:33.074 INFO:journalctl@ceph.mds.d.smithi037.stdout:Sep 19 06:03:32 smithi037 bash[68326]: a98194e40add48c39e3aaa43823778463220799546c550dadbd4ba75b4d11ced 2024-09-19T06:03:33.074 INFO:journalctl@ceph.mds.d.smithi037.stdout:Sep 19 06:03:32 smithi037 systemd[1]: Started Ceph mds.d for b8c8bdae-764b-11ef-bceb-c7b262605968. 2024-09-19T06:03:33.244 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:03:33.504 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:03:34.196 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:33 smithi037 ceph-mon[31211]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:03:34.196 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:33 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:34.196 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:33 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:34.196 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:33 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:34.196 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:33 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:03:34.196 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:33 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:03:34.197 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:33 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:34.197 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:33 smithi037 ceph-mon[31211]: Deploying daemon mds.e on smithi099 2024-09-19T06:03:34.197 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:33 smithi037 ceph-mon[31211]: mds.? [v2:172.21.15.37:6836/633000932,v1:172.21.15.37:6837/633000932] up:boot 2024-09-19T06:03:34.197 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:33 smithi037 ceph-mon[31211]: fsmap 4 up:standby 2024-09-19T06:03:34.197 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:33 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T06:03:34.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:34.193+0000 7fceda504640 1 -- 172.21.15.37:0/157531540 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fced4106a80 msgr2=0x7fced4106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:34.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:34.193+0000 7fceda504640 1 --2- 172.21.15.37:0/157531540 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fced4106a80 0x7fced4106e60 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcec4009930 tx=0x7fcec402a420 comp rx=0 tx=0).stop 2024-09-19T06:03:34.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:34.193+0000 7fceda504640 1 -- 172.21.15.37:0/157531540 shutdown_connections 2024-09-19T06:03:34.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:34.193+0000 7fceda504640 1 --2- 172.21.15.37:0/157531540 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fced4101420 0x7fced410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:34.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:34.193+0000 7fceda504640 1 --2- 172.21.15.37:0/157531540 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fced4100a80 0x7fced4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:34.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:34.193+0000 7fceda504640 1 --2- 172.21.15.37:0/157531540 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fced4106a80 0x7fced4106e60 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:34.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:34.193+0000 7fceda504640 1 -- 172.21.15.37:0/157531540 >> 172.21.15.37:0/157531540 conn(0x7fced40fc7a0 msgr2=0x7fced40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:03:34.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:34.193+0000 7fceda504640 1 -- 172.21.15.37:0/157531540 shutdown_connections 2024-09-19T06:03:34.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:34.193+0000 7fceda504640 1 -- 172.21.15.37:0/157531540 wait complete. 2024-09-19T06:03:34.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:34.194+0000 7fceda504640 1 Processor -- start 2024-09-19T06:03:34.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:34.194+0000 7fceda504640 1 -- start start 2024-09-19T06:03:34.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:34.194+0000 7fceda504640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fced4100a80 0x7fced41984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:34.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:34.194+0000 7fceda504640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fced4101420 0x7fced4198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:34.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:34.194+0000 7fceda504640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fced4106a80 0x7fced419cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:34.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:34.194+0000 7fceda504640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fced4110ea0 con 0x7fced4100a80 2024-09-19T06:03:34.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:34.194+0000 7fceda504640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fced4110d20 con 0x7fced4106a80 2024-09-19T06:03:34.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:34.194+0000 7fceda504640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fced4111020 con 0x7fced4101420 2024-09-19T06:03:34.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:34.195+0000 7fced3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fced4100a80 0x7fced41984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:34.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:34.195+0000 7fced3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fced4100a80 0x7fced41984c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38150/0 (socket says 172.21.15.37:38150) 2024-09-19T06:03:34.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:34.195+0000 7fced3fff640 1 -- 172.21.15.37:0/2608571104 learned_addr learned my addr 172.21.15.37:0/2608571104 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:03:34.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:34.195+0000 7fced8aa1640 1 --2- 172.21.15.37:0/2608571104 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fced4106a80 0x7fced419cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:34.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:34.195+0000 7fced37fe640 1 --2- 172.21.15.37:0/2608571104 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fced4101420 0x7fced4198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:34.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:34.195+0000 7fced3fff640 1 -- 172.21.15.37:0/2608571104 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fced4101420 msgr2=0x7fced4198a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:34.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:34.195+0000 7fced3fff640 1 --2- 172.21.15.37:0/2608571104 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fced4101420 0x7fced4198a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:34.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:34.195+0000 7fced3fff640 1 -- 172.21.15.37:0/2608571104 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fced4106a80 msgr2=0x7fced419cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:34.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:34.195+0000 7fced3fff640 1 --2- 172.21.15.37:0/2608571104 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fced4106a80 0x7fced419cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:34.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:34.195+0000 7fced3fff640 1 -- 172.21.15.37:0/2608571104 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fced419d470 con 0x7fced4100a80 2024-09-19T06:03:34.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:34.195+0000 7fced37fe640 1 --2- 172.21.15.37:0/2608571104 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fced4101420 0x7fced4198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:03:34.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:34.195+0000 7fced3fff640 1 --2- 172.21.15.37:0/2608571104 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fced4100a80 0x7fced41984c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcec4009230 tx=0x7fcec4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:03:34.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:34.195+0000 7fced17fa640 1 -- 172.21.15.37:0/2608571104 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec403f030 con 0x7fced4100a80 2024-09-19T06:03:34.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:34.195+0000 7fced17fa640 1 -- 172.21.15.37:0/2608571104 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcec4003ad0 con 0x7fced4100a80 2024-09-19T06:03:34.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:34.195+0000 7fceda504640 1 -- 172.21.15.37:0/2608571104 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fced419d700 con 0x7fced4100a80 2024-09-19T06:03:34.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:34.195+0000 7fced17fa640 1 -- 172.21.15.37:0/2608571104 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec4035070 con 0x7fced4100a80 2024-09-19T06:03:34.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:34.195+0000 7fceda504640 1 -- 172.21.15.37:0/2608571104 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fced41a5040 con 0x7fced4100a80 2024-09-19T06:03:34.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:34.196+0000 7fceda504640 1 -- 172.21.15.37:0/2608571104 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fced41021c0 con 0x7fced4100a80 2024-09-19T06:03:34.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:34.197+0000 7fced17fa640 1 -- 172.21.15.37:0/2608571104 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fcec4042030 con 0x7fced4100a80 2024-09-19T06:03:34.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:34.198+0000 7fced17fa640 1 --2- 172.21.15.37:0/2608571104 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fcebc0a3240 0x7fcebc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:34.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:34.198+0000 7fced37fe640 1 --2- 172.21.15.37:0/2608571104 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fcebc0a3240 0x7fcebc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:34.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:34.198+0000 7fced17fa640 1 -- 172.21.15.37:0/2608571104 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fcec40ef960 con 0x7fced4100a80 2024-09-19T06:03:34.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:34.199+0000 7fced37fe640 1 --2- 172.21.15.37:0/2608571104 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fcebc0a3240 0x7fcebc0a5700 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fced4105260 tx=0x7fcec8008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:03:34.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:34.202+0000 7fced17fa640 1 -- 172.21.15.37:0/2608571104 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcec40bcb20 con 0x7fced4100a80 2024-09-19T06:03:34.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:34.417+0000 7fceda504640 1 -- 172.21.15.37:0/2608571104 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fced410a000 con 0x7fced4100a80 2024-09-19T06:03:34.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:34.418+0000 7fced17fa640 1 -- 172.21.15.37:0/2608571104 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3907 (secure 0 0 0) 0x7fcec40bc420 con 0x7fced4100a80 2024-09-19T06:03:34.420 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T06:03:34.420 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":5,"btime":"2024-09-19T06:03:33:226008+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14514,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2864247978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2864247978},{"type":"v1","addr":"172.21.15.37:6835","nonce":2864247978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14526,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/633000932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":633000932},{"type":"v1","addr":"172.21.15.37:6837","nonce":633000932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6833/866590207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":866590207},{"type":"v1","addr":"172.21.15.99:6833","nonce":866590207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3898668400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3898668400},{"type":"v1","addr":"172.21.15.117:6833","nonce":3898668400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-19T06:03:34.421 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 5 2024-09-19T06:03:34.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:34.420+0000 7fceda504640 1 -- 172.21.15.37:0/2608571104 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fcebc0a3240 msgr2=0x7fcebc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:34.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:34.420+0000 7fceda504640 1 --2- 172.21.15.37:0/2608571104 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fcebc0a3240 0x7fcebc0a5700 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fced4105260 tx=0x7fcec8008040 comp rx=0 tx=0).stop 2024-09-19T06:03:34.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:34.420+0000 7fceda504640 1 -- 172.21.15.37:0/2608571104 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fced4100a80 msgr2=0x7fced41984c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:34.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:34.420+0000 7fceda504640 1 --2- 172.21.15.37:0/2608571104 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fced4100a80 0x7fced41984c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcec4009230 tx=0x7fcec4004270 comp rx=0 tx=0).stop 2024-09-19T06:03:34.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:34.420+0000 7fceda504640 1 -- 172.21.15.37:0/2608571104 shutdown_connections 2024-09-19T06:03:34.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:34.420+0000 7fceda504640 1 --2- 172.21.15.37:0/2608571104 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fcebc0a3240 0x7fcebc0a5700 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:34.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:34.420+0000 7fceda504640 1 --2- 172.21.15.37:0/2608571104 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fced4106a80 0x7fced419cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:34.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:34.420+0000 7fceda504640 1 --2- 172.21.15.37:0/2608571104 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fced4101420 0x7fced4198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:34.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:34.420+0000 7fceda504640 1 --2- 172.21.15.37:0/2608571104 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fced4100a80 0x7fced41984c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:34.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:34.420+0000 7fceda504640 1 -- 172.21.15.37:0/2608571104 >> 172.21.15.37:0/2608571104 conn(0x7fced40fc7a0 msgr2=0x7fced406aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:03:34.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:34.420+0000 7fceda504640 1 -- 172.21.15.37:0/2608571104 shutdown_connections 2024-09-19T06:03:34.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:34.420+0000 7fceda504640 1 -- 172.21.15.37:0/2608571104 wait complete. 2024-09-19T06:03:34.438 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:33 smithi099 ceph-mon[35300]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:03:34.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:33 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:34.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:33 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:34.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:33 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:34.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:33 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:03:34.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:33 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:03:34.440 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:33 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:34.440 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:33 smithi099 ceph-mon[35300]: Deploying daemon mds.e on smithi099 2024-09-19T06:03:34.440 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:33 smithi099 ceph-mon[35300]: mds.? [v2:172.21.15.37:6836/633000932,v1:172.21.15.37:6837/633000932] up:boot 2024-09-19T06:03:34.440 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:33 smithi099 ceph-mon[35300]: fsmap 4 up:standby 2024-09-19T06:03:34.440 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:33 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T06:03:34.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:33 smithi117 ceph-mon[35050]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:03:34.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:33 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:34.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:33 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:34.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:33 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:34.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:33 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:03:34.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:33 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:03:34.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:33 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:34.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:33 smithi117 ceph-mon[35050]: Deploying daemon mds.e on smithi099 2024-09-19T06:03:34.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:33 smithi117 ceph-mon[35050]: mds.? [v2:172.21.15.37:6836/633000932,v1:172.21.15.37:6837/633000932] up:boot 2024-09-19T06:03:34.501 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:33 smithi117 ceph-mon[35050]: fsmap 4 up:standby 2024-09-19T06:03:34.501 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:33 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T06:03:35.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:35 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/2608571104' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:03:35.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:35 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/2608571104' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:03:35.189 INFO:journalctl@ceph.mds.e.smithi099.stdout:Sep 19 06:03:35 smithi099 systemd[1]: Starting Ceph mds.e for b8c8bdae-764b-11ef-bceb-c7b262605968... 2024-09-19T06:03:35.499 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:35 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/2608571104' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:03:35.540 INFO:journalctl@ceph.mds.e.smithi099.stdout:Sep 19 06:03:35 smithi099 podman[64732]: 2024-09-19 06:03:35.146110866 +0000 UTC m=+0.015433421 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:03:35.541 INFO:journalctl@ceph.mds.e.smithi099.stdout:Sep 19 06:03:35 smithi099 podman[64732]: 2024-09-19 06:03:35.29528075 +0000 UTC m=+0.164603340 container create 89344c0a6c6077b7cdde3df6b401cd73d013053c6d92762c43e85d45d5639c92 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-e, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-19T06:03:35.541 INFO:journalctl@ceph.mds.e.smithi099.stdout:Sep 19 06:03:35 smithi099 podman[64732]: 2024-09-19 06:03:35.53963676 +0000 UTC m=+0.408959321 container init 89344c0a6c6077b7cdde3df6b401cd73d013053c6d92762c43e85d45d5639c92 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-e, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-19T06:03:35.938 INFO:journalctl@ceph.mds.e.smithi099.stdout:Sep 19 06:03:35 smithi099 podman[64732]: 2024-09-19 06:03:35.542510615 +0000 UTC m=+0.411833168 container start 89344c0a6c6077b7cdde3df6b401cd73d013053c6d92762c43e85d45d5639c92 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-e, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:03:35.939 INFO:journalctl@ceph.mds.e.smithi099.stdout:Sep 19 06:03:35 smithi099 ceph-mds[64750]: -- 172.21.15.99:0/2970222287 <== mon.2 v2:172.21.15.99:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e68fd8d860 con 0x55e68fd6b000 2024-09-19T06:03:35.939 INFO:journalctl@ceph.mds.e.smithi099.stdout:Sep 19 06:03:35 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-e[64746]: starting mds.e at 2024-09-19T06:03:35.939 INFO:journalctl@ceph.mds.e.smithi099.stdout:Sep 19 06:03:35 smithi099 bash[64732]: 89344c0a6c6077b7cdde3df6b401cd73d013053c6d92762c43e85d45d5639c92 2024-09-19T06:03:35.939 INFO:journalctl@ceph.mds.e.smithi099.stdout:Sep 19 06:03:35 smithi099 systemd[1]: Started Ceph mds.e for b8c8bdae-764b-11ef-bceb-c7b262605968. 2024-09-19T06:03:36.268 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:36 smithi117 ceph-mon[35050]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:03:36.269 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:36 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:36.269 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:36 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:36.269 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:36 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:36.269 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:36 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:03:36.269 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:36 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:03:36.269 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:36 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:36.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:36 smithi037 ceph-mon[31211]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:03:36.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:36 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:36.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:36 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:36.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:36 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:36.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:36 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:03:36.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:36 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:03:36.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:36 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:36.438 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:36 smithi099 ceph-mon[35300]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:03:36.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:36 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:36.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:36 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:36.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:36 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:36.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:36 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:03:36.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:36 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:03:36.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:36 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:37.234 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:03:37.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:37 smithi037 ceph-mon[31211]: Deploying daemon mds.f on smithi117 2024-09-19T06:03:37.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:37 smithi037 ceph-mon[31211]: mds.? [v2:172.21.15.99:6834/2650673320,v1:172.21.15.99:6835/2650673320] up:boot 2024-09-19T06:03:37.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:37 smithi037 ceph-mon[31211]: fsmap 5 up:standby 2024-09-19T06:03:37.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:37 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T06:03:37.376 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:37 smithi117 ceph-mon[35050]: Deploying daemon mds.f on smithi117 2024-09-19T06:03:37.376 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:37 smithi117 ceph-mon[35050]: mds.? [v2:172.21.15.99:6834/2650673320,v1:172.21.15.99:6835/2650673320] up:boot 2024-09-19T06:03:37.377 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:37 smithi117 ceph-mon[35050]: fsmap 5 up:standby 2024-09-19T06:03:37.377 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:37 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T06:03:37.438 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:37 smithi099 ceph-mon[35300]: Deploying daemon mds.f on smithi117 2024-09-19T06:03:37.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:37 smithi099 ceph-mon[35300]: mds.? [v2:172.21.15.99:6834/2650673320,v1:172.21.15.99:6835/2650673320] up:boot 2024-09-19T06:03:37.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:37 smithi099 ceph-mon[35300]: fsmap 5 up:standby 2024-09-19T06:03:37.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:37 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T06:03:37.504 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:03:37.749 INFO:journalctl@ceph.mds.f.smithi117.stdout:Sep 19 06:03:37 smithi117 systemd[1]: Starting Ceph mds.f for b8c8bdae-764b-11ef-bceb-c7b262605968... 2024-09-19T06:03:38.017 INFO:journalctl@ceph.mds.f.smithi117.stdout:Sep 19 06:03:37 smithi117 podman[64222]: 2024-09-19 06:03:37.661009093 +0000 UTC m=+0.015602833 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:03:38.018 INFO:journalctl@ceph.mds.f.smithi117.stdout:Sep 19 06:03:37 smithi117 podman[64222]: 2024-09-19 06:03:37.764546554 +0000 UTC m=+0.119140316 container create 1d97abc4ce75d745510b224b1043a9f8602bdfb60bccad298195e9e2df3606a3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-f, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-19T06:03:38.018 INFO:journalctl@ceph.mds.f.smithi117.stdout:Sep 19 06:03:37 smithi117 podman[64222]: 2024-09-19 06:03:37.992157052 +0000 UTC m=+0.346750769 container init 1d97abc4ce75d745510b224b1043a9f8602bdfb60bccad298195e9e2df3606a3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-f, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4) 2024-09-19T06:03:38.018 INFO:journalctl@ceph.mds.f.smithi117.stdout:Sep 19 06:03:37 smithi117 podman[64222]: 2024-09-19 06:03:37.99492672 +0000 UTC m=+0.349520438 container start 1d97abc4ce75d745510b224b1043a9f8602bdfb60bccad298195e9e2df3606a3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-f, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-19T06:03:38.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:38.043+0000 7fa78d5f0640 1 -- 172.21.15.37:0/323345121 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa788106f10 msgr2=0x7fa78810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:38.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:38.043+0000 7fa78d5f0640 1 --2- 172.21.15.37:0/323345121 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa788106f10 0x7fa78810ea90 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa780009ca0 tx=0x7fa78002a8c0 comp rx=0 tx=0).stop 2024-09-19T06:03:38.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:38.043+0000 7fa78d5f0640 1 -- 172.21.15.37:0/323345121 shutdown_connections 2024-09-19T06:03:38.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:38.043+0000 7fa78d5f0640 1 --2- 172.21.15.37:0/323345121 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa788102790 0x7fa7881067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:38.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:38.043+0000 7fa78d5f0640 1 --2- 172.21.15.37:0/323345121 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa788106f10 0x7fa78810ea90 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:38.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:38.043+0000 7fa78d5f0640 1 --2- 172.21.15.37:0/323345121 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa788101de0 0x7fa7881021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:38.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:38.043+0000 7fa78d5f0640 1 -- 172.21.15.37:0/323345121 >> 172.21.15.37:0/323345121 conn(0x7fa7880fd8c0 msgr2=0x7fa7880ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:03:38.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:38.043+0000 7fa78d5f0640 1 -- 172.21.15.37:0/323345121 shutdown_connections 2024-09-19T06:03:38.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:38.043+0000 7fa78d5f0640 1 -- 172.21.15.37:0/323345121 wait complete. 2024-09-19T06:03:38.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:38.044+0000 7fa78d5f0640 1 Processor -- start 2024-09-19T06:03:38.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:38.044+0000 7fa78d5f0640 1 -- start start 2024-09-19T06:03:38.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:38.044+0000 7fa78d5f0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa788101de0 0x7fa7880744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:38.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:38.044+0000 7fa78d5f0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa788102790 0x7fa788074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:38.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:38.044+0000 7fa78d5f0640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa788106f10 0x7fa788074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:38.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:38.044+0000 7fa78d5f0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa788111f70 con 0x7fa788102790 2024-09-19T06:03:38.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:38.044+0000 7fa78d5f0640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fa788111df0 con 0x7fa788106f10 2024-09-19T06:03:38.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:38.044+0000 7fa78d5f0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa7881120f0 con 0x7fa788101de0 2024-09-19T06:03:38.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:38.044+0000 7fa77e7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa788102790 0x7fa788074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:38.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:38.044+0000 7fa77e7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa788102790 0x7fa788074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38176/0 (socket says 172.21.15.37:38176) 2024-09-19T06:03:38.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:38.044+0000 7fa77e7fc640 1 -- 172.21.15.37:0/1717482427 learned_addr learned my addr 172.21.15.37:0/1717482427 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:03:38.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:38.044+0000 7fa786ffd640 1 --2- 172.21.15.37:0/1717482427 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa788101de0 0x7fa7880744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:38.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:38.045+0000 7fa7877fe640 1 --2- 172.21.15.37:0/1717482427 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa788106f10 0x7fa788074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:38.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:38.045+0000 7fa77e7fc640 1 -- 172.21.15.37:0/1717482427 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa788101de0 msgr2=0x7fa7880744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:38.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:38.045+0000 7fa77e7fc640 1 --2- 172.21.15.37:0/1717482427 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa788101de0 0x7fa7880744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:38.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:38.045+0000 7fa77e7fc640 1 -- 172.21.15.37:0/1717482427 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa788106f10 msgr2=0x7fa788074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:38.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:38.045+0000 7fa77e7fc640 1 --2- 172.21.15.37:0/1717482427 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa788106f10 0x7fa788074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:38.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:38.045+0000 7fa77e7fc640 1 -- 172.21.15.37:0/1717482427 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7881a6890 con 0x7fa788102790 2024-09-19T06:03:38.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:38.045+0000 7fa77e7fc640 1 --2- 172.21.15.37:0/1717482427 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa788102790 0x7fa788074a30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa77000d950 tx=0x7fa77000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:03:38.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:38.045+0000 7fa784ff9640 1 -- 172.21.15.37:0/1717482427 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa770017070 con 0x7fa788102790 2024-09-19T06:03:38.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:38.045+0000 7fa784ff9640 1 -- 172.21.15.37:0/1717482427 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa770009c30 con 0x7fa788102790 2024-09-19T06:03:38.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:38.045+0000 7fa78d5f0640 1 -- 172.21.15.37:0/1717482427 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7881a6b80 con 0x7fa788102790 2024-09-19T06:03:38.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:38.045+0000 7fa784ff9640 1 -- 172.21.15.37:0/1717482427 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa77000f6b0 con 0x7fa788102790 2024-09-19T06:03:38.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:38.045+0000 7fa78d5f0640 1 -- 172.21.15.37:0/1717482427 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7881a70c0 con 0x7fa788102790 2024-09-19T06:03:38.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:38.046+0000 7fa78d5f0640 1 -- 172.21.15.37:0/1717482427 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7881021c0 con 0x7fa788102790 2024-09-19T06:03:38.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:38.047+0000 7fa784ff9640 1 -- 172.21.15.37:0/1717482427 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fa7700109d0 con 0x7fa788102790 2024-09-19T06:03:38.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:38.048+0000 7fa784ff9640 1 --2- 172.21.15.37:0/1717482427 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fa7740a3240 0x7fa7740a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:38.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:38.048+0000 7fa786ffd640 1 --2- 172.21.15.37:0/1717482427 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fa7740a3240 0x7fa7740a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:38.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:38.048+0000 7fa784ff9640 1 -- 172.21.15.37:0/1717482427 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fa7700cf000 con 0x7fa788102790 2024-09-19T06:03:38.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:38.048+0000 7fa786ffd640 1 --2- 172.21.15.37:0/1717482427 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fa7740a3240 0x7fa7740a5700 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa778009bd0 tx=0x7fa778005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:03:38.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:38.052+0000 7fa784ff9640 1 -- 172.21.15.37:0/1717482427 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa770009de0 con 0x7fa788102790 2024-09-19T06:03:38.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:38 smithi099 ceph-mon[35300]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:03:38.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:38.267+0000 7fa78d5f0640 1 -- 172.21.15.37:0/1717482427 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa788109bc0 con 0x7fa788102790 2024-09-19T06:03:38.270 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:38 smithi037 ceph-mon[31211]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:03:38.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:38.268+0000 7fa784ff9640 1 -- 172.21.15.37:0/1717482427 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4732 (secure 0 0 0) 0x7fa770084e20 con 0x7fa788102790 2024-09-19T06:03:38.270 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T06:03:38.270 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":6,"btime":"2024-09-19T06:03:36:004311+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14514,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2864247978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2864247978},{"type":"v1","addr":"172.21.15.37:6835","nonce":2864247978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14526,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/633000932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":633000932},{"type":"v1","addr":"172.21.15.37:6837","nonce":633000932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6833/866590207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":866590207},{"type":"v1","addr":"172.21.15.99:6833","nonce":866590207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3898668400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3898668400},{"type":"v1","addr":"172.21.15.117:6833","nonce":3898668400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2650673320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2650673320},{"type":"v1","addr":"172.21.15.99:6835","nonce":2650673320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-19T06:03:38.271 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 6 2024-09-19T06:03:38.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:38.271+0000 7fa78d5f0640 1 -- 172.21.15.37:0/1717482427 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fa7740a3240 msgr2=0x7fa7740a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:38.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:38.271+0000 7fa78d5f0640 1 --2- 172.21.15.37:0/1717482427 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fa7740a3240 0x7fa7740a5700 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa778009bd0 tx=0x7fa778005f90 comp rx=0 tx=0).stop 2024-09-19T06:03:38.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:38.271+0000 7fa78d5f0640 1 -- 172.21.15.37:0/1717482427 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa788102790 msgr2=0x7fa788074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:38.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:38.271+0000 7fa78d5f0640 1 --2- 172.21.15.37:0/1717482427 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa788102790 0x7fa788074a30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa77000d950 tx=0x7fa77000de10 comp rx=0 tx=0).stop 2024-09-19T06:03:38.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:38.271+0000 7fa78d5f0640 1 -- 172.21.15.37:0/1717482427 shutdown_connections 2024-09-19T06:03:38.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:38.271+0000 7fa78d5f0640 1 --2- 172.21.15.37:0/1717482427 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fa7740a3240 0x7fa7740a5700 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:38.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:38.271+0000 7fa78d5f0640 1 --2- 172.21.15.37:0/1717482427 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa788106f10 0x7fa788074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:38.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:38.271+0000 7fa78d5f0640 1 --2- 172.21.15.37:0/1717482427 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa788102790 0x7fa788074a30 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:38.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:38.271+0000 7fa78d5f0640 1 --2- 172.21.15.37:0/1717482427 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa788101de0 0x7fa7880744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:38.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:38.271+0000 7fa78d5f0640 1 -- 172.21.15.37:0/1717482427 >> 172.21.15.37:0/1717482427 conn(0x7fa7880fd8c0 msgr2=0x7fa7880feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:03:38.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:38.271+0000 7fa78d5f0640 1 -- 172.21.15.37:0/1717482427 shutdown_connections 2024-09-19T06:03:38.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:38.272+0000 7fa78d5f0640 1 -- 172.21.15.37:0/1717482427 wait complete. 2024-09-19T06:03:38.499 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:38 smithi117 ceph-mon[35050]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:03:38.500 INFO:journalctl@ceph.mds.f.smithi117.stdout:Sep 19 06:03:38 smithi117 ceph-mds[64241]: -- 172.21.15.117:0/60038446 <== mon.1 v2:172.21.15.117:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562cce83b860 con 0x562cce819400 2024-09-19T06:03:38.500 INFO:journalctl@ceph.mds.f.smithi117.stdout:Sep 19 06:03:38 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-f[64237]: starting mds.f at 2024-09-19T06:03:38.500 INFO:journalctl@ceph.mds.f.smithi117.stdout:Sep 19 06:03:38 smithi117 bash[64222]: 1d97abc4ce75d745510b224b1043a9f8602bdfb60bccad298195e9e2df3606a3 2024-09-19T06:03:38.500 INFO:journalctl@ceph.mds.f.smithi117.stdout:Sep 19 06:03:38 smithi117 systemd[1]: Started Ceph mds.f for b8c8bdae-764b-11ef-bceb-c7b262605968. 2024-09-19T06:03:39.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:39 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:39.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:39 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:39.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:39 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:39.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:39 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:03:39.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:39 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:03:39.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:39 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:39.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:39 smithi117 ceph-mon[35050]: Deploying daemon mds.c on smithi117 2024-09-19T06:03:39.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:39 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/1717482427' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:03:39.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:39 smithi117 ceph-mon[35050]: mds.? [v2:172.21.15.117:6834/1097471349,v1:172.21.15.117:6835/1097471349] up:boot 2024-09-19T06:03:39.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:39 smithi117 ceph-mon[35050]: fsmap 6 up:standby 2024-09-19T06:03:39.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:39 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T06:03:39.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:39 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:39.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:39 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:39.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:39 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:39.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:39 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:03:39.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:39 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:03:39.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:39 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:39.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:39 smithi037 ceph-mon[31211]: Deploying daemon mds.c on smithi117 2024-09-19T06:03:39.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:39 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/1717482427' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:03:39.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:39 smithi037 ceph-mon[31211]: mds.? [v2:172.21.15.117:6834/1097471349,v1:172.21.15.117:6835/1097471349] up:boot 2024-09-19T06:03:39.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:39 smithi037 ceph-mon[31211]: fsmap 6 up:standby 2024-09-19T06:03:39.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:39 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T06:03:39.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:39 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:39.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:39 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:39.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:39 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:39.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:39 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:03:39.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:39 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:03:39.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:39 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:39.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:39 smithi099 ceph-mon[35300]: Deploying daemon mds.c on smithi117 2024-09-19T06:03:39.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:39 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/1717482427' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:03:39.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:39 smithi099 ceph-mon[35300]: mds.? [v2:172.21.15.117:6834/1097471349,v1:172.21.15.117:6835/1097471349] up:boot 2024-09-19T06:03:39.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:39 smithi099 ceph-mon[35300]: fsmap 6 up:standby 2024-09-19T06:03:39.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:39 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T06:03:40.157 INFO:journalctl@ceph.mds.c.smithi117.stdout:Sep 19 06:03:40 smithi117 systemd[1]: Starting Ceph mds.c for b8c8bdae-764b-11ef-bceb-c7b262605968... 2024-09-19T06:03:40.415 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:40 smithi117 ceph-mon[35050]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:03:40.415 INFO:journalctl@ceph.mds.c.smithi117.stdout:Sep 19 06:03:40 smithi117 podman[64523]: 2024-09-19 06:03:40.149809103 +0000 UTC m=+0.015727231 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:03:40.415 INFO:journalctl@ceph.mds.c.smithi117.stdout:Sep 19 06:03:40 smithi117 podman[64523]: 2024-09-19 06:03:40.272435636 +0000 UTC m=+0.138353805 container create 5eacfd090aec2694e4815baa9d198ac027404787c50a7037f292db05539ed7c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-c, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-19T06:03:40.438 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:40 smithi099 ceph-mon[35300]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:03:40.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:40 smithi037 ceph-mon[31211]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:03:41.000 INFO:journalctl@ceph.mds.c.smithi117.stdout:Sep 19 06:03:40 smithi117 podman[64523]: 2024-09-19 06:03:40.516824068 +0000 UTC m=+0.382742195 container init 5eacfd090aec2694e4815baa9d198ac027404787c50a7037f292db05539ed7c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-c, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:03:41.000 INFO:journalctl@ceph.mds.c.smithi117.stdout:Sep 19 06:03:40 smithi117 podman[64523]: 2024-09-19 06:03:40.519786776 +0000 UTC m=+0.385704912 container start 5eacfd090aec2694e4815baa9d198ac027404787c50a7037f292db05539ed7c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, io.buildah.version=1.37.2) 2024-09-19T06:03:41.000 INFO:journalctl@ceph.mds.c.smithi117.stdout:Sep 19 06:03:40 smithi117 ceph-mds[64543]: -- 172.21.15.117:0/1277411869 <== mon.1 v2:172.21.15.117:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55751e851860 con 0x55751e82f400 2024-09-19T06:03:41.000 INFO:journalctl@ceph.mds.c.smithi117.stdout:Sep 19 06:03:40 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-c[64539]: starting mds.c at 2024-09-19T06:03:41.000 INFO:journalctl@ceph.mds.c.smithi117.stdout:Sep 19 06:03:40 smithi117 bash[64523]: 5eacfd090aec2694e4815baa9d198ac027404787c50a7037f292db05539ed7c7 2024-09-19T06:03:41.000 INFO:journalctl@ceph.mds.c.smithi117.stdout:Sep 19 06:03:40 smithi117 systemd[1]: Started Ceph mds.c for b8c8bdae-764b-11ef-bceb-c7b262605968. 2024-09-19T06:03:41.016 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:03:41.287 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:03:41.659 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:41 smithi037 ceph-mon[31211]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:03:41.659 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:41 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:41.659 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:41 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:41.659 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:41 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:41.660 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:41 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:03:41.660 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:41 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:03:41.660 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:41 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:41.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:41.818+0000 7f35e0549640 1 -- 172.21.15.37:0/653712300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35d8102570 msgr2=0x7f35d81029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:41.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:41.818+0000 7f35e0549640 1 --2- 172.21.15.37:0/653712300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35d8102570 0x7f35d81029b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f35d4009900 tx=0x7f35d402a480 comp rx=0 tx=0).stop 2024-09-19T06:03:41.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:41.818+0000 7f35e0549640 1 -- 172.21.15.37:0/653712300 shutdown_connections 2024-09-19T06:03:41.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:41.818+0000 7f35e0549640 1 --2- 172.21.15.37:0/653712300 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35d8102ef0 0x7f35d810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:41.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:41.818+0000 7f35e0549640 1 --2- 172.21.15.37:0/653712300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35d8102570 0x7f35d81029b0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:41.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:41.818+0000 7f35e0549640 1 --2- 172.21.15.37:0/653712300 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f35d8100e20 0x7f35d8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:41.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:41.818+0000 7f35e0549640 1 -- 172.21.15.37:0/653712300 >> 172.21.15.37:0/653712300 conn(0x7f35d80fc7d0 msgr2=0x7f35d80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:03:41.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:41.818+0000 7f35e0549640 1 -- 172.21.15.37:0/653712300 shutdown_connections 2024-09-19T06:03:41.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:41.818+0000 7f35e0549640 1 -- 172.21.15.37:0/653712300 wait complete. 2024-09-19T06:03:41.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:41.819+0000 7f35e0549640 1 Processor -- start 2024-09-19T06:03:41.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:41.819+0000 7f35e0549640 1 -- start start 2024-09-19T06:03:41.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:41.819+0000 7f35e0549640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f35d8100e20 0x7f35d80fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:41.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:41.819+0000 7f35e0549640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35d8102570 0x7f35d80fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:41.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:41.819+0000 7f35e0549640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35d8102ef0 0x7f35d80fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:41.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:41.819+0000 7f35e0549640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f35d8110fd0 con 0x7f35d8102570 2024-09-19T06:03:41.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:41.819+0000 7f35e0549640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f35d8110e50 con 0x7f35d8100e20 2024-09-19T06:03:41.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:41.819+0000 7f35e0549640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f35d8111150 con 0x7f35d8102ef0 2024-09-19T06:03:41.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:41.819+0000 7f35ddae4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35d8102570 0x7f35d80fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:41.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:41.819+0000 7f35ddae4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35d8102570 0x7f35d80fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38194/0 (socket says 172.21.15.37:38194) 2024-09-19T06:03:41.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:41.819+0000 7f35ddae4640 1 -- 172.21.15.37:0/145643885 learned_addr learned my addr 172.21.15.37:0/145643885 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:03:41.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:41.819+0000 7f35de2e5640 1 --2- 172.21.15.37:0/145643885 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f35d8100e20 0x7f35d80fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:41.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:41.819+0000 7f35deae6640 1 --2- 172.21.15.37:0/145643885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35d8102ef0 0x7f35d80fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:41.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:41.819+0000 7f35ddae4640 1 -- 172.21.15.37:0/145643885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35d8102ef0 msgr2=0x7f35d80fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:41.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:41.819+0000 7f35ddae4640 1 --2- 172.21.15.37:0/145643885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35d8102ef0 0x7f35d80fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:41.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:41.819+0000 7f35ddae4640 1 -- 172.21.15.37:0/145643885 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f35d8100e20 msgr2=0x7f35d80fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:41.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:41.819+0000 7f35ddae4640 1 --2- 172.21.15.37:0/145643885 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f35d8100e20 0x7f35d80fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:41.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:41.819+0000 7f35ddae4640 1 -- 172.21.15.37:0/145643885 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35d81a6970 con 0x7f35d8102570 2024-09-19T06:03:41.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:41.819+0000 7f35de2e5640 1 --2- 172.21.15.37:0/145643885 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f35d8100e20 0x7f35d80fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:03:41.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:41.820+0000 7f35ddae4640 1 --2- 172.21.15.37:0/145643885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35d8102570 0x7f35d80fd1c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f35d402aa70 tx=0x7f35d4003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:03:41.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:41.820+0000 7f35cf7fe640 1 -- 172.21.15.37:0/145643885 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d403f070 con 0x7f35d8102570 2024-09-19T06:03:41.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:41.820+0000 7f35e0549640 1 -- 172.21.15.37:0/145643885 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35d81a6c00 con 0x7f35d8102570 2024-09-19T06:03:41.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:41.820+0000 7f35cf7fe640 1 -- 172.21.15.37:0/145643885 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f35d4031c30 con 0x7f35d8102570 2024-09-19T06:03:41.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:41.820+0000 7f35cf7fe640 1 -- 172.21.15.37:0/145643885 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d4035030 con 0x7f35d8102570 2024-09-19T06:03:41.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:41.820+0000 7f35e0549640 1 -- 172.21.15.37:0/145643885 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35d81a7130 con 0x7f35d8102570 2024-09-19T06:03:41.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:41.821+0000 7f35e0549640 1 -- 172.21.15.37:0/145643885 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35d8101200 con 0x7f35d8102570 2024-09-19T06:03:41.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:41.823+0000 7f35cf7fe640 1 -- 172.21.15.37:0/145643885 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f35d4042070 con 0x7f35d8102570 2024-09-19T06:03:41.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:41.823+0000 7f35cf7fe640 1 --2- 172.21.15.37:0/145643885 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f35c40a3240 0x7f35c40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:41.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:41.824+0000 7f35de2e5640 1 --2- 172.21.15.37:0/145643885 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f35c40a3240 0x7f35c40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:41.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:41.824+0000 7f35cf7fe640 1 -- 172.21.15.37:0/145643885 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f35d40f0130 con 0x7f35d8102570 2024-09-19T06:03:41.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:41.824+0000 7f35de2e5640 1 --2- 172.21.15.37:0/145643885 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f35c40a3240 0x7f35c40a5700 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f35c8009fc0 tx=0x7f35c8005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:03:41.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:41.827+0000 7f35cf7fe640 1 -- 172.21.15.37:0/145643885 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f35d4031de0 con 0x7f35d8102570 2024-09-19T06:03:41.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:41 smithi099 ceph-mon[35300]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:03:41.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:41 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:41.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:41 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:41.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:41 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:41.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:41 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:03:41.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:41 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:03:41.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:41 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:41.940 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:41 smithi099 ceph-mon[35300]: Deploying daemon mds.h on smithi099 2024-09-19T06:03:41.940 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:41 smithi099 ceph-mon[35300]: mds.? [v2:172.21.15.117:6836/1001392672,v1:172.21.15.117:6837/1001392672] up:boot 2024-09-19T06:03:41.940 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:41 smithi099 ceph-mon[35300]: fsmap 7 up:standby 2024-09-19T06:03:41.940 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:41 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T06:03:42.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:41 smithi117 ceph-mon[35050]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:03:42.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:41 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:42.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:41 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:42.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:41 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:42.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:41 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:03:42.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:41 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:03:42.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:41 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:42.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:41 smithi117 ceph-mon[35050]: Deploying daemon mds.h on smithi099 2024-09-19T06:03:42.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:41 smithi117 ceph-mon[35050]: mds.? [v2:172.21.15.117:6836/1001392672,v1:172.21.15.117:6837/1001392672] up:boot 2024-09-19T06:03:42.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:41 smithi117 ceph-mon[35050]: fsmap 7 up:standby 2024-09-19T06:03:42.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:41 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T06:03:42.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:42.040+0000 7f35e0549640 1 -- 172.21.15.37:0/145643885 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f35d810a0a0 con 0x7f35d8102570 2024-09-19T06:03:42.042 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:41 smithi037 ceph-mon[31211]: Deploying daemon mds.h on smithi099 2024-09-19T06:03:42.042 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:41 smithi037 ceph-mon[31211]: mds.? [v2:172.21.15.117:6836/1001392672,v1:172.21.15.117:6837/1001392672] up:boot 2024-09-19T06:03:42.042 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:41 smithi037 ceph-mon[31211]: fsmap 7 up:standby 2024-09-19T06:03:42.043 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:41 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T06:03:42.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:42.040+0000 7f35cf7fe640 1 -- 172.21.15.37:0/145643885 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6388 (secure 0 0 0) 0x7f35d40bcca0 con 0x7f35d8102570 2024-09-19T06:03:42.043 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T06:03:42.043 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":8,"btime":"2024-09-19T06:03:41:156556+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14514,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2864247978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2864247978},{"type":"v1","addr":"172.21.15.37:6835","nonce":2864247978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14526,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/633000932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":633000932},{"type":"v1","addr":"172.21.15.37:6837","nonce":633000932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6833/866590207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":866590207},{"type":"v1","addr":"172.21.15.99:6833","nonce":866590207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3898668400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3898668400},{"type":"v1","addr":"172.21.15.117:6833","nonce":3898668400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2650673320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2650673320},{"type":"v1","addr":"172.21.15.99:6835","nonce":2650673320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1097471349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1097471349},{"type":"v1","addr":"172.21.15.117:6835","nonce":1097471349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24457,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1001392672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1001392672},{"type":"v1","addr":"172.21.15.117:6837","nonce":1001392672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-19T06:03:42.043 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 8 2024-09-19T06:03:42.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:42.043+0000 7f35e0549640 1 -- 172.21.15.37:0/145643885 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f35c40a3240 msgr2=0x7f35c40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:42.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:42.043+0000 7f35e0549640 1 --2- 172.21.15.37:0/145643885 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f35c40a3240 0x7f35c40a5700 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f35c8009fc0 tx=0x7f35c8005f90 comp rx=0 tx=0).stop 2024-09-19T06:03:42.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:42.043+0000 7f35e0549640 1 -- 172.21.15.37:0/145643885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35d8102570 msgr2=0x7f35d80fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:42.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:42.043+0000 7f35e0549640 1 --2- 172.21.15.37:0/145643885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35d8102570 0x7f35d80fd1c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f35d402aa70 tx=0x7f35d4003c10 comp rx=0 tx=0).stop 2024-09-19T06:03:42.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:42.043+0000 7f35e0549640 1 -- 172.21.15.37:0/145643885 shutdown_connections 2024-09-19T06:03:42.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:42.043+0000 7f35e0549640 1 --2- 172.21.15.37:0/145643885 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f35c40a3240 0x7f35c40a5700 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:42.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:42.043+0000 7f35e0549640 1 --2- 172.21.15.37:0/145643885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35d8102ef0 0x7f35d80fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:42.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:42.043+0000 7f35e0549640 1 --2- 172.21.15.37:0/145643885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35d8102570 0x7f35d80fd1c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:42.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:42.043+0000 7f35e0549640 1 --2- 172.21.15.37:0/145643885 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f35d8100e20 0x7f35d80fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:42.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:42.043+0000 7f35e0549640 1 -- 172.21.15.37:0/145643885 >> 172.21.15.37:0/145643885 conn(0x7f35d80fc7d0 msgr2=0x7f35d806a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:03:42.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:42.043+0000 7f35e0549640 1 -- 172.21.15.37:0/145643885 shutdown_connections 2024-09-19T06:03:42.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:42.043+0000 7f35e0549640 1 -- 172.21.15.37:0/145643885 wait complete. 2024-09-19T06:03:42.934 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:42 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/145643885' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:03:42.934 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 06:03:42 smithi099 systemd[1]: Starting Ceph mds.h for b8c8bdae-764b-11ef-bceb-c7b262605968... 2024-09-19T06:03:43.001 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:42 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/145643885' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:03:43.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:42 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/145643885' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:03:43.189 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 06:03:42 smithi099 podman[65037]: 2024-09-19 06:03:42.835120042 +0000 UTC m=+0.015953328 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:03:43.189 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 06:03:42 smithi099 podman[65037]: 2024-09-19 06:03:42.951116969 +0000 UTC m=+0.131950285 container create 991db6a336b61eec54b69cc6b982007387547c628bb3b422f21c057082e47ff6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-h, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-19T06:03:43.189 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 06:03:43 smithi099 podman[65037]: 2024-09-19 06:03:43.179334362 +0000 UTC m=+0.360167635 container init 991db6a336b61eec54b69cc6b982007387547c628bb3b422f21c057082e47ff6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-h, ceph=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-19T06:03:43.189 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 06:03:43 smithi099 podman[65037]: 2024-09-19 06:03:43.182036459 +0000 UTC m=+0.362869748 container start 991db6a336b61eec54b69cc6b982007387547c628bb3b422f21c057082e47ff6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-h, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True) 2024-09-19T06:03:43.689 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 06:03:43 smithi099 ceph-mds[65056]: -- 172.21.15.99:0/1467291429 <== mon.2 v2:172.21.15.99:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f8cb49f860 con 0x55f8cb47d400 2024-09-19T06:03:43.689 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 06:03:43 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-h[65052]: starting mds.h at 2024-09-19T06:03:43.689 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 06:03:43 smithi099 bash[65037]: 991db6a336b61eec54b69cc6b982007387547c628bb3b422f21c057082e47ff6 2024-09-19T06:03:43.689 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 06:03:43 smithi099 systemd[1]: Started Ceph mds.h for b8c8bdae-764b-11ef-bceb-c7b262605968. 2024-09-19T06:03:44.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:44 smithi099 ceph-mon[35300]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:03:44.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:44 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:44.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:44 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:44.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:44 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:44.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:44 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:03:44.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:44 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:03:44.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:44 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:44.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:44 smithi099 ceph-mon[35300]: Deploying daemon mds.i on smithi117 2024-09-19T06:03:44.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:44 smithi099 ceph-mon[35300]: mds.? [v2:172.21.15.99:6836/23570935,v1:172.21.15.99:6837/23570935] up:boot 2024-09-19T06:03:44.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:44 smithi099 ceph-mon[35300]: fsmap 8 up:standby 2024-09-19T06:03:44.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:44 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T06:03:44.726 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:44 smithi037 ceph-mon[31211]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:03:44.726 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:44 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:44.726 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:44 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:44.726 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:44 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:44.726 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:44 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:03:44.726 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:44 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:03:44.726 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:44 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:44.726 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:44 smithi037 ceph-mon[31211]: Deploying daemon mds.i on smithi117 2024-09-19T06:03:44.726 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:44 smithi037 ceph-mon[31211]: mds.? [v2:172.21.15.99:6836/23570935,v1:172.21.15.99:6837/23570935] up:boot 2024-09-19T06:03:44.726 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:44 smithi037 ceph-mon[31211]: fsmap 8 up:standby 2024-09-19T06:03:44.726 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:44 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T06:03:44.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:44 smithi117 ceph-mon[35050]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:03:44.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:44 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:44.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:44 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:44.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:44 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:44.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:44 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:03:44.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:44 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:03:44.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:44 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:44.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:44 smithi117 ceph-mon[35050]: Deploying daemon mds.i on smithi117 2024-09-19T06:03:44.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:44 smithi117 ceph-mon[35050]: mds.? [v2:172.21.15.99:6836/23570935,v1:172.21.15.99:6837/23570935] up:boot 2024-09-19T06:03:44.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:44 smithi117 ceph-mon[35050]: fsmap 8 up:standby 2024-09-19T06:03:44.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:44 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T06:03:44.798 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:03:45.072 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:03:45.444 INFO:journalctl@ceph.mds.i.smithi117.stdout:Sep 19 06:03:45 smithi117 systemd[1]: Starting Ceph mds.i for b8c8bdae-764b-11ef-bceb-c7b262605968... 2024-09-19T06:03:45.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:45.578+0000 7fdb1026c640 1 -- 172.21.15.37:0/2863609138 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb08101280 msgr2=0x7fdb0810df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:45.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:45.578+0000 7fdb1026c640 1 --2- 172.21.15.37:0/2863609138 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb08101280 0x7fdb0810df40 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fdaf8009900 tx=0x7fdaf802a410 comp rx=0 tx=0).stop 2024-09-19T06:03:45.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:45.578+0000 7fdb1026c640 1 -- 172.21.15.37:0/2863609138 shutdown_connections 2024-09-19T06:03:45.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:45.578+0000 7fdb1026c640 1 --2- 172.21.15.37:0/2863609138 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb0810e480 0x7fdb08110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:45.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:45.578+0000 7fdb1026c640 1 --2- 172.21.15.37:0/2863609138 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb08101280 0x7fdb0810df40 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:45.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:45.578+0000 7fdb1026c640 1 --2- 172.21.15.37:0/2863609138 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdb081008d0 0x7fdb08100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:45.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:45.578+0000 7fdb1026c640 1 -- 172.21.15.37:0/2863609138 >> 172.21.15.37:0/2863609138 conn(0x7fdb080fc7a0 msgr2=0x7fdb080febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:03:45.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:45.578+0000 7fdb1026c640 1 -- 172.21.15.37:0/2863609138 shutdown_connections 2024-09-19T06:03:45.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:45.578+0000 7fdb1026c640 1 -- 172.21.15.37:0/2863609138 wait complete. 2024-09-19T06:03:45.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:45.578+0000 7fdb1026c640 1 Processor -- start 2024-09-19T06:03:45.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:45.578+0000 7fdb1026c640 1 -- start start 2024-09-19T06:03:45.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:45.579+0000 7fdb1026c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb081008d0 0x7fdb081a0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:45.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:45.579+0000 7fdb1026c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdb08101280 0x7fdb081a0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:45.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:45.579+0000 7fdb1026c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb0810e480 0x7fdb0819a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:45.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:45.579+0000 7fdb1026c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdb08114220 con 0x7fdb081008d0 2024-09-19T06:03:45.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:45.579+0000 7fdb1026c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fdb081140a0 con 0x7fdb08101280 2024-09-19T06:03:45.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:45.579+0000 7fdb1026c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fdb081143a0 con 0x7fdb0810e480 2024-09-19T06:03:45.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:45.579+0000 7fdb0e008640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb081008d0 0x7fdb081a0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:45.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:45.579+0000 7fdb0e008640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb081008d0 0x7fdb081a0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56812/0 (socket says 172.21.15.37:56812) 2024-09-19T06:03:45.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:45.579+0000 7fdb0e008640 1 -- 172.21.15.37:0/4041997034 learned_addr learned my addr 172.21.15.37:0/4041997034 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:03:45.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:45.579+0000 7fdb0e809640 1 --2- 172.21.15.37:0/4041997034 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb0810e480 0x7fdb0819a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:45.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:45.579+0000 7fdb0d807640 1 --2- 172.21.15.37:0/4041997034 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdb08101280 0x7fdb081a0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:45.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:45.579+0000 7fdb0e008640 1 -- 172.21.15.37:0/4041997034 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb0810e480 msgr2=0x7fdb0819a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:45.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:45.579+0000 7fdb0e008640 1 --2- 172.21.15.37:0/4041997034 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb0810e480 0x7fdb0819a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:45.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:45.579+0000 7fdb0e008640 1 -- 172.21.15.37:0/4041997034 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdb08101280 msgr2=0x7fdb081a0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:45.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:45.579+0000 7fdb0e008640 1 --2- 172.21.15.37:0/4041997034 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdb08101280 0x7fdb081a0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:45.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:45.579+0000 7fdb0e008640 1 -- 172.21.15.37:0/4041997034 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb0819ad00 con 0x7fdb081008d0 2024-09-19T06:03:45.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:45.579+0000 7fdb0e809640 1 --2- 172.21.15.37:0/4041997034 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb0810e480 0x7fdb0819a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:03:45.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:45.579+0000 7fdb0d807640 1 --2- 172.21.15.37:0/4041997034 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdb08101280 0x7fdb081a0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:03:45.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:45.579+0000 7fdb0e008640 1 --2- 172.21.15.37:0/4041997034 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb081008d0 0x7fdb081a0410 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fdb0400b4a0 tx=0x7fdb0400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:03:45.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:45.579+0000 7fdaff7fe640 1 -- 172.21.15.37:0/4041997034 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb04014070 con 0x7fdb081008d0 2024-09-19T06:03:45.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:45.580+0000 7fdaff7fe640 1 -- 172.21.15.37:0/4041997034 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb04010af0 con 0x7fdb081008d0 2024-09-19T06:03:45.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:45.580+0000 7fdb1026c640 1 -- 172.21.15.37:0/4041997034 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb0819aff0 con 0x7fdb081008d0 2024-09-19T06:03:45.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:45.580+0000 7fdaff7fe640 1 -- 172.21.15.37:0/4041997034 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb04017d10 con 0x7fdb081008d0 2024-09-19T06:03:45.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:45.580+0000 7fdb1026c640 1 -- 172.21.15.37:0/4041997034 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb081a72e0 con 0x7fdb081008d0 2024-09-19T06:03:45.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:45.580+0000 7fdb1026c640 1 -- 172.21.15.37:0/4041997034 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb08100cb0 con 0x7fdb081008d0 2024-09-19T06:03:45.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:45.582+0000 7fdaff7fe640 1 -- 172.21.15.37:0/4041997034 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fdb04017070 con 0x7fdb081008d0 2024-09-19T06:03:45.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:45.583+0000 7fdaff7fe640 1 --2- 172.21.15.37:0/4041997034 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fdaf40a3240 0x7fdaf40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:45.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:45.583+0000 7fdb0d807640 1 --2- 172.21.15.37:0/4041997034 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fdaf40a3240 0x7fdaf40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:45.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:45.583+0000 7fdaff7fe640 1 -- 172.21.15.37:0/4041997034 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fdb040ce8f0 con 0x7fdb081008d0 2024-09-19T06:03:45.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:45.583+0000 7fdb0d807640 1 --2- 172.21.15.37:0/4041997034 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fdaf40a3240 0x7fdaf40a5700 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fdb0819b710 tx=0x7fdaf8005a20 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:03:45.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:45.587+0000 7fdaff7fe640 1 -- 172.21.15.37:0/4041997034 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdb0409bab0 con 0x7fdb081008d0 2024-09-19T06:03:45.705 INFO:journalctl@ceph.mds.i.smithi117.stdout:Sep 19 06:03:45 smithi117 podman[64825]: 2024-09-19 06:03:45.345775743 +0000 UTC m=+0.015866574 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:03:45.705 INFO:journalctl@ceph.mds.i.smithi117.stdout:Sep 19 06:03:45 smithi117 podman[64825]: 2024-09-19 06:03:45.459942288 +0000 UTC m=+0.130033106 container create c4a6e6593f4bb61940233e307e1ef9093e6ace9c51c3e716ad2d28da583bd5cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-i, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-19T06:03:45.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:45.802+0000 7fdb1026c640 1 -- 172.21.15.37:0/4041997034 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdb08109670 con 0x7fdb081008d0 2024-09-19T06:03:45.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:45.803+0000 7fdaff7fe640 1 -- 172.21.15.37:0/4041997034 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7207 (secure 0 0 0) 0x7fdb0409b3b0 con 0x7fdb081008d0 2024-09-19T06:03:45.805 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T06:03:45.805 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":9,"btime":"2024-09-19T06:03:43:662764+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14514,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2864247978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2864247978},{"type":"v1","addr":"172.21.15.37:6835","nonce":2864247978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14526,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/633000932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":633000932},{"type":"v1","addr":"172.21.15.37:6837","nonce":633000932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6833/866590207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":866590207},{"type":"v1","addr":"172.21.15.99:6833","nonce":866590207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3898668400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3898668400},{"type":"v1","addr":"172.21.15.117:6833","nonce":3898668400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2650673320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2650673320},{"type":"v1","addr":"172.21.15.99:6835","nonce":2650673320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1097471349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1097471349},{"type":"v1","addr":"172.21.15.117:6835","nonce":1097471349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24457,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1001392672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1001392672},{"type":"v1","addr":"172.21.15.117:6837","nonce":1001392672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/23570935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":23570935},{"type":"v1","addr":"172.21.15.99:6837","nonce":23570935}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-19T06:03:45.805 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 9 2024-09-19T06:03:45.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:45.805+0000 7fdb1026c640 1 -- 172.21.15.37:0/4041997034 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fdaf40a3240 msgr2=0x7fdaf40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:45.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:45.805+0000 7fdb1026c640 1 --2- 172.21.15.37:0/4041997034 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fdaf40a3240 0x7fdaf40a5700 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fdb0819b710 tx=0x7fdaf8005a20 comp rx=0 tx=0).stop 2024-09-19T06:03:45.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:45.805+0000 7fdb1026c640 1 -- 172.21.15.37:0/4041997034 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb081008d0 msgr2=0x7fdb081a0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:45.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:45.805+0000 7fdb1026c640 1 --2- 172.21.15.37:0/4041997034 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb081008d0 0x7fdb081a0410 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fdb0400b4a0 tx=0x7fdb0400b960 comp rx=0 tx=0).stop 2024-09-19T06:03:45.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:45.805+0000 7fdb1026c640 1 -- 172.21.15.37:0/4041997034 shutdown_connections 2024-09-19T06:03:45.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:45.805+0000 7fdb1026c640 1 --2- 172.21.15.37:0/4041997034 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fdaf40a3240 0x7fdaf40a5700 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:45.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:45.805+0000 7fdb1026c640 1 --2- 172.21.15.37:0/4041997034 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdb08101280 0x7fdb081a0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:45.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:45.805+0000 7fdb1026c640 1 --2- 172.21.15.37:0/4041997034 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb0810e480 0x7fdb0819a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:45.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:45.805+0000 7fdb1026c640 1 --2- 172.21.15.37:0/4041997034 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb081008d0 0x7fdb081a0410 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:45.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:45.805+0000 7fdb1026c640 1 -- 172.21.15.37:0/4041997034 >> 172.21.15.37:0/4041997034 conn(0x7fdb080fc7a0 msgr2=0x7fdb080feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:03:45.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:45.805+0000 7fdb1026c640 1 -- 172.21.15.37:0/4041997034 shutdown_connections 2024-09-19T06:03:45.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:45.805+0000 7fdb1026c640 1 -- 172.21.15.37:0/4041997034 wait complete. 2024-09-19T06:03:46.000 INFO:journalctl@ceph.mds.i.smithi117.stdout:Sep 19 06:03:45 smithi117 podman[64825]: 2024-09-19 06:03:45.70456558 +0000 UTC m=+0.374656400 container init c4a6e6593f4bb61940233e307e1ef9093e6ace9c51c3e716ad2d28da583bd5cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-i, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-19T06:03:46.000 INFO:journalctl@ceph.mds.i.smithi117.stdout:Sep 19 06:03:45 smithi117 podman[64825]: 2024-09-19 06:03:45.707377676 +0000 UTC m=+0.377468502 container start c4a6e6593f4bb61940233e307e1ef9093e6ace9c51c3e716ad2d28da583bd5cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-i, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-19T06:03:46.000 INFO:journalctl@ceph.mds.i.smithi117.stdout:Sep 19 06:03:45 smithi117 ceph-mds[64844]: -- 172.21.15.117:0/1638417758 <== mon.1 v2:172.21.15.117:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55948aa71860 con 0x55948aa4e800 2024-09-19T06:03:46.000 INFO:journalctl@ceph.mds.i.smithi117.stdout:Sep 19 06:03:45 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-i[64840]: starting mds.i at 2024-09-19T06:03:46.000 INFO:journalctl@ceph.mds.i.smithi117.stdout:Sep 19 06:03:45 smithi117 bash[64825]: c4a6e6593f4bb61940233e307e1ef9093e6ace9c51c3e716ad2d28da583bd5cf 2024-09-19T06:03:46.000 INFO:journalctl@ceph.mds.i.smithi117.stdout:Sep 19 06:03:45 smithi117 systemd[1]: Started Ceph mds.i for b8c8bdae-764b-11ef-bceb-c7b262605968. 2024-09-19T06:03:46.502 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:46 smithi037 ceph-mon[31211]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:03:46.502 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:46 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/4041997034' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:03:46.502 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:46 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:46.502 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:46 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:46.502 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:46 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:46.503 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:46 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:03:46.503 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:46 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:03:46.503 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:46 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:46.688 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:46 smithi099 ceph-mon[35300]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:03:46.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:46 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/4041997034' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:03:46.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:46 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:46.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:46 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:46.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:46 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:46.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:46 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:03:46.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:46 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:03:46.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:46 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:46.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:46 smithi117 ceph-mon[35050]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:03:46.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:46 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/4041997034' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:03:46.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:46 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:46.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:46 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:46.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:46 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:46.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:46 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:03:46.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:46 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:03:46.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:46 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:47.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:47 smithi099 ceph-mon[35300]: Deploying daemon mds.g on smithi037 2024-09-19T06:03:47.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:47 smithi099 ceph-mon[35300]: mds.? [v2:172.21.15.117:6838/1269518339,v1:172.21.15.117:6839/1269518339] up:boot 2024-09-19T06:03:47.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:47 smithi099 ceph-mon[35300]: fsmap 9 up:standby 2024-09-19T06:03:47.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:47 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T06:03:47.749 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:47 smithi117 ceph-mon[35050]: Deploying daemon mds.g on smithi037 2024-09-19T06:03:47.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:47 smithi117 ceph-mon[35050]: mds.? [v2:172.21.15.117:6838/1269518339,v1:172.21.15.117:6839/1269518339] up:boot 2024-09-19T06:03:47.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:47 smithi117 ceph-mon[35050]: fsmap 9 up:standby 2024-09-19T06:03:47.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:47 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T06:03:47.777 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:47 smithi037 ceph-mon[31211]: Deploying daemon mds.g on smithi037 2024-09-19T06:03:47.777 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:47 smithi037 ceph-mon[31211]: mds.? [v2:172.21.15.117:6838/1269518339,v1:172.21.15.117:6839/1269518339] up:boot 2024-09-19T06:03:47.777 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:47 smithi037 ceph-mon[31211]: fsmap 9 up:standby 2024-09-19T06:03:47.777 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:47 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T06:03:48.358 INFO:journalctl@ceph.mds.g.smithi037.stdout:Sep 19 06:03:48 smithi037 systemd[1]: Starting Ceph mds.g for b8c8bdae-764b-11ef-bceb-c7b262605968... 2024-09-19T06:03:48.531 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:03:48.668 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:48 smithi037 ceph-mon[31211]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:03:48.668 INFO:journalctl@ceph.mds.g.smithi037.stdout:Sep 19 06:03:48 smithi037 podman[69099]: 2024-09-19 06:03:48.394319012 +0000 UTC m=+0.016818078 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:03:48.668 INFO:journalctl@ceph.mds.g.smithi037.stdout:Sep 19 06:03:48 smithi037 podman[69099]: 2024-09-19 06:03:48.545161201 +0000 UTC m=+0.167660261 container create 303106ce620b3d0cd3f1325aa6d7d04ad5fd3d0e6a2bead8a89dd76b14c1012c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-g, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-19T06:03:48.688 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:48 smithi099 ceph-mon[35300]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:03:48.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:48 smithi117 ceph-mon[35050]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:03:48.981 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:03:49.105 INFO:journalctl@ceph.mds.g.smithi037.stdout:Sep 19 06:03:48 smithi037 podman[69099]: 2024-09-19 06:03:48.823428521 +0000 UTC m=+0.445927582 container init 303106ce620b3d0cd3f1325aa6d7d04ad5fd3d0e6a2bead8a89dd76b14c1012c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-g, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True) 2024-09-19T06:03:49.105 INFO:journalctl@ceph.mds.g.smithi037.stdout:Sep 19 06:03:48 smithi037 podman[69099]: 2024-09-19 06:03:48.826834623 +0000 UTC m=+0.449333684 container start 303106ce620b3d0cd3f1325aa6d7d04ad5fd3d0e6a2bead8a89dd76b14c1012c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-g, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, ceph=True) 2024-09-19T06:03:49.105 INFO:journalctl@ceph.mds.g.smithi037.stdout:Sep 19 06:03:48 smithi037 ceph-mds[69149]: -- 172.21.15.37:0/1967885729 <== mon.0 v2:172.21.15.37:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559bae8ab860 con 0x559bae889000 2024-09-19T06:03:49.105 INFO:journalctl@ceph.mds.g.smithi037.stdout:Sep 19 06:03:48 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-g[69132]: starting mds.g at 2024-09-19T06:03:49.105 INFO:journalctl@ceph.mds.g.smithi037.stdout:Sep 19 06:03:48 smithi037 bash[69099]: 303106ce620b3d0cd3f1325aa6d7d04ad5fd3d0e6a2bead8a89dd76b14c1012c 2024-09-19T06:03:49.105 INFO:journalctl@ceph.mds.g.smithi037.stdout:Sep 19 06:03:48 smithi037 systemd[1]: Started Ceph mds.g for b8c8bdae-764b-11ef-bceb-c7b262605968. 2024-09-19T06:03:49.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:49.485+0000 7f314924f640 1 -- 172.21.15.37:0/1872531064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3144101de0 msgr2=0x7f31441021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:49.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:49.485+0000 7f314924f640 1 --2- 172.21.15.37:0/1872531064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3144101de0 0x7f31441021c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3134009900 tx=0x7f313402a410 comp rx=0 tx=0).stop 2024-09-19T06:03:49.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:49.485+0000 7f314924f640 1 -- 172.21.15.37:0/1872531064 shutdown_connections 2024-09-19T06:03:49.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:49.485+0000 7f314924f640 1 --2- 172.21.15.37:0/1872531064 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3144106f10 0x7f314410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:49.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:49.485+0000 7f314924f640 1 --2- 172.21.15.37:0/1872531064 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3144102790 0x7f31441067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:49.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:49.485+0000 7f314924f640 1 --2- 172.21.15.37:0/1872531064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3144101de0 0x7f31441021c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:49.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:49.485+0000 7f314924f640 1 -- 172.21.15.37:0/1872531064 >> 172.21.15.37:0/1872531064 conn(0x7f31440fd8c0 msgr2=0x7f31440ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:03:49.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:49.485+0000 7f314924f640 1 -- 172.21.15.37:0/1872531064 shutdown_connections 2024-09-19T06:03:49.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:49.485+0000 7f314924f640 1 -- 172.21.15.37:0/1872531064 wait complete. 2024-09-19T06:03:49.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:49.486+0000 7f314924f640 1 Processor -- start 2024-09-19T06:03:49.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:49.486+0000 7f314924f640 1 -- start start 2024-09-19T06:03:49.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:49.487+0000 7f314924f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3144101de0 0x7f314419a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:49.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:49.487+0000 7f314924f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3144102790 0x7f314419ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:49.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:49.487+0000 7f314924f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3144106f10 0x7f314419ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:49.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:49.487+0000 7f314924f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3144111f70 con 0x7f3144101de0 2024-09-19T06:03:49.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:49.487+0000 7f314924f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f3144111df0 con 0x7f3144106f10 2024-09-19T06:03:49.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:49.487+0000 7f314924f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f31441120f0 con 0x7f3144102790 2024-09-19T06:03:49.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:49.487+0000 7f3142d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3144101de0 0x7f314419a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:49.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:49.487+0000 7f3142d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3144101de0 0x7f314419a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56848/0 (socket says 172.21.15.37:56848) 2024-09-19T06:03:49.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:49.487+0000 7f3142d9d640 1 -- 172.21.15.37:0/3055263096 learned_addr learned my addr 172.21.15.37:0/3055263096 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:03:49.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:49.487+0000 7f314359e640 1 --2- 172.21.15.37:0/3055263096 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3144106f10 0x7f314419ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:49.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:49.487+0000 7f314259c640 1 --2- 172.21.15.37:0/3055263096 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3144102790 0x7f314419ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:49.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:49.487+0000 7f3142d9d640 1 -- 172.21.15.37:0/3055263096 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3144102790 msgr2=0x7f314419ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:49.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:49.487+0000 7f3142d9d640 1 --2- 172.21.15.37:0/3055263096 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3144102790 0x7f314419ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:49.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:49.487+0000 7f3142d9d640 1 -- 172.21.15.37:0/3055263096 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3144106f10 msgr2=0x7f314419ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:49.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:49.487+0000 7f3142d9d640 1 --2- 172.21.15.37:0/3055263096 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3144106f10 0x7f314419ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:49.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:49.487+0000 7f3142d9d640 1 -- 172.21.15.37:0/3055263096 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f314419f620 con 0x7f3144101de0 2024-09-19T06:03:49.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:49.487+0000 7f314259c640 1 --2- 172.21.15.37:0/3055263096 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3144102790 0x7f314419ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:03:49.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:49.487+0000 7f3142d9d640 1 --2- 172.21.15.37:0/3055263096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3144101de0 0x7f314419a710 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3134006010 tx=0x7f31340042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:03:49.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:49.487+0000 7f312bfff640 1 -- 172.21.15.37:0/3055263096 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f313403f030 con 0x7f3144101de0 2024-09-19T06:03:49.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:49.488+0000 7f312bfff640 1 -- 172.21.15.37:0/3055263096 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3134003ce0 con 0x7f3144101de0 2024-09-19T06:03:49.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:49.488+0000 7f314924f640 1 -- 172.21.15.37:0/3055263096 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f314419f8b0 con 0x7f3144101de0 2024-09-19T06:03:49.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:49.488+0000 7f312bfff640 1 -- 172.21.15.37:0/3055263096 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3134035070 con 0x7f3144101de0 2024-09-19T06:03:49.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:49.488+0000 7f314924f640 1 -- 172.21.15.37:0/3055263096 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31441a71f0 con 0x7f3144101de0 2024-09-19T06:03:49.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:49.489+0000 7f314924f640 1 -- 172.21.15.37:0/3055263096 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31441021c0 con 0x7f3144101de0 2024-09-19T06:03:49.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:49.490+0000 7f312bfff640 1 -- 172.21.15.37:0/3055263096 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f3134042030 con 0x7f3144101de0 2024-09-19T06:03:49.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:49.490+0000 7f312bfff640 1 --2- 172.21.15.37:0/3055263096 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f312c0a3240 0x7f312c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:49.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:49.490+0000 7f314259c640 1 --2- 172.21.15.37:0/3055263096 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f312c0a3240 0x7f312c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:49.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:49.490+0000 7f312bfff640 1 -- 172.21.15.37:0/3055263096 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f31340ef9d0 con 0x7f3144101de0 2024-09-19T06:03:49.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:49.491+0000 7f314259c640 1 --2- 172.21.15.37:0/3055263096 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f312c0a3240 0x7f312c0a5700 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f314410eee0 tx=0x7f3138005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:03:49.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:49.495+0000 7f312bfff640 1 -- 172.21.15.37:0/3055263096 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f31340bcc50 con 0x7f3144101de0 2024-09-19T06:03:49.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:49.712+0000 7f314924f640 1 -- 172.21.15.37:0/3055263096 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f31441a73c0 con 0x7f3144101de0 2024-09-19T06:03:49.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:49.713+0000 7f312bfff640 1 -- 172.21.15.37:0/3055263096 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8863 (secure 0 0 0) 0x7f31340bc550 con 0x7f3144101de0 2024-09-19T06:03:49.715 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T06:03:49.715 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":11,"btime":"2024-09-19T06:03:49:357550+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14514,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2864247978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2864247978},{"type":"v1","addr":"172.21.15.37:6835","nonce":2864247978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14526,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/633000932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":633000932},{"type":"v1","addr":"172.21.15.37:6837","nonce":633000932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14574,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/3753800615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":3753800615},{"type":"v1","addr":"172.21.15.37:6839","nonce":3753800615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6833/866590207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":866590207},{"type":"v1","addr":"172.21.15.99:6833","nonce":866590207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3898668400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3898668400},{"type":"v1","addr":"172.21.15.117:6833","nonce":3898668400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2650673320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2650673320},{"type":"v1","addr":"172.21.15.99:6835","nonce":2650673320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1097471349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1097471349},{"type":"v1","addr":"172.21.15.117:6835","nonce":1097471349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24457,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1001392672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1001392672},{"type":"v1","addr":"172.21.15.117:6837","nonce":1001392672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/23570935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":23570935},{"type":"v1","addr":"172.21.15.99:6837","nonce":23570935}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24478,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6839/1269518339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":1269518339},{"type":"v1","addr":"172.21.15.117:6839","nonce":1269518339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-19T06:03:49.715 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 11 2024-09-19T06:03:49.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:49.715+0000 7f314924f640 1 -- 172.21.15.37:0/3055263096 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f312c0a3240 msgr2=0x7f312c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:49.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:49.715+0000 7f314924f640 1 --2- 172.21.15.37:0/3055263096 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f312c0a3240 0x7f312c0a5700 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f314410eee0 tx=0x7f3138005f90 comp rx=0 tx=0).stop 2024-09-19T06:03:49.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:49.715+0000 7f314924f640 1 -- 172.21.15.37:0/3055263096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3144101de0 msgr2=0x7f314419a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:49.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:49.715+0000 7f314924f640 1 --2- 172.21.15.37:0/3055263096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3144101de0 0x7f314419a710 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3134006010 tx=0x7f31340042f0 comp rx=0 tx=0).stop 2024-09-19T06:03:49.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:49.715+0000 7f314924f640 1 -- 172.21.15.37:0/3055263096 shutdown_connections 2024-09-19T06:03:49.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:49.715+0000 7f314924f640 1 --2- 172.21.15.37:0/3055263096 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f312c0a3240 0x7f312c0a5700 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:49.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:49.715+0000 7f314924f640 1 --2- 172.21.15.37:0/3055263096 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3144106f10 0x7f314419ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:49.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:49.715+0000 7f314924f640 1 --2- 172.21.15.37:0/3055263096 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3144102790 0x7f314419ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:49.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:49.715+0000 7f314924f640 1 --2- 172.21.15.37:0/3055263096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3144101de0 0x7f314419a710 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:49.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:49.715+0000 7f314924f640 1 -- 172.21.15.37:0/3055263096 >> 172.21.15.37:0/3055263096 conn(0x7f31440fd8c0 msgr2=0x7f31440fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:03:49.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:49.715+0000 7f314924f640 1 -- 172.21.15.37:0/3055263096 shutdown_connections 2024-09-19T06:03:49.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:49.715+0000 7f314924f640 1 -- 172.21.15.37:0/3055263096 wait complete. 2024-09-19T06:03:50.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:49 smithi117 ceph-mon[35050]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:03:50.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:49 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:50.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:49 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:50.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:49 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:50.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:49 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:03:50.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:49 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:03:50.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:49 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:50.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:49 smithi117 ceph-mon[35050]: Deploying daemon mds.a on smithi037 2024-09-19T06:03:50.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:49 smithi117 ceph-mon[35050]: mds.? [v2:172.21.15.37:6838/3753800615,v1:172.21.15.37:6839/3753800615] up:boot 2024-09-19T06:03:50.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:49 smithi117 ceph-mon[35050]: fsmap 10 up:standby 2024-09-19T06:03:50.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:49 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T06:03:50.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:49 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/3055263096' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:03:50.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:49 smithi037 ceph-mon[31211]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:03:50.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:49 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:50.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:49 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:50.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:49 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:50.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:49 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:03:50.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:49 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:03:50.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:49 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:50.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:49 smithi037 ceph-mon[31211]: Deploying daemon mds.a on smithi037 2024-09-19T06:03:50.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:49 smithi037 ceph-mon[31211]: mds.? [v2:172.21.15.37:6838/3753800615,v1:172.21.15.37:6839/3753800615] up:boot 2024-09-19T06:03:50.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:49 smithi037 ceph-mon[31211]: fsmap 10 up:standby 2024-09-19T06:03:50.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:49 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T06:03:50.325 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:49 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/3055263096' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:03:50.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:49 smithi099 ceph-mon[35300]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:03:50.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:49 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:50.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:49 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:50.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:49 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:50.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:49 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:03:50.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:49 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:03:50.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:49 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:50.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:49 smithi099 ceph-mon[35300]: Deploying daemon mds.a on smithi037 2024-09-19T06:03:50.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:49 smithi099 ceph-mon[35300]: mds.? [v2:172.21.15.37:6838/3753800615,v1:172.21.15.37:6839/3753800615] up:boot 2024-09-19T06:03:50.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:49 smithi099 ceph-mon[35300]: fsmap 10 up:standby 2024-09-19T06:03:50.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:49 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T06:03:50.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:49 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/3055263096' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:03:51.987 INFO:journalctl@ceph.mds.a.smithi037.stdout:Sep 19 06:03:51 smithi037 systemd[1]: Starting Ceph mds.a for b8c8bdae-764b-11ef-bceb-c7b262605968... 2024-09-19T06:03:52.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:51 smithi117 ceph-mon[35050]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:03:52.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:51 smithi037 ceph-mon[31211]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:03:52.324 INFO:journalctl@ceph.mds.a.smithi037.stdout:Sep 19 06:03:52 smithi037 podman[69516]: 2024-09-19 06:03:51.966838804 +0000 UTC m=+0.016589747 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:03:52.324 INFO:journalctl@ceph.mds.a.smithi037.stdout:Sep 19 06:03:52 smithi037 podman[69516]: 2024-09-19 06:03:52.077114736 +0000 UTC m=+0.126865708 container create 2e1b94af7032ec193b25dd92e93b39a9b2d379b3255ea0a3a841e4876067657a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-a, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:03:52.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:51 smithi099 ceph-mon[35300]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:03:52.593 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:03:52.618 INFO:journalctl@ceph.mds.a.smithi037.stdout:Sep 19 06:03:52 smithi037 podman[69516]: 2024-09-19 06:03:52.346139237 +0000 UTC m=+0.395890179 container init 2e1b94af7032ec193b25dd92e93b39a9b2d379b3255ea0a3a841e4876067657a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-a, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-19T06:03:52.618 INFO:journalctl@ceph.mds.a.smithi037.stdout:Sep 19 06:03:52 smithi037 podman[69516]: 2024-09-19 06:03:52.349192127 +0000 UTC m=+0.398943055 container start 2e1b94af7032ec193b25dd92e93b39a9b2d379b3255ea0a3a841e4876067657a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-19T06:03:52.618 INFO:journalctl@ceph.mds.a.smithi037.stdout:Sep 19 06:03:52 smithi037 ceph-mds[69535]: -- 172.21.15.37:0/2872866496 <== mon.0 v2:172.21.15.37:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5565782f3860 con 0x5565782d0800 2024-09-19T06:03:52.619 INFO:journalctl@ceph.mds.a.smithi037.stdout:Sep 19 06:03:52 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-a[69531]: starting mds.a at 2024-09-19T06:03:52.619 INFO:journalctl@ceph.mds.a.smithi037.stdout:Sep 19 06:03:52 smithi037 bash[69516]: 2e1b94af7032ec193b25dd92e93b39a9b2d379b3255ea0a3a841e4876067657a 2024-09-19T06:03:52.619 INFO:journalctl@ceph.mds.a.smithi037.stdout:Sep 19 06:03:52 smithi037 systemd[1]: Started Ceph mds.a for b8c8bdae-764b-11ef-bceb-c7b262605968. 2024-09-19T06:03:52.855 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:03:53.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:53.358+0000 7f3de3500640 1 -- 172.21.15.37:0/3231214470 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ddc108300 msgr2=0x7f3ddc10ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:53.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:53.358+0000 7f3de3500640 1 --2- 172.21.15.37:0/3231214470 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ddc108300 0x7f3ddc10ec70 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc009cd0 tx=0x7f3dcc02a8d0 comp rx=0 tx=0).stop 2024-09-19T06:03:53.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:53.358+0000 7f3de3500640 1 -- 172.21.15.37:0/3231214470 shutdown_connections 2024-09-19T06:03:53.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:53.358+0000 7f3de3500640 1 --2- 172.21.15.37:0/3231214470 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ddc108300 0x7f3ddc10ec70 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:53.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:53.358+0000 7f3de3500640 1 --2- 172.21.15.37:0/3231214470 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ddc103780 0x7f3ddc107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:53.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:53.358+0000 7f3de3500640 1 --2- 172.21.15.37:0/3231214470 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ddc102dd0 0x7f3ddc1031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:53.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:53.358+0000 7f3de3500640 1 -- 172.21.15.37:0/3231214470 >> 172.21.15.37:0/3231214470 conn(0x7f3ddc0fc7d0 msgr2=0x7f3ddc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:03:53.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:53.358+0000 7f3de3500640 1 -- 172.21.15.37:0/3231214470 shutdown_connections 2024-09-19T06:03:53.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:53.358+0000 7f3de3500640 1 -- 172.21.15.37:0/3231214470 wait complete. 2024-09-19T06:03:53.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:53.359+0000 7f3de3500640 1 Processor -- start 2024-09-19T06:03:53.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:53.359+0000 7f3de3500640 1 -- start start 2024-09-19T06:03:53.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:53.359+0000 7f3de3500640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ddc102dd0 0x7f3ddc198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:53.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:53.359+0000 7f3de3500640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ddc103780 0x7f3ddc198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:53.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:53.359+0000 7f3de3500640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ddc108300 0x7f3ddc19ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:53.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:53.359+0000 7f3de3500640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3ddc1120d0 con 0x7f3ddc103780 2024-09-19T06:03:53.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:53.359+0000 7f3de3500640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f3ddc111f50 con 0x7f3ddc102dd0 2024-09-19T06:03:53.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:53.359+0000 7f3de3500640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3ddc112250 con 0x7f3ddc108300 2024-09-19T06:03:53.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:53.359+0000 7f3de0a9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ddc103780 0x7f3ddc198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:53.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:53.359+0000 7f3de0a9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ddc103780 0x7f3ddc198a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56870/0 (socket says 172.21.15.37:56870) 2024-09-19T06:03:53.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:53.359+0000 7f3de129c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ddc102dd0 0x7f3ddc198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:53.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:53.359+0000 7f3de0a9b640 1 -- 172.21.15.37:0/2902375039 learned_addr learned my addr 172.21.15.37:0/2902375039 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:03:53.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:53.359+0000 7f3de1a9d640 1 --2- 172.21.15.37:0/2902375039 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ddc108300 0x7f3ddc19ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:53.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:53.359+0000 7f3de0a9b640 1 -- 172.21.15.37:0/2902375039 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ddc108300 msgr2=0x7f3ddc19ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:53.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:53.359+0000 7f3de0a9b640 1 --2- 172.21.15.37:0/2902375039 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ddc108300 0x7f3ddc19ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:53.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:53.359+0000 7f3de0a9b640 1 -- 172.21.15.37:0/2902375039 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ddc102dd0 msgr2=0x7f3ddc198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:53.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:53.359+0000 7f3de0a9b640 1 --2- 172.21.15.37:0/2902375039 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ddc102dd0 0x7f3ddc198530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:53.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:53.359+0000 7f3de0a9b640 1 -- 172.21.15.37:0/2902375039 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ddc19d4e0 con 0x7f3ddc103780 2024-09-19T06:03:53.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:53.359+0000 7f3de1a9d640 1 --2- 172.21.15.37:0/2902375039 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ddc108300 0x7f3ddc19ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:03:53.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:53.359+0000 7f3de129c640 1 --2- 172.21.15.37:0/2902375039 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ddc102dd0 0x7f3ddc198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:03:53.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:53.360+0000 7f3de0a9b640 1 --2- 172.21.15.37:0/2902375039 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ddc103780 0x7f3ddc198a70 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3dd000c970 tx=0x7f3dd000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:03:53.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:53.360+0000 7f3dda7fc640 1 -- 172.21.15.37:0/2902375039 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd0007bb0 con 0x7f3ddc103780 2024-09-19T06:03:53.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:53.360+0000 7f3dda7fc640 1 -- 172.21.15.37:0/2902375039 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3dd0007d50 con 0x7f3ddc103780 2024-09-19T06:03:53.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:53.360+0000 7f3de3500640 1 -- 172.21.15.37:0/2902375039 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ddc19d7d0 con 0x7f3ddc103780 2024-09-19T06:03:53.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:53.360+0000 7f3dda7fc640 1 -- 172.21.15.37:0/2902375039 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd000f450 con 0x7f3ddc103780 2024-09-19T06:03:53.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:53.360+0000 7f3de3500640 1 -- 172.21.15.37:0/2902375039 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ddc1a50b0 con 0x7f3ddc103780 2024-09-19T06:03:53.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:53.361+0000 7f3de3500640 1 -- 172.21.15.37:0/2902375039 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ddc1031b0 con 0x7f3ddc103780 2024-09-19T06:03:53.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:53.362+0000 7f3dda7fc640 1 -- 172.21.15.37:0/2902375039 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f3dd0004f60 con 0x7f3ddc103780 2024-09-19T06:03:53.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:53.363+0000 7f3dda7fc640 1 --2- 172.21.15.37:0/2902375039 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f3dc40a32c0 0x7f3dc40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:53.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:53.363+0000 7f3de129c640 1 --2- 172.21.15.37:0/2902375039 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f3dc40a32c0 0x7f3dc40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:53.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:53.363+0000 7f3dda7fc640 1 -- 172.21.15.37:0/2902375039 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f3dd00cedc0 con 0x7f3ddc103780 2024-09-19T06:03:53.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:53.363+0000 7f3de129c640 1 --2- 172.21.15.37:0/2902375039 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f3dc40a32c0 0x7f3dc40a5780 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3dd400bfd0 tx=0x7f3dd400b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:03:53.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:53.367+0000 7f3dda7fc640 1 -- 172.21.15.37:0/2902375039 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3dd0014030 con 0x7f3ddc103780 2024-09-19T06:03:53.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:53 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:53.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:53 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:53.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:53 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:53.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:53 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:03:53.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:53 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:03:53.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:53 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:53.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:53 smithi037 ceph-mon[31211]: Deploying daemon mds.b on smithi099 2024-09-19T06:03:53.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:53 smithi037 ceph-mon[31211]: mds.? [v2:172.21.15.37:6840/2718998355,v1:172.21.15.37:6841/2718998355] up:boot 2024-09-19T06:03:53.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:53 smithi037 ceph-mon[31211]: fsmap 11 up:standby 2024-09-19T06:03:53.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:53 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T06:03:53.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:53.582+0000 7f3de3500640 1 -- 172.21.15.37:0/2902375039 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3ddc10a290 con 0x7f3ddc103780 2024-09-19T06:03:53.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:53.583+0000 7f3dda7fc640 1 -- 172.21.15.37:0/2902375039 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9689 (secure 0 0 0) 0x7f3dd009bee0 con 0x7f3ddc103780 2024-09-19T06:03:53.585 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T06:03:53.585 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":12,"btime":"2024-09-19T06:03:52:986044+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14514,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2864247978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2864247978},{"type":"v1","addr":"172.21.15.37:6835","nonce":2864247978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14526,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/633000932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":633000932},{"type":"v1","addr":"172.21.15.37:6837","nonce":633000932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14574,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/3753800615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":3753800615},{"type":"v1","addr":"172.21.15.37:6839","nonce":3753800615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/2718998355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":2718998355},{"type":"v1","addr":"172.21.15.37:6841","nonce":2718998355}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6833/866590207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":866590207},{"type":"v1","addr":"172.21.15.99:6833","nonce":866590207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3898668400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3898668400},{"type":"v1","addr":"172.21.15.117:6833","nonce":3898668400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2650673320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2650673320},{"type":"v1","addr":"172.21.15.99:6835","nonce":2650673320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1097471349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1097471349},{"type":"v1","addr":"172.21.15.117:6835","nonce":1097471349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24457,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1001392672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1001392672},{"type":"v1","addr":"172.21.15.117:6837","nonce":1001392672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/23570935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":23570935},{"type":"v1","addr":"172.21.15.99:6837","nonce":23570935}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24478,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6839/1269518339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":1269518339},{"type":"v1","addr":"172.21.15.117:6839","nonce":1269518339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-19T06:03:53.585 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 12 2024-09-19T06:03:53.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:53.585+0000 7f3de3500640 1 -- 172.21.15.37:0/2902375039 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f3dc40a32c0 msgr2=0x7f3dc40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:53.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:53.585+0000 7f3de3500640 1 --2- 172.21.15.37:0/2902375039 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f3dc40a32c0 0x7f3dc40a5780 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3dd400bfd0 tx=0x7f3dd400b390 comp rx=0 tx=0).stop 2024-09-19T06:03:53.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:53.585+0000 7f3de3500640 1 -- 172.21.15.37:0/2902375039 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ddc103780 msgr2=0x7f3ddc198a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:53.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:53.585+0000 7f3de3500640 1 --2- 172.21.15.37:0/2902375039 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ddc103780 0x7f3ddc198a70 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3dd000c970 tx=0x7f3dd000ce30 comp rx=0 tx=0).stop 2024-09-19T06:03:53.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:53.585+0000 7f3de3500640 1 -- 172.21.15.37:0/2902375039 shutdown_connections 2024-09-19T06:03:53.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:53.585+0000 7f3de3500640 1 --2- 172.21.15.37:0/2902375039 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f3dc40a32c0 0x7f3dc40a5780 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:53.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:53.585+0000 7f3de3500640 1 --2- 172.21.15.37:0/2902375039 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ddc108300 0x7f3ddc19ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:53.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:53.585+0000 7f3de3500640 1 --2- 172.21.15.37:0/2902375039 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ddc103780 0x7f3ddc198a70 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:53.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:53.585+0000 7f3de3500640 1 --2- 172.21.15.37:0/2902375039 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ddc102dd0 0x7f3ddc198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:53.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:53.585+0000 7f3de3500640 1 -- 172.21.15.37:0/2902375039 >> 172.21.15.37:0/2902375039 conn(0x7f3ddc0fc7d0 msgr2=0x7f3ddc1063b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:03:53.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:53.585+0000 7f3de3500640 1 -- 172.21.15.37:0/2902375039 shutdown_connections 2024-09-19T06:03:53.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:53.585+0000 7f3de3500640 1 -- 172.21.15.37:0/2902375039 wait complete. 2024-09-19T06:03:53.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:53 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:53.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:53 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:53.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:53 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:53.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:53 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:03:53.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:53 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:03:53.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:53 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:53.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:53 smithi099 ceph-mon[35300]: Deploying daemon mds.b on smithi099 2024-09-19T06:03:53.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:53 smithi099 ceph-mon[35300]: mds.? [v2:172.21.15.37:6840/2718998355,v1:172.21.15.37:6841/2718998355] up:boot 2024-09-19T06:03:53.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:53 smithi099 ceph-mon[35300]: fsmap 11 up:standby 2024-09-19T06:03:53.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:53 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T06:03:53.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:53 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:53.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:53 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:53.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:53 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:53.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:53 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:03:53.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:53 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:03:53.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:53 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:53.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:53 smithi117 ceph-mon[35050]: Deploying daemon mds.b on smithi099 2024-09-19T06:03:53.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:53 smithi117 ceph-mon[35050]: mds.? [v2:172.21.15.37:6840/2718998355,v1:172.21.15.37:6841/2718998355] up:boot 2024-09-19T06:03:53.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:53 smithi117 ceph-mon[35050]: fsmap 11 up:standby 2024-09-19T06:03:53.751 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:53 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T06:03:54.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:54 smithi037 ceph-mon[31211]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:03:54.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:54 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/2902375039' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:03:54.875 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:54 smithi099 ceph-mon[35300]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:03:54.875 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:54 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/2902375039' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:03:54.875 INFO:journalctl@ceph.mds.b.smithi099.stdout:Sep 19 06:03:54 smithi099 systemd[1]: Starting Ceph mds.b for b8c8bdae-764b-11ef-bceb-c7b262605968... 2024-09-19T06:03:55.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:54 smithi117 ceph-mon[35050]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:03:55.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:54 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/2902375039' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:03:55.145 INFO:journalctl@ceph.mds.b.smithi099.stdout:Sep 19 06:03:54 smithi099 podman[65338]: 2024-09-19 06:03:54.776388832 +0000 UTC m=+0.015716181 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:03:55.145 INFO:journalctl@ceph.mds.b.smithi099.stdout:Sep 19 06:03:54 smithi099 podman[65338]: 2024-09-19 06:03:54.896129364 +0000 UTC m=+0.135456701 container create 3620b432be0d9a422602974450e93939ca49baa510affdc2ef191ad721bdf070 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-b, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2) 2024-09-19T06:03:55.146 INFO:journalctl@ceph.mds.b.smithi099.stdout:Sep 19 06:03:55 smithi099 podman[65338]: 2024-09-19 06:03:55.143797221 +0000 UTC m=+0.383124597 container init 3620b432be0d9a422602974450e93939ca49baa510affdc2ef191ad721bdf070 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-19T06:03:55.439 INFO:journalctl@ceph.mds.b.smithi099.stdout:Sep 19 06:03:55 smithi099 podman[65338]: 2024-09-19 06:03:55.148007015 +0000 UTC m=+0.387334364 container start 3620b432be0d9a422602974450e93939ca49baa510affdc2ef191ad721bdf070 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-b, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:03:55.439 INFO:journalctl@ceph.mds.b.smithi099.stdout:Sep 19 06:03:55 smithi099 ceph-mds[65358]: -- 172.21.15.99:0/3076112142 <== mon.2 v2:172.21.15.99:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555a19801860 con 0x555a197df400 2024-09-19T06:03:55.439 INFO:journalctl@ceph.mds.b.smithi099.stdout:Sep 19 06:03:55 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-b[65353]: starting mds.b at 2024-09-19T06:03:55.439 INFO:journalctl@ceph.mds.b.smithi099.stdout:Sep 19 06:03:55 smithi099 bash[65338]: 3620b432be0d9a422602974450e93939ca49baa510affdc2ef191ad721bdf070 2024-09-19T06:03:55.439 INFO:journalctl@ceph.mds.b.smithi099.stdout:Sep 19 06:03:55 smithi099 systemd[1]: Started Ceph mds.b for b8c8bdae-764b-11ef-bceb-c7b262605968. 2024-09-19T06:03:56.274 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:03:56.351 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:56 smithi037 ceph-mon[31211]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:03:56.352 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:56 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:56.352 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:56 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:56.352 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:56 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:56.352 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:56 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:56.352 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:56 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:56.352 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:56 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:03:56.352 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:56 smithi037 ceph-mon[31211]: mds.? [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] up:boot 2024-09-19T06:03:56.352 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:56 smithi037 ceph-mon[31211]: fsmap 12 up:standby 2024-09-19T06:03:56.352 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:56 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T06:03:56.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:56 smithi099 ceph-mon[35300]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:03:56.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:56 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:56.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:56 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:56.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:56 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:56.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:56 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:56.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:56 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:56.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:56 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:03:56.440 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:56 smithi099 ceph-mon[35300]: mds.? [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] up:boot 2024-09-19T06:03:56.440 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:56 smithi099 ceph-mon[35300]: fsmap 12 up:standby 2024-09-19T06:03:56.440 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:56 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T06:03:56.641 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:03:56.749 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:56 smithi117 ceph-mon[35050]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:03:56.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:56 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:56.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:56 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:56.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:56 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:56.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:56 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:56.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:56 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:56.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:56 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:03:56.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:56 smithi117 ceph-mon[35050]: mds.? [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] up:boot 2024-09-19T06:03:56.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:56 smithi117 ceph-mon[35050]: fsmap 12 up:standby 2024-09-19T06:03:56.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:56 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T06:03:57.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:57.144+0000 7f967cb4e640 1 -- 172.21.15.37:0/1542644818 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9678102d90 msgr2=0x7f9678103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:57.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:57.144+0000 7f967cb4e640 1 --2- 172.21.15.37:0/1542644818 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9678102d90 0x7f9678103170 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9668009930 tx=0x7f966802a420 comp rx=0 tx=0).stop 2024-09-19T06:03:57.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:57.144+0000 7f967cb4e640 1 -- 172.21.15.37:0/1542644818 shutdown_connections 2024-09-19T06:03:57.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:57.144+0000 7f967cb4e640 1 --2- 172.21.15.37:0/1542644818 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9678103740 0x7f9678107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:57.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:57.144+0000 7f967cb4e640 1 --2- 172.21.15.37:0/1542644818 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9678108290 0x7f967810ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:57.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:57.144+0000 7f967cb4e640 1 --2- 172.21.15.37:0/1542644818 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9678102d90 0x7f9678103170 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:57.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:57.144+0000 7f967cb4e640 1 -- 172.21.15.37:0/1542644818 >> 172.21.15.37:0/1542644818 conn(0x7f96780fc7d0 msgr2=0x7f96780febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:03:57.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:57.144+0000 7f967cb4e640 1 -- 172.21.15.37:0/1542644818 shutdown_connections 2024-09-19T06:03:57.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:57.144+0000 7f967cb4e640 1 -- 172.21.15.37:0/1542644818 wait complete. 2024-09-19T06:03:57.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:57.145+0000 7f967cb4e640 1 Processor -- start 2024-09-19T06:03:57.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:57.145+0000 7f967cb4e640 1 -- start start 2024-09-19T06:03:57.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:57.145+0000 7f967cb4e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9678102d90 0x7f96781009f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:57.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:57.145+0000 7f967cb4e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9678103740 0x7f9678100f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:57.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:57.145+0000 7f967cb4e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9678108290 0x7f9678101470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:57.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:57.145+0000 7f967cb4e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f96781120d0 con 0x7f9678103740 2024-09-19T06:03:57.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:57.145+0000 7f967cb4e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f9678111f50 con 0x7f9678102d90 2024-09-19T06:03:57.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:57.145+0000 7f967cb4e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9678112250 con 0x7f9678108290 2024-09-19T06:03:57.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:57.145+0000 7f9675d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9678103740 0x7f9678100f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:57.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:57.145+0000 7f9675d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9678103740 0x7f9678100f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50628/0 (socket says 172.21.15.37:50628) 2024-09-19T06:03:57.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:57.145+0000 7f9675d9b640 1 -- 172.21.15.37:0/3061731547 learned_addr learned my addr 172.21.15.37:0/3061731547 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:03:57.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:57.145+0000 7f9676d9d640 1 --2- 172.21.15.37:0/3061731547 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9678108290 0x7f9678101470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:57.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:57.145+0000 7f967659c640 1 --2- 172.21.15.37:0/3061731547 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9678102d90 0x7f96781009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:57.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:57.145+0000 7f9675d9b640 1 -- 172.21.15.37:0/3061731547 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9678108290 msgr2=0x7f9678101470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:57.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:57.145+0000 7f9675d9b640 1 --2- 172.21.15.37:0/3061731547 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9678108290 0x7f9678101470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:57.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:57.146+0000 7f9675d9b640 1 -- 172.21.15.37:0/3061731547 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9678102d90 msgr2=0x7f96781009f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:57.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:57.146+0000 7f9675d9b640 1 --2- 172.21.15.37:0/3061731547 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9678102d90 0x7f96781009f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:57.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:57.146+0000 7f9675d9b640 1 -- 172.21.15.37:0/3061731547 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96781a6b00 con 0x7f9678103740 2024-09-19T06:03:57.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:57.146+0000 7f9675d9b640 1 --2- 172.21.15.37:0/3061731547 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9678103740 0x7f9678100f30 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f966000b450 tx=0x7f966000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:03:57.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:57.146+0000 7f966f7fe640 1 -- 172.21.15.37:0/3061731547 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9660015020 con 0x7f9678103740 2024-09-19T06:03:57.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:57.146+0000 7f966f7fe640 1 -- 172.21.15.37:0/3061731547 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9660011d70 con 0x7f9678103740 2024-09-19T06:03:57.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:57.146+0000 7f967cb4e640 1 -- 172.21.15.37:0/3061731547 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96781a6df0 con 0x7f9678103740 2024-09-19T06:03:57.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:57.146+0000 7f966f7fe640 1 -- 172.21.15.37:0/3061731547 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f966000f340 con 0x7f9678103740 2024-09-19T06:03:57.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:57.146+0000 7f967cb4e640 1 -- 172.21.15.37:0/3061731547 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96781a72a0 con 0x7f9678103740 2024-09-19T06:03:57.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:57.147+0000 7f967cb4e640 1 -- 172.21.15.37:0/3061731547 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f967806a7f0 con 0x7f9678103740 2024-09-19T06:03:57.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:57.148+0000 7f966f7fe640 1 -- 172.21.15.37:0/3061731547 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f9660018020 con 0x7f9678103740 2024-09-19T06:03:57.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:57.149+0000 7f966f7fe640 1 --2- 172.21.15.37:0/3061731547 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f96640a3240 0x7f96640a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:57.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:57.149+0000 7f967659c640 1 --2- 172.21.15.37:0/3061731547 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f96640a3240 0x7f96640a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:57.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:57.149+0000 7f966f7fe640 1 -- 172.21.15.37:0/3061731547 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f96600cee40 con 0x7f9678103740 2024-09-19T06:03:57.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:57.149+0000 7f967659c640 1 --2- 172.21.15.37:0/3061731547 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f96640a3240 0x7f96640a5700 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9668009900 tx=0x7f96680058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:03:57.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:57.153+0000 7f966f7fe640 1 -- 172.21.15.37:0/3061731547 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f966001f020 con 0x7f9678103740 2024-09-19T06:03:57.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:57.421+0000 7f967cb4e640 1 -- 172.21.15.37:0/3061731547 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f967802d7c0 con 0x7f9678103740 2024-09-19T06:03:57.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:57.421+0000 7f966f7fe640 1 -- 172.21.15.37:0/3061731547 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10515 (secure 0 0 0) 0x7f96600afe20 con 0x7f9678103740 2024-09-19T06:03:57.424 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T06:03:57.424 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":13,"btime":"2024-09-19T06:03:55:513854+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14514,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2864247978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2864247978},{"type":"v1","addr":"172.21.15.37:6835","nonce":2864247978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14526,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/633000932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":633000932},{"type":"v1","addr":"172.21.15.37:6837","nonce":633000932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14574,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/3753800615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":3753800615},{"type":"v1","addr":"172.21.15.37:6839","nonce":3753800615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/2718998355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":2718998355},{"type":"v1","addr":"172.21.15.37:6841","nonce":2718998355}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6833/866590207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":866590207},{"type":"v1","addr":"172.21.15.99:6833","nonce":866590207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3898668400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3898668400},{"type":"v1","addr":"172.21.15.117:6833","nonce":3898668400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2650673320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2650673320},{"type":"v1","addr":"172.21.15.99:6835","nonce":2650673320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1097471349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1097471349},{"type":"v1","addr":"172.21.15.117:6835","nonce":1097471349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24457,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1001392672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1001392672},{"type":"v1","addr":"172.21.15.117:6837","nonce":1001392672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/23570935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":23570935},{"type":"v1","addr":"172.21.15.99:6837","nonce":23570935}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24478,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6839/1269518339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":1269518339},{"type":"v1","addr":"172.21.15.117:6839","nonce":1269518339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24485,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6839/3404812329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":3404812329},{"type":"v1","addr":"172.21.15.99:6839","nonce":3404812329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-19T06:03:57.424 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 13 2024-09-19T06:03:57.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:57.424+0000 7f967cb4e640 1 -- 172.21.15.37:0/3061731547 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f96640a3240 msgr2=0x7f96640a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:57.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:57.424+0000 7f967cb4e640 1 --2- 172.21.15.37:0/3061731547 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f96640a3240 0x7f96640a5700 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9668009900 tx=0x7f96680058d0 comp rx=0 tx=0).stop 2024-09-19T06:03:57.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:57.424+0000 7f967cb4e640 1 -- 172.21.15.37:0/3061731547 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9678103740 msgr2=0x7f9678100f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:57.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:57.424+0000 7f967cb4e640 1 --2- 172.21.15.37:0/3061731547 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9678103740 0x7f9678100f30 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f966000b450 tx=0x7f966000b910 comp rx=0 tx=0).stop 2024-09-19T06:03:57.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:57.424+0000 7f967cb4e640 1 -- 172.21.15.37:0/3061731547 shutdown_connections 2024-09-19T06:03:57.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:57.424+0000 7f967cb4e640 1 --2- 172.21.15.37:0/3061731547 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f96640a3240 0x7f96640a5700 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:57.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:57.424+0000 7f967cb4e640 1 --2- 172.21.15.37:0/3061731547 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9678108290 0x7f9678101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:57.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:57.424+0000 7f967cb4e640 1 --2- 172.21.15.37:0/3061731547 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9678103740 0x7f9678100f30 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:57.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:57.424+0000 7f967cb4e640 1 --2- 172.21.15.37:0/3061731547 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9678102d90 0x7f96781009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:57.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:57.424+0000 7f967cb4e640 1 -- 172.21.15.37:0/3061731547 >> 172.21.15.37:0/3061731547 conn(0x7f96780fc7d0 msgr2=0x7f9678105dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:03:57.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:57.424+0000 7f967cb4e640 1 -- 172.21.15.37:0/3061731547 shutdown_connections 2024-09-19T06:03:57.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:57.424+0000 7f967cb4e640 1 -- 172.21.15.37:0/3061731547 wait complete. 2024-09-19T06:03:58.172 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:57 smithi037 ceph-mon[31211]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:03:58.172 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:57 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:58.172 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:57 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:58.172 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:57 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:58.172 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:57 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:58.172 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:57 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/3061731547' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:03:58.172 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:57 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:58.172 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:57 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:58.172 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:57 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:58.172 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:57 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:58.173 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:57 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:03:58.173 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:57 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:58.173 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:03:57 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:03:58.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:57 smithi099 ceph-mon[35300]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:03:58.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:57 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:58.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:57 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:58.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:57 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:58.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:57 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:58.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:57 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/3061731547' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:03:58.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:57 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:58.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:57 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:58.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:57 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:58.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:57 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:58.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:57 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:03:58.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:57 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:58.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:03:57 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:03:58.202 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-19T06:03:58.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:57 smithi117 ceph-mon[35050]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:03:58.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:57 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:58.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:57 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:58.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:57 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:58.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:57 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:58.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:57 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/3061731547' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:03:58.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:57 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:58.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:57 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:58.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:57 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:58.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:57 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:58.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:57 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:03:58.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:57 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:03:58.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:03:57 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:03:59.119 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:03:59.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:59.617+0000 7f172da34640 1 -- 172.21.15.37:0/221398115 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17281036e0 msgr2=0x7f1728107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:59.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:59.617+0000 7f172da34640 1 --2- 172.21.15.37:0/221398115 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17281036e0 0x7f1728107b90 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f171c009930 tx=0x7f171c02a420 comp rx=0 tx=0).stop 2024-09-19T06:03:59.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:59.617+0000 7f172da34640 1 -- 172.21.15.37:0/221398115 shutdown_connections 2024-09-19T06:03:59.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:59.617+0000 7f172da34640 1 --2- 172.21.15.37:0/221398115 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17281082a0 0x7f172810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:59.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:59.617+0000 7f172da34640 1 --2- 172.21.15.37:0/221398115 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17281036e0 0x7f1728107b90 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:59.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:59.617+0000 7f172da34640 1 --2- 172.21.15.37:0/221398115 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1728102d30 0x7f1728103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:59.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:59.617+0000 7f172da34640 1 -- 172.21.15.37:0/221398115 >> 172.21.15.37:0/221398115 conn(0x7f17280fc7d0 msgr2=0x7f17280febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:03:59.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:59.617+0000 7f172da34640 1 -- 172.21.15.37:0/221398115 shutdown_connections 2024-09-19T06:03:59.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:59.617+0000 7f172da34640 1 -- 172.21.15.37:0/221398115 wait complete. 2024-09-19T06:03:59.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:59.617+0000 7f172da34640 1 Processor -- start 2024-09-19T06:03:59.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:59.618+0000 7f172da34640 1 -- start start 2024-09-19T06:03:59.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:59.618+0000 7f172da34640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1728102d30 0x7f17281985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:59.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:59.618+0000 7f172da34640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17281036e0 0x7f1728198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:59.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:59.618+0000 7f172da34640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17281082a0 0x7f172819ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:59.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:59.618+0000 7f172da34640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f17281120a0 con 0x7f17281036e0 2024-09-19T06:03:59.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:59.618+0000 7f172da34640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f1728111f20 con 0x7f1728102d30 2024-09-19T06:03:59.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:59.618+0000 7f172da34640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1728112220 con 0x7f17281082a0 2024-09-19T06:03:59.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:59.618+0000 7f17267fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17281036e0 0x7f1728198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:59.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:59.618+0000 7f17267fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17281036e0 0x7f1728198b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50644/0 (socket says 172.21.15.37:50644) 2024-09-19T06:03:59.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:59.618+0000 7f17267fc640 1 -- 172.21.15.37:0/515227310 learned_addr learned my addr 172.21.15.37:0/515227310 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:03:59.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:59.618+0000 7f1726ffd640 1 --2- 172.21.15.37:0/515227310 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1728102d30 0x7f17281985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:59.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:59.618+0000 7f17277fe640 1 --2- 172.21.15.37:0/515227310 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17281082a0 0x7f172819ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:59.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:59.618+0000 7f17267fc640 1 -- 172.21.15.37:0/515227310 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17281082a0 msgr2=0x7f172819ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:59.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:59.618+0000 7f17267fc640 1 --2- 172.21.15.37:0/515227310 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17281082a0 0x7f172819ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:59.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:59.618+0000 7f17267fc640 1 -- 172.21.15.37:0/515227310 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1728102d30 msgr2=0x7f17281985c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:59.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:59.618+0000 7f17267fc640 1 --2- 172.21.15.37:0/515227310 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1728102d30 0x7f17281985c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:59.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:59.618+0000 7f17267fc640 1 -- 172.21.15.37:0/515227310 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f172819d570 con 0x7f17281036e0 2024-09-19T06:03:59.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:59.618+0000 7f17277fe640 1 --2- 172.21.15.37:0/515227310 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17281082a0 0x7f172819ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:03:59.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:59.619+0000 7f17267fc640 1 --2- 172.21.15.37:0/515227310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17281036e0 0x7f1728198b00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f171c005940 tx=0x7f171c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:03:59.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:59.619+0000 7f172ca32640 1 -- 172.21.15.37:0/515227310 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f171c03f030 con 0x7f17281036e0 2024-09-19T06:03:59.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:59.619+0000 7f172ca32640 1 -- 172.21.15.37:0/515227310 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f171c003ce0 con 0x7f17281036e0 2024-09-19T06:03:59.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:59.619+0000 7f172da34640 1 -- 172.21.15.37:0/515227310 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f172819d800 con 0x7f17281036e0 2024-09-19T06:03:59.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:59.619+0000 7f172ca32640 1 -- 172.21.15.37:0/515227310 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f171c035070 con 0x7f17281036e0 2024-09-19T06:03:59.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:59.619+0000 7f172da34640 1 -- 172.21.15.37:0/515227310 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17281a5140 con 0x7f17281036e0 2024-09-19T06:03:59.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:59.620+0000 7f172da34640 1 -- 172.21.15.37:0/515227310 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f172806a850 con 0x7f17281036e0 2024-09-19T06:03:59.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:59.621+0000 7f172ca32640 1 -- 172.21.15.37:0/515227310 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f171c042030 con 0x7f17281036e0 2024-09-19T06:03:59.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:59.622+0000 7f172ca32640 1 --2- 172.21.15.37:0/515227310 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f17100a3240 0x7f17100a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:59.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:59.622+0000 7f1726ffd640 1 --2- 172.21.15.37:0/515227310 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f17100a3240 0x7f17100a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:59.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:59.622+0000 7f172ca32640 1 -- 172.21.15.37:0/515227310 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f171c0ef9c0 con 0x7f17281036e0 2024-09-19T06:03:59.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:59.623+0000 7f1726ffd640 1 --2- 172.21.15.37:0/515227310 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f17100a3240 0x7f17100a5700 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f171800bbe0 tx=0x7f171800b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:03:59.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:59.627+0000 7f172ca32640 1 -- 172.21.15.37:0/515227310 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f171c0bcae0 con 0x7f17281036e0 2024-09-19T06:03:59.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:59.853+0000 7f172da34640 1 -- 172.21.15.37:0/515227310 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f172810a2b0 con 0x7f17281036e0 2024-09-19T06:03:59.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:59.853+0000 7f172ca32640 1 -- 172.21.15.37:0/515227310 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v76) ==== 84+0+65 (secure 0 0 0) 0x7f171c0bc3e0 con 0x7f17281036e0 2024-09-19T06:03:59.855 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T06:03:59.855 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2024-09-19T06:03:59.855 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:03:59.855 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 1, 2024-09-19T06:03:59.855 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": ".mgr" 2024-09-19T06:03:59.856 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:03:59.856 INFO:teuthology.orchestra.run.smithi037.stdout:] 2024-09-19T06:03:59.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:59.855+0000 7f172da34640 1 -- 172.21.15.37:0/515227310 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f17100a3240 msgr2=0x7f17100a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:59.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:59.855+0000 7f172da34640 1 --2- 172.21.15.37:0/515227310 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f17100a3240 0x7f17100a5700 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f171800bbe0 tx=0x7f171800b390 comp rx=0 tx=0).stop 2024-09-19T06:03:59.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:59.855+0000 7f172da34640 1 -- 172.21.15.37:0/515227310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17281036e0 msgr2=0x7f1728198b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:59.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:59.855+0000 7f172da34640 1 --2- 172.21.15.37:0/515227310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17281036e0 0x7f1728198b00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f171c005940 tx=0x7f171c0042f0 comp rx=0 tx=0).stop 2024-09-19T06:03:59.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:59.855+0000 7f172da34640 1 -- 172.21.15.37:0/515227310 shutdown_connections 2024-09-19T06:03:59.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:59.855+0000 7f172da34640 1 --2- 172.21.15.37:0/515227310 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f17100a3240 0x7f17100a5700 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:59.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:59.855+0000 7f172da34640 1 --2- 172.21.15.37:0/515227310 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17281082a0 0x7f172819ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:59.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:59.855+0000 7f172da34640 1 --2- 172.21.15.37:0/515227310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17281036e0 0x7f1728198b00 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:59.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:59.855+0000 7f172da34640 1 --2- 172.21.15.37:0/515227310 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1728102d30 0x7f17281985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:59.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:59.855+0000 7f172da34640 1 -- 172.21.15.37:0/515227310 >> 172.21.15.37:0/515227310 conn(0x7f17280fc7d0 msgr2=0x7f1728105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:03:59.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:59.855+0000 7f172da34640 1 -- 172.21.15.37:0/515227310 shutdown_connections 2024-09-19T06:03:59.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:03:59.855+0000 7f172da34640 1 -- 172.21.15.37:0/515227310 wait complete. 2024-09-19T06:04:00.550 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:00 smithi037 ceph-mon[31211]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:04:00.550 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:00 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:04:00.550 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:00 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:04:00.550 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:00 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:04:00.550 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:00 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:04:00.551 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:00 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/515227310' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T06:04:00.551 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:00 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:04:00.551 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:00 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:04:00.551 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:00 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:04:00.551 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:00 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:04:00.551 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:00 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:04:00.577 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-19T06:04:00.578 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-19T06:04:00.688 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:00 smithi099 ceph-mon[35300]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:04:00.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:00 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:04:00.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:00 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:04:00.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:00 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:04:00.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:00 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:04:00.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:00 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/515227310' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T06:04:00.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:00 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:04:00.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:00 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:04:00.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:00 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:04:00.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:00 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:04:00.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:00 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:04:00.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:00 smithi117 ceph-mon[35050]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:04:00.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:00 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:04:00.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:00 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:04:00.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:00 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:04:00.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:00 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:04:00.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:00 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/515227310' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T06:04:00.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:00 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:04:00.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:00 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:04:00.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:00 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:04:00.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:00 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:04:00.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:00 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:04:00.831 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:04:01.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:01.304+0000 7fd465e57640 1 -- 172.21.15.37:0/62875379 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd460106f30 msgr2=0x7fd46010eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:01.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:01.304+0000 7fd465e57640 1 --2- 172.21.15.37:0/62875379 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd460106f30 0x7fd46010eab0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd458009ca0 tx=0x7fd45802a8c0 comp rx=0 tx=0).stop 2024-09-19T06:04:01.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:01.304+0000 7fd465e57640 1 -- 172.21.15.37:0/62875379 shutdown_connections 2024-09-19T06:04:01.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:01.304+0000 7fd465e57640 1 --2- 172.21.15.37:0/62875379 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd460100cc0 0x7fd460106800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:01.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:01.304+0000 7fd465e57640 1 --2- 172.21.15.37:0/62875379 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd460106f30 0x7fd46010eab0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:01.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:01.304+0000 7fd465e57640 1 --2- 172.21.15.37:0/62875379 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd460100310 0x7fd4601006f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:01.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:01.304+0000 7fd465e57640 1 -- 172.21.15.37:0/62875379 >> 172.21.15.37:0/62875379 conn(0x7fd460077210 msgr2=0x7fd4600fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:01.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:01.305+0000 7fd465e57640 1 -- 172.21.15.37:0/62875379 shutdown_connections 2024-09-19T06:04:01.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:01.305+0000 7fd465e57640 1 -- 172.21.15.37:0/62875379 wait complete. 2024-09-19T06:04:01.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:01.305+0000 7fd465e57640 1 Processor -- start 2024-09-19T06:04:01.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:01.305+0000 7fd465e57640 1 -- start start 2024-09-19T06:04:01.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:01.305+0000 7fd465e57640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd460100310 0x7fd460101290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:01.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:01.305+0000 7fd465e57640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd460100cc0 0x7fd4601017d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:01.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:01.305+0000 7fd465e57640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd460106f30 0x7fd460101d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:01.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:01.305+0000 7fd465e57640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd460111f90 con 0x7fd460100310 2024-09-19T06:04:01.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:01.305+0000 7fd465e57640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fd460111e10 con 0x7fd460100cc0 2024-09-19T06:04:01.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:01.305+0000 7fd465e57640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd460112110 con 0x7fd460106f30 2024-09-19T06:04:01.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:01.306+0000 7fd45f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd460100310 0x7fd460101290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:01.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:01.306+0000 7fd45f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd460100310 0x7fd460101290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50670/0 (socket says 172.21.15.37:50670) 2024-09-19T06:04:01.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:01.306+0000 7fd45f7fe640 1 -- 172.21.15.37:0/2688272653 learned_addr learned my addr 172.21.15.37:0/2688272653 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:04:01.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:01.306+0000 7fd457fff640 1 --2- 172.21.15.37:0/2688272653 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd460100cc0 0x7fd4601017d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:01.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:01.306+0000 7fd45ffff640 1 --2- 172.21.15.37:0/2688272653 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd460106f30 0x7fd460101d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:01.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:01.306+0000 7fd45f7fe640 1 -- 172.21.15.37:0/2688272653 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd460106f30 msgr2=0x7fd460101d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:01.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:01.306+0000 7fd45f7fe640 1 --2- 172.21.15.37:0/2688272653 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd460106f30 0x7fd460101d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:01.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:01.306+0000 7fd45f7fe640 1 -- 172.21.15.37:0/2688272653 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd460100cc0 msgr2=0x7fd4601017d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:01.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:01.306+0000 7fd45f7fe640 1 --2- 172.21.15.37:0/2688272653 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd460100cc0 0x7fd4601017d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:01.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:01.306+0000 7fd45f7fe640 1 -- 172.21.15.37:0/2688272653 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4601a68d0 con 0x7fd460100310 2024-09-19T06:04:01.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:01.306+0000 7fd45f7fe640 1 --2- 172.21.15.37:0/2688272653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd460100310 0x7fd460101290 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd45000c970 tx=0x7fd45000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:01.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:01.306+0000 7fd45d7fa640 1 -- 172.21.15.37:0/2688272653 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd450007bb0 con 0x7fd460100310 2024-09-19T06:04:01.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:01.306+0000 7fd465e57640 1 -- 172.21.15.37:0/2688272653 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4601a6bc0 con 0x7fd460100310 2024-09-19T06:04:01.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:01.306+0000 7fd45d7fa640 1 -- 172.21.15.37:0/2688272653 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd450007d50 con 0x7fd460100310 2024-09-19T06:04:01.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:01.306+0000 7fd45d7fa640 1 -- 172.21.15.37:0/2688272653 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd45000f450 con 0x7fd460100310 2024-09-19T06:04:01.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:01.306+0000 7fd465e57640 1 -- 172.21.15.37:0/2688272653 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4601a70b0 con 0x7fd460100310 2024-09-19T06:04:01.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:01.307+0000 7fd465e57640 1 -- 172.21.15.37:0/2688272653 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4601006f0 con 0x7fd460100310 2024-09-19T06:04:01.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:01.309+0000 7fd45d7fa640 1 -- 172.21.15.37:0/2688272653 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fd450004fe0 con 0x7fd460100310 2024-09-19T06:04:01.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:01.309+0000 7fd45d7fa640 1 --2- 172.21.15.37:0/2688272653 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fd44c0a3240 0x7fd44c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:01.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:01.309+0000 7fd457fff640 1 --2- 172.21.15.37:0/2688272653 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fd44c0a3240 0x7fd44c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:01.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:01.309+0000 7fd45d7fa640 1 -- 172.21.15.37:0/2688272653 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fd4500cf540 con 0x7fd460100310 2024-09-19T06:04:01.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:01.310+0000 7fd457fff640 1 --2- 172.21.15.37:0/2688272653 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fd44c0a3240 0x7fd44c0a5700 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd460102d20 tx=0x7fd44800b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:01.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:01.312+0000 7fd45d7fa640 1 -- 172.21.15.37:0/2688272653 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd450014030 con 0x7fd460100310 2024-09-19T06:04:01.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:01.486+0000 7fd465e57640 1 -- 172.21.15.37:0/2688272653 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fd4601027c0 con 0x7fd460100310 2024-09-19T06:04:02.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:02.294+0000 7fd45d7fa640 1 -- 172.21.15.37:0/2688272653 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v77) ==== 138+0+0 (secure 0 0 0) 0x7fd4601027c0 con 0x7fd460100310 2024-09-19T06:04:02.296 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' created 2024-09-19T06:04:02.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:02.296+0000 7fd465e57640 1 -- 172.21.15.37:0/2688272653 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fd44c0a3240 msgr2=0x7fd44c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:02.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:02.296+0000 7fd465e57640 1 --2- 172.21.15.37:0/2688272653 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fd44c0a3240 0x7fd44c0a5700 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd460102d20 tx=0x7fd44800b410 comp rx=0 tx=0).stop 2024-09-19T06:04:02.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:02.296+0000 7fd465e57640 1 -- 172.21.15.37:0/2688272653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd460100310 msgr2=0x7fd460101290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:02.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:02.296+0000 7fd465e57640 1 --2- 172.21.15.37:0/2688272653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd460100310 0x7fd460101290 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd45000c970 tx=0x7fd45000ce30 comp rx=0 tx=0).stop 2024-09-19T06:04:02.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:02.296+0000 7fd465e57640 1 -- 172.21.15.37:0/2688272653 shutdown_connections 2024-09-19T06:04:02.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:02.296+0000 7fd465e57640 1 --2- 172.21.15.37:0/2688272653 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fd44c0a3240 0x7fd44c0a5700 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:02.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:02.296+0000 7fd465e57640 1 --2- 172.21.15.37:0/2688272653 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd460100cc0 0x7fd4601017d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:02.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:02.296+0000 7fd465e57640 1 --2- 172.21.15.37:0/2688272653 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd460106f30 0x7fd460101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:02.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:02.296+0000 7fd465e57640 1 --2- 172.21.15.37:0/2688272653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd460100310 0x7fd460101290 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:02.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:02.296+0000 7fd465e57640 1 -- 172.21.15.37:0/2688272653 >> 172.21.15.37:0/2688272653 conn(0x7fd460077210 msgr2=0x7fd460105680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:02.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:02.296+0000 7fd465e57640 1 -- 172.21.15.37:0/2688272653 shutdown_connections 2024-09-19T06:04:02.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:02.297+0000 7fd465e57640 1 -- 172.21.15.37:0/2688272653 wait complete. 2024-09-19T06:04:02.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:02 smithi037 ceph-mon[31211]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:04:02.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:02 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/2688272653' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T06:04:02.688 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:02 smithi099 ceph-mon[35300]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:04:02.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:02 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/2688272653' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T06:04:02.749 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:02 smithi117 ceph-mon[35050]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:04:02.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:02 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/2688272653' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T06:04:03.033 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-19T06:04:03.294 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:04:03.307 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:03 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/2688272653' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T06:04:03.308 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:03 smithi037 ceph-mon[31211]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T06:04:03.688 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:03 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/2688272653' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T06:04:03.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:03 smithi099 ceph-mon[35300]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T06:04:03.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:03 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/2688272653' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T06:04:03.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:03 smithi117 ceph-mon[35050]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T06:04:03.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:03.775+0000 7fae2cf8c640 1 -- 172.21.15.37:0/2831558762 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae28102ef0 msgr2=0x7fae2810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:03.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:03.775+0000 7fae2cf8c640 1 --2- 172.21.15.37:0/2831558762 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae28102ef0 0x7fae2810da40 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fae20009ca0 tx=0x7fae2002a950 comp rx=0 tx=0).stop 2024-09-19T06:04:03.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:03.775+0000 7fae2cf8c640 1 -- 172.21.15.37:0/2831558762 shutdown_connections 2024-09-19T06:04:03.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:03.775+0000 7fae2cf8c640 1 --2- 172.21.15.37:0/2831558762 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae28102ef0 0x7fae2810da40 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:03.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:03.775+0000 7fae2cf8c640 1 --2- 172.21.15.37:0/2831558762 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae28102570 0x7fae281029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:03.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:03.775+0000 7fae2cf8c640 1 --2- 172.21.15.37:0/2831558762 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fae28100e20 0x7fae28101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:03.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:03.775+0000 7fae2cf8c640 1 -- 172.21.15.37:0/2831558762 >> 172.21.15.37:0/2831558762 conn(0x7fae280fc7d0 msgr2=0x7fae280febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:03.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:03.775+0000 7fae2cf8c640 1 -- 172.21.15.37:0/2831558762 shutdown_connections 2024-09-19T06:04:03.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:03.775+0000 7fae2cf8c640 1 -- 172.21.15.37:0/2831558762 wait complete. 2024-09-19T06:04:03.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:03.775+0000 7fae2cf8c640 1 Processor -- start 2024-09-19T06:04:03.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:03.776+0000 7fae2cf8c640 1 -- start start 2024-09-19T06:04:03.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:03.776+0000 7fae2cf8c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fae28100e20 0x7fae281993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:03.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:03.776+0000 7fae2cf8c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae28102570 0x7fae28199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:03.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:03.776+0000 7fae2cf8c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae28102ef0 0x7fae28199e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:03.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:03.776+0000 7fae2cf8c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fae28110fc0 con 0x7fae28102570 2024-09-19T06:04:03.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:03.776+0000 7fae2cf8c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fae28110e40 con 0x7fae28100e20 2024-09-19T06:04:03.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:03.776+0000 7fae2cf8c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fae28111140 con 0x7fae28102ef0 2024-09-19T06:04:03.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:03.776+0000 7fae1dd9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae28102570 0x7fae28199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:03.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:03.776+0000 7fae1dd9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae28102570 0x7fae28199910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39344/0 (socket says 172.21.15.37:39344) 2024-09-19T06:04:03.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:03.776+0000 7fae1dd9b640 1 -- 172.21.15.37:0/2928138771 learned_addr learned my addr 172.21.15.37:0/2928138771 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:04:03.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:03.776+0000 7fae26d9d640 1 --2- 172.21.15.37:0/2928138771 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae28102ef0 0x7fae28199e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:03.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:03.776+0000 7fae1dd9b640 1 -- 172.21.15.37:0/2928138771 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae28102ef0 msgr2=0x7fae28199e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:03.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:03.776+0000 7fae2659c640 1 --2- 172.21.15.37:0/2928138771 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fae28100e20 0x7fae281993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:03.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:03.776+0000 7fae1dd9b640 1 --2- 172.21.15.37:0/2928138771 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae28102ef0 0x7fae28199e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:03.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:03.776+0000 7fae1dd9b640 1 -- 172.21.15.37:0/2928138771 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fae28100e20 msgr2=0x7fae281993d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:03.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:03.776+0000 7fae1dd9b640 1 --2- 172.21.15.37:0/2928138771 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fae28100e20 0x7fae281993d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:03.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:03.776+0000 7fae1dd9b640 1 -- 172.21.15.37:0/2928138771 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae281a47d0 con 0x7fae28102570 2024-09-19T06:04:03.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:03.776+0000 7fae26d9d640 1 --2- 172.21.15.37:0/2928138771 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae28102ef0 0x7fae28199e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:04:03.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:03.776+0000 7fae2659c640 1 --2- 172.21.15.37:0/2928138771 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fae28100e20 0x7fae281993d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:04:03.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:03.777+0000 7fae1dd9b640 1 --2- 172.21.15.37:0/2928138771 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae28102570 0x7fae28199910 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fae1000d770 tx=0x7fae1000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:03.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:03.777+0000 7fae1ffff640 1 -- 172.21.15.37:0/2928138771 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae10017070 con 0x7fae28102570 2024-09-19T06:04:03.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:03.777+0000 7fae2cf8c640 1 -- 172.21.15.37:0/2928138771 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae281a4ac0 con 0x7fae28102570 2024-09-19T06:04:03.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:03.777+0000 7fae1ffff640 1 -- 172.21.15.37:0/2928138771 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae10005500 con 0x7fae28102570 2024-09-19T06:04:03.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:03.777+0000 7fae1ffff640 1 -- 172.21.15.37:0/2928138771 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae10004e00 con 0x7fae28102570 2024-09-19T06:04:03.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:03.777+0000 7fae2cf8c640 1 -- 172.21.15.37:0/2928138771 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae281a4fb0 con 0x7fae28102570 2024-09-19T06:04:03.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:03.778+0000 7fae2cf8c640 1 -- 172.21.15.37:0/2928138771 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae28101200 con 0x7fae28102570 2024-09-19T06:04:03.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:03.779+0000 7fae1ffff640 1 -- 172.21.15.37:0/2928138771 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fae10004fa0 con 0x7fae28102570 2024-09-19T06:04:03.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:03.780+0000 7fae1ffff640 1 --2- 172.21.15.37:0/2928138771 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fae140a3240 0x7fae140a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:03.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:03.780+0000 7fae2659c640 1 --2- 172.21.15.37:0/2928138771 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fae140a3240 0x7fae140a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:03.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:03.780+0000 7fae1ffff640 1 -- 172.21.15.37:0/2928138771 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7497+0+0 (secure 0 0 0) 0x7fae100cf4c0 con 0x7fae28102570 2024-09-19T06:04:03.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:03.780+0000 7fae2659c640 1 --2- 172.21.15.37:0/2928138771 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fae140a3240 0x7fae140a5700 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fae18006fd0 tx=0x7fae18008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:03.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:03.783+0000 7fae1ffff640 1 -- 172.21.15.37:0/2928138771 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fae1009c510 con 0x7fae28102570 2024-09-19T06:04:03.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:03.959+0000 7fae2cf8c640 1 -- 172.21.15.37:0/2928138771 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7fae281a51e0 con 0x7fae28102570 2024-09-19T06:04:04.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:04.399+0000 7fae1ffff640 1 -- 172.21.15.37:0/2928138771 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v79) ==== 171+0+0 (secure 0 0 0) 0x7fae1009be10 con 0x7fae28102570 2024-09-19T06:04:04.402 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' created 2024-09-19T06:04:04.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:04.402+0000 7fae2cf8c640 1 -- 172.21.15.37:0/2928138771 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fae140a3240 msgr2=0x7fae140a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:04.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:04.402+0000 7fae2cf8c640 1 --2- 172.21.15.37:0/2928138771 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fae140a3240 0x7fae140a5700 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fae18006fd0 tx=0x7fae18008040 comp rx=0 tx=0).stop 2024-09-19T06:04:04.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:04.402+0000 7fae2cf8c640 1 -- 172.21.15.37:0/2928138771 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae28102570 msgr2=0x7fae28199910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:04.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:04.402+0000 7fae2cf8c640 1 --2- 172.21.15.37:0/2928138771 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae28102570 0x7fae28199910 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fae1000d770 tx=0x7fae1000dc30 comp rx=0 tx=0).stop 2024-09-19T06:04:04.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:04.402+0000 7fae2cf8c640 1 -- 172.21.15.37:0/2928138771 shutdown_connections 2024-09-19T06:04:04.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:04.402+0000 7fae2cf8c640 1 --2- 172.21.15.37:0/2928138771 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fae140a3240 0x7fae140a5700 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:04.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:04.402+0000 7fae2cf8c640 1 --2- 172.21.15.37:0/2928138771 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae28102ef0 0x7fae28199e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:04.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:04.402+0000 7fae2cf8c640 1 --2- 172.21.15.37:0/2928138771 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae28102570 0x7fae28199910 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:04.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:04.402+0000 7fae2cf8c640 1 --2- 172.21.15.37:0/2928138771 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fae28100e20 0x7fae281993d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:04.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:04.402+0000 7fae2cf8c640 1 -- 172.21.15.37:0/2928138771 >> 172.21.15.37:0/2928138771 conn(0x7fae280fc7d0 msgr2=0x7fae280febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:04.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:04.402+0000 7fae2cf8c640 1 -- 172.21.15.37:0/2928138771 shutdown_connections 2024-09-19T06:04:04.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:04.402+0000 7fae2cf8c640 1 -- 172.21.15.37:0/2928138771 wait complete. 2024-09-19T06:04:04.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:04 smithi099 ceph-mon[35300]: pgmap v272: 33 pgs: 4 creating+peering, 28 unknown, 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:04:04.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:04 smithi099 ceph-mon[35300]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T06:04:04.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:04 smithi099 ceph-mon[35300]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T06:04:04.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:04 smithi037 ceph-mon[31211]: pgmap v272: 33 pgs: 4 creating+peering, 28 unknown, 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:04:04.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:04 smithi037 ceph-mon[31211]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T06:04:04.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:04 smithi037 ceph-mon[31211]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T06:04:04.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:04 smithi117 ceph-mon[35050]: pgmap v272: 33 pgs: 4 creating+peering, 28 unknown, 1 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:04:04.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:04 smithi117 ceph-mon[35050]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T06:04:04.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:04 smithi117 ceph-mon[35050]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T06:04:05.250 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-19T06:04:05.525 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:04:05.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:05 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/2928138771' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-19T06:04:05.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:05 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/2928138771' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-19T06:04:05.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:05 smithi037 ceph-mon[31211]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T06:04:05.688 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:05 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/2928138771' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-19T06:04:05.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:05 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/2928138771' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-19T06:04:05.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:05 smithi099 ceph-mon[35300]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T06:04:05.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:05 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/2928138771' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-19T06:04:05.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:05 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/2928138771' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-19T06:04:05.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:05 smithi117 ceph-mon[35050]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T06:04:06.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:06.029+0000 7f6eb654e640 1 -- 172.21.15.37:0/3930231616 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6eb0101de0 msgr2=0x7f6eb01021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:06.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:06.029+0000 7f6eb654e640 1 --2- 172.21.15.37:0/3930231616 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6eb0101de0 0x7f6eb01021c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6ea0009900 tx=0x7f6ea002a410 comp rx=0 tx=0).stop 2024-09-19T06:04:06.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:06.030+0000 7f6eb654e640 1 -- 172.21.15.37:0/3930231616 shutdown_connections 2024-09-19T06:04:06.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:06.030+0000 7f6eb654e640 1 --2- 172.21.15.37:0/3930231616 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6eb0106f10 0x7f6eb010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:06.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:06.030+0000 7f6eb654e640 1 --2- 172.21.15.37:0/3930231616 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6eb0102790 0x7f6eb01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:06.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:06.030+0000 7f6eb654e640 1 --2- 172.21.15.37:0/3930231616 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6eb0101de0 0x7f6eb01021c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:06.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:06.030+0000 7f6eb654e640 1 -- 172.21.15.37:0/3930231616 >> 172.21.15.37:0/3930231616 conn(0x7f6eb00fd8c0 msgr2=0x7f6eb00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:06.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:06.030+0000 7f6eb654e640 1 -- 172.21.15.37:0/3930231616 shutdown_connections 2024-09-19T06:04:06.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:06.030+0000 7f6eb654e640 1 -- 172.21.15.37:0/3930231616 wait complete. 2024-09-19T06:04:06.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:06.030+0000 7f6eb654e640 1 Processor -- start 2024-09-19T06:04:06.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:06.030+0000 7f6eb654e640 1 -- start start 2024-09-19T06:04:06.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:06.030+0000 7f6eb654e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6eb0101de0 0x7f6eb01985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:06.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:06.030+0000 7f6eb654e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6eb0102790 0x7f6eb0198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:06.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:06.031+0000 7f6eb654e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6eb0106f10 0x7f6eb019ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:06.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:06.031+0000 7f6eb654e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6eb0112010 con 0x7f6eb0102790 2024-09-19T06:04:06.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:06.031+0000 7f6eb654e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f6eb0111e90 con 0x7f6eb0101de0 2024-09-19T06:04:06.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:06.031+0000 7f6eb654e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6eb0112190 con 0x7f6eb0106f10 2024-09-19T06:04:06.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:06.031+0000 7f6ea7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6eb0102790 0x7f6eb0198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:06.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:06.031+0000 7f6ea7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6eb0102790 0x7f6eb0198af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39366/0 (socket says 172.21.15.37:39366) 2024-09-19T06:04:06.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:06.031+0000 7f6ea7fff640 1 -- 172.21.15.37:0/3095645452 learned_addr learned my addr 172.21.15.37:0/3095645452 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:04:06.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:06.031+0000 7f6eb4aeb640 1 --2- 172.21.15.37:0/3095645452 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6eb0106f10 0x7f6eb019ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:06.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:06.031+0000 7f6eaffff640 1 --2- 172.21.15.37:0/3095645452 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6eb0101de0 0x7f6eb01985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:06.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:06.031+0000 7f6ea7fff640 1 -- 172.21.15.37:0/3095645452 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6eb0106f10 msgr2=0x7f6eb019ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:06.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:06.031+0000 7f6ea7fff640 1 --2- 172.21.15.37:0/3095645452 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6eb0106f10 0x7f6eb019ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:06.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:06.031+0000 7f6ea7fff640 1 -- 172.21.15.37:0/3095645452 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6eb0101de0 msgr2=0x7f6eb01985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:06.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:06.031+0000 7f6ea7fff640 1 --2- 172.21.15.37:0/3095645452 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6eb0101de0 0x7f6eb01985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:06.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:06.031+0000 7f6ea7fff640 1 -- 172.21.15.37:0/3095645452 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6eb019d560 con 0x7f6eb0102790 2024-09-19T06:04:06.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:06.031+0000 7f6ea7fff640 1 --2- 172.21.15.37:0/3095645452 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6eb0102790 0x7f6eb0198af0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6e9800b4a0 tx=0x7f6e9800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:06.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:06.031+0000 7f6eadffb640 1 -- 172.21.15.37:0/3095645452 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e98014070 con 0x7f6eb0102790 2024-09-19T06:04:06.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:06.031+0000 7f6eadffb640 1 -- 172.21.15.37:0/3095645452 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e98010af0 con 0x7f6eb0102790 2024-09-19T06:04:06.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:06.031+0000 7f6eadffb640 1 -- 172.21.15.37:0/3095645452 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e98017d10 con 0x7f6eb0102790 2024-09-19T06:04:06.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:06.031+0000 7f6eb654e640 1 -- 172.21.15.37:0/3095645452 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6eb019d850 con 0x7f6eb0102790 2024-09-19T06:04:06.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:06.031+0000 7f6eb654e640 1 -- 172.21.15.37:0/3095645452 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6eb01a5130 con 0x7f6eb0102790 2024-09-19T06:04:06.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:06.033+0000 7f6eb654e640 1 -- 172.21.15.37:0/3095645452 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6eb0102240 con 0x7f6eb0102790 2024-09-19T06:04:06.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:06.034+0000 7f6eadffb640 1 -- 172.21.15.37:0/3095645452 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f6e98017070 con 0x7f6eb0102790 2024-09-19T06:04:06.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:06.035+0000 7f6eadffb640 1 --2- 172.21.15.37:0/3095645452 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f6e9c0a3240 0x7f6e9c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:06.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:06.035+0000 7f6eaffff640 1 --2- 172.21.15.37:0/3095645452 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f6e9c0a3240 0x7f6e9c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:06.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:06.035+0000 7f6eadffb640 1 -- 172.21.15.37:0/3095645452 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7879+0+0 (secure 0 0 0) 0x7f6e980cee90 con 0x7f6eb0102790 2024-09-19T06:04:06.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:06.035+0000 7f6eaffff640 1 --2- 172.21.15.37:0/3095645452 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f6e9c0a3240 0x7f6e9c0a5700 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6ea0000c00 tx=0x7f6ea00058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:06.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:06.039+0000 7f6eadffb640 1 -- 172.21.15.37:0/3095645452 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6e9809b710 con 0x7f6eb0102790 2024-09-19T06:04:06.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:06.251+0000 7f6eb654e640 1 -- 172.21.15.37:0/3095645452 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f6eb0199910 con 0x7f6eb0102790 2024-09-19T06:04:06.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:06.408+0000 7f6eadffb640 1 -- 172.21.15.37:0/3095645452 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f6eb0199910 con 0x7f6eb0102790 2024-09-19T06:04:06.410 INFO:teuthology.orchestra.run.smithi037.stderr:new fs with metadata pool 2 and data pool 3 2024-09-19T06:04:06.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:06.411+0000 7f6eb654e640 1 -- 172.21.15.37:0/3095645452 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f6e9c0a3240 msgr2=0x7f6e9c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:06.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:06.411+0000 7f6eb654e640 1 --2- 172.21.15.37:0/3095645452 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f6e9c0a3240 0x7f6e9c0a5700 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6ea0000c00 tx=0x7f6ea00058d0 comp rx=0 tx=0).stop 2024-09-19T06:04:06.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:06.411+0000 7f6eb654e640 1 -- 172.21.15.37:0/3095645452 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6eb0102790 msgr2=0x7f6eb0198af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:06.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:06.411+0000 7f6eb654e640 1 --2- 172.21.15.37:0/3095645452 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6eb0102790 0x7f6eb0198af0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6e9800b4a0 tx=0x7f6e9800b960 comp rx=0 tx=0).stop 2024-09-19T06:04:06.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:06.411+0000 7f6eb654e640 1 -- 172.21.15.37:0/3095645452 shutdown_connections 2024-09-19T06:04:06.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:06.411+0000 7f6eb654e640 1 --2- 172.21.15.37:0/3095645452 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f6e9c0a3240 0x7f6e9c0a5700 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:06.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:06.411+0000 7f6eb654e640 1 --2- 172.21.15.37:0/3095645452 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6eb0106f10 0x7f6eb019ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:06.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:06.411+0000 7f6eb654e640 1 --2- 172.21.15.37:0/3095645452 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6eb0102790 0x7f6eb0198af0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:06.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:06.411+0000 7f6eb654e640 1 --2- 172.21.15.37:0/3095645452 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6eb0101de0 0x7f6eb01985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:06.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:06.411+0000 7f6eb654e640 1 -- 172.21.15.37:0/3095645452 >> 172.21.15.37:0/3095645452 conn(0x7f6eb00fd8c0 msgr2=0x7f6eb00fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:06.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:06.411+0000 7f6eb654e640 1 -- 172.21.15.37:0/3095645452 shutdown_connections 2024-09-19T06:04:06.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:06.411+0000 7f6eb654e640 1 -- 172.21.15.37:0/3095645452 wait complete. 2024-09-19T06:04:06.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:06 smithi037 ceph-mon[31211]: pgmap v275: 97 pgs: 2 creating+activating, 7 creating+peering, 83 unknown, 5 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:04:06.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:06 smithi037 ceph-mon[31211]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T06:04:06.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:06 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/3095645452' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T06:04:06.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:06 smithi037 ceph-mon[31211]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-19T06:04:06.688 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:06 smithi099 ceph-mon[35300]: pgmap v275: 97 pgs: 2 creating+activating, 7 creating+peering, 83 unknown, 5 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:04:06.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:06 smithi099 ceph-mon[35300]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T06:04:06.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:06 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/3095645452' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T06:04:06.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:06 smithi099 ceph-mon[35300]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-19T06:04:06.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:06 smithi117 ceph-mon[35050]: pgmap v275: 97 pgs: 2 creating+activating, 7 creating+peering, 83 unknown, 5 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:04:06.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:06 smithi117 ceph-mon[35050]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T06:04:06.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:06 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/3095645452' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T06:04:06.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:06 smithi117 ceph-mon[35050]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-19T06:04:07.153 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-19T06:04:07.153 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-19T06:04:07.416 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:04:07.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:07 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/3095645452' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T06:04:07.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:07 smithi099 ceph-mon[35300]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T06:04:07.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:07 smithi099 ceph-mon[35300]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-19T06:04:07.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:07 smithi099 ceph-mon[35300]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-19T06:04:07.691 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:07 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/3095645452' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T06:04:07.691 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:07 smithi037 ceph-mon[31211]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T06:04:07.691 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:07 smithi037 ceph-mon[31211]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-19T06:04:07.691 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:07 smithi037 ceph-mon[31211]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-19T06:04:07.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:07 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/3095645452' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T06:04:07.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:07 smithi117 ceph-mon[35050]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T06:04:07.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:07 smithi117 ceph-mon[35050]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-19T06:04:07.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:07 smithi117 ceph-mon[35050]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-19T06:04:07.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:07.922+0000 7f9b4e7cd640 1 -- 172.21.15.37:0/3594182710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b48102790 msgr2=0x7f9b481067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:07.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:07.922+0000 7f9b4e7cd640 1 --2- 172.21.15.37:0/3594182710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b48102790 0x7f9b481067e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c009900 tx=0x7f9b3c02a410 comp rx=0 tx=0).stop 2024-09-19T06:04:07.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:07.922+0000 7f9b4e7cd640 1 -- 172.21.15.37:0/3594182710 shutdown_connections 2024-09-19T06:04:07.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:07.922+0000 7f9b4e7cd640 1 --2- 172.21.15.37:0/3594182710 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b48106f10 0x7f9b4810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:07.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:07.922+0000 7f9b4e7cd640 1 --2- 172.21.15.37:0/3594182710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b48102790 0x7f9b481067e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:07.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:07.922+0000 7f9b4e7cd640 1 --2- 172.21.15.37:0/3594182710 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b48101de0 0x7f9b481021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:07.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:07.922+0000 7f9b4e7cd640 1 -- 172.21.15.37:0/3594182710 >> 172.21.15.37:0/3594182710 conn(0x7f9b480fd8c0 msgr2=0x7f9b480ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:07.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:07.922+0000 7f9b4e7cd640 1 -- 172.21.15.37:0/3594182710 shutdown_connections 2024-09-19T06:04:07.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:07.922+0000 7f9b4e7cd640 1 -- 172.21.15.37:0/3594182710 wait complete. 2024-09-19T06:04:07.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:07.923+0000 7f9b4e7cd640 1 Processor -- start 2024-09-19T06:04:07.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:07.923+0000 7f9b4e7cd640 1 -- start start 2024-09-19T06:04:07.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:07.923+0000 7f9b4e7cd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b48101de0 0x7f9b480744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:07.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:07.923+0000 7f9b4e7cd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b48102790 0x7f9b48074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:07.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:07.923+0000 7f9b4e7cd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b48106f10 0x7f9b48074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:07.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:07.923+0000 7f9b4e7cd640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9b48111f90 con 0x7f9b48101de0 2024-09-19T06:04:07.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:07.923+0000 7f9b4e7cd640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f9b48111e10 con 0x7f9b48102790 2024-09-19T06:04:07.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:07.923+0000 7f9b4e7cd640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9b48112110 con 0x7f9b48106f10 2024-09-19T06:04:07.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:07.923+0000 7f9b47fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b48101de0 0x7f9b480744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:07.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:07.923+0000 7f9b47fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b48101de0 0x7f9b480744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39388/0 (socket says 172.21.15.37:39388) 2024-09-19T06:04:07.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:07.923+0000 7f9b47fff640 1 -- 172.21.15.37:0/646057895 learned_addr learned my addr 172.21.15.37:0/646057895 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:04:07.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:07.924+0000 7f9b477fe640 1 --2- 172.21.15.37:0/646057895 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b48102790 0x7f9b48074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:07.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:07.924+0000 7f9b4cd6a640 1 --2- 172.21.15.37:0/646057895 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b48106f10 0x7f9b48074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:07.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:07.924+0000 7f9b47fff640 1 -- 172.21.15.37:0/646057895 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b48106f10 msgr2=0x7f9b48074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:07.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:07.924+0000 7f9b47fff640 1 --2- 172.21.15.37:0/646057895 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b48106f10 0x7f9b48074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:07.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:07.924+0000 7f9b47fff640 1 -- 172.21.15.37:0/646057895 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b48102790 msgr2=0x7f9b48074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:07.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:07.924+0000 7f9b47fff640 1 --2- 172.21.15.37:0/646057895 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b48102790 0x7f9b48074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:07.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:07.924+0000 7f9b47fff640 1 -- 172.21.15.37:0/646057895 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b481a69e0 con 0x7f9b48101de0 2024-09-19T06:04:07.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:07.924+0000 7f9b4cd6a640 1 --2- 172.21.15.37:0/646057895 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b48106f10 0x7f9b48074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:04:07.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:07.924+0000 7f9b47fff640 1 --2- 172.21.15.37:0/646057895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b48101de0 0x7f9b480744f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9b3800d950 tx=0x7f9b3800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:07.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:07.924+0000 7f9b457fa640 1 -- 172.21.15.37:0/646057895 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b38017070 con 0x7f9b48101de0 2024-09-19T06:04:07.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:07.924+0000 7f9b4e7cd640 1 -- 172.21.15.37:0/646057895 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b481a6cd0 con 0x7f9b48101de0 2024-09-19T06:04:07.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:07.924+0000 7f9b457fa640 1 -- 172.21.15.37:0/646057895 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9b38009c30 con 0x7f9b48101de0 2024-09-19T06:04:07.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:07.924+0000 7f9b457fa640 1 -- 172.21.15.37:0/646057895 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b3800f6b0 con 0x7f9b48101de0 2024-09-19T06:04:07.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:07.924+0000 7f9b4e7cd640 1 -- 172.21.15.37:0/646057895 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b481a7200 con 0x7f9b48101de0 2024-09-19T06:04:07.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:07.925+0000 7f9b4e7cd640 1 -- 172.21.15.37:0/646057895 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b481021c0 con 0x7f9b48101de0 2024-09-19T06:04:07.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:07.926+0000 7f9b457fa640 1 -- 172.21.15.37:0/646057895 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f9b380109d0 con 0x7f9b48101de0 2024-09-19T06:04:07.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:07.927+0000 7f9b457fa640 1 --2- 172.21.15.37:0/646057895 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f9b300a3240 0x7f9b300a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:07.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:07.927+0000 7f9b477fe640 1 --2- 172.21.15.37:0/646057895 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f9b300a3240 0x7f9b300a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:07.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:07.927+0000 7f9b457fa640 1 -- 172.21.15.37:0/646057895 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f9b380cf530 con 0x7f9b48101de0 2024-09-19T06:04:07.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:07.928+0000 7f9b477fe640 1 --2- 172.21.15.37:0/646057895 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f9b300a3240 0x7f9b300a5700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9b481087b0 tx=0x7f9b3c005a20 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:07.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:07.930+0000 7f9b457fa640 1 -- 172.21.15.37:0/646057895 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9b38009de0 con 0x7f9b48101de0 2024-09-19T06:04:08.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:08.115+0000 7f9b4e7cd640 1 -- 172.21.15.37:0/646057895 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f9b4810a180 con 0x7f9b48101de0 2024-09-19T06:04:08.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:08.426+0000 7f9b457fa640 1 -- 172.21.15.37:0/646057895 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v82) ==== 157+0+0 (secure 0 0 0) 0x7f9b3809c300 con 0x7f9b48101de0 2024-09-19T06:04:08.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:08.429+0000 7f9b4e7cd640 1 -- 172.21.15.37:0/646057895 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f9b300a3240 msgr2=0x7f9b300a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:08.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:08.429+0000 7f9b4e7cd640 1 --2- 172.21.15.37:0/646057895 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f9b300a3240 0x7f9b300a5700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9b481087b0 tx=0x7f9b3c005a20 comp rx=0 tx=0).stop 2024-09-19T06:04:08.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:08.429+0000 7f9b4e7cd640 1 -- 172.21.15.37:0/646057895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b48101de0 msgr2=0x7f9b480744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:08.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:08.429+0000 7f9b4e7cd640 1 --2- 172.21.15.37:0/646057895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b48101de0 0x7f9b480744f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9b3800d950 tx=0x7f9b3800de10 comp rx=0 tx=0).stop 2024-09-19T06:04:08.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:08.429+0000 7f9b4e7cd640 1 -- 172.21.15.37:0/646057895 shutdown_connections 2024-09-19T06:04:08.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:08.429+0000 7f9b4e7cd640 1 --2- 172.21.15.37:0/646057895 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f9b300a3240 0x7f9b300a5700 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:08.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:08.429+0000 7f9b4e7cd640 1 --2- 172.21.15.37:0/646057895 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b48102790 0x7f9b48074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:08.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:08.429+0000 7f9b4e7cd640 1 --2- 172.21.15.37:0/646057895 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b48106f10 0x7f9b48074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:08.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:08.429+0000 7f9b4e7cd640 1 --2- 172.21.15.37:0/646057895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b48101de0 0x7f9b480744f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:08.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:08.429+0000 7f9b4e7cd640 1 -- 172.21.15.37:0/646057895 >> 172.21.15.37:0/646057895 conn(0x7f9b480fd8c0 msgr2=0x7f9b480fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:08.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:08.429+0000 7f9b4e7cd640 1 -- 172.21.15.37:0/646057895 shutdown_connections 2024-09-19T06:04:08.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:08.429+0000 7f9b4e7cd640 1 -- 172.21.15.37:0/646057895 wait complete. 2024-09-19T06:04:08.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:08 smithi099 ceph-mon[35300]: pgmap v278: 97 pgs: 2 creating+activating, 7 creating+peering, 37 unknown, 51 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 1 op/s 2024-09-19T06:04:08.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:08 smithi099 ceph-mon[35300]: mds.? [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] up:active 2024-09-19T06:04:08.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:08 smithi099 ceph-mon[35300]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T06:04:08.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:08 smithi099 ceph-mon[35300]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T06:04:08.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:08 smithi099 ceph-mon[35300]: Cluster is now healthy 2024-09-19T06:04:08.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:08 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/646057895' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-19T06:04:08.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:08 smithi117 ceph-mon[35050]: pgmap v278: 97 pgs: 2 creating+activating, 7 creating+peering, 37 unknown, 51 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 1 op/s 2024-09-19T06:04:08.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:08 smithi117 ceph-mon[35050]: mds.? [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] up:active 2024-09-19T06:04:08.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:08 smithi117 ceph-mon[35050]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T06:04:08.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:08 smithi117 ceph-mon[35050]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T06:04:08.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:08 smithi117 ceph-mon[35050]: Cluster is now healthy 2024-09-19T06:04:08.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:08 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/646057895' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-19T06:04:08.810 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:08 smithi037 ceph-mon[31211]: pgmap v278: 97 pgs: 2 creating+activating, 7 creating+peering, 37 unknown, 51 active+clean; 577 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 1 op/s 2024-09-19T06:04:08.810 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:08 smithi037 ceph-mon[31211]: mds.? [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] up:active 2024-09-19T06:04:08.810 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:08 smithi037 ceph-mon[31211]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T06:04:08.810 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:08 smithi037 ceph-mon[31211]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T06:04:08.810 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:08 smithi037 ceph-mon[31211]: Cluster is now healthy 2024-09-19T06:04:08.810 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:08 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/646057895' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-19T06:04:09.179 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-19T06:04:09.446 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:04:09.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:09 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/646057895' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-19T06:04:09.689 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:09 smithi099 ceph-mon[35300]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T06:04:09.702 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:09 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/646057895' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-19T06:04:09.702 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:09 smithi037 ceph-mon[31211]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T06:04:09.749 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:09 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/646057895' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-19T06:04:09.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:09 smithi117 ceph-mon[35050]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T06:04:09.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:09.935+0000 7f479e9b1640 1 -- 172.21.15.37:0/1648822901 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47981036c0 msgr2=0x7f479810bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:09.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:09.935+0000 7f479e9b1640 1 --2- 172.21.15.37:0/1648822901 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47981036c0 0x7f479810bbb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f478c009900 tx=0x7f478c02a480 comp rx=0 tx=0).stop 2024-09-19T06:04:09.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:09.935+0000 7f479e9b1640 1 -- 172.21.15.37:0/1648822901 shutdown_connections 2024-09-19T06:04:09.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:09.935+0000 7f479e9b1640 1 --2- 172.21.15.37:0/1648822901 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f479810c180 0x7f479810e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:09.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:09.935+0000 7f479e9b1640 1 --2- 172.21.15.37:0/1648822901 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47981036c0 0x7f479810bbb0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:09.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:09.935+0000 7f479e9b1640 1 --2- 172.21.15.37:0/1648822901 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4798102da0 0x7f4798103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:09.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:09.935+0000 7f479e9b1640 1 -- 172.21.15.37:0/1648822901 >> 172.21.15.37:0/1648822901 conn(0x7f47980fc7a0 msgr2=0x7f47980febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:09.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:09.935+0000 7f479e9b1640 1 -- 172.21.15.37:0/1648822901 shutdown_connections 2024-09-19T06:04:09.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:09.935+0000 7f479e9b1640 1 -- 172.21.15.37:0/1648822901 wait complete. 2024-09-19T06:04:09.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:09.936+0000 7f479e9b1640 1 Processor -- start 2024-09-19T06:04:09.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:09.936+0000 7f479e9b1640 1 -- start start 2024-09-19T06:04:09.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:09.936+0000 7f479e9b1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4798102da0 0x7f4798198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:09.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:09.936+0000 7f479e9b1640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47981036c0 0x7f4798198b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:09.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:09.936+0000 7f479e9b1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f479810c180 0x7f479819ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:09.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:09.936+0000 7f479e9b1640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4798112020 con 0x7f4798102da0 2024-09-19T06:04:09.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:09.936+0000 7f479e9b1640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f4798111ea0 con 0x7f47981036c0 2024-09-19T06:04:09.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:09.936+0000 7f479e9b1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f47981121a0 con 0x7f479810c180 2024-09-19T06:04:09.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:09.936+0000 7f4797fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4798102da0 0x7f4798198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:09.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:09.936+0000 7f4797fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4798102da0 0x7f4798198600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39398/0 (socket says 172.21.15.37:39398) 2024-09-19T06:04:09.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:09.936+0000 7f4797fff640 1 -- 172.21.15.37:0/3760426762 learned_addr learned my addr 172.21.15.37:0/3760426762 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:04:09.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:09.936+0000 7f47977fe640 1 --2- 172.21.15.37:0/3760426762 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47981036c0 0x7f4798198b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:09.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:09.936+0000 7f479cf4e640 1 --2- 172.21.15.37:0/3760426762 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f479810c180 0x7f479819ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:09.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:09.937+0000 7f4797fff640 1 -- 172.21.15.37:0/3760426762 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f479810c180 msgr2=0x7f479819ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:09.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:09.937+0000 7f4797fff640 1 --2- 172.21.15.37:0/3760426762 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f479810c180 0x7f479819ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:09.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:09.937+0000 7f4797fff640 1 -- 172.21.15.37:0/3760426762 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47981036c0 msgr2=0x7f4798198b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:09.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:09.937+0000 7f4797fff640 1 --2- 172.21.15.37:0/3760426762 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47981036c0 0x7f4798198b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:09.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:09.937+0000 7f4797fff640 1 -- 172.21.15.37:0/3760426762 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f479819d5b0 con 0x7f4798102da0 2024-09-19T06:04:09.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:09.937+0000 7f479cf4e640 1 --2- 172.21.15.37:0/3760426762 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f479810c180 0x7f479819ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:04:09.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:09.937+0000 7f4797fff640 1 --2- 172.21.15.37:0/3760426762 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4798102da0 0x7f4798198600 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f478800b4a0 tx=0x7f478800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:09.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:09.937+0000 7f47957fa640 1 -- 172.21.15.37:0/3760426762 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4788014070 con 0x7f4798102da0 2024-09-19T06:04:09.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:09.937+0000 7f47957fa640 1 -- 172.21.15.37:0/3760426762 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4788010af0 con 0x7f4798102da0 2024-09-19T06:04:09.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:09.937+0000 7f479e9b1640 1 -- 172.21.15.37:0/3760426762 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f479819d8a0 con 0x7f4798102da0 2024-09-19T06:04:09.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:09.937+0000 7f47957fa640 1 -- 172.21.15.37:0/3760426762 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4788017d10 con 0x7f4798102da0 2024-09-19T06:04:09.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:09.937+0000 7f479e9b1640 1 -- 172.21.15.37:0/3760426762 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47981a5180 con 0x7f4798102da0 2024-09-19T06:04:09.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:09.938+0000 7f479e9b1640 1 -- 172.21.15.37:0/3760426762 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4798103200 con 0x7f4798102da0 2024-09-19T06:04:09.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:09.939+0000 7f47957fa640 1 -- 172.21.15.37:0/3760426762 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f4788017070 con 0x7f4798102da0 2024-09-19T06:04:09.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:09.940+0000 7f47957fa640 1 --2- 172.21.15.37:0/3760426762 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f47800a32c0 0x7f47800a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:09.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:09.940+0000 7f47977fe640 1 --2- 172.21.15.37:0/3760426762 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f47800a32c0 0x7f47800a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:09.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:09.940+0000 7f47957fa640 1 -- 172.21.15.37:0/3760426762 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8277+0+0 (secure 0 0 0) 0x7f47880cec30 con 0x7f4798102da0 2024-09-19T06:04:09.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:09.940+0000 7f47977fe640 1 --2- 172.21.15.37:0/3760426762 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f47800a32c0 0x7f47800a5780 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f478c000c00 tx=0x7f478c0058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:09.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:09.944+0000 7f47957fa640 1 -- 172.21.15.37:0/3760426762 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f478809b920 con 0x7f4798102da0 2024-09-19T06:04:10.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:10.121+0000 7f479e9b1640 1 -- 172.21.15.37:0/3760426762 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f47981071c0 con 0x7f4798102da0 2024-09-19T06:04:10.881 INFO:journalctl@ceph.mds.b.smithi099.stdout:Sep 19 06:04:10 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-b[65353]: 2024-09-19T06:04:10.524+0000 7f6efe34c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T06:04:11.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:10 smithi099 ceph-mon[35300]: pgmap v280: 97 pgs: 9 unknown, 88 active+clean; 578 KiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 8 op/s 2024-09-19T06:04:11.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:10 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/3760426762' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T06:04:11.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:10 smithi117 ceph-mon[35050]: pgmap v280: 97 pgs: 9 unknown, 88 active+clean; 578 KiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 8 op/s 2024-09-19T06:04:11.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:10 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/3760426762' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T06:04:11.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:10 smithi037 ceph-mon[31211]: pgmap v280: 97 pgs: 9 unknown, 88 active+clean; 578 KiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 8 op/s 2024-09-19T06:04:11.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:10 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/3760426762' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T06:04:11.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:11.447+0000 7f47957fa640 1 -- 172.21.15.37:0/3760426762 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v84) ==== 228+0+0 (secure 0 0 0) 0x7f478809b220 con 0x7f4798102da0 2024-09-19T06:04:11.450 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data_ec' created 2024-09-19T06:04:11.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:11.451+0000 7f479e9b1640 1 -- 172.21.15.37:0/3760426762 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f47800a32c0 msgr2=0x7f47800a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:11.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:11.451+0000 7f479e9b1640 1 --2- 172.21.15.37:0/3760426762 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f47800a32c0 0x7f47800a5780 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f478c000c00 tx=0x7f478c0058d0 comp rx=0 tx=0).stop 2024-09-19T06:04:11.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:11.451+0000 7f479e9b1640 1 -- 172.21.15.37:0/3760426762 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4798102da0 msgr2=0x7f4798198600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:11.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:11.451+0000 7f479e9b1640 1 --2- 172.21.15.37:0/3760426762 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4798102da0 0x7f4798198600 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f478800b4a0 tx=0x7f478800b960 comp rx=0 tx=0).stop 2024-09-19T06:04:11.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:11.451+0000 7f479e9b1640 1 -- 172.21.15.37:0/3760426762 shutdown_connections 2024-09-19T06:04:11.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:11.451+0000 7f479e9b1640 1 --2- 172.21.15.37:0/3760426762 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f47800a32c0 0x7f47800a5780 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:11.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:11.451+0000 7f479e9b1640 1 --2- 172.21.15.37:0/3760426762 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47981036c0 0x7f4798198b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:11.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:11.451+0000 7f479e9b1640 1 --2- 172.21.15.37:0/3760426762 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f479810c180 0x7f479819ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:11.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:11.451+0000 7f479e9b1640 1 --2- 172.21.15.37:0/3760426762 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4798102da0 0x7f4798198600 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:11.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:11.451+0000 7f479e9b1640 1 -- 172.21.15.37:0/3760426762 >> 172.21.15.37:0/3760426762 conn(0x7f47980fc7a0 msgr2=0x7f47980fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:11.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:11.451+0000 7f479e9b1640 1 -- 172.21.15.37:0/3760426762 shutdown_connections 2024-09-19T06:04:11.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:11.451+0000 7f479e9b1640 1 -- 172.21.15.37:0/3760426762 wait complete. 2024-09-19T06:04:12.160 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:11 smithi037 ceph-mon[31211]: pgmap v282: 97 pgs: 97 active+clean; 579 KiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 8 op/s 2024-09-19T06:04:12.160 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:11 smithi037 ceph-mon[31211]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T06:04:12.160 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:11 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/3760426762' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T06:04:12.160 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:11 smithi037 ceph-mon[31211]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T06:04:12.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:11 smithi099 ceph-mon[35300]: pgmap v282: 97 pgs: 97 active+clean; 579 KiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 8 op/s 2024-09-19T06:04:12.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:11 smithi099 ceph-mon[35300]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T06:04:12.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:11 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/3760426762' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T06:04:12.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:11 smithi099 ceph-mon[35300]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T06:04:12.196 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-19T06:04:12.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:11 smithi117 ceph-mon[35050]: pgmap v282: 97 pgs: 97 active+clean; 579 KiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 8 op/s 2024-09-19T06:04:12.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:11 smithi117 ceph-mon[35050]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T06:04:12.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:11 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/3760426762' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T06:04:12.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:11 smithi117 ceph-mon[35050]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T06:04:12.477 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:04:12.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:12.940+0000 7fc1700dd640 1 -- 172.21.15.37:0/3415674209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc168100a80 msgr2=0x7fc168100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:12.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:12.940+0000 7fc1700dd640 1 --2- 172.21.15.37:0/3415674209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc168100a80 0x7fc168100ee0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc158009930 tx=0x7fc15802a420 comp rx=0 tx=0).stop 2024-09-19T06:04:12.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:12.940+0000 7fc1700dd640 1 -- 172.21.15.37:0/3415674209 shutdown_connections 2024-09-19T06:04:12.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:12.940+0000 7fc1700dd640 1 --2- 172.21.15.37:0/3415674209 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc168101420 0x7fc16810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:12.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:12.940+0000 7fc1700dd640 1 --2- 172.21.15.37:0/3415674209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc168100a80 0x7fc168100ee0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:12.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:12.940+0000 7fc1700dd640 1 --2- 172.21.15.37:0/3415674209 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc168106a80 0x7fc168106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:12.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:12.940+0000 7fc1700dd640 1 -- 172.21.15.37:0/3415674209 >> 172.21.15.37:0/3415674209 conn(0x7fc1680fc7a0 msgr2=0x7fc1680febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:12.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:12.940+0000 7fc1700dd640 1 -- 172.21.15.37:0/3415674209 shutdown_connections 2024-09-19T06:04:12.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:12.940+0000 7fc1700dd640 1 -- 172.21.15.37:0/3415674209 wait complete. 2024-09-19T06:04:12.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:12.941+0000 7fc1700dd640 1 Processor -- start 2024-09-19T06:04:12.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:12.941+0000 7fc1700dd640 1 -- start start 2024-09-19T06:04:12.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:12.941+0000 7fc1700dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc168100a80 0x7fc1681992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:12.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:12.941+0000 7fc1700dd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc168101420 0x7fc168199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:12.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:12.941+0000 7fc1700dd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc168106a80 0x7fc1681a4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:12.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:12.941+0000 7fc1700dd640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc168110e80 con 0x7fc168100a80 2024-09-19T06:04:12.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:12.941+0000 7fc1700dd640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc168110d00 con 0x7fc168101420 2024-09-19T06:04:12.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:12.941+0000 7fc1700dd640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc168111000 con 0x7fc168106a80 2024-09-19T06:04:12.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:12.941+0000 7fc16de79640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc168100a80 0x7fc1681992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:12.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:12.941+0000 7fc16de79640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc168100a80 0x7fc1681992d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39408/0 (socket says 172.21.15.37:39408) 2024-09-19T06:04:12.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:12.941+0000 7fc16de79640 1 -- 172.21.15.37:0/4161596321 learned_addr learned my addr 172.21.15.37:0/4161596321 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:04:12.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:12.941+0000 7fc16d678640 1 --2- 172.21.15.37:0/4161596321 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc168101420 0x7fc168199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:12.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:12.942+0000 7fc16e67a640 1 --2- 172.21.15.37:0/4161596321 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc168106a80 0x7fc1681a4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:12.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:12.942+0000 7fc16de79640 1 -- 172.21.15.37:0/4161596321 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc168106a80 msgr2=0x7fc1681a4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:12.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:12.942+0000 7fc16de79640 1 --2- 172.21.15.37:0/4161596321 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc168106a80 0x7fc1681a4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:12.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:12.942+0000 7fc16de79640 1 -- 172.21.15.37:0/4161596321 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc168101420 msgr2=0x7fc168199810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:12.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:12.942+0000 7fc16de79640 1 --2- 172.21.15.37:0/4161596321 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc168101420 0x7fc168199810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:12.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:12.942+0000 7fc16de79640 1 -- 172.21.15.37:0/4161596321 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1681a4890 con 0x7fc168100a80 2024-09-19T06:04:12.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:12.942+0000 7fc16de79640 1 --2- 172.21.15.37:0/4161596321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc168100a80 0x7fc1681992d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc16400d770 tx=0x7fc16400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:12.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:12.942+0000 7fc15effd640 1 -- 172.21.15.37:0/4161596321 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc164017070 con 0x7fc168100a80 2024-09-19T06:04:12.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:12.942+0000 7fc15effd640 1 -- 172.21.15.37:0/4161596321 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc164005500 con 0x7fc168100a80 2024-09-19T06:04:12.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:12.942+0000 7fc1700dd640 1 -- 172.21.15.37:0/4161596321 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1681a4a60 con 0x7fc168100a80 2024-09-19T06:04:12.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:12.942+0000 7fc15effd640 1 -- 172.21.15.37:0/4161596321 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc164004e00 con 0x7fc168100a80 2024-09-19T06:04:12.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:12.942+0000 7fc1700dd640 1 -- 172.21.15.37:0/4161596321 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1681a4f20 con 0x7fc168100a80 2024-09-19T06:04:12.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:12.943+0000 7fc1700dd640 1 -- 172.21.15.37:0/4161596321 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc168100ee0 con 0x7fc168100a80 2024-09-19T06:04:12.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:12.944+0000 7fc15effd640 1 -- 172.21.15.37:0/4161596321 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fc164004fa0 con 0x7fc168100a80 2024-09-19T06:04:12.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:12.945+0000 7fc15effd640 1 --2- 172.21.15.37:0/4161596321 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fc1540a32c0 0x7fc1540a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:12.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:12.945+0000 7fc16d678640 1 --2- 172.21.15.37:0/4161596321 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fc1540a32c0 0x7fc1540a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:12.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:12.945+0000 7fc15effd640 1 -- 172.21.15.37:0/4161596321 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8770+0+0 (secure 0 0 0) 0x7fc1640cf530 con 0x7fc168100a80 2024-09-19T06:04:12.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:12.946+0000 7fc16d678640 1 --2- 172.21.15.37:0/4161596321 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fc1540a32c0 0x7fc1540a5780 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc158009900 tx=0x7fc1580058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:12.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:12.950+0000 7fc15effd640 1 -- 172.21.15.37:0/4161596321 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc16409bfd0 con 0x7fc168100a80 2024-09-19T06:04:13.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:13.124+0000 7fc1700dd640 1 -- 172.21.15.37:0/4161596321 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7fc168108a80 con 0x7fc168100a80 2024-09-19T06:04:13.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:13.454+0000 7fc15effd640 1 -- 172.21.15.37:0/4161596321 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v86) ==== 169+0+0 (secure 0 0 0) 0x7fc16409b8d0 con 0x7fc168100a80 2024-09-19T06:04:13.457 INFO:teuthology.orchestra.run.smithi037.stderr:set pool 4 allow_ec_overwrites to true 2024-09-19T06:04:13.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:13.457+0000 7fc1700dd640 1 -- 172.21.15.37:0/4161596321 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fc1540a32c0 msgr2=0x7fc1540a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:13.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:13.457+0000 7fc1700dd640 1 --2- 172.21.15.37:0/4161596321 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fc1540a32c0 0x7fc1540a5780 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc158009900 tx=0x7fc1580058d0 comp rx=0 tx=0).stop 2024-09-19T06:04:13.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:13.457+0000 7fc1700dd640 1 -- 172.21.15.37:0/4161596321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc168100a80 msgr2=0x7fc1681992d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:13.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:13.457+0000 7fc1700dd640 1 --2- 172.21.15.37:0/4161596321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc168100a80 0x7fc1681992d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc16400d770 tx=0x7fc16400dc30 comp rx=0 tx=0).stop 2024-09-19T06:04:13.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:13.457+0000 7fc1700dd640 1 -- 172.21.15.37:0/4161596321 shutdown_connections 2024-09-19T06:04:13.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:13.457+0000 7fc1700dd640 1 --2- 172.21.15.37:0/4161596321 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fc1540a32c0 0x7fc1540a5780 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:13.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:13.457+0000 7fc1700dd640 1 --2- 172.21.15.37:0/4161596321 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc168101420 0x7fc168199810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:13.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:13.457+0000 7fc1700dd640 1 --2- 172.21.15.37:0/4161596321 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc168106a80 0x7fc1681a4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:13.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:13.457+0000 7fc1700dd640 1 --2- 172.21.15.37:0/4161596321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc168100a80 0x7fc1681992d0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:13.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:13.457+0000 7fc1700dd640 1 -- 172.21.15.37:0/4161596321 >> 172.21.15.37:0/4161596321 conn(0x7fc1680fc7a0 msgr2=0x7fc1680fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:13.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:13.457+0000 7fc1700dd640 1 -- 172.21.15.37:0/4161596321 shutdown_connections 2024-09-19T06:04:13.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:13.457+0000 7fc1700dd640 1 -- 172.21.15.37:0/4161596321 wait complete. 2024-09-19T06:04:13.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:13 smithi117 ceph-mon[35050]: osdmap e85: 12 total, 12 up, 12 in 2024-09-19T06:04:13.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:13 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/4161596321' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-19T06:04:13.761 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:13 smithi037 ceph-mon[31211]: osdmap e85: 12 total, 12 up, 12 in 2024-09-19T06:04:13.762 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:13 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/4161596321' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-19T06:04:13.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:13 smithi099 ceph-mon[35300]: osdmap e85: 12 total, 12 up, 12 in 2024-09-19T06:04:13.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:13 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/4161596321' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-19T06:04:14.199 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-19T06:04:14.458 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:14 smithi037 ceph-mon[31211]: pgmap v285: 129 pgs: 8 creating+peering, 23 unknown, 98 active+clean; 579 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 1 op/s 2024-09-19T06:04:14.458 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:14 smithi037 ceph-mon[31211]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T06:04:14.458 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:14 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/4161596321' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-19T06:04:14.458 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:14 smithi037 ceph-mon[31211]: osdmap e86: 12 total, 12 up, 12 in 2024-09-19T06:04:14.466 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:04:14.749 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:14 smithi117 ceph-mon[35050]: pgmap v285: 129 pgs: 8 creating+peering, 23 unknown, 98 active+clean; 579 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 1 op/s 2024-09-19T06:04:14.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:14 smithi117 ceph-mon[35050]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T06:04:14.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:14 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/4161596321' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-19T06:04:14.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:14 smithi117 ceph-mon[35050]: osdmap e86: 12 total, 12 up, 12 in 2024-09-19T06:04:14.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:14 smithi099 ceph-mon[35300]: pgmap v285: 129 pgs: 8 creating+peering, 23 unknown, 98 active+clean; 579 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 1 op/s 2024-09-19T06:04:14.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:14 smithi099 ceph-mon[35300]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T06:04:14.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:14 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/4161596321' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-19T06:04:14.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:14 smithi099 ceph-mon[35300]: osdmap e86: 12 total, 12 up, 12 in 2024-09-19T06:04:14.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:14.981+0000 7fd00c7e7640 1 -- 172.21.15.37:0/1388120934 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd004100a80 msgr2=0x7fd004100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:14.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:14.981+0000 7fd00c7e7640 1 --2- 172.21.15.37:0/1388120934 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd004100a80 0x7fd004100ee0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fcff4009930 tx=0x7fcff402a420 comp rx=0 tx=0).stop 2024-09-19T06:04:14.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:14.981+0000 7fd00c7e7640 1 -- 172.21.15.37:0/1388120934 shutdown_connections 2024-09-19T06:04:14.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:14.981+0000 7fd00c7e7640 1 --2- 172.21.15.37:0/1388120934 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd004101420 0x7fd00410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:14.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:14.981+0000 7fd00c7e7640 1 --2- 172.21.15.37:0/1388120934 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd004100a80 0x7fd004100ee0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:14.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:14.981+0000 7fd00c7e7640 1 --2- 172.21.15.37:0/1388120934 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd004106a80 0x7fd004106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:14.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:14.981+0000 7fd00c7e7640 1 -- 172.21.15.37:0/1388120934 >> 172.21.15.37:0/1388120934 conn(0x7fd0040fc7a0 msgr2=0x7fd0040febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:14.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:14.981+0000 7fd00c7e7640 1 -- 172.21.15.37:0/1388120934 shutdown_connections 2024-09-19T06:04:14.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:14.981+0000 7fd00c7e7640 1 -- 172.21.15.37:0/1388120934 wait complete. 2024-09-19T06:04:14.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:14.982+0000 7fd00c7e7640 1 Processor -- start 2024-09-19T06:04:14.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:14.982+0000 7fd00c7e7640 1 -- start start 2024-09-19T06:04:14.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:14.982+0000 7fd00c7e7640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd004100a80 0x7fd004198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:14.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:14.982+0000 7fd00c7e7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd004101420 0x7fd004198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:15.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:14.982+0000 7fd00c7e7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd004106a80 0x7fd00419cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:15.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:14.982+0000 7fd00c7e7640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd004110e80 con 0x7fd004101420 2024-09-19T06:04:15.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:14.982+0000 7fd00c7e7640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fd004110d00 con 0x7fd004100a80 2024-09-19T06:04:15.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:14.982+0000 7fd00c7e7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd004111000 con 0x7fd004106a80 2024-09-19T06:04:15.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:14.982+0000 7fd009d82640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd004101420 0x7fd004198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:15.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:14.982+0000 7fd009d82640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd004101420 0x7fd004198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35852/0 (socket says 172.21.15.37:35852) 2024-09-19T06:04:15.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:14.982+0000 7fd009d82640 1 -- 172.21.15.37:0/2248648439 learned_addr learned my addr 172.21.15.37:0/2248648439 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:04:15.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:14.982+0000 7fd00a583640 1 --2- 172.21.15.37:0/2248648439 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd004100a80 0x7fd004198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:15.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:14.982+0000 7fd00ad84640 1 --2- 172.21.15.37:0/2248648439 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd004106a80 0x7fd00419cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:15.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:14.983+0000 7fd009d82640 1 -- 172.21.15.37:0/2248648439 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd004106a80 msgr2=0x7fd00419cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:15.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:14.983+0000 7fd009d82640 1 --2- 172.21.15.37:0/2248648439 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd004106a80 0x7fd00419cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:15.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:14.983+0000 7fd009d82640 1 -- 172.21.15.37:0/2248648439 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd004100a80 msgr2=0x7fd004198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:15.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:14.983+0000 7fd009d82640 1 --2- 172.21.15.37:0/2248648439 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd004100a80 0x7fd004198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:15.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:14.983+0000 7fd009d82640 1 -- 172.21.15.37:0/2248648439 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd00419d3e0 con 0x7fd004101420 2024-09-19T06:04:15.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:14.983+0000 7fd009d82640 1 --2- 172.21.15.37:0/2248648439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd004101420 0x7fd004198970 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fcff4009230 tx=0x7fcff4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:15.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:14.983+0000 7fcffb7fe640 1 -- 172.21.15.37:0/2248648439 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff403f030 con 0x7fd004101420 2024-09-19T06:04:15.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:14.983+0000 7fcffb7fe640 1 -- 172.21.15.37:0/2248648439 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcff4003ad0 con 0x7fd004101420 2024-09-19T06:04:15.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:14.983+0000 7fd00c7e7640 1 -- 172.21.15.37:0/2248648439 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd00419d670 con 0x7fd004101420 2024-09-19T06:04:15.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:14.983+0000 7fcffb7fe640 1 -- 172.21.15.37:0/2248648439 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff4035070 con 0x7fd004101420 2024-09-19T06:04:15.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:14.983+0000 7fd00c7e7640 1 -- 172.21.15.37:0/2248648439 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0041a4fb0 con 0x7fd004101420 2024-09-19T06:04:15.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:14.984+0000 7fd00c7e7640 1 -- 172.21.15.37:0/2248648439 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0041021c0 con 0x7fd004101420 2024-09-19T06:04:15.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:14.986+0000 7fcffb7fe640 1 -- 172.21.15.37:0/2248648439 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fcff4042030 con 0x7fd004101420 2024-09-19T06:04:15.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:14.987+0000 7fcffb7fe640 1 --2- 172.21.15.37:0/2248648439 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fcff00a32c0 0x7fcff00a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:15.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:14.987+0000 7fd00a583640 1 --2- 172.21.15.37:0/2248648439 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fcff00a32c0 0x7fcff00a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:15.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:14.987+0000 7fcffb7fe640 1 -- 172.21.15.37:0/2248648439 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8770+0+0 (secure 0 0 0) 0x7fcff40f03b0 con 0x7fd004101420 2024-09-19T06:04:15.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:14.987+0000 7fd00a583640 1 --2- 172.21.15.37:0/2248648439 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fcff00a32c0 0x7fcff00a5780 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd00000bb60 tx=0x7fd00000b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:15.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:14.990+0000 7fcffb7fe640 1 -- 172.21.15.37:0/2248648439 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcff40bc800 con 0x7fd004101420 2024-09-19T06:04:15.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:15.204+0000 7fd00c7e7640 1 -- 172.21.15.37:0/2248648439 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7fd004100ee0 con 0x7fd004101420 2024-09-19T06:04:15.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:15.467+0000 7fcffb7fe640 1 -- 172.21.15.37:0/2248648439 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v16) ==== 137+0+0 (secure 0 0 0) 0x7fd004100ee0 con 0x7fd004101420 2024-09-19T06:04:15.469 INFO:teuthology.orchestra.run.smithi037.stderr:added data pool 4 to fsmap 2024-09-19T06:04:15.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:15.470+0000 7fd00c7e7640 1 -- 172.21.15.37:0/2248648439 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fcff00a32c0 msgr2=0x7fcff00a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:15.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:15.470+0000 7fd00c7e7640 1 --2- 172.21.15.37:0/2248648439 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fcff00a32c0 0x7fcff00a5780 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd00000bb60 tx=0x7fd00000b390 comp rx=0 tx=0).stop 2024-09-19T06:04:15.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:15.470+0000 7fd00c7e7640 1 -- 172.21.15.37:0/2248648439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd004101420 msgr2=0x7fd004198970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:15.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:15.470+0000 7fd00c7e7640 1 --2- 172.21.15.37:0/2248648439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd004101420 0x7fd004198970 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fcff4009230 tx=0x7fcff4004270 comp rx=0 tx=0).stop 2024-09-19T06:04:15.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:15.470+0000 7fd00c7e7640 1 -- 172.21.15.37:0/2248648439 shutdown_connections 2024-09-19T06:04:15.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:15.470+0000 7fd00c7e7640 1 --2- 172.21.15.37:0/2248648439 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fcff00a32c0 0x7fcff00a5780 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:15.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:15.470+0000 7fd00c7e7640 1 --2- 172.21.15.37:0/2248648439 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd004106a80 0x7fd00419cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:15.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:15.470+0000 7fd00c7e7640 1 --2- 172.21.15.37:0/2248648439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd004101420 0x7fd004198970 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:15.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:15.470+0000 7fd00c7e7640 1 --2- 172.21.15.37:0/2248648439 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd004100a80 0x7fd004198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:15.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:15.470+0000 7fd00c7e7640 1 -- 172.21.15.37:0/2248648439 >> 172.21.15.37:0/2248648439 conn(0x7fd0040fc7a0 msgr2=0x7fd00406aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:15.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:15.471+0000 7fd00c7e7640 1 -- 172.21.15.37:0/2248648439 shutdown_connections 2024-09-19T06:04:15.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:15.471+0000 7fd00c7e7640 1 -- 172.21.15.37:0/2248648439 wait complete. 2024-09-19T06:04:15.749 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:15 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/2248648439' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-19T06:04:15.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:15 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/2248648439' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-19T06:04:15.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:15 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/2248648439' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-19T06:04:16.196 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:04:16.459 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:04:16.460 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:16 smithi037 ceph-mon[31211]: pgmap v287: 129 pgs: 8 creating+peering, 9 unknown, 112 active+clean; 579 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 0 op/s 2024-09-19T06:04:16.461 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:16 smithi037 ceph-mon[31211]: osdmap e87: 12 total, 12 up, 12 in 2024-09-19T06:04:16.461 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:16 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/2248648439' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-19T06:04:16.461 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:16 smithi037 ceph-mon[31211]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T06:04:16.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:16 smithi117 ceph-mon[35050]: pgmap v287: 129 pgs: 8 creating+peering, 9 unknown, 112 active+clean; 579 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 0 op/s 2024-09-19T06:04:16.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:16 smithi117 ceph-mon[35050]: osdmap e87: 12 total, 12 up, 12 in 2024-09-19T06:04:16.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:16 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/2248648439' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-19T06:04:16.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:16 smithi117 ceph-mon[35050]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T06:04:16.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:16 smithi099 ceph-mon[35300]: pgmap v287: 129 pgs: 8 creating+peering, 9 unknown, 112 active+clean; 579 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 0 op/s 2024-09-19T06:04:16.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:16 smithi099 ceph-mon[35300]: osdmap e87: 12 total, 12 up, 12 in 2024-09-19T06:04:16.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:16 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/2248648439' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-19T06:04:16.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:16 smithi099 ceph-mon[35300]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T06:04:16.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:16.944+0000 7fe6b1c92640 1 -- 172.21.15.37:0/3074441068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6ac102790 msgr2=0x7fe6ac1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:16.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:16.944+0000 7fe6b1c92640 1 --2- 172.21.15.37:0/3074441068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6ac102790 0x7fe6ac1067e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe6a0009900 tx=0x7fe6a002a410 comp rx=0 tx=0).stop 2024-09-19T06:04:16.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:16.944+0000 7fe6b1c92640 1 -- 172.21.15.37:0/3074441068 shutdown_connections 2024-09-19T06:04:16.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:16.944+0000 7fe6b1c92640 1 --2- 172.21.15.37:0/3074441068 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe6ac106f10 0x7fe6ac10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:16.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:16.944+0000 7fe6b1c92640 1 --2- 172.21.15.37:0/3074441068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6ac102790 0x7fe6ac1067e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:16.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:16.944+0000 7fe6b1c92640 1 --2- 172.21.15.37:0/3074441068 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6ac101de0 0x7fe6ac1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:16.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:16.944+0000 7fe6b1c92640 1 -- 172.21.15.37:0/3074441068 >> 172.21.15.37:0/3074441068 conn(0x7fe6ac0fd8c0 msgr2=0x7fe6ac0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:16.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:16.944+0000 7fe6b1c92640 1 -- 172.21.15.37:0/3074441068 shutdown_connections 2024-09-19T06:04:16.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:16.944+0000 7fe6b1c92640 1 -- 172.21.15.37:0/3074441068 wait complete. 2024-09-19T06:04:16.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:16.945+0000 7fe6b1c92640 1 Processor -- start 2024-09-19T06:04:16.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:16.945+0000 7fe6b1c92640 1 -- start start 2024-09-19T06:04:16.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:16.945+0000 7fe6b1c92640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6ac101de0 0x7fe6ac198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:16.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:16.945+0000 7fe6b1c92640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6ac102790 0x7fe6ac198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:16.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:16.945+0000 7fe6b1c92640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe6ac106f10 0x7fe6ac19cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:16.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:16.946+0000 7fe6b1c92640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ac111f30 con 0x7fe6ac102790 2024-09-19T06:04:16.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:16.946+0000 7fe6b1c92640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ac111db0 con 0x7fe6ac106f10 2024-09-19T06:04:16.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:16.946+0000 7fe6b1c92640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ac1120b0 con 0x7fe6ac101de0 2024-09-19T06:04:16.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:16.946+0000 7fe6aaffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6ac102790 0x7fe6ac198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:16.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:16.946+0000 7fe6aaffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6ac102790 0x7fe6ac198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35870/0 (socket says 172.21.15.37:35870) 2024-09-19T06:04:16.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:16.946+0000 7fe6aaffd640 1 -- 172.21.15.37:0/2624547420 learned_addr learned my addr 172.21.15.37:0/2624547420 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:04:16.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:16.946+0000 7fe6abfff640 1 --2- 172.21.15.37:0/2624547420 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe6ac106f10 0x7fe6ac19cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:16.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:16.946+0000 7fe6ab7fe640 1 --2- 172.21.15.37:0/2624547420 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6ac101de0 0x7fe6ac198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:16.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:16.946+0000 7fe6aaffd640 1 -- 172.21.15.37:0/2624547420 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6ac101de0 msgr2=0x7fe6ac198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:16.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:16.946+0000 7fe6aaffd640 1 --2- 172.21.15.37:0/2624547420 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6ac101de0 0x7fe6ac198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:16.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:16.946+0000 7fe6aaffd640 1 -- 172.21.15.37:0/2624547420 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe6ac106f10 msgr2=0x7fe6ac19cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:16.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:16.946+0000 7fe6aaffd640 1 --2- 172.21.15.37:0/2624547420 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe6ac106f10 0x7fe6ac19cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:16.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:16.946+0000 7fe6aaffd640 1 -- 172.21.15.37:0/2624547420 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6ac19d3e0 con 0x7fe6ac102790 2024-09-19T06:04:16.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:16.946+0000 7fe6aaffd640 1 --2- 172.21.15.37:0/2624547420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6ac102790 0x7fe6ac198970 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe6a0006010 tx=0x7fe6a00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:16.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:16.946+0000 7fe6a8ff9640 1 -- 172.21.15.37:0/2624547420 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a003f030 con 0x7fe6ac102790 2024-09-19T06:04:16.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:16.946+0000 7fe6b1c92640 1 -- 172.21.15.37:0/2624547420 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6ac19d670 con 0x7fe6ac102790 2024-09-19T06:04:16.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:16.946+0000 7fe6a8ff9640 1 -- 172.21.15.37:0/2624547420 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe6a0003ce0 con 0x7fe6ac102790 2024-09-19T06:04:16.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:16.946+0000 7fe6a8ff9640 1 -- 172.21.15.37:0/2624547420 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a0035070 con 0x7fe6ac102790 2024-09-19T06:04:16.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:16.946+0000 7fe6b1c92640 1 -- 172.21.15.37:0/2624547420 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6ac1a4fb0 con 0x7fe6ac102790 2024-09-19T06:04:16.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:16.947+0000 7fe6b1c92640 1 -- 172.21.15.37:0/2624547420 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6ac1021c0 con 0x7fe6ac102790 2024-09-19T06:04:16.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:16.948+0000 7fe6a8ff9640 1 -- 172.21.15.37:0/2624547420 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fe6a0042030 con 0x7fe6ac102790 2024-09-19T06:04:16.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:16.949+0000 7fe6a8ff9640 1 --2- 172.21.15.37:0/2624547420 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fe6940a3240 0x7fe6940a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:16.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:16.949+0000 7fe6ab7fe640 1 --2- 172.21.15.37:0/2624547420 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fe6940a3240 0x7fe6940a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:16.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:16.949+0000 7fe6a8ff9640 1 -- 172.21.15.37:0/2624547420 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7fe6a00f0270 con 0x7fe6ac102790 2024-09-19T06:04:16.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:16.950+0000 7fe6ab7fe640 1 --2- 172.21.15.37:0/2624547420 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fe6940a3240 0x7fe6940a5700 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe69c005fd0 tx=0x7fe69c00b590 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:16.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:16.953+0000 7fe6a8ff9640 1 -- 172.21.15.37:0/2624547420 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe6a00bcdb0 con 0x7fe6ac102790 2024-09-19T06:04:17.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:17.166+0000 7fe6b1c92640 1 -- 172.21.15.37:0/2624547420 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe6ac10a0f0 con 0x7fe6ac102790 2024-09-19T06:04:17.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:17.167+0000 7fe6a8ff9640 1 -- 172.21.15.37:0/2624547420 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+11833 (secure 0 0 0) 0x7fe6a00bc6b0 con 0x7fe6ac102790 2024-09-19T06:04:17.169 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T06:04:17.169 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":16,"btime":"2024-09-19T06:04:15:457587+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14514,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2864247978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2864247978},{"type":"v1","addr":"172.21.15.37:6835","nonce":2864247978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14526,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/633000932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":633000932},{"type":"v1","addr":"172.21.15.37:6837","nonce":633000932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14574,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/3753800615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":3753800615},{"type":"v1","addr":"172.21.15.37:6839","nonce":3753800615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/2718998355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":2718998355},{"type":"v1","addr":"172.21.15.37:6841","nonce":2718998355}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6833/866590207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":866590207},{"type":"v1","addr":"172.21.15.99:6833","nonce":866590207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3898668400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3898668400},{"type":"v1","addr":"172.21.15.117:6833","nonce":3898668400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2650673320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2650673320},{"type":"v1","addr":"172.21.15.99:6835","nonce":2650673320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1097471349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1097471349},{"type":"v1","addr":"172.21.15.117:6835","nonce":1097471349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24457,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1001392672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1001392672},{"type":"v1","addr":"172.21.15.117:6837","nonce":1001392672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/23570935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":23570935},{"type":"v1","addr":"172.21.15.99:6837","nonce":23570935}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24478,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6839/1269518339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":1269518339},{"type":"v1","addr":"172.21.15.117:6839","nonce":1269518339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:04:06.253034+0000","modified":"2024-09-19T06:04:15.206139+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24485},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24485":{"gid":24485,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.99:6839/3404812329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":3404812329},{"type":"v1","addr":"172.21.15.99:6839","nonce":3404812329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24485,"qdb_cluster":[24485]},"id":1}]} 2024-09-19T06:04:17.170 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 16 2024-09-19T06:04:17.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:17.169+0000 7fe6b1c92640 1 -- 172.21.15.37:0/2624547420 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fe6940a3240 msgr2=0x7fe6940a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:17.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:17.169+0000 7fe6b1c92640 1 --2- 172.21.15.37:0/2624547420 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fe6940a3240 0x7fe6940a5700 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe69c005fd0 tx=0x7fe69c00b590 comp rx=0 tx=0).stop 2024-09-19T06:04:17.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:17.169+0000 7fe6b1c92640 1 -- 172.21.15.37:0/2624547420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6ac102790 msgr2=0x7fe6ac198970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:17.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:17.169+0000 7fe6b1c92640 1 --2- 172.21.15.37:0/2624547420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6ac102790 0x7fe6ac198970 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe6a0006010 tx=0x7fe6a00042f0 comp rx=0 tx=0).stop 2024-09-19T06:04:17.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:17.169+0000 7fe6b1c92640 1 -- 172.21.15.37:0/2624547420 shutdown_connections 2024-09-19T06:04:17.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:17.169+0000 7fe6b1c92640 1 --2- 172.21.15.37:0/2624547420 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fe6940a3240 0x7fe6940a5700 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:17.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:17.169+0000 7fe6b1c92640 1 --2- 172.21.15.37:0/2624547420 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe6ac106f10 0x7fe6ac19cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:17.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:17.169+0000 7fe6b1c92640 1 --2- 172.21.15.37:0/2624547420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6ac102790 0x7fe6ac198970 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:17.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:17.169+0000 7fe6b1c92640 1 --2- 172.21.15.37:0/2624547420 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6ac101de0 0x7fe6ac198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:17.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:17.169+0000 7fe6b1c92640 1 -- 172.21.15.37:0/2624547420 >> 172.21.15.37:0/2624547420 conn(0x7fe6ac0fd8c0 msgr2=0x7fe6ac0fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:17.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:17.170+0000 7fe6b1c92640 1 -- 172.21.15.37:0/2624547420 shutdown_connections 2024-09-19T06:04:17.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:17.170+0000 7fe6b1c92640 1 -- 172.21.15.37:0/2624547420 wait complete. 2024-09-19T06:04:17.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:17 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/2624547420' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:04:17.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:17 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/2624547420' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:04:17.864 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T06:04:17.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:17 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/2624547420' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:04:18.129 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:04:18.524 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:18 smithi037 ceph-mon[31211]: pgmap v289: 129 pgs: 4 creating+peering, 125 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:04:18.524 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:18 smithi037 ceph-mon[31211]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-19T06:04:18.524 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:18 smithi037 ceph-mon[31211]: Cluster is now healthy 2024-09-19T06:04:18.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:18.605+0000 7f99bb654640 1 -- 172.21.15.37:0/1089517215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99b4103740 msgr2=0x7f99b4107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:18.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:18.605+0000 7f99bb654640 1 --2- 172.21.15.37:0/1089517215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99b4103740 0x7f99b4107b80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f99a4009930 tx=0x7f99a402a420 comp rx=0 tx=0).stop 2024-09-19T06:04:18.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:18.605+0000 7f99bb654640 1 -- 172.21.15.37:0/1089517215 shutdown_connections 2024-09-19T06:04:18.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:18.605+0000 7f99bb654640 1 --2- 172.21.15.37:0/1089517215 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99b4108290 0x7f99b410ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:18.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:18.605+0000 7f99bb654640 1 --2- 172.21.15.37:0/1089517215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99b4103740 0x7f99b4107b80 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:18.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:18.605+0000 7f99bb654640 1 --2- 172.21.15.37:0/1089517215 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99b4102d90 0x7f99b4103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:18.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:18.605+0000 7f99bb654640 1 -- 172.21.15.37:0/1089517215 >> 172.21.15.37:0/1089517215 conn(0x7f99b40fc7d0 msgr2=0x7f99b40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:18.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:18.605+0000 7f99bb654640 1 -- 172.21.15.37:0/1089517215 shutdown_connections 2024-09-19T06:04:18.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:18.605+0000 7f99bb654640 1 -- 172.21.15.37:0/1089517215 wait complete. 2024-09-19T06:04:18.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:18.606+0000 7f99bb654640 1 Processor -- start 2024-09-19T06:04:18.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:18.606+0000 7f99bb654640 1 -- start start 2024-09-19T06:04:18.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:18.606+0000 7f99bb654640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99b4102d90 0x7f99b4198650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:18.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:18.606+0000 7f99bb654640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99b4103740 0x7f99b4198b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:18.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:18.606+0000 7f99bb654640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99b4108290 0x7f99b419cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:18.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:18.606+0000 7f99bb654640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f99b4112090 con 0x7f99b4103740 2024-09-19T06:04:18.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:18.606+0000 7f99bb654640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f99b4111f10 con 0x7f99b4102d90 2024-09-19T06:04:18.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:18.606+0000 7f99bb654640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f99b4112210 con 0x7f99b4108290 2024-09-19T06:04:18.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:18.606+0000 7f99b8bef640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99b4103740 0x7f99b4198b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:18.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:18.606+0000 7f99b8bef640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99b4103740 0x7f99b4198b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35880/0 (socket says 172.21.15.37:35880) 2024-09-19T06:04:18.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:18.606+0000 7f99b8bef640 1 -- 172.21.15.37:0/2121441187 learned_addr learned my addr 172.21.15.37:0/2121441187 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:04:18.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:18.606+0000 7f99b93f0640 1 --2- 172.21.15.37:0/2121441187 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99b4102d90 0x7f99b4198650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:18.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:18.606+0000 7f99b9bf1640 1 --2- 172.21.15.37:0/2121441187 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99b4108290 0x7f99b419cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:18.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:18.606+0000 7f99b8bef640 1 -- 172.21.15.37:0/2121441187 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99b4108290 msgr2=0x7f99b419cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:18.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:18.606+0000 7f99b8bef640 1 --2- 172.21.15.37:0/2121441187 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99b4108290 0x7f99b419cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:18.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:18.606+0000 7f99b8bef640 1 -- 172.21.15.37:0/2121441187 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99b4102d90 msgr2=0x7f99b4198650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:18.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:18.606+0000 7f99b8bef640 1 --2- 172.21.15.37:0/2121441187 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99b4102d90 0x7f99b4198650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:18.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:18.606+0000 7f99b8bef640 1 -- 172.21.15.37:0/2121441187 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99b419d600 con 0x7f99b4103740 2024-09-19T06:04:18.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:18.606+0000 7f99b9bf1640 1 --2- 172.21.15.37:0/2121441187 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99b4108290 0x7f99b419cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:04:18.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:18.607+0000 7f99b8bef640 1 --2- 172.21.15.37:0/2121441187 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99b4103740 0x7f99b4198b90 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f99a4009230 tx=0x7f99a40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:18.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:18.607+0000 7f99aa7fc640 1 -- 172.21.15.37:0/2121441187 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a403f030 con 0x7f99b4103740 2024-09-19T06:04:18.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:18.607+0000 7f99aa7fc640 1 -- 172.21.15.37:0/2121441187 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f99a4003ce0 con 0x7f99b4103740 2024-09-19T06:04:18.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:18.607+0000 7f99bb654640 1 -- 172.21.15.37:0/2121441187 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99b419d890 con 0x7f99b4103740 2024-09-19T06:04:18.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:18.607+0000 7f99aa7fc640 1 -- 172.21.15.37:0/2121441187 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a4035070 con 0x7f99b4103740 2024-09-19T06:04:18.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:18.607+0000 7f99bb654640 1 -- 172.21.15.37:0/2121441187 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99b41a51d0 con 0x7f99b4103740 2024-09-19T06:04:18.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:18.608+0000 7f99bb654640 1 -- 172.21.15.37:0/2121441187 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99b406a7f0 con 0x7f99b4103740 2024-09-19T06:04:18.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:18.609+0000 7f99aa7fc640 1 -- 172.21.15.37:0/2121441187 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f99a4042030 con 0x7f99b4103740 2024-09-19T06:04:18.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:18.610+0000 7f99aa7fc640 1 --2- 172.21.15.37:0/2121441187 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f99a00a3240 0x7f99a00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:18.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:18.610+0000 7f99b93f0640 1 --2- 172.21.15.37:0/2121441187 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f99a00a3240 0x7f99a00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:18.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:18.610+0000 7f99aa7fc640 1 -- 172.21.15.37:0/2121441187 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f99a40f0110 con 0x7f99b4103740 2024-09-19T06:04:18.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:18.610+0000 7f99b93f0640 1 --2- 172.21.15.37:0/2121441187 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f99a00a3240 0x7f99a00a5700 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f99b00058c0 tx=0x7f99b000a2d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:18.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:18.615+0000 7f99aa7fc640 1 -- 172.21.15.37:0/2121441187 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f99a40bcbf0 con 0x7f99b4103740 2024-09-19T06:04:18.749 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:18 smithi117 ceph-mon[35050]: pgmap v289: 129 pgs: 4 creating+peering, 125 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:04:18.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:18 smithi117 ceph-mon[35050]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-19T06:04:18.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:18 smithi117 ceph-mon[35050]: Cluster is now healthy 2024-09-19T06:04:18.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:18.795+0000 7f99bb654640 1 -- 172.21.15.37:0/2121441187 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f99b410a2a0 con 0x7f99b4103740 2024-09-19T06:04:18.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:18.796+0000 7f99aa7fc640 1 -- 172.21.15.37:0/2121441187 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+24200 (secure 0 0 0) 0x7f99a40bc4f0 con 0x7f99b4103740 2024-09-19T06:04:18.799 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T06:04:18.799 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":87,"fsid":"b8c8bdae-764b-11ef-bceb-c7b262605968","created":"2024-09-19T05:56:22.523060+0000","modified":"2024-09-19T06:04:15.206008+0000","last_up_change":"2024-09-19T06:03:12.771014+0000","last_in_change":"2024-09-19T06:02:49.926626+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:59:27.062607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:04:01.918234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:04:04.392543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T06:04:10.877951+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"455bc11d-2b6e-4a0c-90d9-8ab4ef4f9e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1783875173},{"type":"v1","addr":"172.21.15.37:6803","nonce":1783875173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1783875173},{"type":"v1","addr":"172.21.15.37:6805","nonce":1783875173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1783875173},{"type":"v1","addr":"172.21.15.37:6809","nonce":1783875173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1783875173},{"type":"v1","addr":"172.21.15.37:6807","nonce":1783875173}]},"public_addr":"172.21.15.37:6803/1783875173","cluster_addr":"172.21.15.37:6805/1783875173","heartbeat_back_addr":"172.21.15.37:6809/1783875173","heartbeat_front_addr":"172.21.15.37:6807/1783875173","state":["exists","up"]},{"osd":1,"uuid":"3505c162-c342-479d-8ea2-15b7a9d625cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":3414373360},{"type":"v1","addr":"172.21.15.99:6801","nonce":3414373360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":3414373360},{"type":"v1","addr":"172.21.15.99:6803","nonce":3414373360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":3414373360},{"type":"v1","addr":"172.21.15.99:6807","nonce":3414373360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":3414373360},{"type":"v1","addr":"172.21.15.99:6805","nonce":3414373360}]},"public_addr":"172.21.15.99:6801/3414373360","cluster_addr":"172.21.15.99:6803/3414373360","heartbeat_back_addr":"172.21.15.99:6807/3414373360","heartbeat_front_addr":"172.21.15.99:6805/3414373360","state":["exists","up"]},{"osd":2,"uuid":"736ec67f-b5e7-43f0-9303-0c88878ead6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3794943081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3794943081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3794943081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3794943081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3794943081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3794943081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3794943081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3794943081}]},"public_addr":"172.21.15.117:6801/3794943081","cluster_addr":"172.21.15.117:6803/3794943081","heartbeat_back_addr":"172.21.15.117:6807/3794943081","heartbeat_front_addr":"172.21.15.117:6805/3794943081","state":["exists","up"]},{"osd":3,"uuid":"3f784ef7-0cc1-4c86-a03a-b8f13396c835","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2121011955},{"type":"v1","addr":"172.21.15.37:6811","nonce":2121011955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2121011955},{"type":"v1","addr":"172.21.15.37:6813","nonce":2121011955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2121011955},{"type":"v1","addr":"172.21.15.37:6817","nonce":2121011955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2121011955},{"type":"v1","addr":"172.21.15.37:6815","nonce":2121011955}]},"public_addr":"172.21.15.37:6811/2121011955","cluster_addr":"172.21.15.37:6813/2121011955","heartbeat_back_addr":"172.21.15.37:6817/2121011955","heartbeat_front_addr":"172.21.15.37:6815/2121011955","state":["exists","up"]},{"osd":4,"uuid":"d7c16e7f-f599-419b-b4a2-fd6c1cafa0d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":1881025735},{"type":"v1","addr":"172.21.15.99:6809","nonce":1881025735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1881025735},{"type":"v1","addr":"172.21.15.99:6811","nonce":1881025735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1881025735},{"type":"v1","addr":"172.21.15.99:6815","nonce":1881025735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":1881025735},{"type":"v1","addr":"172.21.15.99:6813","nonce":1881025735}]},"public_addr":"172.21.15.99:6809/1881025735","cluster_addr":"172.21.15.99:6811/1881025735","heartbeat_back_addr":"172.21.15.99:6815/1881025735","heartbeat_front_addr":"172.21.15.99:6813/1881025735","state":["exists","up"]},{"osd":5,"uuid":"2f499ab4-3d09-4f96-a709-b4229865c690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1141976511},{"type":"v1","addr":"172.21.15.117:6809","nonce":1141976511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1141976511},{"type":"v1","addr":"172.21.15.117:6811","nonce":1141976511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1141976511},{"type":"v1","addr":"172.21.15.117:6815","nonce":1141976511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1141976511},{"type":"v1","addr":"172.21.15.117:6813","nonce":1141976511}]},"public_addr":"172.21.15.117:6809/1141976511","cluster_addr":"172.21.15.117:6811/1141976511","heartbeat_back_addr":"172.21.15.117:6815/1141976511","heartbeat_front_addr":"172.21.15.117:6813/1141976511","state":["exists","up"]},{"osd":6,"uuid":"10f7fd72-1ae8-4efd-a448-75f4b5054be3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":770433145},{"type":"v1","addr":"172.21.15.37:6819","nonce":770433145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":770433145},{"type":"v1","addr":"172.21.15.37:6821","nonce":770433145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":770433145},{"type":"v1","addr":"172.21.15.37:6825","nonce":770433145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":770433145},{"type":"v1","addr":"172.21.15.37:6823","nonce":770433145}]},"public_addr":"172.21.15.37:6819/770433145","cluster_addr":"172.21.15.37:6821/770433145","heartbeat_back_addr":"172.21.15.37:6825/770433145","heartbeat_front_addr":"172.21.15.37:6823/770433145","state":["exists","up"]},{"osd":7,"uuid":"7199a267-c486-417c-b530-3ff03fc9eb1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1694360992},{"type":"v1","addr":"172.21.15.99:6817","nonce":1694360992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1694360992},{"type":"v1","addr":"172.21.15.99:6819","nonce":1694360992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":1694360992},{"type":"v1","addr":"172.21.15.99:6823","nonce":1694360992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":1694360992},{"type":"v1","addr":"172.21.15.99:6821","nonce":1694360992}]},"public_addr":"172.21.15.99:6817/1694360992","cluster_addr":"172.21.15.99:6819/1694360992","heartbeat_back_addr":"172.21.15.99:6823/1694360992","heartbeat_front_addr":"172.21.15.99:6821/1694360992","state":["exists","up"]},{"osd":8,"uuid":"8d5bb83c-62eb-4ded-8a16-e8d57ab102c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2005866772},{"type":"v1","addr":"172.21.15.117:6817","nonce":2005866772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2005866772},{"type":"v1","addr":"172.21.15.117:6819","nonce":2005866772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2005866772},{"type":"v1","addr":"172.21.15.117:6823","nonce":2005866772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2005866772},{"type":"v1","addr":"172.21.15.117:6821","nonce":2005866772}]},"public_addr":"172.21.15.117:6817/2005866772","cluster_addr":"172.21.15.117:6819/2005866772","heartbeat_back_addr":"172.21.15.117:6823/2005866772","heartbeat_front_addr":"172.21.15.117:6821/2005866772","state":["exists","up"]},{"osd":9,"uuid":"04b6203d-a10c-4a55-8e59-b30012dee02b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1398779376},{"type":"v1","addr":"172.21.15.37:6827","nonce":1398779376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1398779376},{"type":"v1","addr":"172.21.15.37:6829","nonce":1398779376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1398779376},{"type":"v1","addr":"172.21.15.37:6833","nonce":1398779376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1398779376},{"type":"v1","addr":"172.21.15.37:6831","nonce":1398779376}]},"public_addr":"172.21.15.37:6827/1398779376","cluster_addr":"172.21.15.37:6829/1398779376","heartbeat_back_addr":"172.21.15.37:6833/1398779376","heartbeat_front_addr":"172.21.15.37:6831/1398779376","state":["exists","up"]},{"osd":10,"uuid":"bbf8ff4b-29cd-4d56-a30e-ff2de3555f78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2200957302},{"type":"v1","addr":"172.21.15.99:6825","nonce":2200957302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2200957302},{"type":"v1","addr":"172.21.15.99:6827","nonce":2200957302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2200957302},{"type":"v1","addr":"172.21.15.99:6831","nonce":2200957302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2200957302},{"type":"v1","addr":"172.21.15.99:6829","nonce":2200957302}]},"public_addr":"172.21.15.99:6825/2200957302","cluster_addr":"172.21.15.99:6827/2200957302","heartbeat_back_addr":"172.21.15.99:6831/2200957302","heartbeat_front_addr":"172.21.15.99:6829/2200957302","state":["exists","up"]},{"osd":11,"uuid":"041d54f4-a274-47b5-a467-0ce86efd363b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":1354423136},{"type":"v1","addr":"172.21.15.117:6825","nonce":1354423136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":1354423136},{"type":"v1","addr":"172.21.15.117:6827","nonce":1354423136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":1354423136},{"type":"v1","addr":"172.21.15.117:6831","nonce":1354423136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":1354423136},{"type":"v1","addr":"172.21.15.117:6829","nonce":1354423136}]},"public_addr":"172.21.15.117:6825/1354423136","cluster_addr":"172.21.15.117:6827/1354423136","heartbeat_back_addr":"172.21.15.117:6831/1354423136","heartbeat_front_addr":"172.21.15.117:6829/1354423136","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:58:33.697099+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:58:59.641549+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:59:23.811178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:59:49.550214+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:00:15.034610+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:00:39.399651+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:01:05.106379+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:01:30.375956+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:01:54.881549+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:02:21.519316+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:02:46.125918+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:03:11.310862+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6801/133577710":"2024-09-20T05:57:12.560771+0000","172.21.15.37:6800/133577710":"2024-09-20T05:57:12.560771+0000","172.21.15.37:0/2877363162":"2024-09-20T05:57:12.560771+0000","172.21.15.37:0/1053171617":"2024-09-20T05:57:12.560771+0000","172.21.15.37:6800/3277805697":"2024-09-20T05:56:49.335334+0000","172.21.15.37:0/1280697705":"2024-09-20T05:56:49.335334+0000","172.21.15.37:0/1106526058":"2024-09-20T05:57:12.560771+0000","172.21.15.37:0/1978184693":"2024-09-20T05:56:49.335334+0000","172.21.15.37:6801/3277805697":"2024-09-20T05:56:49.335334+0000","172.21.15.37:0/3650338877":"2024-09-20T05:56:49.335334+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:04:18.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:18.799+0000 7f99bb654640 1 -- 172.21.15.37:0/2121441187 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f99a00a3240 msgr2=0x7f99a00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:18.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:18.799+0000 7f99bb654640 1 --2- 172.21.15.37:0/2121441187 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f99a00a3240 0x7f99a00a5700 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f99b00058c0 tx=0x7f99b000a2d0 comp rx=0 tx=0).stop 2024-09-19T06:04:18.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:18.799+0000 7f99bb654640 1 -- 172.21.15.37:0/2121441187 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99b4103740 msgr2=0x7f99b4198b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:18.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:18.799+0000 7f99bb654640 1 --2- 172.21.15.37:0/2121441187 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99b4103740 0x7f99b4198b90 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f99a4009230 tx=0x7f99a40042f0 comp rx=0 tx=0).stop 2024-09-19T06:04:18.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:18.799+0000 7f99bb654640 1 -- 172.21.15.37:0/2121441187 shutdown_connections 2024-09-19T06:04:18.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:18.799+0000 7f99bb654640 1 --2- 172.21.15.37:0/2121441187 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f99a00a3240 0x7f99a00a5700 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:18.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:18.799+0000 7f99bb654640 1 --2- 172.21.15.37:0/2121441187 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99b4108290 0x7f99b419cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:18.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:18.799+0000 7f99bb654640 1 --2- 172.21.15.37:0/2121441187 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99b4103740 0x7f99b4198b90 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:18.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:18.799+0000 7f99bb654640 1 --2- 172.21.15.37:0/2121441187 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99b4102d90 0x7f99b4198650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:18.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:18.799+0000 7f99bb654640 1 -- 172.21.15.37:0/2121441187 >> 172.21.15.37:0/2121441187 conn(0x7f99b40fc7d0 msgr2=0x7f99b4105e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:18.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:18.799+0000 7f99bb654640 1 -- 172.21.15.37:0/2121441187 shutdown_connections 2024-09-19T06:04:18.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:18.799+0000 7f99bb654640 1 -- 172.21.15.37:0/2121441187 wait complete. 2024-09-19T06:04:18.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:18 smithi099 ceph-mon[35300]: pgmap v289: 129 pgs: 4 creating+peering, 125 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:04:18.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:18 smithi099 ceph-mon[35300]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-19T06:04:18.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:18 smithi099 ceph-mon[35300]: Cluster is now healthy 2024-09-19T06:04:19.536 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T06:04:19.560 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:19 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/2121441187' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:04:19.749 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:19 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/2121441187' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:04:19.795 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:04:19.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:19 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/2121441187' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:04:20.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:20.263+0000 7ffbf57f0640 1 -- 172.21.15.37:0/1337848324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbf0102790 msgr2=0x7ffbf01067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:20.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:20.263+0000 7ffbf57f0640 1 --2- 172.21.15.37:0/1337848324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbf0102790 0x7ffbf01067e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ffbd8009900 tx=0x7ffbd802a410 comp rx=0 tx=0).stop 2024-09-19T06:04:20.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:20.263+0000 7ffbf57f0640 1 -- 172.21.15.37:0/1337848324 shutdown_connections 2024-09-19T06:04:20.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:20.263+0000 7ffbf57f0640 1 --2- 172.21.15.37:0/1337848324 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffbf0106f10 0x7ffbf010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:20.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:20.263+0000 7ffbf57f0640 1 --2- 172.21.15.37:0/1337848324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbf0102790 0x7ffbf01067e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:20.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:20.263+0000 7ffbf57f0640 1 --2- 172.21.15.37:0/1337848324 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffbf0101de0 0x7ffbf01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:20.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:20.263+0000 7ffbf57f0640 1 -- 172.21.15.37:0/1337848324 >> 172.21.15.37:0/1337848324 conn(0x7ffbf00fd8c0 msgr2=0x7ffbf00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:20.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:20.263+0000 7ffbf57f0640 1 -- 172.21.15.37:0/1337848324 shutdown_connections 2024-09-19T06:04:20.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:20.263+0000 7ffbf57f0640 1 -- 172.21.15.37:0/1337848324 wait complete. 2024-09-19T06:04:20.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:20.264+0000 7ffbf57f0640 1 Processor -- start 2024-09-19T06:04:20.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:20.264+0000 7ffbf57f0640 1 -- start start 2024-09-19T06:04:20.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:20.264+0000 7ffbf57f0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbf0101de0 0x7ffbf01985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:20.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:20.264+0000 7ffbf57f0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffbf0102790 0x7ffbf0198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:20.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:20.264+0000 7ffbf57f0640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffbf0106f10 0x7ffbf019ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:20.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:20.264+0000 7ffbf57f0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ffbf0112010 con 0x7ffbf0101de0 2024-09-19T06:04:20.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:20.264+0000 7ffbf57f0640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ffbf0111e90 con 0x7ffbf0106f10 2024-09-19T06:04:20.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:20.264+0000 7ffbf57f0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ffbf0112190 con 0x7ffbf0102790 2024-09-19T06:04:20.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:20.264+0000 7ffbeeffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbf0101de0 0x7ffbf01985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:20.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:20.264+0000 7ffbeeffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbf0101de0 0x7ffbf01985b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35890/0 (socket says 172.21.15.37:35890) 2024-09-19T06:04:20.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:20.264+0000 7ffbeeffd640 1 -- 172.21.15.37:0/1320418875 learned_addr learned my addr 172.21.15.37:0/1320418875 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:04:20.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:20.264+0000 7ffbee7fc640 1 --2- 172.21.15.37:0/1320418875 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffbf0102790 0x7ffbf0198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:20.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:20.264+0000 7ffbeeffd640 1 -- 172.21.15.37:0/1320418875 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffbf0102790 msgr2=0x7ffbf0198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:20.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:20.264+0000 7ffbeeffd640 1 --2- 172.21.15.37:0/1320418875 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffbf0102790 0x7ffbf0198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:20.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:20.264+0000 7ffbef7fe640 1 --2- 172.21.15.37:0/1320418875 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffbf0106f10 0x7ffbf019ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:20.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:20.264+0000 7ffbeeffd640 1 -- 172.21.15.37:0/1320418875 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffbf0106f10 msgr2=0x7ffbf019ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:20.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:20.265+0000 7ffbeeffd640 1 --2- 172.21.15.37:0/1320418875 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffbf0106f10 0x7ffbf019ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:20.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:20.265+0000 7ffbeeffd640 1 -- 172.21.15.37:0/1320418875 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbf019d560 con 0x7ffbf0101de0 2024-09-19T06:04:20.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:20.265+0000 7ffbee7fc640 1 --2- 172.21.15.37:0/1320418875 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffbf0102790 0x7ffbf0198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:04:20.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:20.265+0000 7ffbef7fe640 1 --2- 172.21.15.37:0/1320418875 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffbf0106f10 0x7ffbf019ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:04:20.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:20.265+0000 7ffbeeffd640 1 --2- 172.21.15.37:0/1320418875 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbf0101de0 0x7ffbf01985b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ffbe000b4a0 tx=0x7ffbe000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:20.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:20.265+0000 7ffbe7fff640 1 -- 172.21.15.37:0/1320418875 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbe0014070 con 0x7ffbf0101de0 2024-09-19T06:04:20.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:20.265+0000 7ffbe7fff640 1 -- 172.21.15.37:0/1320418875 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffbe0010af0 con 0x7ffbf0101de0 2024-09-19T06:04:20.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:20.265+0000 7ffbf57f0640 1 -- 172.21.15.37:0/1320418875 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbf019d850 con 0x7ffbf0101de0 2024-09-19T06:04:20.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:20.265+0000 7ffbe7fff640 1 -- 172.21.15.37:0/1320418875 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbe0017d10 con 0x7ffbf0101de0 2024-09-19T06:04:20.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:20.265+0000 7ffbf57f0640 1 -- 172.21.15.37:0/1320418875 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbf01a5130 con 0x7ffbf0101de0 2024-09-19T06:04:20.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:20.266+0000 7ffbf57f0640 1 -- 172.21.15.37:0/1320418875 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbf0102240 con 0x7ffbf0101de0 2024-09-19T06:04:20.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:20.267+0000 7ffbe7fff640 1 -- 172.21.15.37:0/1320418875 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7ffbe0017070 con 0x7ffbf0101de0 2024-09-19T06:04:20.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:20.268+0000 7ffbe7fff640 1 --2- 172.21.15.37:0/1320418875 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7ffbdc0a32c0 0x7ffbdc0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:20.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:20.268+0000 7ffbee7fc640 1 --2- 172.21.15.37:0/1320418875 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7ffbdc0a32c0 0x7ffbdc0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:20.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:20.268+0000 7ffbe7fff640 1 -- 172.21.15.37:0/1320418875 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7ffbe00cef60 con 0x7ffbf0101de0 2024-09-19T06:04:20.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:20.269+0000 7ffbee7fc640 1 --2- 172.21.15.37:0/1320418875 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7ffbdc0a32c0 0x7ffbdc0a5780 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ffbd8000c00 tx=0x7ffbd8032d50 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:20.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:20.273+0000 7ffbe7fff640 1 -- 172.21.15.37:0/1320418875 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ffbe009ba40 con 0x7ffbf0101de0 2024-09-19T06:04:20.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:20.451+0000 7ffbf57f0640 1 -- 172.21.15.37:0/1320418875 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffbf0199910 con 0x7ffbf0101de0 2024-09-19T06:04:20.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:20.452+0000 7ffbe7fff640 1 -- 172.21.15.37:0/1320418875 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+24200 (secure 0 0 0) 0x7ffbe009b340 con 0x7ffbf0101de0 2024-09-19T06:04:20.456 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T06:04:20.457 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":87,"fsid":"b8c8bdae-764b-11ef-bceb-c7b262605968","created":"2024-09-19T05:56:22.523060+0000","modified":"2024-09-19T06:04:15.206008+0000","last_up_change":"2024-09-19T06:03:12.771014+0000","last_in_change":"2024-09-19T06:02:49.926626+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:59:27.062607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:04:01.918234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:04:04.392543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T06:04:10.877951+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"455bc11d-2b6e-4a0c-90d9-8ab4ef4f9e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1783875173},{"type":"v1","addr":"172.21.15.37:6803","nonce":1783875173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1783875173},{"type":"v1","addr":"172.21.15.37:6805","nonce":1783875173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1783875173},{"type":"v1","addr":"172.21.15.37:6809","nonce":1783875173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1783875173},{"type":"v1","addr":"172.21.15.37:6807","nonce":1783875173}]},"public_addr":"172.21.15.37:6803/1783875173","cluster_addr":"172.21.15.37:6805/1783875173","heartbeat_back_addr":"172.21.15.37:6809/1783875173","heartbeat_front_addr":"172.21.15.37:6807/1783875173","state":["exists","up"]},{"osd":1,"uuid":"3505c162-c342-479d-8ea2-15b7a9d625cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":3414373360},{"type":"v1","addr":"172.21.15.99:6801","nonce":3414373360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":3414373360},{"type":"v1","addr":"172.21.15.99:6803","nonce":3414373360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":3414373360},{"type":"v1","addr":"172.21.15.99:6807","nonce":3414373360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":3414373360},{"type":"v1","addr":"172.21.15.99:6805","nonce":3414373360}]},"public_addr":"172.21.15.99:6801/3414373360","cluster_addr":"172.21.15.99:6803/3414373360","heartbeat_back_addr":"172.21.15.99:6807/3414373360","heartbeat_front_addr":"172.21.15.99:6805/3414373360","state":["exists","up"]},{"osd":2,"uuid":"736ec67f-b5e7-43f0-9303-0c88878ead6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3794943081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3794943081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3794943081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3794943081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3794943081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3794943081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3794943081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3794943081}]},"public_addr":"172.21.15.117:6801/3794943081","cluster_addr":"172.21.15.117:6803/3794943081","heartbeat_back_addr":"172.21.15.117:6807/3794943081","heartbeat_front_addr":"172.21.15.117:6805/3794943081","state":["exists","up"]},{"osd":3,"uuid":"3f784ef7-0cc1-4c86-a03a-b8f13396c835","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2121011955},{"type":"v1","addr":"172.21.15.37:6811","nonce":2121011955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2121011955},{"type":"v1","addr":"172.21.15.37:6813","nonce":2121011955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2121011955},{"type":"v1","addr":"172.21.15.37:6817","nonce":2121011955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2121011955},{"type":"v1","addr":"172.21.15.37:6815","nonce":2121011955}]},"public_addr":"172.21.15.37:6811/2121011955","cluster_addr":"172.21.15.37:6813/2121011955","heartbeat_back_addr":"172.21.15.37:6817/2121011955","heartbeat_front_addr":"172.21.15.37:6815/2121011955","state":["exists","up"]},{"osd":4,"uuid":"d7c16e7f-f599-419b-b4a2-fd6c1cafa0d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":1881025735},{"type":"v1","addr":"172.21.15.99:6809","nonce":1881025735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1881025735},{"type":"v1","addr":"172.21.15.99:6811","nonce":1881025735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1881025735},{"type":"v1","addr":"172.21.15.99:6815","nonce":1881025735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":1881025735},{"type":"v1","addr":"172.21.15.99:6813","nonce":1881025735}]},"public_addr":"172.21.15.99:6809/1881025735","cluster_addr":"172.21.15.99:6811/1881025735","heartbeat_back_addr":"172.21.15.99:6815/1881025735","heartbeat_front_addr":"172.21.15.99:6813/1881025735","state":["exists","up"]},{"osd":5,"uuid":"2f499ab4-3d09-4f96-a709-b4229865c690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1141976511},{"type":"v1","addr":"172.21.15.117:6809","nonce":1141976511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1141976511},{"type":"v1","addr":"172.21.15.117:6811","nonce":1141976511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1141976511},{"type":"v1","addr":"172.21.15.117:6815","nonce":1141976511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1141976511},{"type":"v1","addr":"172.21.15.117:6813","nonce":1141976511}]},"public_addr":"172.21.15.117:6809/1141976511","cluster_addr":"172.21.15.117:6811/1141976511","heartbeat_back_addr":"172.21.15.117:6815/1141976511","heartbeat_front_addr":"172.21.15.117:6813/1141976511","state":["exists","up"]},{"osd":6,"uuid":"10f7fd72-1ae8-4efd-a448-75f4b5054be3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":770433145},{"type":"v1","addr":"172.21.15.37:6819","nonce":770433145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":770433145},{"type":"v1","addr":"172.21.15.37:6821","nonce":770433145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":770433145},{"type":"v1","addr":"172.21.15.37:6825","nonce":770433145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":770433145},{"type":"v1","addr":"172.21.15.37:6823","nonce":770433145}]},"public_addr":"172.21.15.37:6819/770433145","cluster_addr":"172.21.15.37:6821/770433145","heartbeat_back_addr":"172.21.15.37:6825/770433145","heartbeat_front_addr":"172.21.15.37:6823/770433145","state":["exists","up"]},{"osd":7,"uuid":"7199a267-c486-417c-b530-3ff03fc9eb1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1694360992},{"type":"v1","addr":"172.21.15.99:6817","nonce":1694360992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1694360992},{"type":"v1","addr":"172.21.15.99:6819","nonce":1694360992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":1694360992},{"type":"v1","addr":"172.21.15.99:6823","nonce":1694360992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":1694360992},{"type":"v1","addr":"172.21.15.99:6821","nonce":1694360992}]},"public_addr":"172.21.15.99:6817/1694360992","cluster_addr":"172.21.15.99:6819/1694360992","heartbeat_back_addr":"172.21.15.99:6823/1694360992","heartbeat_front_addr":"172.21.15.99:6821/1694360992","state":["exists","up"]},{"osd":8,"uuid":"8d5bb83c-62eb-4ded-8a16-e8d57ab102c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2005866772},{"type":"v1","addr":"172.21.15.117:6817","nonce":2005866772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2005866772},{"type":"v1","addr":"172.21.15.117:6819","nonce":2005866772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2005866772},{"type":"v1","addr":"172.21.15.117:6823","nonce":2005866772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2005866772},{"type":"v1","addr":"172.21.15.117:6821","nonce":2005866772}]},"public_addr":"172.21.15.117:6817/2005866772","cluster_addr":"172.21.15.117:6819/2005866772","heartbeat_back_addr":"172.21.15.117:6823/2005866772","heartbeat_front_addr":"172.21.15.117:6821/2005866772","state":["exists","up"]},{"osd":9,"uuid":"04b6203d-a10c-4a55-8e59-b30012dee02b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1398779376},{"type":"v1","addr":"172.21.15.37:6827","nonce":1398779376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1398779376},{"type":"v1","addr":"172.21.15.37:6829","nonce":1398779376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1398779376},{"type":"v1","addr":"172.21.15.37:6833","nonce":1398779376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1398779376},{"type":"v1","addr":"172.21.15.37:6831","nonce":1398779376}]},"public_addr":"172.21.15.37:6827/1398779376","cluster_addr":"172.21.15.37:6829/1398779376","heartbeat_back_addr":"172.21.15.37:6833/1398779376","heartbeat_front_addr":"172.21.15.37:6831/1398779376","state":["exists","up"]},{"osd":10,"uuid":"bbf8ff4b-29cd-4d56-a30e-ff2de3555f78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2200957302},{"type":"v1","addr":"172.21.15.99:6825","nonce":2200957302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2200957302},{"type":"v1","addr":"172.21.15.99:6827","nonce":2200957302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2200957302},{"type":"v1","addr":"172.21.15.99:6831","nonce":2200957302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2200957302},{"type":"v1","addr":"172.21.15.99:6829","nonce":2200957302}]},"public_addr":"172.21.15.99:6825/2200957302","cluster_addr":"172.21.15.99:6827/2200957302","heartbeat_back_addr":"172.21.15.99:6831/2200957302","heartbeat_front_addr":"172.21.15.99:6829/2200957302","state":["exists","up"]},{"osd":11,"uuid":"041d54f4-a274-47b5-a467-0ce86efd363b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":1354423136},{"type":"v1","addr":"172.21.15.117:6825","nonce":1354423136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":1354423136},{"type":"v1","addr":"172.21.15.117:6827","nonce":1354423136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":1354423136},{"type":"v1","addr":"172.21.15.117:6831","nonce":1354423136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":1354423136},{"type":"v1","addr":"172.21.15.117:6829","nonce":1354423136}]},"public_addr":"172.21.15.117:6825/1354423136","cluster_addr":"172.21.15.117:6827/1354423136","heartbeat_back_addr":"172.21.15.117:6831/1354423136","heartbeat_front_addr":"172.21.15.117:6829/1354423136","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:58:33.697099+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:58:59.641549+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:59:23.811178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:59:49.550214+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:00:15.034610+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:00:39.399651+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:01:05.106379+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:01:30.375956+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:01:54.881549+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:02:21.519316+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:02:46.125918+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:03:11.310862+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6801/133577710":"2024-09-20T05:57:12.560771+0000","172.21.15.37:6800/133577710":"2024-09-20T05:57:12.560771+0000","172.21.15.37:0/2877363162":"2024-09-20T05:57:12.560771+0000","172.21.15.37:0/1053171617":"2024-09-20T05:57:12.560771+0000","172.21.15.37:6800/3277805697":"2024-09-20T05:56:49.335334+0000","172.21.15.37:0/1280697705":"2024-09-20T05:56:49.335334+0000","172.21.15.37:0/1106526058":"2024-09-20T05:57:12.560771+0000","172.21.15.37:0/1978184693":"2024-09-20T05:56:49.335334+0000","172.21.15.37:6801/3277805697":"2024-09-20T05:56:49.335334+0000","172.21.15.37:0/3650338877":"2024-09-20T05:56:49.335334+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:04:20.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:20.455+0000 7ffbf57f0640 1 -- 172.21.15.37:0/1320418875 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7ffbdc0a32c0 msgr2=0x7ffbdc0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:20.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:20.455+0000 7ffbf57f0640 1 --2- 172.21.15.37:0/1320418875 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7ffbdc0a32c0 0x7ffbdc0a5780 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ffbd8000c00 tx=0x7ffbd8032d50 comp rx=0 tx=0).stop 2024-09-19T06:04:20.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:20.455+0000 7ffbf57f0640 1 -- 172.21.15.37:0/1320418875 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbf0101de0 msgr2=0x7ffbf01985b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:20.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:20.455+0000 7ffbf57f0640 1 --2- 172.21.15.37:0/1320418875 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbf0101de0 0x7ffbf01985b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ffbe000b4a0 tx=0x7ffbe000b960 comp rx=0 tx=0).stop 2024-09-19T06:04:20.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:20.455+0000 7ffbf57f0640 1 -- 172.21.15.37:0/1320418875 shutdown_connections 2024-09-19T06:04:20.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:20.455+0000 7ffbf57f0640 1 --2- 172.21.15.37:0/1320418875 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7ffbdc0a32c0 0x7ffbdc0a5780 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:20.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:20.455+0000 7ffbf57f0640 1 --2- 172.21.15.37:0/1320418875 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffbf0106f10 0x7ffbf019ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:20.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:20.455+0000 7ffbf57f0640 1 --2- 172.21.15.37:0/1320418875 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffbf0102790 0x7ffbf0198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:20.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:20.455+0000 7ffbf57f0640 1 --2- 172.21.15.37:0/1320418875 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbf0101de0 0x7ffbf01985b0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:20.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:20.455+0000 7ffbf57f0640 1 -- 172.21.15.37:0/1320418875 >> 172.21.15.37:0/1320418875 conn(0x7ffbf00fd8c0 msgr2=0x7ffbf00fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:20.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:20.455+0000 7ffbf57f0640 1 -- 172.21.15.37:0/1320418875 shutdown_connections 2024-09-19T06:04:20.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:20.455+0000 7ffbf57f0640 1 -- 172.21.15.37:0/1320418875 wait complete. 2024-09-19T06:04:20.749 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:20 smithi117 ceph-mon[35050]: pgmap v290: 129 pgs: 129 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:04:20.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:20 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/1320418875' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:04:20.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:20 smithi037 ceph-mon[31211]: pgmap v290: 129 pgs: 129 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:04:20.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:20 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/1320418875' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:04:20.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:20 smithi099 ceph-mon[35300]: pgmap v290: 129 pgs: 129 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:04:20.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:20 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/1320418875' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:04:21.163 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:04:21.448 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:04:21.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:21.912+0000 7fee68c82640 1 -- 172.21.15.37:0/2266366321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee64102790 msgr2=0x7fee641067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:21.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:21.912+0000 7fee68c82640 1 --2- 172.21.15.37:0/2266366321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee64102790 0x7fee641067e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fee58009900 tx=0x7fee5802a410 comp rx=0 tx=0).stop 2024-09-19T06:04:21.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:21.913+0000 7fee68c82640 1 -- 172.21.15.37:0/2266366321 shutdown_connections 2024-09-19T06:04:21.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:21.913+0000 7fee68c82640 1 --2- 172.21.15.37:0/2266366321 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee64106f10 0x7fee6410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:21.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:21.913+0000 7fee68c82640 1 --2- 172.21.15.37:0/2266366321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee64102790 0x7fee641067e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:21.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:21.913+0000 7fee68c82640 1 --2- 172.21.15.37:0/2266366321 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee64101de0 0x7fee641021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:21.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:21.913+0000 7fee68c82640 1 -- 172.21.15.37:0/2266366321 >> 172.21.15.37:0/2266366321 conn(0x7fee640fd8c0 msgr2=0x7fee640ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:21.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:21.913+0000 7fee68c82640 1 -- 172.21.15.37:0/2266366321 shutdown_connections 2024-09-19T06:04:21.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:21.913+0000 7fee68c82640 1 -- 172.21.15.37:0/2266366321 wait complete. 2024-09-19T06:04:21.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:21.913+0000 7fee68c82640 1 Processor -- start 2024-09-19T06:04:21.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:21.913+0000 7fee68c82640 1 -- start start 2024-09-19T06:04:21.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:21.914+0000 7fee68c82640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee64101de0 0x7fee6419a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:21.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:21.914+0000 7fee68c82640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee64102790 0x7fee6419abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:21.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:21.914+0000 7fee68c82640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee64106f10 0x7fee6419ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:21.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:21.914+0000 7fee68c82640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fee64111fc0 con 0x7fee64106f10 2024-09-19T06:04:21.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:21.914+0000 7fee68c82640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fee64111e40 con 0x7fee64102790 2024-09-19T06:04:21.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:21.914+0000 7fee68c82640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fee64112140 con 0x7fee64101de0 2024-09-19T06:04:21.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:21.914+0000 7fee62d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee64106f10 0x7fee6419ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:21.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:21.914+0000 7fee62d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee64106f10 0x7fee6419ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35902/0 (socket says 172.21.15.37:35902) 2024-09-19T06:04:21.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:21.914+0000 7fee62d9d640 1 -- 172.21.15.37:0/1840602378 learned_addr learned my addr 172.21.15.37:0/1840602378 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:04:21.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:21.914+0000 7fee6259c640 1 --2- 172.21.15.37:0/1840602378 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee64101de0 0x7fee6419a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:21.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:21.914+0000 7fee61d9b640 1 --2- 172.21.15.37:0/1840602378 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee64102790 0x7fee6419abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:21.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:21.914+0000 7fee62d9d640 1 -- 172.21.15.37:0/1840602378 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee64101de0 msgr2=0x7fee6419a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:21.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:21.914+0000 7fee62d9d640 1 --2- 172.21.15.37:0/1840602378 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee64101de0 0x7fee6419a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:21.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:21.914+0000 7fee62d9d640 1 -- 172.21.15.37:0/1840602378 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee64102790 msgr2=0x7fee6419abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:21.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:21.914+0000 7fee62d9d640 1 --2- 172.21.15.37:0/1840602378 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee64102790 0x7fee6419abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:21.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:21.914+0000 7fee62d9d640 1 -- 172.21.15.37:0/1840602378 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee6419f640 con 0x7fee64106f10 2024-09-19T06:04:21.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:21.914+0000 7fee62d9d640 1 --2- 172.21.15.37:0/1840602378 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee64106f10 0x7fee6419ef60 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fee5c00eaa0 tx=0x7fee5c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:21.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:21.914+0000 7fee537fe640 1 -- 172.21.15.37:0/1840602378 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee5c00cdb0 con 0x7fee64106f10 2024-09-19T06:04:21.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:21.914+0000 7fee68c82640 1 -- 172.21.15.37:0/1840602378 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee6419f930 con 0x7fee64106f10 2024-09-19T06:04:21.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:21.914+0000 7fee537fe640 1 -- 172.21.15.37:0/1840602378 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee5c005020 con 0x7fee64106f10 2024-09-19T06:04:21.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:21.914+0000 7fee537fe640 1 -- 172.21.15.37:0/1840602378 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee5c0116d0 con 0x7fee64106f10 2024-09-19T06:04:21.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:21.914+0000 7fee68c82640 1 -- 172.21.15.37:0/1840602378 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee641a7210 con 0x7fee64106f10 2024-09-19T06:04:21.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:21.915+0000 7fee68c82640 1 -- 172.21.15.37:0/1840602378 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee641021c0 con 0x7fee64106f10 2024-09-19T06:04:21.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:21.917+0000 7fee537fe640 1 -- 172.21.15.37:0/1840602378 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fee5c0054d0 con 0x7fee64106f10 2024-09-19T06:04:21.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:21.917+0000 7fee537fe640 1 --2- 172.21.15.37:0/1840602378 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fee4c0a3240 0x7fee4c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:21.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:21.917+0000 7fee6259c640 1 --2- 172.21.15.37:0/1840602378 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fee4c0a3240 0x7fee4c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:21.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:21.917+0000 7fee537fe640 1 -- 172.21.15.37:0/1840602378 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7fee5c0cfd00 con 0x7fee64106f10 2024-09-19T06:04:21.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:21.918+0000 7fee6259c640 1 --2- 172.21.15.37:0/1840602378 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fee4c0a3240 0x7fee4c0a5700 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fee5400bbe0 tx=0x7fee5400b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:21.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:21.921+0000 7fee537fe640 1 -- 172.21.15.37:0/1840602378 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fee5c016030 con 0x7fee64106f10 2024-09-19T06:04:22.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:22.133+0000 7fee68c82640 1 -- 172.21.15.37:0/1840602378 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fee641a7530 con 0x7fee64106f10 2024-09-19T06:04:22.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:22.133+0000 7fee537fe640 1 -- 172.21.15.37:0/1840602378 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+11833 (secure 0 0 0) 0x7fee5c09c7e0 con 0x7fee64106f10 2024-09-19T06:04:22.136 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T06:04:22.136 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":16,"btime":"2024-09-19T06:04:15:457587+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14514,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2864247978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2864247978},{"type":"v1","addr":"172.21.15.37:6835","nonce":2864247978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14526,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/633000932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":633000932},{"type":"v1","addr":"172.21.15.37:6837","nonce":633000932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14574,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/3753800615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":3753800615},{"type":"v1","addr":"172.21.15.37:6839","nonce":3753800615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/2718998355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":2718998355},{"type":"v1","addr":"172.21.15.37:6841","nonce":2718998355}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6833/866590207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":866590207},{"type":"v1","addr":"172.21.15.99:6833","nonce":866590207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3898668400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3898668400},{"type":"v1","addr":"172.21.15.117:6833","nonce":3898668400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2650673320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2650673320},{"type":"v1","addr":"172.21.15.99:6835","nonce":2650673320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1097471349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1097471349},{"type":"v1","addr":"172.21.15.117:6835","nonce":1097471349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24457,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1001392672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1001392672},{"type":"v1","addr":"172.21.15.117:6837","nonce":1001392672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/23570935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":23570935},{"type":"v1","addr":"172.21.15.99:6837","nonce":23570935}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24478,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6839/1269518339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":1269518339},{"type":"v1","addr":"172.21.15.117:6839","nonce":1269518339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:04:06.253034+0000","modified":"2024-09-19T06:04:15.206139+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24485},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24485":{"gid":24485,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.99:6839/3404812329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":3404812329},{"type":"v1","addr":"172.21.15.99:6839","nonce":3404812329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24485,"qdb_cluster":[24485]},"id":1}]} 2024-09-19T06:04:22.136 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 16 2024-09-19T06:04:22.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:22.135+0000 7fee68c82640 1 -- 172.21.15.37:0/1840602378 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fee4c0a3240 msgr2=0x7fee4c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:22.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:22.135+0000 7fee68c82640 1 --2- 172.21.15.37:0/1840602378 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fee4c0a3240 0x7fee4c0a5700 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fee5400bbe0 tx=0x7fee5400b390 comp rx=0 tx=0).stop 2024-09-19T06:04:22.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:22.135+0000 7fee68c82640 1 -- 172.21.15.37:0/1840602378 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee64106f10 msgr2=0x7fee6419ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:22.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:22.135+0000 7fee68c82640 1 --2- 172.21.15.37:0/1840602378 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee64106f10 0x7fee6419ef60 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fee5c00eaa0 tx=0x7fee5c00ef60 comp rx=0 tx=0).stop 2024-09-19T06:04:22.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:22.136+0000 7fee68c82640 1 -- 172.21.15.37:0/1840602378 shutdown_connections 2024-09-19T06:04:22.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:22.136+0000 7fee68c82640 1 --2- 172.21.15.37:0/1840602378 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fee4c0a3240 0x7fee4c0a5700 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:22.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:22.136+0000 7fee68c82640 1 --2- 172.21.15.37:0/1840602378 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee64102790 0x7fee6419abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:22.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:22.136+0000 7fee68c82640 1 --2- 172.21.15.37:0/1840602378 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee64106f10 0x7fee6419ef60 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:22.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:22.136+0000 7fee68c82640 1 --2- 172.21.15.37:0/1840602378 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee64101de0 0x7fee6419a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:22.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:22.136+0000 7fee68c82640 1 -- 172.21.15.37:0/1840602378 >> 172.21.15.37:0/1840602378 conn(0x7fee640fd8c0 msgr2=0x7fee640ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:22.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:22.136+0000 7fee68c82640 1 -- 172.21.15.37:0/1840602378 shutdown_connections 2024-09-19T06:04:22.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:22.136+0000 7fee68c82640 1 -- 172.21.15.37:0/1840602378 wait complete. 2024-09-19T06:04:22.753 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:22 smithi117 ceph-mon[35050]: pgmap v291: 129 pgs: 129 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:04:22.753 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:22 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/1840602378' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:04:22.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:22 smithi037 ceph-mon[31211]: pgmap v291: 129 pgs: 129 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:04:22.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:22 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/1840602378' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:04:22.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:22 smithi099 ceph-mon[35300]: pgmap v291: 129 pgs: 129 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:04:22.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:22 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/1840602378' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:04:22.948 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T06:04:23.207 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:04:23.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:23.655+0000 7f2fbef01640 1 -- 172.21.15.37:0/1082906909 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2fb8106a80 msgr2=0x7f2fb8106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:23.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:23.655+0000 7f2fbef01640 1 --2- 172.21.15.37:0/1082906909 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2fb8106a80 0x7f2fb8106e60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2fac009930 tx=0x7f2fac02a420 comp rx=0 tx=0).stop 2024-09-19T06:04:23.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:23.655+0000 7f2fbef01640 1 -- 172.21.15.37:0/1082906909 shutdown_connections 2024-09-19T06:04:23.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:23.655+0000 7f2fbef01640 1 --2- 172.21.15.37:0/1082906909 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2fb8101420 0x7f2fb810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:23.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:23.655+0000 7f2fbef01640 1 --2- 172.21.15.37:0/1082906909 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2fb8100a80 0x7f2fb8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:23.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:23.655+0000 7f2fbef01640 1 --2- 172.21.15.37:0/1082906909 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2fb8106a80 0x7f2fb8106e60 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:23.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:23.655+0000 7f2fbef01640 1 -- 172.21.15.37:0/1082906909 >> 172.21.15.37:0/1082906909 conn(0x7f2fb80fc7a0 msgr2=0x7f2fb80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:23.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:23.655+0000 7f2fbef01640 1 -- 172.21.15.37:0/1082906909 shutdown_connections 2024-09-19T06:04:23.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:23.655+0000 7f2fbef01640 1 -- 172.21.15.37:0/1082906909 wait complete. 2024-09-19T06:04:23.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:23.656+0000 7f2fbef01640 1 Processor -- start 2024-09-19T06:04:23.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:23.656+0000 7f2fbef01640 1 -- start start 2024-09-19T06:04:23.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:23.656+0000 7f2fbef01640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2fb8100a80 0x7f2fb81973a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:23.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:23.656+0000 7f2fbef01640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2fb8101420 0x7f2fb81978e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:23.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:23.656+0000 7f2fbef01640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2fb8106a80 0x7f2fb819bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:23.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:23.656+0000 7f2fbef01640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2fb8110e40 con 0x7f2fb8106a80 2024-09-19T06:04:23.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:23.656+0000 7f2fbef01640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f2fb8110cc0 con 0x7f2fb8101420 2024-09-19T06:04:23.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:23.656+0000 7f2fbef01640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2fb8110fc0 con 0x7f2fb8100a80 2024-09-19T06:04:23.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:23.656+0000 7f2fbd49e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2fb8106a80 0x7f2fb819bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:23.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:23.656+0000 7f2fbcc9d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2fb8100a80 0x7f2fb81973a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:23.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:23.656+0000 7f2fbd49e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2fb8106a80 0x7f2fb819bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39580/0 (socket says 172.21.15.37:39580) 2024-09-19T06:04:23.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:23.656+0000 7f2fbd49e640 1 -- 172.21.15.37:0/2331905050 learned_addr learned my addr 172.21.15.37:0/2331905050 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:04:23.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:23.656+0000 7f2fb7fff640 1 --2- 172.21.15.37:0/2331905050 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2fb8101420 0x7f2fb81978e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:23.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:23.657+0000 7f2fbd49e640 1 -- 172.21.15.37:0/2331905050 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2fb8100a80 msgr2=0x7f2fb81973a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:23.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:23.657+0000 7f2fbd49e640 1 --2- 172.21.15.37:0/2331905050 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2fb8100a80 0x7f2fb81973a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:23.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:23.657+0000 7f2fbd49e640 1 -- 172.21.15.37:0/2331905050 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2fb8101420 msgr2=0x7f2fb81978e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:23.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:23.657+0000 7f2fbd49e640 1 --2- 172.21.15.37:0/2331905050 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2fb8101420 0x7f2fb81978e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:23.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:23.657+0000 7f2fbd49e640 1 -- 172.21.15.37:0/2331905050 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fb819c350 con 0x7f2fb8106a80 2024-09-19T06:04:23.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:23.657+0000 7f2fb7fff640 1 --2- 172.21.15.37:0/2331905050 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2fb8101420 0x7f2fb81978e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:04:23.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:23.657+0000 7f2fbd49e640 1 --2- 172.21.15.37:0/2331905050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2fb8106a80 0x7f2fb819bc70 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2fb000cad0 tx=0x7f2fb000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:23.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:23.657+0000 7f2fb5ffb640 1 -- 172.21.15.37:0/2331905050 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb000ae20 con 0x7f2fb8106a80 2024-09-19T06:04:23.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:23.657+0000 7f2fb5ffb640 1 -- 172.21.15.37:0/2331905050 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2fb0005020 con 0x7f2fb8106a80 2024-09-19T06:04:23.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:23.657+0000 7f2fbef01640 1 -- 172.21.15.37:0/2331905050 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fb819c640 con 0x7f2fb8106a80 2024-09-19T06:04:23.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:23.657+0000 7f2fb5ffb640 1 -- 172.21.15.37:0/2331905050 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb000f6f0 con 0x7f2fb8106a80 2024-09-19T06:04:23.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:23.657+0000 7f2fbef01640 1 -- 172.21.15.37:0/2331905050 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fb81a3f20 con 0x7f2fb8106a80 2024-09-19T06:04:23.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:23.658+0000 7f2fbef01640 1 -- 172.21.15.37:0/2331905050 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fb8100ee0 con 0x7f2fb8106a80 2024-09-19T06:04:23.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:23.659+0000 7f2fb5ffb640 1 -- 172.21.15.37:0/2331905050 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f2fb00051d0 con 0x7f2fb8106a80 2024-09-19T06:04:23.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:23.660+0000 7f2fb5ffb640 1 --2- 172.21.15.37:0/2331905050 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f2fa80a3240 0x7f2fa80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:23.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:23.660+0000 7f2fbcc9d640 1 --2- 172.21.15.37:0/2331905050 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f2fa80a3240 0x7f2fa80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:23.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:23.660+0000 7f2fb5ffb640 1 -- 172.21.15.37:0/2331905050 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f2fb00cfb80 con 0x7f2fb8106a80 2024-09-19T06:04:23.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:23.660+0000 7f2fbcc9d640 1 --2- 172.21.15.37:0/2331905050 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f2fa80a3240 0x7f2fa80a5700 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2fac009900 tx=0x7f2fac0058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:23.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:23.664+0000 7f2fb5ffb640 1 -- 172.21.15.37:0/2331905050 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2fb0014030 con 0x7f2fb8106a80 2024-09-19T06:04:23.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:23.840+0000 7f2fbef01640 1 -- 172.21.15.37:0/2331905050 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2fb8109050 con 0x7f2fb8106a80 2024-09-19T06:04:23.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:23.841+0000 7f2fb5ffb640 1 -- 172.21.15.37:0/2331905050 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+24200 (secure 0 0 0) 0x7f2fb009c660 con 0x7f2fb8106a80 2024-09-19T06:04:23.844 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T06:04:23.844 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":87,"fsid":"b8c8bdae-764b-11ef-bceb-c7b262605968","created":"2024-09-19T05:56:22.523060+0000","modified":"2024-09-19T06:04:15.206008+0000","last_up_change":"2024-09-19T06:03:12.771014+0000","last_in_change":"2024-09-19T06:02:49.926626+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:59:27.062607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:04:01.918234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:04:04.392543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T06:04:10.877951+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"455bc11d-2b6e-4a0c-90d9-8ab4ef4f9e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1783875173},{"type":"v1","addr":"172.21.15.37:6803","nonce":1783875173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1783875173},{"type":"v1","addr":"172.21.15.37:6805","nonce":1783875173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1783875173},{"type":"v1","addr":"172.21.15.37:6809","nonce":1783875173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1783875173},{"type":"v1","addr":"172.21.15.37:6807","nonce":1783875173}]},"public_addr":"172.21.15.37:6803/1783875173","cluster_addr":"172.21.15.37:6805/1783875173","heartbeat_back_addr":"172.21.15.37:6809/1783875173","heartbeat_front_addr":"172.21.15.37:6807/1783875173","state":["exists","up"]},{"osd":1,"uuid":"3505c162-c342-479d-8ea2-15b7a9d625cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":3414373360},{"type":"v1","addr":"172.21.15.99:6801","nonce":3414373360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":3414373360},{"type":"v1","addr":"172.21.15.99:6803","nonce":3414373360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":3414373360},{"type":"v1","addr":"172.21.15.99:6807","nonce":3414373360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":3414373360},{"type":"v1","addr":"172.21.15.99:6805","nonce":3414373360}]},"public_addr":"172.21.15.99:6801/3414373360","cluster_addr":"172.21.15.99:6803/3414373360","heartbeat_back_addr":"172.21.15.99:6807/3414373360","heartbeat_front_addr":"172.21.15.99:6805/3414373360","state":["exists","up"]},{"osd":2,"uuid":"736ec67f-b5e7-43f0-9303-0c88878ead6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3794943081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3794943081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3794943081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3794943081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3794943081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3794943081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3794943081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3794943081}]},"public_addr":"172.21.15.117:6801/3794943081","cluster_addr":"172.21.15.117:6803/3794943081","heartbeat_back_addr":"172.21.15.117:6807/3794943081","heartbeat_front_addr":"172.21.15.117:6805/3794943081","state":["exists","up"]},{"osd":3,"uuid":"3f784ef7-0cc1-4c86-a03a-b8f13396c835","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2121011955},{"type":"v1","addr":"172.21.15.37:6811","nonce":2121011955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2121011955},{"type":"v1","addr":"172.21.15.37:6813","nonce":2121011955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2121011955},{"type":"v1","addr":"172.21.15.37:6817","nonce":2121011955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2121011955},{"type":"v1","addr":"172.21.15.37:6815","nonce":2121011955}]},"public_addr":"172.21.15.37:6811/2121011955","cluster_addr":"172.21.15.37:6813/2121011955","heartbeat_back_addr":"172.21.15.37:6817/2121011955","heartbeat_front_addr":"172.21.15.37:6815/2121011955","state":["exists","up"]},{"osd":4,"uuid":"d7c16e7f-f599-419b-b4a2-fd6c1cafa0d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":1881025735},{"type":"v1","addr":"172.21.15.99:6809","nonce":1881025735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1881025735},{"type":"v1","addr":"172.21.15.99:6811","nonce":1881025735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1881025735},{"type":"v1","addr":"172.21.15.99:6815","nonce":1881025735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":1881025735},{"type":"v1","addr":"172.21.15.99:6813","nonce":1881025735}]},"public_addr":"172.21.15.99:6809/1881025735","cluster_addr":"172.21.15.99:6811/1881025735","heartbeat_back_addr":"172.21.15.99:6815/1881025735","heartbeat_front_addr":"172.21.15.99:6813/1881025735","state":["exists","up"]},{"osd":5,"uuid":"2f499ab4-3d09-4f96-a709-b4229865c690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1141976511},{"type":"v1","addr":"172.21.15.117:6809","nonce":1141976511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1141976511},{"type":"v1","addr":"172.21.15.117:6811","nonce":1141976511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1141976511},{"type":"v1","addr":"172.21.15.117:6815","nonce":1141976511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1141976511},{"type":"v1","addr":"172.21.15.117:6813","nonce":1141976511}]},"public_addr":"172.21.15.117:6809/1141976511","cluster_addr":"172.21.15.117:6811/1141976511","heartbeat_back_addr":"172.21.15.117:6815/1141976511","heartbeat_front_addr":"172.21.15.117:6813/1141976511","state":["exists","up"]},{"osd":6,"uuid":"10f7fd72-1ae8-4efd-a448-75f4b5054be3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":770433145},{"type":"v1","addr":"172.21.15.37:6819","nonce":770433145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":770433145},{"type":"v1","addr":"172.21.15.37:6821","nonce":770433145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":770433145},{"type":"v1","addr":"172.21.15.37:6825","nonce":770433145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":770433145},{"type":"v1","addr":"172.21.15.37:6823","nonce":770433145}]},"public_addr":"172.21.15.37:6819/770433145","cluster_addr":"172.21.15.37:6821/770433145","heartbeat_back_addr":"172.21.15.37:6825/770433145","heartbeat_front_addr":"172.21.15.37:6823/770433145","state":["exists","up"]},{"osd":7,"uuid":"7199a267-c486-417c-b530-3ff03fc9eb1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1694360992},{"type":"v1","addr":"172.21.15.99:6817","nonce":1694360992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1694360992},{"type":"v1","addr":"172.21.15.99:6819","nonce":1694360992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":1694360992},{"type":"v1","addr":"172.21.15.99:6823","nonce":1694360992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":1694360992},{"type":"v1","addr":"172.21.15.99:6821","nonce":1694360992}]},"public_addr":"172.21.15.99:6817/1694360992","cluster_addr":"172.21.15.99:6819/1694360992","heartbeat_back_addr":"172.21.15.99:6823/1694360992","heartbeat_front_addr":"172.21.15.99:6821/1694360992","state":["exists","up"]},{"osd":8,"uuid":"8d5bb83c-62eb-4ded-8a16-e8d57ab102c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2005866772},{"type":"v1","addr":"172.21.15.117:6817","nonce":2005866772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2005866772},{"type":"v1","addr":"172.21.15.117:6819","nonce":2005866772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2005866772},{"type":"v1","addr":"172.21.15.117:6823","nonce":2005866772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2005866772},{"type":"v1","addr":"172.21.15.117:6821","nonce":2005866772}]},"public_addr":"172.21.15.117:6817/2005866772","cluster_addr":"172.21.15.117:6819/2005866772","heartbeat_back_addr":"172.21.15.117:6823/2005866772","heartbeat_front_addr":"172.21.15.117:6821/2005866772","state":["exists","up"]},{"osd":9,"uuid":"04b6203d-a10c-4a55-8e59-b30012dee02b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1398779376},{"type":"v1","addr":"172.21.15.37:6827","nonce":1398779376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1398779376},{"type":"v1","addr":"172.21.15.37:6829","nonce":1398779376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1398779376},{"type":"v1","addr":"172.21.15.37:6833","nonce":1398779376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1398779376},{"type":"v1","addr":"172.21.15.37:6831","nonce":1398779376}]},"public_addr":"172.21.15.37:6827/1398779376","cluster_addr":"172.21.15.37:6829/1398779376","heartbeat_back_addr":"172.21.15.37:6833/1398779376","heartbeat_front_addr":"172.21.15.37:6831/1398779376","state":["exists","up"]},{"osd":10,"uuid":"bbf8ff4b-29cd-4d56-a30e-ff2de3555f78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2200957302},{"type":"v1","addr":"172.21.15.99:6825","nonce":2200957302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2200957302},{"type":"v1","addr":"172.21.15.99:6827","nonce":2200957302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2200957302},{"type":"v1","addr":"172.21.15.99:6831","nonce":2200957302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2200957302},{"type":"v1","addr":"172.21.15.99:6829","nonce":2200957302}]},"public_addr":"172.21.15.99:6825/2200957302","cluster_addr":"172.21.15.99:6827/2200957302","heartbeat_back_addr":"172.21.15.99:6831/2200957302","heartbeat_front_addr":"172.21.15.99:6829/2200957302","state":["exists","up"]},{"osd":11,"uuid":"041d54f4-a274-47b5-a467-0ce86efd363b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":1354423136},{"type":"v1","addr":"172.21.15.117:6825","nonce":1354423136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":1354423136},{"type":"v1","addr":"172.21.15.117:6827","nonce":1354423136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":1354423136},{"type":"v1","addr":"172.21.15.117:6831","nonce":1354423136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":1354423136},{"type":"v1","addr":"172.21.15.117:6829","nonce":1354423136}]},"public_addr":"172.21.15.117:6825/1354423136","cluster_addr":"172.21.15.117:6827/1354423136","heartbeat_back_addr":"172.21.15.117:6831/1354423136","heartbeat_front_addr":"172.21.15.117:6829/1354423136","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:58:33.697099+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:58:59.641549+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:59:23.811178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:59:49.550214+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:00:15.034610+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:00:39.399651+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:01:05.106379+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:01:30.375956+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:01:54.881549+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:02:21.519316+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:02:46.125918+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:03:11.310862+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6801/133577710":"2024-09-20T05:57:12.560771+0000","172.21.15.37:6800/133577710":"2024-09-20T05:57:12.560771+0000","172.21.15.37:0/2877363162":"2024-09-20T05:57:12.560771+0000","172.21.15.37:0/1053171617":"2024-09-20T05:57:12.560771+0000","172.21.15.37:6800/3277805697":"2024-09-20T05:56:49.335334+0000","172.21.15.37:0/1280697705":"2024-09-20T05:56:49.335334+0000","172.21.15.37:0/1106526058":"2024-09-20T05:57:12.560771+0000","172.21.15.37:0/1978184693":"2024-09-20T05:56:49.335334+0000","172.21.15.37:6801/3277805697":"2024-09-20T05:56:49.335334+0000","172.21.15.37:0/3650338877":"2024-09-20T05:56:49.335334+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:04:23.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:23.845+0000 7f2fbef01640 1 -- 172.21.15.37:0/2331905050 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f2fa80a3240 msgr2=0x7f2fa80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:23.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:23.845+0000 7f2fbef01640 1 --2- 172.21.15.37:0/2331905050 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f2fa80a3240 0x7f2fa80a5700 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2fac009900 tx=0x7f2fac0058d0 comp rx=0 tx=0).stop 2024-09-19T06:04:23.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:23.845+0000 7f2fbef01640 1 -- 172.21.15.37:0/2331905050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2fb8106a80 msgr2=0x7f2fb819bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:23.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:23.845+0000 7f2fbef01640 1 --2- 172.21.15.37:0/2331905050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2fb8106a80 0x7f2fb819bc70 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2fb000cad0 tx=0x7f2fb000cf90 comp rx=0 tx=0).stop 2024-09-19T06:04:23.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:23.845+0000 7f2fbef01640 1 -- 172.21.15.37:0/2331905050 shutdown_connections 2024-09-19T06:04:23.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:23.845+0000 7f2fbef01640 1 --2- 172.21.15.37:0/2331905050 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f2fa80a3240 0x7f2fa80a5700 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:23.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:23.845+0000 7f2fbef01640 1 --2- 172.21.15.37:0/2331905050 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2fb8101420 0x7f2fb81978e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:23.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:23.845+0000 7f2fbef01640 1 --2- 172.21.15.37:0/2331905050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2fb8106a80 0x7f2fb819bc70 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:23.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:23.845+0000 7f2fbef01640 1 --2- 172.21.15.37:0/2331905050 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2fb8100a80 0x7f2fb81973a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:23.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:23.845+0000 7f2fbef01640 1 -- 172.21.15.37:0/2331905050 >> 172.21.15.37:0/2331905050 conn(0x7f2fb80fc7a0 msgr2=0x7f2fb80fd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:23.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:23.845+0000 7f2fbef01640 1 -- 172.21.15.37:0/2331905050 shutdown_connections 2024-09-19T06:04:23.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:23.845+0000 7f2fbef01640 1 -- 172.21.15.37:0/2331905050 wait complete. 2024-09-19T06:04:24.654 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-19T06:04:06.253034+0000', 'modified': '2024-09-19T06:04:15.206139+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24485}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24485': {'gid': 24485, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.99:6839/3404812329', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6838', 'nonce': 3404812329}, {'type': 'v1', 'addr': '172.21.15.99:6839', 'nonce': 3404812329}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 24485, 'qdb_cluster': [24485]} 2024-09-19T06:04:24.654 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-19T06:04:24.655 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-19T06:04:24.741 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:24 smithi099 ceph-mon[35300]: pgmap v292: 129 pgs: 129 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:04:24.741 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:24 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/2331905050' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:04:24.749 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:24 smithi117 ceph-mon[35050]: pgmap v292: 129 pgs: 129 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:04:24.749 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:24 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/2331905050' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:04:24.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:24 smithi037 ceph-mon[31211]: pgmap v292: 129 pgs: 129 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:04:24.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:24 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/2331905050' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:04:24.915 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:04:25.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.360+0000 7f5dcf613640 1 -- 172.21.15.37:0/738426885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5dc8103720 msgr2=0x7f5dc810bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:25.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.360+0000 7f5dcf613640 1 --2- 172.21.15.37:0/738426885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5dc8103720 0x7f5dc810bc10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5db8009900 tx=0x7f5db802a480 comp rx=0 tx=0).stop 2024-09-19T06:04:25.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.360+0000 7f5dcf613640 1 -- 172.21.15.37:0/738426885 shutdown_connections 2024-09-19T06:04:25.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.360+0000 7f5dcf613640 1 --2- 172.21.15.37:0/738426885 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5dc810c1a0 0x7f5dc810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:25.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.360+0000 7f5dcf613640 1 --2- 172.21.15.37:0/738426885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5dc8103720 0x7f5dc810bc10 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:25.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.360+0000 7f5dcf613640 1 --2- 172.21.15.37:0/738426885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5dc8102e00 0x7f5dc81031e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:25.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.360+0000 7f5dcf613640 1 -- 172.21.15.37:0/738426885 >> 172.21.15.37:0/738426885 conn(0x7f5dc80fc7a0 msgr2=0x7f5dc80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:25.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.360+0000 7f5dcf613640 1 -- 172.21.15.37:0/738426885 shutdown_connections 2024-09-19T06:04:25.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.360+0000 7f5dcf613640 1 -- 172.21.15.37:0/738426885 wait complete. 2024-09-19T06:04:25.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.361+0000 7f5dcf613640 1 Processor -- start 2024-09-19T06:04:25.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.361+0000 7f5dcf613640 1 -- start start 2024-09-19T06:04:25.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.361+0000 7f5dcf613640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5dc8102e00 0x7f5dc8198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:25.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.361+0000 7f5dcf613640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5dc8103720 0x7f5dc81989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:25.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.361+0000 7f5dcf613640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5dc810c1a0 0x7f5dc819cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:25.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.361+0000 7f5dcf613640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5dc8111f70 con 0x7f5dc8102e00 2024-09-19T06:04:25.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.361+0000 7f5dcf613640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f5dc8111df0 con 0x7f5dc8103720 2024-09-19T06:04:25.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.361+0000 7f5dcf613640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5dc81120f0 con 0x7f5dc810c1a0 2024-09-19T06:04:25.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.361+0000 7f5dcd3af640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5dc8102e00 0x7f5dc8198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:25.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.361+0000 7f5dcd3af640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5dc8102e00 0x7f5dc8198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39592/0 (socket says 172.21.15.37:39592) 2024-09-19T06:04:25.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.361+0000 7f5dcd3af640 1 -- 172.21.15.37:0/1721952314 learned_addr learned my addr 172.21.15.37:0/1721952314 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:04:25.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.361+0000 7f5dccbae640 1 --2- 172.21.15.37:0/1721952314 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5dc8103720 0x7f5dc81989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:25.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.361+0000 7f5dcdbb0640 1 --2- 172.21.15.37:0/1721952314 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5dc810c1a0 0x7f5dc819cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:25.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.362+0000 7f5dcd3af640 1 -- 172.21.15.37:0/1721952314 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5dc810c1a0 msgr2=0x7f5dc819cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:25.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.362+0000 7f5dcd3af640 1 --2- 172.21.15.37:0/1721952314 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5dc810c1a0 0x7f5dc819cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:25.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.362+0000 7f5dcd3af640 1 -- 172.21.15.37:0/1721952314 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5dc8103720 msgr2=0x7f5dc81989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:25.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.362+0000 7f5dcd3af640 1 --2- 172.21.15.37:0/1721952314 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5dc8103720 0x7f5dc81989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:25.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.362+0000 7f5dcd3af640 1 -- 172.21.15.37:0/1721952314 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dc819d420 con 0x7f5dc8102e00 2024-09-19T06:04:25.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.362+0000 7f5dcdbb0640 1 --2- 172.21.15.37:0/1721952314 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5dc810c1a0 0x7f5dc819cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:04:25.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.362+0000 7f5dccbae640 1 --2- 172.21.15.37:0/1721952314 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5dc8103720 0x7f5dc81989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:04:25.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.362+0000 7f5dcd3af640 1 --2- 172.21.15.37:0/1721952314 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5dc8102e00 0x7f5dc8198470 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5dc400c920 tx=0x7f5dc400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:25.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.362+0000 7f5dbe7fc640 1 -- 172.21.15.37:0/1721952314 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc4007c70 con 0x7f5dc8102e00 2024-09-19T06:04:25.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.362+0000 7f5dcf613640 1 -- 172.21.15.37:0/1721952314 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dc819d710 con 0x7f5dc8102e00 2024-09-19T06:04:25.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.362+0000 7f5dbe7fc640 1 -- 172.21.15.37:0/1721952314 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5dc4007e10 con 0x7f5dc8102e00 2024-09-19T06:04:25.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.362+0000 7f5dbe7fc640 1 -- 172.21.15.37:0/1721952314 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc4018890 con 0x7f5dc8102e00 2024-09-19T06:04:25.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.362+0000 7f5dcf613640 1 -- 172.21.15.37:0/1721952314 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dc81a4ff0 con 0x7f5dc8102e00 2024-09-19T06:04:25.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.364+0000 7f5dbe7fc640 1 -- 172.21.15.37:0/1721952314 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f5dc4018a50 con 0x7f5dc8102e00 2024-09-19T06:04:25.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.365+0000 7f5dd19ec740 1 Processor -- start 2024-09-19T06:04:25.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.365+0000 7f5dd19ec740 1 -- start start 2024-09-19T06:04:25.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.365+0000 7f5dd19ec740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cc7ddef8d0 0x55cc7ddefcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:25.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.365+0000 7f5dd19ec740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cc7ddf01f0 0x55cc7ddfea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:25.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.365+0000 7f5dd19ec740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cc7ddfefc0 0x55cc7de013b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:25.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.365+0000 7f5dd19ec740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55cc7dd56090 con 0x55cc7ddfefc0 2024-09-19T06:04:25.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.365+0000 7f5dd19ec740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55cc7dcfda70 con 0x55cc7ddf01f0 2024-09-19T06:04:25.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.365+0000 7f5dd19ec740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55cc7dd52050 con 0x55cc7ddef8d0 2024-09-19T06:04:25.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.365+0000 7f5dbe7fc640 1 --2- 172.21.15.37:0/1721952314 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f5db40a3240 0x7f5db40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:25.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.365+0000 7f5dccbae640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cc7ddfefc0 0x55cc7de013b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:25.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.365+0000 7f5dccbae640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cc7ddfefc0 0x55cc7de013b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39596/0 (socket says 172.21.15.37:39596) 2024-09-19T06:04:25.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.365+0000 7f5dccbae640 1 -- 172.21.15.37:0/1231546669 learned_addr learned my addr 172.21.15.37:0/1231546669 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:04:25.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.365+0000 7f5dcd3af640 1 --2- 172.21.15.37:0/1231546669 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cc7ddf01f0 0x55cc7ddfea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:25.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.365+0000 7f5dcdbb0640 1 --2- 172.21.15.37:0/1231546669 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cc7ddef8d0 0x55cc7ddefcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:25.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.365+0000 7f5dcdbb0640 1 --2- 172.21.15.37:0/1721952314 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f5db40a3240 0x7f5db40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:25.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.366+0000 7f5dbe7fc640 1 -- 172.21.15.37:0/1721952314 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f5dc40cfc80 con 0x7f5dc8102e00 2024-09-19T06:04:25.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.366+0000 7f5dccbae640 1 -- 172.21.15.37:0/1231546669 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cc7ddef8d0 msgr2=0x55cc7ddefcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:04:25.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.366+0000 7f5dccbae640 1 --2- 172.21.15.37:0/1231546669 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cc7ddef8d0 0x55cc7ddefcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:25.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.366+0000 7f5dccbae640 1 -- 172.21.15.37:0/1231546669 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cc7ddf01f0 msgr2=0x55cc7ddfea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:04:25.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.366+0000 7f5dccbae640 1 --2- 172.21.15.37:0/1231546669 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cc7ddf01f0 0x55cc7ddfea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:25.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.366+0000 7f5dccbae640 1 -- 172.21.15.37:0/1231546669 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc7dd0a130 con 0x55cc7ddfefc0 2024-09-19T06:04:25.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.366+0000 7f5dccbae640 1 --2- 172.21.15.37:0/1231546669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cc7ddfefc0 0x55cc7de013b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5db802a9a0 tx=0x7f5db80315b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b4536fc6d26d0c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:25.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.366+0000 7f5dcdbb0640 1 --2- 172.21.15.37:0/1721952314 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f5db40a3240 0x7f5db40a5700 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5dc00094d0 tx=0x7f5dc0009500 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:25.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.366+0000 7f5db37fe640 1 -- 172.21.15.37:0/1231546669 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5db8035040 con 0x55cc7ddfefc0 2024-09-19T06:04:25.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.366+0000 7f5db37fe640 1 -- 172.21.15.37:0/1231546669 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5db8005020 con 0x55cc7ddfefc0 2024-09-19T06:04:25.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.366+0000 7f5db37fe640 1 -- 172.21.15.37:0/1231546669 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5db8004a00 con 0x55cc7ddfefc0 2024-09-19T06:04:25.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.367+0000 7f5dd19ec740 1 -- 172.21.15.37:0/1231546669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cc7ddfefc0 msgr2=0x55cc7de013b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:25.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.367+0000 7f5dd19ec740 1 --2- 172.21.15.37:0/1231546669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cc7ddfefc0 0x55cc7de013b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5db802a9a0 tx=0x7f5db80315b0 comp rx=0 tx=0).stop 2024-09-19T06:04:25.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.367+0000 7f5dd19ec740 1 -- 172.21.15.37:0/1231546669 shutdown_connections 2024-09-19T06:04:25.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.367+0000 7f5dd19ec740 1 --2- 172.21.15.37:0/1231546669 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cc7ddf01f0 0x55cc7ddfea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:25.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.367+0000 7f5dd19ec740 1 --2- 172.21.15.37:0/1231546669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cc7ddfefc0 0x55cc7de013b0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:25.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.367+0000 7f5dd19ec740 1 --2- 172.21.15.37:0/1231546669 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cc7ddef8d0 0x55cc7ddefcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:25.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.367+0000 7f5dd19ec740 1 -- 172.21.15.37:0/1231546669 >> 172.21.15.37:0/1231546669 conn(0x55cc7ddebf60 msgr2=0x55cc7ddec340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:25.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.367+0000 7f5dd19ec740 1 -- 172.21.15.37:0/1231546669 shutdown_connections 2024-09-19T06:04:25.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.367+0000 7f5dd19ec740 1 -- 172.21.15.37:0/1231546669 wait complete. 2024-09-19T06:04:25.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.367+0000 7f5dd19ec740 1 -- start start 2024-09-19T06:04:25.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.367+0000 7f5dd19ec740 1 Processor -- start 2024-09-19T06:04:25.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.368+0000 7f5dd19ec740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cc7ddef8d0 0x55cc7ddfe850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:25.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.368+0000 7f5dd19ec740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cc7ddf01f0 0x55cc7ddfbba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:25.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.368+0000 7f5dd19ec740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cc7ddfefc0 0x55cc7ddfc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:25.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.368+0000 7f5dd19ec740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55cc7de01b90 con 0x55cc7ddfefc0 2024-09-19T06:04:25.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.368+0000 7f5dd19ec740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55cc7dd10f20 con 0x55cc7ddf01f0 2024-09-19T06:04:25.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.368+0000 7f5dd19ec740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55cc7de01d10 con 0x55cc7ddef8d0 2024-09-19T06:04:25.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.368+0000 7f5dd19ec740 10 client.0 _ll_register_callbacks cb 0x55cc7dcda030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:04:25.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.368+0000 7f5dcdbb0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cc7ddfefc0 0x55cc7ddfc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:25.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.368+0000 7f5dcdbb0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cc7ddfefc0 0x55cc7ddfc0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39608/0 (socket says 172.21.15.37:39608) 2024-09-19T06:04:25.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.368+0000 7f5dcdbb0640 1 -- 172.21.15.37:0/1777079313 learned_addr learned my addr 172.21.15.37:0/1777079313 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:04:25.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.368+0000 7f5dccbae640 1 --2- 172.21.15.37:0/1777079313 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cc7ddf01f0 0x55cc7ddfbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:25.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.368+0000 7f5dcd3af640 1 --2- 172.21.15.37:0/1777079313 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cc7ddef8d0 0x55cc7ddfe850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:25.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.368+0000 7f5dcdbb0640 1 -- 172.21.15.37:0/1777079313 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cc7ddef8d0 msgr2=0x55cc7ddfe850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:04:25.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.368+0000 7f5dcdbb0640 1 --2- 172.21.15.37:0/1777079313 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cc7ddef8d0 0x55cc7ddfe850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:25.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.368+0000 7f5dcdbb0640 1 -- 172.21.15.37:0/1777079313 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cc7ddf01f0 msgr2=0x55cc7ddfbba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:04:25.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.368+0000 7f5dcdbb0640 1 --2- 172.21.15.37:0/1777079313 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cc7ddf01f0 0x55cc7ddfbba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:25.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.368+0000 7f5dcdbb0640 1 -- 172.21.15.37:0/1777079313 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc7dac72b0 con 0x55cc7ddfefc0 2024-09-19T06:04:25.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.368+0000 7f5dcd3af640 1 --2- 172.21.15.37:0/1777079313 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cc7ddef8d0 0x55cc7ddfe850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:04:25.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.368+0000 7f5dccbae640 1 --2- 172.21.15.37:0/1777079313 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cc7ddf01f0 0x55cc7ddfbba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:04:25.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.369+0000 7f5dcdbb0640 1 --2- 172.21.15.37:0/1777079313 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cc7ddfefc0 0x55cc7ddfc0e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5dc00042e0 tx=0x7f5dc0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b077623d99caa07a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:25.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.369+0000 7f5db0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-19T06:04:25.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.369+0000 7f5db0ff9640 1 -- 172.21.15.37:0/1777079313 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc0004860 con 0x55cc7ddfefc0 2024-09-19T06:04:25.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.369+0000 7f5dd19ec740 1 -- 172.21.15.37:0/1777079313 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5db8005020 con 0x55cc7ddfefc0 2024-09-19T06:04:25.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.369+0000 7f5db0ff9640 1 -- 172.21.15.37:0/1777079313 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f5dc001f420 con 0x55cc7ddfefc0 2024-09-19T06:04:25.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.369+0000 7f5db0ff9640 1 -- 172.21.15.37:0/1777079313 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f5dc0011e80 con 0x55cc7ddfefc0 2024-09-19T06:04:25.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.369+0000 7f5dd19ec740 10 client.14694 fetch_fsmap learned FSMap version 16 2024-09-19T06:04:25.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.369+0000 7f5dd19ec740 1 -- 172.21.15.37:0/1777079313 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=4+}) -- 0x55cc7de0d540 con 0x55cc7ddfefc0 2024-09-19T06:04:25.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.369+0000 7f5db0ff9640 1 -- 172.21.15.37:0/1777079313 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5db8005020 con 0x55cc7ddfefc0 2024-09-19T06:04:25.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.369+0000 7f5db0ff9640 1 -- 172.21.15.37:0/1777079313 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 16) ==== 8350+0+0 (secure 0 0 0) 0x7f5dc0028940 con 0x55cc7ddfefc0 2024-09-19T06:04:25.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.369+0000 7f5dd19ec740 10 client.14694 fetch_fsmap finished waiting for FSMap version 16 2024-09-19T06:04:25.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.369+0000 7f5dd19ec740 10 client.14694 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T06:04:25.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.369+0000 7f5dd19ec740 20 client.14694 populate_metadata read hostname 'smithi037' 2024-09-19T06:04:25.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.369+0000 7f5dd19ec740 1 --2- 172.21.15.37:0/1777079313 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x55cc7de0fba0 0x55cc7de11010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:25.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.369+0000 7f5dd19ec740 4 client.14694 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:04:25.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.369+0000 7f5dd19ec740 1 -- 172.21.15.37:0/1777079313 --> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cc7dd63600 con 0x55cc7de0fba0 2024-09-19T06:04:25.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.370+0000 7f5dcd3af640 1 --2- 172.21.15.37:0/1777079313 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x55cc7de0fba0 0x55cc7de11010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:25.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.370+0000 7f5db0ff9640 10 client.14694 ms_handle_connect on v2:172.21.15.99:6838/3404812329 2024-09-19T06:04:25.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.370+0000 7f5dcd3af640 1 --2- 172.21.15.37:0/1777079313 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x55cc7de0fba0 0x55cc7de11010 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9fa0a19a57233571 server_cookie=acf9683e20729a8a in_seq=0 out_seq=0 2024-09-19T06:04:25.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.371+0000 7f5db0ff9640 1 -- 172.21.15.37:0/1777079313 <== mds.0 v2:172.21.15.99:6838/3404812329 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cc7dd63600 con 0x55cc7de0fba0 2024-09-19T06:04:25.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.371+0000 7f5db0ff9640 10 client.14694 handle_command_reply: tid=0 2024-09-19T06:04:25.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.371+0000 7f5dd19ec740 1 client.14694 shutdown 2024-09-19T06:04:25.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.371+0000 7f5dd19ec740 1 -- 172.21.15.37:0/1777079313 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cc7ddfefc0 msgr2=0x55cc7ddfc0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:25.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.371+0000 7f5dd19ec740 1 --2- 172.21.15.37:0/1777079313 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cc7ddfefc0 0x55cc7ddfc0e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5dc00042e0 tx=0x7f5dc0004a40 comp rx=0 tx=0).stop 2024-09-19T06:04:25.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.372+0000 7f5dd19ec740 1 -- 172.21.15.37:0/1777079313 shutdown_connections 2024-09-19T06:04:25.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.372+0000 7f5dd19ec740 1 --2- 172.21.15.37:0/1777079313 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x55cc7de0fba0 0x55cc7de11010 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:25.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.372+0000 7f5dd19ec740 1 --2- 172.21.15.37:0/1777079313 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cc7ddf01f0 0x55cc7ddfbba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:25.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.372+0000 7f5dd19ec740 1 --2- 172.21.15.37:0/1777079313 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cc7ddfefc0 0x55cc7ddfc0e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:25.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.372+0000 7f5db0ff9640 0 client.14694 ms_handle_reset on v2:172.21.15.99:6838/3404812329 2024-09-19T06:04:25.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.372+0000 7f5dd19ec740 1 --2- 172.21.15.37:0/1777079313 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cc7ddef8d0 0x55cc7ddfe850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:25.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.372+0000 7f5dd19ec740 1 -- 172.21.15.37:0/1777079313 >> 172.21.15.37:0/1777079313 conn(0x55cc7ddebf60 msgr2=0x55cc7ddf1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:25.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.372+0000 7f5dd19ec740 1 -- 172.21.15.37:0/1777079313 shutdown_connections 2024-09-19T06:04:25.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.372+0000 7f5dd19ec740 1 -- 172.21.15.37:0/1777079313 wait complete. 2024-09-19T06:04:25.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.372+0000 7f5dd19ec740 20 client.14694 trim_cache size 0 max 16384 2024-09-19T06:04:25.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.390+0000 7f5dd19ec740 1 Processor -- start 2024-09-19T06:04:25.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.390+0000 7f5dd19ec740 1 -- start start 2024-09-19T06:04:25.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.390+0000 7f5dd19ec740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cc7ddef8d0 0x55cc7ddfb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:25.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.390+0000 7f5dd19ec740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cc7ddf01f0 0x55cc7ddfa470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:25.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.390+0000 7f5dd19ec740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cc7ddfefc0 0x55cc7ddfa9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:25.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.390+0000 7f5dd19ec740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55cc7de0f350 con 0x55cc7ddf01f0 2024-09-19T06:04:25.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.390+0000 7f5dd19ec740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55cc7de0fa20 con 0x55cc7ddef8d0 2024-09-19T06:04:25.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.390+0000 7f5dd19ec740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55cc7de100f0 con 0x55cc7ddfefc0 2024-09-19T06:04:25.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.390+0000 7f5dccbae640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cc7ddf01f0 0x55cc7ddfa470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:25.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.390+0000 7f5dccbae640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cc7ddf01f0 0x55cc7ddfa470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39620/0 (socket says 172.21.15.37:39620) 2024-09-19T06:04:25.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.390+0000 7f5dccbae640 1 -- 172.21.15.37:0/3433133441 learned_addr learned my addr 172.21.15.37:0/3433133441 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:04:25.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.390+0000 7f5dcd3af640 1 --2- 172.21.15.37:0/3433133441 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cc7ddef8d0 0x55cc7ddfb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:25.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.391+0000 7f5dcdbb0640 1 --2- 172.21.15.37:0/3433133441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cc7ddfefc0 0x55cc7ddfa9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:25.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.391+0000 7f5dccbae640 1 -- 172.21.15.37:0/3433133441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cc7ddfefc0 msgr2=0x55cc7ddfa9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:04:25.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.391+0000 7f5dccbae640 1 --2- 172.21.15.37:0/3433133441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cc7ddfefc0 0x55cc7ddfa9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:25.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.391+0000 7f5dccbae640 1 -- 172.21.15.37:0/3433133441 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cc7ddef8d0 msgr2=0x55cc7ddfb0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:04:25.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.391+0000 7f5dccbae640 1 --2- 172.21.15.37:0/3433133441 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cc7ddef8d0 0x55cc7ddfb0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:25.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.391+0000 7f5dccbae640 1 -- 172.21.15.37:0/3433133441 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc7ddebd90 con 0x55cc7ddf01f0 2024-09-19T06:04:25.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.391+0000 7f5dccbae640 1 --2- 172.21.15.37:0/3433133441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cc7ddf01f0 0x55cc7ddfa470 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5db802a9a0 tx=0x7f5db80314e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f2183b146149974 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:25.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.391+0000 7f5db2ffd640 1 -- 172.21.15.37:0/3433133441 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5db8035040 con 0x55cc7ddf01f0 2024-09-19T06:04:25.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.391+0000 7f5db2ffd640 1 -- 172.21.15.37:0/3433133441 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5db804e070 con 0x55cc7ddf01f0 2024-09-19T06:04:25.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.391+0000 7f5db2ffd640 1 -- 172.21.15.37:0/3433133441 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5db8004920 con 0x55cc7ddf01f0 2024-09-19T06:04:25.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.392+0000 7f5dd19ec740 1 -- 172.21.15.37:0/3433133441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cc7ddf01f0 msgr2=0x55cc7ddfa470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:25.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.392+0000 7f5dd19ec740 1 --2- 172.21.15.37:0/3433133441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cc7ddf01f0 0x55cc7ddfa470 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5db802a9a0 tx=0x7f5db80314e0 comp rx=0 tx=0).stop 2024-09-19T06:04:25.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.392+0000 7f5dd19ec740 1 -- 172.21.15.37:0/3433133441 shutdown_connections 2024-09-19T06:04:25.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.392+0000 7f5dd19ec740 1 --2- 172.21.15.37:0/3433133441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cc7ddfefc0 0x55cc7ddfa9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:25.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.392+0000 7f5dd19ec740 1 --2- 172.21.15.37:0/3433133441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cc7ddf01f0 0x55cc7ddfa470 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:25.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.392+0000 7f5dd19ec740 1 --2- 172.21.15.37:0/3433133441 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cc7ddef8d0 0x55cc7ddfb0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:25.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.392+0000 7f5dd19ec740 1 -- 172.21.15.37:0/3433133441 >> 172.21.15.37:0/3433133441 conn(0x55cc7ddebf60 msgr2=0x55cc7ddfbb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:25.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.392+0000 7f5dd19ec740 1 -- 172.21.15.37:0/3433133441 shutdown_connections 2024-09-19T06:04:25.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.392+0000 7f5dd19ec740 1 -- 172.21.15.37:0/3433133441 wait complete. 2024-09-19T06:04:25.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.392+0000 7f5dd19ec740 1 -- start start 2024-09-19T06:04:25.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.393+0000 7f5dd19ec740 1 Processor -- start 2024-09-19T06:04:25.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.393+0000 7f5dd19ec740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cc7ddef8d0 0x55cc7ddf4570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:25.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.393+0000 7f5dd19ec740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cc7ddf01f0 0x55cc7ddf4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:25.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.393+0000 7f5dd19ec740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cc7ddfefc0 0x55cc7ddf4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:25.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.393+0000 7f5dd19ec740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55cc7de10e90 con 0x55cc7ddef8d0 2024-09-19T06:04:25.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.393+0000 7f5dd19ec740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55cc7de107c0 con 0x55cc7ddf01f0 2024-09-19T06:04:25.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.393+0000 7f5dd19ec740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55cc7de11560 con 0x55cc7ddfefc0 2024-09-19T06:04:25.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.393+0000 7f5dd19ec740 10 client.0 _ll_register_callbacks cb 0x7f5dc0003970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:04:25.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.393+0000 7f5dcd3af640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cc7ddef8d0 0x55cc7ddf4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:25.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.393+0000 7f5dcd3af640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cc7ddef8d0 0x55cc7ddf4570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39624/0 (socket says 172.21.15.37:39624) 2024-09-19T06:04:25.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.393+0000 7f5dcd3af640 1 -- 172.21.15.37:0/3775457141 learned_addr learned my addr 172.21.15.37:0/3775457141 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:04:25.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.393+0000 7f5dccbae640 1 --2- 172.21.15.37:0/3775457141 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cc7ddf01f0 0x55cc7ddf4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:25.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.393+0000 7f5dcd3af640 1 -- 172.21.15.37:0/3775457141 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cc7ddfefc0 msgr2=0x55cc7ddf4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:04:25.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.393+0000 7f5dcdbb0640 1 --2- 172.21.15.37:0/3775457141 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cc7ddfefc0 0x55cc7ddf4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:25.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.393+0000 7f5dcd3af640 1 --2- 172.21.15.37:0/3775457141 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cc7ddfefc0 0x55cc7ddf4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:25.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.393+0000 7f5dcd3af640 1 -- 172.21.15.37:0/3775457141 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cc7ddf01f0 msgr2=0x55cc7ddf4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:04:25.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.393+0000 7f5dcd3af640 1 --2- 172.21.15.37:0/3775457141 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cc7ddf01f0 0x55cc7ddf4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:25.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.393+0000 7f5dcd3af640 1 -- 172.21.15.37:0/3775457141 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc7de01d00 con 0x55cc7ddef8d0 2024-09-19T06:04:25.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.394+0000 7f5dcdbb0640 1 --2- 172.21.15.37:0/3775457141 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cc7ddfefc0 0x55cc7ddf4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:04:25.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.394+0000 7f5dcd3af640 1 --2- 172.21.15.37:0/3775457141 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cc7ddef8d0 0x55cc7ddf4570 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5dc400dfd0 tx=0x7f5dc40bc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46217194e2cb20f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:25.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.394+0000 7f5db0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-19T06:04:25.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.394+0000 7f5db0ff9640 1 -- 172.21.15.37:0/3775457141 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc40a4cd0 con 0x55cc7ddef8d0 2024-09-19T06:04:25.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.394+0000 7f5db0ff9640 1 -- 172.21.15.37:0/3775457141 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f5dc409a360 con 0x55cc7ddef8d0 2024-09-19T06:04:25.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.394+0000 7f5dd19ec740 1 -- 172.21.15.37:0/3775457141 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5db804e070 con 0x55cc7ddef8d0 2024-09-19T06:04:25.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.394+0000 7f5db0ff9640 1 -- 172.21.15.37:0/3775457141 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f5dc4018d40 con 0x55cc7ddef8d0 2024-09-19T06:04:25.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.394+0000 7f5dd19ec740 10 client.14700 fetch_fsmap learned FSMap version 16 2024-09-19T06:04:25.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.394+0000 7f5dd19ec740 1 -- 172.21.15.37:0/3775457141 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=4+}) -- 0x55cc7de19220 con 0x55cc7ddef8d0 2024-09-19T06:04:25.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.394+0000 7f5db0ff9640 1 -- 172.21.15.37:0/3775457141 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5db804e070 con 0x55cc7ddef8d0 2024-09-19T06:04:25.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.394+0000 7f5db0ff9640 1 -- 172.21.15.37:0/3775457141 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 16) ==== 8350+0+0 (secure 0 0 0) 0x7f5dc40986d0 con 0x55cc7ddef8d0 2024-09-19T06:04:25.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.395+0000 7f5dd19ec740 10 client.14700 fetch_fsmap finished waiting for FSMap version 16 2024-09-19T06:04:25.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.395+0000 7f5dd19ec740 10 client.14700 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T06:04:25.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.395+0000 7f5dd19ec740 20 client.14700 populate_metadata read hostname 'smithi037' 2024-09-19T06:04:25.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.395+0000 7f5dd19ec740 1 --2- 172.21.15.37:0/3775457141 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x55cc7de82660 0x55cc7de7eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:25.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.395+0000 7f5dd19ec740 4 client.14700 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T06:04:25.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.395+0000 7f5dd19ec740 1 -- 172.21.15.37:0/3775457141 --> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] -- command(tid 0: {"prefix": "status"}) -- 0x55cc7dd5db10 con 0x55cc7de82660 2024-09-19T06:04:25.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.395+0000 7f5dccbae640 1 --2- 172.21.15.37:0/3775457141 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x55cc7de82660 0x55cc7de7eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:25.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.395+0000 7f5dccbae640 1 --2- 172.21.15.37:0/3775457141 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x55cc7de82660 0x55cc7de7eaa0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=968d4bb5d2986a95 server_cookie=38f7ce5c463bb9f9 in_seq=0 out_seq=0 2024-09-19T06:04:25.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.395+0000 7f5db0ff9640 10 client.14700 ms_handle_connect on v2:172.21.15.99:6838/3404812329 2024-09-19T06:04:25.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.396+0000 7f5db0ff9640 1 -- 172.21.15.37:0/3775457141 <== mds.0 v2:172.21.15.99:6838/3404812329 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55cc7dd5db10 con 0x55cc7de82660 2024-09-19T06:04:25.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.396+0000 7f5db0ff9640 10 client.14700 handle_command_reply: tid=0 2024-09-19T06:04:25.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.396+0000 7f5dd19ec740 1 client.14700 shutdown 2024-09-19T06:04:25.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.396+0000 7f5dd19ec740 1 -- 172.21.15.37:0/3775457141 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cc7ddef8d0 msgr2=0x55cc7ddf4570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:25.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.396+0000 7f5dd19ec740 1 --2- 172.21.15.37:0/3775457141 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cc7ddef8d0 0x55cc7ddf4570 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5dc400dfd0 tx=0x7f5dc40bc040 comp rx=0 tx=0).stop 2024-09-19T06:04:25.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.396+0000 7f5dd19ec740 1 -- 172.21.15.37:0/3775457141 shutdown_connections 2024-09-19T06:04:25.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.396+0000 7f5dd19ec740 1 --2- 172.21.15.37:0/3775457141 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x55cc7de82660 0x55cc7de7eaa0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:25.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.396+0000 7f5dd19ec740 1 --2- 172.21.15.37:0/3775457141 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cc7ddf01f0 0x55cc7ddf4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:25.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.396+0000 7f5dd19ec740 1 --2- 172.21.15.37:0/3775457141 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cc7ddfefc0 0x55cc7ddf4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:25.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.396+0000 7f5dd19ec740 1 --2- 172.21.15.37:0/3775457141 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cc7ddef8d0 0x55cc7ddf4570 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:25.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.396+0000 7f5dd19ec740 1 -- 172.21.15.37:0/3775457141 >> 172.21.15.37:0/3775457141 conn(0x55cc7ddebf60 msgr2=0x55cc7ddfa070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:25.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.396+0000 7f5db0ff9640 0 client.14700 ms_handle_reset on v2:172.21.15.99:6838/3404812329 2024-09-19T06:04:25.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.396+0000 7f5dd19ec740 1 -- 172.21.15.37:0/3775457141 shutdown_connections 2024-09-19T06:04:25.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.396+0000 7f5dd19ec740 1 -- 172.21.15.37:0/3775457141 wait complete. 2024-09-19T06:04:25.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.396+0000 7f5dd19ec740 20 client.14700 trim_cache size 0 max 16384 2024-09-19T06:04:25.403 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-19T06:04:25.403 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "b8c8bdae-764b-11ef-bceb-c7b262605968", 2024-09-19T06:04:25.403 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2024-09-19T06:04:25.403 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 24485, 2024-09-19T06:04:25.403 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-09-19T06:04:25.403 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-09-19T06:04:25.403 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-09-19T06:04:25.404 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 18.98453181, 2024-09-19T06:04:25.404 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 16, 2024-09-19T06:04:25.404 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 87, 2024-09-19T06:04:25.404 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 87, 2024-09-19T06:04:25.404 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 30.221990987000002 2024-09-19T06:04:25.404 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-19T06:04:25.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.397+0000 7f5dcf613640 1 -- 172.21.15.37:0/1721952314 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f5db40a3240 msgr2=0x7f5db40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:25.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.397+0000 7f5dcf613640 1 --2- 172.21.15.37:0/1721952314 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f5db40a3240 0x7f5db40a5700 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5dc00094d0 tx=0x7f5dc0009500 comp rx=0 tx=0).stop 2024-09-19T06:04:25.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.397+0000 7f5dcf613640 1 -- 172.21.15.37:0/1721952314 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5dc8102e00 msgr2=0x7f5dc8198470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:25.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.397+0000 7f5dcf613640 1 --2- 172.21.15.37:0/1721952314 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5dc8102e00 0x7f5dc8198470 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5dc400c920 tx=0x7f5dc400cde0 comp rx=0 tx=0).stop 2024-09-19T06:04:25.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.397+0000 7f5dcf613640 1 -- 172.21.15.37:0/1721952314 shutdown_connections 2024-09-19T06:04:25.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.397+0000 7f5dcf613640 1 --2- 172.21.15.37:0/1721952314 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f5db40a3240 0x7f5db40a5700 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:25.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.397+0000 7f5dcf613640 1 --2- 172.21.15.37:0/1721952314 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5dc8103720 0x7f5dc81989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:25.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.397+0000 7f5dcf613640 1 --2- 172.21.15.37:0/1721952314 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5dc810c1a0 0x7f5dc819cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:25.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.397+0000 7f5dcf613640 1 --2- 172.21.15.37:0/1721952314 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5dc8102e00 0x7f5dc8198470 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:25.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.397+0000 7f5dcf613640 1 -- 172.21.15.37:0/1721952314 >> 172.21.15.37:0/1721952314 conn(0x7f5dc80fc7a0 msgr2=0x7f5dc80fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:25.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.397+0000 7f5dcf613640 1 -- 172.21.15.37:0/1721952314 shutdown_connections 2024-09-19T06:04:25.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:25.397+0000 7f5dcf613640 1 -- 172.21.15.37:0/1721952314 wait complete. 2024-09-19T06:04:26.125 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-19T06:04:26.125 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-19T06:04:26.125 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-19T06:04:26.387 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:04:26.749 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:26 smithi117 ceph-mon[35050]: pgmap v293: 129 pgs: 129 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:04:26.820 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:26 smithi037 ceph-mon[31211]: pgmap v293: 129 pgs: 129 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:04:26.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:26.900+0000 7f959d97f640 1 -- 172.21.15.37:0/1729194240 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9598100e30 msgr2=0x7f9598104e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:26.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:26.900+0000 7f959d97f640 1 --2- 172.21.15.37:0/1729194240 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9598100e30 0x7f9598104e80 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f958c009ca0 tx=0x7f958c02a8c0 comp rx=0 tx=0).stop 2024-09-19T06:04:26.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:26.901+0000 7f959d97f640 1 -- 172.21.15.37:0/1729194240 shutdown_connections 2024-09-19T06:04:26.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:26.901+0000 7f959d97f640 1 --2- 172.21.15.37:0/1729194240 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95981055b0 0x7f959810d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:26.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:26.901+0000 7f959d97f640 1 --2- 172.21.15.37:0/1729194240 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9598100e30 0x7f9598104e80 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:26.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:26.901+0000 7f959d97f640 1 --2- 172.21.15.37:0/1729194240 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9598100480 0x7f9598100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:26.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:26.901+0000 7f959d97f640 1 -- 172.21.15.37:0/1729194240 >> 172.21.15.37:0/1729194240 conn(0x7f9598077210 msgr2=0x7f95980fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:26.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:26.901+0000 7f959d97f640 1 -- 172.21.15.37:0/1729194240 shutdown_connections 2024-09-19T06:04:26.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:26.901+0000 7f959d97f640 1 -- 172.21.15.37:0/1729194240 wait complete. 2024-09-19T06:04:26.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:26.901+0000 7f959d97f640 1 Processor -- start 2024-09-19T06:04:26.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:26.901+0000 7f959d97f640 1 -- start start 2024-09-19T06:04:26.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:26.901+0000 7f959d97f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9598100480 0x7f9598198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:26.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:26.902+0000 7f959d97f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9598100e30 0x7f95981989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:26.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:26.902+0000 7f959d97f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95981055b0 0x7f959819cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:26.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:26.902+0000 7f959d97f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9598110e60 con 0x7f95981055b0 2024-09-19T06:04:26.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:26.902+0000 7f959d97f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f9598110ce0 con 0x7f9598100480 2024-09-19T06:04:26.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:26.902+0000 7f959d97f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9598110fe0 con 0x7f9598100e30 2024-09-19T06:04:26.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:26.902+0000 7f95977fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95981055b0 0x7f959819cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:26.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:26.902+0000 7f95977fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95981055b0 0x7f959819cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39638/0 (socket says 172.21.15.37:39638) 2024-09-19T06:04:26.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:26.902+0000 7f95977fe640 1 -- 172.21.15.37:0/3358145513 learned_addr learned my addr 172.21.15.37:0/3358145513 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:04:26.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:26.902+0000 7f95967fc640 1 --2- 172.21.15.37:0/3358145513 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9598100e30 0x7f95981989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:26.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:26.902+0000 7f9596ffd640 1 --2- 172.21.15.37:0/3358145513 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9598100480 0x7f9598198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:26.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:26.902+0000 7f95977fe640 1 -- 172.21.15.37:0/3358145513 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9598100e30 msgr2=0x7f95981989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:26.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:26.902+0000 7f95977fe640 1 --2- 172.21.15.37:0/3358145513 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9598100e30 0x7f95981989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:26.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:26.902+0000 7f95977fe640 1 -- 172.21.15.37:0/3358145513 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9598100480 msgr2=0x7f9598198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:26.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:26.902+0000 7f95977fe640 1 --2- 172.21.15.37:0/3358145513 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9598100480 0x7f9598198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:26.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:26.902+0000 7f95977fe640 1 -- 172.21.15.37:0/3358145513 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f959819d430 con 0x7f95981055b0 2024-09-19T06:04:26.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:26.902+0000 7f95977fe640 1 --2- 172.21.15.37:0/3358145513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95981055b0 0x7f959819cd50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f959000d750 tx=0x7f959000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:26.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:26.902+0000 7f959c97d640 1 -- 172.21.15.37:0/3358145513 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9590017070 con 0x7f95981055b0 2024-09-19T06:04:26.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:26.902+0000 7f959c97d640 1 -- 172.21.15.37:0/3358145513 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9590005500 con 0x7f95981055b0 2024-09-19T06:04:26.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:26.902+0000 7f959d97f640 1 -- 172.21.15.37:0/3358145513 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f959819d720 con 0x7f95981055b0 2024-09-19T06:04:26.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:26.902+0000 7f959c97d640 1 -- 172.21.15.37:0/3358145513 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9590004d90 con 0x7f95981055b0 2024-09-19T06:04:26.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:26.902+0000 7f959d97f640 1 -- 172.21.15.37:0/3358145513 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95981a5000 con 0x7f95981055b0 2024-09-19T06:04:26.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:26.903+0000 7f959d97f640 1 -- 172.21.15.37:0/3358145513 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9598100860 con 0x7f95981055b0 2024-09-19T06:04:26.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:26.905+0000 7f959c97d640 1 -- 172.21.15.37:0/3358145513 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f9590004f30 con 0x7f95981055b0 2024-09-19T06:04:26.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:26.906+0000 7f959c97d640 1 --2- 172.21.15.37:0/3358145513 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f95800a32c0 0x7f95800a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:26.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:26.906+0000 7f959c97d640 1 -- 172.21.15.37:0/3358145513 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f95900cf910 con 0x7f95981055b0 2024-09-19T06:04:26.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:26.906+0000 7f9596ffd640 1 --2- 172.21.15.37:0/3358145513 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f95800a32c0 0x7f95800a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:26.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:26.907+0000 7f9596ffd640 1 --2- 172.21.15.37:0/3358145513 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f95800a32c0 0x7f95800a5780 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f95880058c0 tx=0x7f958800a4c0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:26.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:26.909+0000 7f959c97d640 1 -- 172.21.15.37:0/3358145513 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f959009c470 con 0x7f95981055b0 2024-09-19T06:04:26.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:26 smithi099 ceph-mon[35300]: pgmap v293: 129 pgs: 129 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:04:27.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:27.122+0000 7f959d97f640 1 -- 172.21.15.37:0/3358145513 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f95981997e0 con 0x7f95981055b0 2024-09-19T06:04:27.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:27.122+0000 7f959c97d640 1 -- 172.21.15.37:0/3358145513 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) ==== 53+0+88 (secure 0 0 0) 0x7f95981997e0 con 0x7f95981055b0 2024-09-19T06:04:27.123 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-19T06:04:27.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:27.124+0000 7f959d97f640 1 -- 172.21.15.37:0/3358145513 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f95800a32c0 msgr2=0x7f95800a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:27.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:27.124+0000 7f959d97f640 1 --2- 172.21.15.37:0/3358145513 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f95800a32c0 0x7f95800a5780 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f95880058c0 tx=0x7f958800a4c0 comp rx=0 tx=0).stop 2024-09-19T06:04:27.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:27.124+0000 7f959d97f640 1 -- 172.21.15.37:0/3358145513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95981055b0 msgr2=0x7f959819cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:27.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:27.124+0000 7f959d97f640 1 --2- 172.21.15.37:0/3358145513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95981055b0 0x7f959819cd50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f959000d750 tx=0x7f959000dc10 comp rx=0 tx=0).stop 2024-09-19T06:04:27.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:27.124+0000 7f959d97f640 1 -- 172.21.15.37:0/3358145513 shutdown_connections 2024-09-19T06:04:27.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:27.124+0000 7f959d97f640 1 --2- 172.21.15.37:0/3358145513 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f95800a32c0 0x7f95800a5780 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:27.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:27.124+0000 7f959d97f640 1 --2- 172.21.15.37:0/3358145513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95981055b0 0x7f959819cd50 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:27.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:27.124+0000 7f959d97f640 1 --2- 172.21.15.37:0/3358145513 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9598100e30 0x7f95981989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:27.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:27.124+0000 7f959d97f640 1 --2- 172.21.15.37:0/3358145513 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9598100480 0x7f9598198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:27.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:27.124+0000 7f959d97f640 1 -- 172.21.15.37:0/3358145513 >> 172.21.15.37:0/3358145513 conn(0x7f9598077210 msgr2=0x7f9598103dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:27.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:27.124+0000 7f959d97f640 1 -- 172.21.15.37:0/3358145513 shutdown_connections 2024-09-19T06:04:27.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:27.124+0000 7f959d97f640 1 -- 172.21.15.37:0/3358145513 wait complete. 2024-09-19T06:04:27.749 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:27 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/3358145513' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T06:04:27.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:27 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/3358145513' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T06:04:27.865 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-19T06:04:27.865 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T06:04:27.865 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2024-09-19T06:04:27.865 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-19T06:04:27.865 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-19T06:04:27.865 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-19T06:04:27.866 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T06:04:27.866 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T06:04:27.866 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-19T06:04:27.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:04:27.866 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2024-09-19T06:04:27.884 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T06:04:27.884 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T06:04:27.885 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T06:04:27.885 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-09-19T06:04:27.885 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2024-09-19T06:04:27.885 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-09-19T06:04:27.885 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T06:04:27.886 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2024-09-19T06:04:27.886 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2024-09-19T06:04:27.886 INFO:teuthology.orchestra.run.smithi037.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T06:04:27.886 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2024-09-19T06:04:27.886 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2024-09-19T06:04:27.886 INFO:teuthology.orchestra.run.smithi037.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T06:04:27.886 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2024-09-19T06:04:27.886 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2024-09-19T06:04:27.886 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-19T06:04:27.886 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 42274sec preferred_lft 42274sec 2024-09-19T06:04:27.886 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link 2024-09-19T06:04:27.886 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-09-19T06:04:27.886 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T06:04:27.887 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2024-09-19T06:04:27.887 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2024-09-19T06:04:27.887 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-19T06:04:27.888 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T06:04:27.888 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-09-19T06:04:27.888 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link add name ceph-brx type bridge 2024-09-19T06:04:27.888 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip addr flush dev ceph-brx 2024-09-19T06:04:27.888 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set ceph-brx up 2024-09-19T06:04:27.888 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-19T06:04:27.888 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-09-19T06:04:27.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:27 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/3358145513' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T06:04:27.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T06:04:28.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:04:28.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:04:28.099 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T06:04:28.125 INFO:teuthology.orchestra.run.smithi037.stdout:1 2024-09-19T06:04:28.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:04:28.127 DEBUG:teuthology.orchestra.run.smithi037:> route 2024-09-19T06:04:28.202 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2024-09-19T06:04:28.202 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T06:04:28.202 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-19T06:04:28.202 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-19T06:04:28.203 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T06:04:28.203 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T06:04:28.203 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-09-19T06:04:28.203 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-19T06:04:28.203 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-19T06:04:28.203 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-19T06:04:28.203 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-09-19T06:04:28.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T06:04:28.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:04:28.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:04:28.493 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2024-09-19T06:04:28.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:04:28.510 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list-id 2024-09-19T06:04:28.566 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T06:04:28.566 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-09-19T06:04:28.567 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-19T06:04:28.567 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-19T06:04:28.567 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-09-19T06:04:28.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T06:04:28.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:28 smithi037 ceph-mon[31211]: pgmap v294: 129 pgs: 129 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:04:28.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:04:28.687 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-19T06:04:28.687 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T06:04:28.687 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-09-19T06:04:28.687 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-19T06:04:28.687 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-19T06:04:28.687 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-19T06:04:28.687 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-19T06:04:28.687 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-19T06:04:28.687 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-09-19T06:04:28.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T06:04:28.749 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:28 smithi117 ceph-mon[35050]: pgmap v294: 129 pgs: 129 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:04:28.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:04:28.814 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T06:04:28.814 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-09-19T06:04:28.814 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2024-09-19T06:04:28.814 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set dev brx.0 master ceph-brx 2024-09-19T06:04:28.814 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-09-19T06:04:28.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T06:04:28.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:04:28.893 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-19T06:04:28.893 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T06:04:28.893 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-19T06:04:28.909 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-19T06:04:28.909 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T06:04:28.909 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-19T06:04:28.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:28 smithi099 ceph-mon[35300]: pgmap v294: 129 pgs: 129 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:04:28.964 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2024-09-19T06:04:29.032 DEBUG:teuthology.orchestra.run.smithi037:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T06:04:29.088 INFO:teuthology.orchestra.run.smithi037.stdout:/proc 2024-09-19T06:04:29.089 INFO:teuthology.orchestra.run.smithi037.stdout:/sys 2024-09-19T06:04:29.089 INFO:teuthology.orchestra.run.smithi037.stdout:/dev 2024-09-19T06:04:29.089 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/security 2024-09-19T06:04:29.089 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/shm 2024-09-19T06:04:29.089 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/pts 2024-09-19T06:04:29.089 INFO:teuthology.orchestra.run.smithi037.stdout:/run 2024-09-19T06:04:29.089 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/cgroup 2024-09-19T06:04:29.089 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/pstore 2024-09-19T06:04:29.089 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/bpf 2024-09-19T06:04:29.089 INFO:teuthology.orchestra.run.smithi037.stdout:/ 2024-09-19T06:04:29.089 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/selinux 2024-09-19T06:04:29.089 INFO:teuthology.orchestra.run.smithi037.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T06:04:29.089 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/debug 2024-09-19T06:04:29.089 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/hugepages 2024-09-19T06:04:29.090 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/mqueue 2024-09-19T06:04:29.090 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/tracing 2024-09-19T06:04:29.090 INFO:teuthology.orchestra.run.smithi037.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-19T06:04:29.090 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/fuse/connections 2024-09-19T06:04:29.090 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/config 2024-09-19T06:04:29.090 INFO:teuthology.orchestra.run.smithi037.stdout:/run/credentials/systemd-sysctl.service 2024-09-19T06:04:29.090 INFO:teuthology.orchestra.run.smithi037.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-19T06:04:29.090 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/nfs/rpc_pipefs 2024-09-19T06:04:29.090 INFO:teuthology.orchestra.run.smithi037.stdout:/run/user/1000 2024-09-19T06:04:29.090 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/ceph 2024-09-19T06:04:29.090 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay 2024-09-19T06:04:29.090 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/f761cb3ff7f90698cfd1535c0fd99702822171d03ea752711b5300808afa681b/merged 2024-09-19T06:04:29.090 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/22bce8d1135aeaed84622e7ce4a6cc9999d0e0dee592bbefa145a122407bb057/merged 2024-09-19T06:04:29.090 INFO:teuthology.orchestra.run.smithi037.stdout:/run/user/0 2024-09-19T06:04:29.091 INFO:teuthology.orchestra.run.smithi037.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T06:04:29.091 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/cbe0b0fd0a7985ef862156c248a07873dde1229eebf8bcd6325eb5cbffacdc4a/merged 2024-09-19T06:04:29.091 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/4e4ee9d280166bae63386ad56dc303bbed9af9ebac9fd55e48d598ae41bb3e7e/merged 2024-09-19T06:04:29.091 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/3d0e173621ae069f5f1f09bfb50d6b794cd8d2b3d315a6d67bdb32316f434739/merged 2024-09-19T06:04:29.091 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/a2f1cb7d636452b416a5d2dbdfd6bc56f0228a1a7abfec225a4dd6e07f32d287/merged 2024-09-19T06:04:29.091 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/aaf246f4cf516b26f3b2f9c76c584be3d1f1bda204bdf4f20fbec7bf039342d7/merged 2024-09-19T06:04:29.091 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/855b08f6741810fc011aba18923b0aae57f3c4d77855c501a67fbe38103a6b5e/merged 2024-09-19T06:04:29.091 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/b8651ca6e1b2e42aa69735b1ce589aa94493df26f6ba40502fe8cc841fd8b55c/merged 2024-09-19T06:04:29.091 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/d09878c75bd855800345e10c5ffed9ae42c2f12332cc7ec0597c009bee1e4e97/merged 2024-09-19T06:04:29.091 INFO:teuthology.orchestra.run.smithi037.stdout:/run/netns 2024-09-19T06:04:29.091 INFO:teuthology.orchestra.run.smithi037.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-19T06:04:29.091 INFO:teuthology.orchestra.run.smithi037.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-19T06:04:29.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:04:29.092 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2024-09-19T06:04:29.145 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-19T06:04:29.145 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-19T06:04:29.187 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2024-09-19T06:04:29.213 DEBUG:teuthology.orchestra.run.smithi037:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T06:04:29.270 INFO:teuthology.orchestra.run.smithi037.stdout:/proc 2024-09-19T06:04:29.270 INFO:teuthology.orchestra.run.smithi037.stdout:/sys 2024-09-19T06:04:29.270 INFO:teuthology.orchestra.run.smithi037.stdout:/dev 2024-09-19T06:04:29.270 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/security 2024-09-19T06:04:29.270 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/shm 2024-09-19T06:04:29.270 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/pts 2024-09-19T06:04:29.271 INFO:teuthology.orchestra.run.smithi037.stdout:/run 2024-09-19T06:04:29.271 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/cgroup 2024-09-19T06:04:29.271 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/pstore 2024-09-19T06:04:29.271 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/bpf 2024-09-19T06:04:29.271 INFO:teuthology.orchestra.run.smithi037.stdout:/ 2024-09-19T06:04:29.271 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/selinux 2024-09-19T06:04:29.271 INFO:teuthology.orchestra.run.smithi037.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T06:04:29.271 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/debug 2024-09-19T06:04:29.271 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/hugepages 2024-09-19T06:04:29.271 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/mqueue 2024-09-19T06:04:29.271 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/tracing 2024-09-19T06:04:29.271 INFO:teuthology.orchestra.run.smithi037.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-19T06:04:29.271 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/fuse/connections 2024-09-19T06:04:29.272 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/config 2024-09-19T06:04:29.272 INFO:teuthology.orchestra.run.smithi037.stdout:/run/credentials/systemd-sysctl.service 2024-09-19T06:04:29.272 INFO:teuthology.orchestra.run.smithi037.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-19T06:04:29.272 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/nfs/rpc_pipefs 2024-09-19T06:04:29.272 INFO:teuthology.orchestra.run.smithi037.stdout:/run/user/1000 2024-09-19T06:04:29.272 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/ceph 2024-09-19T06:04:29.272 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay 2024-09-19T06:04:29.272 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/f761cb3ff7f90698cfd1535c0fd99702822171d03ea752711b5300808afa681b/merged 2024-09-19T06:04:29.272 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/22bce8d1135aeaed84622e7ce4a6cc9999d0e0dee592bbefa145a122407bb057/merged 2024-09-19T06:04:29.272 INFO:teuthology.orchestra.run.smithi037.stdout:/run/user/0 2024-09-19T06:04:29.272 INFO:teuthology.orchestra.run.smithi037.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T06:04:29.272 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/cbe0b0fd0a7985ef862156c248a07873dde1229eebf8bcd6325eb5cbffacdc4a/merged 2024-09-19T06:04:29.272 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/4e4ee9d280166bae63386ad56dc303bbed9af9ebac9fd55e48d598ae41bb3e7e/merged 2024-09-19T06:04:29.273 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/3d0e173621ae069f5f1f09bfb50d6b794cd8d2b3d315a6d67bdb32316f434739/merged 2024-09-19T06:04:29.273 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/a2f1cb7d636452b416a5d2dbdfd6bc56f0228a1a7abfec225a4dd6e07f32d287/merged 2024-09-19T06:04:29.273 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/aaf246f4cf516b26f3b2f9c76c584be3d1f1bda204bdf4f20fbec7bf039342d7/merged 2024-09-19T06:04:29.273 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/855b08f6741810fc011aba18923b0aae57f3c4d77855c501a67fbe38103a6b5e/merged 2024-09-19T06:04:29.273 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/b8651ca6e1b2e42aa69735b1ce589aa94493df26f6ba40502fe8cc841fd8b55c/merged 2024-09-19T06:04:29.273 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/d09878c75bd855800345e10c5ffed9ae42c2f12332cc7ec0597c009bee1e4e97/merged 2024-09-19T06:04:29.273 INFO:teuthology.orchestra.run.smithi037.stdout:/run/netns 2024-09-19T06:04:29.273 INFO:teuthology.orchestra.run.smithi037.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-19T06:04:29.273 INFO:teuthology.orchestra.run.smithi037.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-19T06:04:29.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:04:29.273 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2024-09-19T06:04:29.286 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi037.stderr:2024-09-19T06:04:29.285+0000 7f4e23349480 -1 init, newargv = 0x55df476a0a90 newargc=15 2024-09-19T06:04:29.286 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi037.stderr:ceph-fuse[72691]: starting ceph client 2024-09-19T06:04:29.293 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi037.stderr:ceph-fuse[72691]: starting fuse 2024-09-19T06:04:29.305 INFO:teuthology.orchestra.run.smithi037.stdout:120 2024-09-19T06:04:29.305 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [120] 2024-09-19T06:04:29.306 DEBUG:teuthology.orchestra.run.smithi037:> sudo stdin-killer -- python3 -c ' 2024-09-19T06:04:29.306 DEBUG:teuthology.orchestra.run.smithi037:> import glob 2024-09-19T06:04:29.306 DEBUG:teuthology.orchestra.run.smithi037:> import re 2024-09-19T06:04:29.306 DEBUG:teuthology.orchestra.run.smithi037:> import os 2024-09-19T06:04:29.306 DEBUG:teuthology.orchestra.run.smithi037:> import subprocess 2024-09-19T06:04:29.306 DEBUG:teuthology.orchestra.run.smithi037:> 2024-09-19T06:04:29.306 DEBUG:teuthology.orchestra.run.smithi037:> def _find_admin_socket(client_name): 2024-09-19T06:04:29.306 DEBUG:teuthology.orchestra.run.smithi037:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-19T06:04:29.307 DEBUG:teuthology.orchestra.run.smithi037:> files = glob.glob(asok_path) 2024-09-19T06:04:29.307 DEBUG:teuthology.orchestra.run.smithi037:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-19T06:04:29.307 DEBUG:teuthology.orchestra.run.smithi037:> 2024-09-19T06:04:29.307 DEBUG:teuthology.orchestra.run.smithi037:> # Given a non-glob path, it better be there 2024-09-19T06:04:29.307 DEBUG:teuthology.orchestra.run.smithi037:> if "*" not in asok_path: 2024-09-19T06:04:29.307 DEBUG:teuthology.orchestra.run.smithi037:> assert(len(files) == 1) 2024-09-19T06:04:29.307 DEBUG:teuthology.orchestra.run.smithi037:> return files[0] 2024-09-19T06:04:29.307 DEBUG:teuthology.orchestra.run.smithi037:> 2024-09-19T06:04:29.307 DEBUG:teuthology.orchestra.run.smithi037:> for f in files: 2024-09-19T06:04:29.307 DEBUG:teuthology.orchestra.run.smithi037:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-19T06:04:29.307 DEBUG:teuthology.orchestra.run.smithi037:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-19T06:04:29.308 DEBUG:teuthology.orchestra.run.smithi037:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-19T06:04:29.308 DEBUG:teuthology.orchestra.run.smithi037:> contents = proc_f.read() 2024-09-19T06:04:29.308 DEBUG:teuthology.orchestra.run.smithi037:> if mountpoint in contents: 2024-09-19T06:04:29.308 DEBUG:teuthology.orchestra.run.smithi037:> return f 2024-09-19T06:04:29.308 DEBUG:teuthology.orchestra.run.smithi037:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-19T06:04:29.308 DEBUG:teuthology.orchestra.run.smithi037:> 2024-09-19T06:04:29.308 DEBUG:teuthology.orchestra.run.smithi037:> print(_find_admin_socket("client.admin")) 2024-09-19T06:04:29.309 DEBUG:teuthology.orchestra.run.smithi037:> ' 2024-09-19T06:04:29.426 INFO:teuthology.orchestra.run.smithi037.stdout:/var/run/ceph/ceph-client.admin.72691.asok 2024-09-19T06:04:29.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:04:29.438 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.72691.asok 2024-09-19T06:04:29.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:04:29.438 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.72691.asok status 2024-09-19T06:04:29.576 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-19T06:04:29.576 INFO:teuthology.orchestra.run.smithi037.stdout: "metadata": { 2024-09-19T06:04:29.576 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_sha1": "2f599a46ad10e37c929e5c43da2f6907ddcd1961", 2024-09-19T06:04:29.576 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T06:04:29.576 INFO:teuthology.orchestra.run.smithi037.stdout: "entity_id": "admin", 2024-09-19T06:04:29.576 INFO:teuthology.orchestra.run.smithi037.stdout: "hostname": "smithi037", 2024-09-19T06:04:29.576 INFO:teuthology.orchestra.run.smithi037.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-19T06:04:29.577 INFO:teuthology.orchestra.run.smithi037.stdout: "pid": "72691", 2024-09-19T06:04:29.577 INFO:teuthology.orchestra.run.smithi037.stdout: "root": "/" 2024-09-19T06:04:29.577 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:04:29.577 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_count": 0, 2024-09-19T06:04:29.577 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_pinned_count": 0, 2024-09-19T06:04:29.577 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 14712, 2024-09-19T06:04:29.577 INFO:teuthology.orchestra.run.smithi037.stdout: "inst": { 2024-09-19T06:04:29.577 INFO:teuthology.orchestra.run.smithi037.stdout: "name": { 2024-09-19T06:04:29.577 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "client", 2024-09-19T06:04:29.577 INFO:teuthology.orchestra.run.smithi037.stdout: "num": 14712 2024-09-19T06:04:29.577 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:04:29.578 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2024-09-19T06:04:29.578 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2024-09-19T06:04:29.578 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "192.168.0.1:0", 2024-09-19T06:04:29.578 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 1344667832 2024-09-19T06:04:29.578 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:04:29.578 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:04:29.578 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2024-09-19T06:04:29.578 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2024-09-19T06:04:29.578 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "192.168.0.1:0", 2024-09-19T06:04:29.578 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 1344667832 2024-09-19T06:04:29.578 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:04:29.579 INFO:teuthology.orchestra.run.smithi037.stdout: "inst_str": "client.14712 192.168.0.1:0/1344667832", 2024-09-19T06:04:29.579 INFO:teuthology.orchestra.run.smithi037.stdout: "addr_str": "192.168.0.1:0/1344667832", 2024-09-19T06:04:29.579 INFO:teuthology.orchestra.run.smithi037.stdout: "inode_count": 1, 2024-09-19T06:04:29.579 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_epoch": 16, 2024-09-19T06:04:29.579 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch": 87, 2024-09-19T06:04:29.579 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch_barrier": 0, 2024-09-19T06:04:29.579 INFO:teuthology.orchestra.run.smithi037.stdout: "blocklisted": false, 2024-09-19T06:04:29.579 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs" 2024-09-19T06:04:29.579 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-19T06:04:29.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:04:29.584 DEBUG:teuthology.orchestra.run.smithi037:> stat --file-system '--printf=%T 2024-09-19T06:04:29.585 DEBUG:teuthology.orchestra.run.smithi037:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-19T06:04:29.601 INFO:teuthology.orchestra.run.smithi037.stdout:fuseblk 2024-09-19T06:04:29.601 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-19T06:04:29.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:04:29.601 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-19T06:04:29.669 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-19T06:04:29.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T06:04:29.778 INFO:teuthology.orchestra.run.smithi037.stdout:# file: . 2024-09-19T06:04:29.779 INFO:teuthology.orchestra.run.smithi037.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-19T06:04:29.779 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T06:04:29.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:04:29.785 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-19T06:04:29.785 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T06:04:29.802 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-19T06:04:30.099 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:04:30.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:30.598+0000 7f265e2e4640 1 -- 172.21.15.37:0/2482254407 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2658106f10 msgr2=0x7f265810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:30.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:30.598+0000 7f265e2e4640 1 --2- 172.21.15.37:0/2482254407 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2658106f10 0x7f265810ea90 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2650009ca0 tx=0x7f265002a8c0 comp rx=0 tx=0).stop 2024-09-19T06:04:30.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:30.598+0000 7f265e2e4640 1 -- 172.21.15.37:0/2482254407 shutdown_connections 2024-09-19T06:04:30.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:30.598+0000 7f265e2e4640 1 --2- 172.21.15.37:0/2482254407 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2658106f10 0x7f265810ea90 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:30.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:30.598+0000 7f265e2e4640 1 --2- 172.21.15.37:0/2482254407 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2658102790 0x7f26581067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:30.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:30.598+0000 7f265e2e4640 1 --2- 172.21.15.37:0/2482254407 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2658101de0 0x7f26581021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:30.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:30.598+0000 7f265e2e4640 1 -- 172.21.15.37:0/2482254407 >> 172.21.15.37:0/2482254407 conn(0x7f26580fd8c0 msgr2=0x7f26580ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:30.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:30.598+0000 7f265e2e4640 1 -- 172.21.15.37:0/2482254407 shutdown_connections 2024-09-19T06:04:30.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:30.598+0000 7f265e2e4640 1 -- 172.21.15.37:0/2482254407 wait complete. 2024-09-19T06:04:30.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:30.598+0000 7f265e2e4640 1 Processor -- start 2024-09-19T06:04:30.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:30.598+0000 7f265e2e4640 1 -- start start 2024-09-19T06:04:30.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:30.599+0000 7f265e2e4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2658101de0 0x7f26580744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:30.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:30.599+0000 7f265e2e4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2658102790 0x7f2658074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:30.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:30.599+0000 7f265e2e4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2658106f10 0x7f2658074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:30.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:30.599+0000 7f265e2e4640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2658111f70 con 0x7f2658101de0 2024-09-19T06:04:30.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:30.599+0000 7f265e2e4640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f2658111df0 con 0x7f2658106f10 2024-09-19T06:04:30.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:30.599+0000 7f265e2e4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f26581120f0 con 0x7f2658102790 2024-09-19T06:04:30.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:30.599+0000 7f2657fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2658101de0 0x7f26580744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:30.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:30.599+0000 7f2657fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2658101de0 0x7f26580744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39654/0 (socket says 172.21.15.37:39654) 2024-09-19T06:04:30.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:30.599+0000 7f2657fff640 1 -- 172.21.15.37:0/3515852311 learned_addr learned my addr 172.21.15.37:0/3515852311 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:04:30.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:30.599+0000 7f265c881640 1 --2- 172.21.15.37:0/3515852311 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2658106f10 0x7f2658074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:30.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:30.599+0000 7f26577fe640 1 --2- 172.21.15.37:0/3515852311 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2658102790 0x7f2658074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:30.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:30.599+0000 7f2657fff640 1 -- 172.21.15.37:0/3515852311 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2658102790 msgr2=0x7f2658074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:30.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:30.599+0000 7f2657fff640 1 --2- 172.21.15.37:0/3515852311 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2658102790 0x7f2658074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:30.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:30.599+0000 7f2657fff640 1 -- 172.21.15.37:0/3515852311 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2658106f10 msgr2=0x7f2658074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:30.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:30.599+0000 7f2657fff640 1 --2- 172.21.15.37:0/3515852311 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2658106f10 0x7f2658074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:30.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:30.599+0000 7f2657fff640 1 -- 172.21.15.37:0/3515852311 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26581a6890 con 0x7f2658101de0 2024-09-19T06:04:30.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:30.599+0000 7f265c881640 1 --2- 172.21.15.37:0/3515852311 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2658106f10 0x7f2658074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:04:30.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:30.600+0000 7f2657fff640 1 --2- 172.21.15.37:0/3515852311 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2658101de0 0x7f26580744f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f264800c890 tx=0x7f264800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:30.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:30.600+0000 7f26557fa640 1 -- 172.21.15.37:0/3515852311 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2648004220 con 0x7f2658101de0 2024-09-19T06:04:30.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:30.600+0000 7f26557fa640 1 -- 172.21.15.37:0/3515852311 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f26480043c0 con 0x7f2658101de0 2024-09-19T06:04:30.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:30.600+0000 7f265e2e4640 1 -- 172.21.15.37:0/3515852311 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26581a6b80 con 0x7f2658101de0 2024-09-19T06:04:30.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:30.600+0000 7f26557fa640 1 -- 172.21.15.37:0/3515852311 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26480049e0 con 0x7f2658101de0 2024-09-19T06:04:30.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:30.600+0000 7f265e2e4640 1 -- 172.21.15.37:0/3515852311 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26581a7110 con 0x7f2658101de0 2024-09-19T06:04:30.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:30.601+0000 7f265e2e4640 1 -- 172.21.15.37:0/3515852311 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26581021c0 con 0x7f2658101de0 2024-09-19T06:04:30.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:30.602+0000 7f26557fa640 1 -- 172.21.15.37:0/3515852311 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f26480079b0 con 0x7f2658101de0 2024-09-19T06:04:30.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:30.603+0000 7f26557fa640 1 --2- 172.21.15.37:0/3515852311 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f26400a32c0 0x7f26400a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:30.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:30.603+0000 7f26577fe640 1 --2- 172.21.15.37:0/3515852311 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f26400a32c0 0x7f26400a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:30.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:30.603+0000 7f26557fa640 1 -- 172.21.15.37:0/3515852311 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f26480cfbc0 con 0x7f2658101de0 2024-09-19T06:04:30.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:30.603+0000 7f26577fe640 1 --2- 172.21.15.37:0/3515852311 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f26400a32c0 0x7f26400a5780 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f264c005e00 tx=0x7f264c005c50 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:30.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:30.606+0000 7f26557fa640 1 -- 172.21.15.37:0/3515852311 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2648014030 con 0x7f2658101de0 2024-09-19T06:04:30.749 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:30 smithi117 ceph-mon[35050]: pgmap v295: 129 pgs: 129 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:04:30.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:30.796+0000 7f265e2e4640 1 -- 172.21.15.37:0/3515852311 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f2658075a20 con 0x7f2658101de0 2024-09-19T06:04:30.797 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:30 smithi037 ceph-mon[31211]: pgmap v295: 129 pgs: 129 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:04:30.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:30.797+0000 7f26557fa640 1 -- 172.21.15.37:0/3515852311 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v87) ==== 81+0+590 (secure 0 0 0) 0x7f264809c720 con 0x7f2658101de0 2024-09-19T06:04:30.798 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6801/133577710 2024-09-20T05:57:12.560771+0000 2024-09-19T06:04:30.798 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6800/133577710 2024-09-20T05:57:12.560771+0000 2024-09-19T06:04:30.798 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/2877363162 2024-09-20T05:57:12.560771+0000 2024-09-19T06:04:30.798 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/1053171617 2024-09-20T05:57:12.560771+0000 2024-09-19T06:04:30.798 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6800/3277805697 2024-09-20T05:56:49.335334+0000 2024-09-19T06:04:30.798 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/1280697705 2024-09-20T05:56:49.335334+0000 2024-09-19T06:04:30.798 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/1106526058 2024-09-20T05:57:12.560771+0000 2024-09-19T06:04:30.798 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/1978184693 2024-09-20T05:56:49.335334+0000 2024-09-19T06:04:30.799 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6801/3277805697 2024-09-20T05:56:49.335334+0000 2024-09-19T06:04:30.799 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/3650338877 2024-09-20T05:56:49.335334+0000 2024-09-19T06:04:30.799 INFO:teuthology.orchestra.run.smithi037.stderr:listed 10 entries 2024-09-19T06:04:30.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:30.799+0000 7f265e2e4640 1 -- 172.21.15.37:0/3515852311 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f26400a32c0 msgr2=0x7f26400a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:30.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:30.799+0000 7f265e2e4640 1 --2- 172.21.15.37:0/3515852311 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f26400a32c0 0x7f26400a5780 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f264c005e00 tx=0x7f264c005c50 comp rx=0 tx=0).stop 2024-09-19T06:04:30.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:30.799+0000 7f265e2e4640 1 -- 172.21.15.37:0/3515852311 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2658101de0 msgr2=0x7f26580744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:30.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:30.799+0000 7f265e2e4640 1 --2- 172.21.15.37:0/3515852311 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2658101de0 0x7f26580744f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f264800c890 tx=0x7f264800cd50 comp rx=0 tx=0).stop 2024-09-19T06:04:30.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:30.799+0000 7f265e2e4640 1 -- 172.21.15.37:0/3515852311 shutdown_connections 2024-09-19T06:04:30.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:30.799+0000 7f265e2e4640 1 --2- 172.21.15.37:0/3515852311 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f26400a32c0 0x7f26400a5780 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:30.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:30.799+0000 7f265e2e4640 1 --2- 172.21.15.37:0/3515852311 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2658106f10 0x7f2658074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:30.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:30.799+0000 7f265e2e4640 1 --2- 172.21.15.37:0/3515852311 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2658102790 0x7f2658074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:30.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:30.799+0000 7f265e2e4640 1 --2- 172.21.15.37:0/3515852311 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2658101de0 0x7f26580744f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:30.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:30.799+0000 7f265e2e4640 1 -- 172.21.15.37:0/3515852311 >> 172.21.15.37:0/3515852311 conn(0x7f26580fd8c0 msgr2=0x7f26580fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:30.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:30.799+0000 7f265e2e4640 1 -- 172.21.15.37:0/3515852311 shutdown_connections 2024-09-19T06:04:30.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:30.799+0000 7f265e2e4640 1 -- 172.21.15.37:0/3515852311 wait complete. 2024-09-19T06:04:30.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:30 smithi099 ceph-mon[35300]: pgmap v295: 129 pgs: 129 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:04:31.467 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-19T06:04:31.467 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T06:04:31.486 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-19T06:04:31.749 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:31 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/3515852311' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T06:04:31.784 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:04:31.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:31 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/3515852311' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T06:04:31.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:31 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/3515852311' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T06:04:32.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:32.279+0000 7f2be4bea640 1 -- 172.21.15.37:0/3971871810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2be0112ba0 msgr2=0x7f2be0114f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:32.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:32.279+0000 7f2be4bea640 1 --2- 172.21.15.37:0/3971871810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2be0112ba0 0x7f2be0114f90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2bd8009900 tx=0x7f2bd802a480 comp rx=0 tx=0).stop 2024-09-19T06:04:32.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:32.279+0000 7f2be4bea640 1 -- 172.21.15.37:0/3971871810 shutdown_connections 2024-09-19T06:04:32.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:32.279+0000 7f2be4bea640 1 --2- 172.21.15.37:0/3971871810 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2be0074eb0 0x7f2be0112660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:32.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:32.279+0000 7f2be4bea640 1 --2- 172.21.15.37:0/3971871810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2be0112ba0 0x7f2be0114f90 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:32.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:32.279+0000 7f2be4bea640 1 --2- 172.21.15.37:0/3971871810 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2be0074590 0x7f2be0074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:32.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:32.279+0000 7f2be4bea640 1 -- 172.21.15.37:0/3971871810 >> 172.21.15.37:0/3971871810 conn(0x7f2be00fd8f0 msgr2=0x7f2be00ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:32.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:32.279+0000 7f2be4bea640 1 -- 172.21.15.37:0/3971871810 shutdown_connections 2024-09-19T06:04:32.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:32.279+0000 7f2be4bea640 1 -- 172.21.15.37:0/3971871810 wait complete. 2024-09-19T06:04:32.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:32.280+0000 7f2be4bea640 1 Processor -- start 2024-09-19T06:04:32.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:32.280+0000 7f2be4bea640 1 -- start start 2024-09-19T06:04:32.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:32.280+0000 7f2be4bea640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2be0074590 0x7f2be01a46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:32.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:32.280+0000 7f2be4bea640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2be0074eb0 0x7f2be01a4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:32.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:32.280+0000 7f2be4bea640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2be0112ba0 0x7f2be019e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:32.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:32.280+0000 7f2be4bea640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2be01185d0 con 0x7f2be0074590 2024-09-19T06:04:32.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:32.280+0000 7f2be4bea640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f2be0118450 con 0x7f2be0112ba0 2024-09-19T06:04:32.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:32.280+0000 7f2be4bea640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2be0118750 con 0x7f2be0074eb0 2024-09-19T06:04:32.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:32.280+0000 7f2bde59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2be0074590 0x7f2be01a46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:32.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:32.280+0000 7f2bde59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2be0074590 0x7f2be01a46c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39676/0 (socket says 172.21.15.37:39676) 2024-09-19T06:04:32.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:32.280+0000 7f2bde59c640 1 -- 172.21.15.37:0/3008111895 learned_addr learned my addr 172.21.15.37:0/3008111895 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:04:32.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:32.280+0000 7f2bded9d640 1 --2- 172.21.15.37:0/3008111895 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2be0112ba0 0x7f2be019e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:32.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:32.280+0000 7f2bddd9b640 1 --2- 172.21.15.37:0/3008111895 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2be0074eb0 0x7f2be01a4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:32.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:32.280+0000 7f2bde59c640 1 -- 172.21.15.37:0/3008111895 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2be0074eb0 msgr2=0x7f2be01a4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:32.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:32.280+0000 7f2bde59c640 1 --2- 172.21.15.37:0/3008111895 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2be0074eb0 0x7f2be01a4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:32.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:32.280+0000 7f2bde59c640 1 -- 172.21.15.37:0/3008111895 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2be0112ba0 msgr2=0x7f2be019e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:32.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:32.280+0000 7f2bde59c640 1 --2- 172.21.15.37:0/3008111895 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2be0112ba0 0x7f2be019e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:32.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:32.280+0000 7f2bde59c640 1 -- 172.21.15.37:0/3008111895 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2be019efb0 con 0x7f2be0074590 2024-09-19T06:04:32.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:32.280+0000 7f2bddd9b640 1 --2- 172.21.15.37:0/3008111895 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2be0074eb0 0x7f2be01a4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:04:32.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:32.280+0000 7f2bde59c640 1 --2- 172.21.15.37:0/3008111895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2be0074590 0x7f2be01a46c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2bd000b4a0 tx=0x7f2bd000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:32.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:32.281+0000 7f2bd77fe640 1 -- 172.21.15.37:0/3008111895 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bd0014070 con 0x7f2be0074590 2024-09-19T06:04:32.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:32.281+0000 7f2bd77fe640 1 -- 172.21.15.37:0/3008111895 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2bd0010af0 con 0x7f2be0074590 2024-09-19T06:04:32.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:32.281+0000 7f2be4bea640 1 -- 172.21.15.37:0/3008111895 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2be019f2a0 con 0x7f2be0074590 2024-09-19T06:04:32.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:32.281+0000 7f2bd77fe640 1 -- 172.21.15.37:0/3008111895 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bd0017d10 con 0x7f2be0074590 2024-09-19T06:04:32.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:32.281+0000 7f2be4bea640 1 -- 172.21.15.37:0/3008111895 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2be01ab590 con 0x7f2be0074590 2024-09-19T06:04:32.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:32.282+0000 7f2be4bea640 1 -- 172.21.15.37:0/3008111895 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2be0074970 con 0x7f2be0074590 2024-09-19T06:04:32.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:32.283+0000 7f2bd77fe640 1 -- 172.21.15.37:0/3008111895 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f2bd0017070 con 0x7f2be0074590 2024-09-19T06:04:32.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:32.284+0000 7f2bd77fe640 1 --2- 172.21.15.37:0/3008111895 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f2bcc0a3240 0x7f2bcc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:32.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:32.284+0000 7f2bddd9b640 1 --2- 172.21.15.37:0/3008111895 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f2bcc0a3240 0x7f2bcc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:32.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:32.284+0000 7f2bd77fe640 1 -- 172.21.15.37:0/3008111895 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f2bd00cef90 con 0x7f2be0074590 2024-09-19T06:04:32.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:32.284+0000 7f2bddd9b640 1 --2- 172.21.15.37:0/3008111895 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f2bcc0a3240 0x7f2bcc0a5700 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2be00ffec0 tx=0x7f2bc8008350 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:32.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:32.288+0000 7f2bd77fe640 1 -- 172.21.15.37:0/3008111895 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2bd009ba70 con 0x7f2be0074590 2024-09-19T06:04:32.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:32.476+0000 7f2be4bea640 1 -- 172.21.15.37:0/3008111895 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f2be019fdb0 con 0x7f2be0074590 2024-09-19T06:04:32.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:32.476+0000 7f2bd77fe640 1 -- 172.21.15.37:0/3008111895 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v87) ==== 81+0+590 (secure 0 0 0) 0x7f2bd009b370 con 0x7f2be0074590 2024-09-19T06:04:32.477 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6801/133577710 2024-09-20T05:57:12.560771+0000 2024-09-19T06:04:32.478 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6800/133577710 2024-09-20T05:57:12.560771+0000 2024-09-19T06:04:32.478 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/2877363162 2024-09-20T05:57:12.560771+0000 2024-09-19T06:04:32.478 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/1053171617 2024-09-20T05:57:12.560771+0000 2024-09-19T06:04:32.478 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6800/3277805697 2024-09-20T05:56:49.335334+0000 2024-09-19T06:04:32.478 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/1280697705 2024-09-20T05:56:49.335334+0000 2024-09-19T06:04:32.478 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/1106526058 2024-09-20T05:57:12.560771+0000 2024-09-19T06:04:32.478 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/1978184693 2024-09-20T05:56:49.335334+0000 2024-09-19T06:04:32.478 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6801/3277805697 2024-09-20T05:56:49.335334+0000 2024-09-19T06:04:32.478 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/3650338877 2024-09-20T05:56:49.335334+0000 2024-09-19T06:04:32.478 INFO:teuthology.orchestra.run.smithi037.stderr:listed 10 entries 2024-09-19T06:04:32.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:32.478+0000 7f2be4bea640 1 -- 172.21.15.37:0/3008111895 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f2bcc0a3240 msgr2=0x7f2bcc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:32.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:32.478+0000 7f2be4bea640 1 --2- 172.21.15.37:0/3008111895 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f2bcc0a3240 0x7f2bcc0a5700 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2be00ffec0 tx=0x7f2bc8008350 comp rx=0 tx=0).stop 2024-09-19T06:04:32.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:32.478+0000 7f2be4bea640 1 -- 172.21.15.37:0/3008111895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2be0074590 msgr2=0x7f2be01a46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:32.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:32.478+0000 7f2be4bea640 1 --2- 172.21.15.37:0/3008111895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2be0074590 0x7f2be01a46c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2bd000b4a0 tx=0x7f2bd000b960 comp rx=0 tx=0).stop 2024-09-19T06:04:32.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:32.479+0000 7f2be4bea640 1 -- 172.21.15.37:0/3008111895 shutdown_connections 2024-09-19T06:04:32.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:32.479+0000 7f2be4bea640 1 --2- 172.21.15.37:0/3008111895 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f2bcc0a3240 0x7f2bcc0a5700 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:32.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:32.479+0000 7f2be4bea640 1 --2- 172.21.15.37:0/3008111895 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2be0112ba0 0x7f2be019e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:32.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:32.479+0000 7f2be4bea640 1 --2- 172.21.15.37:0/3008111895 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2be0074eb0 0x7f2be01a4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:32.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:32.479+0000 7f2be4bea640 1 --2- 172.21.15.37:0/3008111895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2be0074590 0x7f2be01a46c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:32.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:32.479+0000 7f2be4bea640 1 -- 172.21.15.37:0/3008111895 >> 172.21.15.37:0/3008111895 conn(0x7f2be00fd8f0 msgr2=0x7f2be00fef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:32.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:32.479+0000 7f2be4bea640 1 -- 172.21.15.37:0/3008111895 shutdown_connections 2024-09-19T06:04:32.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:32.479+0000 7f2be4bea640 1 -- 172.21.15.37:0/3008111895 wait complete. 2024-09-19T06:04:32.749 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:32 smithi117 ceph-mon[35050]: pgmap v296: 129 pgs: 129 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:04:32.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:32 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/3008111895' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T06:04:32.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:32 smithi037 ceph-mon[31211]: pgmap v296: 129 pgs: 129 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:04:32.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:32 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/3008111895' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T06:04:32.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:32 smithi099 ceph-mon[35300]: pgmap v296: 129 pgs: 129 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:04:32.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:32 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/3008111895' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T06:04:33.211 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi037.front.sepia.ceph.com... 2024-09-19T06:04:33.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:04:33.211 DEBUG:teuthology.orchestra.run.smithi037:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-19T06:04:33.239 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi037.stderr:ceph-fuse[72691]: fuse finished with error 0 and tester_r 0 2024-09-19T06:04:33.241 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T06:04:33.272 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2024-09-19T06:04:33.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:04:33.273 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-19T06:04:33.340 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T06:04:33.638 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:04:34.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:34.120+0000 7f7de1b11640 1 -- 172.21.15.37:0/1065278983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ddc102570 msgr2=0x7f7ddc1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:34.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:34.120+0000 7f7de1b11640 1 --2- 172.21.15.37:0/1065278983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ddc102570 0x7f7ddc1029b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7dc4009900 tx=0x7f7dc402a480 comp rx=0 tx=0).stop 2024-09-19T06:04:34.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:34.120+0000 7f7de1b11640 1 -- 172.21.15.37:0/1065278983 shutdown_connections 2024-09-19T06:04:34.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:34.120+0000 7f7de1b11640 1 --2- 172.21.15.37:0/1065278983 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ddc102ef0 0x7f7ddc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:34.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:34.120+0000 7f7de1b11640 1 --2- 172.21.15.37:0/1065278983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ddc102570 0x7f7ddc1029b0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:34.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:34.120+0000 7f7de1b11640 1 --2- 172.21.15.37:0/1065278983 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ddc100e20 0x7f7ddc101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:34.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:34.120+0000 7f7de1b11640 1 -- 172.21.15.37:0/1065278983 >> 172.21.15.37:0/1065278983 conn(0x7f7ddc0fc7d0 msgr2=0x7f7ddc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:34.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:34.120+0000 7f7de1b11640 1 -- 172.21.15.37:0/1065278983 shutdown_connections 2024-09-19T06:04:34.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:34.120+0000 7f7de1b11640 1 -- 172.21.15.37:0/1065278983 wait complete. 2024-09-19T06:04:34.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:34.121+0000 7f7de1b11640 1 Processor -- start 2024-09-19T06:04:34.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:34.121+0000 7f7de1b11640 1 -- start start 2024-09-19T06:04:34.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:34.121+0000 7f7de1b11640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ddc100e20 0x7f7ddc197450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:34.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:34.121+0000 7f7de1b11640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ddc102570 0x7f7ddc197990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:34.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:34.121+0000 7f7de1b11640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ddc102ef0 0x7f7ddc19bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:34.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:34.121+0000 7f7de1b11640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7ddc110ff0 con 0x7f7ddc102ef0 2024-09-19T06:04:34.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:34.121+0000 7f7de1b11640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f7ddc110e70 con 0x7f7ddc100e20 2024-09-19T06:04:34.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:34.121+0000 7f7de1b11640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7ddc111170 con 0x7f7ddc102570 2024-09-19T06:04:34.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:34.121+0000 7f7ddbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ddc102ef0 0x7f7ddc19bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:34.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:34.122+0000 7f7ddb7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ddc100e20 0x7f7ddc197450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:34.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:34.122+0000 7f7ddbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ddc102ef0 0x7f7ddc19bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57218/0 (socket says 172.21.15.37:57218) 2024-09-19T06:04:34.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:34.122+0000 7f7ddbfff640 1 -- 172.21.15.37:0/3433478069 learned_addr learned my addr 172.21.15.37:0/3433478069 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:04:34.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:34.122+0000 7f7dd3fff640 1 --2- 172.21.15.37:0/3433478069 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ddc102570 0x7f7ddc197990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:34.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:34.122+0000 7f7ddbfff640 1 -- 172.21.15.37:0/3433478069 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ddc102570 msgr2=0x7f7ddc197990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:34.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:34.122+0000 7f7ddbfff640 1 --2- 172.21.15.37:0/3433478069 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ddc102570 0x7f7ddc197990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:34.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:34.122+0000 7f7ddbfff640 1 -- 172.21.15.37:0/3433478069 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ddc100e20 msgr2=0x7f7ddc197450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:34.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:34.122+0000 7f7ddbfff640 1 --2- 172.21.15.37:0/3433478069 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ddc100e20 0x7f7ddc197450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:34.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:34.122+0000 7f7ddbfff640 1 -- 172.21.15.37:0/3433478069 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ddc19c400 con 0x7f7ddc102ef0 2024-09-19T06:04:34.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:34.122+0000 7f7dd3fff640 1 --2- 172.21.15.37:0/3433478069 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ddc102570 0x7f7ddc197990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:04:34.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:34.122+0000 7f7ddb7fe640 1 --2- 172.21.15.37:0/3433478069 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ddc100e20 0x7f7ddc197450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:04:34.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:34.122+0000 7f7ddbfff640 1 --2- 172.21.15.37:0/3433478069 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ddc102ef0 0x7f7ddc19bd20 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7dd400b970 tx=0x7f7dd400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:34.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:34.122+0000 7f7dd97fa640 1 -- 172.21.15.37:0/3433478069 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd4019070 con 0x7f7ddc102ef0 2024-09-19T06:04:34.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:34.122+0000 7f7de1b11640 1 -- 172.21.15.37:0/3433478069 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ddc19c6f0 con 0x7f7ddc102ef0 2024-09-19T06:04:34.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:34.122+0000 7f7dd97fa640 1 -- 172.21.15.37:0/3433478069 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7dd4014440 con 0x7f7ddc102ef0 2024-09-19T06:04:34.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:34.122+0000 7f7dd97fa640 1 -- 172.21.15.37:0/3433478069 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd40075d0 con 0x7f7ddc102ef0 2024-09-19T06:04:34.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:34.122+0000 7f7de1b11640 1 -- 172.21.15.37:0/3433478069 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ddc1a3fd0 con 0x7f7ddc102ef0 2024-09-19T06:04:34.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:34.123+0000 7f7de1b11640 1 -- 172.21.15.37:0/3433478069 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ddc101200 con 0x7f7ddc102ef0 2024-09-19T06:04:34.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:34.125+0000 7f7dd97fa640 1 -- 172.21.15.37:0/3433478069 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f7dd401c070 con 0x7f7ddc102ef0 2024-09-19T06:04:34.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:34.125+0000 7f7dd97fa640 1 --2- 172.21.15.37:0/3433478069 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f7dc80a3240 0x7f7dc80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:34.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:34.125+0000 7f7dd97fa640 1 -- 172.21.15.37:0/3433478069 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f7dd40cf620 con 0x7f7ddc102ef0 2024-09-19T06:04:34.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:34.125+0000 7f7ddb7fe640 1 --2- 172.21.15.37:0/3433478069 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f7dc80a3240 0x7f7dc80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:34.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:34.126+0000 7f7ddb7fe640 1 --2- 172.21.15.37:0/3433478069 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f7dc80a3240 0x7f7dc80a5700 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc00afb0 tx=0x7f7dcc00a2d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:34.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:34.128+0000 7f7dd97fa640 1 -- 172.21.15.37:0/3433478069 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7dd409c100 con 0x7f7ddc102ef0 2024-09-19T06:04:34.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:34.304+0000 7f7de1b11640 1 -- 172.21.15.37:0/3433478069 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7ddc1987b0 con 0x7f7ddc102ef0 2024-09-19T06:04:34.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:34.306+0000 7f7dd97fa640 1 -- 172.21.15.37:0/3433478069 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+24200 (secure 0 0 0) 0x7f7ddc1987b0 con 0x7f7ddc102ef0 2024-09-19T06:04:34.308 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T06:04:34.308 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":87,"fsid":"b8c8bdae-764b-11ef-bceb-c7b262605968","created":"2024-09-19T05:56:22.523060+0000","modified":"2024-09-19T06:04:15.206008+0000","last_up_change":"2024-09-19T06:03:12.771014+0000","last_in_change":"2024-09-19T06:02:49.926626+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:59:27.062607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:04:01.918234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:04:04.392543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T06:04:10.877951+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"455bc11d-2b6e-4a0c-90d9-8ab4ef4f9e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1783875173},{"type":"v1","addr":"172.21.15.37:6803","nonce":1783875173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1783875173},{"type":"v1","addr":"172.21.15.37:6805","nonce":1783875173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1783875173},{"type":"v1","addr":"172.21.15.37:6809","nonce":1783875173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1783875173},{"type":"v1","addr":"172.21.15.37:6807","nonce":1783875173}]},"public_addr":"172.21.15.37:6803/1783875173","cluster_addr":"172.21.15.37:6805/1783875173","heartbeat_back_addr":"172.21.15.37:6809/1783875173","heartbeat_front_addr":"172.21.15.37:6807/1783875173","state":["exists","up"]},{"osd":1,"uuid":"3505c162-c342-479d-8ea2-15b7a9d625cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":3414373360},{"type":"v1","addr":"172.21.15.99:6801","nonce":3414373360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":3414373360},{"type":"v1","addr":"172.21.15.99:6803","nonce":3414373360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":3414373360},{"type":"v1","addr":"172.21.15.99:6807","nonce":3414373360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":3414373360},{"type":"v1","addr":"172.21.15.99:6805","nonce":3414373360}]},"public_addr":"172.21.15.99:6801/3414373360","cluster_addr":"172.21.15.99:6803/3414373360","heartbeat_back_addr":"172.21.15.99:6807/3414373360","heartbeat_front_addr":"172.21.15.99:6805/3414373360","state":["exists","up"]},{"osd":2,"uuid":"736ec67f-b5e7-43f0-9303-0c88878ead6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3794943081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3794943081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3794943081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3794943081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3794943081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3794943081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3794943081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3794943081}]},"public_addr":"172.21.15.117:6801/3794943081","cluster_addr":"172.21.15.117:6803/3794943081","heartbeat_back_addr":"172.21.15.117:6807/3794943081","heartbeat_front_addr":"172.21.15.117:6805/3794943081","state":["exists","up"]},{"osd":3,"uuid":"3f784ef7-0cc1-4c86-a03a-b8f13396c835","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2121011955},{"type":"v1","addr":"172.21.15.37:6811","nonce":2121011955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2121011955},{"type":"v1","addr":"172.21.15.37:6813","nonce":2121011955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2121011955},{"type":"v1","addr":"172.21.15.37:6817","nonce":2121011955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2121011955},{"type":"v1","addr":"172.21.15.37:6815","nonce":2121011955}]},"public_addr":"172.21.15.37:6811/2121011955","cluster_addr":"172.21.15.37:6813/2121011955","heartbeat_back_addr":"172.21.15.37:6817/2121011955","heartbeat_front_addr":"172.21.15.37:6815/2121011955","state":["exists","up"]},{"osd":4,"uuid":"d7c16e7f-f599-419b-b4a2-fd6c1cafa0d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":1881025735},{"type":"v1","addr":"172.21.15.99:6809","nonce":1881025735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1881025735},{"type":"v1","addr":"172.21.15.99:6811","nonce":1881025735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1881025735},{"type":"v1","addr":"172.21.15.99:6815","nonce":1881025735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":1881025735},{"type":"v1","addr":"172.21.15.99:6813","nonce":1881025735}]},"public_addr":"172.21.15.99:6809/1881025735","cluster_addr":"172.21.15.99:6811/1881025735","heartbeat_back_addr":"172.21.15.99:6815/1881025735","heartbeat_front_addr":"172.21.15.99:6813/1881025735","state":["exists","up"]},{"osd":5,"uuid":"2f499ab4-3d09-4f96-a709-b4229865c690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1141976511},{"type":"v1","addr":"172.21.15.117:6809","nonce":1141976511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1141976511},{"type":"v1","addr":"172.21.15.117:6811","nonce":1141976511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1141976511},{"type":"v1","addr":"172.21.15.117:6815","nonce":1141976511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1141976511},{"type":"v1","addr":"172.21.15.117:6813","nonce":1141976511}]},"public_addr":"172.21.15.117:6809/1141976511","cluster_addr":"172.21.15.117:6811/1141976511","heartbeat_back_addr":"172.21.15.117:6815/1141976511","heartbeat_front_addr":"172.21.15.117:6813/1141976511","state":["exists","up"]},{"osd":6,"uuid":"10f7fd72-1ae8-4efd-a448-75f4b5054be3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":770433145},{"type":"v1","addr":"172.21.15.37:6819","nonce":770433145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":770433145},{"type":"v1","addr":"172.21.15.37:6821","nonce":770433145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":770433145},{"type":"v1","addr":"172.21.15.37:6825","nonce":770433145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":770433145},{"type":"v1","addr":"172.21.15.37:6823","nonce":770433145}]},"public_addr":"172.21.15.37:6819/770433145","cluster_addr":"172.21.15.37:6821/770433145","heartbeat_back_addr":"172.21.15.37:6825/770433145","heartbeat_front_addr":"172.21.15.37:6823/770433145","state":["exists","up"]},{"osd":7,"uuid":"7199a267-c486-417c-b530-3ff03fc9eb1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1694360992},{"type":"v1","addr":"172.21.15.99:6817","nonce":1694360992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1694360992},{"type":"v1","addr":"172.21.15.99:6819","nonce":1694360992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":1694360992},{"type":"v1","addr":"172.21.15.99:6823","nonce":1694360992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":1694360992},{"type":"v1","addr":"172.21.15.99:6821","nonce":1694360992}]},"public_addr":"172.21.15.99:6817/1694360992","cluster_addr":"172.21.15.99:6819/1694360992","heartbeat_back_addr":"172.21.15.99:6823/1694360992","heartbeat_front_addr":"172.21.15.99:6821/1694360992","state":["exists","up"]},{"osd":8,"uuid":"8d5bb83c-62eb-4ded-8a16-e8d57ab102c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2005866772},{"type":"v1","addr":"172.21.15.117:6817","nonce":2005866772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2005866772},{"type":"v1","addr":"172.21.15.117:6819","nonce":2005866772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2005866772},{"type":"v1","addr":"172.21.15.117:6823","nonce":2005866772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2005866772},{"type":"v1","addr":"172.21.15.117:6821","nonce":2005866772}]},"public_addr":"172.21.15.117:6817/2005866772","cluster_addr":"172.21.15.117:6819/2005866772","heartbeat_back_addr":"172.21.15.117:6823/2005866772","heartbeat_front_addr":"172.21.15.117:6821/2005866772","state":["exists","up"]},{"osd":9,"uuid":"04b6203d-a10c-4a55-8e59-b30012dee02b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1398779376},{"type":"v1","addr":"172.21.15.37:6827","nonce":1398779376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1398779376},{"type":"v1","addr":"172.21.15.37:6829","nonce":1398779376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1398779376},{"type":"v1","addr":"172.21.15.37:6833","nonce":1398779376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1398779376},{"type":"v1","addr":"172.21.15.37:6831","nonce":1398779376}]},"public_addr":"172.21.15.37:6827/1398779376","cluster_addr":"172.21.15.37:6829/1398779376","heartbeat_back_addr":"172.21.15.37:6833/1398779376","heartbeat_front_addr":"172.21.15.37:6831/1398779376","state":["exists","up"]},{"osd":10,"uuid":"bbf8ff4b-29cd-4d56-a30e-ff2de3555f78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2200957302},{"type":"v1","addr":"172.21.15.99:6825","nonce":2200957302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2200957302},{"type":"v1","addr":"172.21.15.99:6827","nonce":2200957302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2200957302},{"type":"v1","addr":"172.21.15.99:6831","nonce":2200957302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2200957302},{"type":"v1","addr":"172.21.15.99:6829","nonce":2200957302}]},"public_addr":"172.21.15.99:6825/2200957302","cluster_addr":"172.21.15.99:6827/2200957302","heartbeat_back_addr":"172.21.15.99:6831/2200957302","heartbeat_front_addr":"172.21.15.99:6829/2200957302","state":["exists","up"]},{"osd":11,"uuid":"041d54f4-a274-47b5-a467-0ce86efd363b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":1354423136},{"type":"v1","addr":"172.21.15.117:6825","nonce":1354423136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":1354423136},{"type":"v1","addr":"172.21.15.117:6827","nonce":1354423136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":1354423136},{"type":"v1","addr":"172.21.15.117:6831","nonce":1354423136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":1354423136},{"type":"v1","addr":"172.21.15.117:6829","nonce":1354423136}]},"public_addr":"172.21.15.117:6825/1354423136","cluster_addr":"172.21.15.117:6827/1354423136","heartbeat_back_addr":"172.21.15.117:6831/1354423136","heartbeat_front_addr":"172.21.15.117:6829/1354423136","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:58:33.697099+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:58:59.641549+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:59:23.811178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:59:49.550214+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:00:15.034610+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:00:39.399651+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:01:05.106379+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:01:30.375956+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:01:54.881549+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:02:21.519316+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:02:46.125918+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:03:11.310862+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6801/133577710":"2024-09-20T05:57:12.560771+0000","172.21.15.37:6800/133577710":"2024-09-20T05:57:12.560771+0000","172.21.15.37:0/2877363162":"2024-09-20T05:57:12.560771+0000","172.21.15.37:0/1053171617":"2024-09-20T05:57:12.560771+0000","172.21.15.37:6800/3277805697":"2024-09-20T05:56:49.335334+0000","172.21.15.37:0/1280697705":"2024-09-20T05:56:49.335334+0000","172.21.15.37:0/1106526058":"2024-09-20T05:57:12.560771+0000","172.21.15.37:0/1978184693":"2024-09-20T05:56:49.335334+0000","172.21.15.37:6801/3277805697":"2024-09-20T05:56:49.335334+0000","172.21.15.37:0/3650338877":"2024-09-20T05:56:49.335334+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:04:34.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:34.310+0000 7f7de1b11640 1 -- 172.21.15.37:0/3433478069 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f7dc80a3240 msgr2=0x7f7dc80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:34.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:34.310+0000 7f7de1b11640 1 --2- 172.21.15.37:0/3433478069 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f7dc80a3240 0x7f7dc80a5700 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc00afb0 tx=0x7f7dcc00a2d0 comp rx=0 tx=0).stop 2024-09-19T06:04:34.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:34.310+0000 7f7de1b11640 1 -- 172.21.15.37:0/3433478069 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ddc102ef0 msgr2=0x7f7ddc19bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:34.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:34.310+0000 7f7de1b11640 1 --2- 172.21.15.37:0/3433478069 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ddc102ef0 0x7f7ddc19bd20 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7dd400b970 tx=0x7f7dd400bd70 comp rx=0 tx=0).stop 2024-09-19T06:04:34.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:34.310+0000 7f7de1b11640 1 -- 172.21.15.37:0/3433478069 shutdown_connections 2024-09-19T06:04:34.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:34.310+0000 7f7de1b11640 1 --2- 172.21.15.37:0/3433478069 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f7dc80a3240 0x7f7dc80a5700 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:34.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:34.310+0000 7f7de1b11640 1 --2- 172.21.15.37:0/3433478069 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ddc102ef0 0x7f7ddc19bd20 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:34.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:34.310+0000 7f7de1b11640 1 --2- 172.21.15.37:0/3433478069 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ddc102570 0x7f7ddc197990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:34.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:34.310+0000 7f7de1b11640 1 --2- 172.21.15.37:0/3433478069 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ddc100e20 0x7f7ddc197450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:34.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:34.310+0000 7f7de1b11640 1 -- 172.21.15.37:0/3433478069 >> 172.21.15.37:0/3433478069 conn(0x7f7ddc0fc7d0 msgr2=0x7f7ddc106830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:34.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:34.310+0000 7f7de1b11640 1 -- 172.21.15.37:0/3433478069 shutdown_connections 2024-09-19T06:04:34.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:34.310+0000 7f7de1b11640 1 -- 172.21.15.37:0/3433478069 wait complete. 2024-09-19T06:04:34.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:34 smithi037 ceph-mon[31211]: pgmap v297: 129 pgs: 129 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:04:34.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:34 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/3433478069' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:04:34.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:34 smithi099 ceph-mon[35300]: pgmap v297: 129 pgs: 129 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:04:34.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:34 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/3433478069' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:04:34.992 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T06:04:34.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:34 smithi117 ceph-mon[35050]: pgmap v297: 129 pgs: 129 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:04:34.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:34 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/3433478069' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:04:35.251 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:04:35.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:35.822+0000 7f373e585640 1 -- 172.21.15.37:0/3979480583 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3738101de0 msgr2=0x7f37381021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:35.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:35.822+0000 7f373e585640 1 --2- 172.21.15.37:0/3979480583 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3738101de0 0x7f37381021c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3728009900 tx=0x7f372802a3f0 comp rx=0 tx=0).stop 2024-09-19T06:04:35.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:35.823+0000 7f373e585640 1 -- 172.21.15.37:0/3979480583 shutdown_connections 2024-09-19T06:04:35.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:35.823+0000 7f373e585640 1 --2- 172.21.15.37:0/3979480583 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3738106f10 0x7f373810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:35.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:35.823+0000 7f373e585640 1 --2- 172.21.15.37:0/3979480583 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3738102790 0x7f37381067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:35.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:35.823+0000 7f373e585640 1 --2- 172.21.15.37:0/3979480583 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3738101de0 0x7f37381021c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:35.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:35.823+0000 7f373e585640 1 -- 172.21.15.37:0/3979480583 >> 172.21.15.37:0/3979480583 conn(0x7f37380fd8c0 msgr2=0x7f37380ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:35.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:35.823+0000 7f373e585640 1 -- 172.21.15.37:0/3979480583 shutdown_connections 2024-09-19T06:04:35.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:35.823+0000 7f373e585640 1 -- 172.21.15.37:0/3979480583 wait complete. 2024-09-19T06:04:35.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:35.823+0000 7f373e585640 1 Processor -- start 2024-09-19T06:04:35.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:35.823+0000 7f373e585640 1 -- start start 2024-09-19T06:04:35.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:35.824+0000 7f373e585640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3738101de0 0x7f37380744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:35.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:35.824+0000 7f373e585640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3738102790 0x7f3738074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:35.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:35.824+0000 7f373e585640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3738106f10 0x7f3738074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:35.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:35.824+0000 7f373e585640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3738111f70 con 0x7f3738106f10 2024-09-19T06:04:35.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:35.824+0000 7f373e585640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f3738111df0 con 0x7f3738102790 2024-09-19T06:04:35.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:35.824+0000 7f373e585640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f37381120f0 con 0x7f3738101de0 2024-09-19T06:04:35.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:35.824+0000 7f373cb22640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3738106f10 0x7f3738074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:35.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:35.824+0000 7f373cb22640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3738106f10 0x7f3738074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57234/0 (socket says 172.21.15.37:57234) 2024-09-19T06:04:35.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:35.824+0000 7f373cb22640 1 -- 172.21.15.37:0/2022879932 learned_addr learned my addr 172.21.15.37:0/2022879932 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:04:35.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:35.824+0000 7f3737fff640 1 --2- 172.21.15.37:0/2022879932 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3738101de0 0x7f37380744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:35.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:35.824+0000 7f37377fe640 1 --2- 172.21.15.37:0/2022879932 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3738102790 0x7f3738074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:35.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:35.824+0000 7f373cb22640 1 -- 172.21.15.37:0/2022879932 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3738101de0 msgr2=0x7f37380744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:35.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:35.824+0000 7f373cb22640 1 --2- 172.21.15.37:0/2022879932 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3738101de0 0x7f37380744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:35.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:35.824+0000 7f373cb22640 1 -- 172.21.15.37:0/2022879932 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3738102790 msgr2=0x7f3738074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:35.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:35.824+0000 7f373cb22640 1 --2- 172.21.15.37:0/2022879932 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3738102790 0x7f3738074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:35.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:35.824+0000 7f373cb22640 1 -- 172.21.15.37:0/2022879932 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37381a6890 con 0x7f3738106f10 2024-09-19T06:04:35.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:35.824+0000 7f373cb22640 1 --2- 172.21.15.37:0/2022879932 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3738106f10 0x7f3738074f70 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f373000cce0 tx=0x7f373000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:35.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:35.825+0000 7f37357fa640 1 -- 172.21.15.37:0/2022879932 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f373000f450 con 0x7f3738106f10 2024-09-19T06:04:35.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:35.825+0000 7f37357fa640 1 -- 172.21.15.37:0/2022879932 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f373000fad0 con 0x7f3738106f10 2024-09-19T06:04:35.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:35.825+0000 7f373e585640 1 -- 172.21.15.37:0/2022879932 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37381a6b80 con 0x7f3738106f10 2024-09-19T06:04:35.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:35.825+0000 7f37357fa640 1 -- 172.21.15.37:0/2022879932 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3730018c10 con 0x7f3738106f10 2024-09-19T06:04:35.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:35.825+0000 7f373e585640 1 -- 172.21.15.37:0/2022879932 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37381a7070 con 0x7f3738106f10 2024-09-19T06:04:35.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:35.826+0000 7f373e585640 1 -- 172.21.15.37:0/2022879932 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37381021c0 con 0x7f3738106f10 2024-09-19T06:04:35.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:35.827+0000 7f37357fa640 1 -- 172.21.15.37:0/2022879932 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f373000f5f0 con 0x7f3738106f10 2024-09-19T06:04:35.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:35.828+0000 7f37357fa640 1 --2- 172.21.15.37:0/2022879932 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f37200a3240 0x7f37200a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:35.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:35.828+0000 7f3737fff640 1 --2- 172.21.15.37:0/2022879932 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f37200a3240 0x7f37200a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:35.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:35.828+0000 7f37357fa640 1 -- 172.21.15.37:0/2022879932 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f37300d01f0 con 0x7f3738106f10 2024-09-19T06:04:35.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:35.828+0000 7f3737fff640 1 --2- 172.21.15.37:0/2022879932 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f37200a3240 0x7f37200a5700 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3728005ab0 tx=0x7f3728005a20 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:35.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:35.831+0000 7f37357fa640 1 -- 172.21.15.37:0/2022879932 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3730014030 con 0x7f3738106f10 2024-09-19T06:04:36.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:36.009+0000 7f373e585640 1 -- 172.21.15.37:0/2022879932 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f373810a0f0 con 0x7f3738106f10 2024-09-19T06:04:36.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:36.010+0000 7f37357fa640 1 -- 172.21.15.37:0/2022879932 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+24200 (secure 0 0 0) 0x7f373009ce00 con 0x7f3738106f10 2024-09-19T06:04:36.013 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T06:04:36.013 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":87,"fsid":"b8c8bdae-764b-11ef-bceb-c7b262605968","created":"2024-09-19T05:56:22.523060+0000","modified":"2024-09-19T06:04:15.206008+0000","last_up_change":"2024-09-19T06:03:12.771014+0000","last_in_change":"2024-09-19T06:02:49.926626+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:59:27.062607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:04:01.918234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:04:04.392543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T06:04:10.877951+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"455bc11d-2b6e-4a0c-90d9-8ab4ef4f9e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1783875173},{"type":"v1","addr":"172.21.15.37:6803","nonce":1783875173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1783875173},{"type":"v1","addr":"172.21.15.37:6805","nonce":1783875173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1783875173},{"type":"v1","addr":"172.21.15.37:6809","nonce":1783875173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1783875173},{"type":"v1","addr":"172.21.15.37:6807","nonce":1783875173}]},"public_addr":"172.21.15.37:6803/1783875173","cluster_addr":"172.21.15.37:6805/1783875173","heartbeat_back_addr":"172.21.15.37:6809/1783875173","heartbeat_front_addr":"172.21.15.37:6807/1783875173","state":["exists","up"]},{"osd":1,"uuid":"3505c162-c342-479d-8ea2-15b7a9d625cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":3414373360},{"type":"v1","addr":"172.21.15.99:6801","nonce":3414373360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":3414373360},{"type":"v1","addr":"172.21.15.99:6803","nonce":3414373360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":3414373360},{"type":"v1","addr":"172.21.15.99:6807","nonce":3414373360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":3414373360},{"type":"v1","addr":"172.21.15.99:6805","nonce":3414373360}]},"public_addr":"172.21.15.99:6801/3414373360","cluster_addr":"172.21.15.99:6803/3414373360","heartbeat_back_addr":"172.21.15.99:6807/3414373360","heartbeat_front_addr":"172.21.15.99:6805/3414373360","state":["exists","up"]},{"osd":2,"uuid":"736ec67f-b5e7-43f0-9303-0c88878ead6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3794943081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3794943081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3794943081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3794943081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3794943081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3794943081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3794943081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3794943081}]},"public_addr":"172.21.15.117:6801/3794943081","cluster_addr":"172.21.15.117:6803/3794943081","heartbeat_back_addr":"172.21.15.117:6807/3794943081","heartbeat_front_addr":"172.21.15.117:6805/3794943081","state":["exists","up"]},{"osd":3,"uuid":"3f784ef7-0cc1-4c86-a03a-b8f13396c835","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2121011955},{"type":"v1","addr":"172.21.15.37:6811","nonce":2121011955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2121011955},{"type":"v1","addr":"172.21.15.37:6813","nonce":2121011955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2121011955},{"type":"v1","addr":"172.21.15.37:6817","nonce":2121011955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2121011955},{"type":"v1","addr":"172.21.15.37:6815","nonce":2121011955}]},"public_addr":"172.21.15.37:6811/2121011955","cluster_addr":"172.21.15.37:6813/2121011955","heartbeat_back_addr":"172.21.15.37:6817/2121011955","heartbeat_front_addr":"172.21.15.37:6815/2121011955","state":["exists","up"]},{"osd":4,"uuid":"d7c16e7f-f599-419b-b4a2-fd6c1cafa0d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":1881025735},{"type":"v1","addr":"172.21.15.99:6809","nonce":1881025735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1881025735},{"type":"v1","addr":"172.21.15.99:6811","nonce":1881025735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1881025735},{"type":"v1","addr":"172.21.15.99:6815","nonce":1881025735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":1881025735},{"type":"v1","addr":"172.21.15.99:6813","nonce":1881025735}]},"public_addr":"172.21.15.99:6809/1881025735","cluster_addr":"172.21.15.99:6811/1881025735","heartbeat_back_addr":"172.21.15.99:6815/1881025735","heartbeat_front_addr":"172.21.15.99:6813/1881025735","state":["exists","up"]},{"osd":5,"uuid":"2f499ab4-3d09-4f96-a709-b4229865c690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1141976511},{"type":"v1","addr":"172.21.15.117:6809","nonce":1141976511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1141976511},{"type":"v1","addr":"172.21.15.117:6811","nonce":1141976511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1141976511},{"type":"v1","addr":"172.21.15.117:6815","nonce":1141976511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1141976511},{"type":"v1","addr":"172.21.15.117:6813","nonce":1141976511}]},"public_addr":"172.21.15.117:6809/1141976511","cluster_addr":"172.21.15.117:6811/1141976511","heartbeat_back_addr":"172.21.15.117:6815/1141976511","heartbeat_front_addr":"172.21.15.117:6813/1141976511","state":["exists","up"]},{"osd":6,"uuid":"10f7fd72-1ae8-4efd-a448-75f4b5054be3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":770433145},{"type":"v1","addr":"172.21.15.37:6819","nonce":770433145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":770433145},{"type":"v1","addr":"172.21.15.37:6821","nonce":770433145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":770433145},{"type":"v1","addr":"172.21.15.37:6825","nonce":770433145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":770433145},{"type":"v1","addr":"172.21.15.37:6823","nonce":770433145}]},"public_addr":"172.21.15.37:6819/770433145","cluster_addr":"172.21.15.37:6821/770433145","heartbeat_back_addr":"172.21.15.37:6825/770433145","heartbeat_front_addr":"172.21.15.37:6823/770433145","state":["exists","up"]},{"osd":7,"uuid":"7199a267-c486-417c-b530-3ff03fc9eb1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1694360992},{"type":"v1","addr":"172.21.15.99:6817","nonce":1694360992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1694360992},{"type":"v1","addr":"172.21.15.99:6819","nonce":1694360992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":1694360992},{"type":"v1","addr":"172.21.15.99:6823","nonce":1694360992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":1694360992},{"type":"v1","addr":"172.21.15.99:6821","nonce":1694360992}]},"public_addr":"172.21.15.99:6817/1694360992","cluster_addr":"172.21.15.99:6819/1694360992","heartbeat_back_addr":"172.21.15.99:6823/1694360992","heartbeat_front_addr":"172.21.15.99:6821/1694360992","state":["exists","up"]},{"osd":8,"uuid":"8d5bb83c-62eb-4ded-8a16-e8d57ab102c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2005866772},{"type":"v1","addr":"172.21.15.117:6817","nonce":2005866772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2005866772},{"type":"v1","addr":"172.21.15.117:6819","nonce":2005866772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2005866772},{"type":"v1","addr":"172.21.15.117:6823","nonce":2005866772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2005866772},{"type":"v1","addr":"172.21.15.117:6821","nonce":2005866772}]},"public_addr":"172.21.15.117:6817/2005866772","cluster_addr":"172.21.15.117:6819/2005866772","heartbeat_back_addr":"172.21.15.117:6823/2005866772","heartbeat_front_addr":"172.21.15.117:6821/2005866772","state":["exists","up"]},{"osd":9,"uuid":"04b6203d-a10c-4a55-8e59-b30012dee02b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1398779376},{"type":"v1","addr":"172.21.15.37:6827","nonce":1398779376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1398779376},{"type":"v1","addr":"172.21.15.37:6829","nonce":1398779376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1398779376},{"type":"v1","addr":"172.21.15.37:6833","nonce":1398779376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1398779376},{"type":"v1","addr":"172.21.15.37:6831","nonce":1398779376}]},"public_addr":"172.21.15.37:6827/1398779376","cluster_addr":"172.21.15.37:6829/1398779376","heartbeat_back_addr":"172.21.15.37:6833/1398779376","heartbeat_front_addr":"172.21.15.37:6831/1398779376","state":["exists","up"]},{"osd":10,"uuid":"bbf8ff4b-29cd-4d56-a30e-ff2de3555f78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2200957302},{"type":"v1","addr":"172.21.15.99:6825","nonce":2200957302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2200957302},{"type":"v1","addr":"172.21.15.99:6827","nonce":2200957302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2200957302},{"type":"v1","addr":"172.21.15.99:6831","nonce":2200957302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2200957302},{"type":"v1","addr":"172.21.15.99:6829","nonce":2200957302}]},"public_addr":"172.21.15.99:6825/2200957302","cluster_addr":"172.21.15.99:6827/2200957302","heartbeat_back_addr":"172.21.15.99:6831/2200957302","heartbeat_front_addr":"172.21.15.99:6829/2200957302","state":["exists","up"]},{"osd":11,"uuid":"041d54f4-a274-47b5-a467-0ce86efd363b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":1354423136},{"type":"v1","addr":"172.21.15.117:6825","nonce":1354423136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":1354423136},{"type":"v1","addr":"172.21.15.117:6827","nonce":1354423136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":1354423136},{"type":"v1","addr":"172.21.15.117:6831","nonce":1354423136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":1354423136},{"type":"v1","addr":"172.21.15.117:6829","nonce":1354423136}]},"public_addr":"172.21.15.117:6825/1354423136","cluster_addr":"172.21.15.117:6827/1354423136","heartbeat_back_addr":"172.21.15.117:6831/1354423136","heartbeat_front_addr":"172.21.15.117:6829/1354423136","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:58:33.697099+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:58:59.641549+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:59:23.811178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:59:49.550214+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:00:15.034610+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:00:39.399651+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:01:05.106379+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:01:30.375956+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:01:54.881549+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:02:21.519316+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:02:46.125918+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:03:11.310862+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6801/133577710":"2024-09-20T05:57:12.560771+0000","172.21.15.37:6800/133577710":"2024-09-20T05:57:12.560771+0000","172.21.15.37:0/2877363162":"2024-09-20T05:57:12.560771+0000","172.21.15.37:0/1053171617":"2024-09-20T05:57:12.560771+0000","172.21.15.37:6800/3277805697":"2024-09-20T05:56:49.335334+0000","172.21.15.37:0/1280697705":"2024-09-20T05:56:49.335334+0000","172.21.15.37:0/1106526058":"2024-09-20T05:57:12.560771+0000","172.21.15.37:0/1978184693":"2024-09-20T05:56:49.335334+0000","172.21.15.37:6801/3277805697":"2024-09-20T05:56:49.335334+0000","172.21.15.37:0/3650338877":"2024-09-20T05:56:49.335334+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:04:36.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:36.012+0000 7f373e585640 1 -- 172.21.15.37:0/2022879932 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f37200a3240 msgr2=0x7f37200a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:36.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:36.012+0000 7f373e585640 1 --2- 172.21.15.37:0/2022879932 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f37200a3240 0x7f37200a5700 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3728005ab0 tx=0x7f3728005a20 comp rx=0 tx=0).stop 2024-09-19T06:04:36.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:36.013+0000 7f373e585640 1 -- 172.21.15.37:0/2022879932 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3738106f10 msgr2=0x7f3738074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:36.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:36.013+0000 7f373e585640 1 --2- 172.21.15.37:0/2022879932 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3738106f10 0x7f3738074f70 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f373000cce0 tx=0x7f373000a620 comp rx=0 tx=0).stop 2024-09-19T06:04:36.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:36.013+0000 7f373e585640 1 -- 172.21.15.37:0/2022879932 shutdown_connections 2024-09-19T06:04:36.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:36.013+0000 7f373e585640 1 --2- 172.21.15.37:0/2022879932 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f37200a3240 0x7f37200a5700 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:36.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:36.013+0000 7f373e585640 1 --2- 172.21.15.37:0/2022879932 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3738102790 0x7f3738074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:36.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:36.013+0000 7f373e585640 1 --2- 172.21.15.37:0/2022879932 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3738106f10 0x7f3738074f70 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:36.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:36.013+0000 7f373e585640 1 --2- 172.21.15.37:0/2022879932 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3738101de0 0x7f37380744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:36.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:36.013+0000 7f373e585640 1 -- 172.21.15.37:0/2022879932 >> 172.21.15.37:0/2022879932 conn(0x7f37380fd8c0 msgr2=0x7f37380febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:36.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:36.013+0000 7f373e585640 1 -- 172.21.15.37:0/2022879932 shutdown_connections 2024-09-19T06:04:36.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:36.013+0000 7f373e585640 1 -- 172.21.15.37:0/2022879932 wait complete. 2024-09-19T06:04:36.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:36 smithi037 ceph-mon[31211]: pgmap v298: 129 pgs: 129 active+clean; 581 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-19T06:04:36.976 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:36 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/2022879932' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:04:36.976 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:36 smithi099 ceph-mon[35300]: pgmap v298: 129 pgs: 129 active+clean; 581 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-19T06:04:36.977 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:36 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/2022879932' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:04:36.978 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-19T06:04:36.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:36 smithi117 ceph-mon[35050]: pgmap v298: 129 pgs: 129 active+clean; 581 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-19T06:04:36.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:36 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/2022879932' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:04:37.236 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:04:37.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:37.743+0000 7f97187f2640 1 -- 172.21.15.37:0/717705697 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9710100a60 msgr2=0x7f9710100ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:37.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:37.743+0000 7f97187f2640 1 --2- 172.21.15.37:0/717705697 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9710100a60 0x7f9710100ec0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9700009930 tx=0x7f970002a420 comp rx=0 tx=0).stop 2024-09-19T06:04:37.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:37.743+0000 7f97187f2640 1 -- 172.21.15.37:0/717705697 shutdown_connections 2024-09-19T06:04:37.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:37.743+0000 7f97187f2640 1 --2- 172.21.15.37:0/717705697 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9710101400 0x7f971010d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:37.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:37.743+0000 7f97187f2640 1 --2- 172.21.15.37:0/717705697 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9710100a60 0x7f9710100ec0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:37.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:37.743+0000 7f97187f2640 1 --2- 172.21.15.37:0/717705697 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9710106a60 0x7f9710106e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:37.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:37.743+0000 7f97187f2640 1 -- 172.21.15.37:0/717705697 >> 172.21.15.37:0/717705697 conn(0x7f97100fc780 msgr2=0x7f97100feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:37.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:37.743+0000 7f97187f2640 1 -- 172.21.15.37:0/717705697 shutdown_connections 2024-09-19T06:04:37.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:37.743+0000 7f97187f2640 1 -- 172.21.15.37:0/717705697 wait complete. 2024-09-19T06:04:37.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:37.743+0000 7f97187f2640 1 Processor -- start 2024-09-19T06:04:37.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:37.744+0000 7f97187f2640 1 -- start start 2024-09-19T06:04:37.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:37.744+0000 7f97187f2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9710100a60 0x7f97101984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:37.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:37.744+0000 7f97187f2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9710101400 0x7f9710198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:37.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:37.744+0000 7f97187f2640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9710106a60 0x7f971019cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:37.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:37.744+0000 7f97187f2640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9710110ed0 con 0x7f9710100a60 2024-09-19T06:04:37.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:37.744+0000 7f97187f2640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f9710110d50 con 0x7f9710106a60 2024-09-19T06:04:37.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:37.744+0000 7f97187f2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9710111050 con 0x7f9710101400 2024-09-19T06:04:37.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:37.744+0000 7f971658e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9710100a60 0x7f97101984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:37.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:37.744+0000 7f971658e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9710100a60 0x7f97101984f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57260/0 (socket says 172.21.15.37:57260) 2024-09-19T06:04:37.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:37.744+0000 7f971658e640 1 -- 172.21.15.37:0/3580479246 learned_addr learned my addr 172.21.15.37:0/3580479246 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:04:37.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:37.744+0000 7f9716d8f640 1 --2- 172.21.15.37:0/3580479246 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9710106a60 0x7f971019cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:37.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:37.744+0000 7f971658e640 1 -- 172.21.15.37:0/3580479246 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9710101400 msgr2=0x7f9710198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:37.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:37.744+0000 7f971658e640 1 --2- 172.21.15.37:0/3580479246 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9710101400 0x7f9710198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:37.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:37.744+0000 7f971658e640 1 -- 172.21.15.37:0/3580479246 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9710106a60 msgr2=0x7f971019cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:37.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:37.744+0000 7f971658e640 1 --2- 172.21.15.37:0/3580479246 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9710106a60 0x7f971019cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:37.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:37.744+0000 7f971658e640 1 -- 172.21.15.37:0/3580479246 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f971019d4a0 con 0x7f9710100a60 2024-09-19T06:04:37.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:37.744+0000 7f971658e640 1 --2- 172.21.15.37:0/3580479246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9710100a60 0x7f97101984f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f970c00b4a0 tx=0x7f970c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:37.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:37.745+0000 7f97077fe640 1 -- 172.21.15.37:0/3580479246 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f970c014070 con 0x7f9710100a60 2024-09-19T06:04:37.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:37.745+0000 7f97077fe640 1 -- 172.21.15.37:0/3580479246 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f970c010af0 con 0x7f9710100a60 2024-09-19T06:04:37.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:37.745+0000 7f97187f2640 1 -- 172.21.15.37:0/3580479246 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f971019d790 con 0x7f9710100a60 2024-09-19T06:04:37.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:37.745+0000 7f97077fe640 1 -- 172.21.15.37:0/3580479246 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f970c017d10 con 0x7f9710100a60 2024-09-19T06:04:37.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:37.745+0000 7f97187f2640 1 -- 172.21.15.37:0/3580479246 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97101a5070 con 0x7f9710100a60 2024-09-19T06:04:37.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:37.746+0000 7f97187f2640 1 -- 172.21.15.37:0/3580479246 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9710100ec0 con 0x7f9710100a60 2024-09-19T06:04:37.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:37.747+0000 7f97077fe640 1 -- 172.21.15.37:0/3580479246 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f970c017070 con 0x7f9710100a60 2024-09-19T06:04:37.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:37.748+0000 7f97077fe640 1 --2- 172.21.15.37:0/3580479246 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f96fc0a3240 0x7f96fc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:37.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:37.748+0000 7f9715d8d640 1 --2- 172.21.15.37:0/3580479246 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f96fc0a3240 0x7f96fc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:37.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:37.748+0000 7f97077fe640 1 -- 172.21.15.37:0/3580479246 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f970c0cf360 con 0x7f9710100a60 2024-09-19T06:04:37.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:37.748+0000 7f9715d8d640 1 --2- 172.21.15.37:0/3580479246 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f96fc0a3240 0x7f96fc0a5700 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f97000096c0 tx=0x7f9700000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:37.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:37.751+0000 7f97077fe640 1 -- 172.21.15.37:0/3580479246 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f970c09be40 con 0x7f9710100a60 2024-09-19T06:04:37.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:37.963+0000 7f97187f2640 1 -- 172.21.15.37:0/3580479246 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f97101a52d0 con 0x7f9710100a60 2024-09-19T06:04:38.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:38.508+0000 7f97077fe640 1 -- 172.21.15.37:0/3580479246 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7f970c09b740 con 0x7f9710100a60 2024-09-19T06:04:38.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:38.511+0000 7f97187f2640 1 -- 172.21.15.37:0/3580479246 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f96fc0a3240 msgr2=0x7f96fc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:38.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:38.511+0000 7f97187f2640 1 --2- 172.21.15.37:0/3580479246 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f96fc0a3240 0x7f96fc0a5700 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f97000096c0 tx=0x7f9700000bc0 comp rx=0 tx=0).stop 2024-09-19T06:04:38.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:38.511+0000 7f97187f2640 1 -- 172.21.15.37:0/3580479246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9710100a60 msgr2=0x7f97101984f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:38.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:38.511+0000 7f97187f2640 1 --2- 172.21.15.37:0/3580479246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9710100a60 0x7f97101984f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f970c00b4a0 tx=0x7f970c00b960 comp rx=0 tx=0).stop 2024-09-19T06:04:38.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:38.511+0000 7f97187f2640 1 -- 172.21.15.37:0/3580479246 shutdown_connections 2024-09-19T06:04:38.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:38.511+0000 7f97187f2640 1 --2- 172.21.15.37:0/3580479246 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f96fc0a3240 0x7f96fc0a5700 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:38.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:38.511+0000 7f97187f2640 1 --2- 172.21.15.37:0/3580479246 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9710106a60 0x7f971019cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:38.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:38.511+0000 7f97187f2640 1 --2- 172.21.15.37:0/3580479246 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9710101400 0x7f9710198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:38.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:38.511+0000 7f97187f2640 1 --2- 172.21.15.37:0/3580479246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9710100a60 0x7f97101984f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:38.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:38.511+0000 7f97187f2640 1 -- 172.21.15.37:0/3580479246 >> 172.21.15.37:0/3580479246 conn(0x7f97100fc780 msgr2=0x7f9710104870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:38.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:38.511+0000 7f97187f2640 1 -- 172.21.15.37:0/3580479246 shutdown_connections 2024-09-19T06:04:38.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:38.511+0000 7f97187f2640 1 -- 172.21.15.37:0/3580479246 wait complete. 2024-09-19T06:04:38.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:38 smithi037 ceph-mon[31211]: pgmap v299: 129 pgs: 129 active+clean; 581 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-19T06:04:38.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:38 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/3580479246' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T06:04:38.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:38 smithi099 ceph-mon[35300]: pgmap v299: 129 pgs: 129 active+clean; 581 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-19T06:04:38.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:38 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/3580479246' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T06:04:38.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:38 smithi117 ceph-mon[35050]: pgmap v299: 129 pgs: 129 active+clean; 581 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-19T06:04:39.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:38 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/3580479246' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T06:04:39.417 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 1, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-09-19T06:04:39.418 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-19T06:04:39.682 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:04:39.804 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:39 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/3580479246' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T06:04:39.805 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:39 smithi037 ceph-mon[31211]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T06:04:39.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:39 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/3580479246' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T06:04:39.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:39 smithi099 ceph-mon[35300]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T06:04:40.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:39 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/3580479246' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T06:04:40.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:39 smithi117 ceph-mon[35050]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T06:04:40.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:40.150+0000 7f5354f4a640 1 -- 172.21.15.37:0/3804422341 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5350102790 msgr2=0x7f53501067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:40.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:40.150+0000 7f5354f4a640 1 --2- 172.21.15.37:0/3804422341 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5350102790 0x7f53501067e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5338009900 tx=0x7f533802a410 comp rx=0 tx=0).stop 2024-09-19T06:04:40.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:40.150+0000 7f5354f4a640 1 -- 172.21.15.37:0/3804422341 shutdown_connections 2024-09-19T06:04:40.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:40.150+0000 7f5354f4a640 1 --2- 172.21.15.37:0/3804422341 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5350106f10 0x7f535010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:40.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:40.150+0000 7f5354f4a640 1 --2- 172.21.15.37:0/3804422341 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5350102790 0x7f53501067e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:40.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:40.150+0000 7f5354f4a640 1 --2- 172.21.15.37:0/3804422341 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5350101de0 0x7f53501021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:40.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:40.150+0000 7f5354f4a640 1 -- 172.21.15.37:0/3804422341 >> 172.21.15.37:0/3804422341 conn(0x7f53500fd8c0 msgr2=0x7f53500ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:40.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:40.150+0000 7f5354f4a640 1 -- 172.21.15.37:0/3804422341 shutdown_connections 2024-09-19T06:04:40.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:40.150+0000 7f5354f4a640 1 -- 172.21.15.37:0/3804422341 wait complete. 2024-09-19T06:04:40.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:40.151+0000 7f5354f4a640 1 Processor -- start 2024-09-19T06:04:40.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:40.151+0000 7f5354f4a640 1 -- start start 2024-09-19T06:04:40.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:40.151+0000 7f5354f4a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5350101de0 0x7f53500744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:40.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:40.151+0000 7f5354f4a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5350102790 0x7f5350074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:40.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:40.151+0000 7f5354f4a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5350106f10 0x7f5350074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:40.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:40.151+0000 7f5354f4a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5350111f70 con 0x7f5350106f10 2024-09-19T06:04:40.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:40.151+0000 7f5354f4a640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f5350111df0 con 0x7f5350101de0 2024-09-19T06:04:40.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:40.151+0000 7f5354f4a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f53501120f0 con 0x7f5350102790 2024-09-19T06:04:40.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:40.151+0000 7f534ed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5350106f10 0x7f5350074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:40.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:40.151+0000 7f534e59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5350101de0 0x7f53500744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:40.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:40.151+0000 7f534ed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5350106f10 0x7f5350074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57282/0 (socket says 172.21.15.37:57282) 2024-09-19T06:04:40.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:40.151+0000 7f534ed9d640 1 -- 172.21.15.37:0/1510256525 learned_addr learned my addr 172.21.15.37:0/1510256525 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:04:40.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:40.151+0000 7f5347fff640 1 --2- 172.21.15.37:0/1510256525 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5350102790 0x7f5350074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:40.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:40.152+0000 7f534ed9d640 1 -- 172.21.15.37:0/1510256525 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5350102790 msgr2=0x7f5350074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:40.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:40.152+0000 7f534ed9d640 1 --2- 172.21.15.37:0/1510256525 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5350102790 0x7f5350074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:40.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:40.152+0000 7f534ed9d640 1 -- 172.21.15.37:0/1510256525 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5350101de0 msgr2=0x7f53500744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:40.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:40.152+0000 7f534ed9d640 1 --2- 172.21.15.37:0/1510256525 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5350101de0 0x7f53500744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:40.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:40.152+0000 7f534ed9d640 1 -- 172.21.15.37:0/1510256525 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53501a6880 con 0x7f5350106f10 2024-09-19T06:04:40.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:40.152+0000 7f534ed9d640 1 --2- 172.21.15.37:0/1510256525 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5350106f10 0x7f5350074f70 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f534800cce0 tx=0x7f534800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:40.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:40.152+0000 7f53477fe640 1 -- 172.21.15.37:0/1510256525 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f534800f450 con 0x7f5350106f10 2024-09-19T06:04:40.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:40.152+0000 7f53477fe640 1 -- 172.21.15.37:0/1510256525 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f534800fad0 con 0x7f5350106f10 2024-09-19T06:04:40.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:40.152+0000 7f5354f4a640 1 -- 172.21.15.37:0/1510256525 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53501a6b70 con 0x7f5350106f10 2024-09-19T06:04:40.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:40.152+0000 7f53477fe640 1 -- 172.21.15.37:0/1510256525 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5348018b60 con 0x7f5350106f10 2024-09-19T06:04:40.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:40.152+0000 7f5354f4a640 1 -- 172.21.15.37:0/1510256525 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53501a7030 con 0x7f5350106f10 2024-09-19T06:04:40.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:40.153+0000 7f5354f4a640 1 -- 172.21.15.37:0/1510256525 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53501021c0 con 0x7f5350106f10 2024-09-19T06:04:40.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:40.155+0000 7f53477fe640 1 -- 172.21.15.37:0/1510256525 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f534800fc80 con 0x7f5350106f10 2024-09-19T06:04:40.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:40.156+0000 7f53477fe640 1 --2- 172.21.15.37:0/1510256525 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f533c0a3240 0x7f533c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:40.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:40.156+0000 7f53477fe640 1 -- 172.21.15.37:0/1510256525 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f53480d0420 con 0x7f5350106f10 2024-09-19T06:04:40.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:40.156+0000 7f534e59c640 1 --2- 172.21.15.37:0/1510256525 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f533c0a3240 0x7f533c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:40.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:40.156+0000 7f534e59c640 1 --2- 172.21.15.37:0/1510256525 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f533c0a3240 0x7f533c0a5700 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f534000abe0 tx=0x7f534000a2d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:40.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:40.159+0000 7f53477fe640 1 -- 172.21.15.37:0/1510256525 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5348014030 con 0x7f5350106f10 2024-09-19T06:04:40.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:40.374+0000 7f5354f4a640 1 -- 172.21.15.37:0/1510256525 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f535010a150 con 0x7f5350106f10 2024-09-19T06:04:40.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:40.517+0000 7f53477fe640 1 -- 172.21.15.37:0/1510256525 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v18) ==== 121+0+0 (secure 0 0 0) 0x7f534809cf30 con 0x7f5350106f10 2024-09-19T06:04:40.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:40.519+0000 7f5354f4a640 1 -- 172.21.15.37:0/1510256525 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f533c0a3240 msgr2=0x7f533c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:40.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:40.519+0000 7f5354f4a640 1 --2- 172.21.15.37:0/1510256525 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f533c0a3240 0x7f533c0a5700 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f534000abe0 tx=0x7f534000a2d0 comp rx=0 tx=0).stop 2024-09-19T06:04:40.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:40.519+0000 7f5354f4a640 1 -- 172.21.15.37:0/1510256525 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5350106f10 msgr2=0x7f5350074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:40.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:40.519+0000 7f5354f4a640 1 --2- 172.21.15.37:0/1510256525 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5350106f10 0x7f5350074f70 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f534800cce0 tx=0x7f534800a620 comp rx=0 tx=0).stop 2024-09-19T06:04:40.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:40.519+0000 7f5354f4a640 1 -- 172.21.15.37:0/1510256525 shutdown_connections 2024-09-19T06:04:40.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:40.519+0000 7f5354f4a640 1 --2- 172.21.15.37:0/1510256525 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f533c0a3240 0x7f533c0a5700 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:40.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:40.519+0000 7f5354f4a640 1 --2- 172.21.15.37:0/1510256525 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5350106f10 0x7f5350074f70 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:40.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:40.519+0000 7f5354f4a640 1 --2- 172.21.15.37:0/1510256525 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5350102790 0x7f5350074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:40.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:40.519+0000 7f5354f4a640 1 --2- 172.21.15.37:0/1510256525 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5350101de0 0x7f53500744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:40.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:40.519+0000 7f5354f4a640 1 -- 172.21.15.37:0/1510256525 >> 172.21.15.37:0/1510256525 conn(0x7f53500fd8c0 msgr2=0x7f53500febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:40.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:40.519+0000 7f5354f4a640 1 -- 172.21.15.37:0/1510256525 shutdown_connections 2024-09-19T06:04:40.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:40.519+0000 7f5354f4a640 1 -- 172.21.15.37:0/1510256525 wait complete. 2024-09-19T06:04:40.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:40 smithi037 ceph-mon[31211]: pgmap v300: 129 pgs: 129 active+clean; 581 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-19T06:04:40.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:40 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/1510256525' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T06:04:40.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:40 smithi099 ceph-mon[35300]: pgmap v300: 129 pgs: 129 active+clean; 581 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-19T06:04:40.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:40 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/1510256525' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T06:04:41.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:40 smithi117 ceph-mon[35050]: pgmap v300: 129 pgs: 129 active+clean; 581 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-19T06:04:41.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:40 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/1510256525' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T06:04:41.201 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-19T06:04:41.461 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:04:41.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:41 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/1510256525' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T06:04:41.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:41 smithi037 ceph-mon[31211]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T06:04:41.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:41 smithi037 ceph-mon[31211]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-19T06:04:41.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:41 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/1510256525' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T06:04:41.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:41 smithi099 ceph-mon[35300]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T06:04:41.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:41 smithi099 ceph-mon[35300]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-19T06:04:41.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:41.973+0000 7fa171104640 1 -- 172.21.15.37:0/4178452166 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa16c101de0 msgr2=0x7fa16c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:41.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:41.973+0000 7fa171104640 1 --2- 172.21.15.37:0/4178452166 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa16c101de0 0x7fa16c1021c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa15c009900 tx=0x7fa15c02a410 comp rx=0 tx=0).stop 2024-09-19T06:04:41.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:41.973+0000 7fa171104640 1 -- 172.21.15.37:0/4178452166 shutdown_connections 2024-09-19T06:04:41.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:41.973+0000 7fa171104640 1 --2- 172.21.15.37:0/4178452166 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa16c106f10 0x7fa16c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:41.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:41.973+0000 7fa171104640 1 --2- 172.21.15.37:0/4178452166 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa16c102790 0x7fa16c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:41.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:41.973+0000 7fa171104640 1 --2- 172.21.15.37:0/4178452166 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa16c101de0 0x7fa16c1021c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:41.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:41.973+0000 7fa171104640 1 -- 172.21.15.37:0/4178452166 >> 172.21.15.37:0/4178452166 conn(0x7fa16c0fd8c0 msgr2=0x7fa16c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:41.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:41.973+0000 7fa171104640 1 -- 172.21.15.37:0/4178452166 shutdown_connections 2024-09-19T06:04:41.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:41.973+0000 7fa171104640 1 -- 172.21.15.37:0/4178452166 wait complete. 2024-09-19T06:04:41.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:41.974+0000 7fa171104640 1 Processor -- start 2024-09-19T06:04:41.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:41.975+0000 7fa171104640 1 -- start start 2024-09-19T06:04:41.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:41.975+0000 7fa171104640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa16c101de0 0x7fa16c198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:41.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:41.975+0000 7fa171104640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa16c102790 0x7fa16c1989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:41.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:41.975+0000 7fa171104640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa16c106f10 0x7fa16c19cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:41.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:41.975+0000 7fa171104640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa16c111f80 con 0x7fa16c102790 2024-09-19T06:04:41.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:41.975+0000 7fa171104640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fa16c111e00 con 0x7fa16c101de0 2024-09-19T06:04:41.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:41.975+0000 7fa171104640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa16c112100 con 0x7fa16c106f10 2024-09-19T06:04:41.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:41.975+0000 7fa16a59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa16c102790 0x7fa16c1989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:41.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:41.975+0000 7fa16a59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa16c102790 0x7fa16c1989a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57306/0 (socket says 172.21.15.37:57306) 2024-09-19T06:04:41.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:41.975+0000 7fa16a59c640 1 -- 172.21.15.37:0/165956063 learned_addr learned my addr 172.21.15.37:0/165956063 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:04:41.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:41.975+0000 7fa16b59e640 1 --2- 172.21.15.37:0/165956063 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa16c106f10 0x7fa16c19cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:41.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:41.975+0000 7fa16ad9d640 1 --2- 172.21.15.37:0/165956063 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa16c101de0 0x7fa16c198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:41.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:41.975+0000 7fa16a59c640 1 -- 172.21.15.37:0/165956063 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa16c106f10 msgr2=0x7fa16c19cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:41.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:41.975+0000 7fa16a59c640 1 --2- 172.21.15.37:0/165956063 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa16c106f10 0x7fa16c19cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:41.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:41.975+0000 7fa16a59c640 1 -- 172.21.15.37:0/165956063 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa16c101de0 msgr2=0x7fa16c198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:41.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:41.975+0000 7fa16a59c640 1 --2- 172.21.15.37:0/165956063 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa16c101de0 0x7fa16c198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:41.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:41.975+0000 7fa16a59c640 1 -- 172.21.15.37:0/165956063 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa16c19d410 con 0x7fa16c102790 2024-09-19T06:04:41.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:41.975+0000 7fa16a59c640 1 --2- 172.21.15.37:0/165956063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa16c102790 0x7fa16c1989a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa16000d950 tx=0x7fa16000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:41.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:41.976+0000 7fa153fff640 1 -- 172.21.15.37:0/165956063 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa160017070 con 0x7fa16c102790 2024-09-19T06:04:41.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:41.976+0000 7fa153fff640 1 -- 172.21.15.37:0/165956063 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa160009c30 con 0x7fa16c102790 2024-09-19T06:04:41.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:41.976+0000 7fa171104640 1 -- 172.21.15.37:0/165956063 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa16c19d700 con 0x7fa16c102790 2024-09-19T06:04:41.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:41.976+0000 7fa153fff640 1 -- 172.21.15.37:0/165956063 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa16000f6b0 con 0x7fa16c102790 2024-09-19T06:04:41.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:41.976+0000 7fa171104640 1 -- 172.21.15.37:0/165956063 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa16c1a4fe0 con 0x7fa16c102790 2024-09-19T06:04:41.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:41.977+0000 7fa171104640 1 -- 172.21.15.37:0/165956063 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa16c1021c0 con 0x7fa16c102790 2024-09-19T06:04:41.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:41.978+0000 7fa153fff640 1 -- 172.21.15.37:0/165956063 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fa1600109d0 con 0x7fa16c102790 2024-09-19T06:04:41.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:41.978+0000 7fa153fff640 1 --2- 172.21.15.37:0/165956063 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fa1540a3240 0x7fa1540a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:41.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:41.979+0000 7fa16ad9d640 1 --2- 172.21.15.37:0/165956063 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fa1540a3240 0x7fa1540a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:41.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:41.979+0000 7fa153fff640 1 -- 172.21.15.37:0/165956063 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7fa1600cf840 con 0x7fa16c102790 2024-09-19T06:04:41.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:41.979+0000 7fa16ad9d640 1 --2- 172.21.15.37:0/165956063 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fa1540a3240 0x7fa1540a5700 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa15c000c00 tx=0x7fa15c005a20 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:41.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:41.983+0000 7fa153fff640 1 -- 172.21.15.37:0/165956063 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa160009de0 con 0x7fa16c102790 2024-09-19T06:04:42.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:41 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/1510256525' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T06:04:42.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:41 smithi117 ceph-mon[35050]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T06:04:42.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:41 smithi117 ceph-mon[35050]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-19T06:04:42.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:42.195+0000 7fa171104640 1 -- 172.21.15.37:0/165956063 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7fa16c1997c0 con 0x7fa16c102790 2024-09-19T06:04:42.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:42.531+0000 7fa153fff640 1 -- 172.21.15.37:0/165956063 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v20) ==== 115+0+0 (secure 0 0 0) 0x7fa16009c2c0 con 0x7fa16c102790 2024-09-19T06:04:42.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:42.534+0000 7fa171104640 1 -- 172.21.15.37:0/165956063 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fa1540a3240 msgr2=0x7fa1540a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:42.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:42.534+0000 7fa171104640 1 --2- 172.21.15.37:0/165956063 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fa1540a3240 0x7fa1540a5700 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa15c000c00 tx=0x7fa15c005a20 comp rx=0 tx=0).stop 2024-09-19T06:04:42.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:42.534+0000 7fa171104640 1 -- 172.21.15.37:0/165956063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa16c102790 msgr2=0x7fa16c1989a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:42.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:42.534+0000 7fa171104640 1 --2- 172.21.15.37:0/165956063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa16c102790 0x7fa16c1989a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa16000d950 tx=0x7fa16000de10 comp rx=0 tx=0).stop 2024-09-19T06:04:42.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:42.534+0000 7fa171104640 1 -- 172.21.15.37:0/165956063 shutdown_connections 2024-09-19T06:04:42.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:42.534+0000 7fa171104640 1 --2- 172.21.15.37:0/165956063 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fa1540a3240 0x7fa1540a5700 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:42.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:42.534+0000 7fa171104640 1 --2- 172.21.15.37:0/165956063 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa16c106f10 0x7fa16c19cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:42.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:42.534+0000 7fa171104640 1 --2- 172.21.15.37:0/165956063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa16c102790 0x7fa16c1989a0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:42.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:42.534+0000 7fa171104640 1 --2- 172.21.15.37:0/165956063 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa16c101de0 0x7fa16c198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:42.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:42.534+0000 7fa171104640 1 -- 172.21.15.37:0/165956063 >> 172.21.15.37:0/165956063 conn(0x7fa16c0fd8c0 msgr2=0x7fa16c0fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:42.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:42.535+0000 7fa171104640 1 -- 172.21.15.37:0/165956063 shutdown_connections 2024-09-19T06:04:42.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:42.535+0000 7fa171104640 1 -- 172.21.15.37:0/165956063 wait complete. 2024-09-19T06:04:42.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:42 smithi037 ceph-mon[31211]: pgmap v301: 129 pgs: 129 active+clean; 581 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-19T06:04:42.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:42 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/165956063' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T06:04:42.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:42 smithi099 ceph-mon[35300]: pgmap v301: 129 pgs: 129 active+clean; 581 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-19T06:04:42.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:42 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/165956063' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T06:04:43.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:42 smithi117 ceph-mon[35050]: pgmap v301: 129 pgs: 129 active+clean; 581 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-19T06:04:43.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:42 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/165956063' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T06:04:43.400 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'} subvols for filesystem 'cephfs' 2024-09-19T06:04:43.401 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-19T06:04:43.665 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:04:43.786 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:43 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/165956063' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T06:04:43.787 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:43 smithi037 ceph-mon[31211]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-19T06:04:43.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:43 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/165956063' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T06:04:43.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:43 smithi099 ceph-mon[35300]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-19T06:04:43.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:43 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/165956063' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T06:04:44.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:43 smithi117 ceph-mon[35050]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-19T06:04:44.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:44.217+0000 7ff51c818640 1 -- 172.21.15.37:0/3726465535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff518101de0 msgr2=0x7ff5181021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:44.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:44.217+0000 7ff51c818640 1 --2- 172.21.15.37:0/3726465535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff518101de0 0x7ff5181021c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff508009900 tx=0x7ff50802a410 comp rx=0 tx=0).stop 2024-09-19T06:04:44.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:44.218+0000 7ff51c818640 1 -- 172.21.15.37:0/3726465535 shutdown_connections 2024-09-19T06:04:44.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:44.218+0000 7ff51c818640 1 --2- 172.21.15.37:0/3726465535 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff518106f10 0x7ff51810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:44.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:44.218+0000 7ff51c818640 1 --2- 172.21.15.37:0/3726465535 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff518102790 0x7ff5181067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:44.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:44.218+0000 7ff51c818640 1 --2- 172.21.15.37:0/3726465535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff518101de0 0x7ff5181021c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:44.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:44.218+0000 7ff51c818640 1 -- 172.21.15.37:0/3726465535 >> 172.21.15.37:0/3726465535 conn(0x7ff5180fd8c0 msgr2=0x7ff5180ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:44.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:44.218+0000 7ff51c818640 1 -- 172.21.15.37:0/3726465535 shutdown_connections 2024-09-19T06:04:44.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:44.218+0000 7ff51c818640 1 -- 172.21.15.37:0/3726465535 wait complete. 2024-09-19T06:04:44.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:44.218+0000 7ff51c818640 1 Processor -- start 2024-09-19T06:04:44.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:44.218+0000 7ff51c818640 1 -- start start 2024-09-19T06:04:44.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:44.219+0000 7ff51c818640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff518101de0 0x7ff5180744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:44.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:44.219+0000 7ff51c818640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff518102790 0x7ff518074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:44.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:44.219+0000 7ff51c818640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff518106f10 0x7ff518074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:44.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:44.219+0000 7ff51c818640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff518111f70 con 0x7ff518101de0 2024-09-19T06:04:44.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:44.219+0000 7ff51c818640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff518111df0 con 0x7ff518106f10 2024-09-19T06:04:44.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:44.219+0000 7ff51c818640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff5181120f0 con 0x7ff518102790 2024-09-19T06:04:44.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:44.219+0000 7ff51659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff518101de0 0x7ff5180744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:44.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:44.219+0000 7ff51659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff518101de0 0x7ff5180744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37558/0 (socket says 172.21.15.37:37558) 2024-09-19T06:04:44.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:44.219+0000 7ff51659c640 1 -- 172.21.15.37:0/284921075 learned_addr learned my addr 172.21.15.37:0/284921075 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:04:44.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:44.219+0000 7ff516d9d640 1 --2- 172.21.15.37:0/284921075 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff518106f10 0x7ff518074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:44.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:44.219+0000 7ff515d9b640 1 --2- 172.21.15.37:0/284921075 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff518102790 0x7ff518074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:44.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:44.219+0000 7ff51659c640 1 -- 172.21.15.37:0/284921075 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff518102790 msgr2=0x7ff518074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:44.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:44.219+0000 7ff51659c640 1 --2- 172.21.15.37:0/284921075 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff518102790 0x7ff518074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:44.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:44.219+0000 7ff51659c640 1 -- 172.21.15.37:0/284921075 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff518106f10 msgr2=0x7ff518074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:44.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:44.219+0000 7ff51659c640 1 --2- 172.21.15.37:0/284921075 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff518106f10 0x7ff518074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:44.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:44.219+0000 7ff51659c640 1 -- 172.21.15.37:0/284921075 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5181a6970 con 0x7ff518101de0 2024-09-19T06:04:44.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:44.219+0000 7ff515d9b640 1 --2- 172.21.15.37:0/284921075 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff518102790 0x7ff518074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:04:44.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:44.219+0000 7ff51659c640 1 --2- 172.21.15.37:0/284921075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff518101de0 0x7ff5180744f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff508006010 tx=0x7ff5080042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:44.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:44.219+0000 7ff5077fe640 1 -- 172.21.15.37:0/284921075 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff50803f030 con 0x7ff518101de0 2024-09-19T06:04:44.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:44.220+0000 7ff5077fe640 1 -- 172.21.15.37:0/284921075 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff508003ce0 con 0x7ff518101de0 2024-09-19T06:04:44.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:44.220+0000 7ff5077fe640 1 -- 172.21.15.37:0/284921075 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff508035070 con 0x7ff518101de0 2024-09-19T06:04:44.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:44.220+0000 7ff51c818640 1 -- 172.21.15.37:0/284921075 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5181a6c00 con 0x7ff518101de0 2024-09-19T06:04:44.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:44.220+0000 7ff51c818640 1 -- 172.21.15.37:0/284921075 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5181a70e0 con 0x7ff518101de0 2024-09-19T06:04:44.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:44.221+0000 7ff51c818640 1 -- 172.21.15.37:0/284921075 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5181021c0 con 0x7ff518101de0 2024-09-19T06:04:44.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:44.222+0000 7ff5077fe640 1 -- 172.21.15.37:0/284921075 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7ff508042030 con 0x7ff518101de0 2024-09-19T06:04:44.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:44.223+0000 7ff5077fe640 1 --2- 172.21.15.37:0/284921075 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7ff5000a3240 0x7ff5000a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:44.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:44.223+0000 7ff515d9b640 1 --2- 172.21.15.37:0/284921075 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7ff5000a3240 0x7ff5000a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:44.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:44.223+0000 7ff5077fe640 1 -- 172.21.15.37:0/284921075 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7ff5080f0460 con 0x7ff518101de0 2024-09-19T06:04:44.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:44.223+0000 7ff515d9b640 1 --2- 172.21.15.37:0/284921075 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7ff5000a3240 0x7ff5000a5700 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff518075f80 tx=0x7ff50c005e50 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:44.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:44.227+0000 7ff5077fe640 1 -- 172.21.15.37:0/284921075 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff5080bd000 con 0x7ff518101de0 2024-09-19T06:04:44.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:44.427+0000 7ff51c818640 1 -- 172.21.15.37:0/284921075 --> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7ff51810a160 con 0x7ff5000a3240 2024-09-19T06:04:44.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:44.448+0000 7ff5077fe640 1 -- 172.21.15.37:0/284921075 <== mgr.14148 v2:172.21.15.37:6800/3797010169 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff50c009750 con 0x7ff5000a3240 2024-09-19T06:04:44.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:44.449+0000 7ff51c818640 1 -- 172.21.15.37:0/284921075 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7ff5000a3240 msgr2=0x7ff5000a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:44.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:44.449+0000 7ff51c818640 1 --2- 172.21.15.37:0/284921075 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7ff5000a3240 0x7ff5000a5700 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff518075f80 tx=0x7ff50c005e50 comp rx=0 tx=0).stop 2024-09-19T06:04:44.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:44.449+0000 7ff51c818640 1 -- 172.21.15.37:0/284921075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff518101de0 msgr2=0x7ff5180744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:44.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:44.449+0000 7ff51c818640 1 --2- 172.21.15.37:0/284921075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff518101de0 0x7ff5180744f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff508006010 tx=0x7ff5080042f0 comp rx=0 tx=0).stop 2024-09-19T06:04:44.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:44.450+0000 7ff51c818640 1 -- 172.21.15.37:0/284921075 shutdown_connections 2024-09-19T06:04:44.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:44.450+0000 7ff51c818640 1 --2- 172.21.15.37:0/284921075 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7ff5000a3240 0x7ff5000a5700 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:44.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:44.450+0000 7ff51c818640 1 --2- 172.21.15.37:0/284921075 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff518106f10 0x7ff518074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:44.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:44.450+0000 7ff51c818640 1 --2- 172.21.15.37:0/284921075 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff518102790 0x7ff518074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:44.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:44.450+0000 7ff51c818640 1 --2- 172.21.15.37:0/284921075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff518101de0 0x7ff5180744f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:44.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:44.450+0000 7ff51c818640 1 -- 172.21.15.37:0/284921075 >> 172.21.15.37:0/284921075 conn(0x7ff5180fd8c0 msgr2=0x7ff5180fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:44.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:44.450+0000 7ff51c818640 1 -- 172.21.15.37:0/284921075 shutdown_connections 2024-09-19T06:04:44.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:44.450+0000 7ff51c818640 1 -- 172.21.15.37:0/284921075 wait complete. 2024-09-19T06:04:44.739 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:44 smithi037 ceph-mon[31211]: pgmap v302: 129 pgs: 129 active+clean; 581 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s rd, 426 B/s wr, 0 op/s 2024-09-19T06:04:44.740 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 06:04:44 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T06:04:44.433+0000 7faf15162640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:04:44.740 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 06:04:44 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T06:04:44.433+0000 7faf15162640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:04:44.740 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 06:04:44 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T06:04:44.433+0000 7faf15162640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:04:44.740 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 06:04:44 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T06:04:44.433+0000 7faf15162640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:04:44.740 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 06:04:44 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T06:04:44.433+0000 7faf15162640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:04:44.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:44 smithi099 ceph-mon[35300]: pgmap v302: 129 pgs: 129 active+clean; 581 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s rd, 426 B/s wr, 0 op/s 2024-09-19T06:04:45.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:44 smithi117 ceph-mon[35050]: pgmap v302: 129 pgs: 129 active+clean; 581 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s rd, 426 B/s wr, 0 op/s 2024-09-19T06:04:45.178 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-19T06:04:45.443 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:04:45.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:45 smithi037 ceph-mon[31211]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:04:45.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:45 smithi099 ceph-mon[35300]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:04:45.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:45 smithi117 ceph-mon[35050]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:04:46.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:45.989+0000 7fc68bc98640 1 -- 172.21.15.37:0/887604632 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc684102b50 msgr2=0x7fc684100090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:46.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:45.989+0000 7fc68bc98640 1 --2- 172.21.15.37:0/887604632 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc684102b50 0x7fc684100090 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc680009900 tx=0x7fc68002a400 comp rx=0 tx=0).stop 2024-09-19T06:04:46.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:45.989+0000 7fc68bc98640 1 -- 172.21.15.37:0/887604632 shutdown_connections 2024-09-19T06:04:46.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:45.989+0000 7fc68bc98640 1 --2- 172.21.15.37:0/887604632 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc68410e810 0x7fc684110c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:46.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:45.989+0000 7fc68bc98640 1 --2- 172.21.15.37:0/887604632 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc684102fc0 0x7fc6841005d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:46.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:45.989+0000 7fc68bc98640 1 --2- 172.21.15.37:0/887604632 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc684102b50 0x7fc684100090 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:46.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:45.989+0000 7fc68bc98640 1 -- 172.21.15.37:0/887604632 >> 172.21.15.37:0/887604632 conn(0x7fc684077210 msgr2=0x7fc6840fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:46.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:45.990+0000 7fc68bc98640 1 -- 172.21.15.37:0/887604632 shutdown_connections 2024-09-19T06:04:46.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:45.990+0000 7fc68bc98640 1 -- 172.21.15.37:0/887604632 wait complete. 2024-09-19T06:04:46.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:45.990+0000 7fc68bc98640 1 Processor -- start 2024-09-19T06:04:46.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:45.990+0000 7fc68bc98640 1 -- start start 2024-09-19T06:04:46.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:45.990+0000 7fc68bc98640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc684102b50 0x7fc68419a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:46.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:45.990+0000 7fc68bc98640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc68410e810 0x7fc68419ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:46.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:45.990+0000 7fc68bc98640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc68419eef0 0x7fc68419f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:46.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:45.990+0000 7fc68bc98640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc6841141e0 con 0x7fc68419eef0 2024-09-19T06:04:46.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:45.990+0000 7fc68bc98640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc684114060 con 0x7fc684102b50 2024-09-19T06:04:46.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:45.990+0000 7fc68bc98640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc684114360 con 0x7fc68410e810 2024-09-19T06:04:46.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:45.991+0000 7fc68a235640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc68419eef0 0x7fc68419f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:46.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:45.991+0000 7fc68a235640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc68419eef0 0x7fc68419f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37598/0 (socket says 172.21.15.37:37598) 2024-09-19T06:04:46.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:45.991+0000 7fc68a235640 1 -- 172.21.15.37:0/361960437 learned_addr learned my addr 172.21.15.37:0/361960437 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:04:46.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:45.991+0000 7fc689a34640 1 --2- 172.21.15.37:0/361960437 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc684102b50 0x7fc68419a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:46.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:45.991+0000 7fc689233640 1 --2- 172.21.15.37:0/361960437 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc68410e810 0x7fc68419ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:46.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:45.991+0000 7fc68a235640 1 -- 172.21.15.37:0/361960437 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc68410e810 msgr2=0x7fc68419ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:46.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:45.991+0000 7fc68a235640 1 --2- 172.21.15.37:0/361960437 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc68410e810 0x7fc68419ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:46.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:45.991+0000 7fc68a235640 1 -- 172.21.15.37:0/361960437 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc684102b50 msgr2=0x7fc68419a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:46.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:45.991+0000 7fc68a235640 1 --2- 172.21.15.37:0/361960437 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc684102b50 0x7fc68419a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:46.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:45.991+0000 7fc68a235640 1 -- 172.21.15.37:0/361960437 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc68419f9b0 con 0x7fc68419eef0 2024-09-19T06:04:46.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:45.991+0000 7fc68a235640 1 --2- 172.21.15.37:0/361960437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc68419eef0 0x7fc68419f3a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc67c00eaa0 tx=0x7fc67c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:46.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:45.991+0000 7fc67affd640 1 -- 172.21.15.37:0/361960437 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc67c00cdb0 con 0x7fc68419eef0 2024-09-19T06:04:46.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:45.991+0000 7fc67affd640 1 -- 172.21.15.37:0/361960437 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc67c005020 con 0x7fc68419eef0 2024-09-19T06:04:46.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:45.991+0000 7fc68bc98640 1 -- 172.21.15.37:0/361960437 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc68419fca0 con 0x7fc68419eef0 2024-09-19T06:04:46.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:45.991+0000 7fc67affd640 1 -- 172.21.15.37:0/361960437 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc67c0116b0 con 0x7fc68419eef0 2024-09-19T06:04:46.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:45.991+0000 7fc68bc98640 1 -- 172.21.15.37:0/361960437 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6841a7480 con 0x7fc68419eef0 2024-09-19T06:04:46.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:45.992+0000 7fc68bc98640 1 -- 172.21.15.37:0/361960437 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc684100090 con 0x7fc68419eef0 2024-09-19T06:04:46.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:45.994+0000 7fc67affd640 1 -- 172.21.15.37:0/361960437 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fc67c005560 con 0x7fc68419eef0 2024-09-19T06:04:46.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:45.995+0000 7fc67affd640 1 --2- 172.21.15.37:0/361960437 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fc6700a3350 0x7fc6700a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:46.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:45.995+0000 7fc67affd640 1 -- 172.21.15.37:0/361960437 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7fc67c0d01e0 con 0x7fc68419eef0 2024-09-19T06:04:46.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:45.995+0000 7fc689a34640 1 --2- 172.21.15.37:0/361960437 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fc6700a3350 0x7fc6700a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:46.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:45.995+0000 7fc689a34640 1 --2- 172.21.15.37:0/361960437 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fc6700a3350 0x7fc6700a5810 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc680009230 tx=0x7fc6800058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:46.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:45.999+0000 7fc67affd640 1 -- 172.21.15.37:0/361960437 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc67c016030 con 0x7fc68419eef0 2024-09-19T06:04:46.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:46.200+0000 7fc68bc98640 1 -- 172.21.15.37:0/361960437 --> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fc684103140 con 0x7fc6700a3350 2024-09-19T06:04:46.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:46.224+0000 7fc67affd640 1 -- 172.21.15.37:0/361960437 <== mgr.14148 v2:172.21.15.37:6800/3797010169 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fc684103140 con 0x7fc6700a3350 2024-09-19T06:04:46.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:46.226+0000 7fc68bc98640 1 -- 172.21.15.37:0/361960437 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fc6700a3350 msgr2=0x7fc6700a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:46.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:46.226+0000 7fc68bc98640 1 --2- 172.21.15.37:0/361960437 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fc6700a3350 0x7fc6700a5810 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc680009230 tx=0x7fc6800058d0 comp rx=0 tx=0).stop 2024-09-19T06:04:46.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:46.226+0000 7fc68bc98640 1 -- 172.21.15.37:0/361960437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc68419eef0 msgr2=0x7fc68419f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:46.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:46.226+0000 7fc68bc98640 1 --2- 172.21.15.37:0/361960437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc68419eef0 0x7fc68419f3a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc67c00eaa0 tx=0x7fc67c00ef60 comp rx=0 tx=0).stop 2024-09-19T06:04:46.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:46.226+0000 7fc68bc98640 1 -- 172.21.15.37:0/361960437 shutdown_connections 2024-09-19T06:04:46.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:46.226+0000 7fc68bc98640 1 --2- 172.21.15.37:0/361960437 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fc6700a3350 0x7fc6700a5810 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:46.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:46.226+0000 7fc68bc98640 1 --2- 172.21.15.37:0/361960437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc68419eef0 0x7fc68419f3a0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:46.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:46.226+0000 7fc68bc98640 1 --2- 172.21.15.37:0/361960437 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc68410e810 0x7fc68419ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:46.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:46.226+0000 7fc68bc98640 1 --2- 172.21.15.37:0/361960437 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc684102b50 0x7fc68419a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:46.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:46.226+0000 7fc68bc98640 1 -- 172.21.15.37:0/361960437 >> 172.21.15.37:0/361960437 conn(0x7fc684077210 msgr2=0x7fc68410fd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:46.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:46.226+0000 7fc68bc98640 1 -- 172.21.15.37:0/361960437 shutdown_connections 2024-09-19T06:04:46.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:46.226+0000 7fc68bc98640 1 -- 172.21.15.37:0/361960437 wait complete. 2024-09-19T06:04:46.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:46 smithi037 ceph-mon[31211]: pgmap v303: 129 pgs: 129 active+clean; 581 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 426 B/s wr, 1 op/s 2024-09-19T06:04:46.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:46 smithi037 ceph-mon[31211]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-19T06:04:46.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:46 smithi099 ceph-mon[35300]: pgmap v303: 129 pgs: 129 active+clean; 581 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 426 B/s wr, 1 op/s 2024-09-19T06:04:46.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:46 smithi099 ceph-mon[35300]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-19T06:04:46.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:46 smithi117 ceph-mon[35050]: pgmap v303: 129 pgs: 129 active+clean; 581 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 426 B/s wr, 1 op/s 2024-09-19T06:04:47.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:46 smithi117 ceph-mon[35050]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-19T06:04:47.063 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-19T06:04:47.327 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:04:47.713 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:47 smithi037 ceph-mon[31211]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:04:47.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:47.799+0000 7f8a80419640 1 -- 172.21.15.37:0/2181454207 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a78100a80 msgr2=0x7f8a78100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:47.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:47.799+0000 7f8a80419640 1 --2- 172.21.15.37:0/2181454207 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a78100a80 0x7f8a78100ee0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8a68009930 tx=0x7f8a6802a420 comp rx=0 tx=0).stop 2024-09-19T06:04:47.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:47.799+0000 7f8a80419640 1 -- 172.21.15.37:0/2181454207 shutdown_connections 2024-09-19T06:04:47.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:47.799+0000 7f8a80419640 1 --2- 172.21.15.37:0/2181454207 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a78101420 0x7f8a7810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:47.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:47.799+0000 7f8a80419640 1 --2- 172.21.15.37:0/2181454207 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a78100a80 0x7f8a78100ee0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:47.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:47.799+0000 7f8a80419640 1 --2- 172.21.15.37:0/2181454207 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a78106a80 0x7f8a78106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:47.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:47.799+0000 7f8a80419640 1 -- 172.21.15.37:0/2181454207 >> 172.21.15.37:0/2181454207 conn(0x7f8a780fc7a0 msgr2=0x7f8a780febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:47.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:47.799+0000 7f8a80419640 1 -- 172.21.15.37:0/2181454207 shutdown_connections 2024-09-19T06:04:47.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:47.799+0000 7f8a80419640 1 -- 172.21.15.37:0/2181454207 wait complete. 2024-09-19T06:04:47.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:47.800+0000 7f8a80419640 1 Processor -- start 2024-09-19T06:04:47.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:47.800+0000 7f8a80419640 1 -- start start 2024-09-19T06:04:47.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:47.800+0000 7f8a80419640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a78100a80 0x7f8a781983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:47.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:47.800+0000 7f8a80419640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a78101420 0x7f8a781988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:47.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:47.800+0000 7f8a80419640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a78106a80 0x7f8a7819cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:47.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:47.800+0000 7f8a80419640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8a78110e40 con 0x7f8a78100a80 2024-09-19T06:04:47.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:47.800+0000 7f8a80419640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f8a78110cc0 con 0x7f8a78106a80 2024-09-19T06:04:47.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:47.800+0000 7f8a80419640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8a78110fc0 con 0x7f8a78101420 2024-09-19T06:04:47.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:47.800+0000 7f8a7e1b5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a78100a80 0x7f8a781983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:47.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:47.800+0000 7f8a7e1b5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a78100a80 0x7f8a781983a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37628/0 (socket says 172.21.15.37:37628) 2024-09-19T06:04:47.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:47.800+0000 7f8a7e1b5640 1 -- 172.21.15.37:0/907816638 learned_addr learned my addr 172.21.15.37:0/907816638 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:04:47.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:47.800+0000 7f8a7d9b4640 1 --2- 172.21.15.37:0/907816638 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a78101420 0x7f8a781988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:47.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:47.800+0000 7f8a7e1b5640 1 -- 172.21.15.37:0/907816638 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a78101420 msgr2=0x7f8a781988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:47.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:47.800+0000 7f8a7e1b5640 1 --2- 172.21.15.37:0/907816638 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a78101420 0x7f8a781988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:47.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:47.800+0000 7f8a7e1b5640 1 -- 172.21.15.37:0/907816638 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a78106a80 msgr2=0x7f8a7819cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:47.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:47.800+0000 7f8a7e1b5640 1 --2- 172.21.15.37:0/907816638 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a78106a80 0x7f8a7819cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:47.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:47.800+0000 7f8a7e1b5640 1 -- 172.21.15.37:0/907816638 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a7819d350 con 0x7f8a78100a80 2024-09-19T06:04:47.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:47.800+0000 7f8a7d9b4640 1 --2- 172.21.15.37:0/907816638 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a78101420 0x7f8a781988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:04:47.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:47.801+0000 7f8a7e1b5640 1 --2- 172.21.15.37:0/907816638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a78100a80 0x7f8a781983a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8a7400c920 tx=0x7f8a7400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:47.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:47.801+0000 7f8a6f7fe640 1 -- 172.21.15.37:0/907816638 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a74007c70 con 0x7f8a78100a80 2024-09-19T06:04:47.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:47.801+0000 7f8a6f7fe640 1 -- 172.21.15.37:0/907816638 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a74007e10 con 0x7f8a78100a80 2024-09-19T06:04:47.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:47.801+0000 7f8a80419640 1 -- 172.21.15.37:0/907816638 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a7819d640 con 0x7f8a78100a80 2024-09-19T06:04:47.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:47.801+0000 7f8a6f7fe640 1 -- 172.21.15.37:0/907816638 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a74018890 con 0x7f8a78100a80 2024-09-19T06:04:47.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:47.801+0000 7f8a80419640 1 -- 172.21.15.37:0/907816638 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a781a4f20 con 0x7f8a78100a80 2024-09-19T06:04:47.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:47.802+0000 7f8a80419640 1 -- 172.21.15.37:0/907816638 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a78100ee0 con 0x7f8a78100a80 2024-09-19T06:04:47.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:47.803+0000 7f8a6f7fe640 1 -- 172.21.15.37:0/907816638 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f8a74018a70 con 0x7f8a78100a80 2024-09-19T06:04:47.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:47.804+0000 7f8a6f7fe640 1 --2- 172.21.15.37:0/907816638 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f8a640a32d0 0x7f8a640a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:47.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:47.804+0000 7f8a7d9b4640 1 --2- 172.21.15.37:0/907816638 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f8a640a32d0 0x7f8a640a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:47.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:47.804+0000 7f8a6f7fe640 1 -- 172.21.15.37:0/907816638 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f8a740cfe60 con 0x7f8a78100a80 2024-09-19T06:04:47.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:47.804+0000 7f8a7d9b4640 1 --2- 172.21.15.37:0/907816638 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f8a640a32d0 0x7f8a640a5790 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8a68000c00 tx=0x7f8a68005a20 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:47.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:47.808+0000 7f8a6f7fe640 1 -- 172.21.15.37:0/907816638 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8a74014030 con 0x7f8a78100a80 2024-09-19T06:04:47.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:47 smithi099 ceph-mon[35300]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:04:48.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:47 smithi117 ceph-mon[35050]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:04:48.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:48.012+0000 7f8a80419640 1 -- 172.21.15.37:0/907816638 --> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f8a7806a790 con 0x7f8a640a32d0 2024-09-19T06:04:48.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:48.017+0000 7f8a6f7fe640 1 -- 172.21.15.37:0/907816638 <== mgr.14148 v2:172.21.15.37:6800/3797010169 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f8a7806a790 con 0x7f8a640a32d0 2024-09-19T06:04:48.019 INFO:teuthology.orchestra.run.smithi037.stdout:/volumes/qa/sv_0/1c83c19b-df67-4896-9a79-803465e831a0 2024-09-19T06:04:48.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:48.019+0000 7f8a80419640 1 -- 172.21.15.37:0/907816638 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f8a640a32d0 msgr2=0x7f8a640a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:48.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:48.019+0000 7f8a80419640 1 --2- 172.21.15.37:0/907816638 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f8a640a32d0 0x7f8a640a5790 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8a68000c00 tx=0x7f8a68005a20 comp rx=0 tx=0).stop 2024-09-19T06:04:48.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:48.019+0000 7f8a80419640 1 -- 172.21.15.37:0/907816638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a78100a80 msgr2=0x7f8a781983a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:48.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:48.019+0000 7f8a80419640 1 --2- 172.21.15.37:0/907816638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a78100a80 0x7f8a781983a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8a7400c920 tx=0x7f8a7400cde0 comp rx=0 tx=0).stop 2024-09-19T06:04:48.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:48.019+0000 7f8a80419640 1 -- 172.21.15.37:0/907816638 shutdown_connections 2024-09-19T06:04:48.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:48.019+0000 7f8a80419640 1 --2- 172.21.15.37:0/907816638 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f8a640a32d0 0x7f8a640a5790 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:48.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:48.019+0000 7f8a80419640 1 --2- 172.21.15.37:0/907816638 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a78106a80 0x7f8a7819cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:48.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:48.019+0000 7f8a80419640 1 --2- 172.21.15.37:0/907816638 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a78101420 0x7f8a781988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:48.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:48.019+0000 7f8a80419640 1 --2- 172.21.15.37:0/907816638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a78100a80 0x7f8a781983a0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:48.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:48.019+0000 7f8a80419640 1 -- 172.21.15.37:0/907816638 >> 172.21.15.37:0/907816638 conn(0x7f8a780fc7a0 msgr2=0x7f8a78104790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:48.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:48.019+0000 7f8a80419640 1 -- 172.21.15.37:0/907816638 shutdown_connections 2024-09-19T06:04:48.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:48.019+0000 7f8a80419640 1 -- 172.21.15.37:0/907816638 wait complete. 2024-09-19T06:04:48.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:48 smithi037 ceph-mon[31211]: pgmap v304: 129 pgs: 129 active+clean; 581 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 1 op/s 2024-09-19T06:04:48.906 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-19T06:04:48.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:48 smithi099 ceph-mon[35300]: pgmap v304: 129 pgs: 129 active+clean; 581 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 1 op/s 2024-09-19T06:04:48.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:48 smithi117 ceph-mon[35050]: pgmap v304: 129 pgs: 129 active+clean; 581 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 1 op/s 2024-09-19T06:04:49.171 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:04:49.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:49.658+0000 7f5d050f8640 1 -- 172.21.15.37:0/514292220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d00106f10 msgr2=0x7f5d0010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:49.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:49.658+0000 7f5d050f8640 1 --2- 172.21.15.37:0/514292220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d00106f10 0x7f5d0010ea90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5cf8009900 tx=0x7f5cf802a3f0 comp rx=0 tx=0).stop 2024-09-19T06:04:49.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:49.658+0000 7f5d050f8640 1 -- 172.21.15.37:0/514292220 shutdown_connections 2024-09-19T06:04:49.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:49.658+0000 7f5d050f8640 1 --2- 172.21.15.37:0/514292220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d00106f10 0x7f5d0010ea90 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:49.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:49.658+0000 7f5d050f8640 1 --2- 172.21.15.37:0/514292220 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d00102790 0x7f5d001067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:49.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:49.658+0000 7f5d050f8640 1 --2- 172.21.15.37:0/514292220 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d00101de0 0x7f5d001021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:49.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:49.658+0000 7f5d050f8640 1 -- 172.21.15.37:0/514292220 >> 172.21.15.37:0/514292220 conn(0x7f5d000fd8c0 msgr2=0x7f5d000ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:49.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:49.658+0000 7f5d050f8640 1 -- 172.21.15.37:0/514292220 shutdown_connections 2024-09-19T06:04:49.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:49.658+0000 7f5d050f8640 1 -- 172.21.15.37:0/514292220 wait complete. 2024-09-19T06:04:49.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:49.659+0000 7f5d050f8640 1 Processor -- start 2024-09-19T06:04:49.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:49.659+0000 7f5d050f8640 1 -- start start 2024-09-19T06:04:49.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:49.660+0000 7f5d050f8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d00101de0 0x7f5d00198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:49.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:49.660+0000 7f5d050f8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d00102790 0x7f5d00198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:49.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:49.660+0000 7f5d050f8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d00106f10 0x7f5d0019ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:49.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:49.660+0000 7f5d050f8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5d00112060 con 0x7f5d00102790 2024-09-19T06:04:49.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:49.660+0000 7f5d050f8640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f5d00111ee0 con 0x7f5d00106f10 2024-09-19T06:04:49.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:49.660+0000 7f5d050f8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5d001121e0 con 0x7f5d00101de0 2024-09-19T06:04:49.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:49.660+0000 7f5cfe59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d00102790 0x7f5d00198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:49.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:49.660+0000 7f5cfe59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d00102790 0x7f5d00198a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37644/0 (socket says 172.21.15.37:37644) 2024-09-19T06:04:49.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:49.660+0000 7f5cfe59c640 1 -- 172.21.15.37:0/1707359057 learned_addr learned my addr 172.21.15.37:0/1707359057 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:04:49.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:49.660+0000 7f5cfed9d640 1 --2- 172.21.15.37:0/1707359057 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d00101de0 0x7f5d00198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:49.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:49.660+0000 7f5cff59e640 1 --2- 172.21.15.37:0/1707359057 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d00106f10 0x7f5d0019ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:49.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:49.660+0000 7f5cfe59c640 1 -- 172.21.15.37:0/1707359057 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d00101de0 msgr2=0x7f5d00198540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:49.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:49.660+0000 7f5cfe59c640 1 --2- 172.21.15.37:0/1707359057 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d00101de0 0x7f5d00198540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:49.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:49.660+0000 7f5cfe59c640 1 -- 172.21.15.37:0/1707359057 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d00106f10 msgr2=0x7f5d0019ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:49.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:49.660+0000 7f5cfe59c640 1 --2- 172.21.15.37:0/1707359057 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d00106f10 0x7f5d0019ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:49.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:49.660+0000 7f5cfe59c640 1 -- 172.21.15.37:0/1707359057 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d0019d4f0 con 0x7f5d00102790 2024-09-19T06:04:49.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:49.660+0000 7f5cff59e640 1 --2- 172.21.15.37:0/1707359057 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d00106f10 0x7f5d0019ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:04:49.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:49.660+0000 7f5cfe59c640 1 --2- 172.21.15.37:0/1707359057 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d00102790 0x7f5d00198a80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5ce800b4a0 tx=0x7f5ce800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:49.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:49.660+0000 7f5cf7fff640 1 -- 172.21.15.37:0/1707359057 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce8014070 con 0x7f5d00102790 2024-09-19T06:04:49.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:49.661+0000 7f5d050f8640 1 -- 172.21.15.37:0/1707359057 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d0019d7e0 con 0x7f5d00102790 2024-09-19T06:04:49.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:49.661+0000 7f5cf7fff640 1 -- 172.21.15.37:0/1707359057 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ce8010af0 con 0x7f5d00102790 2024-09-19T06:04:49.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:49.661+0000 7f5cf7fff640 1 -- 172.21.15.37:0/1707359057 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce8017d10 con 0x7f5d00102790 2024-09-19T06:04:49.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:49.661+0000 7f5d050f8640 1 -- 172.21.15.37:0/1707359057 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d001a50c0 con 0x7f5d00102790 2024-09-19T06:04:49.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:49.662+0000 7f5d050f8640 1 -- 172.21.15.37:0/1707359057 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d00102240 con 0x7f5d00102790 2024-09-19T06:04:49.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:49.663+0000 7f5cf7fff640 1 -- 172.21.15.37:0/1707359057 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f5ce8017070 con 0x7f5d00102790 2024-09-19T06:04:49.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:49.664+0000 7f5cf7fff640 1 --2- 172.21.15.37:0/1707359057 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f5cec0a32d0 0x7f5cec0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:49.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:49.664+0000 7f5cfed9d640 1 --2- 172.21.15.37:0/1707359057 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f5cec0a32d0 0x7f5cec0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:49.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:49.664+0000 7f5cf7fff640 1 -- 172.21.15.37:0/1707359057 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f5ce80ceff0 con 0x7f5d00102790 2024-09-19T06:04:49.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:49.664+0000 7f5cfed9d640 1 --2- 172.21.15.37:0/1707359057 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f5cec0a32d0 0x7f5cec0a5790 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5cf000a400 tx=0x7f5cf000d040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:49.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:49.668+0000 7f5cf7fff640 1 -- 172.21.15.37:0/1707359057 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5ce809ba60 con 0x7f5d00102790 2024-09-19T06:04:49.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:49 smithi037 ceph-mon[31211]: from='client.14778 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:04:49.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:49.870+0000 7f5d050f8640 1 -- 172.21.15.37:0/1707359057 --> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f5d00062630 con 0x7f5cec0a32d0 2024-09-19T06:04:49.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:49.894+0000 7f5cf7fff640 1 -- 172.21.15.37:0/1707359057 <== mgr.14148 v2:172.21.15.37:6800/3797010169 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f5d00062630 con 0x7f5cec0a32d0 2024-09-19T06:04:49.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:49.896+0000 7f5d050f8640 1 -- 172.21.15.37:0/1707359057 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f5cec0a32d0 msgr2=0x7f5cec0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:49.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:49.896+0000 7f5d050f8640 1 --2- 172.21.15.37:0/1707359057 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f5cec0a32d0 0x7f5cec0a5790 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5cf000a400 tx=0x7f5cf000d040 comp rx=0 tx=0).stop 2024-09-19T06:04:49.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:49.896+0000 7f5d050f8640 1 -- 172.21.15.37:0/1707359057 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d00102790 msgr2=0x7f5d00198a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:49.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:49.896+0000 7f5d050f8640 1 --2- 172.21.15.37:0/1707359057 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d00102790 0x7f5d00198a80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5ce800b4a0 tx=0x7f5ce800b960 comp rx=0 tx=0).stop 2024-09-19T06:04:49.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:49.896+0000 7f5d050f8640 1 -- 172.21.15.37:0/1707359057 shutdown_connections 2024-09-19T06:04:49.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:49.896+0000 7f5d050f8640 1 --2- 172.21.15.37:0/1707359057 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f5cec0a32d0 0x7f5cec0a5790 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:49.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:49.896+0000 7f5d050f8640 1 --2- 172.21.15.37:0/1707359057 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d00106f10 0x7f5d0019ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:49.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:49.896+0000 7f5d050f8640 1 --2- 172.21.15.37:0/1707359057 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d00102790 0x7f5d00198a80 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:49.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:49.896+0000 7f5d050f8640 1 --2- 172.21.15.37:0/1707359057 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d00101de0 0x7f5d00198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:49.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:49.896+0000 7f5d050f8640 1 -- 172.21.15.37:0/1707359057 >> 172.21.15.37:0/1707359057 conn(0x7f5d000fd8c0 msgr2=0x7f5d000feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:49.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:49.896+0000 7f5d050f8640 1 -- 172.21.15.37:0/1707359057 shutdown_connections 2024-09-19T06:04:49.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:49.897+0000 7f5d050f8640 1 -- 172.21.15.37:0/1707359057 wait complete. 2024-09-19T06:04:49.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:49 smithi099 ceph-mon[35300]: from='client.14778 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:04:50.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:49 smithi117 ceph-mon[35050]: from='client.14778 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:04:50.711 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-19T06:04:50.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:50 smithi037 ceph-mon[31211]: pgmap v305: 129 pgs: 129 active+clean; 601 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 2.1 KiB/s wr, 2 op/s 2024-09-19T06:04:50.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:50 smithi099 ceph-mon[35300]: pgmap v305: 129 pgs: 129 active+clean; 601 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 2.1 KiB/s wr, 2 op/s 2024-09-19T06:04:50.971 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:04:50.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:50 smithi117 ceph-mon[35050]: pgmap v305: 129 pgs: 129 active+clean; 601 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 2.1 KiB/s wr, 2 op/s 2024-09-19T06:04:51.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:51.541+0000 7feec96b1640 1 -- 172.21.15.37:0/2348638973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feec4100e20 msgr2=0x7feec4101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:51.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:51.541+0000 7feec96b1640 1 --2- 172.21.15.37:0/2348638973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feec4100e20 0x7feec4101200 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7feeb4009900 tx=0x7feeb402a480 comp rx=0 tx=0).stop 2024-09-19T06:04:51.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:51.541+0000 7feec96b1640 1 -- 172.21.15.37:0/2348638973 shutdown_connections 2024-09-19T06:04:51.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:51.541+0000 7feec96b1640 1 --2- 172.21.15.37:0/2348638973 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feec4102570 0x7feec41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:51.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:51.541+0000 7feec96b1640 1 --2- 172.21.15.37:0/2348638973 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feec4102ef0 0x7feec410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:51.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:51.541+0000 7feec96b1640 1 --2- 172.21.15.37:0/2348638973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feec4100e20 0x7feec4101200 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:51.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:51.541+0000 7feec96b1640 1 -- 172.21.15.37:0/2348638973 >> 172.21.15.37:0/2348638973 conn(0x7feec40fc7d0 msgr2=0x7feec40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:51.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:51.541+0000 7feec96b1640 1 -- 172.21.15.37:0/2348638973 shutdown_connections 2024-09-19T06:04:51.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:51.541+0000 7feec96b1640 1 -- 172.21.15.37:0/2348638973 wait complete. 2024-09-19T06:04:51.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:51.542+0000 7feec96b1640 1 Processor -- start 2024-09-19T06:04:51.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:51.542+0000 7feec96b1640 1 -- start start 2024-09-19T06:04:51.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:51.542+0000 7feec96b1640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feec4100e20 0x7feec40fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:51.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:51.542+0000 7feec96b1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feec4102570 0x7feec40fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:51.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:51.542+0000 7feec96b1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feec4102ef0 0x7feec40fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:51.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:51.542+0000 7feec96b1640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7feec4110f80 con 0x7feec4102570 2024-09-19T06:04:51.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:51.542+0000 7feec96b1640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7feec4110e00 con 0x7feec4100e20 2024-09-19T06:04:51.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:51.542+0000 7feec96b1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7feec4111100 con 0x7feec4102ef0 2024-09-19T06:04:51.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:51.542+0000 7feeba7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feec4102570 0x7feec40fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:51.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:51.542+0000 7feeba7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feec4102570 0x7feec40fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37672/0 (socket says 172.21.15.37:37672) 2024-09-19T06:04:51.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:51.542+0000 7feeba7fc640 1 -- 172.21.15.37:0/767561606 learned_addr learned my addr 172.21.15.37:0/767561606 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:04:51.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:51.543+0000 7feec2ffd640 1 --2- 172.21.15.37:0/767561606 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feec4100e20 0x7feec40fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:51.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:51.543+0000 7feec37fe640 1 --2- 172.21.15.37:0/767561606 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feec4102ef0 0x7feec40fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:51.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:51.543+0000 7feeba7fc640 1 -- 172.21.15.37:0/767561606 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feec4102ef0 msgr2=0x7feec40fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:51.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:51.543+0000 7feeba7fc640 1 --2- 172.21.15.37:0/767561606 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feec4102ef0 0x7feec40fd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:51.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:51.543+0000 7feeba7fc640 1 -- 172.21.15.37:0/767561606 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feec4100e20 msgr2=0x7feec40fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:51.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:51.543+0000 7feeba7fc640 1 --2- 172.21.15.37:0/767561606 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feec4100e20 0x7feec40fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:51.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:51.543+0000 7feeba7fc640 1 -- 172.21.15.37:0/767561606 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feec41a69f0 con 0x7feec4102570 2024-09-19T06:04:51.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:51.543+0000 7feeba7fc640 1 --2- 172.21.15.37:0/767561606 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feec4102570 0x7feec40fd1c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7feeac00d950 tx=0x7feeac00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:51.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:51.543+0000 7feec0ff9640 1 -- 172.21.15.37:0/767561606 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeac017030 con 0x7feec4102570 2024-09-19T06:04:51.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:51.543+0000 7feec0ff9640 1 -- 172.21.15.37:0/767561606 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feeac004020 con 0x7feec4102570 2024-09-19T06:04:51.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:51.543+0000 7feec96b1640 1 -- 172.21.15.37:0/767561606 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feec41a6ce0 con 0x7feec4102570 2024-09-19T06:04:51.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:51.543+0000 7feec0ff9640 1 -- 172.21.15.37:0/767561606 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeac0047a0 con 0x7feec4102570 2024-09-19T06:04:51.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:51.543+0000 7feec96b1640 1 -- 172.21.15.37:0/767561606 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feec41a7210 con 0x7feec4102570 2024-09-19T06:04:51.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:51.544+0000 7feec96b1640 1 -- 172.21.15.37:0/767561606 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feec4101200 con 0x7feec4102570 2024-09-19T06:04:51.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:51.545+0000 7feec0ff9640 1 -- 172.21.15.37:0/767561606 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7feeac0041d0 con 0x7feec4102570 2024-09-19T06:04:51.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:51.546+0000 7feec0ff9640 1 --2- 172.21.15.37:0/767561606 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7feeb00a3350 0x7feeb00a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:51.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:51.546+0000 7feec0ff9640 1 -- 172.21.15.37:0/767561606 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7feeac0cfcf0 con 0x7feec4102570 2024-09-19T06:04:51.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:51.546+0000 7feec2ffd640 1 --2- 172.21.15.37:0/767561606 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7feeb00a3350 0x7feeb00a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:51.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:51.547+0000 7feec2ffd640 1 --2- 172.21.15.37:0/767561606 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7feeb00a3350 0x7feeb00a5810 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7feeb4009230 tx=0x7feeb40058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:51.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:51.549+0000 7feec0ff9640 1 -- 172.21.15.37:0/767561606 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7feeac09c6f0 con 0x7feec4102570 2024-09-19T06:04:51.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:51.756+0000 7feec96b1640 1 -- 172.21.15.37:0/767561606 --> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7feec4062630 con 0x7feeb00a3350 2024-09-19T06:04:51.758 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:51 smithi037 ceph-mon[31211]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:04:51.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:51.760+0000 7feec0ff9640 1 -- 172.21.15.37:0/767561606 <== mgr.14148 v2:172.21.15.37:6800/3797010169 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7feec4062630 con 0x7feeb00a3350 2024-09-19T06:04:51.762 INFO:teuthology.orchestra.run.smithi037.stdout:/volumes/qa/sv_1/d38e3a0f-a8c2-42d8-99c9-0f41a22bbbfc 2024-09-19T06:04:51.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:51.762+0000 7feec96b1640 1 -- 172.21.15.37:0/767561606 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7feeb00a3350 msgr2=0x7feeb00a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:51.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:51.762+0000 7feec96b1640 1 --2- 172.21.15.37:0/767561606 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7feeb00a3350 0x7feeb00a5810 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7feeb4009230 tx=0x7feeb40058d0 comp rx=0 tx=0).stop 2024-09-19T06:04:51.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:51.762+0000 7feec96b1640 1 -- 172.21.15.37:0/767561606 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feec4102570 msgr2=0x7feec40fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:51.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:51.762+0000 7feec96b1640 1 --2- 172.21.15.37:0/767561606 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feec4102570 0x7feec40fd1c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7feeac00d950 tx=0x7feeac00de10 comp rx=0 tx=0).stop 2024-09-19T06:04:51.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:51.762+0000 7feec96b1640 1 -- 172.21.15.37:0/767561606 shutdown_connections 2024-09-19T06:04:51.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:51.762+0000 7feec96b1640 1 --2- 172.21.15.37:0/767561606 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7feeb00a3350 0x7feeb00a5810 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:51.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:51.762+0000 7feec96b1640 1 --2- 172.21.15.37:0/767561606 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feec4102ef0 0x7feec40fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:51.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:51.762+0000 7feec96b1640 1 --2- 172.21.15.37:0/767561606 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feec4102570 0x7feec40fd1c0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:51.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:51.762+0000 7feec96b1640 1 --2- 172.21.15.37:0/767561606 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feec4100e20 0x7feec40fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:51.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:51.762+0000 7feec96b1640 1 -- 172.21.15.37:0/767561606 >> 172.21.15.37:0/767561606 conn(0x7feec40fc7d0 msgr2=0x7feec406a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:51.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:51.762+0000 7feec96b1640 1 -- 172.21.15.37:0/767561606 shutdown_connections 2024-09-19T06:04:51.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:51.762+0000 7feec96b1640 1 -- 172.21.15.37:0/767561606 wait complete. 2024-09-19T06:04:51.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:51 smithi099 ceph-mon[35300]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:04:52.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:51 smithi117 ceph-mon[35050]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:04:52.429 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:04:52.689 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:04:52.810 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:52 smithi037 ceph-mon[31211]: pgmap v306: 129 pgs: 129 active+clean; 601 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-09-19T06:04:52.901 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:52 smithi117 ceph-mon[35050]: pgmap v306: 129 pgs: 129 active+clean; 601 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-09-19T06:04:52.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:52 smithi099 ceph-mon[35300]: pgmap v306: 129 pgs: 129 active+clean; 601 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-09-19T06:04:53.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:53.157+0000 7f55a14e2640 1 -- 172.21.15.37:0/344458826 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f559c102da0 msgr2=0x7f559c103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:53.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:53.157+0000 7f55a14e2640 1 --2- 172.21.15.37:0/344458826 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f559c102da0 0x7f559c103180 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f558c009900 tx=0x7f558c02a480 comp rx=0 tx=0).stop 2024-09-19T06:04:53.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:53.157+0000 7f55a14e2640 1 -- 172.21.15.37:0/344458826 shutdown_connections 2024-09-19T06:04:53.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:53.157+0000 7f55a14e2640 1 --2- 172.21.15.37:0/344458826 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f559c1036c0 0x7f559c10bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:53.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:53.157+0000 7f55a14e2640 1 --2- 172.21.15.37:0/344458826 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f559c10c180 0x7f559c10e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:53.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:53.157+0000 7f55a14e2640 1 --2- 172.21.15.37:0/344458826 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f559c102da0 0x7f559c103180 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:53.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:53.157+0000 7f55a14e2640 1 -- 172.21.15.37:0/344458826 >> 172.21.15.37:0/344458826 conn(0x7f559c0fc7a0 msgr2=0x7f559c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:53.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:53.157+0000 7f55a14e2640 1 -- 172.21.15.37:0/344458826 shutdown_connections 2024-09-19T06:04:53.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:53.157+0000 7f55a14e2640 1 -- 172.21.15.37:0/344458826 wait complete. 2024-09-19T06:04:53.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:53.157+0000 7f55a14e2640 1 Processor -- start 2024-09-19T06:04:53.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:53.158+0000 7f55a14e2640 1 -- start start 2024-09-19T06:04:53.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:53.158+0000 7f55a14e2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f559c102da0 0x7f559c198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:53.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:53.158+0000 7f55a14e2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f559c1036c0 0x7f559c198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:53.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:53.158+0000 7f55a14e2640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f559c10c180 0x7f559c19ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:53.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:53.158+0000 7f55a14e2640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f559c111f60 con 0x7f559c1036c0 2024-09-19T06:04:53.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:53.158+0000 7f55a14e2640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f559c111de0 con 0x7f559c10c180 2024-09-19T06:04:53.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:53.158+0000 7f55a14e2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f559c1120e0 con 0x7f559c102da0 2024-09-19T06:04:53.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:53.158+0000 7f559a7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f559c1036c0 0x7f559c198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:53.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:53.158+0000 7f559a7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f559c1036c0 0x7f559c198960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37694/0 (socket says 172.21.15.37:37694) 2024-09-19T06:04:53.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:53.158+0000 7f559a7fc640 1 -- 172.21.15.37:0/720167136 learned_addr learned my addr 172.21.15.37:0/720167136 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:04:53.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:53.158+0000 7f559b7fe640 1 --2- 172.21.15.37:0/720167136 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f559c10c180 0x7f559c19ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:53.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:53.158+0000 7f559affd640 1 --2- 172.21.15.37:0/720167136 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f559c102da0 0x7f559c198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:53.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:53.158+0000 7f559a7fc640 1 -- 172.21.15.37:0/720167136 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f559c102da0 msgr2=0x7f559c198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:53.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:53.158+0000 7f559a7fc640 1 --2- 172.21.15.37:0/720167136 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f559c102da0 0x7f559c198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:53.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:53.158+0000 7f559a7fc640 1 -- 172.21.15.37:0/720167136 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f559c10c180 msgr2=0x7f559c19ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:53.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:53.158+0000 7f559a7fc640 1 --2- 172.21.15.37:0/720167136 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f559c10c180 0x7f559c19ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:53.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:53.158+0000 7f559a7fc640 1 -- 172.21.15.37:0/720167136 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f559c19d3d0 con 0x7f559c1036c0 2024-09-19T06:04:53.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:53.158+0000 7f559a7fc640 1 --2- 172.21.15.37:0/720167136 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f559c1036c0 0x7f559c198960 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f559000c890 tx=0x7f559000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:53.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:53.159+0000 7f5583fff640 1 -- 172.21.15.37:0/720167136 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5590004220 con 0x7f559c1036c0 2024-09-19T06:04:53.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:53.159+0000 7f5583fff640 1 -- 172.21.15.37:0/720167136 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f55900043c0 con 0x7f559c1036c0 2024-09-19T06:04:53.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:53.159+0000 7f5583fff640 1 -- 172.21.15.37:0/720167136 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55900049e0 con 0x7f559c1036c0 2024-09-19T06:04:53.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:53.159+0000 7f55a14e2640 1 -- 172.21.15.37:0/720167136 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f559c19d6c0 con 0x7f559c1036c0 2024-09-19T06:04:53.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:53.159+0000 7f55a14e2640 1 -- 172.21.15.37:0/720167136 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f559c1a4fa0 con 0x7f559c1036c0 2024-09-19T06:04:53.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:53.160+0000 7f55a14e2640 1 -- 172.21.15.37:0/720167136 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f559c103180 con 0x7f559c1036c0 2024-09-19T06:04:53.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:53.161+0000 7f5583fff640 1 -- 172.21.15.37:0/720167136 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f55900079b0 con 0x7f559c1036c0 2024-09-19T06:04:53.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:53.162+0000 7f5583fff640 1 --2- 172.21.15.37:0/720167136 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f55840a3350 0x7f55840a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:53.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:53.162+0000 7f559affd640 1 --2- 172.21.15.37:0/720167136 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f55840a3350 0x7f55840a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:53.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:53.162+0000 7f5583fff640 1 -- 172.21.15.37:0/720167136 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f55900cfd00 con 0x7f559c1036c0 2024-09-19T06:04:53.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:53.162+0000 7f559affd640 1 --2- 172.21.15.37:0/720167136 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f55840a3350 0x7f55840a5810 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f558c005ab0 tx=0x7f558c005a20 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:53.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:53.166+0000 7f5583fff640 1 -- 172.21.15.37:0/720167136 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5590014030 con 0x7f559c1036c0 2024-09-19T06:04:53.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:53.377+0000 7f55a14e2640 1 -- 172.21.15.37:0/720167136 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f559c1a52d0 con 0x7f559c1036c0 2024-09-19T06:04:53.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:53.378+0000 7f5583fff640 1 -- 172.21.15.37:0/720167136 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11842 (secure 0 0 0) 0x7f559009c680 con 0x7f559c1036c0 2024-09-19T06:04:53.380 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T06:04:53.380 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"btime":"2024-09-19T06:04:42:531480+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14514,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2864247978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2864247978},{"type":"v1","addr":"172.21.15.37:6835","nonce":2864247978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14526,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/633000932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":633000932},{"type":"v1","addr":"172.21.15.37:6837","nonce":633000932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14574,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/3753800615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":3753800615},{"type":"v1","addr":"172.21.15.37:6839","nonce":3753800615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/2718998355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":2718998355},{"type":"v1","addr":"172.21.15.37:6841","nonce":2718998355}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6833/866590207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":866590207},{"type":"v1","addr":"172.21.15.99:6833","nonce":866590207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3898668400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3898668400},{"type":"v1","addr":"172.21.15.117:6833","nonce":3898668400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2650673320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2650673320},{"type":"v1","addr":"172.21.15.99:6835","nonce":2650673320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1097471349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1097471349},{"type":"v1","addr":"172.21.15.117:6835","nonce":1097471349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24457,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1001392672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1001392672},{"type":"v1","addr":"172.21.15.117:6837","nonce":1001392672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/23570935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":23570935},{"type":"v1","addr":"172.21.15.99:6837","nonce":23570935}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:04:06.253034+0000","modified":"2024-09-19T06:04:42.196783+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24485},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24478":{"gid":24478,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6839/1269518339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":1269518339},{"type":"v1","addr":"172.21.15.117:6839","nonce":1269518339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.99:6839/3404812329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":3404812329},{"type":"v1","addr":"172.21.15.99:6839","nonce":3404812329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24485,"qdb_cluster":[24485]},"id":1}]} 2024-09-19T06:04:53.381 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 20 2024-09-19T06:04:53.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:53.380+0000 7f55a14e2640 1 -- 172.21.15.37:0/720167136 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f55840a3350 msgr2=0x7f55840a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:53.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:53.380+0000 7f55a14e2640 1 --2- 172.21.15.37:0/720167136 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f55840a3350 0x7f55840a5810 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f558c005ab0 tx=0x7f558c005a20 comp rx=0 tx=0).stop 2024-09-19T06:04:53.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:53.380+0000 7f55a14e2640 1 -- 172.21.15.37:0/720167136 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f559c1036c0 msgr2=0x7f559c198960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:53.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:53.380+0000 7f55a14e2640 1 --2- 172.21.15.37:0/720167136 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f559c1036c0 0x7f559c198960 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f559000c890 tx=0x7f559000cd50 comp rx=0 tx=0).stop 2024-09-19T06:04:53.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:53.380+0000 7f55a14e2640 1 -- 172.21.15.37:0/720167136 shutdown_connections 2024-09-19T06:04:53.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:53.380+0000 7f55a14e2640 1 --2- 172.21.15.37:0/720167136 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f55840a3350 0x7f55840a5810 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:53.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:53.380+0000 7f55a14e2640 1 --2- 172.21.15.37:0/720167136 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f559c10c180 0x7f559c19ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:53.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:53.380+0000 7f55a14e2640 1 --2- 172.21.15.37:0/720167136 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f559c1036c0 0x7f559c198960 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:53.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:53.380+0000 7f55a14e2640 1 --2- 172.21.15.37:0/720167136 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f559c102da0 0x7f559c198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:53.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:53.380+0000 7f55a14e2640 1 -- 172.21.15.37:0/720167136 >> 172.21.15.37:0/720167136 conn(0x7f559c0fc7a0 msgr2=0x7f559c0fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:53.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:53.381+0000 7f55a14e2640 1 -- 172.21.15.37:0/720167136 shutdown_connections 2024-09-19T06:04:53.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:53.381+0000 7f55a14e2640 1 -- 172.21.15.37:0/720167136 wait complete. 2024-09-19T06:04:53.698 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:53 smithi037 ceph-mon[31211]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:04:53.698 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:53 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/720167136' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:04:53.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:53 smithi099 ceph-mon[35300]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:04:53.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:53 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/720167136' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:04:54.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:53 smithi117 ceph-mon[35050]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:04:54.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:53 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/720167136' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:04:54.071 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T06:04:54.327 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:04:54.698 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:54 smithi037 ceph-mon[31211]: pgmap v307: 129 pgs: 129 active+clean; 601 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-09-19T06:04:54.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:54.775+0000 7fd1947c5640 1 -- 172.21.15.37:0/2976701060 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd18c102ef0 msgr2=0x7fd18c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:54.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:54.775+0000 7fd1947c5640 1 --2- 172.21.15.37:0/2976701060 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd18c102ef0 0x7fd18c10da40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd184009ca0 tx=0x7fd18402a950 comp rx=0 tx=0).stop 2024-09-19T06:04:54.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:54.775+0000 7fd1947c5640 1 -- 172.21.15.37:0/2976701060 shutdown_connections 2024-09-19T06:04:54.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:54.775+0000 7fd1947c5640 1 --2- 172.21.15.37:0/2976701060 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd18c102570 0x7fd18c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:54.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:54.775+0000 7fd1947c5640 1 --2- 172.21.15.37:0/2976701060 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd18c102ef0 0x7fd18c10da40 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:54.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:54.775+0000 7fd1947c5640 1 --2- 172.21.15.37:0/2976701060 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd18c100e20 0x7fd18c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:54.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:54.775+0000 7fd1947c5640 1 -- 172.21.15.37:0/2976701060 >> 172.21.15.37:0/2976701060 conn(0x7fd18c0fc7d0 msgr2=0x7fd18c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:54.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:54.775+0000 7fd1947c5640 1 -- 172.21.15.37:0/2976701060 shutdown_connections 2024-09-19T06:04:54.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:54.775+0000 7fd1947c5640 1 -- 172.21.15.37:0/2976701060 wait complete. 2024-09-19T06:04:54.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:54.775+0000 7fd1947c5640 1 Processor -- start 2024-09-19T06:04:54.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:54.776+0000 7fd1947c5640 1 -- start start 2024-09-19T06:04:54.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:54.776+0000 7fd1947c5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd18c100e20 0x7fd18c0fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:54.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:54.776+0000 7fd1947c5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd18c102570 0x7fd18c0fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:54.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:54.776+0000 7fd1947c5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd18c102ef0 0x7fd18c0fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:54.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:54.776+0000 7fd1947c5640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd18c110fa0 con 0x7fd18c100e20 2024-09-19T06:04:54.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:54.776+0000 7fd1947c5640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fd18c110e20 con 0x7fd18c102ef0 2024-09-19T06:04:54.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:54.776+0000 7fd1947c5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd18c111120 con 0x7fd18c102570 2024-09-19T06:04:54.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:54.776+0000 7fd192561640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd18c100e20 0x7fd18c0fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:54.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:54.776+0000 7fd192561640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd18c100e20 0x7fd18c0fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50152/0 (socket says 172.21.15.37:50152) 2024-09-19T06:04:54.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:54.776+0000 7fd192561640 1 -- 172.21.15.37:0/4168528677 learned_addr learned my addr 172.21.15.37:0/4168528677 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:04:54.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:54.776+0000 7fd191d60640 1 --2- 172.21.15.37:0/4168528677 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd18c102570 0x7fd18c0fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:54.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:54.776+0000 7fd192d62640 1 --2- 172.21.15.37:0/4168528677 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd18c102ef0 0x7fd18c0fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:54.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:54.776+0000 7fd192561640 1 -- 172.21.15.37:0/4168528677 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd18c102570 msgr2=0x7fd18c0fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:54.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:54.776+0000 7fd192561640 1 --2- 172.21.15.37:0/4168528677 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd18c102570 0x7fd18c0fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:54.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:54.776+0000 7fd192561640 1 -- 172.21.15.37:0/4168528677 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd18c102ef0 msgr2=0x7fd18c0fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:54.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:54.776+0000 7fd192561640 1 --2- 172.21.15.37:0/4168528677 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd18c102ef0 0x7fd18c0fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:54.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:54.776+0000 7fd192561640 1 -- 172.21.15.37:0/4168528677 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd18c1a69a0 con 0x7fd18c100e20 2024-09-19T06:04:54.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:54.776+0000 7fd192561640 1 --2- 172.21.15.37:0/4168528677 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd18c100e20 0x7fd18c0fcc80 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd18800b4a0 tx=0x7fd18800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:54.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:54.777+0000 7fd1837fe640 1 -- 172.21.15.37:0/4168528677 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd188014070 con 0x7fd18c100e20 2024-09-19T06:04:54.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:54.777+0000 7fd1837fe640 1 -- 172.21.15.37:0/4168528677 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd188010af0 con 0x7fd18c100e20 2024-09-19T06:04:54.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:54.777+0000 7fd1947c5640 1 -- 172.21.15.37:0/4168528677 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd18c1a6c90 con 0x7fd18c100e20 2024-09-19T06:04:54.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:54.777+0000 7fd1837fe640 1 -- 172.21.15.37:0/4168528677 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd188017d10 con 0x7fd18c100e20 2024-09-19T06:04:54.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:54.777+0000 7fd1947c5640 1 -- 172.21.15.37:0/4168528677 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd18c1a71c0 con 0x7fd18c100e20 2024-09-19T06:04:54.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:54.778+0000 7fd1947c5640 1 -- 172.21.15.37:0/4168528677 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd18c101200 con 0x7fd18c100e20 2024-09-19T06:04:54.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:54.779+0000 7fd1837fe640 1 -- 172.21.15.37:0/4168528677 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fd188017070 con 0x7fd18c100e20 2024-09-19T06:04:54.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:54.779+0000 7fd1837fe640 1 --2- 172.21.15.37:0/4168528677 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fd1780a3350 0x7fd1780a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:54.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:54.780+0000 7fd191d60640 1 --2- 172.21.15.37:0/4168528677 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fd1780a3350 0x7fd1780a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:54.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:54.780+0000 7fd1837fe640 1 -- 172.21.15.37:0/4168528677 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7fd1880ceec0 con 0x7fd18c100e20 2024-09-19T06:04:54.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:54.780+0000 7fd191d60640 1 --2- 172.21.15.37:0/4168528677 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fd1780a3350 0x7fd1780a5810 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd18c0fe710 tx=0x7fd17c00a2d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:54.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:54.784+0000 7fd1837fe640 1 -- 172.21.15.37:0/4168528677 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd18809b950 con 0x7fd18c100e20 2024-09-19T06:04:54.840 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:54 smithi099 ceph-mon[35300]: pgmap v307: 129 pgs: 129 active+clean; 601 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-09-19T06:04:54.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:54.959+0000 7fd1947c5640 1 -- 172.21.15.37:0/4168528677 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd18c0fe1b0 con 0x7fd18c100e20 2024-09-19T06:04:54.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:54.961+0000 7fd1837fe640 1 -- 172.21.15.37:0/4168528677 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+24200 (secure 0 0 0) 0x7fd18c0fe1b0 con 0x7fd18c100e20 2024-09-19T06:04:54.963 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T06:04:54.963 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":87,"fsid":"b8c8bdae-764b-11ef-bceb-c7b262605968","created":"2024-09-19T05:56:22.523060+0000","modified":"2024-09-19T06:04:15.206008+0000","last_up_change":"2024-09-19T06:03:12.771014+0000","last_in_change":"2024-09-19T06:02:49.926626+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:59:27.062607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:04:01.918234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:04:04.392543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T06:04:10.877951+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"455bc11d-2b6e-4a0c-90d9-8ab4ef4f9e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1783875173},{"type":"v1","addr":"172.21.15.37:6803","nonce":1783875173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1783875173},{"type":"v1","addr":"172.21.15.37:6805","nonce":1783875173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1783875173},{"type":"v1","addr":"172.21.15.37:6809","nonce":1783875173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1783875173},{"type":"v1","addr":"172.21.15.37:6807","nonce":1783875173}]},"public_addr":"172.21.15.37:6803/1783875173","cluster_addr":"172.21.15.37:6805/1783875173","heartbeat_back_addr":"172.21.15.37:6809/1783875173","heartbeat_front_addr":"172.21.15.37:6807/1783875173","state":["exists","up"]},{"osd":1,"uuid":"3505c162-c342-479d-8ea2-15b7a9d625cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":3414373360},{"type":"v1","addr":"172.21.15.99:6801","nonce":3414373360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":3414373360},{"type":"v1","addr":"172.21.15.99:6803","nonce":3414373360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":3414373360},{"type":"v1","addr":"172.21.15.99:6807","nonce":3414373360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":3414373360},{"type":"v1","addr":"172.21.15.99:6805","nonce":3414373360}]},"public_addr":"172.21.15.99:6801/3414373360","cluster_addr":"172.21.15.99:6803/3414373360","heartbeat_back_addr":"172.21.15.99:6807/3414373360","heartbeat_front_addr":"172.21.15.99:6805/3414373360","state":["exists","up"]},{"osd":2,"uuid":"736ec67f-b5e7-43f0-9303-0c88878ead6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3794943081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3794943081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3794943081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3794943081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3794943081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3794943081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3794943081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3794943081}]},"public_addr":"172.21.15.117:6801/3794943081","cluster_addr":"172.21.15.117:6803/3794943081","heartbeat_back_addr":"172.21.15.117:6807/3794943081","heartbeat_front_addr":"172.21.15.117:6805/3794943081","state":["exists","up"]},{"osd":3,"uuid":"3f784ef7-0cc1-4c86-a03a-b8f13396c835","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2121011955},{"type":"v1","addr":"172.21.15.37:6811","nonce":2121011955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2121011955},{"type":"v1","addr":"172.21.15.37:6813","nonce":2121011955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2121011955},{"type":"v1","addr":"172.21.15.37:6817","nonce":2121011955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2121011955},{"type":"v1","addr":"172.21.15.37:6815","nonce":2121011955}]},"public_addr":"172.21.15.37:6811/2121011955","cluster_addr":"172.21.15.37:6813/2121011955","heartbeat_back_addr":"172.21.15.37:6817/2121011955","heartbeat_front_addr":"172.21.15.37:6815/2121011955","state":["exists","up"]},{"osd":4,"uuid":"d7c16e7f-f599-419b-b4a2-fd6c1cafa0d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":1881025735},{"type":"v1","addr":"172.21.15.99:6809","nonce":1881025735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1881025735},{"type":"v1","addr":"172.21.15.99:6811","nonce":1881025735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1881025735},{"type":"v1","addr":"172.21.15.99:6815","nonce":1881025735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":1881025735},{"type":"v1","addr":"172.21.15.99:6813","nonce":1881025735}]},"public_addr":"172.21.15.99:6809/1881025735","cluster_addr":"172.21.15.99:6811/1881025735","heartbeat_back_addr":"172.21.15.99:6815/1881025735","heartbeat_front_addr":"172.21.15.99:6813/1881025735","state":["exists","up"]},{"osd":5,"uuid":"2f499ab4-3d09-4f96-a709-b4229865c690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1141976511},{"type":"v1","addr":"172.21.15.117:6809","nonce":1141976511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1141976511},{"type":"v1","addr":"172.21.15.117:6811","nonce":1141976511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1141976511},{"type":"v1","addr":"172.21.15.117:6815","nonce":1141976511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1141976511},{"type":"v1","addr":"172.21.15.117:6813","nonce":1141976511}]},"public_addr":"172.21.15.117:6809/1141976511","cluster_addr":"172.21.15.117:6811/1141976511","heartbeat_back_addr":"172.21.15.117:6815/1141976511","heartbeat_front_addr":"172.21.15.117:6813/1141976511","state":["exists","up"]},{"osd":6,"uuid":"10f7fd72-1ae8-4efd-a448-75f4b5054be3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":770433145},{"type":"v1","addr":"172.21.15.37:6819","nonce":770433145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":770433145},{"type":"v1","addr":"172.21.15.37:6821","nonce":770433145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":770433145},{"type":"v1","addr":"172.21.15.37:6825","nonce":770433145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":770433145},{"type":"v1","addr":"172.21.15.37:6823","nonce":770433145}]},"public_addr":"172.21.15.37:6819/770433145","cluster_addr":"172.21.15.37:6821/770433145","heartbeat_back_addr":"172.21.15.37:6825/770433145","heartbeat_front_addr":"172.21.15.37:6823/770433145","state":["exists","up"]},{"osd":7,"uuid":"7199a267-c486-417c-b530-3ff03fc9eb1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1694360992},{"type":"v1","addr":"172.21.15.99:6817","nonce":1694360992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1694360992},{"type":"v1","addr":"172.21.15.99:6819","nonce":1694360992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":1694360992},{"type":"v1","addr":"172.21.15.99:6823","nonce":1694360992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":1694360992},{"type":"v1","addr":"172.21.15.99:6821","nonce":1694360992}]},"public_addr":"172.21.15.99:6817/1694360992","cluster_addr":"172.21.15.99:6819/1694360992","heartbeat_back_addr":"172.21.15.99:6823/1694360992","heartbeat_front_addr":"172.21.15.99:6821/1694360992","state":["exists","up"]},{"osd":8,"uuid":"8d5bb83c-62eb-4ded-8a16-e8d57ab102c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2005866772},{"type":"v1","addr":"172.21.15.117:6817","nonce":2005866772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2005866772},{"type":"v1","addr":"172.21.15.117:6819","nonce":2005866772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2005866772},{"type":"v1","addr":"172.21.15.117:6823","nonce":2005866772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2005866772},{"type":"v1","addr":"172.21.15.117:6821","nonce":2005866772}]},"public_addr":"172.21.15.117:6817/2005866772","cluster_addr":"172.21.15.117:6819/2005866772","heartbeat_back_addr":"172.21.15.117:6823/2005866772","heartbeat_front_addr":"172.21.15.117:6821/2005866772","state":["exists","up"]},{"osd":9,"uuid":"04b6203d-a10c-4a55-8e59-b30012dee02b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1398779376},{"type":"v1","addr":"172.21.15.37:6827","nonce":1398779376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1398779376},{"type":"v1","addr":"172.21.15.37:6829","nonce":1398779376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1398779376},{"type":"v1","addr":"172.21.15.37:6833","nonce":1398779376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1398779376},{"type":"v1","addr":"172.21.15.37:6831","nonce":1398779376}]},"public_addr":"172.21.15.37:6827/1398779376","cluster_addr":"172.21.15.37:6829/1398779376","heartbeat_back_addr":"172.21.15.37:6833/1398779376","heartbeat_front_addr":"172.21.15.37:6831/1398779376","state":["exists","up"]},{"osd":10,"uuid":"bbf8ff4b-29cd-4d56-a30e-ff2de3555f78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2200957302},{"type":"v1","addr":"172.21.15.99:6825","nonce":2200957302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2200957302},{"type":"v1","addr":"172.21.15.99:6827","nonce":2200957302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2200957302},{"type":"v1","addr":"172.21.15.99:6831","nonce":2200957302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2200957302},{"type":"v1","addr":"172.21.15.99:6829","nonce":2200957302}]},"public_addr":"172.21.15.99:6825/2200957302","cluster_addr":"172.21.15.99:6827/2200957302","heartbeat_back_addr":"172.21.15.99:6831/2200957302","heartbeat_front_addr":"172.21.15.99:6829/2200957302","state":["exists","up"]},{"osd":11,"uuid":"041d54f4-a274-47b5-a467-0ce86efd363b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":1354423136},{"type":"v1","addr":"172.21.15.117:6825","nonce":1354423136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":1354423136},{"type":"v1","addr":"172.21.15.117:6827","nonce":1354423136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":1354423136},{"type":"v1","addr":"172.21.15.117:6831","nonce":1354423136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":1354423136},{"type":"v1","addr":"172.21.15.117:6829","nonce":1354423136}]},"public_addr":"172.21.15.117:6825/1354423136","cluster_addr":"172.21.15.117:6827/1354423136","heartbeat_back_addr":"172.21.15.117:6831/1354423136","heartbeat_front_addr":"172.21.15.117:6829/1354423136","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:58:33.697099+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:58:59.641549+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:59:23.811178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:59:49.550214+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:00:15.034610+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:00:39.399651+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:01:05.106379+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:01:30.375956+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:01:54.881549+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:02:21.519316+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:02:46.125918+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:03:11.310862+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6801/133577710":"2024-09-20T05:57:12.560771+0000","172.21.15.37:6800/133577710":"2024-09-20T05:57:12.560771+0000","172.21.15.37:0/2877363162":"2024-09-20T05:57:12.560771+0000","172.21.15.37:0/1053171617":"2024-09-20T05:57:12.560771+0000","172.21.15.37:6800/3277805697":"2024-09-20T05:56:49.335334+0000","172.21.15.37:0/1280697705":"2024-09-20T05:56:49.335334+0000","172.21.15.37:0/1106526058":"2024-09-20T05:57:12.560771+0000","172.21.15.37:0/1978184693":"2024-09-20T05:56:49.335334+0000","172.21.15.37:6801/3277805697":"2024-09-20T05:56:49.335334+0000","172.21.15.37:0/3650338877":"2024-09-20T05:56:49.335334+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:04:54.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:54.963+0000 7fd1947c5640 1 -- 172.21.15.37:0/4168528677 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fd1780a3350 msgr2=0x7fd1780a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:54.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:54.963+0000 7fd1947c5640 1 --2- 172.21.15.37:0/4168528677 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fd1780a3350 0x7fd1780a5810 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd18c0fe710 tx=0x7fd17c00a2d0 comp rx=0 tx=0).stop 2024-09-19T06:04:54.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:54.963+0000 7fd1947c5640 1 -- 172.21.15.37:0/4168528677 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd18c100e20 msgr2=0x7fd18c0fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:54.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:54.963+0000 7fd1947c5640 1 --2- 172.21.15.37:0/4168528677 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd18c100e20 0x7fd18c0fcc80 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd18800b4a0 tx=0x7fd18800b960 comp rx=0 tx=0).stop 2024-09-19T06:04:54.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:54.963+0000 7fd1947c5640 1 -- 172.21.15.37:0/4168528677 shutdown_connections 2024-09-19T06:04:54.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:54.963+0000 7fd1947c5640 1 --2- 172.21.15.37:0/4168528677 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fd1780a3350 0x7fd1780a5810 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:54.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:54.963+0000 7fd1947c5640 1 --2- 172.21.15.37:0/4168528677 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd18c102ef0 0x7fd18c0fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:54.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:54.963+0000 7fd1947c5640 1 --2- 172.21.15.37:0/4168528677 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd18c102570 0x7fd18c0fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:54.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:54.963+0000 7fd1947c5640 1 --2- 172.21.15.37:0/4168528677 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd18c100e20 0x7fd18c0fcc80 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:54.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:54.963+0000 7fd1947c5640 1 -- 172.21.15.37:0/4168528677 >> 172.21.15.37:0/4168528677 conn(0x7fd18c0fc7d0 msgr2=0x7fd18c06a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:54.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:54.963+0000 7fd1947c5640 1 -- 172.21.15.37:0/4168528677 shutdown_connections 2024-09-19T06:04:54.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:54.963+0000 7fd1947c5640 1 -- 172.21.15.37:0/4168528677 wait complete. 2024-09-19T06:04:54.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:54 smithi117 ceph-mon[35050]: pgmap v307: 129 pgs: 129 active+clean; 601 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-09-19T06:04:55.649 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T06:04:55.649 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T06:04:55.845 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:55 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/4168528677' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:04:55.908 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:04:55.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:55 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/4168528677' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:04:56.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:55 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/4168528677' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:04:56.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:56.421+0000 7fb568a15640 1 -- 172.21.15.37:0/1751716695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5641036c0 msgr2=0x7fb56410bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:56.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:56.421+0000 7fb568a15640 1 --2- 172.21.15.37:0/1751716695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5641036c0 0x7fb56410bbb0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb558009900 tx=0x7fb55802a480 comp rx=0 tx=0).stop 2024-09-19T06:04:56.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:56.421+0000 7fb568a15640 1 -- 172.21.15.37:0/1751716695 shutdown_connections 2024-09-19T06:04:56.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:56.421+0000 7fb568a15640 1 --2- 172.21.15.37:0/1751716695 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb56410c180 0x7fb56410e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:56.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:56.421+0000 7fb568a15640 1 --2- 172.21.15.37:0/1751716695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5641036c0 0x7fb56410bbb0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:56.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:56.421+0000 7fb568a15640 1 --2- 172.21.15.37:0/1751716695 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb564102da0 0x7fb564103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:56.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:56.421+0000 7fb568a15640 1 -- 172.21.15.37:0/1751716695 >> 172.21.15.37:0/1751716695 conn(0x7fb5640fc7a0 msgr2=0x7fb5640febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:56.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:56.421+0000 7fb568a15640 1 -- 172.21.15.37:0/1751716695 shutdown_connections 2024-09-19T06:04:56.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:56.421+0000 7fb568a15640 1 -- 172.21.15.37:0/1751716695 wait complete. 2024-09-19T06:04:56.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:56.422+0000 7fb568a15640 1 Processor -- start 2024-09-19T06:04:56.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:56.422+0000 7fb568a15640 1 -- start start 2024-09-19T06:04:56.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:56.422+0000 7fb568a15640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb564102da0 0x7fb564100a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:56.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:56.422+0000 7fb568a15640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5641036c0 0x7fb564100f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:56.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:56.422+0000 7fb568a15640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb56410c180 0x7fb564101480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:56.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:56.422+0000 7fb568a15640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb564111f60 con 0x7fb56410c180 2024-09-19T06:04:56.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:56.422+0000 7fb568a15640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb564111de0 con 0x7fb5641036c0 2024-09-19T06:04:56.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:56.422+0000 7fb568a15640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb5641120e0 con 0x7fb564102da0 2024-09-19T06:04:56.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:56.422+0000 7fb562d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb56410c180 0x7fb564101480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:56.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:56.422+0000 7fb56259c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb564102da0 0x7fb564100a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:56.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:56.422+0000 7fb56259c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb564102da0 0x7fb564100a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.37:34138/0 (socket says 172.21.15.37:34138) 2024-09-19T06:04:56.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:56.422+0000 7fb562d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb56410c180 0x7fb564101480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50172/0 (socket says 172.21.15.37:50172) 2024-09-19T06:04:56.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:56.422+0000 7fb562d9d640 1 -- 172.21.15.37:0/828529088 learned_addr learned my addr 172.21.15.37:0/828529088 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:04:56.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:56.422+0000 7fb561d9b640 1 --2- 172.21.15.37:0/828529088 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5641036c0 0x7fb564100f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:56.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:56.422+0000 7fb562d9d640 1 -- 172.21.15.37:0/828529088 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb564102da0 msgr2=0x7fb564100a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:56.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:56.422+0000 7fb562d9d640 1 --2- 172.21.15.37:0/828529088 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb564102da0 0x7fb564100a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:56.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:56.422+0000 7fb562d9d640 1 -- 172.21.15.37:0/828529088 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5641036c0 msgr2=0x7fb564100f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:56.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:56.422+0000 7fb562d9d640 1 --2- 172.21.15.37:0/828529088 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5641036c0 0x7fb564100f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:56.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:56.422+0000 7fb562d9d640 1 -- 172.21.15.37:0/828529088 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5641a68f0 con 0x7fb56410c180 2024-09-19T06:04:56.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:56.422+0000 7fb56259c640 1 --2- 172.21.15.37:0/828529088 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb564102da0 0x7fb564100a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:04:56.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:56.422+0000 7fb561d9b640 1 --2- 172.21.15.37:0/828529088 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5641036c0 0x7fb564100f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:04:56.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:56.423+0000 7fb562d9d640 1 --2- 172.21.15.37:0/828529088 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb56410c180 0x7fb564101480 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb55c00eb10 tx=0x7fb55c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:56.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:56.423+0000 7fb5537fe640 1 -- 172.21.15.37:0/828529088 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb55c004b20 con 0x7fb56410c180 2024-09-19T06:04:56.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:56.423+0000 7fb5537fe640 1 -- 172.21.15.37:0/828529088 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb55c004cc0 con 0x7fb56410c180 2024-09-19T06:04:56.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:56.423+0000 7fb568a15640 1 -- 172.21.15.37:0/828529088 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5641a6be0 con 0x7fb56410c180 2024-09-19T06:04:56.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:56.423+0000 7fb5537fe640 1 -- 172.21.15.37:0/828529088 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb55c010760 con 0x7fb56410c180 2024-09-19T06:04:56.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:56.423+0000 7fb568a15640 1 -- 172.21.15.37:0/828529088 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5641a70a0 con 0x7fb56410c180 2024-09-19T06:04:56.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:56.424+0000 7fb568a15640 1 -- 172.21.15.37:0/828529088 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb564103180 con 0x7fb56410c180 2024-09-19T06:04:56.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:56.425+0000 7fb5537fe640 1 -- 172.21.15.37:0/828529088 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fb55c005020 con 0x7fb56410c180 2024-09-19T06:04:56.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:56.426+0000 7fb5537fe640 1 --2- 172.21.15.37:0/828529088 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fb54c0a32d0 0x7fb54c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:56.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:56.426+0000 7fb56259c640 1 --2- 172.21.15.37:0/828529088 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fb54c0a32d0 0x7fb54c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:56.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:56.426+0000 7fb5537fe640 1 -- 172.21.15.37:0/828529088 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7fb55c0d01d0 con 0x7fb56410c180 2024-09-19T06:04:56.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:56.426+0000 7fb56259c640 1 --2- 172.21.15.37:0/828529088 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fb54c0a32d0 0x7fb54c0a5790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb554005fd0 tx=0x7fb55400b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:56.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:56.430+0000 7fb5537fe640 1 -- 172.21.15.37:0/828529088 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb55c09cb50 con 0x7fb56410c180 2024-09-19T06:04:56.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:56.605+0000 7fb568a15640 1 -- 172.21.15.37:0/828529088 --> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb564062630 con 0x7fb54c0a32d0 2024-09-19T06:04:56.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:56.614+0000 7fb5537fe640 1 -- 172.21.15.37:0/828529088 <== mgr.14148 v2:172.21.15.37:6800/3797010169 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340255 (secure 0 0 0) 0x7fb564062630 con 0x7fb54c0a32d0 2024-09-19T06:04:56.620 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T06:04:56.622 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-19T06:04:56.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:56.617+0000 7fb568a15640 1 -- 172.21.15.37:0/828529088 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fb54c0a32d0 msgr2=0x7fb54c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:56.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:56.617+0000 7fb568a15640 1 --2- 172.21.15.37:0/828529088 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fb54c0a32d0 0x7fb54c0a5790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb554005fd0 tx=0x7fb55400b390 comp rx=0 tx=0).stop 2024-09-19T06:04:56.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:56.617+0000 7fb568a15640 1 -- 172.21.15.37:0/828529088 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb56410c180 msgr2=0x7fb564101480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:56.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:56.617+0000 7fb568a15640 1 --2- 172.21.15.37:0/828529088 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb56410c180 0x7fb564101480 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb55c00eb10 tx=0x7fb55c00c2d0 comp rx=0 tx=0).stop 2024-09-19T06:04:56.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:56.618+0000 7fb568a15640 1 -- 172.21.15.37:0/828529088 shutdown_connections 2024-09-19T06:04:56.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:56.618+0000 7fb568a15640 1 --2- 172.21.15.37:0/828529088 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fb54c0a32d0 0x7fb54c0a5790 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:56.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:56.618+0000 7fb568a15640 1 --2- 172.21.15.37:0/828529088 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5641036c0 0x7fb564100f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:56.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:56.618+0000 7fb568a15640 1 --2- 172.21.15.37:0/828529088 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb56410c180 0x7fb564101480 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:56.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:56.618+0000 7fb568a15640 1 --2- 172.21.15.37:0/828529088 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb564102da0 0x7fb564100a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:56.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:56.618+0000 7fb568a15640 1 -- 172.21.15.37:0/828529088 >> 172.21.15.37:0/828529088 conn(0x7fb5640fc7a0 msgr2=0x7fb5640fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:56.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:56.618+0000 7fb568a15640 1 -- 172.21.15.37:0/828529088 shutdown_connections 2024-09-19T06:04:56.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:56.618+0000 7fb568a15640 1 -- 172.21.15.37:0/828529088 wait complete. 2024-09-19T06:04:56.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:56 smithi099 ceph-mon[35300]: pgmap v308: 129 pgs: 129 active+clean; 625 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.7 KiB/s wr, 4 op/s 2024-09-19T06:04:56.987 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:56 smithi037 ceph-mon[31211]: pgmap v308: 129 pgs: 129 active+clean; 625 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.7 KiB/s wr, 4 op/s 2024-09-19T06:04:56.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:56 smithi117 ceph-mon[35050]: pgmap v308: 129 pgs: 129 active+clean; 625 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.7 KiB/s wr, 4 op/s 2024-09-19T06:04:57.371 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":308,"stamp":"2024-09-19T06:04:54.654801+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":640498,"num_objects":26,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":163,"num_read_kb":178,"num_write":254,"num_write_kb":3013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":200,"ondisk_log_size":200,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":362588,"kb_used_data":13328,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124579236,"statfs":{"total":1151940427776,"available":1151569137664,"internally_reserved":0,"allocated":13647872,"data_stored":7650560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":357414202},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":45488,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":64,"num_write":24,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003978"},"pg_stats":[{"pgid":"2.1f","version":"81'4","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.496490+0000","last_change":"2024-09-19T06:04:03.323722+0000","last_active":"2024-09-19T06:04:15.496490+0000","last_peered":"2024-09-19T06:04:15.496490+0000","last_clean":"2024-09-19T06:04:15.496490+0000","last_became_active":"2024-09-19T06:04:03.323380+0000","last_became_peered":"2024-09-19T06:04:03.323380+0000","last_unstale":"2024-09-19T06:04:15.496490+0000","last_undegraded":"2024-09-19T06:04:15.496490+0000","last_fullsized":"2024-09-19T06:04:15.496490+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:49:17.449780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.495302+0000","last_change":"2024-09-19T06:04:05.427994+0000","last_active":"2024-09-19T06:04:15.495302+0000","last_peered":"2024-09-19T06:04:15.495302+0000","last_clean":"2024-09-19T06:04:15.495302+0000","last_became_active":"2024-09-19T06:04:05.427745+0000","last_became_peered":"2024-09-19T06:04:05.427745+0000","last_unstale":"2024-09-19T06:04:15.495302+0000","last_undegraded":"2024-09-19T06:04:15.495302+0000","last_fullsized":"2024-09-19T06:04:15.495302+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:54.917003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.495578+0000","last_change":"2024-09-19T06:04:12.463838+0000","last_active":"2024-09-19T06:04:15.495578+0000","last_peered":"2024-09-19T06:04:15.495578+0000","last_clean":"2024-09-19T06:04:15.495578+0000","last_became_active":"2024-09-19T06:04:12.463426+0000","last_became_peered":"2024-09-19T06:04:12.463426+0000","last_unstale":"2024-09-19T06:04:15.495578+0000","last_undegraded":"2024-09-19T06:04:15.495578+0000","last_fullsized":"2024-09-19T06:04:15.495578+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:40:37.994203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"81'1","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.495619+0000","last_change":"2024-09-19T06:04:03.378129+0000","last_active":"2024-09-19T06:04:15.495619+0000","last_peered":"2024-09-19T06:04:15.495619+0000","last_clean":"2024-09-19T06:04:15.495619+0000","last_became_active":"2024-09-19T06:04:03.377793+0000","last_became_peered":"2024-09-19T06:04:03.377793+0000","last_unstale":"2024-09-19T06:04:15.495619+0000","last_undegraded":"2024-09-19T06:04:15.495619+0000","last_fullsized":"2024-09-19T06:04:15.495619+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:38:22.739168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.464818+0000","last_change":"2024-09-19T06:04:05.433909+0000","last_active":"2024-09-19T06:04:15.464818+0000","last_peered":"2024-09-19T06:04:15.464818+0000","last_clean":"2024-09-19T06:04:15.464818+0000","last_became_active":"2024-09-19T06:04:05.433591+0000","last_became_peered":"2024-09-19T06:04:05.433591+0000","last_unstale":"2024-09-19T06:04:15.464818+0000","last_undegraded":"2024-09-19T06:04:15.464818+0000","last_fullsized":"2024-09-19T06:04:15.464818+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:19:18.916703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.495431+0000","last_change":"2024-09-19T06:04:12.468984+0000","last_active":"2024-09-19T06:04:15.495431+0000","last_peered":"2024-09-19T06:04:15.495431+0000","last_clean":"2024-09-19T06:04:15.495431+0000","last_became_active":"2024-09-19T06:04:12.467287+0000","last_became_peered":"2024-09-19T06:04:12.467287+0000","last_unstale":"2024-09-19T06:04:15.495431+0000","last_undegraded":"2024-09-19T06:04:15.495431+0000","last_fullsized":"2024-09-19T06:04:15.495431+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:05:46.279679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.463530+0000","last_change":"2024-09-19T06:04:03.319764+0000","last_active":"2024-09-19T06:04:15.463530+0000","last_peered":"2024-09-19T06:04:15.463530+0000","last_clean":"2024-09-19T06:04:15.463530+0000","last_became_active":"2024-09-19T06:04:03.319415+0000","last_became_peered":"2024-09-19T06:04:03.319415+0000","last_unstale":"2024-09-19T06:04:15.463530+0000","last_undegraded":"2024-09-19T06:04:15.463530+0000","last_fullsized":"2024-09-19T06:04:15.463530+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:34.900872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.494650+0000","last_change":"2024-09-19T06:04:05.430288+0000","last_active":"2024-09-19T06:04:15.494650+0000","last_peered":"2024-09-19T06:04:15.494650+0000","last_clean":"2024-09-19T06:04:15.494650+0000","last_became_active":"2024-09-19T06:04:05.429947+0000","last_became_peered":"2024-09-19T06:04:05.429947+0000","last_unstale":"2024-09-19T06:04:15.494650+0000","last_undegraded":"2024-09-19T06:04:15.494650+0000","last_fullsized":"2024-09-19T06:04:15.494650+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:43:09.169658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.496100+0000","last_change":"2024-09-19T06:04:12.465946+0000","last_active":"2024-09-19T06:04:15.496100+0000","last_peered":"2024-09-19T06:04:15.496100+0000","last_clean":"2024-09-19T06:04:15.496100+0000","last_became_active":"2024-09-19T06:04:12.465553+0000","last_became_peered":"2024-09-19T06:04:12.465553+0000","last_unstale":"2024-09-19T06:04:15.496100+0000","last_undegraded":"2024-09-19T06:04:15.496100+0000","last_fullsized":"2024-09-19T06:04:15.496100+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:50:41.181483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.463430+0000","last_change":"2024-09-19T06:04:03.318528+0000","last_active":"2024-09-19T06:04:15.463430+0000","last_peered":"2024-09-19T06:04:15.463430+0000","last_clean":"2024-09-19T06:04:15.463430+0000","last_became_active":"2024-09-19T06:04:03.318210+0000","last_became_peered":"2024-09-19T06:04:03.318210+0000","last_unstale":"2024-09-19T06:04:15.463430+0000","last_undegraded":"2024-09-19T06:04:15.463430+0000","last_fullsized":"2024-09-19T06:04:15.463430+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:06.766545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.496288+0000","last_change":"2024-09-19T06:04:05.427025+0000","last_active":"2024-09-19T06:04:15.496288+0000","last_peered":"2024-09-19T06:04:15.496288+0000","last_clean":"2024-09-19T06:04:15.496288+0000","last_became_active":"2024-09-19T06:04:05.425679+0000","last_became_peered":"2024-09-19T06:04:05.425679+0000","last_unstale":"2024-09-19T06:04:15.496288+0000","last_undegraded":"2024-09-19T06:04:15.496288+0000","last_fullsized":"2024-09-19T06:04:15.496288+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:26:06.480664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.495732+0000","last_change":"2024-09-19T06:04:12.467065+0000","last_active":"2024-09-19T06:04:15.495732+0000","last_peered":"2024-09-19T06:04:15.495732+0000","last_clean":"2024-09-19T06:04:15.495732+0000","last_became_active":"2024-09-19T06:04:12.465961+0000","last_became_peered":"2024-09-19T06:04:12.465961+0000","last_unstale":"2024-09-19T06:04:15.495732+0000","last_undegraded":"2024-09-19T06:04:15.495732+0000","last_fullsized":"2024-09-19T06:04:15.495732+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:13:38.566692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.461219+0000","last_change":"2024-09-19T06:04:05.436202+0000","last_active":"2024-09-19T06:04:15.461219+0000","last_peered":"2024-09-19T06:04:15.461219+0000","last_clean":"2024-09-19T06:04:15.461219+0000","last_became_active":"2024-09-19T06:04:05.435779+0000","last_became_peered":"2024-09-19T06:04:05.435779+0000","last_unstale":"2024-09-19T06:04:15.461219+0000","last_undegraded":"2024-09-19T06:04:15.461219+0000","last_fullsized":"2024-09-19T06:04:15.461219+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:27:56.463592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":33,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.463214+0000","last_change":"2024-09-19T06:04:03.320472+0000","last_active":"2024-09-19T06:04:15.463214+0000","last_peered":"2024-09-19T06:04:15.463214+0000","last_clean":"2024-09-19T06:04:15.463214+0000","last_became_active":"2024-09-19T06:04:03.320178+0000","last_became_peered":"2024-09-19T06:04:03.320178+0000","last_unstale":"2024-09-19T06:04:15.463214+0000","last_undegraded":"2024-09-19T06:04:15.463214+0000","last_fullsized":"2024-09-19T06:04:15.463214+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:23.285302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.496082+0000","last_change":"2024-09-19T06:04:12.635733+0000","last_active":"2024-09-19T06:04:15.496082+0000","last_peered":"2024-09-19T06:04:15.496082+0000","last_clean":"2024-09-19T06:04:15.496082+0000","last_became_active":"2024-09-19T06:04:12.634938+0000","last_became_peered":"2024-09-19T06:04:12.634938+0000","last_unstale":"2024-09-19T06:04:15.496082+0000","last_undegraded":"2024-09-19T06:04:15.496082+0000","last_fullsized":"2024-09-19T06:04:15.496082+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:44:09.015733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.494973+0000","last_change":"2024-09-19T06:04:05.418702+0000","last_active":"2024-09-19T06:04:15.494973+0000","last_peered":"2024-09-19T06:04:15.494973+0000","last_clean":"2024-09-19T06:04:15.494973+0000","last_became_active":"2024-09-19T06:04:05.418213+0000","last_became_peered":"2024-09-19T06:04:05.418213+0000","last_unstale":"2024-09-19T06:04:15.494973+0000","last_undegraded":"2024-09-19T06:04:15.494973+0000","last_fullsized":"2024-09-19T06:04:15.494973+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:46:01.865286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.496224+0000","last_change":"2024-09-19T06:04:03.323683+0000","last_active":"2024-09-19T06:04:15.496224+0000","last_peered":"2024-09-19T06:04:15.496224+0000","last_clean":"2024-09-19T06:04:15.496224+0000","last_became_active":"2024-09-19T06:04:03.323166+0000","last_became_peered":"2024-09-19T06:04:03.323166+0000","last_unstale":"2024-09-19T06:04:15.496224+0000","last_undegraded":"2024-09-19T06:04:15.496224+0000","last_fullsized":"2024-09-19T06:04:15.496224+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:53.787307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"87'1","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.496252+0000","last_change":"2024-09-19T06:04:12.467620+0000","last_active":"2024-09-19T06:04:15.496252+0000","last_peered":"2024-09-19T06:04:15.496252+0000","last_clean":"2024-09-19T06:04:15.496252+0000","last_became_active":"2024-09-19T06:04:12.467231+0000","last_became_peered":"2024-09-19T06:04:12.467231+0000","last_unstale":"2024-09-19T06:04:15.496252+0000","last_undegraded":"2024-09-19T06:04:15.496252+0000","last_fullsized":"2024-09-19T06:04:15.496252+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:12:07.731338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.494618+0000","last_change":"2024-09-19T06:04:05.426415+0000","last_active":"2024-09-19T06:04:15.494618+0000","last_peered":"2024-09-19T06:04:15.494618+0000","last_clean":"2024-09-19T06:04:15.494618+0000","last_became_active":"2024-09-19T06:04:05.426061+0000","last_became_peered":"2024-09-19T06:04:05.426061+0000","last_unstale":"2024-09-19T06:04:15.494618+0000","last_undegraded":"2024-09-19T06:04:15.494618+0000","last_fullsized":"2024-09-19T06:04:15.494618+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:44.810600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.495211+0000","last_change":"2024-09-19T06:04:03.319185+0000","last_active":"2024-09-19T06:04:15.495211+0000","last_peered":"2024-09-19T06:04:15.495211+0000","last_clean":"2024-09-19T06:04:15.495211+0000","last_became_active":"2024-09-19T06:04:03.318788+0000","last_became_peered":"2024-09-19T06:04:03.318788+0000","last_unstale":"2024-09-19T06:04:15.495211+0000","last_undegraded":"2024-09-19T06:04:15.495211+0000","last_fullsized":"2024-09-19T06:04:15.495211+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:41:14.668303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.496266+0000","last_change":"2024-09-19T06:04:12.467703+0000","last_active":"2024-09-19T06:04:15.496266+0000","last_peered":"2024-09-19T06:04:15.496266+0000","last_clean":"2024-09-19T06:04:15.496266+0000","last_became_active":"2024-09-19T06:04:12.467287+0000","last_became_peered":"2024-09-19T06:04:12.467287+0000","last_unstale":"2024-09-19T06:04:15.496266+0000","last_undegraded":"2024-09-19T06:04:15.496266+0000","last_fullsized":"2024-09-19T06:04:15.496266+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:04:17.961912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.462962+0000","last_change":"2024-09-19T06:04:05.428027+0000","last_active":"2024-09-19T06:04:15.462962+0000","last_peered":"2024-09-19T06:04:15.462962+0000","last_clean":"2024-09-19T06:04:15.462962+0000","last_became_active":"2024-09-19T06:04:05.427698+0000","last_became_peered":"2024-09-19T06:04:05.427698+0000","last_unstale":"2024-09-19T06:04:15.462962+0000","last_undegraded":"2024-09-19T06:04:15.462962+0000","last_fullsized":"2024-09-19T06:04:15.462962+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:06:34.627086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.494400+0000","last_change":"2024-09-19T06:04:03.380435+0000","last_active":"2024-09-19T06:04:15.494400+0000","last_peered":"2024-09-19T06:04:15.494400+0000","last_clean":"2024-09-19T06:04:15.494400+0000","last_became_active":"2024-09-19T06:04:03.380102+0000","last_became_peered":"2024-09-19T06:04:03.380102+0000","last_unstale":"2024-09-19T06:04:15.494400+0000","last_undegraded":"2024-09-19T06:04:15.494400+0000","last_fullsized":"2024-09-19T06:04:15.494400+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:43.886466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.496141+0000","last_change":"2024-09-19T06:04:12.636056+0000","last_active":"2024-09-19T06:04:15.496141+0000","last_peered":"2024-09-19T06:04:15.496141+0000","last_clean":"2024-09-19T06:04:15.496141+0000","last_became_active":"2024-09-19T06:04:12.635258+0000","last_became_peered":"2024-09-19T06:04:12.635258+0000","last_unstale":"2024-09-19T06:04:15.496141+0000","last_undegraded":"2024-09-19T06:04:15.496141+0000","last_fullsized":"2024-09-19T06:04:15.496141+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:47:15.300131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.464778+0000","last_change":"2024-09-19T06:04:05.422587+0000","last_active":"2024-09-19T06:04:15.464778+0000","last_peered":"2024-09-19T06:04:15.464778+0000","last_clean":"2024-09-19T06:04:15.464778+0000","last_became_active":"2024-09-19T06:04:05.422284+0000","last_became_peered":"2024-09-19T06:04:05.422284+0000","last_unstale":"2024-09-19T06:04:15.464778+0000","last_undegraded":"2024-09-19T06:04:15.464778+0000","last_fullsized":"2024-09-19T06:04:15.464778+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:12:11.885251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"81'2","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.496082+0000","last_change":"2024-09-19T06:04:03.376510+0000","last_active":"2024-09-19T06:04:15.496082+0000","last_peered":"2024-09-19T06:04:15.496082+0000","last_clean":"2024-09-19T06:04:15.496082+0000","last_became_active":"2024-09-19T06:04:03.376241+0000","last_became_peered":"2024-09-19T06:04:03.376241+0000","last_unstale":"2024-09-19T06:04:15.496082+0000","last_undegraded":"2024-09-19T06:04:15.496082+0000","last_fullsized":"2024-09-19T06:04:15.496082+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:19:29.209233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.495819+0000","last_change":"2024-09-19T06:04:12.462237+0000","last_active":"2024-09-19T06:04:15.495819+0000","last_peered":"2024-09-19T06:04:15.495819+0000","last_clean":"2024-09-19T06:04:15.495819+0000","last_became_active":"2024-09-19T06:04:12.461771+0000","last_became_peered":"2024-09-19T06:04:12.461771+0000","last_unstale":"2024-09-19T06:04:15.495819+0000","last_undegraded":"2024-09-19T06:04:15.495819+0000","last_fullsized":"2024-09-19T06:04:15.495819+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:46:42.780847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.495873+0000","last_change":"2024-09-19T06:04:05.420472+0000","last_active":"2024-09-19T06:04:15.495873+0000","last_peered":"2024-09-19T06:04:15.495873+0000","last_clean":"2024-09-19T06:04:15.495873+0000","last_became_active":"2024-09-19T06:04:05.420147+0000","last_became_peered":"2024-09-19T06:04:05.420147+0000","last_unstale":"2024-09-19T06:04:15.495873+0000","last_undegraded":"2024-09-19T06:04:15.495873+0000","last_fullsized":"2024-09-19T06:04:15.495873+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:38.616378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"87'5","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:50.422877+0000","last_change":"2024-09-19T06:04:03.316655+0000","last_active":"2024-09-19T06:04:50.422877+0000","last_peered":"2024-09-19T06:04:50.422877+0000","last_clean":"2024-09-19T06:04:50.422877+0000","last_became_active":"2024-09-19T06:04:03.316296+0000","last_became_peered":"2024-09-19T06:04:03.316296+0000","last_unstale":"2024-09-19T06:04:50.422877+0000","last_undegraded":"2024-09-19T06:04:50.422877+0000","last_fullsized":"2024-09-19T06:04:50.422877+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:02:06.320482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.494659+0000","last_change":"2024-09-19T06:04:12.635106+0000","last_active":"2024-09-19T06:04:15.494659+0000","last_peered":"2024-09-19T06:04:15.494659+0000","last_clean":"2024-09-19T06:04:15.494659+0000","last_became_active":"2024-09-19T06:04:12.634671+0000","last_became_peered":"2024-09-19T06:04:12.634671+0000","last_unstale":"2024-09-19T06:04:15.494659+0000","last_undegraded":"2024-09-19T06:04:15.494659+0000","last_fullsized":"2024-09-19T06:04:15.494659+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:54:22.428102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.494962+0000","last_change":"2024-09-19T06:04:05.427483+0000","last_active":"2024-09-19T06:04:15.494962+0000","last_peered":"2024-09-19T06:04:15.494962+0000","last_clean":"2024-09-19T06:04:15.494962+0000","last_became_active":"2024-09-19T06:04:05.427092+0000","last_became_peered":"2024-09-19T06:04:05.427092+0000","last_unstale":"2024-09-19T06:04:15.494962+0000","last_undegraded":"2024-09-19T06:04:15.494962+0000","last_fullsized":"2024-09-19T06:04:15.494962+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:50:21.576757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.463582+0000","last_change":"2024-09-19T06:04:03.377962+0000","last_active":"2024-09-19T06:04:15.463582+0000","last_peered":"2024-09-19T06:04:15.463582+0000","last_clean":"2024-09-19T06:04:15.463582+0000","last_became_active":"2024-09-19T06:04:03.377686+0000","last_became_peered":"2024-09-19T06:04:03.377686+0000","last_unstale":"2024-09-19T06:04:15.463582+0000","last_undegraded":"2024-09-19T06:04:15.463582+0000","last_fullsized":"2024-09-19T06:04:15.463582+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:00.635765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.494613+0000","last_change":"2024-09-19T06:04:12.467349+0000","last_active":"2024-09-19T06:04:15.494613+0000","last_peered":"2024-09-19T06:04:15.494613+0000","last_clean":"2024-09-19T06:04:15.494613+0000","last_became_active":"2024-09-19T06:04:12.466117+0000","last_became_peered":"2024-09-19T06:04:12.466117+0000","last_unstale":"2024-09-19T06:04:15.494613+0000","last_undegraded":"2024-09-19T06:04:15.494613+0000","last_fullsized":"2024-09-19T06:04:15.494613+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:28:03.040586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.495288+0000","last_change":"2024-09-19T06:04:05.429656+0000","last_active":"2024-09-19T06:04:15.495288+0000","last_peered":"2024-09-19T06:04:15.495288+0000","last_clean":"2024-09-19T06:04:15.495288+0000","last_became_active":"2024-09-19T06:04:05.429023+0000","last_became_peered":"2024-09-19T06:04:05.429023+0000","last_unstale":"2024-09-19T06:04:15.495288+0000","last_undegraded":"2024-09-19T06:04:15.495288+0000","last_fullsized":"2024-09-19T06:04:15.495288+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:25:57.627940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.496017+0000","last_change":"2024-09-19T06:04:03.378415+0000","last_active":"2024-09-19T06:04:15.496017+0000","last_peered":"2024-09-19T06:04:15.496017+0000","last_clean":"2024-09-19T06:04:15.496017+0000","last_became_active":"2024-09-19T06:04:03.378096+0000","last_became_peered":"2024-09-19T06:04:03.378096+0000","last_unstale":"2024-09-19T06:04:15.496017+0000","last_undegraded":"2024-09-19T06:04:15.496017+0000","last_fullsized":"2024-09-19T06:04:15.496017+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:14:33.988869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.463100+0000","last_change":"2024-09-19T06:04:12.635410+0000","last_active":"2024-09-19T06:04:15.463100+0000","last_peered":"2024-09-19T06:04:15.463100+0000","last_clean":"2024-09-19T06:04:15.463100+0000","last_became_active":"2024-09-19T06:04:12.634852+0000","last_became_peered":"2024-09-19T06:04:12.634852+0000","last_unstale":"2024-09-19T06:04:15.463100+0000","last_undegraded":"2024-09-19T06:04:15.463100+0000","last_fullsized":"2024-09-19T06:04:15.463100+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:28:46.014324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.495163+0000","last_change":"2024-09-19T06:04:05.421348+0000","last_active":"2024-09-19T06:04:15.495163+0000","last_peered":"2024-09-19T06:04:15.495163+0000","last_clean":"2024-09-19T06:04:15.495163+0000","last_became_active":"2024-09-19T06:04:05.420999+0000","last_became_peered":"2024-09-19T06:04:05.420999+0000","last_unstale":"2024-09-19T06:04:15.495163+0000","last_undegraded":"2024-09-19T06:04:15.495163+0000","last_fullsized":"2024-09-19T06:04:15.495163+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:52:26.257580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.461311+0000","last_change":"2024-09-19T06:04:03.321233+0000","last_active":"2024-09-19T06:04:15.461311+0000","last_peered":"2024-09-19T06:04:15.461311+0000","last_clean":"2024-09-19T06:04:15.461311+0000","last_became_active":"2024-09-19T06:04:03.320755+0000","last_became_peered":"2024-09-19T06:04:03.320755+0000","last_unstale":"2024-09-19T06:04:15.461311+0000","last_undegraded":"2024-09-19T06:04:15.461311+0000","last_fullsized":"2024-09-19T06:04:15.461311+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:46.661751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.494702+0000","last_change":"2024-09-19T06:04:12.463185+0000","last_active":"2024-09-19T06:04:15.494702+0000","last_peered":"2024-09-19T06:04:15.494702+0000","last_clean":"2024-09-19T06:04:15.494702+0000","last_became_active":"2024-09-19T06:04:12.462824+0000","last_became_peered":"2024-09-19T06:04:12.462824+0000","last_unstale":"2024-09-19T06:04:15.494702+0000","last_undegraded":"2024-09-19T06:04:15.494702+0000","last_fullsized":"2024-09-19T06:04:15.494702+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:54:05.634907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.494933+0000","last_change":"2024-09-19T06:04:05.427259+0000","last_active":"2024-09-19T06:04:15.494933+0000","last_peered":"2024-09-19T06:04:15.494933+0000","last_clean":"2024-09-19T06:04:15.494933+0000","last_became_active":"2024-09-19T06:04:05.426955+0000","last_became_peered":"2024-09-19T06:04:05.426955+0000","last_unstale":"2024-09-19T06:04:15.494933+0000","last_undegraded":"2024-09-19T06:04:15.494933+0000","last_fullsized":"2024-09-19T06:04:15.494933+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:34:22.085384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.494453+0000","last_change":"2024-09-19T06:04:03.378174+0000","last_active":"2024-09-19T06:04:15.494453+0000","last_peered":"2024-09-19T06:04:15.494453+0000","last_clean":"2024-09-19T06:04:15.494453+0000","last_became_active":"2024-09-19T06:04:03.377803+0000","last_became_peered":"2024-09-19T06:04:03.377803+0000","last_unstale":"2024-09-19T06:04:15.494453+0000","last_undegraded":"2024-09-19T06:04:15.494453+0000","last_fullsized":"2024-09-19T06:04:15.494453+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:24:26.087284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.496057+0000","last_change":"2024-09-19T06:04:12.635365+0000","last_active":"2024-09-19T06:04:15.496057+0000","last_peered":"2024-09-19T06:04:15.496057+0000","last_clean":"2024-09-19T06:04:15.496057+0000","last_became_active":"2024-09-19T06:04:12.634691+0000","last_became_peered":"2024-09-19T06:04:12.634691+0000","last_unstale":"2024-09-19T06:04:15.496057+0000","last_undegraded":"2024-09-19T06:04:15.496057+0000","last_fullsized":"2024-09-19T06:04:15.496057+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:20:58.523992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.494329+0000","last_change":"2024-09-19T06:04:05.425638+0000","last_active":"2024-09-19T06:04:15.494329+0000","last_peered":"2024-09-19T06:04:15.494329+0000","last_clean":"2024-09-19T06:04:15.494329+0000","last_became_active":"2024-09-19T06:04:05.425356+0000","last_became_peered":"2024-09-19T06:04:05.425356+0000","last_unstale":"2024-09-19T06:04:15.494329+0000","last_undegraded":"2024-09-19T06:04:15.494329+0000","last_fullsized":"2024-09-19T06:04:15.494329+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:51:11.857888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.460869+0000","last_change":"2024-09-19T06:04:03.322432+0000","last_active":"2024-09-19T06:04:15.460869+0000","last_peered":"2024-09-19T06:04:15.460869+0000","last_clean":"2024-09-19T06:04:15.460869+0000","last_became_active":"2024-09-19T06:04:03.322071+0000","last_became_peered":"2024-09-19T06:04:03.322071+0000","last_unstale":"2024-09-19T06:04:15.460869+0000","last_undegraded":"2024-09-19T06:04:15.460869+0000","last_fullsized":"2024-09-19T06:04:15.460869+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:16:23.935470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.495859+0000","last_change":"2024-09-19T06:04:12.635970+0000","last_active":"2024-09-19T06:04:15.495859+0000","last_peered":"2024-09-19T06:04:15.495859+0000","last_clean":"2024-09-19T06:04:15.495859+0000","last_became_active":"2024-09-19T06:04:12.635283+0000","last_became_peered":"2024-09-19T06:04:12.635283+0000","last_unstale":"2024-09-19T06:04:15.495859+0000","last_undegraded":"2024-09-19T06:04:15.495859+0000","last_fullsized":"2024-09-19T06:04:15.495859+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:55:05.460652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.495050+0000","last_change":"2024-09-19T06:04:05.424335+0000","last_active":"2024-09-19T06:04:15.495050+0000","last_peered":"2024-09-19T06:04:15.495050+0000","last_clean":"2024-09-19T06:04:15.495050+0000","last_became_active":"2024-09-19T06:04:05.423868+0000","last_became_peered":"2024-09-19T06:04:05.423868+0000","last_unstale":"2024-09-19T06:04:15.495050+0000","last_undegraded":"2024-09-19T06:04:15.495050+0000","last_fullsized":"2024-09-19T06:04:15.495050+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:17:15.556240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.496406+0000","last_change":"2024-09-19T06:04:03.315749+0000","last_active":"2024-09-19T06:04:15.496406+0000","last_peered":"2024-09-19T06:04:15.496406+0000","last_clean":"2024-09-19T06:04:15.496406+0000","last_became_active":"2024-09-19T06:04:03.315404+0000","last_became_peered":"2024-09-19T06:04:03.315404+0000","last_unstale":"2024-09-19T06:04:15.496406+0000","last_undegraded":"2024-09-19T06:04:15.496406+0000","last_fullsized":"2024-09-19T06:04:15.496406+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:43:35.485993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":340,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.461031+0000","last_change":"2024-09-19T06:02:49.934106+0000","last_active":"2024-09-19T06:04:15.461031+0000","last_peered":"2024-09-19T06:04:15.461031+0000","last_clean":"2024-09-19T06:04:15.461031+0000","last_became_active":"2024-09-19T06:02:49.933684+0000","last_became_peered":"2024-09-19T06:02:49.933684+0000","last_unstale":"2024-09-19T06:04:15.461031+0000","last_undegraded":"2024-09-19T06:04:15.461031+0000","last_fullsized":"2024-09-19T06:04:15.461031+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:59:27.582796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:59:27.582796+0000","last_clean_scrub_stamp":"2024-09-19T05:59:27.582796+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:35:06.837740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"87'1","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:16.422872+0000","last_change":"2024-09-19T06:04:12.468160+0000","last_active":"2024-09-19T06:04:16.422872+0000","last_peered":"2024-09-19T06:04:16.422872+0000","last_clean":"2024-09-19T06:04:16.422872+0000","last_became_active":"2024-09-19T06:04:12.467642+0000","last_became_peered":"2024-09-19T06:04:12.467642+0000","last_unstale":"2024-09-19T06:04:16.422872+0000","last_undegraded":"2024-09-19T06:04:16.422872+0000","last_fullsized":"2024-09-19T06:04:16.422872+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:40.053143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.461511+0000","last_change":"2024-09-19T06:04:05.435815+0000","last_active":"2024-09-19T06:04:15.461511+0000","last_peered":"2024-09-19T06:04:15.461511+0000","last_clean":"2024-09-19T06:04:15.461511+0000","last_became_active":"2024-09-19T06:04:05.435498+0000","last_became_peered":"2024-09-19T06:04:05.435498+0000","last_unstale":"2024-09-19T06:04:15.461511+0000","last_undegraded":"2024-09-19T06:04:15.461511+0000","last_fullsized":"2024-09-19T06:04:15.461511+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:33:30.330877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.496722+0000","last_change":"2024-09-19T06:04:03.379675+0000","last_active":"2024-09-19T06:04:15.496722+0000","last_peered":"2024-09-19T06:04:15.496722+0000","last_clean":"2024-09-19T06:04:15.496722+0000","last_became_active":"2024-09-19T06:04:03.379336+0000","last_became_peered":"2024-09-19T06:04:03.379336+0000","last_unstale":"2024-09-19T06:04:15.496722+0000","last_undegraded":"2024-09-19T06:04:15.496722+0000","last_fullsized":"2024-09-19T06:04:15.496722+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:04.139137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.494475+0000","last_change":"2024-09-19T06:04:12.466249+0000","last_active":"2024-09-19T06:04:15.494475+0000","last_peered":"2024-09-19T06:04:15.494475+0000","last_clean":"2024-09-19T06:04:15.494475+0000","last_became_active":"2024-09-19T06:04:12.465709+0000","last_became_peered":"2024-09-19T06:04:12.465709+0000","last_unstale":"2024-09-19T06:04:15.494475+0000","last_undegraded":"2024-09-19T06:04:15.494475+0000","last_fullsized":"2024-09-19T06:04:15.494475+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:02:11.454334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.461172+0000","last_change":"2024-09-19T06:04:05.425733+0000","last_active":"2024-09-19T06:04:15.461172+0000","last_peered":"2024-09-19T06:04:15.461172+0000","last_clean":"2024-09-19T06:04:15.461172+0000","last_became_active":"2024-09-19T06:04:05.425399+0000","last_became_peered":"2024-09-19T06:04:05.425399+0000","last_unstale":"2024-09-19T06:04:15.461172+0000","last_undegraded":"2024-09-19T06:04:15.461172+0000","last_fullsized":"2024-09-19T06:04:15.461172+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:35:33.287456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.496538+0000","last_change":"2024-09-19T06:04:03.319361+0000","last_active":"2024-09-19T06:04:15.496538+0000","last_peered":"2024-09-19T06:04:15.496538+0000","last_clean":"2024-09-19T06:04:15.496538+0000","last_became_active":"2024-09-19T06:04:03.319053+0000","last_became_peered":"2024-09-19T06:04:03.319053+0000","last_unstale":"2024-09-19T06:04:15.496538+0000","last_undegraded":"2024-09-19T06:04:15.496538+0000","last_fullsized":"2024-09-19T06:04:15.496538+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:25:23.739392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.464687+0000","last_change":"2024-09-19T06:04:12.468270+0000","last_active":"2024-09-19T06:04:15.464687+0000","last_peered":"2024-09-19T06:04:15.464687+0000","last_clean":"2024-09-19T06:04:15.464687+0000","last_became_active":"2024-09-19T06:04:12.467872+0000","last_became_peered":"2024-09-19T06:04:12.467872+0000","last_unstale":"2024-09-19T06:04:15.464687+0000","last_undegraded":"2024-09-19T06:04:15.464687+0000","last_fullsized":"2024-09-19T06:04:15.464687+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:35.476189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.461360+0000","last_change":"2024-09-19T06:04:05.431360+0000","last_active":"2024-09-19T06:04:15.461360+0000","last_peered":"2024-09-19T06:04:15.461360+0000","last_clean":"2024-09-19T06:04:15.461360+0000","last_became_active":"2024-09-19T06:04:05.431067+0000","last_became_peered":"2024-09-19T06:04:05.431067+0000","last_unstale":"2024-09-19T06:04:15.461360+0000","last_undegraded":"2024-09-19T06:04:15.461360+0000","last_fullsized":"2024-09-19T06:04:15.461360+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:16:25.317086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.496424+0000","last_change":"2024-09-19T06:04:03.316793+0000","last_active":"2024-09-19T06:04:15.496424+0000","last_peered":"2024-09-19T06:04:15.496424+0000","last_clean":"2024-09-19T06:04:15.496424+0000","last_became_active":"2024-09-19T06:04:03.316485+0000","last_became_peered":"2024-09-19T06:04:03.316485+0000","last_unstale":"2024-09-19T06:04:15.496424+0000","last_undegraded":"2024-09-19T06:04:15.496424+0000","last_fullsized":"2024-09-19T06:04:15.496424+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:19:26.427025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.494798+0000","last_change":"2024-09-19T06:04:12.466322+0000","last_active":"2024-09-19T06:04:15.494798+0000","last_peered":"2024-09-19T06:04:15.494798+0000","last_clean":"2024-09-19T06:04:15.494798+0000","last_became_active":"2024-09-19T06:04:12.465806+0000","last_became_peered":"2024-09-19T06:04:12.465806+0000","last_unstale":"2024-09-19T06:04:15.494798+0000","last_undegraded":"2024-09-19T06:04:15.494798+0000","last_fullsized":"2024-09-19T06:04:15.494798+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:33:28.893570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.495001+0000","last_change":"2024-09-19T06:04:05.424864+0000","last_active":"2024-09-19T06:04:15.495001+0000","last_peered":"2024-09-19T06:04:15.495001+0000","last_clean":"2024-09-19T06:04:15.495001+0000","last_became_active":"2024-09-19T06:04:05.424504+0000","last_became_peered":"2024-09-19T06:04:05.424504+0000","last_unstale":"2024-09-19T06:04:15.495001+0000","last_undegraded":"2024-09-19T06:04:15.495001+0000","last_fullsized":"2024-09-19T06:04:15.495001+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:30.471757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.463570+0000","last_change":"2024-09-19T06:04:03.321925+0000","last_active":"2024-09-19T06:04:15.463570+0000","last_peered":"2024-09-19T06:04:15.463570+0000","last_clean":"2024-09-19T06:04:15.463570+0000","last_became_active":"2024-09-19T06:04:03.321445+0000","last_became_peered":"2024-09-19T06:04:03.321445+0000","last_unstale":"2024-09-19T06:04:15.463570+0000","last_undegraded":"2024-09-19T06:04:15.463570+0000","last_fullsized":"2024-09-19T06:04:15.463570+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:15:55.621352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.495372+0000","last_change":"2024-09-19T06:04:12.471413+0000","last_active":"2024-09-19T06:04:15.495372+0000","last_peered":"2024-09-19T06:04:15.495372+0000","last_clean":"2024-09-19T06:04:15.495372+0000","last_became_active":"2024-09-19T06:04:12.471057+0000","last_became_peered":"2024-09-19T06:04:12.471057+0000","last_unstale":"2024-09-19T06:04:15.495372+0000","last_undegraded":"2024-09-19T06:04:15.495372+0000","last_fullsized":"2024-09-19T06:04:15.495372+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:08:47.259211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.496253+0000","last_change":"2024-09-19T06:04:05.429447+0000","last_active":"2024-09-19T06:04:15.496253+0000","last_peered":"2024-09-19T06:04:15.496253+0000","last_clean":"2024-09-19T06:04:15.496253+0000","last_became_active":"2024-09-19T06:04:05.428852+0000","last_became_peered":"2024-09-19T06:04:05.428852+0000","last_unstale":"2024-09-19T06:04:15.496253+0000","last_undegraded":"2024-09-19T06:04:15.496253+0000","last_fullsized":"2024-09-19T06:04:15.496253+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:01.466814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.462962+0000","last_change":"2024-09-19T06:04:03.378586+0000","last_active":"2024-09-19T06:04:15.462962+0000","last_peered":"2024-09-19T06:04:15.462962+0000","last_clean":"2024-09-19T06:04:15.462962+0000","last_became_active":"2024-09-19T06:04:03.378292+0000","last_became_peered":"2024-09-19T06:04:03.378292+0000","last_unstale":"2024-09-19T06:04:15.462962+0000","last_undegraded":"2024-09-19T06:04:15.462962+0000","last_fullsized":"2024-09-19T06:04:15.462962+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:54.247070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.496326+0000","last_change":"2024-09-19T06:04:12.470914+0000","last_active":"2024-09-19T06:04:15.496326+0000","last_peered":"2024-09-19T06:04:15.496326+0000","last_clean":"2024-09-19T06:04:15.496326+0000","last_became_active":"2024-09-19T06:04:12.470563+0000","last_became_peered":"2024-09-19T06:04:12.470563+0000","last_unstale":"2024-09-19T06:04:15.496326+0000","last_undegraded":"2024-09-19T06:04:15.496326+0000","last_fullsized":"2024-09-19T06:04:15.496326+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:13.060646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.460769+0000","last_change":"2024-09-19T06:04:05.424009+0000","last_active":"2024-09-19T06:04:15.460769+0000","last_peered":"2024-09-19T06:04:15.460769+0000","last_clean":"2024-09-19T06:04:15.460769+0000","last_became_active":"2024-09-19T06:04:05.423670+0000","last_became_peered":"2024-09-19T06:04:05.423670+0000","last_unstale":"2024-09-19T06:04:15.460769+0000","last_undegraded":"2024-09-19T06:04:15.460769+0000","last_fullsized":"2024-09-19T06:04:15.460769+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:30:15.165259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.495975+0000","last_change":"2024-09-19T06:04:03.317089+0000","last_active":"2024-09-19T06:04:15.495975+0000","last_peered":"2024-09-19T06:04:15.495975+0000","last_clean":"2024-09-19T06:04:15.495975+0000","last_became_active":"2024-09-19T06:04:03.316575+0000","last_became_peered":"2024-09-19T06:04:03.316575+0000","last_unstale":"2024-09-19T06:04:15.495975+0000","last_undegraded":"2024-09-19T06:04:15.495975+0000","last_fullsized":"2024-09-19T06:04:15.495975+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:11:43.769660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.496345+0000","last_change":"2024-09-19T06:04:12.472234+0000","last_active":"2024-09-19T06:04:15.496345+0000","last_peered":"2024-09-19T06:04:15.496345+0000","last_clean":"2024-09-19T06:04:15.496345+0000","last_became_active":"2024-09-19T06:04:12.469847+0000","last_became_peered":"2024-09-19T06:04:12.469847+0000","last_unstale":"2024-09-19T06:04:15.496345+0000","last_undegraded":"2024-09-19T06:04:15.496345+0000","last_fullsized":"2024-09-19T06:04:15.496345+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:02:50.200613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.461104+0000","last_change":"2024-09-19T06:04:05.430145+0000","last_active":"2024-09-19T06:04:15.461104+0000","last_peered":"2024-09-19T06:04:15.461104+0000","last_clean":"2024-09-19T06:04:15.461104+0000","last_became_active":"2024-09-19T06:04:05.429763+0000","last_became_peered":"2024-09-19T06:04:05.429763+0000","last_unstale":"2024-09-19T06:04:15.461104+0000","last_undegraded":"2024-09-19T06:04:15.461104+0000","last_fullsized":"2024-09-19T06:04:15.461104+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:44:38.783894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.495792+0000","last_change":"2024-09-19T06:04:03.317410+0000","last_active":"2024-09-19T06:04:15.495792+0000","last_peered":"2024-09-19T06:04:15.495792+0000","last_clean":"2024-09-19T06:04:15.495792+0000","last_became_active":"2024-09-19T06:04:03.317068+0000","last_became_peered":"2024-09-19T06:04:03.317068+0000","last_unstale":"2024-09-19T06:04:15.495792+0000","last_undegraded":"2024-09-19T06:04:15.495792+0000","last_fullsized":"2024-09-19T06:04:15.495792+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:23.209080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.494903+0000","last_change":"2024-09-19T06:04:12.469867+0000","last_active":"2024-09-19T06:04:15.494903+0000","last_peered":"2024-09-19T06:04:15.494903+0000","last_clean":"2024-09-19T06:04:15.494903+0000","last_became_active":"2024-09-19T06:04:12.469391+0000","last_became_peered":"2024-09-19T06:04:12.469391+0000","last_unstale":"2024-09-19T06:04:15.494903+0000","last_undegraded":"2024-09-19T06:04:15.494903+0000","last_fullsized":"2024-09-19T06:04:15.494903+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:43:29.493247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.494619+0000","last_change":"2024-09-19T06:04:05.423515+0000","last_active":"2024-09-19T06:04:15.494619+0000","last_peered":"2024-09-19T06:04:15.494619+0000","last_clean":"2024-09-19T06:04:15.494619+0000","last_became_active":"2024-09-19T06:04:05.422185+0000","last_became_peered":"2024-09-19T06:04:05.422185+0000","last_unstale":"2024-09-19T06:04:15.494619+0000","last_undegraded":"2024-09-19T06:04:15.494619+0000","last_fullsized":"2024-09-19T06:04:15.494619+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:09:22.951171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"81'2","reported_seq":33,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.496502+0000","last_change":"2024-09-19T06:04:03.319681+0000","last_active":"2024-09-19T06:04:15.496502+0000","last_peered":"2024-09-19T06:04:15.496502+0000","last_clean":"2024-09-19T06:04:15.496502+0000","last_became_active":"2024-09-19T06:04:03.319189+0000","last_became_peered":"2024-09-19T06:04:03.319189+0000","last_unstale":"2024-09-19T06:04:15.496502+0000","last_undegraded":"2024-09-19T06:04:15.496502+0000","last_fullsized":"2024-09-19T06:04:15.496502+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:20:54.139461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.496195+0000","last_change":"2024-09-19T06:04:12.468569+0000","last_active":"2024-09-19T06:04:15.496195+0000","last_peered":"2024-09-19T06:04:15.496195+0000","last_clean":"2024-09-19T06:04:15.496195+0000","last_became_active":"2024-09-19T06:04:12.467759+0000","last_became_peered":"2024-09-19T06:04:12.467759+0000","last_unstale":"2024-09-19T06:04:15.496195+0000","last_undegraded":"2024-09-19T06:04:15.496195+0000","last_fullsized":"2024-09-19T06:04:15.496195+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:20:49.817163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.463376+0000","last_change":"2024-09-19T06:04:05.425703+0000","last_active":"2024-09-19T06:04:15.463376+0000","last_peered":"2024-09-19T06:04:15.463376+0000","last_clean":"2024-09-19T06:04:15.463376+0000","last_became_active":"2024-09-19T06:04:05.425360+0000","last_became_peered":"2024-09-19T06:04:05.425360+0000","last_unstale":"2024-09-19T06:04:15.463376+0000","last_undegraded":"2024-09-19T06:04:15.463376+0000","last_fullsized":"2024-09-19T06:04:15.463376+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:33:25.457191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"87'24","reported_seq":85,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:52.556738+0000","last_change":"2024-09-19T06:04:03.319087+0000","last_active":"2024-09-19T06:04:52.556738+0000","last_peered":"2024-09-19T06:04:52.556738+0000","last_clean":"2024-09-19T06:04:52.556738+0000","last_became_active":"2024-09-19T06:04:03.318721+0000","last_became_peered":"2024-09-19T06:04:03.318721+0000","last_unstale":"2024-09-19T06:04:52.556738+0000","last_undegraded":"2024-09-19T06:04:52.556738+0000","last_fullsized":"2024-09-19T06:04:52.556738+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:14:32.337455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49098,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":31,"num_read_kb":63,"num_write":24,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.495572+0000","last_change":"2024-09-19T06:04:12.472008+0000","last_active":"2024-09-19T06:04:15.495572+0000","last_peered":"2024-09-19T06:04:15.495572+0000","last_clean":"2024-09-19T06:04:15.495572+0000","last_became_active":"2024-09-19T06:04:12.471623+0000","last_became_peered":"2024-09-19T06:04:12.471623+0000","last_unstale":"2024-09-19T06:04:15.495572+0000","last_undegraded":"2024-09-19T06:04:15.495572+0000","last_fullsized":"2024-09-19T06:04:15.495572+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:13:11.424242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.494760+0000","last_change":"2024-09-19T06:04:05.434865+0000","last_active":"2024-09-19T06:04:15.494760+0000","last_peered":"2024-09-19T06:04:15.494760+0000","last_clean":"2024-09-19T06:04:15.494760+0000","last_became_active":"2024-09-19T06:04:05.434472+0000","last_became_peered":"2024-09-19T06:04:05.434472+0000","last_unstale":"2024-09-19T06:04:15.494760+0000","last_undegraded":"2024-09-19T06:04:15.494760+0000","last_fullsized":"2024-09-19T06:04:15.494760+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:35.490406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"81'3","reported_seq":33,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.496415+0000","last_change":"2024-09-19T06:04:03.380447+0000","last_active":"2024-09-19T06:04:15.496415+0000","last_peered":"2024-09-19T06:04:15.496415+0000","last_clean":"2024-09-19T06:04:15.496415+0000","last_became_active":"2024-09-19T06:04:03.380154+0000","last_became_peered":"2024-09-19T06:04:03.380154+0000","last_unstale":"2024-09-19T06:04:15.496415+0000","last_undegraded":"2024-09-19T06:04:15.496415+0000","last_fullsized":"2024-09-19T06:04:15.496415+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:48:11.570148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.496343+0000","last_change":"2024-09-19T06:04:12.467995+0000","last_active":"2024-09-19T06:04:15.496343+0000","last_peered":"2024-09-19T06:04:15.496343+0000","last_clean":"2024-09-19T06:04:15.496343+0000","last_became_active":"2024-09-19T06:04:12.467539+0000","last_became_peered":"2024-09-19T06:04:12.467539+0000","last_unstale":"2024-09-19T06:04:15.496343+0000","last_undegraded":"2024-09-19T06:04:15.496343+0000","last_fullsized":"2024-09-19T06:04:15.496343+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:13:29.285909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.464875+0000","last_change":"2024-09-19T06:04:05.429919+0000","last_active":"2024-09-19T06:04:15.464875+0000","last_peered":"2024-09-19T06:04:15.464875+0000","last_clean":"2024-09-19T06:04:15.464875+0000","last_became_active":"2024-09-19T06:04:05.429597+0000","last_became_peered":"2024-09-19T06:04:05.429597+0000","last_unstale":"2024-09-19T06:04:15.464875+0000","last_undegraded":"2024-09-19T06:04:15.464875+0000","last_fullsized":"2024-09-19T06:04:15.464875+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:08:38.816272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.461230+0000","last_change":"2024-09-19T06:04:03.320501+0000","last_active":"2024-09-19T06:04:15.461230+0000","last_peered":"2024-09-19T06:04:15.461230+0000","last_clean":"2024-09-19T06:04:15.461230+0000","last_became_active":"2024-09-19T06:04:03.320093+0000","last_became_peered":"2024-09-19T06:04:03.320093+0000","last_unstale":"2024-09-19T06:04:15.461230+0000","last_undegraded":"2024-09-19T06:04:15.461230+0000","last_fullsized":"2024-09-19T06:04:15.461230+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:31:11.896935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.495327+0000","last_change":"2024-09-19T06:04:12.468455+0000","last_active":"2024-09-19T06:04:15.495327+0000","last_peered":"2024-09-19T06:04:15.495327+0000","last_clean":"2024-09-19T06:04:15.495327+0000","last_became_active":"2024-09-19T06:04:12.468007+0000","last_became_peered":"2024-09-19T06:04:12.468007+0000","last_unstale":"2024-09-19T06:04:15.495327+0000","last_undegraded":"2024-09-19T06:04:15.495327+0000","last_fullsized":"2024-09-19T06:04:15.495327+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:50:58.995825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.495285+0000","last_change":"2024-09-19T06:04:05.427599+0000","last_active":"2024-09-19T06:04:15.495285+0000","last_peered":"2024-09-19T06:04:15.495285+0000","last_clean":"2024-09-19T06:04:15.495285+0000","last_became_active":"2024-09-19T06:04:05.425338+0000","last_became_peered":"2024-09-19T06:04:05.425338+0000","last_unstale":"2024-09-19T06:04:15.495285+0000","last_undegraded":"2024-09-19T06:04:15.495285+0000","last_fullsized":"2024-09-19T06:04:15.495285+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:44.547625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.495456+0000","last_change":"2024-09-19T06:04:03.322165+0000","last_active":"2024-09-19T06:04:15.495456+0000","last_peered":"2024-09-19T06:04:15.495456+0000","last_clean":"2024-09-19T06:04:15.495456+0000","last_became_active":"2024-09-19T06:04:03.321822+0000","last_became_peered":"2024-09-19T06:04:03.321822+0000","last_unstale":"2024-09-19T06:04:15.495456+0000","last_undegraded":"2024-09-19T06:04:15.495456+0000","last_fullsized":"2024-09-19T06:04:15.495456+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:58:00.943453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.494914+0000","last_change":"2024-09-19T06:04:12.465823+0000","last_active":"2024-09-19T06:04:15.494914+0000","last_peered":"2024-09-19T06:04:15.494914+0000","last_clean":"2024-09-19T06:04:15.494914+0000","last_became_active":"2024-09-19T06:04:12.465375+0000","last_became_peered":"2024-09-19T06:04:12.465375+0000","last_unstale":"2024-09-19T06:04:15.494914+0000","last_undegraded":"2024-09-19T06:04:15.494914+0000","last_fullsized":"2024-09-19T06:04:15.494914+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:26:25.428328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.464776+0000","last_change":"2024-09-19T06:04:12.470023+0000","last_active":"2024-09-19T06:04:15.464776+0000","last_peered":"2024-09-19T06:04:15.464776+0000","last_clean":"2024-09-19T06:04:15.464776+0000","last_became_active":"2024-09-19T06:04:12.469651+0000","last_became_peered":"2024-09-19T06:04:12.469651+0000","last_unstale":"2024-09-19T06:04:15.464776+0000","last_undegraded":"2024-09-19T06:04:15.464776+0000","last_fullsized":"2024-09-19T06:04:15.464776+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:50:35.374437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.495376+0000","last_change":"2024-09-19T06:04:05.417466+0000","last_active":"2024-09-19T06:04:15.495376+0000","last_peered":"2024-09-19T06:04:15.495376+0000","last_clean":"2024-09-19T06:04:15.495376+0000","last_became_active":"2024-09-19T06:04:05.417026+0000","last_became_peered":"2024-09-19T06:04:05.417026+0000","last_unstale":"2024-09-19T06:04:15.495376+0000","last_undegraded":"2024-09-19T06:04:15.495376+0000","last_fullsized":"2024-09-19T06:04:15.495376+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:44:08.251755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.495043+0000","last_change":"2024-09-19T06:04:03.317466+0000","last_active":"2024-09-19T06:04:15.495043+0000","last_peered":"2024-09-19T06:04:15.495043+0000","last_clean":"2024-09-19T06:04:15.495043+0000","last_became_active":"2024-09-19T06:04:03.317148+0000","last_became_peered":"2024-09-19T06:04:03.317148+0000","last_unstale":"2024-09-19T06:04:15.495043+0000","last_undegraded":"2024-09-19T06:04:15.495043+0000","last_fullsized":"2024-09-19T06:04:15.495043+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:45:50.789900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.495206+0000","last_change":"2024-09-19T06:04:12.469279+0000","last_active":"2024-09-19T06:04:15.495206+0000","last_peered":"2024-09-19T06:04:15.495206+0000","last_clean":"2024-09-19T06:04:15.495206+0000","last_became_active":"2024-09-19T06:04:12.467928+0000","last_became_peered":"2024-09-19T06:04:12.467928+0000","last_unstale":"2024-09-19T06:04:15.495206+0000","last_undegraded":"2024-09-19T06:04:15.495206+0000","last_fullsized":"2024-09-19T06:04:15.495206+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:52:25.839433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.494895+0000","last_change":"2024-09-19T06:04:05.420425+0000","last_active":"2024-09-19T06:04:15.494895+0000","last_peered":"2024-09-19T06:04:15.494895+0000","last_clean":"2024-09-19T06:04:15.494895+0000","last_became_active":"2024-09-19T06:04:05.420107+0000","last_became_peered":"2024-09-19T06:04:05.420107+0000","last_unstale":"2024-09-19T06:04:15.494895+0000","last_undegraded":"2024-09-19T06:04:15.494895+0000","last_fullsized":"2024-09-19T06:04:15.494895+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:49:24.566302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.494333+0000","last_change":"2024-09-19T06:04:03.315704+0000","last_active":"2024-09-19T06:04:15.494333+0000","last_peered":"2024-09-19T06:04:15.494333+0000","last_clean":"2024-09-19T06:04:15.494333+0000","last_became_active":"2024-09-19T06:04:03.315392+0000","last_became_peered":"2024-09-19T06:04:03.315392+0000","last_unstale":"2024-09-19T06:04:15.494333+0000","last_undegraded":"2024-09-19T06:04:15.494333+0000","last_fullsized":"2024-09-19T06:04:15.494333+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:52:14.417470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"81'1","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.495114+0000","last_change":"2024-09-19T06:04:03.323560+0000","last_active":"2024-09-19T06:04:15.495114+0000","last_peered":"2024-09-19T06:04:15.495114+0000","last_clean":"2024-09-19T06:04:15.495114+0000","last_became_active":"2024-09-19T06:04:03.323188+0000","last_became_peered":"2024-09-19T06:04:03.323188+0000","last_unstale":"2024-09-19T06:04:15.495114+0000","last_undegraded":"2024-09-19T06:04:15.495114+0000","last_fullsized":"2024-09-19T06:04:15.495114+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:02:50.426435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.495938+0000","last_change":"2024-09-19T06:04:05.430677+0000","last_active":"2024-09-19T06:04:15.495938+0000","last_peered":"2024-09-19T06:04:15.495938+0000","last_clean":"2024-09-19T06:04:15.495938+0000","last_became_active":"2024-09-19T06:04:05.430257+0000","last_became_peered":"2024-09-19T06:04:05.430257+0000","last_unstale":"2024-09-19T06:04:15.495938+0000","last_undegraded":"2024-09-19T06:04:15.495938+0000","last_fullsized":"2024-09-19T06:04:15.495938+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:38:42.138770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.496501+0000","last_change":"2024-09-19T06:04:12.465252+0000","last_active":"2024-09-19T06:04:15.496501+0000","last_peered":"2024-09-19T06:04:15.496501+0000","last_clean":"2024-09-19T06:04:15.496501+0000","last_became_active":"2024-09-19T06:04:12.464649+0000","last_became_peered":"2024-09-19T06:04:12.464649+0000","last_unstale":"2024-09-19T06:04:15.496501+0000","last_undegraded":"2024-09-19T06:04:15.496501+0000","last_fullsized":"2024-09-19T06:04:15.496501+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:11:43.137148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"81'1","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.495972+0000","last_change":"2024-09-19T06:04:03.317584+0000","last_active":"2024-09-19T06:04:15.495972+0000","last_peered":"2024-09-19T06:04:15.495972+0000","last_clean":"2024-09-19T06:04:15.495972+0000","last_became_active":"2024-09-19T06:04:03.317250+0000","last_became_peered":"2024-09-19T06:04:03.317250+0000","last_unstale":"2024-09-19T06:04:15.495972+0000","last_undegraded":"2024-09-19T06:04:15.495972+0000","last_fullsized":"2024-09-19T06:04:15.495972+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:22.353887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.463114+0000","last_change":"2024-09-19T06:04:05.431102+0000","last_active":"2024-09-19T06:04:15.463114+0000","last_peered":"2024-09-19T06:04:15.463114+0000","last_clean":"2024-09-19T06:04:15.463114+0000","last_became_active":"2024-09-19T06:04:05.430792+0000","last_became_peered":"2024-09-19T06:04:05.430792+0000","last_unstale":"2024-09-19T06:04:15.463114+0000","last_undegraded":"2024-09-19T06:04:15.463114+0000","last_fullsized":"2024-09-19T06:04:15.463114+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:48:48.682273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.496840+0000","last_change":"2024-09-19T06:04:12.467143+0000","last_active":"2024-09-19T06:04:15.496840+0000","last_peered":"2024-09-19T06:04:15.496840+0000","last_clean":"2024-09-19T06:04:15.496840+0000","last_became_active":"2024-09-19T06:04:12.466672+0000","last_became_peered":"2024-09-19T06:04:12.466672+0000","last_unstale":"2024-09-19T06:04:15.496840+0000","last_undegraded":"2024-09-19T06:04:15.496840+0000","last_fullsized":"2024-09-19T06:04:15.496840+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:57:36.710316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.494492+0000","last_change":"2024-09-19T06:04:05.427387+0000","last_active":"2024-09-19T06:04:15.494492+0000","last_peered":"2024-09-19T06:04:15.494492+0000","last_clean":"2024-09-19T06:04:15.494492+0000","last_became_active":"2024-09-19T06:04:05.427082+0000","last_became_peered":"2024-09-19T06:04:05.427082+0000","last_unstale":"2024-09-19T06:04:15.494492+0000","last_undegraded":"2024-09-19T06:04:15.494492+0000","last_fullsized":"2024-09-19T06:04:15.494492+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:55.931289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.496018+0000","last_change":"2024-09-19T06:04:05.434396+0000","last_active":"2024-09-19T06:04:15.496018+0000","last_peered":"2024-09-19T06:04:15.496018+0000","last_clean":"2024-09-19T06:04:15.496018+0000","last_became_active":"2024-09-19T06:04:05.433907+0000","last_became_peered":"2024-09-19T06:04:05.433907+0000","last_unstale":"2024-09-19T06:04:15.496018+0000","last_undegraded":"2024-09-19T06:04:15.496018+0000","last_fullsized":"2024-09-19T06:04:15.496018+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:02:40.885820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.496127+0000","last_change":"2024-09-19T06:04:05.435813+0000","last_active":"2024-09-19T06:04:15.496127+0000","last_peered":"2024-09-19T06:04:15.496127+0000","last_clean":"2024-09-19T06:04:15.496127+0000","last_became_active":"2024-09-19T06:04:05.435441+0000","last_became_peered":"2024-09-19T06:04:05.435441+0000","last_unstale":"2024-09-19T06:04:15.496127+0000","last_undegraded":"2024-09-19T06:04:15.496127+0000","last_fullsized":"2024-09-19T06:04:15.496127+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:11:20.071732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.464638+0000","last_change":"2024-09-19T06:04:05.433045+0000","last_active":"2024-09-19T06:04:15.464638+0000","last_peered":"2024-09-19T06:04:15.464638+0000","last_clean":"2024-09-19T06:04:15.464638+0000","last_became_active":"2024-09-19T06:04:05.432674+0000","last_became_peered":"2024-09-19T06:04:05.432674+0000","last_unstale":"2024-09-19T06:04:15.464638+0000","last_undegraded":"2024-09-19T06:04:15.464638+0000","last_fullsized":"2024-09-19T06:04:15.464638+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:33:06.743886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.494863+0000","last_change":"2024-09-19T06:04:05.431702+0000","last_active":"2024-09-19T06:04:15.494863+0000","last_peered":"2024-09-19T06:04:15.494863+0000","last_clean":"2024-09-19T06:04:15.494863+0000","last_became_active":"2024-09-19T06:04:05.431394+0000","last_became_peered":"2024-09-19T06:04:05.431394+0000","last_unstale":"2024-09-19T06:04:15.494863+0000","last_undegraded":"2024-09-19T06:04:15.494863+0000","last_fullsized":"2024-09-19T06:04:15.494863+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:42:18.692549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.495030+0000","last_change":"2024-09-19T06:04:05.428315+0000","last_active":"2024-09-19T06:04:15.495030+0000","last_peered":"2024-09-19T06:04:15.495030+0000","last_clean":"2024-09-19T06:04:15.495030+0000","last_became_active":"2024-09-19T06:04:05.428018+0000","last_became_peered":"2024-09-19T06:04:05.428018+0000","last_unstale":"2024-09-19T06:04:15.495030+0000","last_undegraded":"2024-09-19T06:04:15.495030+0000","last_fullsized":"2024-09-19T06:04:15.495030+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:53:50.670653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.496831+0000","last_change":"2024-09-19T06:04:05.430104+0000","last_active":"2024-09-19T06:04:15.496831+0000","last_peered":"2024-09-19T06:04:15.496831+0000","last_clean":"2024-09-19T06:04:15.496831+0000","last_became_active":"2024-09-19T06:04:05.429779+0000","last_became_peered":"2024-09-19T06:04:05.429779+0000","last_unstale":"2024-09-19T06:04:15.496831+0000","last_undegraded":"2024-09-19T06:04:15.496831+0000","last_fullsized":"2024-09-19T06:04:15.496831+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:52:46.191484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.495874+0000","last_change":"2024-09-19T06:04:05.427235+0000","last_active":"2024-09-19T06:04:15.495874+0000","last_peered":"2024-09-19T06:04:15.495874+0000","last_clean":"2024-09-19T06:04:15.495874+0000","last_became_active":"2024-09-19T06:04:05.426937+0000","last_became_peered":"2024-09-19T06:04:05.426937+0000","last_unstale":"2024-09-19T06:04:15.495874+0000","last_undegraded":"2024-09-19T06:04:15.495874+0000","last_fullsized":"2024-09-19T06:04:15.495874+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:55.949564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.494910+0000","last_change":"2024-09-19T06:04:05.422199+0000","last_active":"2024-09-19T06:04:15.494910+0000","last_peered":"2024-09-19T06:04:15.494910+0000","last_clean":"2024-09-19T06:04:15.494910+0000","last_became_active":"2024-09-19T06:04:05.421681+0000","last_became_peered":"2024-09-19T06:04:05.421681+0000","last_unstale":"2024-09-19T06:04:15.494910+0000","last_undegraded":"2024-09-19T06:04:15.494910+0000","last_fullsized":"2024-09-19T06:04:15.494910+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:27:54.774211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.495032+0000","last_change":"2024-09-19T06:04:05.426559+0000","last_active":"2024-09-19T06:04:15.495032+0000","last_peered":"2024-09-19T06:04:15.495032+0000","last_clean":"2024-09-19T06:04:15.495032+0000","last_became_active":"2024-09-19T06:04:05.423197+0000","last_became_peered":"2024-09-19T06:04:05.423197+0000","last_unstale":"2024-09-19T06:04:15.495032+0000","last_undegraded":"2024-09-19T06:04:15.495032+0000","last_fullsized":"2024-09-19T06:04:15.495032+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:43.964457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.494621+0000","last_change":"2024-09-19T06:04:05.435779+0000","last_active":"2024-09-19T06:04:15.494621+0000","last_peered":"2024-09-19T06:04:15.494621+0000","last_clean":"2024-09-19T06:04:15.494621+0000","last_became_active":"2024-09-19T06:04:05.435436+0000","last_became_peered":"2024-09-19T06:04:05.435436+0000","last_unstale":"2024-09-19T06:04:15.494621+0000","last_undegraded":"2024-09-19T06:04:15.494621+0000","last_fullsized":"2024-09-19T06:04:15.494621+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:13:03.341438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.495007+0000","last_change":"2024-09-19T06:04:05.431718+0000","last_active":"2024-09-19T06:04:15.495007+0000","last_peered":"2024-09-19T06:04:15.495007+0000","last_clean":"2024-09-19T06:04:15.495007+0000","last_became_active":"2024-09-19T06:04:05.431429+0000","last_became_peered":"2024-09-19T06:04:05.431429+0000","last_unstale":"2024-09-19T06:04:15.495007+0000","last_undegraded":"2024-09-19T06:04:15.495007+0000","last_fullsized":"2024-09-19T06:04:15.495007+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:11:42.818368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.494774+0000","last_change":"2024-09-19T06:04:05.429575+0000","last_active":"2024-09-19T06:04:15.494774+0000","last_peered":"2024-09-19T06:04:15.494774+0000","last_clean":"2024-09-19T06:04:15.494774+0000","last_became_active":"2024-09-19T06:04:05.429226+0000","last_became_peered":"2024-09-19T06:04:05.429226+0000","last_unstale":"2024-09-19T06:04:15.494774+0000","last_undegraded":"2024-09-19T06:04:15.494774+0000","last_fullsized":"2024-09-19T06:04:15.494774+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:29:19.680433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.496854+0000","last_change":"2024-09-19T06:04:05.431612+0000","last_active":"2024-09-19T06:04:15.496854+0000","last_peered":"2024-09-19T06:04:15.496854+0000","last_clean":"2024-09-19T06:04:15.496854+0000","last_became_active":"2024-09-19T06:04:05.431240+0000","last_became_peered":"2024-09-19T06:04:05.431240+0000","last_unstale":"2024-09-19T06:04:15.496854+0000","last_undegraded":"2024-09-19T06:04:15.496854+0000","last_fullsized":"2024-09-19T06:04:15.496854+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:46:14.138603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.496258+0000","last_change":"2024-09-19T06:04:05.428849+0000","last_active":"2024-09-19T06:04:15.496258+0000","last_peered":"2024-09-19T06:04:15.496258+0000","last_clean":"2024-09-19T06:04:15.496258+0000","last_became_active":"2024-09-19T06:04:05.428516+0000","last_became_peered":"2024-09-19T06:04:05.428516+0000","last_unstale":"2024-09-19T06:04:15.496258+0000","last_undegraded":"2024-09-19T06:04:15.496258+0000","last_fullsized":"2024-09-19T06:04:15.496258+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:58:00.323959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.495321+0000","last_change":"2024-09-19T06:04:05.436409+0000","last_active":"2024-09-19T06:04:15.495321+0000","last_peered":"2024-09-19T06:04:15.495321+0000","last_clean":"2024-09-19T06:04:15.495321+0000","last_became_active":"2024-09-19T06:04:05.436058+0000","last_became_peered":"2024-09-19T06:04:05.436058+0000","last_unstale":"2024-09-19T06:04:15.495321+0000","last_undegraded":"2024-09-19T06:04:15.495321+0000","last_fullsized":"2024-09-19T06:04:15.495321+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:20:45.227159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.494214+0000","last_change":"2024-09-19T06:04:05.434398+0000","last_active":"2024-09-19T06:04:15.494214+0000","last_peered":"2024-09-19T06:04:15.494214+0000","last_clean":"2024-09-19T06:04:15.494214+0000","last_became_active":"2024-09-19T06:04:05.433635+0000","last_became_peered":"2024-09-19T06:04:05.433635+0000","last_unstale":"2024-09-19T06:04:15.494214+0000","last_undegraded":"2024-09-19T06:04:15.494214+0000","last_fullsized":"2024-09-19T06:04:15.494214+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:10:42.104705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.464300+0000","last_change":"2024-09-19T06:04:05.423447+0000","last_active":"2024-09-19T06:04:15.464300+0000","last_peered":"2024-09-19T06:04:15.464300+0000","last_clean":"2024-09-19T06:04:15.464300+0000","last_became_active":"2024-09-19T06:04:05.423081+0000","last_became_peered":"2024-09-19T06:04:05.423081+0000","last_unstale":"2024-09-19T06:04:15.464300+0000","last_undegraded":"2024-09-19T06:04:15.464300+0000","last_fullsized":"2024-09-19T06:04:15.464300+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:03:54.856251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.464308+0000","last_change":"2024-09-19T06:04:05.426371+0000","last_active":"2024-09-19T06:04:15.464308+0000","last_peered":"2024-09-19T06:04:15.464308+0000","last_clean":"2024-09-19T06:04:15.464308+0000","last_became_active":"2024-09-19T06:04:05.425601+0000","last_became_peered":"2024-09-19T06:04:05.425601+0000","last_unstale":"2024-09-19T06:04:15.464308+0000","last_undegraded":"2024-09-19T06:04:15.464308+0000","last_fullsized":"2024-09-19T06:04:15.464308+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:55:05.677121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.494912+0000","last_change":"2024-09-19T06:04:05.426264+0000","last_active":"2024-09-19T06:04:15.494912+0000","last_peered":"2024-09-19T06:04:15.494912+0000","last_clean":"2024-09-19T06:04:15.494912+0000","last_became_active":"2024-09-19T06:04:05.425939+0000","last_became_peered":"2024-09-19T06:04:05.425939+0000","last_unstale":"2024-09-19T06:04:15.494912+0000","last_undegraded":"2024-09-19T06:04:15.494912+0000","last_fullsized":"2024-09-19T06:04:15.494912+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:18:43.250682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.496367+0000","last_change":"2024-09-19T06:04:05.432654+0000","last_active":"2024-09-19T06:04:15.496367+0000","last_peered":"2024-09-19T06:04:15.496367+0000","last_clean":"2024-09-19T06:04:15.496367+0000","last_became_active":"2024-09-19T06:04:05.431489+0000","last_became_peered":"2024-09-19T06:04:05.431489+0000","last_unstale":"2024-09-19T06:04:15.496367+0000","last_undegraded":"2024-09-19T06:04:15.496367+0000","last_fullsized":"2024-09-19T06:04:15.496367+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:15:41.251538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.461475+0000","last_change":"2024-09-19T06:04:05.435221+0000","last_active":"2024-09-19T06:04:15.461475+0000","last_peered":"2024-09-19T06:04:15.461475+0000","last_clean":"2024-09-19T06:04:15.461475+0000","last_became_active":"2024-09-19T06:04:05.434909+0000","last_became_peered":"2024-09-19T06:04:05.434909+0000","last_unstale":"2024-09-19T06:04:15.461475+0000","last_undegraded":"2024-09-19T06:04:15.461475+0000","last_fullsized":"2024-09-19T06:04:15.461475+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:15:20.414499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.495538+0000","last_change":"2024-09-19T06:04:05.426472+0000","last_active":"2024-09-19T06:04:15.495538+0000","last_peered":"2024-09-19T06:04:15.495538+0000","last_clean":"2024-09-19T06:04:15.495538+0000","last_became_active":"2024-09-19T06:04:05.426141+0000","last_became_peered":"2024-09-19T06:04:05.426141+0000","last_unstale":"2024-09-19T06:04:15.495538+0000","last_undegraded":"2024-09-19T06:04:15.495538+0000","last_fullsized":"2024-09-19T06:04:15.495538+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:57:25.022094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.495530+0000","last_change":"2024-09-19T06:04:05.432940+0000","last_active":"2024-09-19T06:04:15.495530+0000","last_peered":"2024-09-19T06:04:15.495530+0000","last_clean":"2024-09-19T06:04:15.495530+0000","last_became_active":"2024-09-19T06:04:05.432579+0000","last_became_peered":"2024-09-19T06:04:05.432579+0000","last_unstale":"2024-09-19T06:04:15.495530+0000","last_undegraded":"2024-09-19T06:04:15.495530+0000","last_fullsized":"2024-09-19T06:04:15.495530+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:56.740048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.494785+0000","last_change":"2024-09-19T06:04:05.417967+0000","last_active":"2024-09-19T06:04:15.494785+0000","last_peered":"2024-09-19T06:04:15.494785+0000","last_clean":"2024-09-19T06:04:15.494785+0000","last_became_active":"2024-09-19T06:04:05.417658+0000","last_became_peered":"2024-09-19T06:04:05.417658+0000","last_unstale":"2024-09-19T06:04:15.494785+0000","last_undegraded":"2024-09-19T06:04:15.494785+0000","last_fullsized":"2024-09-19T06:04:15.494785+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:55.571313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.460861+0000","last_change":"2024-09-19T06:04:05.424627+0000","last_active":"2024-09-19T06:04:15.460861+0000","last_peered":"2024-09-19T06:04:15.460861+0000","last_clean":"2024-09-19T06:04:15.460861+0000","last_became_active":"2024-09-19T06:04:05.424301+0000","last_became_peered":"2024-09-19T06:04:05.424301+0000","last_unstale":"2024-09-19T06:04:15.460861+0000","last_undegraded":"2024-09-19T06:04:15.460861+0000","last_fullsized":"2024-09-19T06:04:15.460861+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:48:00.964989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.494995+0000","last_change":"2024-09-19T06:04:05.423635+0000","last_active":"2024-09-19T06:04:15.494995+0000","last_peered":"2024-09-19T06:04:15.494995+0000","last_clean":"2024-09-19T06:04:15.494995+0000","last_became_active":"2024-09-19T06:04:05.422625+0000","last_became_peered":"2024-09-19T06:04:05.422625+0000","last_unstale":"2024-09-19T06:04:15.494995+0000","last_undegraded":"2024-09-19T06:04:15.494995+0000","last_fullsized":"2024-09-19T06:04:15.494995+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:33:34.099443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.463107+0000","last_change":"2024-09-19T06:04:05.428933+0000","last_active":"2024-09-19T06:04:15.463107+0000","last_peered":"2024-09-19T06:04:15.463107+0000","last_clean":"2024-09-19T06:04:15.463107+0000","last_became_active":"2024-09-19T06:04:05.428598+0000","last_became_peered":"2024-09-19T06:04:05.428598+0000","last_unstale":"2024-09-19T06:04:15.463107+0000","last_undegraded":"2024-09-19T06:04:15.463107+0000","last_fullsized":"2024-09-19T06:04:15.463107+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:27:15.111954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.496318+0000","last_change":"2024-09-19T06:04:05.431661+0000","last_active":"2024-09-19T06:04:15.496318+0000","last_peered":"2024-09-19T06:04:15.496318+0000","last_clean":"2024-09-19T06:04:15.496318+0000","last_became_active":"2024-09-19T06:04:05.430579+0000","last_became_peered":"2024-09-19T06:04:05.430579+0000","last_unstale":"2024-09-19T06:04:15.496318+0000","last_undegraded":"2024-09-19T06:04:15.496318+0000","last_fullsized":"2024-09-19T06:04:15.496318+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:02:46.505053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.464462+0000","last_change":"2024-09-19T06:04:05.430427+0000","last_active":"2024-09-19T06:04:15.464462+0000","last_peered":"2024-09-19T06:04:15.464462+0000","last_clean":"2024-09-19T06:04:15.464462+0000","last_became_active":"2024-09-19T06:04:05.430106+0000","last_became_peered":"2024-09-19T06:04:05.430106+0000","last_unstale":"2024-09-19T06:04:15.464462+0000","last_undegraded":"2024-09-19T06:04:15.464462+0000","last_fullsized":"2024-09-19T06:04:15.464462+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:03:00.764689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.464577+0000","last_change":"2024-09-19T06:04:05.427189+0000","last_active":"2024-09-19T06:04:15.464577+0000","last_peered":"2024-09-19T06:04:15.464577+0000","last_clean":"2024-09-19T06:04:15.464577+0000","last_became_active":"2024-09-19T06:04:05.426874+0000","last_became_peered":"2024-09-19T06:04:05.426874+0000","last_unstale":"2024-09-19T06:04:15.464577+0000","last_undegraded":"2024-09-19T06:04:15.464577+0000","last_fullsized":"2024-09-19T06:04:15.464577+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:37:10.910723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.495314+0000","last_change":"2024-09-19T06:04:05.435803+0000","last_active":"2024-09-19T06:04:15.495314+0000","last_peered":"2024-09-19T06:04:15.495314+0000","last_clean":"2024-09-19T06:04:15.495314+0000","last_became_active":"2024-09-19T06:04:05.435430+0000","last_became_peered":"2024-09-19T06:04:05.435430+0000","last_unstale":"2024-09-19T06:04:15.495314+0000","last_undegraded":"2024-09-19T06:04:15.495314+0000","last_fullsized":"2024-09-19T06:04:15.495314+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:41.828016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":49896,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":37,"num_read_kb":69,"num_write":71,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":233472,"data_stored":149688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":61,"ondisk_log_size":61,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547223,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":970752,"data_stored":478846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776156,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36936,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708216,"statfs":{"total":95995035648,"available":95957213184,"internally_reserved":0,"allocated":1630208,"data_stored":1114410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939681,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":978944,"data_stored":483524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168613,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":978944,"data_stored":479450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397546,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36880,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708272,"statfs":{"total":95995035648,"available":95957270528,"internally_reserved":0,"allocated":1572864,"data_stored":1073892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561072,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":966656,"data_stored":474750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790004,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28564,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716588,"statfs":{"total":95995035648,"available":95965786112,"internally_reserved":0,"allocated":1576960,"data_stored":1069396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953529,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":478868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182462,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36296,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708856,"statfs":{"total":95995035648,"available":95957868544,"internally_reserved":0,"allocated":974848,"data_stored":474854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411396,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1028096,"data_stored":523882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574921,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1024000,"data_stored":523848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738446,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":970752,"data_stored":474840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":49098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":49132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":49292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T06:04:57.379 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T06:04:57.645 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:04:57.905 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:57 smithi037 ceph-mon[31211]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:04:57.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:57 smithi099 ceph-mon[35300]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:04:57.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:57 smithi117 ceph-mon[35050]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:04:58.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:58.113+0000 7ffa30292640 1 -- 172.21.15.37:0/2320370860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa28102790 msgr2=0x7ffa281067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:58.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:58.113+0000 7ffa30292640 1 --2- 172.21.15.37:0/2320370860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa28102790 0x7ffa281067e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ffa18009900 tx=0x7ffa1802a410 comp rx=0 tx=0).stop 2024-09-19T06:04:58.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:58.113+0000 7ffa30292640 1 -- 172.21.15.37:0/2320370860 shutdown_connections 2024-09-19T06:04:58.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:58.113+0000 7ffa30292640 1 --2- 172.21.15.37:0/2320370860 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa28106f10 0x7ffa2810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:58.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:58.113+0000 7ffa30292640 1 --2- 172.21.15.37:0/2320370860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa28102790 0x7ffa281067e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:58.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:58.113+0000 7ffa30292640 1 --2- 172.21.15.37:0/2320370860 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa28101de0 0x7ffa281021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:58.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:58.113+0000 7ffa30292640 1 -- 172.21.15.37:0/2320370860 >> 172.21.15.37:0/2320370860 conn(0x7ffa280fd8c0 msgr2=0x7ffa280ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:58.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:58.114+0000 7ffa30292640 1 -- 172.21.15.37:0/2320370860 shutdown_connections 2024-09-19T06:04:58.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:58.114+0000 7ffa30292640 1 -- 172.21.15.37:0/2320370860 wait complete. 2024-09-19T06:04:58.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:58.114+0000 7ffa30292640 1 Processor -- start 2024-09-19T06:04:58.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:58.114+0000 7ffa30292640 1 -- start start 2024-09-19T06:04:58.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:58.115+0000 7ffa30292640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa28101de0 0x7ffa281984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:58.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:58.115+0000 7ffa30292640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa28102790 0x7ffa281989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:58.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:58.115+0000 7ffa30292640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa28106f10 0x7ffa2819cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:58.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:58.115+0000 7ffa30292640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ffa28112000 con 0x7ffa28102790 2024-09-19T06:04:58.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:58.115+0000 7ffa30292640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ffa28111e80 con 0x7ffa28106f10 2024-09-19T06:04:58.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:58.115+0000 7ffa30292640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ffa28112180 con 0x7ffa28101de0 2024-09-19T06:04:58.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:58.115+0000 7ffa2d82d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa28102790 0x7ffa281989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:58.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:58.115+0000 7ffa2d82d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa28102790 0x7ffa281989e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50176/0 (socket says 172.21.15.37:50176) 2024-09-19T06:04:58.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:58.115+0000 7ffa2d82d640 1 -- 172.21.15.37:0/1851969944 learned_addr learned my addr 172.21.15.37:0/1851969944 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:04:58.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:58.115+0000 7ffa2e02e640 1 --2- 172.21.15.37:0/1851969944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa28101de0 0x7ffa281984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:58.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:58.115+0000 7ffa2e82f640 1 --2- 172.21.15.37:0/1851969944 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa28106f10 0x7ffa2819cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:58.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:58.115+0000 7ffa2d82d640 1 -- 172.21.15.37:0/1851969944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa28101de0 msgr2=0x7ffa281984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:58.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:58.115+0000 7ffa2d82d640 1 --2- 172.21.15.37:0/1851969944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa28101de0 0x7ffa281984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:58.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:58.115+0000 7ffa2d82d640 1 -- 172.21.15.37:0/1851969944 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa28106f10 msgr2=0x7ffa2819cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:58.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:58.115+0000 7ffa2d82d640 1 --2- 172.21.15.37:0/1851969944 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa28106f10 0x7ffa2819cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:58.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:58.115+0000 7ffa2d82d640 1 -- 172.21.15.37:0/1851969944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa2819d450 con 0x7ffa28102790 2024-09-19T06:04:58.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:58.115+0000 7ffa2e82f640 1 --2- 172.21.15.37:0/1851969944 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa28106f10 0x7ffa2819cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:04:58.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:58.115+0000 7ffa2d82d640 1 --2- 172.21.15.37:0/1851969944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa28102790 0x7ffa281989e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ffa18004770 tx=0x7ffa18003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:58.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:58.115+0000 7ffa1f7fe640 1 -- 172.21.15.37:0/1851969944 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa1803f070 con 0x7ffa28102790 2024-09-19T06:04:58.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:58.115+0000 7ffa1f7fe640 1 -- 172.21.15.37:0/1851969944 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa18031ca0 con 0x7ffa28102790 2024-09-19T06:04:58.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:58.116+0000 7ffa1f7fe640 1 -- 172.21.15.37:0/1851969944 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa18035030 con 0x7ffa28102790 2024-09-19T06:04:58.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:58.116+0000 7ffa30292640 1 -- 172.21.15.37:0/1851969944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa2819d6e0 con 0x7ffa28102790 2024-09-19T06:04:58.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:58.116+0000 7ffa30292640 1 -- 172.21.15.37:0/1851969944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa281a5020 con 0x7ffa28102790 2024-09-19T06:04:58.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:58.117+0000 7ffa30292640 1 -- 172.21.15.37:0/1851969944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa281021c0 con 0x7ffa28102790 2024-09-19T06:04:58.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:58.119+0000 7ffa1f7fe640 1 -- 172.21.15.37:0/1851969944 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7ffa18042070 con 0x7ffa28102790 2024-09-19T06:04:58.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:58.119+0000 7ffa1f7fe640 1 --2- 172.21.15.37:0/1851969944 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7ffa140a3350 0x7ffa140a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:58.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:58.119+0000 7ffa1f7fe640 1 -- 172.21.15.37:0/1851969944 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7ffa180f07f0 con 0x7ffa28102790 2024-09-19T06:04:58.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:58.119+0000 7ffa2e02e640 1 --2- 172.21.15.37:0/1851969944 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7ffa140a3350 0x7ffa140a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:58.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:58.120+0000 7ffa2e02e640 1 --2- 172.21.15.37:0/1851969944 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7ffa140a3350 0x7ffa140a5810 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ffa24005fd0 tx=0x7ffa2400b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:58.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:58.123+0000 7ffa1f7fe640 1 -- 172.21.15.37:0/1851969944 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ffa180bd280 con 0x7ffa28102790 2024-09-19T06:04:58.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:58.296+0000 7ffa30292640 1 -- 172.21.15.37:0/1851969944 --> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ffa2810a180 con 0x7ffa140a3350 2024-09-19T06:04:58.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:58.304+0000 7ffa1f7fe640 1 -- 172.21.15.37:0/1851969944 <== mgr.14148 v2:172.21.15.37:6800/3797010169 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340255 (secure 0 0 0) 0x7ffa2810a180 con 0x7ffa140a3350 2024-09-19T06:04:58.311 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T06:04:58.314 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-19T06:04:58.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:58.308+0000 7ffa30292640 1 -- 172.21.15.37:0/1851969944 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7ffa140a3350 msgr2=0x7ffa140a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:58.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:58.308+0000 7ffa30292640 1 --2- 172.21.15.37:0/1851969944 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7ffa140a3350 0x7ffa140a5810 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ffa24005fd0 tx=0x7ffa2400b390 comp rx=0 tx=0).stop 2024-09-19T06:04:58.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:58.308+0000 7ffa30292640 1 -- 172.21.15.37:0/1851969944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa28102790 msgr2=0x7ffa281989e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:58.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:58.308+0000 7ffa30292640 1 --2- 172.21.15.37:0/1851969944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa28102790 0x7ffa281989e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ffa18004770 tx=0x7ffa18003c10 comp rx=0 tx=0).stop 2024-09-19T06:04:58.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:58.308+0000 7ffa30292640 1 -- 172.21.15.37:0/1851969944 shutdown_connections 2024-09-19T06:04:58.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:58.308+0000 7ffa30292640 1 --2- 172.21.15.37:0/1851969944 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7ffa140a3350 0x7ffa140a5810 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:58.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:58.308+0000 7ffa30292640 1 --2- 172.21.15.37:0/1851969944 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa28106f10 0x7ffa2819cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:58.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:58.308+0000 7ffa30292640 1 --2- 172.21.15.37:0/1851969944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa28102790 0x7ffa281989e0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:58.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:58.308+0000 7ffa30292640 1 --2- 172.21.15.37:0/1851969944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa28101de0 0x7ffa281984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:58.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:58.308+0000 7ffa30292640 1 -- 172.21.15.37:0/1851969944 >> 172.21.15.37:0/1851969944 conn(0x7ffa280fd8c0 msgr2=0x7ffa280fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:58.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:58.308+0000 7ffa30292640 1 -- 172.21.15.37:0/1851969944 shutdown_connections 2024-09-19T06:04:58.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:58.308+0000 7ffa30292640 1 -- 172.21.15.37:0/1851969944 wait complete. 2024-09-19T06:04:58.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:58 smithi099 ceph-mon[35300]: pgmap v309: 129 pgs: 129 active+clean; 625 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 4.7 KiB/s wr, 3 op/s 2024-09-19T06:04:58.981 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:58 smithi037 ceph-mon[31211]: pgmap v309: 129 pgs: 129 active+clean; 625 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 4.7 KiB/s wr, 3 op/s 2024-09-19T06:04:58.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:58 smithi117 ceph-mon[35050]: pgmap v309: 129 pgs: 129 active+clean; 625 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 4.7 KiB/s wr, 3 op/s 2024-09-19T06:04:59.010 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":309,"stamp":"2024-09-19T06:04:56.655353+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":640498,"num_objects":26,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":163,"num_read_kb":178,"num_write":254,"num_write_kb":3013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":200,"ondisk_log_size":200,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":362588,"kb_used_data":13328,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124579236,"statfs":{"total":1151940427776,"available":1151569137664,"internally_reserved":0,"allocated":13647872,"data_stored":7650560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":357414202},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":45488,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":55,"num_write":24,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003814"},"pg_stats":[{"pgid":"2.1f","version":"81'4","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.496490+0000","last_change":"2024-09-19T06:04:03.323722+0000","last_active":"2024-09-19T06:04:15.496490+0000","last_peered":"2024-09-19T06:04:15.496490+0000","last_clean":"2024-09-19T06:04:15.496490+0000","last_became_active":"2024-09-19T06:04:03.323380+0000","last_became_peered":"2024-09-19T06:04:03.323380+0000","last_unstale":"2024-09-19T06:04:15.496490+0000","last_undegraded":"2024-09-19T06:04:15.496490+0000","last_fullsized":"2024-09-19T06:04:15.496490+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:49:17.449780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.495302+0000","last_change":"2024-09-19T06:04:05.427994+0000","last_active":"2024-09-19T06:04:15.495302+0000","last_peered":"2024-09-19T06:04:15.495302+0000","last_clean":"2024-09-19T06:04:15.495302+0000","last_became_active":"2024-09-19T06:04:05.427745+0000","last_became_peered":"2024-09-19T06:04:05.427745+0000","last_unstale":"2024-09-19T06:04:15.495302+0000","last_undegraded":"2024-09-19T06:04:15.495302+0000","last_fullsized":"2024-09-19T06:04:15.495302+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:54.917003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.495578+0000","last_change":"2024-09-19T06:04:12.463838+0000","last_active":"2024-09-19T06:04:15.495578+0000","last_peered":"2024-09-19T06:04:15.495578+0000","last_clean":"2024-09-19T06:04:15.495578+0000","last_became_active":"2024-09-19T06:04:12.463426+0000","last_became_peered":"2024-09-19T06:04:12.463426+0000","last_unstale":"2024-09-19T06:04:15.495578+0000","last_undegraded":"2024-09-19T06:04:15.495578+0000","last_fullsized":"2024-09-19T06:04:15.495578+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:40:37.994203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"81'1","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.495619+0000","last_change":"2024-09-19T06:04:03.378129+0000","last_active":"2024-09-19T06:04:15.495619+0000","last_peered":"2024-09-19T06:04:15.495619+0000","last_clean":"2024-09-19T06:04:15.495619+0000","last_became_active":"2024-09-19T06:04:03.377793+0000","last_became_peered":"2024-09-19T06:04:03.377793+0000","last_unstale":"2024-09-19T06:04:15.495619+0000","last_undegraded":"2024-09-19T06:04:15.495619+0000","last_fullsized":"2024-09-19T06:04:15.495619+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:38:22.739168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.464818+0000","last_change":"2024-09-19T06:04:05.433909+0000","last_active":"2024-09-19T06:04:15.464818+0000","last_peered":"2024-09-19T06:04:15.464818+0000","last_clean":"2024-09-19T06:04:15.464818+0000","last_became_active":"2024-09-19T06:04:05.433591+0000","last_became_peered":"2024-09-19T06:04:05.433591+0000","last_unstale":"2024-09-19T06:04:15.464818+0000","last_undegraded":"2024-09-19T06:04:15.464818+0000","last_fullsized":"2024-09-19T06:04:15.464818+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:19:18.916703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.495431+0000","last_change":"2024-09-19T06:04:12.468984+0000","last_active":"2024-09-19T06:04:15.495431+0000","last_peered":"2024-09-19T06:04:15.495431+0000","last_clean":"2024-09-19T06:04:15.495431+0000","last_became_active":"2024-09-19T06:04:12.467287+0000","last_became_peered":"2024-09-19T06:04:12.467287+0000","last_unstale":"2024-09-19T06:04:15.495431+0000","last_undegraded":"2024-09-19T06:04:15.495431+0000","last_fullsized":"2024-09-19T06:04:15.495431+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:05:46.279679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.463530+0000","last_change":"2024-09-19T06:04:03.319764+0000","last_active":"2024-09-19T06:04:15.463530+0000","last_peered":"2024-09-19T06:04:15.463530+0000","last_clean":"2024-09-19T06:04:15.463530+0000","last_became_active":"2024-09-19T06:04:03.319415+0000","last_became_peered":"2024-09-19T06:04:03.319415+0000","last_unstale":"2024-09-19T06:04:15.463530+0000","last_undegraded":"2024-09-19T06:04:15.463530+0000","last_fullsized":"2024-09-19T06:04:15.463530+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:34.900872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.494650+0000","last_change":"2024-09-19T06:04:05.430288+0000","last_active":"2024-09-19T06:04:15.494650+0000","last_peered":"2024-09-19T06:04:15.494650+0000","last_clean":"2024-09-19T06:04:15.494650+0000","last_became_active":"2024-09-19T06:04:05.429947+0000","last_became_peered":"2024-09-19T06:04:05.429947+0000","last_unstale":"2024-09-19T06:04:15.494650+0000","last_undegraded":"2024-09-19T06:04:15.494650+0000","last_fullsized":"2024-09-19T06:04:15.494650+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:43:09.169658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.496100+0000","last_change":"2024-09-19T06:04:12.465946+0000","last_active":"2024-09-19T06:04:15.496100+0000","last_peered":"2024-09-19T06:04:15.496100+0000","last_clean":"2024-09-19T06:04:15.496100+0000","last_became_active":"2024-09-19T06:04:12.465553+0000","last_became_peered":"2024-09-19T06:04:12.465553+0000","last_unstale":"2024-09-19T06:04:15.496100+0000","last_undegraded":"2024-09-19T06:04:15.496100+0000","last_fullsized":"2024-09-19T06:04:15.496100+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:50:41.181483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.463430+0000","last_change":"2024-09-19T06:04:03.318528+0000","last_active":"2024-09-19T06:04:15.463430+0000","last_peered":"2024-09-19T06:04:15.463430+0000","last_clean":"2024-09-19T06:04:15.463430+0000","last_became_active":"2024-09-19T06:04:03.318210+0000","last_became_peered":"2024-09-19T06:04:03.318210+0000","last_unstale":"2024-09-19T06:04:15.463430+0000","last_undegraded":"2024-09-19T06:04:15.463430+0000","last_fullsized":"2024-09-19T06:04:15.463430+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:06.766545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.496288+0000","last_change":"2024-09-19T06:04:05.427025+0000","last_active":"2024-09-19T06:04:15.496288+0000","last_peered":"2024-09-19T06:04:15.496288+0000","last_clean":"2024-09-19T06:04:15.496288+0000","last_became_active":"2024-09-19T06:04:05.425679+0000","last_became_peered":"2024-09-19T06:04:05.425679+0000","last_unstale":"2024-09-19T06:04:15.496288+0000","last_undegraded":"2024-09-19T06:04:15.496288+0000","last_fullsized":"2024-09-19T06:04:15.496288+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:26:06.480664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.495732+0000","last_change":"2024-09-19T06:04:12.467065+0000","last_active":"2024-09-19T06:04:15.495732+0000","last_peered":"2024-09-19T06:04:15.495732+0000","last_clean":"2024-09-19T06:04:15.495732+0000","last_became_active":"2024-09-19T06:04:12.465961+0000","last_became_peered":"2024-09-19T06:04:12.465961+0000","last_unstale":"2024-09-19T06:04:15.495732+0000","last_undegraded":"2024-09-19T06:04:15.495732+0000","last_fullsized":"2024-09-19T06:04:15.495732+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:13:38.566692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.461219+0000","last_change":"2024-09-19T06:04:05.436202+0000","last_active":"2024-09-19T06:04:15.461219+0000","last_peered":"2024-09-19T06:04:15.461219+0000","last_clean":"2024-09-19T06:04:15.461219+0000","last_became_active":"2024-09-19T06:04:05.435779+0000","last_became_peered":"2024-09-19T06:04:05.435779+0000","last_unstale":"2024-09-19T06:04:15.461219+0000","last_undegraded":"2024-09-19T06:04:15.461219+0000","last_fullsized":"2024-09-19T06:04:15.461219+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:27:56.463592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":33,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.463214+0000","last_change":"2024-09-19T06:04:03.320472+0000","last_active":"2024-09-19T06:04:15.463214+0000","last_peered":"2024-09-19T06:04:15.463214+0000","last_clean":"2024-09-19T06:04:15.463214+0000","last_became_active":"2024-09-19T06:04:03.320178+0000","last_became_peered":"2024-09-19T06:04:03.320178+0000","last_unstale":"2024-09-19T06:04:15.463214+0000","last_undegraded":"2024-09-19T06:04:15.463214+0000","last_fullsized":"2024-09-19T06:04:15.463214+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:23.285302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.496082+0000","last_change":"2024-09-19T06:04:12.635733+0000","last_active":"2024-09-19T06:04:15.496082+0000","last_peered":"2024-09-19T06:04:15.496082+0000","last_clean":"2024-09-19T06:04:15.496082+0000","last_became_active":"2024-09-19T06:04:12.634938+0000","last_became_peered":"2024-09-19T06:04:12.634938+0000","last_unstale":"2024-09-19T06:04:15.496082+0000","last_undegraded":"2024-09-19T06:04:15.496082+0000","last_fullsized":"2024-09-19T06:04:15.496082+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:44:09.015733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.494973+0000","last_change":"2024-09-19T06:04:05.418702+0000","last_active":"2024-09-19T06:04:15.494973+0000","last_peered":"2024-09-19T06:04:15.494973+0000","last_clean":"2024-09-19T06:04:15.494973+0000","last_became_active":"2024-09-19T06:04:05.418213+0000","last_became_peered":"2024-09-19T06:04:05.418213+0000","last_unstale":"2024-09-19T06:04:15.494973+0000","last_undegraded":"2024-09-19T06:04:15.494973+0000","last_fullsized":"2024-09-19T06:04:15.494973+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:46:01.865286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.496224+0000","last_change":"2024-09-19T06:04:03.323683+0000","last_active":"2024-09-19T06:04:15.496224+0000","last_peered":"2024-09-19T06:04:15.496224+0000","last_clean":"2024-09-19T06:04:15.496224+0000","last_became_active":"2024-09-19T06:04:03.323166+0000","last_became_peered":"2024-09-19T06:04:03.323166+0000","last_unstale":"2024-09-19T06:04:15.496224+0000","last_undegraded":"2024-09-19T06:04:15.496224+0000","last_fullsized":"2024-09-19T06:04:15.496224+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:53.787307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"87'1","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.496252+0000","last_change":"2024-09-19T06:04:12.467620+0000","last_active":"2024-09-19T06:04:15.496252+0000","last_peered":"2024-09-19T06:04:15.496252+0000","last_clean":"2024-09-19T06:04:15.496252+0000","last_became_active":"2024-09-19T06:04:12.467231+0000","last_became_peered":"2024-09-19T06:04:12.467231+0000","last_unstale":"2024-09-19T06:04:15.496252+0000","last_undegraded":"2024-09-19T06:04:15.496252+0000","last_fullsized":"2024-09-19T06:04:15.496252+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:12:07.731338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.494618+0000","last_change":"2024-09-19T06:04:05.426415+0000","last_active":"2024-09-19T06:04:15.494618+0000","last_peered":"2024-09-19T06:04:15.494618+0000","last_clean":"2024-09-19T06:04:15.494618+0000","last_became_active":"2024-09-19T06:04:05.426061+0000","last_became_peered":"2024-09-19T06:04:05.426061+0000","last_unstale":"2024-09-19T06:04:15.494618+0000","last_undegraded":"2024-09-19T06:04:15.494618+0000","last_fullsized":"2024-09-19T06:04:15.494618+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:44.810600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.495211+0000","last_change":"2024-09-19T06:04:03.319185+0000","last_active":"2024-09-19T06:04:15.495211+0000","last_peered":"2024-09-19T06:04:15.495211+0000","last_clean":"2024-09-19T06:04:15.495211+0000","last_became_active":"2024-09-19T06:04:03.318788+0000","last_became_peered":"2024-09-19T06:04:03.318788+0000","last_unstale":"2024-09-19T06:04:15.495211+0000","last_undegraded":"2024-09-19T06:04:15.495211+0000","last_fullsized":"2024-09-19T06:04:15.495211+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:41:14.668303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.496266+0000","last_change":"2024-09-19T06:04:12.467703+0000","last_active":"2024-09-19T06:04:15.496266+0000","last_peered":"2024-09-19T06:04:15.496266+0000","last_clean":"2024-09-19T06:04:15.496266+0000","last_became_active":"2024-09-19T06:04:12.467287+0000","last_became_peered":"2024-09-19T06:04:12.467287+0000","last_unstale":"2024-09-19T06:04:15.496266+0000","last_undegraded":"2024-09-19T06:04:15.496266+0000","last_fullsized":"2024-09-19T06:04:15.496266+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:04:17.961912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.462962+0000","last_change":"2024-09-19T06:04:05.428027+0000","last_active":"2024-09-19T06:04:15.462962+0000","last_peered":"2024-09-19T06:04:15.462962+0000","last_clean":"2024-09-19T06:04:15.462962+0000","last_became_active":"2024-09-19T06:04:05.427698+0000","last_became_peered":"2024-09-19T06:04:05.427698+0000","last_unstale":"2024-09-19T06:04:15.462962+0000","last_undegraded":"2024-09-19T06:04:15.462962+0000","last_fullsized":"2024-09-19T06:04:15.462962+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:06:34.627086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.494400+0000","last_change":"2024-09-19T06:04:03.380435+0000","last_active":"2024-09-19T06:04:15.494400+0000","last_peered":"2024-09-19T06:04:15.494400+0000","last_clean":"2024-09-19T06:04:15.494400+0000","last_became_active":"2024-09-19T06:04:03.380102+0000","last_became_peered":"2024-09-19T06:04:03.380102+0000","last_unstale":"2024-09-19T06:04:15.494400+0000","last_undegraded":"2024-09-19T06:04:15.494400+0000","last_fullsized":"2024-09-19T06:04:15.494400+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:43.886466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.496141+0000","last_change":"2024-09-19T06:04:12.636056+0000","last_active":"2024-09-19T06:04:15.496141+0000","last_peered":"2024-09-19T06:04:15.496141+0000","last_clean":"2024-09-19T06:04:15.496141+0000","last_became_active":"2024-09-19T06:04:12.635258+0000","last_became_peered":"2024-09-19T06:04:12.635258+0000","last_unstale":"2024-09-19T06:04:15.496141+0000","last_undegraded":"2024-09-19T06:04:15.496141+0000","last_fullsized":"2024-09-19T06:04:15.496141+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:47:15.300131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.464778+0000","last_change":"2024-09-19T06:04:05.422587+0000","last_active":"2024-09-19T06:04:15.464778+0000","last_peered":"2024-09-19T06:04:15.464778+0000","last_clean":"2024-09-19T06:04:15.464778+0000","last_became_active":"2024-09-19T06:04:05.422284+0000","last_became_peered":"2024-09-19T06:04:05.422284+0000","last_unstale":"2024-09-19T06:04:15.464778+0000","last_undegraded":"2024-09-19T06:04:15.464778+0000","last_fullsized":"2024-09-19T06:04:15.464778+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:12:11.885251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"81'2","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.496082+0000","last_change":"2024-09-19T06:04:03.376510+0000","last_active":"2024-09-19T06:04:15.496082+0000","last_peered":"2024-09-19T06:04:15.496082+0000","last_clean":"2024-09-19T06:04:15.496082+0000","last_became_active":"2024-09-19T06:04:03.376241+0000","last_became_peered":"2024-09-19T06:04:03.376241+0000","last_unstale":"2024-09-19T06:04:15.496082+0000","last_undegraded":"2024-09-19T06:04:15.496082+0000","last_fullsized":"2024-09-19T06:04:15.496082+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:19:29.209233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.495819+0000","last_change":"2024-09-19T06:04:12.462237+0000","last_active":"2024-09-19T06:04:15.495819+0000","last_peered":"2024-09-19T06:04:15.495819+0000","last_clean":"2024-09-19T06:04:15.495819+0000","last_became_active":"2024-09-19T06:04:12.461771+0000","last_became_peered":"2024-09-19T06:04:12.461771+0000","last_unstale":"2024-09-19T06:04:15.495819+0000","last_undegraded":"2024-09-19T06:04:15.495819+0000","last_fullsized":"2024-09-19T06:04:15.495819+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:46:42.780847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.495873+0000","last_change":"2024-09-19T06:04:05.420472+0000","last_active":"2024-09-19T06:04:15.495873+0000","last_peered":"2024-09-19T06:04:15.495873+0000","last_clean":"2024-09-19T06:04:15.495873+0000","last_became_active":"2024-09-19T06:04:05.420147+0000","last_became_peered":"2024-09-19T06:04:05.420147+0000","last_unstale":"2024-09-19T06:04:15.495873+0000","last_undegraded":"2024-09-19T06:04:15.495873+0000","last_fullsized":"2024-09-19T06:04:15.495873+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:38.616378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"87'5","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:50.422877+0000","last_change":"2024-09-19T06:04:03.316655+0000","last_active":"2024-09-19T06:04:50.422877+0000","last_peered":"2024-09-19T06:04:50.422877+0000","last_clean":"2024-09-19T06:04:50.422877+0000","last_became_active":"2024-09-19T06:04:03.316296+0000","last_became_peered":"2024-09-19T06:04:03.316296+0000","last_unstale":"2024-09-19T06:04:50.422877+0000","last_undegraded":"2024-09-19T06:04:50.422877+0000","last_fullsized":"2024-09-19T06:04:50.422877+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:02:06.320482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.494659+0000","last_change":"2024-09-19T06:04:12.635106+0000","last_active":"2024-09-19T06:04:15.494659+0000","last_peered":"2024-09-19T06:04:15.494659+0000","last_clean":"2024-09-19T06:04:15.494659+0000","last_became_active":"2024-09-19T06:04:12.634671+0000","last_became_peered":"2024-09-19T06:04:12.634671+0000","last_unstale":"2024-09-19T06:04:15.494659+0000","last_undegraded":"2024-09-19T06:04:15.494659+0000","last_fullsized":"2024-09-19T06:04:15.494659+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:54:22.428102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.494962+0000","last_change":"2024-09-19T06:04:05.427483+0000","last_active":"2024-09-19T06:04:15.494962+0000","last_peered":"2024-09-19T06:04:15.494962+0000","last_clean":"2024-09-19T06:04:15.494962+0000","last_became_active":"2024-09-19T06:04:05.427092+0000","last_became_peered":"2024-09-19T06:04:05.427092+0000","last_unstale":"2024-09-19T06:04:15.494962+0000","last_undegraded":"2024-09-19T06:04:15.494962+0000","last_fullsized":"2024-09-19T06:04:15.494962+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:50:21.576757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.463582+0000","last_change":"2024-09-19T06:04:03.377962+0000","last_active":"2024-09-19T06:04:15.463582+0000","last_peered":"2024-09-19T06:04:15.463582+0000","last_clean":"2024-09-19T06:04:15.463582+0000","last_became_active":"2024-09-19T06:04:03.377686+0000","last_became_peered":"2024-09-19T06:04:03.377686+0000","last_unstale":"2024-09-19T06:04:15.463582+0000","last_undegraded":"2024-09-19T06:04:15.463582+0000","last_fullsized":"2024-09-19T06:04:15.463582+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:00.635765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.494613+0000","last_change":"2024-09-19T06:04:12.467349+0000","last_active":"2024-09-19T06:04:15.494613+0000","last_peered":"2024-09-19T06:04:15.494613+0000","last_clean":"2024-09-19T06:04:15.494613+0000","last_became_active":"2024-09-19T06:04:12.466117+0000","last_became_peered":"2024-09-19T06:04:12.466117+0000","last_unstale":"2024-09-19T06:04:15.494613+0000","last_undegraded":"2024-09-19T06:04:15.494613+0000","last_fullsized":"2024-09-19T06:04:15.494613+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:28:03.040586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.495288+0000","last_change":"2024-09-19T06:04:05.429656+0000","last_active":"2024-09-19T06:04:15.495288+0000","last_peered":"2024-09-19T06:04:15.495288+0000","last_clean":"2024-09-19T06:04:15.495288+0000","last_became_active":"2024-09-19T06:04:05.429023+0000","last_became_peered":"2024-09-19T06:04:05.429023+0000","last_unstale":"2024-09-19T06:04:15.495288+0000","last_undegraded":"2024-09-19T06:04:15.495288+0000","last_fullsized":"2024-09-19T06:04:15.495288+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:25:57.627940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.496017+0000","last_change":"2024-09-19T06:04:03.378415+0000","last_active":"2024-09-19T06:04:15.496017+0000","last_peered":"2024-09-19T06:04:15.496017+0000","last_clean":"2024-09-19T06:04:15.496017+0000","last_became_active":"2024-09-19T06:04:03.378096+0000","last_became_peered":"2024-09-19T06:04:03.378096+0000","last_unstale":"2024-09-19T06:04:15.496017+0000","last_undegraded":"2024-09-19T06:04:15.496017+0000","last_fullsized":"2024-09-19T06:04:15.496017+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:14:33.988869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.463100+0000","last_change":"2024-09-19T06:04:12.635410+0000","last_active":"2024-09-19T06:04:15.463100+0000","last_peered":"2024-09-19T06:04:15.463100+0000","last_clean":"2024-09-19T06:04:15.463100+0000","last_became_active":"2024-09-19T06:04:12.634852+0000","last_became_peered":"2024-09-19T06:04:12.634852+0000","last_unstale":"2024-09-19T06:04:15.463100+0000","last_undegraded":"2024-09-19T06:04:15.463100+0000","last_fullsized":"2024-09-19T06:04:15.463100+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:28:46.014324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.495163+0000","last_change":"2024-09-19T06:04:05.421348+0000","last_active":"2024-09-19T06:04:15.495163+0000","last_peered":"2024-09-19T06:04:15.495163+0000","last_clean":"2024-09-19T06:04:15.495163+0000","last_became_active":"2024-09-19T06:04:05.420999+0000","last_became_peered":"2024-09-19T06:04:05.420999+0000","last_unstale":"2024-09-19T06:04:15.495163+0000","last_undegraded":"2024-09-19T06:04:15.495163+0000","last_fullsized":"2024-09-19T06:04:15.495163+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:52:26.257580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.461311+0000","last_change":"2024-09-19T06:04:03.321233+0000","last_active":"2024-09-19T06:04:15.461311+0000","last_peered":"2024-09-19T06:04:15.461311+0000","last_clean":"2024-09-19T06:04:15.461311+0000","last_became_active":"2024-09-19T06:04:03.320755+0000","last_became_peered":"2024-09-19T06:04:03.320755+0000","last_unstale":"2024-09-19T06:04:15.461311+0000","last_undegraded":"2024-09-19T06:04:15.461311+0000","last_fullsized":"2024-09-19T06:04:15.461311+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:46.661751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.494702+0000","last_change":"2024-09-19T06:04:12.463185+0000","last_active":"2024-09-19T06:04:15.494702+0000","last_peered":"2024-09-19T06:04:15.494702+0000","last_clean":"2024-09-19T06:04:15.494702+0000","last_became_active":"2024-09-19T06:04:12.462824+0000","last_became_peered":"2024-09-19T06:04:12.462824+0000","last_unstale":"2024-09-19T06:04:15.494702+0000","last_undegraded":"2024-09-19T06:04:15.494702+0000","last_fullsized":"2024-09-19T06:04:15.494702+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:54:05.634907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.494933+0000","last_change":"2024-09-19T06:04:05.427259+0000","last_active":"2024-09-19T06:04:15.494933+0000","last_peered":"2024-09-19T06:04:15.494933+0000","last_clean":"2024-09-19T06:04:15.494933+0000","last_became_active":"2024-09-19T06:04:05.426955+0000","last_became_peered":"2024-09-19T06:04:05.426955+0000","last_unstale":"2024-09-19T06:04:15.494933+0000","last_undegraded":"2024-09-19T06:04:15.494933+0000","last_fullsized":"2024-09-19T06:04:15.494933+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:34:22.085384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.494453+0000","last_change":"2024-09-19T06:04:03.378174+0000","last_active":"2024-09-19T06:04:15.494453+0000","last_peered":"2024-09-19T06:04:15.494453+0000","last_clean":"2024-09-19T06:04:15.494453+0000","last_became_active":"2024-09-19T06:04:03.377803+0000","last_became_peered":"2024-09-19T06:04:03.377803+0000","last_unstale":"2024-09-19T06:04:15.494453+0000","last_undegraded":"2024-09-19T06:04:15.494453+0000","last_fullsized":"2024-09-19T06:04:15.494453+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:24:26.087284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.496057+0000","last_change":"2024-09-19T06:04:12.635365+0000","last_active":"2024-09-19T06:04:15.496057+0000","last_peered":"2024-09-19T06:04:15.496057+0000","last_clean":"2024-09-19T06:04:15.496057+0000","last_became_active":"2024-09-19T06:04:12.634691+0000","last_became_peered":"2024-09-19T06:04:12.634691+0000","last_unstale":"2024-09-19T06:04:15.496057+0000","last_undegraded":"2024-09-19T06:04:15.496057+0000","last_fullsized":"2024-09-19T06:04:15.496057+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:20:58.523992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.494329+0000","last_change":"2024-09-19T06:04:05.425638+0000","last_active":"2024-09-19T06:04:15.494329+0000","last_peered":"2024-09-19T06:04:15.494329+0000","last_clean":"2024-09-19T06:04:15.494329+0000","last_became_active":"2024-09-19T06:04:05.425356+0000","last_became_peered":"2024-09-19T06:04:05.425356+0000","last_unstale":"2024-09-19T06:04:15.494329+0000","last_undegraded":"2024-09-19T06:04:15.494329+0000","last_fullsized":"2024-09-19T06:04:15.494329+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:51:11.857888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.460869+0000","last_change":"2024-09-19T06:04:03.322432+0000","last_active":"2024-09-19T06:04:15.460869+0000","last_peered":"2024-09-19T06:04:15.460869+0000","last_clean":"2024-09-19T06:04:15.460869+0000","last_became_active":"2024-09-19T06:04:03.322071+0000","last_became_peered":"2024-09-19T06:04:03.322071+0000","last_unstale":"2024-09-19T06:04:15.460869+0000","last_undegraded":"2024-09-19T06:04:15.460869+0000","last_fullsized":"2024-09-19T06:04:15.460869+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:16:23.935470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.495859+0000","last_change":"2024-09-19T06:04:12.635970+0000","last_active":"2024-09-19T06:04:15.495859+0000","last_peered":"2024-09-19T06:04:15.495859+0000","last_clean":"2024-09-19T06:04:15.495859+0000","last_became_active":"2024-09-19T06:04:12.635283+0000","last_became_peered":"2024-09-19T06:04:12.635283+0000","last_unstale":"2024-09-19T06:04:15.495859+0000","last_undegraded":"2024-09-19T06:04:15.495859+0000","last_fullsized":"2024-09-19T06:04:15.495859+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:55:05.460652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.495050+0000","last_change":"2024-09-19T06:04:05.424335+0000","last_active":"2024-09-19T06:04:15.495050+0000","last_peered":"2024-09-19T06:04:15.495050+0000","last_clean":"2024-09-19T06:04:15.495050+0000","last_became_active":"2024-09-19T06:04:05.423868+0000","last_became_peered":"2024-09-19T06:04:05.423868+0000","last_unstale":"2024-09-19T06:04:15.495050+0000","last_undegraded":"2024-09-19T06:04:15.495050+0000","last_fullsized":"2024-09-19T06:04:15.495050+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:17:15.556240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.496406+0000","last_change":"2024-09-19T06:04:03.315749+0000","last_active":"2024-09-19T06:04:15.496406+0000","last_peered":"2024-09-19T06:04:15.496406+0000","last_clean":"2024-09-19T06:04:15.496406+0000","last_became_active":"2024-09-19T06:04:03.315404+0000","last_became_peered":"2024-09-19T06:04:03.315404+0000","last_unstale":"2024-09-19T06:04:15.496406+0000","last_undegraded":"2024-09-19T06:04:15.496406+0000","last_fullsized":"2024-09-19T06:04:15.496406+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:43:35.485993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":340,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.461031+0000","last_change":"2024-09-19T06:02:49.934106+0000","last_active":"2024-09-19T06:04:15.461031+0000","last_peered":"2024-09-19T06:04:15.461031+0000","last_clean":"2024-09-19T06:04:15.461031+0000","last_became_active":"2024-09-19T06:02:49.933684+0000","last_became_peered":"2024-09-19T06:02:49.933684+0000","last_unstale":"2024-09-19T06:04:15.461031+0000","last_undegraded":"2024-09-19T06:04:15.461031+0000","last_fullsized":"2024-09-19T06:04:15.461031+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:59:27.582796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:59:27.582796+0000","last_clean_scrub_stamp":"2024-09-19T05:59:27.582796+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:35:06.837740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"87'1","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:16.422872+0000","last_change":"2024-09-19T06:04:12.468160+0000","last_active":"2024-09-19T06:04:16.422872+0000","last_peered":"2024-09-19T06:04:16.422872+0000","last_clean":"2024-09-19T06:04:16.422872+0000","last_became_active":"2024-09-19T06:04:12.467642+0000","last_became_peered":"2024-09-19T06:04:12.467642+0000","last_unstale":"2024-09-19T06:04:16.422872+0000","last_undegraded":"2024-09-19T06:04:16.422872+0000","last_fullsized":"2024-09-19T06:04:16.422872+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:40.053143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.461511+0000","last_change":"2024-09-19T06:04:05.435815+0000","last_active":"2024-09-19T06:04:15.461511+0000","last_peered":"2024-09-19T06:04:15.461511+0000","last_clean":"2024-09-19T06:04:15.461511+0000","last_became_active":"2024-09-19T06:04:05.435498+0000","last_became_peered":"2024-09-19T06:04:05.435498+0000","last_unstale":"2024-09-19T06:04:15.461511+0000","last_undegraded":"2024-09-19T06:04:15.461511+0000","last_fullsized":"2024-09-19T06:04:15.461511+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:33:30.330877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.496722+0000","last_change":"2024-09-19T06:04:03.379675+0000","last_active":"2024-09-19T06:04:15.496722+0000","last_peered":"2024-09-19T06:04:15.496722+0000","last_clean":"2024-09-19T06:04:15.496722+0000","last_became_active":"2024-09-19T06:04:03.379336+0000","last_became_peered":"2024-09-19T06:04:03.379336+0000","last_unstale":"2024-09-19T06:04:15.496722+0000","last_undegraded":"2024-09-19T06:04:15.496722+0000","last_fullsized":"2024-09-19T06:04:15.496722+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:04.139137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.494475+0000","last_change":"2024-09-19T06:04:12.466249+0000","last_active":"2024-09-19T06:04:15.494475+0000","last_peered":"2024-09-19T06:04:15.494475+0000","last_clean":"2024-09-19T06:04:15.494475+0000","last_became_active":"2024-09-19T06:04:12.465709+0000","last_became_peered":"2024-09-19T06:04:12.465709+0000","last_unstale":"2024-09-19T06:04:15.494475+0000","last_undegraded":"2024-09-19T06:04:15.494475+0000","last_fullsized":"2024-09-19T06:04:15.494475+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:02:11.454334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.461172+0000","last_change":"2024-09-19T06:04:05.425733+0000","last_active":"2024-09-19T06:04:15.461172+0000","last_peered":"2024-09-19T06:04:15.461172+0000","last_clean":"2024-09-19T06:04:15.461172+0000","last_became_active":"2024-09-19T06:04:05.425399+0000","last_became_peered":"2024-09-19T06:04:05.425399+0000","last_unstale":"2024-09-19T06:04:15.461172+0000","last_undegraded":"2024-09-19T06:04:15.461172+0000","last_fullsized":"2024-09-19T06:04:15.461172+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:35:33.287456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.496538+0000","last_change":"2024-09-19T06:04:03.319361+0000","last_active":"2024-09-19T06:04:15.496538+0000","last_peered":"2024-09-19T06:04:15.496538+0000","last_clean":"2024-09-19T06:04:15.496538+0000","last_became_active":"2024-09-19T06:04:03.319053+0000","last_became_peered":"2024-09-19T06:04:03.319053+0000","last_unstale":"2024-09-19T06:04:15.496538+0000","last_undegraded":"2024-09-19T06:04:15.496538+0000","last_fullsized":"2024-09-19T06:04:15.496538+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:25:23.739392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.464687+0000","last_change":"2024-09-19T06:04:12.468270+0000","last_active":"2024-09-19T06:04:15.464687+0000","last_peered":"2024-09-19T06:04:15.464687+0000","last_clean":"2024-09-19T06:04:15.464687+0000","last_became_active":"2024-09-19T06:04:12.467872+0000","last_became_peered":"2024-09-19T06:04:12.467872+0000","last_unstale":"2024-09-19T06:04:15.464687+0000","last_undegraded":"2024-09-19T06:04:15.464687+0000","last_fullsized":"2024-09-19T06:04:15.464687+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:35.476189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.461360+0000","last_change":"2024-09-19T06:04:05.431360+0000","last_active":"2024-09-19T06:04:15.461360+0000","last_peered":"2024-09-19T06:04:15.461360+0000","last_clean":"2024-09-19T06:04:15.461360+0000","last_became_active":"2024-09-19T06:04:05.431067+0000","last_became_peered":"2024-09-19T06:04:05.431067+0000","last_unstale":"2024-09-19T06:04:15.461360+0000","last_undegraded":"2024-09-19T06:04:15.461360+0000","last_fullsized":"2024-09-19T06:04:15.461360+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:16:25.317086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.496424+0000","last_change":"2024-09-19T06:04:03.316793+0000","last_active":"2024-09-19T06:04:15.496424+0000","last_peered":"2024-09-19T06:04:15.496424+0000","last_clean":"2024-09-19T06:04:15.496424+0000","last_became_active":"2024-09-19T06:04:03.316485+0000","last_became_peered":"2024-09-19T06:04:03.316485+0000","last_unstale":"2024-09-19T06:04:15.496424+0000","last_undegraded":"2024-09-19T06:04:15.496424+0000","last_fullsized":"2024-09-19T06:04:15.496424+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:19:26.427025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.494798+0000","last_change":"2024-09-19T06:04:12.466322+0000","last_active":"2024-09-19T06:04:15.494798+0000","last_peered":"2024-09-19T06:04:15.494798+0000","last_clean":"2024-09-19T06:04:15.494798+0000","last_became_active":"2024-09-19T06:04:12.465806+0000","last_became_peered":"2024-09-19T06:04:12.465806+0000","last_unstale":"2024-09-19T06:04:15.494798+0000","last_undegraded":"2024-09-19T06:04:15.494798+0000","last_fullsized":"2024-09-19T06:04:15.494798+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:33:28.893570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.495001+0000","last_change":"2024-09-19T06:04:05.424864+0000","last_active":"2024-09-19T06:04:15.495001+0000","last_peered":"2024-09-19T06:04:15.495001+0000","last_clean":"2024-09-19T06:04:15.495001+0000","last_became_active":"2024-09-19T06:04:05.424504+0000","last_became_peered":"2024-09-19T06:04:05.424504+0000","last_unstale":"2024-09-19T06:04:15.495001+0000","last_undegraded":"2024-09-19T06:04:15.495001+0000","last_fullsized":"2024-09-19T06:04:15.495001+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:30.471757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.463570+0000","last_change":"2024-09-19T06:04:03.321925+0000","last_active":"2024-09-19T06:04:15.463570+0000","last_peered":"2024-09-19T06:04:15.463570+0000","last_clean":"2024-09-19T06:04:15.463570+0000","last_became_active":"2024-09-19T06:04:03.321445+0000","last_became_peered":"2024-09-19T06:04:03.321445+0000","last_unstale":"2024-09-19T06:04:15.463570+0000","last_undegraded":"2024-09-19T06:04:15.463570+0000","last_fullsized":"2024-09-19T06:04:15.463570+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:15:55.621352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.495372+0000","last_change":"2024-09-19T06:04:12.471413+0000","last_active":"2024-09-19T06:04:15.495372+0000","last_peered":"2024-09-19T06:04:15.495372+0000","last_clean":"2024-09-19T06:04:15.495372+0000","last_became_active":"2024-09-19T06:04:12.471057+0000","last_became_peered":"2024-09-19T06:04:12.471057+0000","last_unstale":"2024-09-19T06:04:15.495372+0000","last_undegraded":"2024-09-19T06:04:15.495372+0000","last_fullsized":"2024-09-19T06:04:15.495372+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:08:47.259211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.496253+0000","last_change":"2024-09-19T06:04:05.429447+0000","last_active":"2024-09-19T06:04:15.496253+0000","last_peered":"2024-09-19T06:04:15.496253+0000","last_clean":"2024-09-19T06:04:15.496253+0000","last_became_active":"2024-09-19T06:04:05.428852+0000","last_became_peered":"2024-09-19T06:04:05.428852+0000","last_unstale":"2024-09-19T06:04:15.496253+0000","last_undegraded":"2024-09-19T06:04:15.496253+0000","last_fullsized":"2024-09-19T06:04:15.496253+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:01.466814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.462962+0000","last_change":"2024-09-19T06:04:03.378586+0000","last_active":"2024-09-19T06:04:15.462962+0000","last_peered":"2024-09-19T06:04:15.462962+0000","last_clean":"2024-09-19T06:04:15.462962+0000","last_became_active":"2024-09-19T06:04:03.378292+0000","last_became_peered":"2024-09-19T06:04:03.378292+0000","last_unstale":"2024-09-19T06:04:15.462962+0000","last_undegraded":"2024-09-19T06:04:15.462962+0000","last_fullsized":"2024-09-19T06:04:15.462962+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:54.247070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.496326+0000","last_change":"2024-09-19T06:04:12.470914+0000","last_active":"2024-09-19T06:04:15.496326+0000","last_peered":"2024-09-19T06:04:15.496326+0000","last_clean":"2024-09-19T06:04:15.496326+0000","last_became_active":"2024-09-19T06:04:12.470563+0000","last_became_peered":"2024-09-19T06:04:12.470563+0000","last_unstale":"2024-09-19T06:04:15.496326+0000","last_undegraded":"2024-09-19T06:04:15.496326+0000","last_fullsized":"2024-09-19T06:04:15.496326+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:13.060646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.460769+0000","last_change":"2024-09-19T06:04:05.424009+0000","last_active":"2024-09-19T06:04:15.460769+0000","last_peered":"2024-09-19T06:04:15.460769+0000","last_clean":"2024-09-19T06:04:15.460769+0000","last_became_active":"2024-09-19T06:04:05.423670+0000","last_became_peered":"2024-09-19T06:04:05.423670+0000","last_unstale":"2024-09-19T06:04:15.460769+0000","last_undegraded":"2024-09-19T06:04:15.460769+0000","last_fullsized":"2024-09-19T06:04:15.460769+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:30:15.165259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.495975+0000","last_change":"2024-09-19T06:04:03.317089+0000","last_active":"2024-09-19T06:04:15.495975+0000","last_peered":"2024-09-19T06:04:15.495975+0000","last_clean":"2024-09-19T06:04:15.495975+0000","last_became_active":"2024-09-19T06:04:03.316575+0000","last_became_peered":"2024-09-19T06:04:03.316575+0000","last_unstale":"2024-09-19T06:04:15.495975+0000","last_undegraded":"2024-09-19T06:04:15.495975+0000","last_fullsized":"2024-09-19T06:04:15.495975+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:11:43.769660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.496345+0000","last_change":"2024-09-19T06:04:12.472234+0000","last_active":"2024-09-19T06:04:15.496345+0000","last_peered":"2024-09-19T06:04:15.496345+0000","last_clean":"2024-09-19T06:04:15.496345+0000","last_became_active":"2024-09-19T06:04:12.469847+0000","last_became_peered":"2024-09-19T06:04:12.469847+0000","last_unstale":"2024-09-19T06:04:15.496345+0000","last_undegraded":"2024-09-19T06:04:15.496345+0000","last_fullsized":"2024-09-19T06:04:15.496345+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:02:50.200613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.461104+0000","last_change":"2024-09-19T06:04:05.430145+0000","last_active":"2024-09-19T06:04:15.461104+0000","last_peered":"2024-09-19T06:04:15.461104+0000","last_clean":"2024-09-19T06:04:15.461104+0000","last_became_active":"2024-09-19T06:04:05.429763+0000","last_became_peered":"2024-09-19T06:04:05.429763+0000","last_unstale":"2024-09-19T06:04:15.461104+0000","last_undegraded":"2024-09-19T06:04:15.461104+0000","last_fullsized":"2024-09-19T06:04:15.461104+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:44:38.783894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.495792+0000","last_change":"2024-09-19T06:04:03.317410+0000","last_active":"2024-09-19T06:04:15.495792+0000","last_peered":"2024-09-19T06:04:15.495792+0000","last_clean":"2024-09-19T06:04:15.495792+0000","last_became_active":"2024-09-19T06:04:03.317068+0000","last_became_peered":"2024-09-19T06:04:03.317068+0000","last_unstale":"2024-09-19T06:04:15.495792+0000","last_undegraded":"2024-09-19T06:04:15.495792+0000","last_fullsized":"2024-09-19T06:04:15.495792+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:23.209080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.494903+0000","last_change":"2024-09-19T06:04:12.469867+0000","last_active":"2024-09-19T06:04:15.494903+0000","last_peered":"2024-09-19T06:04:15.494903+0000","last_clean":"2024-09-19T06:04:15.494903+0000","last_became_active":"2024-09-19T06:04:12.469391+0000","last_became_peered":"2024-09-19T06:04:12.469391+0000","last_unstale":"2024-09-19T06:04:15.494903+0000","last_undegraded":"2024-09-19T06:04:15.494903+0000","last_fullsized":"2024-09-19T06:04:15.494903+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:43:29.493247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.494619+0000","last_change":"2024-09-19T06:04:05.423515+0000","last_active":"2024-09-19T06:04:15.494619+0000","last_peered":"2024-09-19T06:04:15.494619+0000","last_clean":"2024-09-19T06:04:15.494619+0000","last_became_active":"2024-09-19T06:04:05.422185+0000","last_became_peered":"2024-09-19T06:04:05.422185+0000","last_unstale":"2024-09-19T06:04:15.494619+0000","last_undegraded":"2024-09-19T06:04:15.494619+0000","last_fullsized":"2024-09-19T06:04:15.494619+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:09:22.951171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"81'2","reported_seq":33,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.496502+0000","last_change":"2024-09-19T06:04:03.319681+0000","last_active":"2024-09-19T06:04:15.496502+0000","last_peered":"2024-09-19T06:04:15.496502+0000","last_clean":"2024-09-19T06:04:15.496502+0000","last_became_active":"2024-09-19T06:04:03.319189+0000","last_became_peered":"2024-09-19T06:04:03.319189+0000","last_unstale":"2024-09-19T06:04:15.496502+0000","last_undegraded":"2024-09-19T06:04:15.496502+0000","last_fullsized":"2024-09-19T06:04:15.496502+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:20:54.139461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.496195+0000","last_change":"2024-09-19T06:04:12.468569+0000","last_active":"2024-09-19T06:04:15.496195+0000","last_peered":"2024-09-19T06:04:15.496195+0000","last_clean":"2024-09-19T06:04:15.496195+0000","last_became_active":"2024-09-19T06:04:12.467759+0000","last_became_peered":"2024-09-19T06:04:12.467759+0000","last_unstale":"2024-09-19T06:04:15.496195+0000","last_undegraded":"2024-09-19T06:04:15.496195+0000","last_fullsized":"2024-09-19T06:04:15.496195+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:20:49.817163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.463376+0000","last_change":"2024-09-19T06:04:05.425703+0000","last_active":"2024-09-19T06:04:15.463376+0000","last_peered":"2024-09-19T06:04:15.463376+0000","last_clean":"2024-09-19T06:04:15.463376+0000","last_became_active":"2024-09-19T06:04:05.425360+0000","last_became_peered":"2024-09-19T06:04:05.425360+0000","last_unstale":"2024-09-19T06:04:15.463376+0000","last_undegraded":"2024-09-19T06:04:15.463376+0000","last_fullsized":"2024-09-19T06:04:15.463376+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:33:25.457191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"87'24","reported_seq":85,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:52.556738+0000","last_change":"2024-09-19T06:04:03.319087+0000","last_active":"2024-09-19T06:04:52.556738+0000","last_peered":"2024-09-19T06:04:52.556738+0000","last_clean":"2024-09-19T06:04:52.556738+0000","last_became_active":"2024-09-19T06:04:03.318721+0000","last_became_peered":"2024-09-19T06:04:03.318721+0000","last_unstale":"2024-09-19T06:04:52.556738+0000","last_undegraded":"2024-09-19T06:04:52.556738+0000","last_fullsized":"2024-09-19T06:04:52.556738+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:14:32.337455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49098,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":31,"num_read_kb":63,"num_write":24,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.495572+0000","last_change":"2024-09-19T06:04:12.472008+0000","last_active":"2024-09-19T06:04:15.495572+0000","last_peered":"2024-09-19T06:04:15.495572+0000","last_clean":"2024-09-19T06:04:15.495572+0000","last_became_active":"2024-09-19T06:04:12.471623+0000","last_became_peered":"2024-09-19T06:04:12.471623+0000","last_unstale":"2024-09-19T06:04:15.495572+0000","last_undegraded":"2024-09-19T06:04:15.495572+0000","last_fullsized":"2024-09-19T06:04:15.495572+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:13:11.424242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.494760+0000","last_change":"2024-09-19T06:04:05.434865+0000","last_active":"2024-09-19T06:04:15.494760+0000","last_peered":"2024-09-19T06:04:15.494760+0000","last_clean":"2024-09-19T06:04:15.494760+0000","last_became_active":"2024-09-19T06:04:05.434472+0000","last_became_peered":"2024-09-19T06:04:05.434472+0000","last_unstale":"2024-09-19T06:04:15.494760+0000","last_undegraded":"2024-09-19T06:04:15.494760+0000","last_fullsized":"2024-09-19T06:04:15.494760+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:35.490406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"81'3","reported_seq":33,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.496415+0000","last_change":"2024-09-19T06:04:03.380447+0000","last_active":"2024-09-19T06:04:15.496415+0000","last_peered":"2024-09-19T06:04:15.496415+0000","last_clean":"2024-09-19T06:04:15.496415+0000","last_became_active":"2024-09-19T06:04:03.380154+0000","last_became_peered":"2024-09-19T06:04:03.380154+0000","last_unstale":"2024-09-19T06:04:15.496415+0000","last_undegraded":"2024-09-19T06:04:15.496415+0000","last_fullsized":"2024-09-19T06:04:15.496415+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:48:11.570148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.496343+0000","last_change":"2024-09-19T06:04:12.467995+0000","last_active":"2024-09-19T06:04:15.496343+0000","last_peered":"2024-09-19T06:04:15.496343+0000","last_clean":"2024-09-19T06:04:15.496343+0000","last_became_active":"2024-09-19T06:04:12.467539+0000","last_became_peered":"2024-09-19T06:04:12.467539+0000","last_unstale":"2024-09-19T06:04:15.496343+0000","last_undegraded":"2024-09-19T06:04:15.496343+0000","last_fullsized":"2024-09-19T06:04:15.496343+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:13:29.285909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.464875+0000","last_change":"2024-09-19T06:04:05.429919+0000","last_active":"2024-09-19T06:04:15.464875+0000","last_peered":"2024-09-19T06:04:15.464875+0000","last_clean":"2024-09-19T06:04:15.464875+0000","last_became_active":"2024-09-19T06:04:05.429597+0000","last_became_peered":"2024-09-19T06:04:05.429597+0000","last_unstale":"2024-09-19T06:04:15.464875+0000","last_undegraded":"2024-09-19T06:04:15.464875+0000","last_fullsized":"2024-09-19T06:04:15.464875+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:08:38.816272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.461230+0000","last_change":"2024-09-19T06:04:03.320501+0000","last_active":"2024-09-19T06:04:15.461230+0000","last_peered":"2024-09-19T06:04:15.461230+0000","last_clean":"2024-09-19T06:04:15.461230+0000","last_became_active":"2024-09-19T06:04:03.320093+0000","last_became_peered":"2024-09-19T06:04:03.320093+0000","last_unstale":"2024-09-19T06:04:15.461230+0000","last_undegraded":"2024-09-19T06:04:15.461230+0000","last_fullsized":"2024-09-19T06:04:15.461230+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:31:11.896935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.495327+0000","last_change":"2024-09-19T06:04:12.468455+0000","last_active":"2024-09-19T06:04:15.495327+0000","last_peered":"2024-09-19T06:04:15.495327+0000","last_clean":"2024-09-19T06:04:15.495327+0000","last_became_active":"2024-09-19T06:04:12.468007+0000","last_became_peered":"2024-09-19T06:04:12.468007+0000","last_unstale":"2024-09-19T06:04:15.495327+0000","last_undegraded":"2024-09-19T06:04:15.495327+0000","last_fullsized":"2024-09-19T06:04:15.495327+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:50:58.995825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.495285+0000","last_change":"2024-09-19T06:04:05.427599+0000","last_active":"2024-09-19T06:04:15.495285+0000","last_peered":"2024-09-19T06:04:15.495285+0000","last_clean":"2024-09-19T06:04:15.495285+0000","last_became_active":"2024-09-19T06:04:05.425338+0000","last_became_peered":"2024-09-19T06:04:05.425338+0000","last_unstale":"2024-09-19T06:04:15.495285+0000","last_undegraded":"2024-09-19T06:04:15.495285+0000","last_fullsized":"2024-09-19T06:04:15.495285+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:44.547625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.495456+0000","last_change":"2024-09-19T06:04:03.322165+0000","last_active":"2024-09-19T06:04:15.495456+0000","last_peered":"2024-09-19T06:04:15.495456+0000","last_clean":"2024-09-19T06:04:15.495456+0000","last_became_active":"2024-09-19T06:04:03.321822+0000","last_became_peered":"2024-09-19T06:04:03.321822+0000","last_unstale":"2024-09-19T06:04:15.495456+0000","last_undegraded":"2024-09-19T06:04:15.495456+0000","last_fullsized":"2024-09-19T06:04:15.495456+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:58:00.943453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.494914+0000","last_change":"2024-09-19T06:04:12.465823+0000","last_active":"2024-09-19T06:04:15.494914+0000","last_peered":"2024-09-19T06:04:15.494914+0000","last_clean":"2024-09-19T06:04:15.494914+0000","last_became_active":"2024-09-19T06:04:12.465375+0000","last_became_peered":"2024-09-19T06:04:12.465375+0000","last_unstale":"2024-09-19T06:04:15.494914+0000","last_undegraded":"2024-09-19T06:04:15.494914+0000","last_fullsized":"2024-09-19T06:04:15.494914+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:26:25.428328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.464776+0000","last_change":"2024-09-19T06:04:12.470023+0000","last_active":"2024-09-19T06:04:15.464776+0000","last_peered":"2024-09-19T06:04:15.464776+0000","last_clean":"2024-09-19T06:04:15.464776+0000","last_became_active":"2024-09-19T06:04:12.469651+0000","last_became_peered":"2024-09-19T06:04:12.469651+0000","last_unstale":"2024-09-19T06:04:15.464776+0000","last_undegraded":"2024-09-19T06:04:15.464776+0000","last_fullsized":"2024-09-19T06:04:15.464776+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:50:35.374437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.495376+0000","last_change":"2024-09-19T06:04:05.417466+0000","last_active":"2024-09-19T06:04:15.495376+0000","last_peered":"2024-09-19T06:04:15.495376+0000","last_clean":"2024-09-19T06:04:15.495376+0000","last_became_active":"2024-09-19T06:04:05.417026+0000","last_became_peered":"2024-09-19T06:04:05.417026+0000","last_unstale":"2024-09-19T06:04:15.495376+0000","last_undegraded":"2024-09-19T06:04:15.495376+0000","last_fullsized":"2024-09-19T06:04:15.495376+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:44:08.251755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.495043+0000","last_change":"2024-09-19T06:04:03.317466+0000","last_active":"2024-09-19T06:04:15.495043+0000","last_peered":"2024-09-19T06:04:15.495043+0000","last_clean":"2024-09-19T06:04:15.495043+0000","last_became_active":"2024-09-19T06:04:03.317148+0000","last_became_peered":"2024-09-19T06:04:03.317148+0000","last_unstale":"2024-09-19T06:04:15.495043+0000","last_undegraded":"2024-09-19T06:04:15.495043+0000","last_fullsized":"2024-09-19T06:04:15.495043+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:45:50.789900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.495206+0000","last_change":"2024-09-19T06:04:12.469279+0000","last_active":"2024-09-19T06:04:15.495206+0000","last_peered":"2024-09-19T06:04:15.495206+0000","last_clean":"2024-09-19T06:04:15.495206+0000","last_became_active":"2024-09-19T06:04:12.467928+0000","last_became_peered":"2024-09-19T06:04:12.467928+0000","last_unstale":"2024-09-19T06:04:15.495206+0000","last_undegraded":"2024-09-19T06:04:15.495206+0000","last_fullsized":"2024-09-19T06:04:15.495206+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:52:25.839433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.494895+0000","last_change":"2024-09-19T06:04:05.420425+0000","last_active":"2024-09-19T06:04:15.494895+0000","last_peered":"2024-09-19T06:04:15.494895+0000","last_clean":"2024-09-19T06:04:15.494895+0000","last_became_active":"2024-09-19T06:04:05.420107+0000","last_became_peered":"2024-09-19T06:04:05.420107+0000","last_unstale":"2024-09-19T06:04:15.494895+0000","last_undegraded":"2024-09-19T06:04:15.494895+0000","last_fullsized":"2024-09-19T06:04:15.494895+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:49:24.566302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.494333+0000","last_change":"2024-09-19T06:04:03.315704+0000","last_active":"2024-09-19T06:04:15.494333+0000","last_peered":"2024-09-19T06:04:15.494333+0000","last_clean":"2024-09-19T06:04:15.494333+0000","last_became_active":"2024-09-19T06:04:03.315392+0000","last_became_peered":"2024-09-19T06:04:03.315392+0000","last_unstale":"2024-09-19T06:04:15.494333+0000","last_undegraded":"2024-09-19T06:04:15.494333+0000","last_fullsized":"2024-09-19T06:04:15.494333+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:52:14.417470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"81'1","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.495114+0000","last_change":"2024-09-19T06:04:03.323560+0000","last_active":"2024-09-19T06:04:15.495114+0000","last_peered":"2024-09-19T06:04:15.495114+0000","last_clean":"2024-09-19T06:04:15.495114+0000","last_became_active":"2024-09-19T06:04:03.323188+0000","last_became_peered":"2024-09-19T06:04:03.323188+0000","last_unstale":"2024-09-19T06:04:15.495114+0000","last_undegraded":"2024-09-19T06:04:15.495114+0000","last_fullsized":"2024-09-19T06:04:15.495114+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:02:50.426435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.495938+0000","last_change":"2024-09-19T06:04:05.430677+0000","last_active":"2024-09-19T06:04:15.495938+0000","last_peered":"2024-09-19T06:04:15.495938+0000","last_clean":"2024-09-19T06:04:15.495938+0000","last_became_active":"2024-09-19T06:04:05.430257+0000","last_became_peered":"2024-09-19T06:04:05.430257+0000","last_unstale":"2024-09-19T06:04:15.495938+0000","last_undegraded":"2024-09-19T06:04:15.495938+0000","last_fullsized":"2024-09-19T06:04:15.495938+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:38:42.138770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.496501+0000","last_change":"2024-09-19T06:04:12.465252+0000","last_active":"2024-09-19T06:04:15.496501+0000","last_peered":"2024-09-19T06:04:15.496501+0000","last_clean":"2024-09-19T06:04:15.496501+0000","last_became_active":"2024-09-19T06:04:12.464649+0000","last_became_peered":"2024-09-19T06:04:12.464649+0000","last_unstale":"2024-09-19T06:04:15.496501+0000","last_undegraded":"2024-09-19T06:04:15.496501+0000","last_fullsized":"2024-09-19T06:04:15.496501+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:11:43.137148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"81'1","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.495972+0000","last_change":"2024-09-19T06:04:03.317584+0000","last_active":"2024-09-19T06:04:15.495972+0000","last_peered":"2024-09-19T06:04:15.495972+0000","last_clean":"2024-09-19T06:04:15.495972+0000","last_became_active":"2024-09-19T06:04:03.317250+0000","last_became_peered":"2024-09-19T06:04:03.317250+0000","last_unstale":"2024-09-19T06:04:15.495972+0000","last_undegraded":"2024-09-19T06:04:15.495972+0000","last_fullsized":"2024-09-19T06:04:15.495972+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:22.353887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.463114+0000","last_change":"2024-09-19T06:04:05.431102+0000","last_active":"2024-09-19T06:04:15.463114+0000","last_peered":"2024-09-19T06:04:15.463114+0000","last_clean":"2024-09-19T06:04:15.463114+0000","last_became_active":"2024-09-19T06:04:05.430792+0000","last_became_peered":"2024-09-19T06:04:05.430792+0000","last_unstale":"2024-09-19T06:04:15.463114+0000","last_undegraded":"2024-09-19T06:04:15.463114+0000","last_fullsized":"2024-09-19T06:04:15.463114+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:48:48.682273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.496840+0000","last_change":"2024-09-19T06:04:12.467143+0000","last_active":"2024-09-19T06:04:15.496840+0000","last_peered":"2024-09-19T06:04:15.496840+0000","last_clean":"2024-09-19T06:04:15.496840+0000","last_became_active":"2024-09-19T06:04:12.466672+0000","last_became_peered":"2024-09-19T06:04:12.466672+0000","last_unstale":"2024-09-19T06:04:15.496840+0000","last_undegraded":"2024-09-19T06:04:15.496840+0000","last_fullsized":"2024-09-19T06:04:15.496840+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:57:36.710316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.494492+0000","last_change":"2024-09-19T06:04:05.427387+0000","last_active":"2024-09-19T06:04:15.494492+0000","last_peered":"2024-09-19T06:04:15.494492+0000","last_clean":"2024-09-19T06:04:15.494492+0000","last_became_active":"2024-09-19T06:04:05.427082+0000","last_became_peered":"2024-09-19T06:04:05.427082+0000","last_unstale":"2024-09-19T06:04:15.494492+0000","last_undegraded":"2024-09-19T06:04:15.494492+0000","last_fullsized":"2024-09-19T06:04:15.494492+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:55.931289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.496018+0000","last_change":"2024-09-19T06:04:05.434396+0000","last_active":"2024-09-19T06:04:15.496018+0000","last_peered":"2024-09-19T06:04:15.496018+0000","last_clean":"2024-09-19T06:04:15.496018+0000","last_became_active":"2024-09-19T06:04:05.433907+0000","last_became_peered":"2024-09-19T06:04:05.433907+0000","last_unstale":"2024-09-19T06:04:15.496018+0000","last_undegraded":"2024-09-19T06:04:15.496018+0000","last_fullsized":"2024-09-19T06:04:15.496018+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:02:40.885820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.496127+0000","last_change":"2024-09-19T06:04:05.435813+0000","last_active":"2024-09-19T06:04:15.496127+0000","last_peered":"2024-09-19T06:04:15.496127+0000","last_clean":"2024-09-19T06:04:15.496127+0000","last_became_active":"2024-09-19T06:04:05.435441+0000","last_became_peered":"2024-09-19T06:04:05.435441+0000","last_unstale":"2024-09-19T06:04:15.496127+0000","last_undegraded":"2024-09-19T06:04:15.496127+0000","last_fullsized":"2024-09-19T06:04:15.496127+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:11:20.071732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.464638+0000","last_change":"2024-09-19T06:04:05.433045+0000","last_active":"2024-09-19T06:04:15.464638+0000","last_peered":"2024-09-19T06:04:15.464638+0000","last_clean":"2024-09-19T06:04:15.464638+0000","last_became_active":"2024-09-19T06:04:05.432674+0000","last_became_peered":"2024-09-19T06:04:05.432674+0000","last_unstale":"2024-09-19T06:04:15.464638+0000","last_undegraded":"2024-09-19T06:04:15.464638+0000","last_fullsized":"2024-09-19T06:04:15.464638+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:33:06.743886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.494863+0000","last_change":"2024-09-19T06:04:05.431702+0000","last_active":"2024-09-19T06:04:15.494863+0000","last_peered":"2024-09-19T06:04:15.494863+0000","last_clean":"2024-09-19T06:04:15.494863+0000","last_became_active":"2024-09-19T06:04:05.431394+0000","last_became_peered":"2024-09-19T06:04:05.431394+0000","last_unstale":"2024-09-19T06:04:15.494863+0000","last_undegraded":"2024-09-19T06:04:15.494863+0000","last_fullsized":"2024-09-19T06:04:15.494863+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:42:18.692549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.495030+0000","last_change":"2024-09-19T06:04:05.428315+0000","last_active":"2024-09-19T06:04:15.495030+0000","last_peered":"2024-09-19T06:04:15.495030+0000","last_clean":"2024-09-19T06:04:15.495030+0000","last_became_active":"2024-09-19T06:04:05.428018+0000","last_became_peered":"2024-09-19T06:04:05.428018+0000","last_unstale":"2024-09-19T06:04:15.495030+0000","last_undegraded":"2024-09-19T06:04:15.495030+0000","last_fullsized":"2024-09-19T06:04:15.495030+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:53:50.670653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.496831+0000","last_change":"2024-09-19T06:04:05.430104+0000","last_active":"2024-09-19T06:04:15.496831+0000","last_peered":"2024-09-19T06:04:15.496831+0000","last_clean":"2024-09-19T06:04:15.496831+0000","last_became_active":"2024-09-19T06:04:05.429779+0000","last_became_peered":"2024-09-19T06:04:05.429779+0000","last_unstale":"2024-09-19T06:04:15.496831+0000","last_undegraded":"2024-09-19T06:04:15.496831+0000","last_fullsized":"2024-09-19T06:04:15.496831+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:52:46.191484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.495874+0000","last_change":"2024-09-19T06:04:05.427235+0000","last_active":"2024-09-19T06:04:15.495874+0000","last_peered":"2024-09-19T06:04:15.495874+0000","last_clean":"2024-09-19T06:04:15.495874+0000","last_became_active":"2024-09-19T06:04:05.426937+0000","last_became_peered":"2024-09-19T06:04:05.426937+0000","last_unstale":"2024-09-19T06:04:15.495874+0000","last_undegraded":"2024-09-19T06:04:15.495874+0000","last_fullsized":"2024-09-19T06:04:15.495874+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:55.949564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.494910+0000","last_change":"2024-09-19T06:04:05.422199+0000","last_active":"2024-09-19T06:04:15.494910+0000","last_peered":"2024-09-19T06:04:15.494910+0000","last_clean":"2024-09-19T06:04:15.494910+0000","last_became_active":"2024-09-19T06:04:05.421681+0000","last_became_peered":"2024-09-19T06:04:05.421681+0000","last_unstale":"2024-09-19T06:04:15.494910+0000","last_undegraded":"2024-09-19T06:04:15.494910+0000","last_fullsized":"2024-09-19T06:04:15.494910+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:27:54.774211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.495032+0000","last_change":"2024-09-19T06:04:05.426559+0000","last_active":"2024-09-19T06:04:15.495032+0000","last_peered":"2024-09-19T06:04:15.495032+0000","last_clean":"2024-09-19T06:04:15.495032+0000","last_became_active":"2024-09-19T06:04:05.423197+0000","last_became_peered":"2024-09-19T06:04:05.423197+0000","last_unstale":"2024-09-19T06:04:15.495032+0000","last_undegraded":"2024-09-19T06:04:15.495032+0000","last_fullsized":"2024-09-19T06:04:15.495032+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:43.964457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.494621+0000","last_change":"2024-09-19T06:04:05.435779+0000","last_active":"2024-09-19T06:04:15.494621+0000","last_peered":"2024-09-19T06:04:15.494621+0000","last_clean":"2024-09-19T06:04:15.494621+0000","last_became_active":"2024-09-19T06:04:05.435436+0000","last_became_peered":"2024-09-19T06:04:05.435436+0000","last_unstale":"2024-09-19T06:04:15.494621+0000","last_undegraded":"2024-09-19T06:04:15.494621+0000","last_fullsized":"2024-09-19T06:04:15.494621+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:13:03.341438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.495007+0000","last_change":"2024-09-19T06:04:05.431718+0000","last_active":"2024-09-19T06:04:15.495007+0000","last_peered":"2024-09-19T06:04:15.495007+0000","last_clean":"2024-09-19T06:04:15.495007+0000","last_became_active":"2024-09-19T06:04:05.431429+0000","last_became_peered":"2024-09-19T06:04:05.431429+0000","last_unstale":"2024-09-19T06:04:15.495007+0000","last_undegraded":"2024-09-19T06:04:15.495007+0000","last_fullsized":"2024-09-19T06:04:15.495007+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:11:42.818368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.494774+0000","last_change":"2024-09-19T06:04:05.429575+0000","last_active":"2024-09-19T06:04:15.494774+0000","last_peered":"2024-09-19T06:04:15.494774+0000","last_clean":"2024-09-19T06:04:15.494774+0000","last_became_active":"2024-09-19T06:04:05.429226+0000","last_became_peered":"2024-09-19T06:04:05.429226+0000","last_unstale":"2024-09-19T06:04:15.494774+0000","last_undegraded":"2024-09-19T06:04:15.494774+0000","last_fullsized":"2024-09-19T06:04:15.494774+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:29:19.680433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.496854+0000","last_change":"2024-09-19T06:04:05.431612+0000","last_active":"2024-09-19T06:04:15.496854+0000","last_peered":"2024-09-19T06:04:15.496854+0000","last_clean":"2024-09-19T06:04:15.496854+0000","last_became_active":"2024-09-19T06:04:05.431240+0000","last_became_peered":"2024-09-19T06:04:05.431240+0000","last_unstale":"2024-09-19T06:04:15.496854+0000","last_undegraded":"2024-09-19T06:04:15.496854+0000","last_fullsized":"2024-09-19T06:04:15.496854+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:46:14.138603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.496258+0000","last_change":"2024-09-19T06:04:05.428849+0000","last_active":"2024-09-19T06:04:15.496258+0000","last_peered":"2024-09-19T06:04:15.496258+0000","last_clean":"2024-09-19T06:04:15.496258+0000","last_became_active":"2024-09-19T06:04:05.428516+0000","last_became_peered":"2024-09-19T06:04:05.428516+0000","last_unstale":"2024-09-19T06:04:15.496258+0000","last_undegraded":"2024-09-19T06:04:15.496258+0000","last_fullsized":"2024-09-19T06:04:15.496258+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:58:00.323959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.495321+0000","last_change":"2024-09-19T06:04:05.436409+0000","last_active":"2024-09-19T06:04:15.495321+0000","last_peered":"2024-09-19T06:04:15.495321+0000","last_clean":"2024-09-19T06:04:15.495321+0000","last_became_active":"2024-09-19T06:04:05.436058+0000","last_became_peered":"2024-09-19T06:04:05.436058+0000","last_unstale":"2024-09-19T06:04:15.495321+0000","last_undegraded":"2024-09-19T06:04:15.495321+0000","last_fullsized":"2024-09-19T06:04:15.495321+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:20:45.227159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.494214+0000","last_change":"2024-09-19T06:04:05.434398+0000","last_active":"2024-09-19T06:04:15.494214+0000","last_peered":"2024-09-19T06:04:15.494214+0000","last_clean":"2024-09-19T06:04:15.494214+0000","last_became_active":"2024-09-19T06:04:05.433635+0000","last_became_peered":"2024-09-19T06:04:05.433635+0000","last_unstale":"2024-09-19T06:04:15.494214+0000","last_undegraded":"2024-09-19T06:04:15.494214+0000","last_fullsized":"2024-09-19T06:04:15.494214+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:10:42.104705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.464300+0000","last_change":"2024-09-19T06:04:05.423447+0000","last_active":"2024-09-19T06:04:15.464300+0000","last_peered":"2024-09-19T06:04:15.464300+0000","last_clean":"2024-09-19T06:04:15.464300+0000","last_became_active":"2024-09-19T06:04:05.423081+0000","last_became_peered":"2024-09-19T06:04:05.423081+0000","last_unstale":"2024-09-19T06:04:15.464300+0000","last_undegraded":"2024-09-19T06:04:15.464300+0000","last_fullsized":"2024-09-19T06:04:15.464300+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:03:54.856251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.464308+0000","last_change":"2024-09-19T06:04:05.426371+0000","last_active":"2024-09-19T06:04:15.464308+0000","last_peered":"2024-09-19T06:04:15.464308+0000","last_clean":"2024-09-19T06:04:15.464308+0000","last_became_active":"2024-09-19T06:04:05.425601+0000","last_became_peered":"2024-09-19T06:04:05.425601+0000","last_unstale":"2024-09-19T06:04:15.464308+0000","last_undegraded":"2024-09-19T06:04:15.464308+0000","last_fullsized":"2024-09-19T06:04:15.464308+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:55:05.677121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.494912+0000","last_change":"2024-09-19T06:04:05.426264+0000","last_active":"2024-09-19T06:04:15.494912+0000","last_peered":"2024-09-19T06:04:15.494912+0000","last_clean":"2024-09-19T06:04:15.494912+0000","last_became_active":"2024-09-19T06:04:05.425939+0000","last_became_peered":"2024-09-19T06:04:05.425939+0000","last_unstale":"2024-09-19T06:04:15.494912+0000","last_undegraded":"2024-09-19T06:04:15.494912+0000","last_fullsized":"2024-09-19T06:04:15.494912+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:18:43.250682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.496367+0000","last_change":"2024-09-19T06:04:05.432654+0000","last_active":"2024-09-19T06:04:15.496367+0000","last_peered":"2024-09-19T06:04:15.496367+0000","last_clean":"2024-09-19T06:04:15.496367+0000","last_became_active":"2024-09-19T06:04:05.431489+0000","last_became_peered":"2024-09-19T06:04:05.431489+0000","last_unstale":"2024-09-19T06:04:15.496367+0000","last_undegraded":"2024-09-19T06:04:15.496367+0000","last_fullsized":"2024-09-19T06:04:15.496367+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:15:41.251538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.461475+0000","last_change":"2024-09-19T06:04:05.435221+0000","last_active":"2024-09-19T06:04:15.461475+0000","last_peered":"2024-09-19T06:04:15.461475+0000","last_clean":"2024-09-19T06:04:15.461475+0000","last_became_active":"2024-09-19T06:04:05.434909+0000","last_became_peered":"2024-09-19T06:04:05.434909+0000","last_unstale":"2024-09-19T06:04:15.461475+0000","last_undegraded":"2024-09-19T06:04:15.461475+0000","last_fullsized":"2024-09-19T06:04:15.461475+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:15:20.414499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.495538+0000","last_change":"2024-09-19T06:04:05.426472+0000","last_active":"2024-09-19T06:04:15.495538+0000","last_peered":"2024-09-19T06:04:15.495538+0000","last_clean":"2024-09-19T06:04:15.495538+0000","last_became_active":"2024-09-19T06:04:05.426141+0000","last_became_peered":"2024-09-19T06:04:05.426141+0000","last_unstale":"2024-09-19T06:04:15.495538+0000","last_undegraded":"2024-09-19T06:04:15.495538+0000","last_fullsized":"2024-09-19T06:04:15.495538+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:57:25.022094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.495530+0000","last_change":"2024-09-19T06:04:05.432940+0000","last_active":"2024-09-19T06:04:15.495530+0000","last_peered":"2024-09-19T06:04:15.495530+0000","last_clean":"2024-09-19T06:04:15.495530+0000","last_became_active":"2024-09-19T06:04:05.432579+0000","last_became_peered":"2024-09-19T06:04:05.432579+0000","last_unstale":"2024-09-19T06:04:15.495530+0000","last_undegraded":"2024-09-19T06:04:15.495530+0000","last_fullsized":"2024-09-19T06:04:15.495530+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:56.740048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.494785+0000","last_change":"2024-09-19T06:04:05.417967+0000","last_active":"2024-09-19T06:04:15.494785+0000","last_peered":"2024-09-19T06:04:15.494785+0000","last_clean":"2024-09-19T06:04:15.494785+0000","last_became_active":"2024-09-19T06:04:05.417658+0000","last_became_peered":"2024-09-19T06:04:05.417658+0000","last_unstale":"2024-09-19T06:04:15.494785+0000","last_undegraded":"2024-09-19T06:04:15.494785+0000","last_fullsized":"2024-09-19T06:04:15.494785+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:55.571313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.460861+0000","last_change":"2024-09-19T06:04:05.424627+0000","last_active":"2024-09-19T06:04:15.460861+0000","last_peered":"2024-09-19T06:04:15.460861+0000","last_clean":"2024-09-19T06:04:15.460861+0000","last_became_active":"2024-09-19T06:04:05.424301+0000","last_became_peered":"2024-09-19T06:04:05.424301+0000","last_unstale":"2024-09-19T06:04:15.460861+0000","last_undegraded":"2024-09-19T06:04:15.460861+0000","last_fullsized":"2024-09-19T06:04:15.460861+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:48:00.964989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.494995+0000","last_change":"2024-09-19T06:04:05.423635+0000","last_active":"2024-09-19T06:04:15.494995+0000","last_peered":"2024-09-19T06:04:15.494995+0000","last_clean":"2024-09-19T06:04:15.494995+0000","last_became_active":"2024-09-19T06:04:05.422625+0000","last_became_peered":"2024-09-19T06:04:05.422625+0000","last_unstale":"2024-09-19T06:04:15.494995+0000","last_undegraded":"2024-09-19T06:04:15.494995+0000","last_fullsized":"2024-09-19T06:04:15.494995+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:33:34.099443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.463107+0000","last_change":"2024-09-19T06:04:05.428933+0000","last_active":"2024-09-19T06:04:15.463107+0000","last_peered":"2024-09-19T06:04:15.463107+0000","last_clean":"2024-09-19T06:04:15.463107+0000","last_became_active":"2024-09-19T06:04:05.428598+0000","last_became_peered":"2024-09-19T06:04:05.428598+0000","last_unstale":"2024-09-19T06:04:15.463107+0000","last_undegraded":"2024-09-19T06:04:15.463107+0000","last_fullsized":"2024-09-19T06:04:15.463107+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:27:15.111954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.496318+0000","last_change":"2024-09-19T06:04:05.431661+0000","last_active":"2024-09-19T06:04:15.496318+0000","last_peered":"2024-09-19T06:04:15.496318+0000","last_clean":"2024-09-19T06:04:15.496318+0000","last_became_active":"2024-09-19T06:04:05.430579+0000","last_became_peered":"2024-09-19T06:04:05.430579+0000","last_unstale":"2024-09-19T06:04:15.496318+0000","last_undegraded":"2024-09-19T06:04:15.496318+0000","last_fullsized":"2024-09-19T06:04:15.496318+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:02:46.505053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.464462+0000","last_change":"2024-09-19T06:04:05.430427+0000","last_active":"2024-09-19T06:04:15.464462+0000","last_peered":"2024-09-19T06:04:15.464462+0000","last_clean":"2024-09-19T06:04:15.464462+0000","last_became_active":"2024-09-19T06:04:05.430106+0000","last_became_peered":"2024-09-19T06:04:05.430106+0000","last_unstale":"2024-09-19T06:04:15.464462+0000","last_undegraded":"2024-09-19T06:04:15.464462+0000","last_fullsized":"2024-09-19T06:04:15.464462+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:03:00.764689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.464577+0000","last_change":"2024-09-19T06:04:05.427189+0000","last_active":"2024-09-19T06:04:15.464577+0000","last_peered":"2024-09-19T06:04:15.464577+0000","last_clean":"2024-09-19T06:04:15.464577+0000","last_became_active":"2024-09-19T06:04:05.426874+0000","last_became_peered":"2024-09-19T06:04:05.426874+0000","last_unstale":"2024-09-19T06:04:15.464577+0000","last_undegraded":"2024-09-19T06:04:15.464577+0000","last_fullsized":"2024-09-19T06:04:15.464577+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:37:10.910723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:04:15.495314+0000","last_change":"2024-09-19T06:04:05.435803+0000","last_active":"2024-09-19T06:04:15.495314+0000","last_peered":"2024-09-19T06:04:15.495314+0000","last_clean":"2024-09-19T06:04:15.495314+0000","last_became_active":"2024-09-19T06:04:05.435430+0000","last_became_peered":"2024-09-19T06:04:05.435430+0000","last_unstale":"2024-09-19T06:04:15.495314+0000","last_undegraded":"2024-09-19T06:04:15.495314+0000","last_fullsized":"2024-09-19T06:04:15.495314+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:41.828016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":49896,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":37,"num_read_kb":69,"num_write":71,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":245760,"data_stored":159836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":61,"ondisk_log_size":61,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547223,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":970752,"data_stored":478846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776156,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36936,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708216,"statfs":{"total":95995035648,"available":95957213184,"internally_reserved":0,"allocated":1630208,"data_stored":1114410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939681,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":978944,"data_stored":483524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168613,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":978944,"data_stored":479450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397547,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36880,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708272,"statfs":{"total":95995035648,"available":95957270528,"internally_reserved":0,"allocated":1572864,"data_stored":1073892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561072,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":966656,"data_stored":474750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790005,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28564,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716588,"statfs":{"total":95995035648,"available":95965786112,"internally_reserved":0,"allocated":1576960,"data_stored":1069396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953529,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":478868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182463,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36296,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708856,"statfs":{"total":95995035648,"available":95957868544,"internally_reserved":0,"allocated":974848,"data_stored":474854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411397,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1028096,"data_stored":523882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574921,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1024000,"data_stored":523848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738447,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":970752,"data_stored":474840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":49098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":59280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":49292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T06:04:59.015 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T06:04:59.016 INFO:tasks.cephadm:Setting up client nodes... 2024-09-19T06:04:59.016 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-19T06:04:59.272 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:04:59.694 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:04:59 smithi037 ceph-mon[31211]: from='client.14814 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:04:59.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:59.783+0000 7f3ecca35640 1 -- 172.21.15.37:0/1440049513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ec8101c00 msgr2=0x7f3ec8102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:59.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:59.783+0000 7f3ecca35640 1 --2- 172.21.15.37:0/1440049513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ec8101c00 0x7f3ec8102000 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3eb8009900 tx=0x7f3eb802a410 comp rx=0 tx=0).stop 2024-09-19T06:04:59.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:59.783+0000 7f3ecca35640 1 -- 172.21.15.37:0/1440049513 shutdown_connections 2024-09-19T06:04:59.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:59.783+0000 7f3ecca35640 1 --2- 172.21.15.37:0/1440049513 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ec8102e00 0x7f3ec8103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:59.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:59.783+0000 7f3ecca35640 1 --2- 172.21.15.37:0/1440049513 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ec81037c0 0x7f3ec810a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:59.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:59.783+0000 7f3ecca35640 1 --2- 172.21.15.37:0/1440049513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ec8101c00 0x7f3ec8102000 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:59.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:59.783+0000 7f3ecca35640 1 -- 172.21.15.37:0/1440049513 >> 172.21.15.37:0/1440049513 conn(0x7f3ec80fd390 msgr2=0x7f3ec80ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:59.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:59.783+0000 7f3ecca35640 1 -- 172.21.15.37:0/1440049513 shutdown_connections 2024-09-19T06:04:59.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:59.783+0000 7f3ecca35640 1 -- 172.21.15.37:0/1440049513 wait complete. 2024-09-19T06:04:59.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:59.784+0000 7f3ecca35640 1 Processor -- start 2024-09-19T06:04:59.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:59.784+0000 7f3ecca35640 1 -- start start 2024-09-19T06:04:59.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:59.784+0000 7f3ecca35640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ec8101c00 0x7f3ec8197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:59.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:59.784+0000 7f3ecca35640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ec8102e00 0x7f3ec8198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:59.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:59.784+0000 7f3ecca35640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ec81037c0 0x7f3ec819f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:59.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:59.784+0000 7f3ecca35640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec810d860 con 0x7f3ec81037c0 2024-09-19T06:04:59.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:59.784+0000 7f3ecca35640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec810d6e0 con 0x7f3ec8102e00 2024-09-19T06:04:59.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:59.784+0000 7f3ecca35640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec810d9e0 con 0x7f3ec8101c00 2024-09-19T06:04:59.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:59.784+0000 7f3ec6d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ec81037c0 0x7f3ec819f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:59.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:59.784+0000 7f3ec6d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ec81037c0 0x7f3ec819f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50192/0 (socket says 172.21.15.37:50192) 2024-09-19T06:04:59.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:59.784+0000 7f3ec6d9d640 1 -- 172.21.15.37:0/3727935079 learned_addr learned my addr 172.21.15.37:0/3727935079 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:04:59.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:59.784+0000 7f3ec5d9b640 1 --2- 172.21.15.37:0/3727935079 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ec8102e00 0x7f3ec8198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:59.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:59.784+0000 7f3ec659c640 1 --2- 172.21.15.37:0/3727935079 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ec8101c00 0x7f3ec8197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:59.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:59.784+0000 7f3ec6d9d640 1 -- 172.21.15.37:0/3727935079 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ec8101c00 msgr2=0x7f3ec8197f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:59.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:59.784+0000 7f3ec6d9d640 1 --2- 172.21.15.37:0/3727935079 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ec8101c00 0x7f3ec8197f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:59.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:59.784+0000 7f3ec6d9d640 1 -- 172.21.15.37:0/3727935079 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ec8102e00 msgr2=0x7f3ec8198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:59.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:59.784+0000 7f3ec6d9d640 1 --2- 172.21.15.37:0/3727935079 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ec8102e00 0x7f3ec8198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:59.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:59.784+0000 7f3ec6d9d640 1 -- 172.21.15.37:0/3727935079 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ec819fb50 con 0x7f3ec81037c0 2024-09-19T06:04:59.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:59.784+0000 7f3ec5d9b640 1 --2- 172.21.15.37:0/3727935079 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ec8102e00 0x7f3ec8198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:04:59.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:59.785+0000 7f3ec6d9d640 1 --2- 172.21.15.37:0/3727935079 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ec81037c0 0x7f3ec819f4e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3ec000cad0 tx=0x7f3ec000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:59.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:59.785+0000 7f3eb77fe640 1 -- 172.21.15.37:0/3727935079 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ec000ae20 con 0x7f3ec81037c0 2024-09-19T06:04:59.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:59.785+0000 7f3ecca35640 1 -- 172.21.15.37:0/3727935079 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ec819fe40 con 0x7f3ec81037c0 2024-09-19T06:04:59.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:59.785+0000 7f3eb77fe640 1 -- 172.21.15.37:0/3727935079 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ec0005020 con 0x7f3ec81037c0 2024-09-19T06:04:59.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:59.785+0000 7f3eb77fe640 1 -- 172.21.15.37:0/3727935079 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ec000f6f0 con 0x7f3ec81037c0 2024-09-19T06:04:59.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:59.785+0000 7f3ecca35640 1 -- 172.21.15.37:0/3727935079 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ec81a02a0 con 0x7f3ec81037c0 2024-09-19T06:04:59.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:59.786+0000 7f3ecca35640 1 -- 172.21.15.37:0/3727935079 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ec8109050 con 0x7f3ec81037c0 2024-09-19T06:04:59.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:59.787+0000 7f3eb77fe640 1 -- 172.21.15.37:0/3727935079 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f3ec00051d0 con 0x7f3ec81037c0 2024-09-19T06:04:59.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:59.788+0000 7f3eb77fe640 1 --2- 172.21.15.37:0/3727935079 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f3eb00a3300 0x7f3eb00a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:59.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:59.788+0000 7f3ec659c640 1 --2- 172.21.15.37:0/3727935079 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f3eb00a3300 0x7f3eb00a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:59.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:59.788+0000 7f3eb77fe640 1 -- 172.21.15.37:0/3727935079 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f3ec00d0180 con 0x7f3ec81037c0 2024-09-19T06:04:59.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:59.788+0000 7f3ec659c640 1 --2- 172.21.15.37:0/3727935079 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f3eb00a3300 0x7f3eb00a57c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3eb8006010 tx=0x7f3eb8000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:59.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:04:59.791+0000 7f3eb77fe640 1 -- 172.21.15.37:0/3727935079 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3ec0014030 con 0x7f3ec81037c0 2024-09-19T06:04:59.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:04:59 smithi099 ceph-mon[35300]: from='client.14814 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:05:00.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:04:59 smithi117 ceph-mon[35050]: from='client.14814 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:05:00.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:00.033+0000 7f3ecca35640 1 -- 172.21.15.37:0/3727935079 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f3ec802d7c0 con 0x7f3ec81037c0 2024-09-19T06:05:00.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:00.036+0000 7f3eb77fe640 1 -- 172.21.15.37:0/3727935079 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f3ec009cb00 con 0x7f3ec81037c0 2024-09-19T06:05:00.038 INFO:teuthology.orchestra.run.smithi037.stdout:[client.0] 2024-09-19T06:05:00.038 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQAMv+tmwOcXAhAA8AwLTVo+b1z5D97opw7c+w== 2024-09-19T06:05:00.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:00.038+0000 7f3ecca35640 1 -- 172.21.15.37:0/3727935079 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f3eb00a3300 msgr2=0x7f3eb00a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:00.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:00.038+0000 7f3ecca35640 1 --2- 172.21.15.37:0/3727935079 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f3eb00a3300 0x7f3eb00a57c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3eb8006010 tx=0x7f3eb8000bc0 comp rx=0 tx=0).stop 2024-09-19T06:05:00.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:00.038+0000 7f3ecca35640 1 -- 172.21.15.37:0/3727935079 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ec81037c0 msgr2=0x7f3ec819f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:00.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:00.038+0000 7f3ecca35640 1 --2- 172.21.15.37:0/3727935079 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ec81037c0 0x7f3ec819f4e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3ec000cad0 tx=0x7f3ec000cf90 comp rx=0 tx=0).stop 2024-09-19T06:05:00.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:00.038+0000 7f3ecca35640 1 -- 172.21.15.37:0/3727935079 shutdown_connections 2024-09-19T06:05:00.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:00.038+0000 7f3ecca35640 1 --2- 172.21.15.37:0/3727935079 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f3eb00a3300 0x7f3eb00a57c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:00.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:00.038+0000 7f3ecca35640 1 --2- 172.21.15.37:0/3727935079 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ec8102e00 0x7f3ec8198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:00.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:00.038+0000 7f3ecca35640 1 --2- 172.21.15.37:0/3727935079 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ec81037c0 0x7f3ec819f4e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:00.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:00.038+0000 7f3ecca35640 1 --2- 172.21.15.37:0/3727935079 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ec8101c00 0x7f3ec8197f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:00.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:00.038+0000 7f3ecca35640 1 -- 172.21.15.37:0/3727935079 >> 172.21.15.37:0/3727935079 conn(0x7f3ec80fd390 msgr2=0x7f3ec8106220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:00.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:00.038+0000 7f3ecca35640 1 -- 172.21.15.37:0/3727935079 shutdown_connections 2024-09-19T06:05:00.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:00.038+0000 7f3ecca35640 1 -- 172.21.15.37:0/3727935079 wait complete. 2024-09-19T06:05:00.741 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:00 smithi037 ceph-mon[31211]: pgmap v310: 129 pgs: 129 active+clean; 635 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 5.6 KiB/s wr, 5 op/s 2024-09-19T06:05:00.741 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:00 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/3727935079' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T06:05:00.741 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:00 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/3727935079' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T06:05:00.741 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:00 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:05:00.768 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-19T06:05:00.768 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-19T06:05:00.768 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-19T06:05:00.805 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-19T06:05:00.805 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-19T06:05:00.805 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-19T06:05:00.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:00 smithi099 ceph-mon[35300]: pgmap v310: 129 pgs: 129 active+clean; 635 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 5.6 KiB/s wr, 5 op/s 2024-09-19T06:05:00.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:00 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/3727935079' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T06:05:00.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:00 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/3727935079' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T06:05:00.869 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:00 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:05:00.961 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:00 smithi117 ceph-mon[35050]: pgmap v310: 129 pgs: 129 active+clean; 635 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 5.6 KiB/s wr, 5 op/s 2024-09-19T06:05:00.961 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:00 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/3727935079' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T06:05:00.961 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:00 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/3727935079' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T06:05:00.961 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:00 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:05:01.747 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:05:02.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:02.388+0000 7fca0116c640 1 -- 172.21.15.37:0/2912210058 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9fc100a80 msgr2=0x7fc9fc100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:02.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:02.388+0000 7fca0116c640 1 --2- 172.21.15.37:0/2912210058 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9fc100a80 0x7fc9fc100ee0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc9e4009930 tx=0x7fc9e402a420 comp rx=0 tx=0).stop 2024-09-19T06:05:02.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:02.388+0000 7fca0116c640 1 -- 172.21.15.37:0/2912210058 shutdown_connections 2024-09-19T06:05:02.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:02.388+0000 7fca0116c640 1 --2- 172.21.15.37:0/2912210058 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9fc101420 0x7fc9fc10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:02.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:02.388+0000 7fca0116c640 1 --2- 172.21.15.37:0/2912210058 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9fc100a80 0x7fc9fc100ee0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:02.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:02.388+0000 7fca0116c640 1 --2- 172.21.15.37:0/2912210058 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc9fc106a80 0x7fc9fc106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:02.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:02.388+0000 7fca0116c640 1 -- 172.21.15.37:0/2912210058 >> 172.21.15.37:0/2912210058 conn(0x7fc9fc0fc7a0 msgr2=0x7fc9fc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:02.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:02.388+0000 7fca0116c640 1 -- 172.21.15.37:0/2912210058 shutdown_connections 2024-09-19T06:05:02.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:02.388+0000 7fca0116c640 1 -- 172.21.15.37:0/2912210058 wait complete. 2024-09-19T06:05:02.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:02.389+0000 7fca0116c640 1 Processor -- start 2024-09-19T06:05:02.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:02.389+0000 7fca0116c640 1 -- start start 2024-09-19T06:05:02.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:02.389+0000 7fca0116c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9fc100a80 0x7fc9fc197330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:02.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:02.389+0000 7fca0116c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc9fc101420 0x7fc9fc197870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:02.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:02.389+0000 7fca0116c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9fc106a80 0x7fc9fc19bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:02.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:02.389+0000 7fca0116c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc9fc110e80 con 0x7fc9fc106a80 2024-09-19T06:05:02.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:02.389+0000 7fca0116c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc9fc110d00 con 0x7fc9fc101420 2024-09-19T06:05:02.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:02.389+0000 7fca0116c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc9fc111000 con 0x7fc9fc100a80 2024-09-19T06:05:02.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:02.389+0000 7fc9fb59e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9fc106a80 0x7fc9fc19bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:02.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:02.390+0000 7fc9fb59e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9fc106a80 0x7fc9fc19bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50204/0 (socket says 172.21.15.37:50204) 2024-09-19T06:05:02.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:02.390+0000 7fc9fb59e640 1 -- 172.21.15.37:0/1901530515 learned_addr learned my addr 172.21.15.37:0/1901530515 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:05:02.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:02.390+0000 7fc9fad9d640 1 --2- 172.21.15.37:0/1901530515 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9fc100a80 0x7fc9fc197330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:02.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:02.390+0000 7fc9f3fff640 1 --2- 172.21.15.37:0/1901530515 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc9fc101420 0x7fc9fc197870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:02.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:02.390+0000 7fc9fb59e640 1 -- 172.21.15.37:0/1901530515 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9fc100a80 msgr2=0x7fc9fc197330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:02.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:02.390+0000 7fc9fb59e640 1 --2- 172.21.15.37:0/1901530515 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9fc100a80 0x7fc9fc197330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:02.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:02.390+0000 7fc9fb59e640 1 -- 172.21.15.37:0/1901530515 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc9fc101420 msgr2=0x7fc9fc197870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:02.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:02.390+0000 7fc9fb59e640 1 --2- 172.21.15.37:0/1901530515 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc9fc101420 0x7fc9fc197870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:02.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:02.390+0000 7fc9fb59e640 1 -- 172.21.15.37:0/1901530515 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9fc19c2e0 con 0x7fc9fc106a80 2024-09-19T06:05:02.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:02.390+0000 7fc9fb59e640 1 --2- 172.21.15.37:0/1901530515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9fc106a80 0x7fc9fc19bc00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc9f400eaa0 tx=0x7fc9f400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:02.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:02.390+0000 7fc9f8d99640 1 -- 172.21.15.37:0/1901530515 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9f400cdb0 con 0x7fc9fc106a80 2024-09-19T06:05:02.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:02.390+0000 7fc9f8d99640 1 -- 172.21.15.37:0/1901530515 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9f4005020 con 0x7fc9fc106a80 2024-09-19T06:05:02.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:02.390+0000 7fca0116c640 1 -- 172.21.15.37:0/1901530515 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9fc19c5d0 con 0x7fc9fc106a80 2024-09-19T06:05:02.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:02.390+0000 7fc9f8d99640 1 -- 172.21.15.37:0/1901530515 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9f40116b0 con 0x7fc9fc106a80 2024-09-19T06:05:02.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:02.390+0000 7fca0116c640 1 -- 172.21.15.37:0/1901530515 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9fc1a3eb0 con 0x7fc9fc106a80 2024-09-19T06:05:02.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:02.391+0000 7fca0116c640 1 -- 172.21.15.37:0/1901530515 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9fc1021c0 con 0x7fc9fc106a80 2024-09-19T06:05:02.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:02.393+0000 7fc9f8d99640 1 -- 172.21.15.37:0/1901530515 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fc9f4005560 con 0x7fc9fc106a80 2024-09-19T06:05:02.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:02.393+0000 7fc9f8d99640 1 --2- 172.21.15.37:0/1901530515 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fc9e80a32d0 0x7fc9e80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:02.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:02.393+0000 7fc9f8d99640 1 -- 172.21.15.37:0/1901530515 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7fc9f40cfe60 con 0x7fc9fc106a80 2024-09-19T06:05:02.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:02.393+0000 7fc9fad9d640 1 --2- 172.21.15.37:0/1901530515 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fc9e80a32d0 0x7fc9e80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:02.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:02.394+0000 7fc9fad9d640 1 --2- 172.21.15.37:0/1901530515 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fc9e80a32d0 0x7fc9e80a5790 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec00bb60 tx=0x7fc9ec00b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:02.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:02.398+0000 7fc9f8d99640 1 -- 172.21.15.37:0/1901530515 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc9f4016030 con 0x7fc9fc106a80 2024-09-19T06:05:02.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:02.651+0000 7fca0116c640 1 -- 172.21.15.37:0/1901530515 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fc9fc100ee0 con 0x7fc9fc106a80 2024-09-19T06:05:02.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:02.656+0000 7fc9f8d99640 1 -- 172.21.15.37:0/1901530515 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+264049 (secure 0 0 0) 0x7fc9fc100ee0 con 0x7fc9fc106a80 2024-09-19T06:05:02.658 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T06:05:02.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:02.659+0000 7fca0116c640 1 -- 172.21.15.37:0/1901530515 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fc9e80a32d0 msgr2=0x7fc9e80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:02.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:02.659+0000 7fca0116c640 1 --2- 172.21.15.37:0/1901530515 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fc9e80a32d0 0x7fc9e80a5790 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec00bb60 tx=0x7fc9ec00b390 comp rx=0 tx=0).stop 2024-09-19T06:05:02.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:02.659+0000 7fca0116c640 1 -- 172.21.15.37:0/1901530515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9fc106a80 msgr2=0x7fc9fc19bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:02.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:02.659+0000 7fca0116c640 1 --2- 172.21.15.37:0/1901530515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9fc106a80 0x7fc9fc19bc00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc9f400eaa0 tx=0x7fc9f400ef60 comp rx=0 tx=0).stop 2024-09-19T06:05:02.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:02.659+0000 7fca0116c640 1 -- 172.21.15.37:0/1901530515 shutdown_connections 2024-09-19T06:05:02.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:02.659+0000 7fca0116c640 1 --2- 172.21.15.37:0/1901530515 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fc9e80a32d0 0x7fc9e80a5790 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:02.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:02.659+0000 7fca0116c640 1 --2- 172.21.15.37:0/1901530515 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc9fc101420 0x7fc9fc197870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:02.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:02.659+0000 7fca0116c640 1 --2- 172.21.15.37:0/1901530515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9fc106a80 0x7fc9fc19bc00 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:02.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:02.659+0000 7fca0116c640 1 --2- 172.21.15.37:0/1901530515 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9fc100a80 0x7fc9fc197330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:02.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:02.659+0000 7fca0116c640 1 -- 172.21.15.37:0/1901530515 >> 172.21.15.37:0/1901530515 conn(0x7fc9fc0fc7a0 msgr2=0x7fc9fc0fcfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:02.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:02.659+0000 7fca0116c640 1 -- 172.21.15.37:0/1901530515 shutdown_connections 2024-09-19T06:05:02.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:02.659+0000 7fca0116c640 1 -- 172.21.15.37:0/1901530515 wait complete. 2024-09-19T06:05:02.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:02 smithi099 ceph-mon[35300]: pgmap v311: 129 pgs: 129 active+clean; 635 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 3.6 KiB/s wr, 3 op/s 2024-09-19T06:05:02.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:02 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:05:02.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:02 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:05:02.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:02 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:05:02.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:02 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:05:02.980 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:02 smithi037 ceph-mon[31211]: pgmap v311: 129 pgs: 129 active+clean; 635 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 3.6 KiB/s wr, 3 op/s 2024-09-19T06:05:02.980 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:02 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:05:02.980 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:02 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:05:02.980 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:02 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:05:02.980 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:02 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:05:02.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:02 smithi117 ceph-mon[35050]: pgmap v311: 129 pgs: 129 active+clean; 635 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 3.6 KiB/s wr, 3 op/s 2024-09-19T06:05:03.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:02 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:05:03.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:02 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:05:03.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:02 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:05:03.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:02 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:05:03.341 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":17,"flags":0,"active_gid":14148,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":3797010169},{"type":"v1","addr":"172.21.15.37:6801","nonce":3797010169}]},"active_addr":"172.21.15.37:6801/3797010169","active_change":"2024-09-19T05:57:12.560919+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24122,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.37:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.37:0","nonce":1417461922}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.37:0","nonce":1246351928}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.37:0","nonce":808418272}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.37:0","nonce":1366126104}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.37:0","nonce":1362344674}]}]} 2024-09-19T06:05:03.347 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-19T06:05:03.347 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-19T06:05:03.348 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T06:05:03.604 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:05:03.888 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:03 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:05:03.888 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:03 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:05:03.888 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:03 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/1901530515' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T06:05:03.888 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:03 smithi037 ceph-mon[31211]: pgmap v312: 129 pgs: 129 active+clean; 635 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 3.4 KiB/s wr, 3 op/s 2024-09-19T06:05:03.889 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:03 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:05:03.889 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:03 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:05:03.889 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:03 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:05:03.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:03 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:05:03.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:03 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:05:03.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:03 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/1901530515' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T06:05:03.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:03 smithi099 ceph-mon[35300]: pgmap v312: 129 pgs: 129 active+clean; 635 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 3.4 KiB/s wr, 3 op/s 2024-09-19T06:05:03.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:03 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:05:03.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:03 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:05:03.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:03 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:05:03.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:03 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:05:04.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:03 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:05:04.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:03 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/1901530515' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T06:05:04.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:03 smithi117 ceph-mon[35050]: pgmap v312: 129 pgs: 129 active+clean; 635 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 3.4 KiB/s wr, 3 op/s 2024-09-19T06:05:04.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:03 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:05:04.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:03 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:05:04.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:03 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:05:04.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:04.115+0000 7f518c0ac640 1 -- 172.21.15.37:0/1020552005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5184101de0 msgr2=0x7f51841021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:04.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:04.115+0000 7f518c0ac640 1 --2- 172.21.15.37:0/1020552005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5184101de0 0x7f51841021c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5180009900 tx=0x7f518002a410 comp rx=0 tx=0).stop 2024-09-19T06:05:04.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:04.115+0000 7f518c0ac640 1 -- 172.21.15.37:0/1020552005 shutdown_connections 2024-09-19T06:05:04.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:04.115+0000 7f518c0ac640 1 --2- 172.21.15.37:0/1020552005 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5184102790 0x7f51841067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:04.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:04.115+0000 7f518c0ac640 1 --2- 172.21.15.37:0/1020552005 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5184106f10 0x7f518410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:04.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:04.115+0000 7f518c0ac640 1 --2- 172.21.15.37:0/1020552005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5184101de0 0x7f51841021c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:04.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:04.115+0000 7f518c0ac640 1 -- 172.21.15.37:0/1020552005 >> 172.21.15.37:0/1020552005 conn(0x7f51840fd8c0 msgr2=0x7f51840ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:04.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:04.115+0000 7f518c0ac640 1 -- 172.21.15.37:0/1020552005 shutdown_connections 2024-09-19T06:05:04.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:04.115+0000 7f518c0ac640 1 -- 172.21.15.37:0/1020552005 wait complete. 2024-09-19T06:05:04.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:04.116+0000 7f518c0ac640 1 Processor -- start 2024-09-19T06:05:04.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:04.116+0000 7f518c0ac640 1 -- start start 2024-09-19T06:05:04.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:04.116+0000 7f518c0ac640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5184101de0 0x7f51841984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:04.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:04.116+0000 7f518c0ac640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5184102790 0x7f51841989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:04.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:04.116+0000 7f518c0ac640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5184106f10 0x7f518419cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:04.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:04.116+0000 7f518c0ac640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5184111f90 con 0x7f5184102790 2024-09-19T06:05:04.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:04.116+0000 7f518c0ac640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f5184111e10 con 0x7f5184101de0 2024-09-19T06:05:04.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:04.116+0000 7f518c0ac640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5184112110 con 0x7f5184106f10 2024-09-19T06:05:04.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:04.116+0000 7f5189647640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5184102790 0x7f51841989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:04.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:04.116+0000 7f5189647640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5184102790 0x7f51841989f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35360/0 (socket says 172.21.15.37:35360) 2024-09-19T06:05:04.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:04.116+0000 7f5189647640 1 -- 172.21.15.37:0/45484203 learned_addr learned my addr 172.21.15.37:0/45484203 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:05:04.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:04.116+0000 7f5189e48640 1 --2- 172.21.15.37:0/45484203 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5184101de0 0x7f51841984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:04.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:04.116+0000 7f5189647640 1 -- 172.21.15.37:0/45484203 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5184106f10 msgr2=0x7f518419cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:04.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:04.116+0000 7f5189647640 1 --2- 172.21.15.37:0/45484203 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5184106f10 0x7f518419cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:04.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:04.116+0000 7f5189647640 1 -- 172.21.15.37:0/45484203 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5184101de0 msgr2=0x7f51841984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:04.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:04.116+0000 7f5189647640 1 --2- 172.21.15.37:0/45484203 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5184101de0 0x7f51841984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:04.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:04.116+0000 7f5189647640 1 -- 172.21.15.37:0/45484203 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f518419d460 con 0x7f5184102790 2024-09-19T06:05:04.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:04.116+0000 7f5189647640 1 --2- 172.21.15.37:0/45484203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5184102790 0x7f51841989f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f517400b4a0 tx=0x7f517400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:04.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:04.117+0000 7f517affd640 1 -- 172.21.15.37:0/45484203 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5174014070 con 0x7f5184102790 2024-09-19T06:05:04.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:04.117+0000 7f517affd640 1 -- 172.21.15.37:0/45484203 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5174010af0 con 0x7f5184102790 2024-09-19T06:05:04.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:04.117+0000 7f518c0ac640 1 -- 172.21.15.37:0/45484203 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f518419d750 con 0x7f5184102790 2024-09-19T06:05:04.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:04.117+0000 7f517affd640 1 -- 172.21.15.37:0/45484203 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5174017d10 con 0x7f5184102790 2024-09-19T06:05:04.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:04.117+0000 7f518c0ac640 1 -- 172.21.15.37:0/45484203 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51841a5030 con 0x7f5184102790 2024-09-19T06:05:04.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:04.118+0000 7f518c0ac640 1 -- 172.21.15.37:0/45484203 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51841021c0 con 0x7f5184102790 2024-09-19T06:05:04.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:04.119+0000 7f517affd640 1 -- 172.21.15.37:0/45484203 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f5174017070 con 0x7f5184102790 2024-09-19T06:05:04.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:04.120+0000 7f517affd640 1 --2- 172.21.15.37:0/45484203 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f51700a3350 0x7f51700a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:04.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:04.120+0000 7f5189e48640 1 --2- 172.21.15.37:0/45484203 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f51700a3350 0x7f51700a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:04.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:04.120+0000 7f517affd640 1 -- 172.21.15.37:0/45484203 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f51740cef70 con 0x7f5184102790 2024-09-19T06:05:04.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:04.121+0000 7f5189e48640 1 --2- 172.21.15.37:0/45484203 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f51700a3350 0x7f51700a5810 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f51800096c0 tx=0x7f5180000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:04.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:04.124+0000 7f517affd640 1 -- 172.21.15.37:0/45484203 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f517409ba00 con 0x7f5184102790 2024-09-19T06:05:04.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:04.300+0000 7f518c0ac640 1 -- 172.21.15.37:0/45484203 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f518402d7c0 con 0x7f5184102790 2024-09-19T06:05:04.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:04.302+0000 7f517affd640 1 -- 172.21.15.37:0/45484203 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+24200 (secure 0 0 0) 0x7f517409b300 con 0x7f5184102790 2024-09-19T06:05:04.304 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T06:05:04.304 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":87,"fsid":"b8c8bdae-764b-11ef-bceb-c7b262605968","created":"2024-09-19T05:56:22.523060+0000","modified":"2024-09-19T06:04:15.206008+0000","last_up_change":"2024-09-19T06:03:12.771014+0000","last_in_change":"2024-09-19T06:02:49.926626+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:59:27.062607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:04:01.918234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:04:04.392543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T06:04:10.877951+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"455bc11d-2b6e-4a0c-90d9-8ab4ef4f9e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1783875173},{"type":"v1","addr":"172.21.15.37:6803","nonce":1783875173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1783875173},{"type":"v1","addr":"172.21.15.37:6805","nonce":1783875173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1783875173},{"type":"v1","addr":"172.21.15.37:6809","nonce":1783875173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1783875173},{"type":"v1","addr":"172.21.15.37:6807","nonce":1783875173}]},"public_addr":"172.21.15.37:6803/1783875173","cluster_addr":"172.21.15.37:6805/1783875173","heartbeat_back_addr":"172.21.15.37:6809/1783875173","heartbeat_front_addr":"172.21.15.37:6807/1783875173","state":["exists","up"]},{"osd":1,"uuid":"3505c162-c342-479d-8ea2-15b7a9d625cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":3414373360},{"type":"v1","addr":"172.21.15.99:6801","nonce":3414373360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":3414373360},{"type":"v1","addr":"172.21.15.99:6803","nonce":3414373360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":3414373360},{"type":"v1","addr":"172.21.15.99:6807","nonce":3414373360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":3414373360},{"type":"v1","addr":"172.21.15.99:6805","nonce":3414373360}]},"public_addr":"172.21.15.99:6801/3414373360","cluster_addr":"172.21.15.99:6803/3414373360","heartbeat_back_addr":"172.21.15.99:6807/3414373360","heartbeat_front_addr":"172.21.15.99:6805/3414373360","state":["exists","up"]},{"osd":2,"uuid":"736ec67f-b5e7-43f0-9303-0c88878ead6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3794943081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3794943081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3794943081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3794943081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3794943081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3794943081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3794943081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3794943081}]},"public_addr":"172.21.15.117:6801/3794943081","cluster_addr":"172.21.15.117:6803/3794943081","heartbeat_back_addr":"172.21.15.117:6807/3794943081","heartbeat_front_addr":"172.21.15.117:6805/3794943081","state":["exists","up"]},{"osd":3,"uuid":"3f784ef7-0cc1-4c86-a03a-b8f13396c835","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2121011955},{"type":"v1","addr":"172.21.15.37:6811","nonce":2121011955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2121011955},{"type":"v1","addr":"172.21.15.37:6813","nonce":2121011955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2121011955},{"type":"v1","addr":"172.21.15.37:6817","nonce":2121011955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2121011955},{"type":"v1","addr":"172.21.15.37:6815","nonce":2121011955}]},"public_addr":"172.21.15.37:6811/2121011955","cluster_addr":"172.21.15.37:6813/2121011955","heartbeat_back_addr":"172.21.15.37:6817/2121011955","heartbeat_front_addr":"172.21.15.37:6815/2121011955","state":["exists","up"]},{"osd":4,"uuid":"d7c16e7f-f599-419b-b4a2-fd6c1cafa0d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":1881025735},{"type":"v1","addr":"172.21.15.99:6809","nonce":1881025735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1881025735},{"type":"v1","addr":"172.21.15.99:6811","nonce":1881025735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1881025735},{"type":"v1","addr":"172.21.15.99:6815","nonce":1881025735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":1881025735},{"type":"v1","addr":"172.21.15.99:6813","nonce":1881025735}]},"public_addr":"172.21.15.99:6809/1881025735","cluster_addr":"172.21.15.99:6811/1881025735","heartbeat_back_addr":"172.21.15.99:6815/1881025735","heartbeat_front_addr":"172.21.15.99:6813/1881025735","state":["exists","up"]},{"osd":5,"uuid":"2f499ab4-3d09-4f96-a709-b4229865c690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1141976511},{"type":"v1","addr":"172.21.15.117:6809","nonce":1141976511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1141976511},{"type":"v1","addr":"172.21.15.117:6811","nonce":1141976511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1141976511},{"type":"v1","addr":"172.21.15.117:6815","nonce":1141976511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1141976511},{"type":"v1","addr":"172.21.15.117:6813","nonce":1141976511}]},"public_addr":"172.21.15.117:6809/1141976511","cluster_addr":"172.21.15.117:6811/1141976511","heartbeat_back_addr":"172.21.15.117:6815/1141976511","heartbeat_front_addr":"172.21.15.117:6813/1141976511","state":["exists","up"]},{"osd":6,"uuid":"10f7fd72-1ae8-4efd-a448-75f4b5054be3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":770433145},{"type":"v1","addr":"172.21.15.37:6819","nonce":770433145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":770433145},{"type":"v1","addr":"172.21.15.37:6821","nonce":770433145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":770433145},{"type":"v1","addr":"172.21.15.37:6825","nonce":770433145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":770433145},{"type":"v1","addr":"172.21.15.37:6823","nonce":770433145}]},"public_addr":"172.21.15.37:6819/770433145","cluster_addr":"172.21.15.37:6821/770433145","heartbeat_back_addr":"172.21.15.37:6825/770433145","heartbeat_front_addr":"172.21.15.37:6823/770433145","state":["exists","up"]},{"osd":7,"uuid":"7199a267-c486-417c-b530-3ff03fc9eb1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1694360992},{"type":"v1","addr":"172.21.15.99:6817","nonce":1694360992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1694360992},{"type":"v1","addr":"172.21.15.99:6819","nonce":1694360992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":1694360992},{"type":"v1","addr":"172.21.15.99:6823","nonce":1694360992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":1694360992},{"type":"v1","addr":"172.21.15.99:6821","nonce":1694360992}]},"public_addr":"172.21.15.99:6817/1694360992","cluster_addr":"172.21.15.99:6819/1694360992","heartbeat_back_addr":"172.21.15.99:6823/1694360992","heartbeat_front_addr":"172.21.15.99:6821/1694360992","state":["exists","up"]},{"osd":8,"uuid":"8d5bb83c-62eb-4ded-8a16-e8d57ab102c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2005866772},{"type":"v1","addr":"172.21.15.117:6817","nonce":2005866772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2005866772},{"type":"v1","addr":"172.21.15.117:6819","nonce":2005866772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2005866772},{"type":"v1","addr":"172.21.15.117:6823","nonce":2005866772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2005866772},{"type":"v1","addr":"172.21.15.117:6821","nonce":2005866772}]},"public_addr":"172.21.15.117:6817/2005866772","cluster_addr":"172.21.15.117:6819/2005866772","heartbeat_back_addr":"172.21.15.117:6823/2005866772","heartbeat_front_addr":"172.21.15.117:6821/2005866772","state":["exists","up"]},{"osd":9,"uuid":"04b6203d-a10c-4a55-8e59-b30012dee02b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1398779376},{"type":"v1","addr":"172.21.15.37:6827","nonce":1398779376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1398779376},{"type":"v1","addr":"172.21.15.37:6829","nonce":1398779376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1398779376},{"type":"v1","addr":"172.21.15.37:6833","nonce":1398779376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1398779376},{"type":"v1","addr":"172.21.15.37:6831","nonce":1398779376}]},"public_addr":"172.21.15.37:6827/1398779376","cluster_addr":"172.21.15.37:6829/1398779376","heartbeat_back_addr":"172.21.15.37:6833/1398779376","heartbeat_front_addr":"172.21.15.37:6831/1398779376","state":["exists","up"]},{"osd":10,"uuid":"bbf8ff4b-29cd-4d56-a30e-ff2de3555f78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2200957302},{"type":"v1","addr":"172.21.15.99:6825","nonce":2200957302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2200957302},{"type":"v1","addr":"172.21.15.99:6827","nonce":2200957302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2200957302},{"type":"v1","addr":"172.21.15.99:6831","nonce":2200957302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2200957302},{"type":"v1","addr":"172.21.15.99:6829","nonce":2200957302}]},"public_addr":"172.21.15.99:6825/2200957302","cluster_addr":"172.21.15.99:6827/2200957302","heartbeat_back_addr":"172.21.15.99:6831/2200957302","heartbeat_front_addr":"172.21.15.99:6829/2200957302","state":["exists","up"]},{"osd":11,"uuid":"041d54f4-a274-47b5-a467-0ce86efd363b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":1354423136},{"type":"v1","addr":"172.21.15.117:6825","nonce":1354423136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":1354423136},{"type":"v1","addr":"172.21.15.117:6827","nonce":1354423136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":1354423136},{"type":"v1","addr":"172.21.15.117:6831","nonce":1354423136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":1354423136},{"type":"v1","addr":"172.21.15.117:6829","nonce":1354423136}]},"public_addr":"172.21.15.117:6825/1354423136","cluster_addr":"172.21.15.117:6827/1354423136","heartbeat_back_addr":"172.21.15.117:6831/1354423136","heartbeat_front_addr":"172.21.15.117:6829/1354423136","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:58:33.697099+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:58:59.641549+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:59:23.811178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:59:49.550214+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:00:15.034610+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:00:39.399651+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:01:05.106379+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:01:30.375956+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:01:54.881549+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:02:21.519316+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:02:46.125918+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:03:11.310862+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6801/133577710":"2024-09-20T05:57:12.560771+0000","172.21.15.37:6800/133577710":"2024-09-20T05:57:12.560771+0000","172.21.15.37:0/2877363162":"2024-09-20T05:57:12.560771+0000","172.21.15.37:0/1053171617":"2024-09-20T05:57:12.560771+0000","172.21.15.37:6800/3277805697":"2024-09-20T05:56:49.335334+0000","172.21.15.37:0/1280697705":"2024-09-20T05:56:49.335334+0000","172.21.15.37:0/1106526058":"2024-09-20T05:57:12.560771+0000","172.21.15.37:0/1978184693":"2024-09-20T05:56:49.335334+0000","172.21.15.37:6801/3277805697":"2024-09-20T05:56:49.335334+0000","172.21.15.37:0/3650338877":"2024-09-20T05:56:49.335334+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:05:04.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:04.304+0000 7f518c0ac640 1 -- 172.21.15.37:0/45484203 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f51700a3350 msgr2=0x7f51700a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:04.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:04.304+0000 7f518c0ac640 1 --2- 172.21.15.37:0/45484203 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f51700a3350 0x7f51700a5810 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f51800096c0 tx=0x7f5180000bc0 comp rx=0 tx=0).stop 2024-09-19T06:05:04.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:04.304+0000 7f518c0ac640 1 -- 172.21.15.37:0/45484203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5184102790 msgr2=0x7f51841989f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:04.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:04.304+0000 7f518c0ac640 1 --2- 172.21.15.37:0/45484203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5184102790 0x7f51841989f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f517400b4a0 tx=0x7f517400b960 comp rx=0 tx=0).stop 2024-09-19T06:05:04.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:04.304+0000 7f518c0ac640 1 -- 172.21.15.37:0/45484203 shutdown_connections 2024-09-19T06:05:04.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:04.304+0000 7f518c0ac640 1 --2- 172.21.15.37:0/45484203 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f51700a3350 0x7f51700a5810 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:04.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:04.304+0000 7f518c0ac640 1 --2- 172.21.15.37:0/45484203 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5184106f10 0x7f518419cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:04.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:04.304+0000 7f518c0ac640 1 --2- 172.21.15.37:0/45484203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5184102790 0x7f51841989f0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:04.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:04.304+0000 7f518c0ac640 1 --2- 172.21.15.37:0/45484203 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5184101de0 0x7f51841984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:04.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:04.304+0000 7f518c0ac640 1 -- 172.21.15.37:0/45484203 >> 172.21.15.37:0/45484203 conn(0x7f51840fd8c0 msgr2=0x7f51840feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:04.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:04.304+0000 7f518c0ac640 1 -- 172.21.15.37:0/45484203 shutdown_connections 2024-09-19T06:05:04.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:04.304+0000 7f518c0ac640 1 -- 172.21.15.37:0/45484203 wait complete. 2024-09-19T06:05:04.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:04 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/45484203' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:05:04.939 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:04 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/45484203' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:05:04.970 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-19T06:05:04.970 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T06:05:04.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:04 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/45484203' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:05:05.229 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:05:05.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:05.714+0000 7f92a1466640 1 -- 172.21.15.37:0/1627187323 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f929c100a80 msgr2=0x7f929c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:05.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:05.714+0000 7f92a1466640 1 --2- 172.21.15.37:0/1627187323 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f929c100a80 0x7f929c100ee0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9290009930 tx=0x7f929002a440 comp rx=0 tx=0).stop 2024-09-19T06:05:05.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:05.714+0000 7f92a1466640 1 -- 172.21.15.37:0/1627187323 shutdown_connections 2024-09-19T06:05:05.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:05.714+0000 7f92a1466640 1 --2- 172.21.15.37:0/1627187323 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f929c101420 0x7f929c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:05.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:05.714+0000 7f92a1466640 1 --2- 172.21.15.37:0/1627187323 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f929c100a80 0x7f929c100ee0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:05.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:05.714+0000 7f92a1466640 1 --2- 172.21.15.37:0/1627187323 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f929c106a80 0x7f929c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:05.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:05.714+0000 7f92a1466640 1 -- 172.21.15.37:0/1627187323 >> 172.21.15.37:0/1627187323 conn(0x7f929c0fc7a0 msgr2=0x7f929c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:05.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:05.714+0000 7f92a1466640 1 -- 172.21.15.37:0/1627187323 shutdown_connections 2024-09-19T06:05:05.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:05.714+0000 7f92a1466640 1 -- 172.21.15.37:0/1627187323 wait complete. 2024-09-19T06:05:05.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:05.715+0000 7f92a1466640 1 Processor -- start 2024-09-19T06:05:05.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:05.715+0000 7f92a1466640 1 -- start start 2024-09-19T06:05:05.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:05.715+0000 7f92a1466640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f929c100a80 0x7f929c198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:05.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:05.715+0000 7f92a1466640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f929c101420 0x7f929c198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:05.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:05.715+0000 7f92a1466640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f929c106a80 0x7f929c19cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:05.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:05.715+0000 7f92a1466640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f929c110e80 con 0x7f929c106a80 2024-09-19T06:05:05.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:05.715+0000 7f92a1466640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f929c110d00 con 0x7f929c101420 2024-09-19T06:05:05.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:05.715+0000 7f92a1466640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f929c111000 con 0x7f929c100a80 2024-09-19T06:05:05.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:05.715+0000 7f929b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f929c106a80 0x7f929c19cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:05.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:05.715+0000 7f929b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f929c106a80 0x7f929c19cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35374/0 (socket says 172.21.15.37:35374) 2024-09-19T06:05:05.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:05.715+0000 7f929b7fe640 1 -- 172.21.15.37:0/2638208086 learned_addr learned my addr 172.21.15.37:0/2638208086 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:05:05.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:05.715+0000 7f929affd640 1 --2- 172.21.15.37:0/2638208086 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f929c100a80 0x7f929c198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:05.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:05.715+0000 7f929a7fc640 1 --2- 172.21.15.37:0/2638208086 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f929c101420 0x7f929c198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:05.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:05.716+0000 7f929b7fe640 1 -- 172.21.15.37:0/2638208086 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f929c100a80 msgr2=0x7f929c198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:05.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:05.716+0000 7f929b7fe640 1 --2- 172.21.15.37:0/2638208086 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f929c100a80 0x7f929c198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:05.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:05.716+0000 7f929b7fe640 1 -- 172.21.15.37:0/2638208086 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f929c101420 msgr2=0x7f929c198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:05.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:05.716+0000 7f929b7fe640 1 --2- 172.21.15.37:0/2638208086 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f929c101420 0x7f929c198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:05.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:05.716+0000 7f929b7fe640 1 -- 172.21.15.37:0/2638208086 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f929c19d400 con 0x7f929c106a80 2024-09-19T06:05:05.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:05.716+0000 7f929b7fe640 1 --2- 172.21.15.37:0/2638208086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f929c106a80 0x7f929c19cd20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f929400d950 tx=0x7f929400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:05.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:05.716+0000 7f9283fff640 1 -- 172.21.15.37:0/2638208086 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9294017030 con 0x7f929c106a80 2024-09-19T06:05:05.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:05.716+0000 7f92a1466640 1 -- 172.21.15.37:0/2638208086 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f929c19d6f0 con 0x7f929c106a80 2024-09-19T06:05:05.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:05.716+0000 7f9283fff640 1 -- 172.21.15.37:0/2638208086 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9294004020 con 0x7f929c106a80 2024-09-19T06:05:05.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:05.716+0000 7f92a1466640 1 -- 172.21.15.37:0/2638208086 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f929c1a4fd0 con 0x7f929c106a80 2024-09-19T06:05:05.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:05.716+0000 7f9283fff640 1 -- 172.21.15.37:0/2638208086 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9294003c00 con 0x7f929c106a80 2024-09-19T06:05:05.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:05.717+0000 7f92a1466640 1 -- 172.21.15.37:0/2638208086 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f929c1021c0 con 0x7f929c106a80 2024-09-19T06:05:05.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:05.718+0000 7f9283fff640 1 -- 172.21.15.37:0/2638208086 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f929401a070 con 0x7f929c106a80 2024-09-19T06:05:05.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:05.719+0000 7f9283fff640 1 --2- 172.21.15.37:0/2638208086 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f92840a3350 0x7f92840a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:05.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:05.719+0000 7f929affd640 1 --2- 172.21.15.37:0/2638208086 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f92840a3350 0x7f92840a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:05.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:05.719+0000 7f9283fff640 1 -- 172.21.15.37:0/2638208086 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f92940cf8d0 con 0x7f929c106a80 2024-09-19T06:05:05.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:05.720+0000 7f929affd640 1 --2- 172.21.15.37:0/2638208086 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f92840a3350 0x7f92840a5810 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f928c007e40 tx=0x7f928c0075b0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:05.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:05.722+0000 7f9283fff640 1 -- 172.21.15.37:0/2638208086 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9294021070 con 0x7f929c106a80 2024-09-19T06:05:05.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:05.898+0000 7f92a1466640 1 -- 172.21.15.37:0/2638208086 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f929c10a020 con 0x7f929c106a80 2024-09-19T06:05:05.900 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:05 smithi037 ceph-mon[31211]: pgmap v313: 129 pgs: 129 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 3.9 KiB/s wr, 4 op/s 2024-09-19T06:05:05.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:05.899+0000 7f9283fff640 1 -- 172.21.15.37:0/2638208086 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+24200 (secure 0 0 0) 0x7f929409c270 con 0x7f929c106a80 2024-09-19T06:05:05.902 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T06:05:05.902 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":87,"fsid":"b8c8bdae-764b-11ef-bceb-c7b262605968","created":"2024-09-19T05:56:22.523060+0000","modified":"2024-09-19T06:04:15.206008+0000","last_up_change":"2024-09-19T06:03:12.771014+0000","last_in_change":"2024-09-19T06:02:49.926626+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:59:27.062607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:04:01.918234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:04:04.392543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T06:04:10.877951+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"455bc11d-2b6e-4a0c-90d9-8ab4ef4f9e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1783875173},{"type":"v1","addr":"172.21.15.37:6803","nonce":1783875173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1783875173},{"type":"v1","addr":"172.21.15.37:6805","nonce":1783875173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1783875173},{"type":"v1","addr":"172.21.15.37:6809","nonce":1783875173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1783875173},{"type":"v1","addr":"172.21.15.37:6807","nonce":1783875173}]},"public_addr":"172.21.15.37:6803/1783875173","cluster_addr":"172.21.15.37:6805/1783875173","heartbeat_back_addr":"172.21.15.37:6809/1783875173","heartbeat_front_addr":"172.21.15.37:6807/1783875173","state":["exists","up"]},{"osd":1,"uuid":"3505c162-c342-479d-8ea2-15b7a9d625cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":3414373360},{"type":"v1","addr":"172.21.15.99:6801","nonce":3414373360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":3414373360},{"type":"v1","addr":"172.21.15.99:6803","nonce":3414373360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":3414373360},{"type":"v1","addr":"172.21.15.99:6807","nonce":3414373360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":3414373360},{"type":"v1","addr":"172.21.15.99:6805","nonce":3414373360}]},"public_addr":"172.21.15.99:6801/3414373360","cluster_addr":"172.21.15.99:6803/3414373360","heartbeat_back_addr":"172.21.15.99:6807/3414373360","heartbeat_front_addr":"172.21.15.99:6805/3414373360","state":["exists","up"]},{"osd":2,"uuid":"736ec67f-b5e7-43f0-9303-0c88878ead6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3794943081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3794943081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3794943081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3794943081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3794943081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3794943081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3794943081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3794943081}]},"public_addr":"172.21.15.117:6801/3794943081","cluster_addr":"172.21.15.117:6803/3794943081","heartbeat_back_addr":"172.21.15.117:6807/3794943081","heartbeat_front_addr":"172.21.15.117:6805/3794943081","state":["exists","up"]},{"osd":3,"uuid":"3f784ef7-0cc1-4c86-a03a-b8f13396c835","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2121011955},{"type":"v1","addr":"172.21.15.37:6811","nonce":2121011955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2121011955},{"type":"v1","addr":"172.21.15.37:6813","nonce":2121011955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2121011955},{"type":"v1","addr":"172.21.15.37:6817","nonce":2121011955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2121011955},{"type":"v1","addr":"172.21.15.37:6815","nonce":2121011955}]},"public_addr":"172.21.15.37:6811/2121011955","cluster_addr":"172.21.15.37:6813/2121011955","heartbeat_back_addr":"172.21.15.37:6817/2121011955","heartbeat_front_addr":"172.21.15.37:6815/2121011955","state":["exists","up"]},{"osd":4,"uuid":"d7c16e7f-f599-419b-b4a2-fd6c1cafa0d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":1881025735},{"type":"v1","addr":"172.21.15.99:6809","nonce":1881025735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1881025735},{"type":"v1","addr":"172.21.15.99:6811","nonce":1881025735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1881025735},{"type":"v1","addr":"172.21.15.99:6815","nonce":1881025735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":1881025735},{"type":"v1","addr":"172.21.15.99:6813","nonce":1881025735}]},"public_addr":"172.21.15.99:6809/1881025735","cluster_addr":"172.21.15.99:6811/1881025735","heartbeat_back_addr":"172.21.15.99:6815/1881025735","heartbeat_front_addr":"172.21.15.99:6813/1881025735","state":["exists","up"]},{"osd":5,"uuid":"2f499ab4-3d09-4f96-a709-b4229865c690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1141976511},{"type":"v1","addr":"172.21.15.117:6809","nonce":1141976511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1141976511},{"type":"v1","addr":"172.21.15.117:6811","nonce":1141976511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1141976511},{"type":"v1","addr":"172.21.15.117:6815","nonce":1141976511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1141976511},{"type":"v1","addr":"172.21.15.117:6813","nonce":1141976511}]},"public_addr":"172.21.15.117:6809/1141976511","cluster_addr":"172.21.15.117:6811/1141976511","heartbeat_back_addr":"172.21.15.117:6815/1141976511","heartbeat_front_addr":"172.21.15.117:6813/1141976511","state":["exists","up"]},{"osd":6,"uuid":"10f7fd72-1ae8-4efd-a448-75f4b5054be3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":770433145},{"type":"v1","addr":"172.21.15.37:6819","nonce":770433145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":770433145},{"type":"v1","addr":"172.21.15.37:6821","nonce":770433145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":770433145},{"type":"v1","addr":"172.21.15.37:6825","nonce":770433145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":770433145},{"type":"v1","addr":"172.21.15.37:6823","nonce":770433145}]},"public_addr":"172.21.15.37:6819/770433145","cluster_addr":"172.21.15.37:6821/770433145","heartbeat_back_addr":"172.21.15.37:6825/770433145","heartbeat_front_addr":"172.21.15.37:6823/770433145","state":["exists","up"]},{"osd":7,"uuid":"7199a267-c486-417c-b530-3ff03fc9eb1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1694360992},{"type":"v1","addr":"172.21.15.99:6817","nonce":1694360992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1694360992},{"type":"v1","addr":"172.21.15.99:6819","nonce":1694360992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":1694360992},{"type":"v1","addr":"172.21.15.99:6823","nonce":1694360992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":1694360992},{"type":"v1","addr":"172.21.15.99:6821","nonce":1694360992}]},"public_addr":"172.21.15.99:6817/1694360992","cluster_addr":"172.21.15.99:6819/1694360992","heartbeat_back_addr":"172.21.15.99:6823/1694360992","heartbeat_front_addr":"172.21.15.99:6821/1694360992","state":["exists","up"]},{"osd":8,"uuid":"8d5bb83c-62eb-4ded-8a16-e8d57ab102c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2005866772},{"type":"v1","addr":"172.21.15.117:6817","nonce":2005866772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2005866772},{"type":"v1","addr":"172.21.15.117:6819","nonce":2005866772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2005866772},{"type":"v1","addr":"172.21.15.117:6823","nonce":2005866772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2005866772},{"type":"v1","addr":"172.21.15.117:6821","nonce":2005866772}]},"public_addr":"172.21.15.117:6817/2005866772","cluster_addr":"172.21.15.117:6819/2005866772","heartbeat_back_addr":"172.21.15.117:6823/2005866772","heartbeat_front_addr":"172.21.15.117:6821/2005866772","state":["exists","up"]},{"osd":9,"uuid":"04b6203d-a10c-4a55-8e59-b30012dee02b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1398779376},{"type":"v1","addr":"172.21.15.37:6827","nonce":1398779376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1398779376},{"type":"v1","addr":"172.21.15.37:6829","nonce":1398779376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1398779376},{"type":"v1","addr":"172.21.15.37:6833","nonce":1398779376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1398779376},{"type":"v1","addr":"172.21.15.37:6831","nonce":1398779376}]},"public_addr":"172.21.15.37:6827/1398779376","cluster_addr":"172.21.15.37:6829/1398779376","heartbeat_back_addr":"172.21.15.37:6833/1398779376","heartbeat_front_addr":"172.21.15.37:6831/1398779376","state":["exists","up"]},{"osd":10,"uuid":"bbf8ff4b-29cd-4d56-a30e-ff2de3555f78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2200957302},{"type":"v1","addr":"172.21.15.99:6825","nonce":2200957302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2200957302},{"type":"v1","addr":"172.21.15.99:6827","nonce":2200957302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2200957302},{"type":"v1","addr":"172.21.15.99:6831","nonce":2200957302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2200957302},{"type":"v1","addr":"172.21.15.99:6829","nonce":2200957302}]},"public_addr":"172.21.15.99:6825/2200957302","cluster_addr":"172.21.15.99:6827/2200957302","heartbeat_back_addr":"172.21.15.99:6831/2200957302","heartbeat_front_addr":"172.21.15.99:6829/2200957302","state":["exists","up"]},{"osd":11,"uuid":"041d54f4-a274-47b5-a467-0ce86efd363b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":1354423136},{"type":"v1","addr":"172.21.15.117:6825","nonce":1354423136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":1354423136},{"type":"v1","addr":"172.21.15.117:6827","nonce":1354423136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":1354423136},{"type":"v1","addr":"172.21.15.117:6831","nonce":1354423136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":1354423136},{"type":"v1","addr":"172.21.15.117:6829","nonce":1354423136}]},"public_addr":"172.21.15.117:6825/1354423136","cluster_addr":"172.21.15.117:6827/1354423136","heartbeat_back_addr":"172.21.15.117:6831/1354423136","heartbeat_front_addr":"172.21.15.117:6829/1354423136","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:58:33.697099+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:58:59.641549+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:59:23.811178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:59:49.550214+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:00:15.034610+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:00:39.399651+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:01:05.106379+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:01:30.375956+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:01:54.881549+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:02:21.519316+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:02:46.125918+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:03:11.310862+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6801/133577710":"2024-09-20T05:57:12.560771+0000","172.21.15.37:6800/133577710":"2024-09-20T05:57:12.560771+0000","172.21.15.37:0/2877363162":"2024-09-20T05:57:12.560771+0000","172.21.15.37:0/1053171617":"2024-09-20T05:57:12.560771+0000","172.21.15.37:6800/3277805697":"2024-09-20T05:56:49.335334+0000","172.21.15.37:0/1280697705":"2024-09-20T05:56:49.335334+0000","172.21.15.37:0/1106526058":"2024-09-20T05:57:12.560771+0000","172.21.15.37:0/1978184693":"2024-09-20T05:56:49.335334+0000","172.21.15.37:6801/3277805697":"2024-09-20T05:56:49.335334+0000","172.21.15.37:0/3650338877":"2024-09-20T05:56:49.335334+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:05:05.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:05.902+0000 7f92a1466640 1 -- 172.21.15.37:0/2638208086 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f92840a3350 msgr2=0x7f92840a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:05.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:05.902+0000 7f92a1466640 1 --2- 172.21.15.37:0/2638208086 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f92840a3350 0x7f92840a5810 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f928c007e40 tx=0x7f928c0075b0 comp rx=0 tx=0).stop 2024-09-19T06:05:05.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:05.902+0000 7f92a1466640 1 -- 172.21.15.37:0/2638208086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f929c106a80 msgr2=0x7f929c19cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:05.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:05.902+0000 7f92a1466640 1 --2- 172.21.15.37:0/2638208086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f929c106a80 0x7f929c19cd20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f929400d950 tx=0x7f929400de10 comp rx=0 tx=0).stop 2024-09-19T06:05:05.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:05.902+0000 7f92a1466640 1 -- 172.21.15.37:0/2638208086 shutdown_connections 2024-09-19T06:05:05.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:05.902+0000 7f92a1466640 1 --2- 172.21.15.37:0/2638208086 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f92840a3350 0x7f92840a5810 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:05.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:05.902+0000 7f92a1466640 1 --2- 172.21.15.37:0/2638208086 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f929c101420 0x7f929c198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:05.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:05.902+0000 7f92a1466640 1 --2- 172.21.15.37:0/2638208086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f929c106a80 0x7f929c19cd20 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:05.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:05.902+0000 7f92a1466640 1 --2- 172.21.15.37:0/2638208086 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f929c100a80 0x7f929c198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:05.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:05.902+0000 7f92a1466640 1 -- 172.21.15.37:0/2638208086 >> 172.21.15.37:0/2638208086 conn(0x7f929c0fc7a0 msgr2=0x7f929c06aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:05.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:05.902+0000 7f92a1466640 1 -- 172.21.15.37:0/2638208086 shutdown_connections 2024-09-19T06:05:05.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:05.902+0000 7f92a1466640 1 -- 172.21.15.37:0/2638208086 wait complete. 2024-09-19T06:05:05.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:05 smithi099 ceph-mon[35300]: pgmap v313: 129 pgs: 129 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 3.9 KiB/s wr, 4 op/s 2024-09-19T06:05:05.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:05 smithi117 ceph-mon[35050]: pgmap v313: 129 pgs: 129 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 3.9 KiB/s wr, 4 op/s 2024-09-19T06:05:06.637 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-19T06:05:06.638 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-19T06:05:06.638 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-19T06:05:06.638 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-19T06:05:06.639 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-19T06:05:06.639 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-19T06:05:06.640 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-19T06:05:06.640 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-19T06:05:06.640 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-19T06:05:06.641 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-19T06:05:06.641 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-19T06:05:06.642 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-19T06:05:06.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:06 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/2638208086' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:05:06.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:06 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/2638208086' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:05:07.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:06 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/2638208086' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:05:07.290 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:05:07.744 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:07 smithi037 ceph-mon[31211]: pgmap v314: 129 pgs: 129 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-09-19T06:05:07.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:07.823+0000 7f676c761640 1 -- 172.21.15.37:0/1128670815 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6764101de0 msgr2=0x7f67641021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:07.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:07.823+0000 7f676c761640 1 --2- 172.21.15.37:0/1128670815 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6764101de0 0x7f67641021c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6760009900 tx=0x7f676002a410 comp rx=0 tx=0).stop 2024-09-19T06:05:07.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:07.823+0000 7f676c761640 1 -- 172.21.15.37:0/1128670815 shutdown_connections 2024-09-19T06:05:07.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:07.823+0000 7f676c761640 1 --2- 172.21.15.37:0/1128670815 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6764102790 0x7f67641067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:07.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:07.823+0000 7f676c761640 1 --2- 172.21.15.37:0/1128670815 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6764106f10 0x7f676410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:07.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:07.823+0000 7f676c761640 1 --2- 172.21.15.37:0/1128670815 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6764101de0 0x7f67641021c0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:07.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:07.823+0000 7f676c761640 1 -- 172.21.15.37:0/1128670815 >> 172.21.15.37:0/1128670815 conn(0x7f67640fd8c0 msgr2=0x7f67640ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:07.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:07.823+0000 7f676c761640 1 -- 172.21.15.37:0/1128670815 shutdown_connections 2024-09-19T06:05:07.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:07.823+0000 7f676c761640 1 -- 172.21.15.37:0/1128670815 wait complete. 2024-09-19T06:05:07.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:07.824+0000 7f676c761640 1 Processor -- start 2024-09-19T06:05:07.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:07.824+0000 7f676c761640 1 -- start start 2024-09-19T06:05:07.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:07.824+0000 7f676c761640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6764101de0 0x7f6764198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:07.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:07.824+0000 7f676c761640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6764102790 0x7f67641989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:07.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:07.824+0000 7f676c761640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6764106f10 0x7f676419cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:07.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:07.824+0000 7f676c761640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6764111f30 con 0x7f6764101de0 2024-09-19T06:05:07.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:07.824+0000 7f676c761640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f6764111db0 con 0x7f6764106f10 2024-09-19T06:05:07.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:07.824+0000 7f676c761640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f67641120b0 con 0x7f6764102790 2024-09-19T06:05:07.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:07.824+0000 7f676a4fd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6764101de0 0x7f6764198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:07.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:07.824+0000 7f676a4fd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6764101de0 0x7f6764198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35388/0 (socket says 172.21.15.37:35388) 2024-09-19T06:05:07.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:07.824+0000 7f676a4fd640 1 -- 172.21.15.37:0/138728346 learned_addr learned my addr 172.21.15.37:0/138728346 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:05:07.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:07.824+0000 7f6769cfc640 1 --2- 172.21.15.37:0/138728346 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6764102790 0x7f67641989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:07.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:07.825+0000 7f676acfe640 1 --2- 172.21.15.37:0/138728346 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6764106f10 0x7f676419cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:07.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:07.825+0000 7f676a4fd640 1 -- 172.21.15.37:0/138728346 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6764102790 msgr2=0x7f67641989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:07.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:07.825+0000 7f676a4fd640 1 --2- 172.21.15.37:0/138728346 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6764102790 0x7f67641989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:07.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:07.825+0000 7f676a4fd640 1 -- 172.21.15.37:0/138728346 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6764106f10 msgr2=0x7f676419cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:07.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:07.825+0000 7f676a4fd640 1 --2- 172.21.15.37:0/138728346 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6764106f10 0x7f676419cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:07.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:07.825+0000 7f676a4fd640 1 -- 172.21.15.37:0/138728346 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f676419d410 con 0x7f6764101de0 2024-09-19T06:05:07.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:07.825+0000 7f6769cfc640 1 --2- 172.21.15.37:0/138728346 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6764102790 0x7f67641989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:05:07.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:07.825+0000 7f676acfe640 1 --2- 172.21.15.37:0/138728346 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6764106f10 0x7f676419cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:05:07.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:07.825+0000 7f676a4fd640 1 --2- 172.21.15.37:0/138728346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6764101de0 0x7f6764198460 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6760006010 tx=0x7f67600042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:07.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:07.825+0000 7f675b7fe640 1 -- 172.21.15.37:0/138728346 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f676003f030 con 0x7f6764101de0 2024-09-19T06:05:07.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:07.825+0000 7f676c761640 1 -- 172.21.15.37:0/138728346 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f676419d6a0 con 0x7f6764101de0 2024-09-19T06:05:07.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:07.825+0000 7f675b7fe640 1 -- 172.21.15.37:0/138728346 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6760003ce0 con 0x7f6764101de0 2024-09-19T06:05:07.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:07.825+0000 7f675b7fe640 1 -- 172.21.15.37:0/138728346 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6760035070 con 0x7f6764101de0 2024-09-19T06:05:07.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:07.825+0000 7f676c761640 1 -- 172.21.15.37:0/138728346 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67641a4fe0 con 0x7f6764101de0 2024-09-19T06:05:07.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:07.826+0000 7f676c761640 1 -- 172.21.15.37:0/138728346 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6764062980 con 0x7f6764101de0 2024-09-19T06:05:07.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:07.827+0000 7f675b7fe640 1 -- 172.21.15.37:0/138728346 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f6760042030 con 0x7f6764101de0 2024-09-19T06:05:07.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:07.828+0000 7f675b7fe640 1 --2- 172.21.15.37:0/138728346 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f67500a32d0 0x7f67500a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:07.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:07.828+0000 7f675b7fe640 1 -- 172.21.15.37:0/138728346 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f67600f0b90 con 0x7f6764101de0 2024-09-19T06:05:07.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:07.828+0000 7f6769cfc640 1 --2- 172.21.15.37:0/138728346 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f67500a32d0 0x7f67500a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:07.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:07.828+0000 7f675b7fe640 1 --2- 172.21.15.37:0/138728346 >> [v2:172.21.15.99:6800/3414373360,v1:172.21.15.99:6801/3414373360] conn(0x7f67500ae000 0x7f67500b0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:07.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:07.828+0000 7f675b7fe640 1 -- 172.21.15.37:0/138728346 --> [v2:172.21.15.99:6800/3414373360,v1:172.21.15.99:6801/3414373360] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f676003be50 con 0x7f67500ae000 2024-09-19T06:05:07.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:07.828+0000 7f675b7fe640 1 -- 172.21.15.37:0/138728346 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7f67600f0fe0 con 0x7f6764101de0 2024-09-19T06:05:07.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:07.828+0000 7f6769cfc640 1 --2- 172.21.15.37:0/138728346 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f67500a32d0 0x7f67500a5790 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f67640fdce0 tx=0x7f675400b5f0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:07.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:07.829+0000 7f676acfe640 1 --2- 172.21.15.37:0/138728346 >> [v2:172.21.15.99:6800/3414373360,v1:172.21.15.99:6801/3414373360] conn(0x7f67500ae000 0x7f67500b0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:07.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:07.829+0000 7f676acfe640 1 --2- 172.21.15.37:0/138728346 >> [v2:172.21.15.99:6800/3414373360,v1:172.21.15.99:6801/3414373360] conn(0x7f67500ae000 0x7f67500b0440 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:07.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:07.830+0000 7f675b7fe640 1 -- 172.21.15.37:0/138728346 <== osd.1 v2:172.21.15.99:6800/3414373360 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f676003be50 con 0x7f67500ae000 2024-09-19T06:05:07.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:07.843+0000 7f676c761640 1 -- 172.21.15.37:0/138728346 --> [v2:172.21.15.99:6800/3414373360,v1:172.21.15.99:6801/3414373360] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6764062e00 con 0x7f67500ae000 2024-09-19T06:05:07.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:07.844+0000 7f675b7fe640 1 -- 172.21.15.37:0/138728346 <== osd.1 v2:172.21.15.99:6800/3414373360 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6764062e00 con 0x7f67500ae000 2024-09-19T06:05:07.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:07.844+0000 7f676c761640 1 -- 172.21.15.37:0/138728346 >> [v2:172.21.15.99:6800/3414373360,v1:172.21.15.99:6801/3414373360] conn(0x7f67500ae000 msgr2=0x7f67500b0440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:07.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:07.844+0000 7f676c761640 1 --2- 172.21.15.37:0/138728346 >> [v2:172.21.15.99:6800/3414373360,v1:172.21.15.99:6801/3414373360] conn(0x7f67500ae000 0x7f67500b0440 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:07.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:07.844+0000 7f676c761640 1 -- 172.21.15.37:0/138728346 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f67500a32d0 msgr2=0x7f67500a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:07.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:07.844+0000 7f676c761640 1 --2- 172.21.15.37:0/138728346 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f67500a32d0 0x7f67500a5790 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f67640fdce0 tx=0x7f675400b5f0 comp rx=0 tx=0).stop 2024-09-19T06:05:07.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:07.844+0000 7f676c761640 1 -- 172.21.15.37:0/138728346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6764101de0 msgr2=0x7f6764198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:07.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:07.844+0000 7f676c761640 1 --2- 172.21.15.37:0/138728346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6764101de0 0x7f6764198460 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6760006010 tx=0x7f67600042f0 comp rx=0 tx=0).stop 2024-09-19T06:05:07.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:07.844+0000 7f676acfe640 1 -- 172.21.15.37:0/138728346 reap_dead start 2024-09-19T06:05:07.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:07.844+0000 7f676c761640 1 -- 172.21.15.37:0/138728346 shutdown_connections 2024-09-19T06:05:07.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:07.844+0000 7f676c761640 1 -- 172.21.15.37:0/138728346 >> 172.21.15.37:0/138728346 conn(0x7f67640fd8c0 msgr2=0x7f67640fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:07.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:07.844+0000 7f676c761640 1 -- 172.21.15.37:0/138728346 shutdown_connections 2024-09-19T06:05:07.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:07.844+0000 7f676c761640 1 -- 172.21.15.37:0/138728346 wait complete. 2024-09-19T06:05:07.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:07 smithi099 ceph-mon[35300]: pgmap v314: 129 pgs: 129 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-09-19T06:05:08.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:07 smithi117 ceph-mon[35050]: pgmap v314: 129 pgs: 129 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-09-19T06:05:08.124 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:05:08.124 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:05:08.125 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:05:08.127 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:05:08.559 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:05:08.560 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:05:08.560 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:05:08.563 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:05:08.563 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:05:08.563 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:05:08.565 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:05:08.602 INFO:teuthology.orchestra.run.smithi037.stdout:55834574925 2024-09-19T06:05:08.602 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-19T06:05:09.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.355+0000 7f64b5cf3640 1 -- 172.21.15.37:0/1968476502 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64b0103660 msgr2=0x7f64b010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:09.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.355+0000 7f64b5cf3640 1 --2- 172.21.15.37:0/1968476502 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64b0103660 0x7f64b010bb50 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6498009900 tx=0x7f649802a480 comp rx=0 tx=0).stop 2024-09-19T06:05:09.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.355+0000 7f64b5cf3640 1 -- 172.21.15.37:0/1968476502 shutdown_connections 2024-09-19T06:05:09.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.355+0000 7f64b5cf3640 1 --2- 172.21.15.37:0/1968476502 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64b010c170 0x7f64b010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:09.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.355+0000 7f64b5cf3640 1 --2- 172.21.15.37:0/1968476502 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64b0103660 0x7f64b010bb50 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:09.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.355+0000 7f64b5cf3640 1 --2- 172.21.15.37:0/1968476502 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f64b0102d40 0x7f64b0103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:09.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.355+0000 7f64b5cf3640 1 -- 172.21.15.37:0/1968476502 >> 172.21.15.37:0/1968476502 conn(0x7f64b00fc7a0 msgr2=0x7f64b00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:09.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.355+0000 7f64b5cf3640 1 -- 172.21.15.37:0/1968476502 shutdown_connections 2024-09-19T06:05:09.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.355+0000 7f64b5cf3640 1 -- 172.21.15.37:0/1968476502 wait complete. 2024-09-19T06:05:09.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.355+0000 7f64b5cf3640 1 Processor -- start 2024-09-19T06:05:09.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.355+0000 7f64b5cf3640 1 -- start start 2024-09-19T06:05:09.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.356+0000 7f64b5cf3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64b0102d40 0x7f64b0198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:09.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.356+0000 7f64b5cf3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64b0103660 0x7f64b01989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:09.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.356+0000 7f64b5cf3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f64b010c170 0x7f64b019cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:09.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.356+0000 7f64b5cf3640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f64b0111fd0 con 0x7f64b0103660 2024-09-19T06:05:09.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.356+0000 7f64b5cf3640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f64b0111e50 con 0x7f64b010c170 2024-09-19T06:05:09.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.356+0000 7f64b5cf3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f64b0112150 con 0x7f64b0102d40 2024-09-19T06:05:09.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.356+0000 7f64a6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64b0103660 0x7f64b01989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:09.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.356+0000 7f64a6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64b0103660 0x7f64b01989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35430/0 (socket says 172.21.15.37:35430) 2024-09-19T06:05:09.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.356+0000 7f64a6ffd640 1 -- 172.21.15.37:0/3054943834 learned_addr learned my addr 172.21.15.37:0/3054943834 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:05:09.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.356+0000 7f64af7fe640 1 --2- 172.21.15.37:0/3054943834 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64b0102d40 0x7f64b0198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:09.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.356+0000 7f64affff640 1 --2- 172.21.15.37:0/3054943834 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f64b010c170 0x7f64b019cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:09.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.356+0000 7f64a6ffd640 1 -- 172.21.15.37:0/3054943834 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64b0102d40 msgr2=0x7f64b0198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:09.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.356+0000 7f64a6ffd640 1 --2- 172.21.15.37:0/3054943834 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64b0102d40 0x7f64b0198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:09.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.356+0000 7f64a6ffd640 1 -- 172.21.15.37:0/3054943834 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f64b010c170 msgr2=0x7f64b019cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:09.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.356+0000 7f64a6ffd640 1 --2- 172.21.15.37:0/3054943834 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f64b010c170 0x7f64b019cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:09.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.356+0000 7f64a6ffd640 1 -- 172.21.15.37:0/3054943834 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64b019d440 con 0x7f64b0103660 2024-09-19T06:05:09.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.356+0000 7f64affff640 1 --2- 172.21.15.37:0/3054943834 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f64b010c170 0x7f64b019cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:05:09.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.357+0000 7f64a6ffd640 1 --2- 172.21.15.37:0/3054943834 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64b0103660 0x7f64b01989d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6498005ab0 tx=0x7f64980042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:09.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.357+0000 7f64ad7fa640 1 -- 172.21.15.37:0/3054943834 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f649803f030 con 0x7f64b0103660 2024-09-19T06:05:09.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.357+0000 7f64ad7fa640 1 -- 172.21.15.37:0/3054943834 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6498003ce0 con 0x7f64b0103660 2024-09-19T06:05:09.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.357+0000 7f64b5cf3640 1 -- 172.21.15.37:0/3054943834 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64b019d6d0 con 0x7f64b0103660 2024-09-19T06:05:09.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.357+0000 7f64ad7fa640 1 -- 172.21.15.37:0/3054943834 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6498035070 con 0x7f64b0103660 2024-09-19T06:05:09.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.357+0000 7f64b5cf3640 1 -- 172.21.15.37:0/3054943834 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64b01a5010 con 0x7f64b0103660 2024-09-19T06:05:09.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.358+0000 7f64b5cf3640 1 -- 172.21.15.37:0/3054943834 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f64b0062980 con 0x7f64b0103660 2024-09-19T06:05:09.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.359+0000 7f64ad7fa640 1 -- 172.21.15.37:0/3054943834 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f6498042030 con 0x7f64b0103660 2024-09-19T06:05:09.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.360+0000 7f64ad7fa640 1 --2- 172.21.15.37:0/3054943834 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f649c0a32d0 0x7f649c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:09.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.360+0000 7f64ad7fa640 1 -- 172.21.15.37:0/3054943834 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f64980f0930 con 0x7f64b0103660 2024-09-19T06:05:09.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.360+0000 7f64af7fe640 1 --2- 172.21.15.37:0/3054943834 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f649c0a32d0 0x7f649c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:09.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.360+0000 7f64ad7fa640 1 --2- 172.21.15.37:0/3054943834 >> [v2:172.21.15.99:6824/2200957302,v1:172.21.15.99:6825/2200957302] conn(0x7f649c0ae000 0x7f649c0b0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:09.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.360+0000 7f64ad7fa640 1 -- 172.21.15.37:0/3054943834 --> [v2:172.21.15.99:6824/2200957302,v1:172.21.15.99:6825/2200957302] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6498045e50 con 0x7f649c0ae000 2024-09-19T06:05:09.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.360+0000 7f64ad7fa640 1 -- 172.21.15.37:0/3054943834 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7f64980f0d80 con 0x7f64b0103660 2024-09-19T06:05:09.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.360+0000 7f64af7fe640 1 --2- 172.21.15.37:0/3054943834 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f649c0a32d0 0x7f649c0a5790 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f64a0005fd0 tx=0x7f64a0005e20 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:09.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.360+0000 7f64affff640 1 --2- 172.21.15.37:0/3054943834 >> [v2:172.21.15.99:6824/2200957302,v1:172.21.15.99:6825/2200957302] conn(0x7f649c0ae000 0x7f649c0b0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:09.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.361+0000 7f64affff640 1 --2- 172.21.15.37:0/3054943834 >> [v2:172.21.15.99:6824/2200957302,v1:172.21.15.99:6825/2200957302] conn(0x7f649c0ae000 0x7f649c0b0440 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:09.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.362+0000 7f64ad7fa640 1 -- 172.21.15.37:0/3054943834 <== osd.10 v2:172.21.15.99:6824/2200957302 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6498045e50 con 0x7f649c0ae000 2024-09-19T06:05:09.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.376+0000 7f64b5cf3640 1 -- 172.21.15.37:0/3054943834 --> [v2:172.21.15.99:6824/2200957302,v1:172.21.15.99:6825/2200957302] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f64b0062e00 con 0x7f649c0ae000 2024-09-19T06:05:09.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.376+0000 7f64ad7fa640 1 -- 172.21.15.37:0/3054943834 <== osd.10 v2:172.21.15.99:6824/2200957302 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f64b0062e00 con 0x7f649c0ae000 2024-09-19T06:05:09.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.376+0000 7f64b5cf3640 1 -- 172.21.15.37:0/3054943834 >> [v2:172.21.15.99:6824/2200957302,v1:172.21.15.99:6825/2200957302] conn(0x7f649c0ae000 msgr2=0x7f649c0b0440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:09.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.376+0000 7f64b5cf3640 1 --2- 172.21.15.37:0/3054943834 >> [v2:172.21.15.99:6824/2200957302,v1:172.21.15.99:6825/2200957302] conn(0x7f649c0ae000 0x7f649c0b0440 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:09.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.377+0000 7f64b5cf3640 1 -- 172.21.15.37:0/3054943834 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f649c0a32d0 msgr2=0x7f649c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:09.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.377+0000 7f64b5cf3640 1 --2- 172.21.15.37:0/3054943834 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f649c0a32d0 0x7f649c0a5790 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f64a0005fd0 tx=0x7f64a0005e20 comp rx=0 tx=0).stop 2024-09-19T06:05:09.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.377+0000 7f64b5cf3640 1 -- 172.21.15.37:0/3054943834 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64b0103660 msgr2=0x7f64b01989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:09.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.377+0000 7f64b5cf3640 1 --2- 172.21.15.37:0/3054943834 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64b0103660 0x7f64b01989d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6498005ab0 tx=0x7f64980042f0 comp rx=0 tx=0).stop 2024-09-19T06:05:09.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.377+0000 7f64affff640 1 -- 172.21.15.37:0/3054943834 reap_dead start 2024-09-19T06:05:09.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.377+0000 7f64b5cf3640 1 -- 172.21.15.37:0/3054943834 shutdown_connections 2024-09-19T06:05:09.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.377+0000 7f64b5cf3640 1 -- 172.21.15.37:0/3054943834 >> 172.21.15.37:0/3054943834 conn(0x7f64b00fc7a0 msgr2=0x7f64b00fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:09.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.377+0000 7f64b5cf3640 1 -- 172.21.15.37:0/3054943834 shutdown_connections 2024-09-19T06:05:09.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.377+0000 7f64b5cf3640 1 -- 172.21.15.37:0/3054943834 wait complete. 2024-09-19T06:05:09.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.245+0000 7f5f353d8640 1 -- 172.21.15.37:0/2360332743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f30103700 msgr2=0x7f5f3010bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:09.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.245+0000 7f5f353d8640 1 --2- 172.21.15.37:0/2360332743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f30103700 0x7f5f3010bbf0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5f24009900 tx=0x7f5f2402a480 comp rx=0 tx=0).stop 2024-09-19T06:05:09.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.245+0000 7f5f353d8640 1 -- 172.21.15.37:0/2360332743 shutdown_connections 2024-09-19T06:05:09.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.245+0000 7f5f353d8640 1 --2- 172.21.15.37:0/2360332743 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5f3010c180 0x7f5f3010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:09.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.245+0000 7f5f353d8640 1 --2- 172.21.15.37:0/2360332743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f30103700 0x7f5f3010bbf0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:09.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.245+0000 7f5f353d8640 1 --2- 172.21.15.37:0/2360332743 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f30102de0 0x7f5f301031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:09.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.245+0000 7f5f353d8640 1 -- 172.21.15.37:0/2360332743 >> 172.21.15.37:0/2360332743 conn(0x7f5f300fc7a0 msgr2=0x7f5f300febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:09.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.245+0000 7f5f353d8640 1 -- 172.21.15.37:0/2360332743 shutdown_connections 2024-09-19T06:05:09.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.245+0000 7f5f353d8640 1 -- 172.21.15.37:0/2360332743 wait complete. 2024-09-19T06:05:09.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.246+0000 7f5f353d8640 1 Processor -- start 2024-09-19T06:05:09.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.246+0000 7f5f353d8640 1 -- start start 2024-09-19T06:05:09.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.246+0000 7f5f353d8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f30102de0 0x7f5f30198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:09.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.246+0000 7f5f353d8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5f30103700 0x7f5f30198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:09.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.246+0000 7f5f353d8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f3010c180 0x7f5f3019cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:09.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.246+0000 7f5f353d8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5f30111f70 con 0x7f5f30102de0 2024-09-19T06:05:09.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.246+0000 7f5f353d8640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f5f30111df0 con 0x7f5f30103700 2024-09-19T06:05:09.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.246+0000 7f5f353d8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5f301120f0 con 0x7f5f3010c180 2024-09-19T06:05:09.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.246+0000 7f5f2effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f30102de0 0x7f5f30198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:09.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.246+0000 7f5f2effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f30102de0 0x7f5f30198410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35410/0 (socket says 172.21.15.37:35410) 2024-09-19T06:05:09.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.246+0000 7f5f2effd640 1 -- 172.21.15.37:0/967104269 learned_addr learned my addr 172.21.15.37:0/967104269 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:05:09.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.247+0000 7f5f2e7fc640 1 --2- 172.21.15.37:0/967104269 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5f30103700 0x7f5f30198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:09.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.247+0000 7f5f2f7fe640 1 --2- 172.21.15.37:0/967104269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f3010c180 0x7f5f3019cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:09.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.247+0000 7f5f2effd640 1 -- 172.21.15.37:0/967104269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f3010c180 msgr2=0x7f5f3019cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:09.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.247+0000 7f5f2effd640 1 --2- 172.21.15.37:0/967104269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f3010c180 0x7f5f3019cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:09.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.247+0000 7f5f2effd640 1 -- 172.21.15.37:0/967104269 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5f30103700 msgr2=0x7f5f30198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:09.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.247+0000 7f5f2effd640 1 --2- 172.21.15.37:0/967104269 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5f30103700 0x7f5f30198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:09.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.247+0000 7f5f2effd640 1 -- 172.21.15.37:0/967104269 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f3019d3c0 con 0x7f5f30102de0 2024-09-19T06:05:09.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.247+0000 7f5f2effd640 1 --2- 172.21.15.37:0/967104269 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f30102de0 0x7f5f30198410 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5f2000d950 tx=0x7f5f2000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:09.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.247+0000 7f5f17fff640 1 -- 172.21.15.37:0/967104269 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f20017070 con 0x7f5f30102de0 2024-09-19T06:05:09.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.247+0000 7f5f17fff640 1 -- 172.21.15.37:0/967104269 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f20009c30 con 0x7f5f30102de0 2024-09-19T06:05:09.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.247+0000 7f5f353d8640 1 -- 172.21.15.37:0/967104269 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f3019d6b0 con 0x7f5f30102de0 2024-09-19T06:05:09.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.247+0000 7f5f17fff640 1 -- 172.21.15.37:0/967104269 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f2000f6b0 con 0x7f5f30102de0 2024-09-19T06:05:09.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.247+0000 7f5f353d8640 1 -- 172.21.15.37:0/967104269 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f301a4f90 con 0x7f5f30102de0 2024-09-19T06:05:09.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.248+0000 7f5f353d8640 1 -- 172.21.15.37:0/967104269 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5f30062980 con 0x7f5f30102de0 2024-09-19T06:05:09.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.249+0000 7f5f17fff640 1 -- 172.21.15.37:0/967104269 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f5f200109d0 con 0x7f5f30102de0 2024-09-19T06:05:09.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.250+0000 7f5f17fff640 1 --2- 172.21.15.37:0/967104269 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f5f180a3350 0x7f5f180a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:09.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.250+0000 7f5f17fff640 1 -- 172.21.15.37:0/967104269 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f5f200cfd60 con 0x7f5f30102de0 2024-09-19T06:05:09.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.250+0000 7f5f2e7fc640 1 --2- 172.21.15.37:0/967104269 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f5f180a3350 0x7f5f180a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:09.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.250+0000 7f5f17fff640 1 --2- 172.21.15.37:0/967104269 >> [v2:172.21.15.37:6810/2121011955,v1:172.21.15.37:6811/2121011955] conn(0x7f5f180ae080 0x7f5f180b04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:09.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.250+0000 7f5f17fff640 1 -- 172.21.15.37:0/967104269 --> [v2:172.21.15.37:6810/2121011955,v1:172.21.15.37:6811/2121011955] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5f2001de50 con 0x7f5f180ae080 2024-09-19T06:05:09.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.250+0000 7f5f17fff640 1 -- 172.21.15.37:0/967104269 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7f5f200d01b0 con 0x7f5f30102de0 2024-09-19T06:05:09.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.250+0000 7f5f2f7fe640 1 --2- 172.21.15.37:0/967104269 >> [v2:172.21.15.37:6810/2121011955,v1:172.21.15.37:6811/2121011955] conn(0x7f5f180ae080 0x7f5f180b04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:09.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.251+0000 7f5f2e7fc640 1 --2- 172.21.15.37:0/967104269 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f5f180a3350 0x7f5f180a5810 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5f300feda0 tx=0x7f5f24005a20 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:09.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.251+0000 7f5f2f7fe640 1 --2- 172.21.15.37:0/967104269 >> [v2:172.21.15.37:6810/2121011955,v1:172.21.15.37:6811/2121011955] conn(0x7f5f180ae080 0x7f5f180b04c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:09.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.251+0000 7f5f17fff640 1 -- 172.21.15.37:0/967104269 <== osd.3 v2:172.21.15.37:6810/2121011955 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5f2001de50 con 0x7f5f180ae080 2024-09-19T06:05:09.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.265+0000 7f5f353d8640 1 -- 172.21.15.37:0/967104269 --> [v2:172.21.15.37:6810/2121011955,v1:172.21.15.37:6811/2121011955] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5f30062d80 con 0x7f5f180ae080 2024-09-19T06:05:09.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.265+0000 7f5f17fff640 1 -- 172.21.15.37:0/967104269 <== osd.3 v2:172.21.15.37:6810/2121011955 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5f30062d80 con 0x7f5f180ae080 2024-09-19T06:05:09.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.266+0000 7f5f353d8640 1 -- 172.21.15.37:0/967104269 >> [v2:172.21.15.37:6810/2121011955,v1:172.21.15.37:6811/2121011955] conn(0x7f5f180ae080 msgr2=0x7f5f180b04c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:09.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.266+0000 7f5f353d8640 1 --2- 172.21.15.37:0/967104269 >> [v2:172.21.15.37:6810/2121011955,v1:172.21.15.37:6811/2121011955] conn(0x7f5f180ae080 0x7f5f180b04c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:09.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.266+0000 7f5f353d8640 1 -- 172.21.15.37:0/967104269 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f5f180a3350 msgr2=0x7f5f180a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:09.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.266+0000 7f5f353d8640 1 --2- 172.21.15.37:0/967104269 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f5f180a3350 0x7f5f180a5810 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5f300feda0 tx=0x7f5f24005a20 comp rx=0 tx=0).stop 2024-09-19T06:05:09.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.266+0000 7f5f353d8640 1 -- 172.21.15.37:0/967104269 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f30102de0 msgr2=0x7f5f30198410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:09.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.266+0000 7f5f353d8640 1 --2- 172.21.15.37:0/967104269 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f30102de0 0x7f5f30198410 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5f2000d950 tx=0x7f5f2000de10 comp rx=0 tx=0).stop 2024-09-19T06:05:09.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.266+0000 7f5f2f7fe640 1 -- 172.21.15.37:0/967104269 reap_dead start 2024-09-19T06:05:09.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.266+0000 7f5f353d8640 1 -- 172.21.15.37:0/967104269 shutdown_connections 2024-09-19T06:05:09.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.266+0000 7f5f353d8640 1 -- 172.21.15.37:0/967104269 >> 172.21.15.37:0/967104269 conn(0x7f5f300fc7a0 msgr2=0x7f5f300fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:09.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.266+0000 7f5f353d8640 1 -- 172.21.15.37:0/967104269 shutdown_connections 2024-09-19T06:05:09.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:09.266+0000 7f5f353d8640 1 -- 172.21.15.37:0/967104269 wait complete. 2024-09-19T06:05:09.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:09 smithi117 ceph-mon[35050]: pgmap v315: 129 pgs: 129 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-09-19T06:05:10.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:09 smithi037 ceph-mon[31211]: pgmap v315: 129 pgs: 129 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-09-19T06:05:10.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:09 smithi099 ceph-mon[35300]: pgmap v315: 129 pgs: 129 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-09-19T06:05:10.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:10.727+0000 7f9cc667e640 1 -- 172.21.15.37:0/2288470609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cc01082a0 msgr2=0x7f9cc010ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:10.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:10.727+0000 7f9cc667e640 1 --2- 172.21.15.37:0/2288470609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cc01082a0 0x7f9cc010ec40 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f9cb8009cd0 tx=0x7f9cb802a8e0 comp rx=0 tx=0).stop 2024-09-19T06:05:10.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:10.727+0000 7f9cc667e640 1 -- 172.21.15.37:0/2288470609 shutdown_connections 2024-09-19T06:05:10.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:10.727+0000 7f9cc667e640 1 --2- 172.21.15.37:0/2288470609 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9cc01036e0 0x7f9cc0107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:10.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:10.727+0000 7f9cc667e640 1 --2- 172.21.15.37:0/2288470609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cc01082a0 0x7f9cc010ec40 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:10.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:10.727+0000 7f9cc667e640 1 --2- 172.21.15.37:0/2288470609 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9cc0102d30 0x7f9cc0103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:10.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:10.727+0000 7f9cc667e640 1 -- 172.21.15.37:0/2288470609 >> 172.21.15.37:0/2288470609 conn(0x7f9cc00fc7d0 msgr2=0x7f9cc00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:10.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:10.727+0000 7f9cc667e640 1 -- 172.21.15.37:0/2288470609 shutdown_connections 2024-09-19T06:05:10.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:10.727+0000 7f9cc667e640 1 -- 172.21.15.37:0/2288470609 wait complete. 2024-09-19T06:05:10.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:10.727+0000 7f9cc667e640 1 Processor -- start 2024-09-19T06:05:10.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:10.727+0000 7f9cc667e640 1 -- start start 2024-09-19T06:05:10.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:10.727+0000 7f9cc667e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cc0102d30 0x7f9cc0100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:10.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:10.728+0000 7f9cc667e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9cc01036e0 0x7f9cc0100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:10.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:10.728+0000 7f9cc667e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9cc01082a0 0x7f9cc0101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:10.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:10.728+0000 7f9cc667e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9cc01120a0 con 0x7f9cc0102d30 2024-09-19T06:05:10.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:10.728+0000 7f9cc667e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f9cc0111f20 con 0x7f9cc01082a0 2024-09-19T06:05:10.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:10.728+0000 7f9cc667e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9cc0112220 con 0x7f9cc01036e0 2024-09-19T06:05:10.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:10.728+0000 7f9cbffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cc0102d30 0x7f9cc0100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:10.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:10.728+0000 7f9cbffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cc0102d30 0x7f9cc0100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35446/0 (socket says 172.21.15.37:35446) 2024-09-19T06:05:10.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:10.728+0000 7f9cbffff640 1 -- 172.21.15.37:0/625466822 learned_addr learned my addr 172.21.15.37:0/625466822 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:05:10.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:10.728+0000 7f9cc4c1b640 1 --2- 172.21.15.37:0/625466822 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9cc01082a0 0x7f9cc0101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:10.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:10.728+0000 7f9cb7fff640 1 --2- 172.21.15.37:0/625466822 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9cc01036e0 0x7f9cc0100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:10.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:10.728+0000 7f9cbffff640 1 -- 172.21.15.37:0/625466822 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9cc01036e0 msgr2=0x7f9cc0100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:10.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:10.728+0000 7f9cbffff640 1 --2- 172.21.15.37:0/625466822 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9cc01036e0 0x7f9cc0100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:10.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:10.728+0000 7f9cbffff640 1 -- 172.21.15.37:0/625466822 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9cc01082a0 msgr2=0x7f9cc0101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:10.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:10.728+0000 7f9cbffff640 1 --2- 172.21.15.37:0/625466822 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9cc01082a0 0x7f9cc0101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:10.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:10.728+0000 7f9cbffff640 1 -- 172.21.15.37:0/625466822 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cc01a69b0 con 0x7f9cc0102d30 2024-09-19T06:05:10.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:10.728+0000 7f9cbffff640 1 --2- 172.21.15.37:0/625466822 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cc0102d30 0x7f9cc0100990 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9cb000c970 tx=0x7f9cb000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:10.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:10.728+0000 7f9cbdffb640 1 -- 172.21.15.37:0/625466822 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb0007bb0 con 0x7f9cc0102d30 2024-09-19T06:05:10.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:10.728+0000 7f9cc667e640 1 -- 172.21.15.37:0/625466822 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cc01a6ca0 con 0x7f9cc0102d30 2024-09-19T06:05:10.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:10.728+0000 7f9cbdffb640 1 -- 172.21.15.37:0/625466822 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9cb0007d50 con 0x7f9cc0102d30 2024-09-19T06:05:10.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:10.728+0000 7f9cbdffb640 1 -- 172.21.15.37:0/625466822 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb000f450 con 0x7f9cc0102d30 2024-09-19T06:05:10.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:10.729+0000 7f9cc667e640 1 -- 172.21.15.37:0/625466822 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cc01a7190 con 0x7f9cc0102d30 2024-09-19T06:05:10.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:10.729+0000 7f9cc667e640 1 -- 172.21.15.37:0/625466822 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9cc00628c0 con 0x7f9cc0102d30 2024-09-19T06:05:10.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:10.731+0000 7f9cbdffb640 1 -- 172.21.15.37:0/625466822 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f9cb0004fa0 con 0x7f9cc0102d30 2024-09-19T06:05:10.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:10.731+0000 7f9cbdffb640 1 --2- 172.21.15.37:0/625466822 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f9cac0a32d0 0x7f9cac0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:10.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:10.731+0000 7f9cbdffb640 1 -- 172.21.15.37:0/625466822 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f9cb00cfe70 con 0x7f9cc0102d30 2024-09-19T06:05:10.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:10.732+0000 7f9cb7fff640 1 --2- 172.21.15.37:0/625466822 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f9cac0a32d0 0x7f9cac0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:10.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:10.732+0000 7f9cbdffb640 1 --2- 172.21.15.37:0/625466822 >> [v2:172.21.15.117:6816/2005866772,v1:172.21.15.117:6817/2005866772] conn(0x7f9cac0ae000 0x7f9cac0b0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:10.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:10.732+0000 7f9cbdffb640 1 -- 172.21.15.37:0/625466822 --> [v2:172.21.15.117:6816/2005866772,v1:172.21.15.117:6817/2005866772] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9cac0b0b10 con 0x7f9cac0ae000 2024-09-19T06:05:10.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:10.732+0000 7f9cbdffb640 1 -- 172.21.15.37:0/625466822 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7f9cb00d02c0 con 0x7f9cc0102d30 2024-09-19T06:05:10.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:10.732+0000 7f9cc4c1b640 1 --2- 172.21.15.37:0/625466822 >> [v2:172.21.15.117:6816/2005866772,v1:172.21.15.117:6817/2005866772] conn(0x7f9cac0ae000 0x7f9cac0b0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:10.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:10.732+0000 7f9cb7fff640 1 --2- 172.21.15.37:0/625466822 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f9cac0a32d0 0x7f9cac0a5790 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9cc0102420 tx=0x7f9ca800c4a0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:10.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:10.733+0000 7f9cc4c1b640 1 --2- 172.21.15.37:0/625466822 >> [v2:172.21.15.117:6816/2005866772,v1:172.21.15.117:6817/2005866772] conn(0x7f9cac0ae000 0x7f9cac0b0440 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:10.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:10.733+0000 7f9cbdffb640 1 -- 172.21.15.37:0/625466822 <== osd.8 v2:172.21.15.117:6816/2005866772 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9cac0b0b10 con 0x7f9cac0ae000 2024-09-19T06:05:10.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:10.747+0000 7f9cc667e640 1 -- 172.21.15.37:0/625466822 --> [v2:172.21.15.117:6816/2005866772,v1:172.21.15.117:6817/2005866772] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9cc0062d40 con 0x7f9cac0ae000 2024-09-19T06:05:10.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:10.748+0000 7f9cbdffb640 1 -- 172.21.15.37:0/625466822 <== osd.8 v2:172.21.15.117:6816/2005866772 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9cc0062d40 con 0x7f9cac0ae000 2024-09-19T06:05:10.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:10.748+0000 7f9cc667e640 1 -- 172.21.15.37:0/625466822 >> [v2:172.21.15.117:6816/2005866772,v1:172.21.15.117:6817/2005866772] conn(0x7f9cac0ae000 msgr2=0x7f9cac0b0440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:10.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:10.748+0000 7f9cc667e640 1 --2- 172.21.15.37:0/625466822 >> [v2:172.21.15.117:6816/2005866772,v1:172.21.15.117:6817/2005866772] conn(0x7f9cac0ae000 0x7f9cac0b0440 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:10.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:10.748+0000 7f9cc667e640 1 -- 172.21.15.37:0/625466822 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f9cac0a32d0 msgr2=0x7f9cac0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:10.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:10.748+0000 7f9cc667e640 1 --2- 172.21.15.37:0/625466822 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f9cac0a32d0 0x7f9cac0a5790 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9cc0102420 tx=0x7f9ca800c4a0 comp rx=0 tx=0).stop 2024-09-19T06:05:10.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:10.748+0000 7f9cc667e640 1 -- 172.21.15.37:0/625466822 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cc0102d30 msgr2=0x7f9cc0100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:10.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:10.748+0000 7f9cc667e640 1 --2- 172.21.15.37:0/625466822 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cc0102d30 0x7f9cc0100990 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9cb000c970 tx=0x7f9cb000ce30 comp rx=0 tx=0).stop 2024-09-19T06:05:10.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:10.748+0000 7f9cc4c1b640 1 -- 172.21.15.37:0/625466822 reap_dead start 2024-09-19T06:05:10.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:10.748+0000 7f9cc667e640 1 -- 172.21.15.37:0/625466822 shutdown_connections 2024-09-19T06:05:10.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:10.748+0000 7f9cc667e640 1 -- 172.21.15.37:0/625466822 >> 172.21.15.37:0/625466822 conn(0x7f9cc00fc7d0 msgr2=0x7f9cc0106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:10.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:10.748+0000 7f9cc667e640 1 -- 172.21.15.37:0/625466822 shutdown_connections 2024-09-19T06:05:10.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:10.749+0000 7f9cc667e640 1 -- 172.21.15.37:0/625466822 wait complete. 2024-09-19T06:05:11.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.465+0000 7f9716feb640 1 -- 172.21.15.37:0/1710081132 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9710106a60 msgr2=0x7f9710106e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:11.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.465+0000 7f9716feb640 1 --2- 172.21.15.37:0/1710081132 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9710106a60 0x7f9710106e40 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f9700009930 tx=0x7f970002a420 comp rx=0 tx=0).stop 2024-09-19T06:05:11.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.465+0000 7f9716feb640 1 -- 172.21.15.37:0/1710081132 shutdown_connections 2024-09-19T06:05:11.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.465+0000 7f9716feb640 1 --2- 172.21.15.37:0/1710081132 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9710100a60 0x7f9710100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:11.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.465+0000 7f9716feb640 1 --2- 172.21.15.37:0/1710081132 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9710101400 0x7f971010d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:11.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.465+0000 7f9716feb640 1 --2- 172.21.15.37:0/1710081132 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9710106a60 0x7f9710106e40 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:11.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.465+0000 7f9716feb640 1 -- 172.21.15.37:0/1710081132 >> 172.21.15.37:0/1710081132 conn(0x7f97100fc780 msgr2=0x7f97100feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:11.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.465+0000 7f9716feb640 1 -- 172.21.15.37:0/1710081132 shutdown_connections 2024-09-19T06:05:11.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.465+0000 7f9716feb640 1 -- 172.21.15.37:0/1710081132 wait complete. 2024-09-19T06:05:11.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.466+0000 7f9716feb640 1 Processor -- start 2024-09-19T06:05:11.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.466+0000 7f9716feb640 1 -- start start 2024-09-19T06:05:11.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.466+0000 7f9716feb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9710100a60 0x7f9710199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:11.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.466+0000 7f9716feb640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9710101400 0x7f9710199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:11.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.466+0000 7f9716feb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9710106a60 0x7f97101a43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:11.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.466+0000 7f9716feb640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9710110e70 con 0x7f9710106a60 2024-09-19T06:05:11.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.466+0000 7f9716feb640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f9710110cf0 con 0x7f9710101400 2024-09-19T06:05:11.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.466+0000 7f9716feb640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9710110ff0 con 0x7f9710100a60 2024-09-19T06:05:11.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.466+0000 7f9715588640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9710106a60 0x7f97101a43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:11.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.466+0000 7f9715588640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9710106a60 0x7f97101a43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35466/0 (socket says 172.21.15.37:35466) 2024-09-19T06:05:11.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.466+0000 7f9715588640 1 -- 172.21.15.37:0/1984402130 learned_addr learned my addr 172.21.15.37:0/1984402130 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:05:11.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.466+0000 7f9714d87640 1 --2- 172.21.15.37:0/1984402130 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9710100a60 0x7f9710199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:11.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.466+0000 7f970ffff640 1 --2- 172.21.15.37:0/1984402130 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9710101400 0x7f9710199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:11.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.466+0000 7f9715588640 1 -- 172.21.15.37:0/1984402130 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9710100a60 msgr2=0x7f9710199340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:11.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.466+0000 7f9715588640 1 --2- 172.21.15.37:0/1984402130 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9710100a60 0x7f9710199340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:11.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.466+0000 7f9715588640 1 -- 172.21.15.37:0/1984402130 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9710101400 msgr2=0x7f9710199880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:11.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.467+0000 7f9715588640 1 --2- 172.21.15.37:0/1984402130 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9710101400 0x7f9710199880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:11.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.467+0000 7f9715588640 1 -- 172.21.15.37:0/1984402130 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97101a4900 con 0x7f9710106a60 2024-09-19T06:05:11.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.467+0000 7f970ffff640 1 --2- 172.21.15.37:0/1984402130 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9710101400 0x7f9710199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:05:11.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.467+0000 7f9715588640 1 --2- 172.21.15.37:0/1984402130 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9710106a60 0x7f97101a43c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9708009fd0 tx=0x7f970800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:11.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.467+0000 7f970dffb640 1 -- 172.21.15.37:0/1984402130 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9708017070 con 0x7f9710106a60 2024-09-19T06:05:11.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.467+0000 7f970dffb640 1 -- 172.21.15.37:0/1984402130 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9708003e50 con 0x7f9710106a60 2024-09-19T06:05:11.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.467+0000 7f9716feb640 1 -- 172.21.15.37:0/1984402130 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97101a4ad0 con 0x7f9710106a60 2024-09-19T06:05:11.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.467+0000 7f970dffb640 1 -- 172.21.15.37:0/1984402130 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97080106c0 con 0x7f9710106a60 2024-09-19T06:05:11.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.467+0000 7f9716feb640 1 -- 172.21.15.37:0/1984402130 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97101a4fe0 con 0x7f9710106a60 2024-09-19T06:05:11.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.468+0000 7f9716feb640 1 -- 172.21.15.37:0/1984402130 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9710062900 con 0x7f9710106a60 2024-09-19T06:05:11.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.469+0000 7f970dffb640 1 -- 172.21.15.37:0/1984402130 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f9708003970 con 0x7f9710106a60 2024-09-19T06:05:11.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.470+0000 7f970dffb640 1 --2- 172.21.15.37:0/1984402130 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f96fc0a3350 0x7f96fc0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:11.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.470+0000 7f9714d87640 1 --2- 172.21.15.37:0/1984402130 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f96fc0a3350 0x7f96fc0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:11.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.470+0000 7f970dffb640 1 -- 172.21.15.37:0/1984402130 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f97080cfd70 con 0x7f9710106a60 2024-09-19T06:05:11.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.470+0000 7f970dffb640 1 --2- 172.21.15.37:0/1984402130 >> [v2:172.21.15.37:6826/1398779376,v1:172.21.15.37:6827/1398779376] conn(0x7f96fc0ae080 0x7f96fc0b04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:11.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.470+0000 7f970dffb640 1 -- 172.21.15.37:0/1984402130 --> [v2:172.21.15.37:6826/1398779376,v1:172.21.15.37:6827/1398779376] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9708018ec0 con 0x7f96fc0ae080 2024-09-19T06:05:11.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.470+0000 7f970dffb640 1 -- 172.21.15.37:0/1984402130 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7f97080d01c0 con 0x7f9710106a60 2024-09-19T06:05:11.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.470+0000 7f970ffff640 1 --2- 172.21.15.37:0/1984402130 >> [v2:172.21.15.37:6826/1398779376,v1:172.21.15.37:6827/1398779376] conn(0x7f96fc0ae080 0x7f96fc0b04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:11.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.470+0000 7f9714d87640 1 --2- 172.21.15.37:0/1984402130 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f96fc0a3350 0x7f96fc0a5810 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9700006010 tx=0x7f9700000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:11.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.471+0000 7f970ffff640 1 --2- 172.21.15.37:0/1984402130 >> [v2:172.21.15.37:6826/1398779376,v1:172.21.15.37:6827/1398779376] conn(0x7f96fc0ae080 0x7f96fc0b04c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:11.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.471+0000 7f970dffb640 1 -- 172.21.15.37:0/1984402130 <== osd.9 v2:172.21.15.37:6826/1398779376 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9708018ec0 con 0x7f96fc0ae080 2024-09-19T06:05:11.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.485+0000 7f9716feb640 1 -- 172.21.15.37:0/1984402130 --> [v2:172.21.15.37:6826/1398779376,v1:172.21.15.37:6827/1398779376] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9710062d80 con 0x7f96fc0ae080 2024-09-19T06:05:11.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.485+0000 7f970dffb640 1 -- 172.21.15.37:0/1984402130 <== osd.9 v2:172.21.15.37:6826/1398779376 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9710062d80 con 0x7f96fc0ae080 2024-09-19T06:05:11.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.486+0000 7f9716feb640 1 -- 172.21.15.37:0/1984402130 >> [v2:172.21.15.37:6826/1398779376,v1:172.21.15.37:6827/1398779376] conn(0x7f96fc0ae080 msgr2=0x7f96fc0b04c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:11.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.486+0000 7f9716feb640 1 --2- 172.21.15.37:0/1984402130 >> [v2:172.21.15.37:6826/1398779376,v1:172.21.15.37:6827/1398779376] conn(0x7f96fc0ae080 0x7f96fc0b04c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:11.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.486+0000 7f9716feb640 1 -- 172.21.15.37:0/1984402130 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f96fc0a3350 msgr2=0x7f96fc0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:11.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.486+0000 7f9716feb640 1 --2- 172.21.15.37:0/1984402130 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f96fc0a3350 0x7f96fc0a5810 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9700006010 tx=0x7f9700000bc0 comp rx=0 tx=0).stop 2024-09-19T06:05:11.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.486+0000 7f9716feb640 1 -- 172.21.15.37:0/1984402130 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9710106a60 msgr2=0x7f97101a43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:11.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.486+0000 7f9716feb640 1 --2- 172.21.15.37:0/1984402130 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9710106a60 0x7f97101a43c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9708009fd0 tx=0x7f970800b260 comp rx=0 tx=0).stop 2024-09-19T06:05:11.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.486+0000 7f9715588640 1 -- 172.21.15.37:0/1984402130 reap_dead start 2024-09-19T06:05:11.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.486+0000 7f9716feb640 1 -- 172.21.15.37:0/1984402130 shutdown_connections 2024-09-19T06:05:11.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.486+0000 7f9716feb640 1 -- 172.21.15.37:0/1984402130 >> 172.21.15.37:0/1984402130 conn(0x7f97100fc780 msgr2=0x7f97100fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:11.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.486+0000 7f9716feb640 1 -- 172.21.15.37:0/1984402130 shutdown_connections 2024-09-19T06:05:11.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.486+0000 7f9716feb640 1 -- 172.21.15.37:0/1984402130 wait complete. 2024-09-19T06:05:11.796 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:11 smithi037 ceph-mon[31211]: pgmap v316: 129 pgs: 129 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-19T06:05:11.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.876+0000 7f1de95d5640 1 -- 172.21.15.37:0/3600260012 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1de4101420 msgr2=0x7f1de410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:11.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.876+0000 7f1de95d5640 1 --2- 172.21.15.37:0/3600260012 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1de4101420 0x7f1de410d950 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc009cd0 tx=0x7f1ddc02a8e0 comp rx=0 tx=0).stop 2024-09-19T06:05:11.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.876+0000 7f1de95d5640 1 -- 172.21.15.37:0/3600260012 shutdown_connections 2024-09-19T06:05:11.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.876+0000 7f1de95d5640 1 --2- 172.21.15.37:0/3600260012 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1de4100a80 0x7f1de4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:11.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.876+0000 7f1de95d5640 1 --2- 172.21.15.37:0/3600260012 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1de4101420 0x7f1de410d950 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:11.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.876+0000 7f1de95d5640 1 --2- 172.21.15.37:0/3600260012 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1de4106a80 0x7f1de4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:11.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.876+0000 7f1de95d5640 1 -- 172.21.15.37:0/3600260012 >> 172.21.15.37:0/3600260012 conn(0x7f1de40fc7a0 msgr2=0x7f1de40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:11.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.876+0000 7f1de95d5640 1 -- 172.21.15.37:0/3600260012 shutdown_connections 2024-09-19T06:05:11.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.876+0000 7f1de95d5640 1 -- 172.21.15.37:0/3600260012 wait complete. 2024-09-19T06:05:11.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.877+0000 7f1de95d5640 1 Processor -- start 2024-09-19T06:05:11.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.877+0000 7f1de95d5640 1 -- start start 2024-09-19T06:05:11.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.877+0000 7f1de95d5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1de4100a80 0x7f1de4198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:11.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.877+0000 7f1de95d5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1de4101420 0x7f1de4198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:11.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.877+0000 7f1de95d5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1de4106a80 0x7f1de419ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:11.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.877+0000 7f1de95d5640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1de4110ec0 con 0x7f1de4101420 2024-09-19T06:05:11.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.877+0000 7f1de95d5640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f1de4110d40 con 0x7f1de4100a80 2024-09-19T06:05:11.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.877+0000 7f1de95d5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1de4111040 con 0x7f1de4106a80 2024-09-19T06:05:11.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.877+0000 7f1de27fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1de4101420 0x7f1de4198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:11.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.877+0000 7f1de27fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1de4101420 0x7f1de4198a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35496/0 (socket says 172.21.15.37:35496) 2024-09-19T06:05:11.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.877+0000 7f1de27fc640 1 -- 172.21.15.37:0/2857727165 learned_addr learned my addr 172.21.15.37:0/2857727165 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:05:11.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.878+0000 7f1de37fe640 1 --2- 172.21.15.37:0/2857727165 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1de4106a80 0x7f1de419ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:11.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.878+0000 7f1de2ffd640 1 --2- 172.21.15.37:0/2857727165 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1de4100a80 0x7f1de4198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:11.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.878+0000 7f1de27fc640 1 -- 172.21.15.37:0/2857727165 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1de4106a80 msgr2=0x7f1de419ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:11.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.878+0000 7f1de27fc640 1 --2- 172.21.15.37:0/2857727165 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1de4106a80 0x7f1de419ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:11.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.878+0000 7f1de27fc640 1 -- 172.21.15.37:0/2857727165 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1de4100a80 msgr2=0x7f1de4198550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:11.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.878+0000 7f1de27fc640 1 --2- 172.21.15.37:0/2857727165 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1de4100a80 0x7f1de4198550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:11.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.878+0000 7f1de27fc640 1 -- 172.21.15.37:0/2857727165 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1de419d500 con 0x7f1de4101420 2024-09-19T06:05:11.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.878+0000 7f1de27fc640 1 --2- 172.21.15.37:0/2857727165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1de4101420 0x7f1de4198a90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1dd800b4a0 tx=0x7f1dd800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:11.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.878+0000 7f1dcbfff640 1 -- 172.21.15.37:0/2857727165 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd8014070 con 0x7f1de4101420 2024-09-19T06:05:11.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.878+0000 7f1dcbfff640 1 -- 172.21.15.37:0/2857727165 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1dd8010af0 con 0x7f1de4101420 2024-09-19T06:05:11.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.878+0000 7f1de95d5640 1 -- 172.21.15.37:0/2857727165 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1de419d7f0 con 0x7f1de4101420 2024-09-19T06:05:11.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.878+0000 7f1dcbfff640 1 -- 172.21.15.37:0/2857727165 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd8017d10 con 0x7f1de4101420 2024-09-19T06:05:11.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.878+0000 7f1de95d5640 1 -- 172.21.15.37:0/2857727165 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1de41a50d0 con 0x7f1de4101420 2024-09-19T06:05:11.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.879+0000 7f1de95d5640 1 -- 172.21.15.37:0/2857727165 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1de4062900 con 0x7f1de4101420 2024-09-19T06:05:11.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.880+0000 7f1dcbfff640 1 -- 172.21.15.37:0/2857727165 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f1dd8017070 con 0x7f1de4101420 2024-09-19T06:05:11.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.881+0000 7f1dcbfff640 1 --2- 172.21.15.37:0/2857727165 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f1dcc0a32d0 0x7f1dcc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:11.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.881+0000 7f1de2ffd640 1 --2- 172.21.15.37:0/2857727165 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f1dcc0a32d0 0x7f1dcc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:11.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.881+0000 7f1dcbfff640 1 -- 172.21.15.37:0/2857727165 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f1dd80cf3c0 con 0x7f1de4101420 2024-09-19T06:05:11.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.881+0000 7f1dcbfff640 1 --2- 172.21.15.37:0/2857727165 >> [v2:172.21.15.117:6808/1141976511,v1:172.21.15.117:6809/1141976511] conn(0x7f1dcc0ae000 0x7f1dcc0b0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:11.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.881+0000 7f1dcbfff640 1 -- 172.21.15.37:0/2857727165 --> [v2:172.21.15.117:6808/1141976511,v1:172.21.15.117:6809/1141976511] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1dd8011e50 con 0x7f1dcc0ae000 2024-09-19T06:05:11.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.881+0000 7f1dcbfff640 1 -- 172.21.15.37:0/2857727165 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7f1dd80cf810 con 0x7f1de4101420 2024-09-19T06:05:11.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.882+0000 7f1de2ffd640 1 --2- 172.21.15.37:0/2857727165 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f1dcc0a32d0 0x7f1dcc0a5790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1dd4005fd0 tx=0x7f1dd4005850 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:11.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.882+0000 7f1de37fe640 1 --2- 172.21.15.37:0/2857727165 >> [v2:172.21.15.117:6808/1141976511,v1:172.21.15.117:6809/1141976511] conn(0x7f1dcc0ae000 0x7f1dcc0b0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:11.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.882+0000 7f1de37fe640 1 --2- 172.21.15.37:0/2857727165 >> [v2:172.21.15.117:6808/1141976511,v1:172.21.15.117:6809/1141976511] conn(0x7f1dcc0ae000 0x7f1dcc0b0440 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:11.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.883+0000 7f1dcbfff640 1 -- 172.21.15.37:0/2857727165 <== osd.5 v2:172.21.15.117:6808/1141976511 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1dd8011e50 con 0x7f1dcc0ae000 2024-09-19T06:05:11.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.896+0000 7f1de95d5640 1 -- 172.21.15.37:0/2857727165 --> [v2:172.21.15.117:6808/1141976511,v1:172.21.15.117:6809/1141976511] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1de4062d80 con 0x7f1dcc0ae000 2024-09-19T06:05:11.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.897+0000 7f1dcbfff640 1 -- 172.21.15.37:0/2857727165 <== osd.5 v2:172.21.15.117:6808/1141976511 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f1de4062d80 con 0x7f1dcc0ae000 2024-09-19T06:05:11.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.897+0000 7f1de95d5640 1 -- 172.21.15.37:0/2857727165 >> [v2:172.21.15.117:6808/1141976511,v1:172.21.15.117:6809/1141976511] conn(0x7f1dcc0ae000 msgr2=0x7f1dcc0b0440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:11.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.897+0000 7f1de95d5640 1 --2- 172.21.15.37:0/2857727165 >> [v2:172.21.15.117:6808/1141976511,v1:172.21.15.117:6809/1141976511] conn(0x7f1dcc0ae000 0x7f1dcc0b0440 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:11.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.897+0000 7f1de95d5640 1 -- 172.21.15.37:0/2857727165 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f1dcc0a32d0 msgr2=0x7f1dcc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:11.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.897+0000 7f1de95d5640 1 --2- 172.21.15.37:0/2857727165 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f1dcc0a32d0 0x7f1dcc0a5790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1dd4005fd0 tx=0x7f1dd4005850 comp rx=0 tx=0).stop 2024-09-19T06:05:11.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.897+0000 7f1de95d5640 1 -- 172.21.15.37:0/2857727165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1de4101420 msgr2=0x7f1de4198a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:11.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.897+0000 7f1de95d5640 1 --2- 172.21.15.37:0/2857727165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1de4101420 0x7f1de4198a90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1dd800b4a0 tx=0x7f1dd800b960 comp rx=0 tx=0).stop 2024-09-19T06:05:11.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.897+0000 7f1de37fe640 1 -- 172.21.15.37:0/2857727165 reap_dead start 2024-09-19T06:05:11.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.897+0000 7f1de95d5640 1 -- 172.21.15.37:0/2857727165 shutdown_connections 2024-09-19T06:05:11.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.897+0000 7f1de95d5640 1 -- 172.21.15.37:0/2857727165 >> 172.21.15.37:0/2857727165 conn(0x7f1de40fc7a0 msgr2=0x7f1de406aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:11.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.898+0000 7f1de95d5640 1 -- 172.21.15.37:0/2857727165 shutdown_connections 2024-09-19T06:05:11.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.898+0000 7f1de95d5640 1 -- 172.21.15.37:0/2857727165 wait complete. 2024-09-19T06:05:12.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:11 smithi117 ceph-mon[35050]: pgmap v316: 129 pgs: 129 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-19T06:05:12.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:11 smithi099 ceph-mon[35300]: pgmap v316: 129 pgs: 129 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-19T06:05:12.554 INFO:teuthology.orchestra.run.smithi037.stdout:158913790009 2024-09-19T06:05:12.555 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-19T06:05:12.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.677+0000 7fb3c70a6640 1 -- 172.21.15.37:0/4017642740 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3c0106f40 msgr2=0x7fb3c010eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:12.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.677+0000 7fb3c70a6640 1 --2- 172.21.15.37:0/4017642740 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3c0106f40 0x7fb3c010eac0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb3b8009ca0 tx=0x7fb3b802a8c0 comp rx=0 tx=0).stop 2024-09-19T06:05:12.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.677+0000 7fb3c70a6640 1 -- 172.21.15.37:0/4017642740 shutdown_connections 2024-09-19T06:05:12.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.677+0000 7fb3c70a6640 1 --2- 172.21.15.37:0/4017642740 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3c0106f40 0x7fb3c010eac0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:12.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.677+0000 7fb3c70a6640 1 --2- 172.21.15.37:0/4017642740 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3c01027c0 0x7fb3c0106810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:12.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.677+0000 7fb3c70a6640 1 --2- 172.21.15.37:0/4017642740 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb3c0101e10 0x7fb3c01021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:12.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.677+0000 7fb3c70a6640 1 -- 172.21.15.37:0/4017642740 >> 172.21.15.37:0/4017642740 conn(0x7fb3c00fd8d0 msgr2=0x7fb3c00ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:12.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.677+0000 7fb3c70a6640 1 -- 172.21.15.37:0/4017642740 shutdown_connections 2024-09-19T06:05:12.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.677+0000 7fb3c70a6640 1 -- 172.21.15.37:0/4017642740 wait complete. 2024-09-19T06:05:12.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.678+0000 7fb3c70a6640 1 Processor -- start 2024-09-19T06:05:12.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.678+0000 7fb3c70a6640 1 -- start start 2024-09-19T06:05:12.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.678+0000 7fb3c70a6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3c0101e10 0x7fb3c01983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:12.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.678+0000 7fb3c70a6640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb3c01027c0 0x7fb3c0198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:12.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.678+0000 7fb3c70a6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3c0106f40 0x7fb3c019cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:12.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.678+0000 7fb3c70a6640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c0111fa0 con 0x7fb3c0106f40 2024-09-19T06:05:12.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.678+0000 7fb3c70a6640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c0111e20 con 0x7fb3c01027c0 2024-09-19T06:05:12.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.678+0000 7fb3c70a6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c0112120 con 0x7fb3c0101e10 2024-09-19T06:05:12.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.678+0000 7fb3c5643640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3c0106f40 0x7fb3c019cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:12.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.678+0000 7fb3c5643640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3c0106f40 0x7fb3c019cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35492/0 (socket says 172.21.15.37:35492) 2024-09-19T06:05:12.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.678+0000 7fb3c5643640 1 -- 172.21.15.37:0/1574103062 learned_addr learned my addr 172.21.15.37:0/1574103062 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:05:12.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.678+0000 7fb3bffff640 1 --2- 172.21.15.37:0/1574103062 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb3c01027c0 0x7fb3c0198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:12.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.679+0000 7fb3c4e42640 1 --2- 172.21.15.37:0/1574103062 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3c0101e10 0x7fb3c01983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:12.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.679+0000 7fb3c5643640 1 -- 172.21.15.37:0/1574103062 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3c0101e10 msgr2=0x7fb3c01983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:12.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.679+0000 7fb3c5643640 1 --2- 172.21.15.37:0/1574103062 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3c0101e10 0x7fb3c01983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:12.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.679+0000 7fb3c5643640 1 -- 172.21.15.37:0/1574103062 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb3c01027c0 msgr2=0x7fb3c0198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:12.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.679+0000 7fb3c5643640 1 --2- 172.21.15.37:0/1574103062 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb3c01027c0 0x7fb3c0198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:12.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.679+0000 7fb3c5643640 1 -- 172.21.15.37:0/1574103062 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3c019d380 con 0x7fb3c0106f40 2024-09-19T06:05:12.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.679+0000 7fb3c5643640 1 --2- 172.21.15.37:0/1574103062 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3c0106f40 0x7fb3c019cca0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb3b8031a20 tx=0x7fb3b8031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:12.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.679+0000 7fb3bdffb640 1 -- 172.21.15.37:0/1574103062 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b8003c30 con 0x7fb3c0106f40 2024-09-19T06:05:12.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.679+0000 7fb3bdffb640 1 -- 172.21.15.37:0/1574103062 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3b8003dd0 con 0x7fb3c0106f40 2024-09-19T06:05:12.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.679+0000 7fb3c70a6640 1 -- 172.21.15.37:0/1574103062 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3c019d610 con 0x7fb3c0106f40 2024-09-19T06:05:12.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.679+0000 7fb3bdffb640 1 -- 172.21.15.37:0/1574103062 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b802fcf0 con 0x7fb3c0106f40 2024-09-19T06:05:12.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.679+0000 7fb3c70a6640 1 -- 172.21.15.37:0/1574103062 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3c01a4f50 con 0x7fb3c0106f40 2024-09-19T06:05:12.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.680+0000 7fb3c70a6640 1 -- 172.21.15.37:0/1574103062 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb3c0062980 con 0x7fb3c0106f40 2024-09-19T06:05:12.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.681+0000 7fb3bdffb640 1 -- 172.21.15.37:0/1574103062 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fb3b8004050 con 0x7fb3c0106f40 2024-09-19T06:05:12.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.682+0000 7fb3bdffb640 1 --2- 172.21.15.37:0/1574103062 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fb3b00a3350 0x7fb3b00a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:12.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.682+0000 7fb3c4e42640 1 --2- 172.21.15.37:0/1574103062 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fb3b00a3350 0x7fb3b00a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:12.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.682+0000 7fb3bdffb640 1 -- 172.21.15.37:0/1574103062 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7fb3b80f11c0 con 0x7fb3c0106f40 2024-09-19T06:05:12.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.682+0000 7fb3bdffb640 1 --2- 172.21.15.37:0/1574103062 >> [v2:172.21.15.37:6802/1783875173,v1:172.21.15.37:6803/1783875173] conn(0x7fb3b00ae080 0x7fb3b00b04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:12.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.682+0000 7fb3bdffb640 1 -- 172.21.15.37:0/1574103062 --> [v2:172.21.15.37:6802/1783875173,v1:172.21.15.37:6803/1783875173] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb3b00b0b90 con 0x7fb3b00ae080 2024-09-19T06:05:12.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.682+0000 7fb3bdffb640 1 -- 172.21.15.37:0/1574103062 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7fb3b80f1610 con 0x7fb3c0106f40 2024-09-19T06:05:12.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.683+0000 7fb3bffff640 1 --2- 172.21.15.37:0/1574103062 >> [v2:172.21.15.37:6802/1783875173,v1:172.21.15.37:6803/1783875173] conn(0x7fb3b00ae080 0x7fb3b00b04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:12.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.683+0000 7fb3c4e42640 1 --2- 172.21.15.37:0/1574103062 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fb3b00a3350 0x7fb3b00a5810 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb3b400bbe0 tx=0x7fb3b400b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:12.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.683+0000 7fb3bffff640 1 --2- 172.21.15.37:0/1574103062 >> [v2:172.21.15.37:6802/1783875173,v1:172.21.15.37:6803/1783875173] conn(0x7fb3b00ae080 0x7fb3b00b04c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:12.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.684+0000 7fb3bdffb640 1 -- 172.21.15.37:0/1574103062 <== osd.0 v2:172.21.15.37:6802/1783875173 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb3b00b0b90 con 0x7fb3b00ae080 2024-09-19T06:05:12.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.698+0000 7fb3c70a6640 1 -- 172.21.15.37:0/1574103062 --> [v2:172.21.15.37:6802/1783875173,v1:172.21.15.37:6803/1783875173] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb3c0062d80 con 0x7fb3b00ae080 2024-09-19T06:05:12.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.698+0000 7fb3bdffb640 1 -- 172.21.15.37:0/1574103062 <== osd.0 v2:172.21.15.37:6802/1783875173 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb3c0062d80 con 0x7fb3b00ae080 2024-09-19T06:05:12.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.698+0000 7fb3c70a6640 1 -- 172.21.15.37:0/1574103062 >> [v2:172.21.15.37:6802/1783875173,v1:172.21.15.37:6803/1783875173] conn(0x7fb3b00ae080 msgr2=0x7fb3b00b04c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:12.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.698+0000 7fb3c70a6640 1 --2- 172.21.15.37:0/1574103062 >> [v2:172.21.15.37:6802/1783875173,v1:172.21.15.37:6803/1783875173] conn(0x7fb3b00ae080 0x7fb3b00b04c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:12.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.699+0000 7fb3c70a6640 1 -- 172.21.15.37:0/1574103062 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fb3b00a3350 msgr2=0x7fb3b00a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:12.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.699+0000 7fb3c70a6640 1 --2- 172.21.15.37:0/1574103062 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fb3b00a3350 0x7fb3b00a5810 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb3b400bbe0 tx=0x7fb3b400b390 comp rx=0 tx=0).stop 2024-09-19T06:05:12.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.699+0000 7fb3c70a6640 1 -- 172.21.15.37:0/1574103062 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3c0106f40 msgr2=0x7fb3c019cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:12.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.699+0000 7fb3c70a6640 1 --2- 172.21.15.37:0/1574103062 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3c0106f40 0x7fb3c019cca0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb3b8031a20 tx=0x7fb3b8031a50 comp rx=0 tx=0).stop 2024-09-19T06:05:12.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.699+0000 7fb3c5643640 1 -- 172.21.15.37:0/1574103062 reap_dead start 2024-09-19T06:05:12.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.699+0000 7fb3c70a6640 1 -- 172.21.15.37:0/1574103062 shutdown_connections 2024-09-19T06:05:12.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.699+0000 7fb3c70a6640 1 -- 172.21.15.37:0/1574103062 >> 172.21.15.37:0/1574103062 conn(0x7fb3c00fd8d0 msgr2=0x7fb3c00feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:12.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.699+0000 7fb3c70a6640 1 -- 172.21.15.37:0/1574103062 shutdown_connections 2024-09-19T06:05:12.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:11.699+0000 7fb3c70a6640 1 -- 172.21.15.37:0/1574103062 wait complete. 2024-09-19T06:05:12.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:12 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]: dispatch 2024-09-19T06:05:12.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:12 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]: dispatch 2024-09-19T06:05:12.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:12 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]: dispatch 2024-09-19T06:05:12.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:12 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]: dispatch 2024-09-19T06:05:12.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:12 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]: dispatch 2024-09-19T06:05:12.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:12 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2024-09-19T06:05:12.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:12 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]: dispatch 2024-09-19T06:05:12.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:12 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [5, 8]}]: dispatch 2024-09-19T06:05:12.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:12 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [9, 8]}]: dispatch 2024-09-19T06:05:12.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:12 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]: dispatch 2024-09-19T06:05:13.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:12 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]: dispatch 2024-09-19T06:05:13.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:12 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]: dispatch 2024-09-19T06:05:13.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:12 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]: dispatch 2024-09-19T06:05:13.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:12 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]: dispatch 2024-09-19T06:05:13.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:12 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]: dispatch 2024-09-19T06:05:13.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:12 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2024-09-19T06:05:13.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:12 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]: dispatch 2024-09-19T06:05:13.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:12 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [5, 8]}]: dispatch 2024-09-19T06:05:13.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:12 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [9, 8]}]: dispatch 2024-09-19T06:05:13.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:12 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]: dispatch 2024-09-19T06:05:13.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:12 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]: dispatch 2024-09-19T06:05:13.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:12 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]: dispatch 2024-09-19T06:05:13.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:12 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]: dispatch 2024-09-19T06:05:13.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:12 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]: dispatch 2024-09-19T06:05:13.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:12 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]: dispatch 2024-09-19T06:05:13.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:12 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2024-09-19T06:05:13.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:12 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]: dispatch 2024-09-19T06:05:13.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:12 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [5, 8]}]: dispatch 2024-09-19T06:05:13.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:12 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [9, 8]}]: dispatch 2024-09-19T06:05:13.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:12 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]: dispatch 2024-09-19T06:05:13.634 INFO:teuthology.orchestra.run.smithi037.stdout:292057776160 2024-09-19T06:05:13.635 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-19T06:05:13.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:13 smithi037 ceph-mon[31211]: pgmap v317: 129 pgs: 129 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-19T06:05:13.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:13 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]': finished 2024-09-19T06:05:13.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:13 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2024-09-19T06:05:13.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:13 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2024-09-19T06:05:13.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:13 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]': finished 2024-09-19T06:05:13.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:13 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]': finished 2024-09-19T06:05:13.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:13 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-09-19T06:05:13.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:13 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2024-09-19T06:05:13.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:13 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [5, 8]}]': finished 2024-09-19T06:05:13.825 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:13 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [9, 8]}]': finished 2024-09-19T06:05:13.825 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:13 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]': finished 2024-09-19T06:05:13.825 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:13 smithi037 ceph-mon[31211]: osdmap e88: 12 total, 12 up, 12 in 2024-09-19T06:05:14.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:13 smithi117 ceph-mon[35050]: pgmap v317: 129 pgs: 129 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-19T06:05:14.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:13 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]': finished 2024-09-19T06:05:14.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:13 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2024-09-19T06:05:14.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:13 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2024-09-19T06:05:14.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:13 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]': finished 2024-09-19T06:05:14.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:13 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]': finished 2024-09-19T06:05:14.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:13 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-09-19T06:05:14.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:13 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2024-09-19T06:05:14.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:13 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [5, 8]}]': finished 2024-09-19T06:05:14.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:13 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [9, 8]}]': finished 2024-09-19T06:05:14.001 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:13 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]': finished 2024-09-19T06:05:14.001 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:13 smithi117 ceph-mon[35050]: osdmap e88: 12 total, 12 up, 12 in 2024-09-19T06:05:14.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:13 smithi099 ceph-mon[35300]: pgmap v317: 129 pgs: 129 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-19T06:05:14.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:13 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]': finished 2024-09-19T06:05:14.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:13 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2024-09-19T06:05:14.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:13 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2024-09-19T06:05:14.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:13 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]': finished 2024-09-19T06:05:14.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:13 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]': finished 2024-09-19T06:05:14.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:13 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-09-19T06:05:14.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:13 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2024-09-19T06:05:14.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:13 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [5, 8]}]': finished 2024-09-19T06:05:14.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:13 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [9, 8]}]': finished 2024-09-19T06:05:14.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:13 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]': finished 2024-09-19T06:05:14.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:13 smithi099 ceph-mon[35300]: osdmap e88: 12 total, 12 up, 12 in 2024-09-19T06:05:14.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:14.189+0000 7fed6539e640 1 -- 172.21.15.37:0/470429565 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed601068d0 msgr2=0x7fed60106cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:14.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:14.189+0000 7fed6539e640 1 --2- 172.21.15.37:0/470429565 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed601068d0 0x7fed60106cb0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fed50009930 tx=0x7fed5002a420 comp rx=0 tx=0).stop 2024-09-19T06:05:14.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:14.189+0000 7fed6539e640 1 -- 172.21.15.37:0/470429565 shutdown_connections 2024-09-19T06:05:14.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:14.189+0000 7fed6539e640 1 --2- 172.21.15.37:0/470429565 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fed601008d0 0x7fed60100d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:14.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:14.189+0000 7fed6539e640 1 --2- 172.21.15.37:0/470429565 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed60101270 0x7fed6010d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:14.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:14.189+0000 7fed6539e640 1 --2- 172.21.15.37:0/470429565 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed601068d0 0x7fed60106cb0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:14.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:14.189+0000 7fed6539e640 1 -- 172.21.15.37:0/470429565 >> 172.21.15.37:0/470429565 conn(0x7fed600fc610 msgr2=0x7fed600fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:14.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:14.189+0000 7fed6539e640 1 -- 172.21.15.37:0/470429565 shutdown_connections 2024-09-19T06:05:14.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:14.189+0000 7fed6539e640 1 -- 172.21.15.37:0/470429565 wait complete. 2024-09-19T06:05:14.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:14.190+0000 7fed6539e640 1 Processor -- start 2024-09-19T06:05:14.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:14.190+0000 7fed6539e640 1 -- start start 2024-09-19T06:05:14.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:14.190+0000 7fed6539e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed601008d0 0x7fed60196ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:14.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:14.190+0000 7fed6539e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fed60101270 0x7fed60197410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:14.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:14.190+0000 7fed6539e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed601068d0 0x7fed60197950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:14.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:14.190+0000 7fed6539e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fed60110c90 con 0x7fed601008d0 2024-09-19T06:05:14.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:14.190+0000 7fed6539e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fed60110b10 con 0x7fed60101270 2024-09-19T06:05:14.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:14.190+0000 7fed6539e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fed60110e10 con 0x7fed601068d0 2024-09-19T06:05:14.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:14.190+0000 7fed5ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed601008d0 0x7fed60196ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:14.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:14.190+0000 7fed5ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed601008d0 0x7fed60196ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34510/0 (socket says 172.21.15.37:34510) 2024-09-19T06:05:14.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:14.190+0000 7fed5ffff640 1 -- 172.21.15.37:0/2740809780 learned_addr learned my addr 172.21.15.37:0/2740809780 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:05:14.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:14.191+0000 7fed5f7fe640 1 --2- 172.21.15.37:0/2740809780 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fed60101270 0x7fed60197410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:14.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:14.191+0000 7fed64b9d640 1 --2- 172.21.15.37:0/2740809780 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed601068d0 0x7fed60197950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:14.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:14.191+0000 7fed5ffff640 1 -- 172.21.15.37:0/2740809780 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed601068d0 msgr2=0x7fed60197950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:14.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:14.191+0000 7fed5ffff640 1 --2- 172.21.15.37:0/2740809780 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed601068d0 0x7fed60197950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:14.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:14.191+0000 7fed5ffff640 1 -- 172.21.15.37:0/2740809780 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fed60101270 msgr2=0x7fed60197410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:14.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:14.191+0000 7fed5ffff640 1 --2- 172.21.15.37:0/2740809780 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fed60101270 0x7fed60197410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:14.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:14.191+0000 7fed5ffff640 1 -- 172.21.15.37:0/2740809780 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed601a6740 con 0x7fed601008d0 2024-09-19T06:05:14.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:14.191+0000 7fed5ffff640 1 --2- 172.21.15.37:0/2740809780 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed601008d0 0x7fed60196ed0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fed50009230 tx=0x7fed50004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:14.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:14.191+0000 7fed5d7fa640 1 -- 172.21.15.37:0/2740809780 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed5003f030 con 0x7fed601008d0 2024-09-19T06:05:14.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:14.191+0000 7fed6539e640 1 -- 172.21.15.37:0/2740809780 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed601a69d0 con 0x7fed601008d0 2024-09-19T06:05:14.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:14.191+0000 7fed5d7fa640 1 -- 172.21.15.37:0/2740809780 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed50003ad0 con 0x7fed601008d0 2024-09-19T06:05:14.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:14.191+0000 7fed5d7fa640 1 -- 172.21.15.37:0/2740809780 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed50035070 con 0x7fed601008d0 2024-09-19T06:05:14.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:14.192+0000 7fed6539e640 1 -- 172.21.15.37:0/2740809780 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed601a6f00 con 0x7fed601008d0 2024-09-19T06:05:14.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:14.192+0000 7fed6539e640 1 -- 172.21.15.37:0/2740809780 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fed60062980 con 0x7fed601008d0 2024-09-19T06:05:14.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:14.194+0000 7fed5d7fa640 1 -- 172.21.15.37:0/2740809780 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fed50042030 con 0x7fed601008d0 2024-09-19T06:05:14.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:14.195+0000 7fed5d7fa640 1 --2- 172.21.15.37:0/2740809780 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fed480a32d0 0x7fed480a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:14.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:14.195+0000 7fed5d7fa640 1 -- 172.21.15.37:0/2740809780 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fed500f0290 con 0x7fed601008d0 2024-09-19T06:05:14.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:14.195+0000 7fed5f7fe640 1 --2- 172.21.15.37:0/2740809780 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fed480a32d0 0x7fed480a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:14.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:14.195+0000 7fed5d7fa640 1 --2- 172.21.15.37:0/2740809780 >> [v2:172.21.15.117:6800/3794943081,v1:172.21.15.117:6801/3794943081] conn(0x7fed480ae4a0 0x7fed480b0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:14.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:14.195+0000 7fed5d7fa640 1 -- 172.21.15.37:0/2740809780 --> [v2:172.21.15.117:6800/3794943081,v1:172.21.15.117:6801/3794943081] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fed480b1010 con 0x7fed480ae4a0 2024-09-19T06:05:14.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:14.195+0000 7fed5d7fa640 1 -- 172.21.15.37:0/2740809780 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7fed500f06e0 con 0x7fed601008d0 2024-09-19T06:05:14.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:14.195+0000 7fed5f7fe640 1 --2- 172.21.15.37:0/2740809780 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fed480a32d0 0x7fed480a5790 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fed60199030 tx=0x7fed5400b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:14.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:14.196+0000 7fed64b9d640 1 --2- 172.21.15.37:0/2740809780 >> [v2:172.21.15.117:6800/3794943081,v1:172.21.15.117:6801/3794943081] conn(0x7fed480ae4a0 0x7fed480b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:14.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:14.196+0000 7fed64b9d640 1 --2- 172.21.15.37:0/2740809780 >> [v2:172.21.15.117:6800/3794943081,v1:172.21.15.117:6801/3794943081] conn(0x7fed480ae4a0 0x7fed480b0940 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:14.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:14.197+0000 7fed5d7fa640 1 -- 172.21.15.37:0/2740809780 <== osd.2 v2:172.21.15.117:6800/3794943081 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fed480b1010 con 0x7fed480ae4a0 2024-09-19T06:05:14.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:14.211+0000 7fed6539e640 1 -- 172.21.15.37:0/2740809780 --> [v2:172.21.15.117:6800/3794943081,v1:172.21.15.117:6801/3794943081] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fed60062d80 con 0x7fed480ae4a0 2024-09-19T06:05:14.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:14.212+0000 7fed5d7fa640 1 -- 172.21.15.37:0/2740809780 <== osd.2 v2:172.21.15.117:6800/3794943081 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fed60062d80 con 0x7fed480ae4a0 2024-09-19T06:05:14.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:14.212+0000 7fed6539e640 1 -- 172.21.15.37:0/2740809780 >> [v2:172.21.15.117:6800/3794943081,v1:172.21.15.117:6801/3794943081] conn(0x7fed480ae4a0 msgr2=0x7fed480b0940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:14.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:14.212+0000 7fed6539e640 1 --2- 172.21.15.37:0/2740809780 >> [v2:172.21.15.117:6800/3794943081,v1:172.21.15.117:6801/3794943081] conn(0x7fed480ae4a0 0x7fed480b0940 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:14.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:14.212+0000 7fed6539e640 1 -- 172.21.15.37:0/2740809780 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fed480a32d0 msgr2=0x7fed480a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:14.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:14.212+0000 7fed6539e640 1 --2- 172.21.15.37:0/2740809780 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fed480a32d0 0x7fed480a5790 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fed60199030 tx=0x7fed5400b410 comp rx=0 tx=0).stop 2024-09-19T06:05:14.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:14.212+0000 7fed6539e640 1 -- 172.21.15.37:0/2740809780 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed601008d0 msgr2=0x7fed60196ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:14.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:14.212+0000 7fed6539e640 1 --2- 172.21.15.37:0/2740809780 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed601008d0 0x7fed60196ed0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fed50009230 tx=0x7fed50004270 comp rx=0 tx=0).stop 2024-09-19T06:05:14.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:14.212+0000 7fed64b9d640 1 -- 172.21.15.37:0/2740809780 reap_dead start 2024-09-19T06:05:14.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:14.212+0000 7fed6539e640 1 -- 172.21.15.37:0/2740809780 shutdown_connections 2024-09-19T06:05:14.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:14.212+0000 7fed6539e640 1 -- 172.21.15.37:0/2740809780 >> 172.21.15.37:0/2740809780 conn(0x7fed600fc610 msgr2=0x7fed600fce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:14.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:14.212+0000 7fed6539e640 1 -- 172.21.15.37:0/2740809780 shutdown_connections 2024-09-19T06:05:14.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:14.213+0000 7fed6539e640 1 -- 172.21.15.37:0/2740809780 wait complete. 2024-09-19T06:05:14.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:14 smithi117 ceph-mon[35050]: osdmap e89: 12 total, 12 up, 12 in 2024-09-19T06:05:15.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:14 smithi037 ceph-mon[31211]: osdmap e89: 12 total, 12 up, 12 in 2024-09-19T06:05:15.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:14 smithi099 ceph-mon[35300]: osdmap e89: 12 total, 12 up, 12 in 2024-09-19T06:05:15.627 INFO:teuthology.orchestra.run.smithi037.stdout:270582939685 2024-09-19T06:05:15.628 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-19T06:05:15.755 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:15 smithi037 ceph-mon[31211]: pgmap v320: 129 pgs: 1 peering, 128 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-09-19T06:05:16.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:15 smithi117 ceph-mon[35050]: pgmap v320: 129 pgs: 1 peering, 128 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-09-19T06:05:16.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:15 smithi099 ceph-mon[35300]: pgmap v320: 129 pgs: 1 peering, 128 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-09-19T06:05:16.219 INFO:teuthology.orchestra.run.smithi037.stdout:107374182466 2024-09-19T06:05:16.220 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-19T06:05:16.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:16.497+0000 7fe8932de640 1 -- 172.21.15.37:0/1082934878 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe88c102790 msgr2=0x7fe88c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:16.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:16.497+0000 7fe8932de640 1 --2- 172.21.15.37:0/1082934878 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe88c102790 0x7fe88c1067e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe87c009900 tx=0x7fe87c02a410 comp rx=0 tx=0).stop 2024-09-19T06:05:16.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:16.497+0000 7fe8932de640 1 -- 172.21.15.37:0/1082934878 shutdown_connections 2024-09-19T06:05:16.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:16.497+0000 7fe8932de640 1 --2- 172.21.15.37:0/1082934878 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe88c106f10 0x7fe88c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:16.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:16.497+0000 7fe8932de640 1 --2- 172.21.15.37:0/1082934878 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe88c102790 0x7fe88c1067e0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:16.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:16.497+0000 7fe8932de640 1 --2- 172.21.15.37:0/1082934878 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe88c101de0 0x7fe88c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:16.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:16.497+0000 7fe8932de640 1 -- 172.21.15.37:0/1082934878 >> 172.21.15.37:0/1082934878 conn(0x7fe88c0fd8c0 msgr2=0x7fe88c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:16.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:16.497+0000 7fe8932de640 1 -- 172.21.15.37:0/1082934878 shutdown_connections 2024-09-19T06:05:16.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:16.497+0000 7fe8932de640 1 -- 172.21.15.37:0/1082934878 wait complete. 2024-09-19T06:05:16.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:16.498+0000 7fe8932de640 1 Processor -- start 2024-09-19T06:05:16.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:16.498+0000 7fe8932de640 1 -- start start 2024-09-19T06:05:16.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:16.498+0000 7fe8932de640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe88c101de0 0x7fe88c198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:16.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:16.498+0000 7fe8932de640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe88c102790 0x7fe88c198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:16.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:16.498+0000 7fe8932de640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe88c106f10 0x7fe88c19cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:16.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:16.498+0000 7fe8932de640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe88c111f90 con 0x7fe88c102790 2024-09-19T06:05:16.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:16.498+0000 7fe8932de640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fe88c111e10 con 0x7fe88c101de0 2024-09-19T06:05:16.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:16.498+0000 7fe8932de640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe88c112110 con 0x7fe88c106f10 2024-09-19T06:05:16.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:16.499+0000 7fe890879640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe88c102790 0x7fe88c198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:16.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:16.499+0000 7fe890879640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe88c102790 0x7fe88c198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34526/0 (socket says 172.21.15.37:34526) 2024-09-19T06:05:16.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:16.499+0000 7fe890879640 1 -- 172.21.15.37:0/2449447840 learned_addr learned my addr 172.21.15.37:0/2449447840 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:05:16.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:16.499+0000 7fe89107a640 1 --2- 172.21.15.37:0/2449447840 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe88c101de0 0x7fe88c198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:16.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:16.499+0000 7fe89187b640 1 --2- 172.21.15.37:0/2449447840 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe88c106f10 0x7fe88c19cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:16.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:16.499+0000 7fe890879640 1 -- 172.21.15.37:0/2449447840 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe88c106f10 msgr2=0x7fe88c19cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:16.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:16.499+0000 7fe890879640 1 --2- 172.21.15.37:0/2449447840 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe88c106f10 0x7fe88c19cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:16.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:16.499+0000 7fe890879640 1 -- 172.21.15.37:0/2449447840 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe88c101de0 msgr2=0x7fe88c198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:16.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:16.499+0000 7fe890879640 1 --2- 172.21.15.37:0/2449447840 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe88c101de0 0x7fe88c198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:16.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:16.499+0000 7fe890879640 1 -- 172.21.15.37:0/2449447840 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe88c19d3e0 con 0x7fe88c102790 2024-09-19T06:05:16.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:16.499+0000 7fe89187b640 1 --2- 172.21.15.37:0/2449447840 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe88c106f10 0x7fe88c19cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:05:16.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:16.499+0000 7fe890879640 1 --2- 172.21.15.37:0/2449447840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe88c102790 0x7fe88c198970 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe87c005ab0 tx=0x7fe87c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:16.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:16.499+0000 7fe8827fc640 1 -- 172.21.15.37:0/2449447840 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe87c03f030 con 0x7fe88c102790 2024-09-19T06:05:16.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:16.499+0000 7fe8932de640 1 -- 172.21.15.37:0/2449447840 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe88c19d670 con 0x7fe88c102790 2024-09-19T06:05:16.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:16.499+0000 7fe8827fc640 1 -- 172.21.15.37:0/2449447840 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe87c003ce0 con 0x7fe88c102790 2024-09-19T06:05:16.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:16.499+0000 7fe8827fc640 1 -- 172.21.15.37:0/2449447840 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe87c035070 con 0x7fe88c102790 2024-09-19T06:05:16.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:16.499+0000 7fe8932de640 1 -- 172.21.15.37:0/2449447840 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe88c1a4fb0 con 0x7fe88c102790 2024-09-19T06:05:16.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:16.500+0000 7fe8932de640 1 -- 172.21.15.37:0/2449447840 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe88c062980 con 0x7fe88c102790 2024-09-19T06:05:16.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:16.502+0000 7fe8827fc640 1 -- 172.21.15.37:0/2449447840 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fe87c042030 con 0x7fe88c102790 2024-09-19T06:05:16.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:16.502+0000 7fe8827fc640 1 --2- 172.21.15.37:0/2449447840 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fe8780a32d0 0x7fe8780a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:16.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:16.502+0000 7fe89107a640 1 --2- 172.21.15.37:0/2449447840 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fe8780a32d0 0x7fe8780a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:16.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:16.502+0000 7fe8827fc640 1 -- 172.21.15.37:0/2449447840 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fe87c0f0ac0 con 0x7fe88c102790 2024-09-19T06:05:16.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:16.502+0000 7fe8827fc640 1 --2- 172.21.15.37:0/2449447840 >> [v2:172.21.15.37:6818/770433145,v1:172.21.15.37:6819/770433145] conn(0x7fe8780ae4a0 0x7fe8780b0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:16.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:16.503+0000 7fe8827fc640 1 -- 172.21.15.37:0/2449447840 --> [v2:172.21.15.37:6818/770433145,v1:172.21.15.37:6819/770433145] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe8780b1010 con 0x7fe8780ae4a0 2024-09-19T06:05:16.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:16.503+0000 7fe8827fc640 1 -- 172.21.15.37:0/2449447840 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7fe87c0f0e70 con 0x7fe88c102790 2024-09-19T06:05:16.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:16.503+0000 7fe89187b640 1 --2- 172.21.15.37:0/2449447840 >> [v2:172.21.15.37:6818/770433145,v1:172.21.15.37:6819/770433145] conn(0x7fe8780ae4a0 0x7fe8780b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:16.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:16.503+0000 7fe89107a640 1 --2- 172.21.15.37:0/2449447840 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fe8780a32d0 0x7fe8780a5790 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe888009990 tx=0x7fe888009110 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:16.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:16.503+0000 7fe89187b640 1 --2- 172.21.15.37:0/2449447840 >> [v2:172.21.15.37:6818/770433145,v1:172.21.15.37:6819/770433145] conn(0x7fe8780ae4a0 0x7fe8780b0940 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:16.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:16.504+0000 7fe8827fc640 1 -- 172.21.15.37:0/2449447840 <== osd.6 v2:172.21.15.37:6818/770433145 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe8780b1010 con 0x7fe8780ae4a0 2024-09-19T06:05:16.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:16.518+0000 7fe8932de640 1 -- 172.21.15.37:0/2449447840 --> [v2:172.21.15.37:6818/770433145,v1:172.21.15.37:6819/770433145] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe88c062e00 con 0x7fe8780ae4a0 2024-09-19T06:05:16.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:16.518+0000 7fe8827fc640 1 -- 172.21.15.37:0/2449447840 <== osd.6 v2:172.21.15.37:6818/770433145 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fe88c062e00 con 0x7fe8780ae4a0 2024-09-19T06:05:16.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:16.518+0000 7fe8932de640 1 -- 172.21.15.37:0/2449447840 >> [v2:172.21.15.37:6818/770433145,v1:172.21.15.37:6819/770433145] conn(0x7fe8780ae4a0 msgr2=0x7fe8780b0940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:16.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:16.518+0000 7fe8932de640 1 --2- 172.21.15.37:0/2449447840 >> [v2:172.21.15.37:6818/770433145,v1:172.21.15.37:6819/770433145] conn(0x7fe8780ae4a0 0x7fe8780b0940 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:16.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:16.518+0000 7fe8932de640 1 -- 172.21.15.37:0/2449447840 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fe8780a32d0 msgr2=0x7fe8780a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:16.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:16.518+0000 7fe8932de640 1 --2- 172.21.15.37:0/2449447840 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fe8780a32d0 0x7fe8780a5790 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe888009990 tx=0x7fe888009110 comp rx=0 tx=0).stop 2024-09-19T06:05:16.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:16.518+0000 7fe8932de640 1 -- 172.21.15.37:0/2449447840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe88c102790 msgr2=0x7fe88c198970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:16.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:16.518+0000 7fe8932de640 1 --2- 172.21.15.37:0/2449447840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe88c102790 0x7fe88c198970 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe87c005ab0 tx=0x7fe87c0042f0 comp rx=0 tx=0).stop 2024-09-19T06:05:16.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:16.518+0000 7fe89187b640 1 -- 172.21.15.37:0/2449447840 reap_dead start 2024-09-19T06:05:16.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:16.518+0000 7fe8932de640 1 -- 172.21.15.37:0/2449447840 shutdown_connections 2024-09-19T06:05:16.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:16.518+0000 7fe8932de640 1 -- 172.21.15.37:0/2449447840 >> 172.21.15.37:0/2449447840 conn(0x7fe88c0fd8c0 msgr2=0x7fe88c0fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:16.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:16.519+0000 7fe8932de640 1 -- 172.21.15.37:0/2449447840 shutdown_connections 2024-09-19T06:05:16.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:16.519+0000 7fe8932de640 1 -- 172.21.15.37:0/2449447840 wait complete. 2024-09-19T06:05:17.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:16 smithi037 ceph-mon[31211]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-19T06:05:17.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:16 smithi099 ceph-mon[35300]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-19T06:05:17.218 INFO:teuthology.orchestra.run.smithi037.stdout:34359738451 2024-09-19T06:05:17.218 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-19T06:05:17.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:16 smithi117 ceph-mon[35050]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-19T06:05:17.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:17.550+0000 7f2cd9075640 1 -- 172.21.15.37:0/3031087466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2cd4101420 msgr2=0x7f2cd410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:17.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:17.550+0000 7f2cd9075640 1 --2- 172.21.15.37:0/3031087466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2cd4101420 0x7f2cd410d950 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc009cd0 tx=0x7f2ccc02a8e0 comp rx=0 tx=0).stop 2024-09-19T06:05:17.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:17.550+0000 7f2cd9075640 1 -- 172.21.15.37:0/3031087466 shutdown_connections 2024-09-19T06:05:17.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:17.550+0000 7f2cd9075640 1 --2- 172.21.15.37:0/3031087466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2cd4101420 0x7f2cd410d950 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:17.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:17.550+0000 7f2cd9075640 1 --2- 172.21.15.37:0/3031087466 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2cd4100a80 0x7f2cd4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:17.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:17.550+0000 7f2cd9075640 1 --2- 172.21.15.37:0/3031087466 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cd4106a80 0x7f2cd4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:17.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:17.550+0000 7f2cd9075640 1 -- 172.21.15.37:0/3031087466 >> 172.21.15.37:0/3031087466 conn(0x7f2cd40fc7a0 msgr2=0x7f2cd40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:17.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:17.550+0000 7f2cd9075640 1 -- 172.21.15.37:0/3031087466 shutdown_connections 2024-09-19T06:05:17.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:17.550+0000 7f2cd9075640 1 -- 172.21.15.37:0/3031087466 wait complete. 2024-09-19T06:05:17.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:17.551+0000 7f2cd9075640 1 Processor -- start 2024-09-19T06:05:17.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:17.551+0000 7f2cd9075640 1 -- start start 2024-09-19T06:05:17.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:17.552+0000 7f2cd9075640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cd4100a80 0x7f2cd419a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:17.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:17.552+0000 7f2cd9075640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2cd4101420 0x7f2cd419aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:17.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:17.552+0000 7f2cd9075640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2cd4106a80 0x7f2cd419ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:17.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:17.552+0000 7f2cd9075640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd4110e80 con 0x7f2cd4106a80 2024-09-19T06:05:17.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:17.552+0000 7f2cd9075640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd4110d00 con 0x7f2cd4100a80 2024-09-19T06:05:17.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:17.552+0000 7f2cd9075640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd4111000 con 0x7f2cd4101420 2024-09-19T06:05:17.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:17.552+0000 7f2cd359e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2cd4106a80 0x7f2cd419ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:17.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:17.552+0000 7f2cd359e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2cd4106a80 0x7f2cd419ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34534/0 (socket says 172.21.15.37:34534) 2024-09-19T06:05:17.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:17.552+0000 7f2cd359e640 1 -- 172.21.15.37:0/4264846415 learned_addr learned my addr 172.21.15.37:0/4264846415 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:05:17.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:17.552+0000 7f2cd2d9d640 1 --2- 172.21.15.37:0/4264846415 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cd4100a80 0x7f2cd419a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:17.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:17.552+0000 7f2cd259c640 1 --2- 172.21.15.37:0/4264846415 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2cd4101420 0x7f2cd419aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:17.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:17.552+0000 7f2cd359e640 1 -- 172.21.15.37:0/4264846415 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2cd4101420 msgr2=0x7f2cd419aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:17.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:17.552+0000 7f2cd359e640 1 --2- 172.21.15.37:0/4264846415 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2cd4101420 0x7f2cd419aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:17.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:17.552+0000 7f2cd359e640 1 -- 172.21.15.37:0/4264846415 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cd4100a80 msgr2=0x7f2cd419a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:17.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:17.552+0000 7f2cd359e640 1 --2- 172.21.15.37:0/4264846415 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cd4100a80 0x7f2cd419a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:17.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:17.552+0000 7f2cd359e640 1 -- 172.21.15.37:0/4264846415 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cd419f510 con 0x7f2cd4106a80 2024-09-19T06:05:17.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:17.552+0000 7f2cd359e640 1 --2- 172.21.15.37:0/4264846415 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2cd4106a80 0x7f2cd419ee30 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc005cc0 tx=0x7f2ccc003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:17.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:17.552+0000 7f2cbbfff640 1 -- 172.21.15.37:0/4264846415 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ccc004040 con 0x7f2cd4106a80 2024-09-19T06:05:17.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:17.552+0000 7f2cd9075640 1 -- 172.21.15.37:0/4264846415 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cd419f7a0 con 0x7f2cd4106a80 2024-09-19T06:05:17.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:17.552+0000 7f2cbbfff640 1 -- 172.21.15.37:0/4264846415 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ccc0046c0 con 0x7f2cd4106a80 2024-09-19T06:05:17.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:17.552+0000 7f2cbbfff640 1 -- 172.21.15.37:0/4264846415 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ccc030e70 con 0x7f2cd4106a80 2024-09-19T06:05:17.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:17.553+0000 7f2cd9075640 1 -- 172.21.15.37:0/4264846415 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cd41a70e0 con 0x7f2cd4106a80 2024-09-19T06:05:17.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:17.553+0000 7f2cd9075640 1 -- 172.21.15.37:0/4264846415 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2cd406b170 con 0x7f2cd4106a80 2024-09-19T06:05:17.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:17.555+0000 7f2cbbfff640 1 -- 172.21.15.37:0/4264846415 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f2ccc0305a0 con 0x7f2cd4106a80 2024-09-19T06:05:17.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:17.555+0000 7f2cbbfff640 1 --2- 172.21.15.37:0/4264846415 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f2cbc0a32d0 0x7f2cbc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:17.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:17.555+0000 7f2cbbfff640 1 -- 172.21.15.37:0/4264846415 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f2ccc02e030 con 0x7f2cd4106a80 2024-09-19T06:05:17.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:17.555+0000 7f2cd2d9d640 1 --2- 172.21.15.37:0/4264846415 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f2cbc0a32d0 0x7f2cbc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:17.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:17.556+0000 7f2cbbfff640 1 --2- 172.21.15.37:0/4264846415 >> [v2:172.21.15.99:6816/1694360992,v1:172.21.15.99:6817/1694360992] conn(0x7f2cbc0ae4a0 0x7f2cbc0b0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:17.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:17.556+0000 7f2cbbfff640 1 -- 172.21.15.37:0/4264846415 --> [v2:172.21.15.99:6816/1694360992,v1:172.21.15.99:6817/1694360992] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2cbc0b1010 con 0x7f2cbc0ae4a0 2024-09-19T06:05:17.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:17.556+0000 7f2cbbfff640 1 -- 172.21.15.37:0/4264846415 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f2ccc0f1630 con 0x7f2cd4106a80 2024-09-19T06:05:17.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:17.556+0000 7f2cd2d9d640 1 --2- 172.21.15.37:0/4264846415 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f2cbc0a32d0 0x7f2cbc0a5790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2cc400ab60 tx=0x7f2cc400a2d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:17.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:17.556+0000 7f2cd259c640 1 --2- 172.21.15.37:0/4264846415 >> [v2:172.21.15.99:6816/1694360992,v1:172.21.15.99:6817/1694360992] conn(0x7f2cbc0ae4a0 0x7f2cbc0b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:17.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:17.556+0000 7f2cd259c640 1 --2- 172.21.15.37:0/4264846415 >> [v2:172.21.15.99:6816/1694360992,v1:172.21.15.99:6817/1694360992] conn(0x7f2cbc0ae4a0 0x7f2cbc0b0940 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:17.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:17.557+0000 7f2cbbfff640 1 -- 172.21.15.37:0/4264846415 <== osd.7 v2:172.21.15.99:6816/1694360992 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2cbc0b1010 con 0x7f2cbc0ae4a0 2024-09-19T06:05:17.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:17.571+0000 7f2cd9075640 1 -- 172.21.15.37:0/4264846415 --> [v2:172.21.15.99:6816/1694360992,v1:172.21.15.99:6817/1694360992] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2cd41021c0 con 0x7f2cbc0ae4a0 2024-09-19T06:05:17.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:17.571+0000 7f2cbbfff640 1 -- 172.21.15.37:0/4264846415 <== osd.7 v2:172.21.15.99:6816/1694360992 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f2cd41021c0 con 0x7f2cbc0ae4a0 2024-09-19T06:05:17.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:17.572+0000 7f2cd9075640 1 -- 172.21.15.37:0/4264846415 >> [v2:172.21.15.99:6816/1694360992,v1:172.21.15.99:6817/1694360992] conn(0x7f2cbc0ae4a0 msgr2=0x7f2cbc0b0940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:17.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:17.572+0000 7f2cd9075640 1 --2- 172.21.15.37:0/4264846415 >> [v2:172.21.15.99:6816/1694360992,v1:172.21.15.99:6817/1694360992] conn(0x7f2cbc0ae4a0 0x7f2cbc0b0940 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:17.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:17.572+0000 7f2cd9075640 1 -- 172.21.15.37:0/4264846415 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f2cbc0a32d0 msgr2=0x7f2cbc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:17.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:17.572+0000 7f2cd9075640 1 --2- 172.21.15.37:0/4264846415 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f2cbc0a32d0 0x7f2cbc0a5790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2cc400ab60 tx=0x7f2cc400a2d0 comp rx=0 tx=0).stop 2024-09-19T06:05:17.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:17.572+0000 7f2cd9075640 1 -- 172.21.15.37:0/4264846415 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2cd4106a80 msgr2=0x7f2cd419ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:17.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:17.572+0000 7f2cd9075640 1 --2- 172.21.15.37:0/4264846415 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2cd4106a80 0x7f2cd419ee30 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc005cc0 tx=0x7f2ccc003970 comp rx=0 tx=0).stop 2024-09-19T06:05:17.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:17.572+0000 7f2cd359e640 1 -- 172.21.15.37:0/4264846415 reap_dead start 2024-09-19T06:05:17.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:17.572+0000 7f2cd9075640 1 -- 172.21.15.37:0/4264846415 shutdown_connections 2024-09-19T06:05:17.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:17.572+0000 7f2cd9075640 1 -- 172.21.15.37:0/4264846415 >> 172.21.15.37:0/4264846415 conn(0x7f2cd40fc7a0 msgr2=0x7f2cd406a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:17.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:17.572+0000 7f2cd9075640 1 -- 172.21.15.37:0/4264846415 shutdown_connections 2024-09-19T06:05:17.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:17.572+0000 7f2cd9075640 1 -- 172.21.15.37:0/4264846415 wait complete. 2024-09-19T06:05:18.055 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:17 smithi037 ceph-mon[31211]: pgmap v321: 129 pgs: 1 peering, 128 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-09-19T06:05:18.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:17 smithi099 ceph-mon[35300]: pgmap v321: 129 pgs: 1 peering, 128 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-09-19T06:05:18.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:17 smithi117 ceph-mon[35050]: pgmap v321: 129 pgs: 1 peering, 128 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-09-19T06:05:18.385 INFO:teuthology.orchestra.run.smithi037.stdout:210453397552 2024-09-19T06:05:18.386 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-19T06:05:19.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:18 smithi037 ceph-mon[31211]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-19T06:05:19.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:18 smithi037 ceph-mon[31211]: Cluster is now healthy 2024-09-19T06:05:19.128 INFO:teuthology.orchestra.run.smithi037.stdout:240518168617 2024-09-19T06:05:19.129 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-19T06:05:19.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:18 smithi099 ceph-mon[35300]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-19T06:05:19.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:18 smithi099 ceph-mon[35300]: Cluster is now healthy 2024-09-19T06:05:19.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:18 smithi117 ceph-mon[35050]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-19T06:05:19.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:18 smithi117 ceph-mon[35050]: Cluster is now healthy 2024-09-19T06:05:19.483 INFO:teuthology.orchestra.run.smithi037.stdout:77309411401 2024-09-19T06:05:19.483 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-19T06:05:19.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:19.673+0000 7fa4e13b4640 1 -- 172.21.15.37:0/4110635129 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4dc106a60 msgr2=0x7fa4dc106e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:19.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:19.673+0000 7fa4e13b4640 1 --2- 172.21.15.37:0/4110635129 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4dc106a60 0x7fa4dc106e40 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa4d4009cd0 tx=0x7fa4d402a8f0 comp rx=0 tx=0).stop 2024-09-19T06:05:19.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:19.673+0000 7fa4e13b4640 1 -- 172.21.15.37:0/4110635129 shutdown_connections 2024-09-19T06:05:19.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:19.673+0000 7fa4e13b4640 1 --2- 172.21.15.37:0/4110635129 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa4dc101400 0x7fa4dc10d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:19.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:19.673+0000 7fa4e13b4640 1 --2- 172.21.15.37:0/4110635129 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4dc100a60 0x7fa4dc100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:19.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:19.673+0000 7fa4e13b4640 1 --2- 172.21.15.37:0/4110635129 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4dc106a60 0x7fa4dc106e40 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:19.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:19.673+0000 7fa4e13b4640 1 -- 172.21.15.37:0/4110635129 >> 172.21.15.37:0/4110635129 conn(0x7fa4dc0fc780 msgr2=0x7fa4dc0feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:19.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:19.673+0000 7fa4e13b4640 1 -- 172.21.15.37:0/4110635129 shutdown_connections 2024-09-19T06:05:19.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:19.673+0000 7fa4e13b4640 1 -- 172.21.15.37:0/4110635129 wait complete. 2024-09-19T06:05:19.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:19.674+0000 7fa4e13b4640 1 Processor -- start 2024-09-19T06:05:19.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:19.674+0000 7fa4e13b4640 1 -- start start 2024-09-19T06:05:19.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:19.674+0000 7fa4e13b4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4dc100a60 0x7fa4dc198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:19.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:19.674+0000 7fa4e13b4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4dc101400 0x7fa4dc198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:19.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:19.674+0000 7fa4e13b4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa4dc106a60 0x7fa4dc19cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:19.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:19.674+0000 7fa4e13b4640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa4dc110e60 con 0x7fa4dc101400 2024-09-19T06:05:19.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:19.674+0000 7fa4e13b4640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fa4dc110ce0 con 0x7fa4dc106a60 2024-09-19T06:05:19.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:19.674+0000 7fa4e13b4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa4dc110fe0 con 0x7fa4dc100a60 2024-09-19T06:05:19.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:19.674+0000 7fa4da7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4dc101400 0x7fa4dc198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:19.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:19.674+0000 7fa4da7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4dc101400 0x7fa4dc198960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34548/0 (socket says 172.21.15.37:34548) 2024-09-19T06:05:19.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:19.674+0000 7fa4da7fc640 1 -- 172.21.15.37:0/3921962785 learned_addr learned my addr 172.21.15.37:0/3921962785 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:05:19.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:19.674+0000 7fa4daffd640 1 --2- 172.21.15.37:0/3921962785 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4dc100a60 0x7fa4dc198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:19.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:19.674+0000 7fa4db7fe640 1 --2- 172.21.15.37:0/3921962785 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa4dc106a60 0x7fa4dc19cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:19.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:19.674+0000 7fa4da7fc640 1 -- 172.21.15.37:0/3921962785 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4dc100a60 msgr2=0x7fa4dc198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:19.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:19.674+0000 7fa4da7fc640 1 --2- 172.21.15.37:0/3921962785 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4dc100a60 0x7fa4dc198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:19.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:19.674+0000 7fa4da7fc640 1 -- 172.21.15.37:0/3921962785 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa4dc106a60 msgr2=0x7fa4dc19cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:19.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:19.674+0000 7fa4da7fc640 1 --2- 172.21.15.37:0/3921962785 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa4dc106a60 0x7fa4dc19cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:19.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:19.674+0000 7fa4da7fc640 1 -- 172.21.15.37:0/3921962785 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4dc19d330 con 0x7fa4dc101400 2024-09-19T06:05:19.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:19.674+0000 7fa4db7fe640 1 --2- 172.21.15.37:0/3921962785 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa4dc106a60 0x7fa4dc19cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:05:19.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:19.675+0000 7fa4da7fc640 1 --2- 172.21.15.37:0/3921962785 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4dc101400 0x7fa4dc198960 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fa4c400c920 tx=0x7fa4c400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:19.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:19.675+0000 7fa4d3fff640 1 -- 172.21.15.37:0/3921962785 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c4007c70 con 0x7fa4dc101400 2024-09-19T06:05:19.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:19.675+0000 7fa4e13b4640 1 -- 172.21.15.37:0/3921962785 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4dc19d620 con 0x7fa4dc101400 2024-09-19T06:05:19.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:19.675+0000 7fa4d3fff640 1 -- 172.21.15.37:0/3921962785 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4c4007e10 con 0x7fa4dc101400 2024-09-19T06:05:19.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:19.675+0000 7fa4d3fff640 1 -- 172.21.15.37:0/3921962785 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c4018890 con 0x7fa4dc101400 2024-09-19T06:05:19.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:19.675+0000 7fa4e13b4640 1 -- 172.21.15.37:0/3921962785 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4dc1a4f00 con 0x7fa4dc101400 2024-09-19T06:05:19.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:19.676+0000 7fa4e13b4640 1 -- 172.21.15.37:0/3921962785 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa4dc06b250 con 0x7fa4dc101400 2024-09-19T06:05:19.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:19.677+0000 7fa4d3fff640 1 -- 172.21.15.37:0/3921962785 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fa4c4018a50 con 0x7fa4dc101400 2024-09-19T06:05:19.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:19.678+0000 7fa4d3fff640 1 --2- 172.21.15.37:0/3921962785 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fa4c80a32d0 0x7fa4c80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:19.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:19.678+0000 7fa4daffd640 1 --2- 172.21.15.37:0/3921962785 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fa4c80a32d0 0x7fa4c80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:19.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:19.678+0000 7fa4d3fff640 1 -- 172.21.15.37:0/3921962785 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fa4c40d0350 con 0x7fa4dc101400 2024-09-19T06:05:19.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:19.678+0000 7fa4d3fff640 1 --2- 172.21.15.37:0/3921962785 >> [v2:172.21.15.99:6808/1881025735,v1:172.21.15.99:6809/1881025735] conn(0x7fa4c80ae4a0 0x7fa4c80b0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:19.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:19.678+0000 7fa4d3fff640 1 -- 172.21.15.37:0/3921962785 --> [v2:172.21.15.99:6808/1881025735,v1:172.21.15.99:6809/1881025735] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa4c80b1010 con 0x7fa4c80ae4a0 2024-09-19T06:05:19.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:19.678+0000 7fa4d3fff640 1 -- 172.21.15.37:0/3921962785 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7fa4c40d0830 con 0x7fa4dc101400 2024-09-19T06:05:19.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:19.678+0000 7fa4daffd640 1 --2- 172.21.15.37:0/3921962785 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fa4c80a32d0 0x7fa4c80a5790 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa4d4009a60 tx=0x7fa4d40093f0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:19.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:19.678+0000 7fa4db7fe640 1 --2- 172.21.15.37:0/3921962785 >> [v2:172.21.15.99:6808/1881025735,v1:172.21.15.99:6809/1881025735] conn(0x7fa4c80ae4a0 0x7fa4c80b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:19.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:19.679+0000 7fa4db7fe640 1 --2- 172.21.15.37:0/3921962785 >> [v2:172.21.15.99:6808/1881025735,v1:172.21.15.99:6809/1881025735] conn(0x7fa4c80ae4a0 0x7fa4c80b0940 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:19.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:19.680+0000 7fa4d3fff640 1 -- 172.21.15.37:0/3921962785 <== osd.4 v2:172.21.15.99:6808/1881025735 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa4c80b1010 con 0x7fa4c80ae4a0 2024-09-19T06:05:19.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:19.693+0000 7fa4e13b4640 1 -- 172.21.15.37:0/3921962785 --> [v2:172.21.15.99:6808/1881025735,v1:172.21.15.99:6809/1881025735] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa4dc1021a0 con 0x7fa4c80ae4a0 2024-09-19T06:05:19.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:19.694+0000 7fa4d3fff640 1 -- 172.21.15.37:0/3921962785 <== osd.4 v2:172.21.15.99:6808/1881025735 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fa4dc1021a0 con 0x7fa4c80ae4a0 2024-09-19T06:05:19.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:19.694+0000 7fa4e13b4640 1 -- 172.21.15.37:0/3921962785 >> [v2:172.21.15.99:6808/1881025735,v1:172.21.15.99:6809/1881025735] conn(0x7fa4c80ae4a0 msgr2=0x7fa4c80b0940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:19.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:19.694+0000 7fa4e13b4640 1 --2- 172.21.15.37:0/3921962785 >> [v2:172.21.15.99:6808/1881025735,v1:172.21.15.99:6809/1881025735] conn(0x7fa4c80ae4a0 0x7fa4c80b0940 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:19.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:19.694+0000 7fa4e13b4640 1 -- 172.21.15.37:0/3921962785 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fa4c80a32d0 msgr2=0x7fa4c80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:19.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:19.694+0000 7fa4e13b4640 1 --2- 172.21.15.37:0/3921962785 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fa4c80a32d0 0x7fa4c80a5790 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa4d4009a60 tx=0x7fa4d40093f0 comp rx=0 tx=0).stop 2024-09-19T06:05:19.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:19.694+0000 7fa4e13b4640 1 -- 172.21.15.37:0/3921962785 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4dc101400 msgr2=0x7fa4dc198960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:19.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:19.694+0000 7fa4e13b4640 1 --2- 172.21.15.37:0/3921962785 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4dc101400 0x7fa4dc198960 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fa4c400c920 tx=0x7fa4c400cde0 comp rx=0 tx=0).stop 2024-09-19T06:05:19.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:19.694+0000 7fa4db7fe640 1 -- 172.21.15.37:0/3921962785 reap_dead start 2024-09-19T06:05:19.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:19.695+0000 7fa4e13b4640 1 -- 172.21.15.37:0/3921962785 shutdown_connections 2024-09-19T06:05:19.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:19.695+0000 7fa4e13b4640 1 -- 172.21.15.37:0/3921962785 >> 172.21.15.37:0/3921962785 conn(0x7fa4dc0fc780 msgr2=0x7fa4dc06a830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:19.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:19.695+0000 7fa4e13b4640 1 -- 172.21.15.37:0/3921962785 shutdown_connections 2024-09-19T06:05:19.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:19.695+0000 7fa4e13b4640 1 -- 172.21.15.37:0/3921962785 wait complete. 2024-09-19T06:05:20.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:19 smithi037 ceph-mon[31211]: pgmap v322: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-09-19T06:05:20.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:19 smithi099 ceph-mon[35300]: pgmap v322: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-09-19T06:05:20.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:19 smithi117 ceph-mon[35050]: pgmap v322: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-09-19T06:05:20.351 INFO:teuthology.orchestra.run.smithi037.stdout:137438953535 2024-09-19T06:05:20.352 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-19T06:05:20.487 INFO:teuthology.orchestra.run.smithi037.stdout:188978561077 2024-09-19T06:05:20.487 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-19T06:05:20.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:20.689+0000 7f5b22958640 1 -- 172.21.15.37:0/721369312 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b1c101440 msgr2=0x7f5b1c10df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:20.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:20.689+0000 7f5b22958640 1 --2- 172.21.15.37:0/721369312 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b1c101440 0x7f5b1c10df30 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5b10009900 tx=0x7f5b1002a410 comp rx=0 tx=0).stop 2024-09-19T06:05:20.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:20.689+0000 7f5b22958640 1 -- 172.21.15.37:0/721369312 shutdown_connections 2024-09-19T06:05:20.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:20.690+0000 7f5b22958640 1 --2- 172.21.15.37:0/721369312 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b1c10e500 0x7f5b1c110910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:20.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:20.690+0000 7f5b22958640 1 --2- 172.21.15.37:0/721369312 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b1c101440 0x7f5b1c10df30 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:20.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:20.690+0000 7f5b22958640 1 --2- 172.21.15.37:0/721369312 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5b1c100b20 0x7f5b1c100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:20.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:20.690+0000 7f5b22958640 1 -- 172.21.15.37:0/721369312 >> 172.21.15.37:0/721369312 conn(0x7f5b1c0fc7d0 msgr2=0x7f5b1c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:20.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:20.690+0000 7f5b22958640 1 -- 172.21.15.37:0/721369312 shutdown_connections 2024-09-19T06:05:20.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:20.690+0000 7f5b22958640 1 -- 172.21.15.37:0/721369312 wait complete. 2024-09-19T06:05:20.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:20.690+0000 7f5b22958640 1 Processor -- start 2024-09-19T06:05:20.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:20.690+0000 7f5b22958640 1 -- start start 2024-09-19T06:05:20.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:20.691+0000 7f5b22958640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b1c100b20 0x7f5b1c1a0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:20.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:20.691+0000 7f5b22958640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b1c101440 0x7f5b1c1a0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:20.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:20.691+0000 7f5b22958640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5b1c10e500 0x7f5b1c19a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:20.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:20.691+0000 7f5b22958640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5b1c114250 con 0x7f5b1c100b20 2024-09-19T06:05:20.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:20.691+0000 7f5b22958640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f5b1c1140d0 con 0x7f5b1c10e500 2024-09-19T06:05:20.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:20.691+0000 7f5b22958640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5b1c1143d0 con 0x7f5b1c101440 2024-09-19T06:05:20.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:20.691+0000 7f5b1bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b1c100b20 0x7f5b1c1a0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:20.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:20.691+0000 7f5b1bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b1c100b20 0x7f5b1c1a0420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34554/0 (socket says 172.21.15.37:34554) 2024-09-19T06:05:20.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:20.691+0000 7f5b1bfff640 1 -- 172.21.15.37:0/1416832688 learned_addr learned my addr 172.21.15.37:0/1416832688 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:05:20.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:20.691+0000 7f5b1b7fe640 1 --2- 172.21.15.37:0/1416832688 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b1c101440 0x7f5b1c1a0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:20.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:20.691+0000 7f5b20ef5640 1 --2- 172.21.15.37:0/1416832688 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5b1c10e500 0x7f5b1c19a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:20.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:20.691+0000 7f5b1bfff640 1 -- 172.21.15.37:0/1416832688 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b1c101440 msgr2=0x7f5b1c1a0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:20.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:20.691+0000 7f5b1bfff640 1 --2- 172.21.15.37:0/1416832688 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5b1c101440 0x7f5b1c1a0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:20.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:20.691+0000 7f5b1bfff640 1 -- 172.21.15.37:0/1416832688 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5b1c10e500 msgr2=0x7f5b1c19a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:20.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:20.691+0000 7f5b1bfff640 1 --2- 172.21.15.37:0/1416832688 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5b1c10e500 0x7f5b1c19a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:20.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:20.691+0000 7f5b1bfff640 1 -- 172.21.15.37:0/1416832688 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b1c19ad10 con 0x7f5b1c100b20 2024-09-19T06:05:20.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:20.691+0000 7f5b20ef5640 1 --2- 172.21.15.37:0/1416832688 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5b1c10e500 0x7f5b1c19a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:05:20.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:20.691+0000 7f5b1bfff640 1 --2- 172.21.15.37:0/1416832688 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b1c100b20 0x7f5b1c1a0420 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c00d950 tx=0x7f5b0c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:20.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:20.691+0000 7f5b197fa640 1 -- 172.21.15.37:0/1416832688 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c017070 con 0x7f5b1c100b20 2024-09-19T06:05:20.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:20.691+0000 7f5b22958640 1 -- 172.21.15.37:0/1416832688 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b1c19b000 con 0x7f5b1c100b20 2024-09-19T06:05:20.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:20.692+0000 7f5b197fa640 1 -- 172.21.15.37:0/1416832688 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b0c009c30 con 0x7f5b1c100b20 2024-09-19T06:05:20.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:20.692+0000 7f5b22958640 1 -- 172.21.15.37:0/1416832688 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b1c1a72f0 con 0x7f5b1c100b20 2024-09-19T06:05:20.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:20.692+0000 7f5b197fa640 1 -- 172.21.15.37:0/1416832688 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c020060 con 0x7f5b1c100b20 2024-09-19T06:05:20.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:20.692+0000 7f5b22958640 1 -- 172.21.15.37:0/1416832688 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5b1c062980 con 0x7f5b1c100b20 2024-09-19T06:05:20.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:20.694+0000 7f5b197fa640 1 -- 172.21.15.37:0/1416832688 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f5b0c0109d0 con 0x7f5b1c100b20 2024-09-19T06:05:20.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:20.694+0000 7f5b197fa640 1 --2- 172.21.15.37:0/1416832688 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f5b040a32d0 0x7f5b040a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:20.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:20.695+0000 7f5b1b7fe640 1 --2- 172.21.15.37:0/1416832688 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f5b040a32d0 0x7f5b040a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:20.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:20.695+0000 7f5b197fa640 1 -- 172.21.15.37:0/1416832688 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f5b0c0cfe10 con 0x7f5b1c100b20 2024-09-19T06:05:20.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:20.695+0000 7f5b197fa640 1 --2- 172.21.15.37:0/1416832688 >> [v2:172.21.15.117:6824/1354423136,v1:172.21.15.117:6825/1354423136] conn(0x7f5b040ae4a0 0x7f5b040b0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:20.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:20.695+0000 7f5b197fa640 1 -- 172.21.15.37:0/1416832688 --> [v2:172.21.15.117:6824/1354423136,v1:172.21.15.117:6825/1354423136] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5b0c013e50 con 0x7f5b040ae4a0 2024-09-19T06:05:20.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:20.695+0000 7f5b197fa640 1 -- 172.21.15.37:0/1416832688 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f5b0c0d01c0 con 0x7f5b1c100b20 2024-09-19T06:05:20.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:20.695+0000 7f5b1b7fe640 1 --2- 172.21.15.37:0/1416832688 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f5b040a32d0 0x7f5b040a5790 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5b10004770 tx=0x7f5b100058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:20.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:20.695+0000 7f5b20ef5640 1 --2- 172.21.15.37:0/1416832688 >> [v2:172.21.15.117:6824/1354423136,v1:172.21.15.117:6825/1354423136] conn(0x7f5b040ae4a0 0x7f5b040b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:20.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:20.696+0000 7f5b20ef5640 1 --2- 172.21.15.37:0/1416832688 >> [v2:172.21.15.117:6824/1354423136,v1:172.21.15.117:6825/1354423136] conn(0x7f5b040ae4a0 0x7f5b040b0940 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:20.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:20.697+0000 7f5b197fa640 1 -- 172.21.15.37:0/1416832688 <== osd.11 v2:172.21.15.117:6824/1354423136 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5b0c013e50 con 0x7f5b040ae4a0 2024-09-19T06:05:20.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:20.710+0000 7f5b22958640 1 -- 172.21.15.37:0/1416832688 --> [v2:172.21.15.117:6824/1354423136,v1:172.21.15.117:6825/1354423136] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5b1c062e00 con 0x7f5b040ae4a0 2024-09-19T06:05:20.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:20.711+0000 7f5b197fa640 1 -- 172.21.15.37:0/1416832688 <== osd.11 v2:172.21.15.117:6824/1354423136 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5b1c062e00 con 0x7f5b040ae4a0 2024-09-19T06:05:20.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:20.711+0000 7f5b22958640 1 -- 172.21.15.37:0/1416832688 >> [v2:172.21.15.117:6824/1354423136,v1:172.21.15.117:6825/1354423136] conn(0x7f5b040ae4a0 msgr2=0x7f5b040b0940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:20.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:20.711+0000 7f5b22958640 1 --2- 172.21.15.37:0/1416832688 >> [v2:172.21.15.117:6824/1354423136,v1:172.21.15.117:6825/1354423136] conn(0x7f5b040ae4a0 0x7f5b040b0940 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:20.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:20.712+0000 7f5b22958640 1 -- 172.21.15.37:0/1416832688 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f5b040a32d0 msgr2=0x7f5b040a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:20.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:20.712+0000 7f5b22958640 1 --2- 172.21.15.37:0/1416832688 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f5b040a32d0 0x7f5b040a5790 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5b10004770 tx=0x7f5b100058d0 comp rx=0 tx=0).stop 2024-09-19T06:05:20.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:20.712+0000 7f5b22958640 1 -- 172.21.15.37:0/1416832688 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b1c100b20 msgr2=0x7f5b1c1a0420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:20.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:20.712+0000 7f5b22958640 1 --2- 172.21.15.37:0/1416832688 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b1c100b20 0x7f5b1c1a0420 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c00d950 tx=0x7f5b0c00de10 comp rx=0 tx=0).stop 2024-09-19T06:05:20.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:20.712+0000 7f5b20ef5640 1 -- 172.21.15.37:0/1416832688 reap_dead start 2024-09-19T06:05:20.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:20.712+0000 7f5b22958640 1 -- 172.21.15.37:0/1416832688 shutdown_connections 2024-09-19T06:05:20.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:20.712+0000 7f5b22958640 1 -- 172.21.15.37:0/1416832688 >> 172.21.15.37:0/1416832688 conn(0x7f5b1c0fc7d0 msgr2=0x7f5b1c10f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:20.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:20.712+0000 7f5b22958640 1 -- 172.21.15.37:0/1416832688 shutdown_connections 2024-09-19T06:05:20.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:20.712+0000 7f5b22958640 1 -- 172.21.15.37:0/1416832688 wait complete. 2024-09-19T06:05:20.976 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:05:21.511 INFO:teuthology.orchestra.run.smithi037.stdout:322122547229 2024-09-19T06:05:21.512 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-19T06:05:21.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:21.971+0000 7efe7d06c640 1 -- 172.21.15.37:0/1173027437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe78102d40 msgr2=0x7efe78103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:21.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:21.971+0000 7efe7d06c640 1 --2- 172.21.15.37:0/1173027437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe78102d40 0x7efe78103120 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7efe68009900 tx=0x7efe6802a480 comp rx=0 tx=0).stop 2024-09-19T06:05:21.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:21.971+0000 7efe7d06c640 1 -- 172.21.15.37:0/1173027437 shutdown_connections 2024-09-19T06:05:21.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:21.971+0000 7efe7d06c640 1 --2- 172.21.15.37:0/1173027437 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efe7810c170 0x7efe7810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:21.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:21.971+0000 7efe7d06c640 1 --2- 172.21.15.37:0/1173027437 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe78103660 0x7efe7810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:21.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:21.971+0000 7efe7d06c640 1 --2- 172.21.15.37:0/1173027437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe78102d40 0x7efe78103120 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:21.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:21.971+0000 7efe7d06c640 1 -- 172.21.15.37:0/1173027437 >> 172.21.15.37:0/1173027437 conn(0x7efe780fc7a0 msgr2=0x7efe780febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:21.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:21.971+0000 7efe7d06c640 1 -- 172.21.15.37:0/1173027437 shutdown_connections 2024-09-19T06:05:21.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:21.972+0000 7efe7d06c640 1 -- 172.21.15.37:0/1173027437 wait complete. 2024-09-19T06:05:21.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:21.972+0000 7efe7d06c640 1 Processor -- start 2024-09-19T06:05:21.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:21.973+0000 7efe7d06c640 1 -- start start 2024-09-19T06:05:21.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:21.973+0000 7efe7d06c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe78102d40 0x7efe781009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:21.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:21.973+0000 7efe7d06c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe78103660 0x7efe78100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:21.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:21.973+0000 7efe7d06c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efe7810c170 0x7efe78101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:21.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:21.973+0000 7efe7d06c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7efe78112030 con 0x7efe78102d40 2024-09-19T06:05:21.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:21.973+0000 7efe7d06c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7efe78111eb0 con 0x7efe7810c170 2024-09-19T06:05:21.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:21.973+0000 7efe7d06c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7efe781121b0 con 0x7efe78103660 2024-09-19T06:05:21.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:21.973+0000 7efe76d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe78102d40 0x7efe781009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:21.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:21.973+0000 7efe76d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe78102d40 0x7efe781009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34574/0 (socket says 172.21.15.37:34574) 2024-09-19T06:05:21.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:21.973+0000 7efe76d9d640 1 -- 172.21.15.37:0/2076162278 learned_addr learned my addr 172.21.15.37:0/2076162278 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:05:21.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:21.973+0000 7efe7759e640 1 --2- 172.21.15.37:0/2076162278 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efe7810c170 0x7efe78101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:21.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:21.973+0000 7efe7659c640 1 --2- 172.21.15.37:0/2076162278 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe78103660 0x7efe78100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:21.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:21.973+0000 7efe76d9d640 1 -- 172.21.15.37:0/2076162278 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe78103660 msgr2=0x7efe78100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:21.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:21.973+0000 7efe76d9d640 1 --2- 172.21.15.37:0/2076162278 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe78103660 0x7efe78100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:21.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:21.973+0000 7efe76d9d640 1 -- 172.21.15.37:0/2076162278 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efe7810c170 msgr2=0x7efe78101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:21.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:21.973+0000 7efe76d9d640 1 --2- 172.21.15.37:0/2076162278 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efe7810c170 0x7efe78101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:21.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:21.973+0000 7efe76d9d640 1 -- 172.21.15.37:0/2076162278 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe781a6a60 con 0x7efe78102d40 2024-09-19T06:05:21.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:21.973+0000 7efe7659c640 1 --2- 172.21.15.37:0/2076162278 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe78103660 0x7efe78100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:05:21.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:21.974+0000 7efe76d9d640 1 --2- 172.21.15.37:0/2076162278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe78102d40 0x7efe781009a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7efe68005ab0 tx=0x7efe680042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:21.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:21.974+0000 7efe5ffff640 1 -- 172.21.15.37:0/2076162278 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe6803f030 con 0x7efe78102d40 2024-09-19T06:05:21.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:21.974+0000 7efe5ffff640 1 -- 172.21.15.37:0/2076162278 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe68003ce0 con 0x7efe78102d40 2024-09-19T06:05:21.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:21.974+0000 7efe5ffff640 1 -- 172.21.15.37:0/2076162278 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe68035070 con 0x7efe78102d40 2024-09-19T06:05:21.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:21.974+0000 7efe7d06c640 1 -- 172.21.15.37:0/2076162278 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe781a6cf0 con 0x7efe78102d40 2024-09-19T06:05:21.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:21.974+0000 7efe7d06c640 1 -- 172.21.15.37:0/2076162278 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe781a7180 con 0x7efe78102d40 2024-09-19T06:05:21.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:21.975+0000 7efe7d06c640 1 -- 172.21.15.37:0/2076162278 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe781031a0 con 0x7efe78102d40 2024-09-19T06:05:21.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:21.977+0000 7efe5ffff640 1 -- 172.21.15.37:0/2076162278 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7efe68042030 con 0x7efe78102d40 2024-09-19T06:05:21.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:21.978+0000 7efe5ffff640 1 --2- 172.21.15.37:0/2076162278 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7efe600a32d0 0x7efe600a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:21.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:21.978+0000 7efe5ffff640 1 -- 172.21.15.37:0/2076162278 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7efe680f0820 con 0x7efe78102d40 2024-09-19T06:05:21.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:21.979+0000 7efe7659c640 1 --2- 172.21.15.37:0/2076162278 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7efe600a32d0 0x7efe600a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:21.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:21.979+0000 7efe7659c640 1 --2- 172.21.15.37:0/2076162278 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7efe600a32d0 0x7efe600a5790 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7efe78102430 tx=0x7efe6c008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:21.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:21.983+0000 7efe5ffff640 1 -- 172.21.15.37:0/2076162278 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7efe680bd020 con 0x7efe78102d40 2024-09-19T06:05:22.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:21 smithi037 ceph-mon[31211]: pgmap v323: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-09-19T06:05:22.177 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:05:22.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:22.173+0000 7efe7d06c640 1 -- 172.21.15.37:0/2076162278 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7efe781071e0 con 0x7efe78102d40 2024-09-19T06:05:22.179 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:05:22.182 INFO:teuthology.orchestra.run.smithi037.stdout:55834574927 2024-09-19T06:05:22.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:22.175+0000 7efe5ffff640 1 -- 172.21.15.37:0/2076162278 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7efe680bc920 con 0x7efe78102d40 2024-09-19T06:05:22.183 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:05:22.183 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:05:22.184 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:05:22.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:22.182+0000 7efe7d06c640 1 -- 172.21.15.37:0/2076162278 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7efe600a32d0 msgr2=0x7efe600a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:22.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:22.182+0000 7efe7d06c640 1 --2- 172.21.15.37:0/2076162278 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7efe600a32d0 0x7efe600a5790 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7efe78102430 tx=0x7efe6c008040 comp rx=0 tx=0).stop 2024-09-19T06:05:22.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:22.182+0000 7efe7d06c640 1 -- 172.21.15.37:0/2076162278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe78102d40 msgr2=0x7efe781009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:22.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:22.182+0000 7efe7d06c640 1 --2- 172.21.15.37:0/2076162278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe78102d40 0x7efe781009a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7efe68005ab0 tx=0x7efe680042f0 comp rx=0 tx=0).stop 2024-09-19T06:05:22.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:21 smithi099 ceph-mon[35300]: pgmap v323: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-09-19T06:05:22.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:22.186+0000 7efe7d06c640 1 -- 172.21.15.37:0/2076162278 shutdown_connections 2024-09-19T06:05:22.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:22.186+0000 7efe7d06c640 1 --2- 172.21.15.37:0/2076162278 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7efe600a32d0 0x7efe600a5790 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:22.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:22.186+0000 7efe7d06c640 1 --2- 172.21.15.37:0/2076162278 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efe7810c170 0x7efe78101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:22.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:22.186+0000 7efe7d06c640 1 --2- 172.21.15.37:0/2076162278 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe78103660 0x7efe78100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:22.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:22.186+0000 7efe7d06c640 1 --2- 172.21.15.37:0/2076162278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe78102d40 0x7efe781009a0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:22.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:22.186+0000 7efe7d06c640 1 -- 172.21.15.37:0/2076162278 >> 172.21.15.37:0/2076162278 conn(0x7efe780fc7a0 msgr2=0x7efe780fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:22.190 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:05:22.194 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:05:22.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:22.188+0000 7efe7d06c640 1 -- 172.21.15.37:0/2076162278 shutdown_connections 2024-09-19T06:05:22.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:22.188+0000 7efe7d06c640 1 -- 172.21.15.37:0/2076162278 wait complete. 2024-09-19T06:05:22.197 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:05:22.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:21 smithi117 ceph-mon[35050]: pgmap v323: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-09-19T06:05:23.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:22 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/2076162278' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T06:05:23.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.093+0000 7f1d0aac8640 1 -- 172.21.15.37:0/1124786042 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d04103660 msgr2=0x7f1d0410bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:23.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.093+0000 7f1d0aac8640 1 --2- 172.21.15.37:0/1124786042 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d04103660 0x7f1d0410bb50 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1cf8009900 tx=0x7f1cf802a480 comp rx=0 tx=0).stop 2024-09-19T06:05:23.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.093+0000 7f1d0aac8640 1 -- 172.21.15.37:0/1124786042 shutdown_connections 2024-09-19T06:05:23.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.093+0000 7f1d0aac8640 1 --2- 172.21.15.37:0/1124786042 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d0410c170 0x7f1d0410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:23.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.093+0000 7f1d0aac8640 1 --2- 172.21.15.37:0/1124786042 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d04103660 0x7f1d0410bb50 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:23.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.093+0000 7f1d0aac8640 1 --2- 172.21.15.37:0/1124786042 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d04102d40 0x7f1d04103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:23.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.093+0000 7f1d0aac8640 1 -- 172.21.15.37:0/1124786042 >> 172.21.15.37:0/1124786042 conn(0x7f1d040fc7a0 msgr2=0x7f1d040febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:23.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.093+0000 7f1d0aac8640 1 -- 172.21.15.37:0/1124786042 shutdown_connections 2024-09-19T06:05:23.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.093+0000 7f1d0aac8640 1 -- 172.21.15.37:0/1124786042 wait complete. 2024-09-19T06:05:23.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.093+0000 7f1d0aac8640 1 Processor -- start 2024-09-19T06:05:23.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.093+0000 7f1d0aac8640 1 -- start start 2024-09-19T06:05:23.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.093+0000 7f1d0aac8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d04102d40 0x7f1d04198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:23.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.093+0000 7f1d0aac8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d04103660 0x7f1d041989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:23.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.094+0000 7f1d0aac8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d0410c170 0x7f1d0419cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:23.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.094+0000 7f1d0aac8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1d04111f70 con 0x7f1d04102d40 2024-09-19T06:05:23.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.094+0000 7f1d0aac8640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f1d04111df0 con 0x7f1d0410c170 2024-09-19T06:05:23.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.094+0000 7f1d0aac8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1d041120f0 con 0x7f1d04103660 2024-09-19T06:05:23.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.094+0000 7f1d08864640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d04102d40 0x7f1d04198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:23.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.094+0000 7f1d08864640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d04102d40 0x7f1d04198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34584/0 (socket says 172.21.15.37:34584) 2024-09-19T06:05:23.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.094+0000 7f1d08864640 1 -- 172.21.15.37:0/2908181696 learned_addr learned my addr 172.21.15.37:0/2908181696 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:05:23.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.094+0000 7f1d03fff640 1 --2- 172.21.15.37:0/2908181696 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d04103660 0x7f1d041989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:23.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.094+0000 7f1d09065640 1 --2- 172.21.15.37:0/2908181696 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d0410c170 0x7f1d0419cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:23.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.094+0000 7f1d08864640 1 -- 172.21.15.37:0/2908181696 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d04103660 msgr2=0x7f1d041989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:23.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.094+0000 7f1d08864640 1 --2- 172.21.15.37:0/2908181696 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d04103660 0x7f1d041989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:23.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.094+0000 7f1d08864640 1 -- 172.21.15.37:0/2908181696 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d0410c170 msgr2=0x7f1d0419cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:23.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.094+0000 7f1d08864640 1 --2- 172.21.15.37:0/2908181696 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d0410c170 0x7f1d0419cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:23.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.094+0000 7f1d08864640 1 -- 172.21.15.37:0/2908181696 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d0419d420 con 0x7f1d04102d40 2024-09-19T06:05:23.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.094+0000 7f1d03fff640 1 --2- 172.21.15.37:0/2908181696 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d04103660 0x7f1d041989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:05:23.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.094+0000 7f1d09065640 1 --2- 172.21.15.37:0/2908181696 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d0410c170 0x7f1d0419cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:05:23.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.094+0000 7f1d08864640 1 --2- 172.21.15.37:0/2908181696 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d04102d40 0x7f1d04198470 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1cf400d950 tx=0x7f1cf400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:23.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.094+0000 7f1d01ffb640 1 -- 172.21.15.37:0/2908181696 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf4017030 con 0x7f1d04102d40 2024-09-19T06:05:23.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.094+0000 7f1d0aac8640 1 -- 172.21.15.37:0/2908181696 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d0419d710 con 0x7f1d04102d40 2024-09-19T06:05:23.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.094+0000 7f1d01ffb640 1 -- 172.21.15.37:0/2908181696 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1cf4004020 con 0x7f1d04102d40 2024-09-19T06:05:23.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.094+0000 7f1d01ffb640 1 -- 172.21.15.37:0/2908181696 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf40047a0 con 0x7f1d04102d40 2024-09-19T06:05:23.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.095+0000 7f1d0aac8640 1 -- 172.21.15.37:0/2908181696 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d041a4ff0 con 0x7f1d04102d40 2024-09-19T06:05:23.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.096+0000 7f1d0aac8640 1 -- 172.21.15.37:0/2908181696 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d04103120 con 0x7f1d04102d40 2024-09-19T06:05:23.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.097+0000 7f1d01ffb640 1 -- 172.21.15.37:0/2908181696 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f1cf40041d0 con 0x7f1d04102d40 2024-09-19T06:05:23.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.098+0000 7f1d01ffb640 1 --2- 172.21.15.37:0/2908181696 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f1cec0a32d0 0x7f1cec0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:23.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.098+0000 7f1d03fff640 1 --2- 172.21.15.37:0/2908181696 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f1cec0a32d0 0x7f1cec0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:23.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.098+0000 7f1d01ffb640 1 -- 172.21.15.37:0/2908181696 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f1cf40cf890 con 0x7f1d04102d40 2024-09-19T06:05:23.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.098+0000 7f1d03fff640 1 --2- 172.21.15.37:0/2908181696 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f1cec0a32d0 0x7f1cec0a5790 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1d0410d5b0 tx=0x7f1cf8005a20 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:23.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.102+0000 7f1d01ffb640 1 -- 172.21.15.37:0/2908181696 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1cf409c0f0 con 0x7f1d04102d40 2024-09-19T06:05:23.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:22 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/2076162278' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T06:05:23.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:22 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/2076162278' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T06:05:23.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.281+0000 7f1d0aac8640 1 -- 172.21.15.37:0/2908181696 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f1d04106c50 con 0x7f1d04102d40 2024-09-19T06:05:23.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.282+0000 7f1d01ffb640 1 -- 172.21.15.37:0/2908181696 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f1cf409b9f0 con 0x7f1d04102d40 2024-09-19T06:05:23.284 INFO:teuthology.orchestra.run.smithi037.stdout:270582939687 2024-09-19T06:05:23.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.284+0000 7f1d0aac8640 1 -- 172.21.15.37:0/2908181696 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f1cec0a32d0 msgr2=0x7f1cec0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:23.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.284+0000 7f1d0aac8640 1 --2- 172.21.15.37:0/2908181696 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f1cec0a32d0 0x7f1cec0a5790 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1d0410d5b0 tx=0x7f1cf8005a20 comp rx=0 tx=0).stop 2024-09-19T06:05:23.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.284+0000 7f1d0aac8640 1 -- 172.21.15.37:0/2908181696 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d04102d40 msgr2=0x7f1d04198470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:23.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.284+0000 7f1d0aac8640 1 --2- 172.21.15.37:0/2908181696 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d04102d40 0x7f1d04198470 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1cf400d950 tx=0x7f1cf400de10 comp rx=0 tx=0).stop 2024-09-19T06:05:23.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.284+0000 7f1d0aac8640 1 -- 172.21.15.37:0/2908181696 shutdown_connections 2024-09-19T06:05:23.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.284+0000 7f1d0aac8640 1 --2- 172.21.15.37:0/2908181696 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f1cec0a32d0 0x7f1cec0a5790 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:23.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.284+0000 7f1d0aac8640 1 --2- 172.21.15.37:0/2908181696 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d0410c170 0x7f1d0419cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:23.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.284+0000 7f1d0aac8640 1 --2- 172.21.15.37:0/2908181696 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d04103660 0x7f1d041989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:23.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.284+0000 7f1d0aac8640 1 --2- 172.21.15.37:0/2908181696 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d04102d40 0x7f1d04198470 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:23.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.284+0000 7f1d0aac8640 1 -- 172.21.15.37:0/2908181696 >> 172.21.15.37:0/2908181696 conn(0x7f1d040fc7a0 msgr2=0x7f1d040fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:23.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.284+0000 7f1d0aac8640 1 -- 172.21.15.37:0/2908181696 shutdown_connections 2024-09-19T06:05:23.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.284+0000 7f1d0aac8640 1 -- 172.21.15.37:0/2908181696 wait complete. 2024-09-19T06:05:23.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.326+0000 7f695fe9e640 1 -- 172.21.15.37:0/389009598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6958106f10 msgr2=0x7f695810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:23.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.326+0000 7f695fe9e640 1 --2- 172.21.15.37:0/389009598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6958106f10 0x7f695810ea90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6950009ca0 tx=0x7f695002a8c0 comp rx=0 tx=0).stop 2024-09-19T06:05:23.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.326+0000 7f695fe9e640 1 -- 172.21.15.37:0/389009598 shutdown_connections 2024-09-19T06:05:23.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.326+0000 7f695fe9e640 1 --2- 172.21.15.37:0/389009598 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6958102790 0x7f69581067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:23.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.326+0000 7f695fe9e640 1 --2- 172.21.15.37:0/389009598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6958106f10 0x7f695810ea90 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:23.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.326+0000 7f695fe9e640 1 --2- 172.21.15.37:0/389009598 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6958101de0 0x7f69581021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:23.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.326+0000 7f695fe9e640 1 -- 172.21.15.37:0/389009598 >> 172.21.15.37:0/389009598 conn(0x7f69580fd8e0 msgr2=0x7f69580ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:23.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.327+0000 7f695fe9e640 1 -- 172.21.15.37:0/389009598 shutdown_connections 2024-09-19T06:05:23.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.327+0000 7f695fe9e640 1 -- 172.21.15.37:0/389009598 wait complete. 2024-09-19T06:05:23.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.327+0000 7f695fe9e640 1 Processor -- start 2024-09-19T06:05:23.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.327+0000 7f695fe9e640 1 -- start start 2024-09-19T06:05:23.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.327+0000 7f695fe9e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6958101de0 0x7f69580744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:23.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.327+0000 7f695fe9e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6958102790 0x7f6958074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:23.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.327+0000 7f695fe9e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6958106f10 0x7f6958074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:23.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.327+0000 7f695fe9e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6958111f70 con 0x7f6958106f10 2024-09-19T06:05:23.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.327+0000 7f695fe9e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f6958111df0 con 0x7f6958101de0 2024-09-19T06:05:23.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.327+0000 7f695fe9e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f69581120f0 con 0x7f6958102790 2024-09-19T06:05:23.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.328+0000 7f695e43b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6958106f10 0x7f6958074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:23.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.328+0000 7f695e43b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6958106f10 0x7f6958074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34616/0 (socket says 172.21.15.37:34616) 2024-09-19T06:05:23.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.328+0000 7f695e43b640 1 -- 172.21.15.37:0/2695042150 learned_addr learned my addr 172.21.15.37:0/2695042150 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:05:23.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.328+0000 7f695dc3a640 1 --2- 172.21.15.37:0/2695042150 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6958101de0 0x7f69580744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:23.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.328+0000 7f695d439640 1 --2- 172.21.15.37:0/2695042150 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6958102790 0x7f6958074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:23.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.328+0000 7f695e43b640 1 -- 172.21.15.37:0/2695042150 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6958102790 msgr2=0x7f6958074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:23.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.328+0000 7f695e43b640 1 --2- 172.21.15.37:0/2695042150 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6958102790 0x7f6958074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:23.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.328+0000 7f695e43b640 1 -- 172.21.15.37:0/2695042150 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6958101de0 msgr2=0x7f69580744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:23.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.328+0000 7f695e43b640 1 --2- 172.21.15.37:0/2695042150 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6958101de0 0x7f69580744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:23.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.328+0000 7f695e43b640 1 -- 172.21.15.37:0/2695042150 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69581a68d0 con 0x7f6958106f10 2024-09-19T06:05:23.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.328+0000 7f695dc3a640 1 --2- 172.21.15.37:0/2695042150 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6958101de0 0x7f69580744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:05:23.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.328+0000 7f695d439640 1 --2- 172.21.15.37:0/2695042150 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6958102790 0x7f6958074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:05:23.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.328+0000 7f695e43b640 1 --2- 172.21.15.37:0/2695042150 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6958106f10 0x7f6958074f70 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6950031a20 tx=0x7f6950031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:23.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.328+0000 7f694effd640 1 -- 172.21.15.37:0/2695042150 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6950003b70 con 0x7f6958106f10 2024-09-19T06:05:23.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.328+0000 7f694effd640 1 -- 172.21.15.37:0/2695042150 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6950003d10 con 0x7f6958106f10 2024-09-19T06:05:23.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.328+0000 7f695fe9e640 1 -- 172.21.15.37:0/2695042150 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69581a6b60 con 0x7f6958106f10 2024-09-19T06:05:23.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.328+0000 7f694effd640 1 -- 172.21.15.37:0/2695042150 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f695002fc40 con 0x7f6958106f10 2024-09-19T06:05:23.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.329+0000 7f695fe9e640 1 -- 172.21.15.37:0/2695042150 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69581a70f0 con 0x7f6958106f10 2024-09-19T06:05:23.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.329+0000 7f695fe9e640 1 -- 172.21.15.37:0/2695042150 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69581021c0 con 0x7f6958106f10 2024-09-19T06:05:23.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.331+0000 7f694effd640 1 -- 172.21.15.37:0/2695042150 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f6950004050 con 0x7f6958106f10 2024-09-19T06:05:23.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.331+0000 7f694effd640 1 --2- 172.21.15.37:0/2695042150 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f69440a3350 0x7f69440a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:23.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.332+0000 7f695dc3a640 1 --2- 172.21.15.37:0/2695042150 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f69440a3350 0x7f69440a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:23.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.332+0000 7f694effd640 1 -- 172.21.15.37:0/2695042150 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f69500f0eb0 con 0x7f6958106f10 2024-09-19T06:05:23.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.332+0000 7f695dc3a640 1 --2- 172.21.15.37:0/2695042150 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f69440a3350 0x7f69440a5810 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6954009c20 tx=0x7f6954005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:23.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.336+0000 7f694effd640 1 -- 172.21.15.37:0/2695042150 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f69500bd8b0 con 0x7f6958106f10 2024-09-19T06:05:23.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.514+0000 7f695fe9e640 1 -- 172.21.15.37:0/2695042150 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f695810a150 con 0x7f6958106f10 2024-09-19T06:05:23.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.514+0000 7f694effd640 1 -- 172.21.15.37:0/2695042150 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f69500bd1b0 con 0x7f6958106f10 2024-09-19T06:05:23.517 INFO:teuthology.orchestra.run.smithi037.stdout:188978561079 2024-09-19T06:05:23.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.516+0000 7f695fe9e640 1 -- 172.21.15.37:0/2695042150 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f69440a3350 msgr2=0x7f69440a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:23.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.516+0000 7f695fe9e640 1 --2- 172.21.15.37:0/2695042150 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f69440a3350 0x7f69440a5810 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6954009c20 tx=0x7f6954005f90 comp rx=0 tx=0).stop 2024-09-19T06:05:23.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.516+0000 7f695fe9e640 1 -- 172.21.15.37:0/2695042150 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6958106f10 msgr2=0x7f6958074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:23.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.516+0000 7f695fe9e640 1 --2- 172.21.15.37:0/2695042150 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6958106f10 0x7f6958074f70 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6950031a20 tx=0x7f6950031a50 comp rx=0 tx=0).stop 2024-09-19T06:05:23.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.516+0000 7f695fe9e640 1 -- 172.21.15.37:0/2695042150 shutdown_connections 2024-09-19T06:05:23.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.516+0000 7f695fe9e640 1 --2- 172.21.15.37:0/2695042150 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f69440a3350 0x7f69440a5810 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:23.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.516+0000 7f695fe9e640 1 --2- 172.21.15.37:0/2695042150 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6958106f10 0x7f6958074f70 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:23.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.516+0000 7f695fe9e640 1 --2- 172.21.15.37:0/2695042150 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6958102790 0x7f6958074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:23.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.516+0000 7f695fe9e640 1 --2- 172.21.15.37:0/2695042150 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6958101de0 0x7f69580744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:23.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.516+0000 7f695fe9e640 1 -- 172.21.15.37:0/2695042150 >> 172.21.15.37:0/2695042150 conn(0x7f69580fd8e0 msgr2=0x7f69580febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:23.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.516+0000 7f695fe9e640 1 -- 172.21.15.37:0/2695042150 shutdown_connections 2024-09-19T06:05:23.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:23.516+0000 7f695fe9e640 1 -- 172.21.15.37:0/2695042150 wait complete. 2024-09-19T06:05:24.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:23 smithi037 ceph-mon[31211]: pgmap v324: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 927 B/s rd, 1 op/s; 3 B/s, 1 keys/s, 0 objects/s recovering 2024-09-19T06:05:24.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:23 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/2908181696' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T06:05:24.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:23 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/2695042150' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T06:05:24.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:23 smithi099 ceph-mon[35300]: pgmap v324: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 927 B/s rd, 1 op/s; 3 B/s, 1 keys/s, 0 objects/s recovering 2024-09-19T06:05:24.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:23 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/2908181696' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T06:05:24.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:23 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/2695042150' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T06:05:24.218 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:05:24.223 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:05:24.247 INFO:tasks.cephadm.ceph_manager.ceph:need seq 188978561077 got 188978561079 for osd.6 2024-09-19T06:05:24.247 DEBUG:teuthology.parallel:result is None 2024-09-19T06:05:24.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:23 smithi117 ceph-mon[35050]: pgmap v324: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 927 B/s rd, 1 op/s; 3 B/s, 1 keys/s, 0 objects/s recovering 2024-09-19T06:05:24.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:23 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/2908181696' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T06:05:24.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:23 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/2695042150' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T06:05:24.896 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574925 got 55834574927 for osd.1 2024-09-19T06:05:24.897 DEBUG:teuthology.parallel:result is None 2024-09-19T06:05:25.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.514+0000 7fc570c7a640 1 -- 172.21.15.37:0/2000807696 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc56c10c180 msgr2=0x7fc56c10e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:25.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.514+0000 7fc570c7a640 1 --2- 172.21.15.37:0/2000807696 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc56c10c180 0x7fc56c10e620 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc564009ca0 tx=0x7fc56402a950 comp rx=0 tx=0).stop 2024-09-19T06:05:25.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.514+0000 7fc570c7a640 1 -- 172.21.15.37:0/2000807696 shutdown_connections 2024-09-19T06:05:25.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.514+0000 7fc570c7a640 1 --2- 172.21.15.37:0/2000807696 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc56c103670 0x7fc56c10bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:25.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.514+0000 7fc570c7a640 1 --2- 172.21.15.37:0/2000807696 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc56c10c180 0x7fc56c10e620 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:25.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.514+0000 7fc570c7a640 1 --2- 172.21.15.37:0/2000807696 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc56c102d50 0x7fc56c103130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:25.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.514+0000 7fc570c7a640 1 -- 172.21.15.37:0/2000807696 >> 172.21.15.37:0/2000807696 conn(0x7fc56c0fc7d0 msgr2=0x7fc56c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:25.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.515+0000 7fc570c7a640 1 -- 172.21.15.37:0/2000807696 shutdown_connections 2024-09-19T06:05:25.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.515+0000 7fc570c7a640 1 -- 172.21.15.37:0/2000807696 wait complete. 2024-09-19T06:05:25.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.515+0000 7fc570c7a640 1 Processor -- start 2024-09-19T06:05:25.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.516+0000 7fc570c7a640 1 -- start start 2024-09-19T06:05:25.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.516+0000 7fc570c7a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc56c102d50 0x7fc56c1009b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:25.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.516+0000 7fc570c7a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc56c103670 0x7fc56c100ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:25.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.516+0000 7fc570c7a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc56c10c180 0x7fc56c101430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:25.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.516+0000 7fc570c7a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc56c111f40 con 0x7fc56c10c180 2024-09-19T06:05:25.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.516+0000 7fc570c7a640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc56c111dc0 con 0x7fc56c102d50 2024-09-19T06:05:25.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.516+0000 7fc570c7a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc56c1120c0 con 0x7fc56c103670 2024-09-19T06:05:25.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.516+0000 7fc56ad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc56c10c180 0x7fc56c101430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:25.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.516+0000 7fc56ad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc56c10c180 0x7fc56c101430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50560/0 (socket says 172.21.15.37:50560) 2024-09-19T06:05:25.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.516+0000 7fc56ad9d640 1 -- 172.21.15.37:0/446478146 learned_addr learned my addr 172.21.15.37:0/446478146 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:05:25.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.516+0000 7fc56a59c640 1 --2- 172.21.15.37:0/446478146 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc56c102d50 0x7fc56c1009b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:25.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.516+0000 7fc563fff640 1 --2- 172.21.15.37:0/446478146 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc56c103670 0x7fc56c100ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:25.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.516+0000 7fc56ad9d640 1 -- 172.21.15.37:0/446478146 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc56c103670 msgr2=0x7fc56c100ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:25.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.516+0000 7fc56ad9d640 1 --2- 172.21.15.37:0/446478146 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc56c103670 0x7fc56c100ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:25.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.516+0000 7fc56ad9d640 1 -- 172.21.15.37:0/446478146 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc56c102d50 msgr2=0x7fc56c1009b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:25.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.516+0000 7fc56ad9d640 1 --2- 172.21.15.37:0/446478146 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc56c102d50 0x7fc56c1009b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:25.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.516+0000 7fc56ad9d640 1 -- 172.21.15.37:0/446478146 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc56c1a6960 con 0x7fc56c10c180 2024-09-19T06:05:25.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.517+0000 7fc56ad9d640 1 --2- 172.21.15.37:0/446478146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc56c10c180 0x7fc56c101430 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc56402ae70 tx=0x7fc56402f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:25.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.517+0000 7fc5637fe640 1 -- 172.21.15.37:0/446478146 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc564034040 con 0x7fc56c10c180 2024-09-19T06:05:25.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.517+0000 7fc570c7a640 1 -- 172.21.15.37:0/446478146 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc56c1a6bf0 con 0x7fc56c10c180 2024-09-19T06:05:25.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.517+0000 7fc5637fe640 1 -- 172.21.15.37:0/446478146 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc564030920 con 0x7fc56c10c180 2024-09-19T06:05:25.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.517+0000 7fc5637fe640 1 -- 172.21.15.37:0/446478146 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc564045480 con 0x7fc56c10c180 2024-09-19T06:05:25.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.517+0000 7fc570c7a640 1 -- 172.21.15.37:0/446478146 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc56c1a7120 con 0x7fc56c10c180 2024-09-19T06:05:25.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.518+0000 7fc570c7a640 1 -- 172.21.15.37:0/446478146 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc56c103130 con 0x7fc56c10c180 2024-09-19T06:05:25.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.520+0000 7fc5637fe640 1 -- 172.21.15.37:0/446478146 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fc564037020 con 0x7fc56c10c180 2024-09-19T06:05:25.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.521+0000 7fc5637fe640 1 --2- 172.21.15.37:0/446478146 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fc5580a3350 0x7fc5580a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:25.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.521+0000 7fc56a59c640 1 --2- 172.21.15.37:0/446478146 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fc5580a3350 0x7fc5580a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:25.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.521+0000 7fc5637fe640 1 -- 172.21.15.37:0/446478146 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fc5640f0c60 con 0x7fc56c10c180 2024-09-19T06:05:25.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.521+0000 7fc56a59c640 1 --2- 172.21.15.37:0/446478146 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fc5580a3350 0x7fc5580a5810 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc55c00bbe0 tx=0x7fc55c00b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:25.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.529+0000 7fc5637fe640 1 -- 172.21.15.37:0/446478146 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc5640bd570 con 0x7fc56c10c180 2024-09-19T06:05:25.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.689+0000 7f6b2d02d640 1 -- 172.21.15.37:0/928729896 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b28101e10 msgr2=0x7f6b281021f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:25.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.689+0000 7f6b2d02d640 1 --2- 172.21.15.37:0/928729896 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b28101e10 0x7f6b281021f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6b18009900 tx=0x7f6b1802a3f0 comp rx=0 tx=0).stop 2024-09-19T06:05:25.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.690+0000 7f6b2d02d640 1 -- 172.21.15.37:0/928729896 shutdown_connections 2024-09-19T06:05:25.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.690+0000 7f6b2d02d640 1 --2- 172.21.15.37:0/928729896 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6b281027c0 0x7f6b28106810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:25.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.690+0000 7f6b2d02d640 1 --2- 172.21.15.37:0/928729896 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b28106f40 0x7f6b2810eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:25.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.690+0000 7f6b2d02d640 1 --2- 172.21.15.37:0/928729896 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b28101e10 0x7f6b281021f0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:25.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.690+0000 7f6b2d02d640 1 -- 172.21.15.37:0/928729896 >> 172.21.15.37:0/928729896 conn(0x7f6b280fd8d0 msgr2=0x7f6b280ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:25.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.690+0000 7f6b2d02d640 1 -- 172.21.15.37:0/928729896 shutdown_connections 2024-09-19T06:05:25.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.690+0000 7f6b2d02d640 1 -- 172.21.15.37:0/928729896 wait complete. 2024-09-19T06:05:25.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.690+0000 7f6b2d02d640 1 Processor -- start 2024-09-19T06:05:25.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.690+0000 7f6b2d02d640 1 -- start start 2024-09-19T06:05:25.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.691+0000 7f6b2d02d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b28101e10 0x7f6b281983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:25.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.691+0000 7f6b2d02d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6b281027c0 0x7f6b281988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:25.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.691+0000 7f6b2d02d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b28106f40 0x7f6b2819cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:25.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.691+0000 7f6b2d02d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6b28111fa0 con 0x7f6b28106f40 2024-09-19T06:05:25.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.691+0000 7f6b2d02d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f6b28111e20 con 0x7f6b281027c0 2024-09-19T06:05:25.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.691+0000 7f6b2d02d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6b28112120 con 0x7f6b28101e10 2024-09-19T06:05:25.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.691+0000 7f6b2759e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b28106f40 0x7f6b2819cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:25.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.691+0000 7f6b2759e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b28106f40 0x7f6b2819cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50586/0 (socket says 172.21.15.37:50586) 2024-09-19T06:05:25.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.691+0000 7f6b2759e640 1 -- 172.21.15.37:0/5374441 learned_addr learned my addr 172.21.15.37:0/5374441 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:05:25.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.691+0000 7f6b1ffff640 1 --2- 172.21.15.37:0/5374441 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6b281027c0 0x7f6b281988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:25.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.691+0000 7f6b26d9d640 1 --2- 172.21.15.37:0/5374441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b28101e10 0x7f6b281983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:25.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.691+0000 7f6b2759e640 1 -- 172.21.15.37:0/5374441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b28101e10 msgr2=0x7f6b281983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:25.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.691+0000 7f6b2759e640 1 --2- 172.21.15.37:0/5374441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b28101e10 0x7f6b281983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:25.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.691+0000 7f6b2759e640 1 -- 172.21.15.37:0/5374441 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6b281027c0 msgr2=0x7f6b281988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:25.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.691+0000 7f6b2759e640 1 --2- 172.21.15.37:0/5374441 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6b281027c0 0x7f6b281988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:25.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.691+0000 7f6b2759e640 1 -- 172.21.15.37:0/5374441 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b2819d360 con 0x7f6b28106f40 2024-09-19T06:05:25.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.691+0000 7f6b2759e640 1 --2- 172.21.15.37:0/5374441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b28106f40 0x7f6b2819cc80 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6b2000eaa0 tx=0x7f6b2000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:25.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.691+0000 7f6b24d99640 1 -- 172.21.15.37:0/5374441 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b20004d20 con 0x7f6b28106f40 2024-09-19T06:05:25.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.691+0000 7f6b24d99640 1 -- 172.21.15.37:0/5374441 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6b20005020 con 0x7f6b28106f40 2024-09-19T06:05:25.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.692+0000 7f6b2d02d640 1 -- 172.21.15.37:0/5374441 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b2819d650 con 0x7f6b28106f40 2024-09-19T06:05:25.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.692+0000 7f6b24d99640 1 -- 172.21.15.37:0/5374441 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b200116d0 con 0x7f6b28106f40 2024-09-19T06:05:25.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.692+0000 7f6b2d02d640 1 -- 172.21.15.37:0/5374441 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b281a4f30 con 0x7f6b28106f40 2024-09-19T06:05:25.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.693+0000 7f6b2d02d640 1 -- 172.21.15.37:0/5374441 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b281021f0 con 0x7f6b28106f40 2024-09-19T06:05:25.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.694+0000 7f6b24d99640 1 -- 172.21.15.37:0/5374441 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f6b200051d0 con 0x7f6b28106f40 2024-09-19T06:05:25.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.694+0000 7f6b24d99640 1 --2- 172.21.15.37:0/5374441 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f6b140a32d0 0x7f6b140a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:25.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.694+0000 7f6b26d9d640 1 --2- 172.21.15.37:0/5374441 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f6b140a32d0 0x7f6b140a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:25.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.695+0000 7f6b24d99640 1 -- 172.21.15.37:0/5374441 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f6b200cffb0 con 0x7f6b28106f40 2024-09-19T06:05:25.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.695+0000 7f6b26d9d640 1 --2- 172.21.15.37:0/5374441 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f6b140a32d0 0x7f6b140a5790 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6b18005ab0 tx=0x7f6b18005a20 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:25.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.699+0000 7f6b24d99640 1 -- 172.21.15.37:0/5374441 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6b20016030 con 0x7f6b28106f40 2024-09-19T06:05:25.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.711+0000 7fc570c7a640 1 -- 172.21.15.37:0/446478146 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7fc56c107220 con 0x7fc56c10c180 2024-09-19T06:05:25.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.712+0000 7fc5637fe640 1 -- 172.21.15.37:0/446478146 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fc5640bce70 con 0x7fc56c10c180 2024-09-19T06:05:25.714 INFO:teuthology.orchestra.run.smithi037.stdout:292057776163 2024-09-19T06:05:25.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.714+0000 7fc570c7a640 1 -- 172.21.15.37:0/446478146 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fc5580a3350 msgr2=0x7fc5580a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:25.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.714+0000 7fc570c7a640 1 --2- 172.21.15.37:0/446478146 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fc5580a3350 0x7fc5580a5810 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc55c00bbe0 tx=0x7fc55c00b390 comp rx=0 tx=0).stop 2024-09-19T06:05:25.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.714+0000 7fc570c7a640 1 -- 172.21.15.37:0/446478146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc56c10c180 msgr2=0x7fc56c101430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:25.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.714+0000 7fc570c7a640 1 --2- 172.21.15.37:0/446478146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc56c10c180 0x7fc56c101430 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc56402ae70 tx=0x7fc56402f5b0 comp rx=0 tx=0).stop 2024-09-19T06:05:25.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.714+0000 7fc570c7a640 1 -- 172.21.15.37:0/446478146 shutdown_connections 2024-09-19T06:05:25.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.714+0000 7fc570c7a640 1 --2- 172.21.15.37:0/446478146 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fc5580a3350 0x7fc5580a5810 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:25.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.714+0000 7fc570c7a640 1 --2- 172.21.15.37:0/446478146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc56c10c180 0x7fc56c101430 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:25.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.714+0000 7fc570c7a640 1 --2- 172.21.15.37:0/446478146 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc56c103670 0x7fc56c100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:25.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.714+0000 7fc570c7a640 1 --2- 172.21.15.37:0/446478146 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc56c102d50 0x7fc56c1009b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:25.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.714+0000 7fc570c7a640 1 -- 172.21.15.37:0/446478146 >> 172.21.15.37:0/446478146 conn(0x7fc56c0fc7d0 msgr2=0x7fc56c0fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:25.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.714+0000 7fc570c7a640 1 -- 172.21.15.37:0/446478146 shutdown_connections 2024-09-19T06:05:25.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.714+0000 7fc570c7a640 1 -- 172.21.15.37:0/446478146 wait complete. 2024-09-19T06:05:25.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.882+0000 7f6b2d02d640 1 -- 172.21.15.37:0/5374441 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f6b28109b90 con 0x7f6b28106f40 2024-09-19T06:05:25.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.883+0000 7f6b24d99640 1 -- 172.21.15.37:0/5374441 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6b2009c810 con 0x7f6b28106f40 2024-09-19T06:05:25.885 INFO:teuthology.orchestra.run.smithi037.stdout:77309411403 2024-09-19T06:05:25.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.885+0000 7f6b2d02d640 1 -- 172.21.15.37:0/5374441 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f6b140a32d0 msgr2=0x7f6b140a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:25.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.885+0000 7f6b2d02d640 1 --2- 172.21.15.37:0/5374441 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f6b140a32d0 0x7f6b140a5790 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6b18005ab0 tx=0x7f6b18005a20 comp rx=0 tx=0).stop 2024-09-19T06:05:25.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.885+0000 7f6b2d02d640 1 -- 172.21.15.37:0/5374441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b28106f40 msgr2=0x7f6b2819cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:25.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.885+0000 7f6b2d02d640 1 --2- 172.21.15.37:0/5374441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b28106f40 0x7f6b2819cc80 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6b2000eaa0 tx=0x7f6b2000eea0 comp rx=0 tx=0).stop 2024-09-19T06:05:25.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.885+0000 7f6b2d02d640 1 -- 172.21.15.37:0/5374441 shutdown_connections 2024-09-19T06:05:25.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.885+0000 7f6b2d02d640 1 --2- 172.21.15.37:0/5374441 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f6b140a32d0 0x7f6b140a5790 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:25.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.885+0000 7f6b2d02d640 1 --2- 172.21.15.37:0/5374441 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6b281027c0 0x7f6b281988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:25.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.885+0000 7f6b2d02d640 1 --2- 172.21.15.37:0/5374441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b28106f40 0x7f6b2819cc80 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:25.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.885+0000 7f6b2d02d640 1 --2- 172.21.15.37:0/5374441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b28101e10 0x7f6b281983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:25.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.885+0000 7f6b2d02d640 1 -- 172.21.15.37:0/5374441 >> 172.21.15.37:0/5374441 conn(0x7f6b280fd8d0 msgr2=0x7f6b280feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:25.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.885+0000 7f6b2d02d640 1 -- 172.21.15.37:0/5374441 shutdown_connections 2024-09-19T06:05:25.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:25.885+0000 7f6b2d02d640 1 -- 172.21.15.37:0/5374441 wait complete. 2024-09-19T06:05:26.163 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:25 smithi037 ceph-mon[31211]: pgmap v325: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 935 B/s rd, 1 op/s; 3 B/s, 0 keys/s, 0 objects/s recovering 2024-09-19T06:05:26.163 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:25 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/446478146' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T06:05:26.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:25 smithi099 ceph-mon[35300]: pgmap v325: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 935 B/s rd, 1 op/s; 3 B/s, 0 keys/s, 0 objects/s recovering 2024-09-19T06:05:26.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:25 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/446478146' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T06:05:26.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:26.161+0000 7f3f754d5640 1 -- 172.21.15.37:0/605271844 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f70102790 msgr2=0x7f3f701067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:26.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:26.161+0000 7f3f754d5640 1 --2- 172.21.15.37:0/605271844 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f70102790 0x7f3f701067e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f3f64009900 tx=0x7f3f6402a410 comp rx=0 tx=0).stop 2024-09-19T06:05:26.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:26.161+0000 7f3f754d5640 1 -- 172.21.15.37:0/605271844 shutdown_connections 2024-09-19T06:05:26.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:26.161+0000 7f3f754d5640 1 --2- 172.21.15.37:0/605271844 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f70106f10 0x7f3f7010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:26.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:26.161+0000 7f3f754d5640 1 --2- 172.21.15.37:0/605271844 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f70102790 0x7f3f701067e0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:26.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:26.161+0000 7f3f754d5640 1 --2- 172.21.15.37:0/605271844 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f70101de0 0x7f3f701021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:26.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:26.161+0000 7f3f754d5640 1 -- 172.21.15.37:0/605271844 >> 172.21.15.37:0/605271844 conn(0x7f3f700fd8c0 msgr2=0x7f3f700ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:26.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:26.161+0000 7f3f754d5640 1 -- 172.21.15.37:0/605271844 shutdown_connections 2024-09-19T06:05:26.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:26.161+0000 7f3f754d5640 1 -- 172.21.15.37:0/605271844 wait complete. 2024-09-19T06:05:26.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:26.162+0000 7f3f754d5640 1 Processor -- start 2024-09-19T06:05:26.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:26.162+0000 7f3f754d5640 1 -- start start 2024-09-19T06:05:26.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:26.162+0000 7f3f754d5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f70101de0 0x7f3f70198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:26.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:26.162+0000 7f3f754d5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f70102790 0x7f3f70198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:26.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:26.162+0000 7f3f754d5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f70106f10 0x7f3f7019cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:26.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:26.162+0000 7f3f754d5640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3f70111f70 con 0x7f3f70106f10 2024-09-19T06:05:26.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:26.162+0000 7f3f754d5640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f3f70111df0 con 0x7f3f70101de0 2024-09-19T06:05:26.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:26.162+0000 7f3f754d5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3f701120f0 con 0x7f3f70102790 2024-09-19T06:05:26.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:26.163+0000 7f3f6f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f70106f10 0x7f3f7019cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:26.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:26.163+0000 7f3f6f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f70106f10 0x7f3f7019cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50594/0 (socket says 172.21.15.37:50594) 2024-09-19T06:05:26.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:26.163+0000 7f3f6f7fe640 1 -- 172.21.15.37:0/4129987468 learned_addr learned my addr 172.21.15.37:0/4129987468 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:05:26.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:26.163+0000 7f3f6effd640 1 --2- 172.21.15.37:0/4129987468 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f70101de0 0x7f3f70198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:26.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:26.163+0000 7f3f6e7fc640 1 --2- 172.21.15.37:0/4129987468 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f70102790 0x7f3f70198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:26.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:26.163+0000 7f3f6f7fe640 1 -- 172.21.15.37:0/4129987468 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f70102790 msgr2=0x7f3f70198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:26.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:26.163+0000 7f3f6f7fe640 1 --2- 172.21.15.37:0/4129987468 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f70102790 0x7f3f70198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:26.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:26.163+0000 7f3f6f7fe640 1 -- 172.21.15.37:0/4129987468 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f70101de0 msgr2=0x7f3f70198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:26.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:26.163+0000 7f3f6f7fe640 1 --2- 172.21.15.37:0/4129987468 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f70101de0 0x7f3f70198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:26.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:26.163+0000 7f3f6f7fe640 1 -- 172.21.15.37:0/4129987468 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f7019d3e0 con 0x7f3f70106f10 2024-09-19T06:05:26.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:26.163+0000 7f3f6f7fe640 1 --2- 172.21.15.37:0/4129987468 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f70106f10 0x7f3f7019cd00 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3f6800eaa0 tx=0x7f3f6800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:26.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:26.163+0000 7f3f57fff640 1 -- 172.21.15.37:0/4129987468 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f6800cdb0 con 0x7f3f70106f10 2024-09-19T06:05:26.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:26.163+0000 7f3f57fff640 1 -- 172.21.15.37:0/4129987468 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3f68005020 con 0x7f3f70106f10 2024-09-19T06:05:26.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:26.163+0000 7f3f754d5640 1 -- 172.21.15.37:0/4129987468 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f7019d6d0 con 0x7f3f70106f10 2024-09-19T06:05:26.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:26.163+0000 7f3f57fff640 1 -- 172.21.15.37:0/4129987468 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f680116b0 con 0x7f3f70106f10 2024-09-19T06:05:26.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:26.163+0000 7f3f754d5640 1 -- 172.21.15.37:0/4129987468 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f701a4fb0 con 0x7f3f70106f10 2024-09-19T06:05:26.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:26.164+0000 7f3f754d5640 1 -- 172.21.15.37:0/4129987468 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f701021c0 con 0x7f3f70106f10 2024-09-19T06:05:26.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:26.166+0000 7f3f57fff640 1 -- 172.21.15.37:0/4129987468 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f3f68005560 con 0x7f3f70106f10 2024-09-19T06:05:26.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:26.167+0000 7f3f57fff640 1 --2- 172.21.15.37:0/4129987468 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f3f580a3350 0x7f3f580a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:26.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:26.167+0000 7f3f6effd640 1 --2- 172.21.15.37:0/4129987468 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f3f580a3350 0x7f3f580a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:26.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:26.167+0000 7f3f57fff640 1 -- 172.21.15.37:0/4129987468 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f3f680d0360 con 0x7f3f70106f10 2024-09-19T06:05:26.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:26.167+0000 7f3f6effd640 1 --2- 172.21.15.37:0/4129987468 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f3f580a3350 0x7f3f580a5810 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3f60005d00 tx=0x7f3f6000b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:26.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:26.170+0000 7f3f57fff640 1 -- 172.21.15.37:0/4129987468 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3f68016030 con 0x7f3f70106f10 2024-09-19T06:05:26.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:25 smithi117 ceph-mon[35050]: pgmap v325: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 935 B/s rd, 1 op/s; 3 B/s, 0 keys/s, 0 objects/s recovering 2024-09-19T06:05:26.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:25 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/446478146' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T06:05:26.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:26.347+0000 7f3f754d5640 1 -- 172.21.15.37:0/4129987468 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f3f7010a150 con 0x7f3f70106f10 2024-09-19T06:05:26.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:26.348+0000 7f3f57fff640 1 -- 172.21.15.37:0/4129987468 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f3f6809cbe0 con 0x7f3f70106f10 2024-09-19T06:05:26.350 INFO:teuthology.orchestra.run.smithi037.stdout:210453397553 2024-09-19T06:05:26.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:26.349+0000 7f3f754d5640 1 -- 172.21.15.37:0/4129987468 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f3f580a3350 msgr2=0x7f3f580a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:26.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:26.349+0000 7f3f754d5640 1 --2- 172.21.15.37:0/4129987468 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f3f580a3350 0x7f3f580a5810 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3f60005d00 tx=0x7f3f6000b410 comp rx=0 tx=0).stop 2024-09-19T06:05:26.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:26.349+0000 7f3f754d5640 1 -- 172.21.15.37:0/4129987468 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f70106f10 msgr2=0x7f3f7019cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:26.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:26.349+0000 7f3f754d5640 1 --2- 172.21.15.37:0/4129987468 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f70106f10 0x7f3f7019cd00 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3f6800eaa0 tx=0x7f3f6800ef60 comp rx=0 tx=0).stop 2024-09-19T06:05:26.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:26.350+0000 7f3f754d5640 1 -- 172.21.15.37:0/4129987468 shutdown_connections 2024-09-19T06:05:26.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:26.350+0000 7f3f754d5640 1 --2- 172.21.15.37:0/4129987468 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f3f580a3350 0x7f3f580a5810 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:26.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:26.350+0000 7f3f754d5640 1 --2- 172.21.15.37:0/4129987468 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f70106f10 0x7f3f7019cd00 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:26.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:26.350+0000 7f3f754d5640 1 --2- 172.21.15.37:0/4129987468 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f70102790 0x7f3f70198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:26.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:26.350+0000 7f3f754d5640 1 --2- 172.21.15.37:0/4129987468 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f70101de0 0x7f3f70198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:26.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:26.350+0000 7f3f754d5640 1 -- 172.21.15.37:0/4129987468 >> 172.21.15.37:0/4129987468 conn(0x7f3f700fd8c0 msgr2=0x7f3f700fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:26.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:26.350+0000 7f3f754d5640 1 -- 172.21.15.37:0/4129987468 shutdown_connections 2024-09-19T06:05:26.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:26.350+0000 7f3f754d5640 1 -- 172.21.15.37:0/4129987468 wait complete. 2024-09-19T06:05:27.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:26 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/5374441' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T06:05:27.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:26 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/4129987468' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T06:05:27.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:26 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/5374441' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T06:05:27.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:26 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/4129987468' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T06:05:27.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:26 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/5374441' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T06:05:27.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:26 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/4129987468' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T06:05:27.389 INFO:tasks.cephadm.ceph_manager.ceph:need seq 270582939685 got 270582939687 for osd.9 2024-09-19T06:05:27.389 DEBUG:teuthology.parallel:result is None 2024-09-19T06:05:27.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:27.323+0000 7fd057648640 1 -- 172.21.15.37:0/502453791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd050102570 msgr2=0x7fd0501029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:27.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:27.323+0000 7fd057648640 1 --2- 172.21.15.37:0/502453791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd050102570 0x7fd0501029b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd040009900 tx=0x7fd04002a480 comp rx=0 tx=0).stop 2024-09-19T06:05:27.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:27.323+0000 7fd057648640 1 -- 172.21.15.37:0/502453791 shutdown_connections 2024-09-19T06:05:27.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:27.323+0000 7fd057648640 1 --2- 172.21.15.37:0/502453791 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd050102ef0 0x7fd05010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:27.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:27.323+0000 7fd057648640 1 --2- 172.21.15.37:0/502453791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd050102570 0x7fd0501029b0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:27.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:27.323+0000 7fd057648640 1 --2- 172.21.15.37:0/502453791 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd050100e20 0x7fd050101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:27.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:27.323+0000 7fd057648640 1 -- 172.21.15.37:0/502453791 >> 172.21.15.37:0/502453791 conn(0x7fd0500fc7d0 msgr2=0x7fd0500febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:27.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:27.323+0000 7fd057648640 1 -- 172.21.15.37:0/502453791 shutdown_connections 2024-09-19T06:05:27.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:27.323+0000 7fd057648640 1 -- 172.21.15.37:0/502453791 wait complete. 2024-09-19T06:05:27.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:27.324+0000 7fd057648640 1 Processor -- start 2024-09-19T06:05:27.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:27.324+0000 7fd057648640 1 -- start start 2024-09-19T06:05:27.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:27.324+0000 7fd057648640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd050100e20 0x7fd050198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:27.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:27.324+0000 7fd057648640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd050102570 0x7fd050198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:27.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:27.324+0000 7fd057648640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd050102ef0 0x7fd05019ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:27.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:27.324+0000 7fd057648640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd050110fc0 con 0x7fd050102570 2024-09-19T06:05:27.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:27.324+0000 7fd057648640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fd050110e40 con 0x7fd050102ef0 2024-09-19T06:05:27.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:27.324+0000 7fd057648640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd050111140 con 0x7fd050100e20 2024-09-19T06:05:27.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:27.324+0000 7fd054be3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd050102570 0x7fd050198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:27.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:27.324+0000 7fd054be3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd050102570 0x7fd050198a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50614/0 (socket says 172.21.15.37:50614) 2024-09-19T06:05:27.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:27.324+0000 7fd054be3640 1 -- 172.21.15.37:0/3209425638 learned_addr learned my addr 172.21.15.37:0/3209425638 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:05:27.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:27.324+0000 7fd0553e4640 1 --2- 172.21.15.37:0/3209425638 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd050100e20 0x7fd050198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:27.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:27.324+0000 7fd055be5640 1 --2- 172.21.15.37:0/3209425638 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd050102ef0 0x7fd05019ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:27.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:27.325+0000 7fd054be3640 1 -- 172.21.15.37:0/3209425638 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd050100e20 msgr2=0x7fd050198540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:27.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:27.325+0000 7fd054be3640 1 --2- 172.21.15.37:0/3209425638 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd050100e20 0x7fd050198540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:27.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:27.325+0000 7fd054be3640 1 -- 172.21.15.37:0/3209425638 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd050102ef0 msgr2=0x7fd05019ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:27.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:27.325+0000 7fd054be3640 1 --2- 172.21.15.37:0/3209425638 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd050102ef0 0x7fd05019ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:27.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:27.325+0000 7fd054be3640 1 -- 172.21.15.37:0/3209425638 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd05019d4f0 con 0x7fd050102570 2024-09-19T06:05:27.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:27.325+0000 7fd054be3640 1 --2- 172.21.15.37:0/3209425638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd050102570 0x7fd050198a80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd040006010 tx=0x7fd040003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:27.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:27.325+0000 7fd0467fc640 1 -- 172.21.15.37:0/3209425638 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd04003f070 con 0x7fd050102570 2024-09-19T06:05:27.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:27.325+0000 7fd057648640 1 -- 172.21.15.37:0/3209425638 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd05019d780 con 0x7fd050102570 2024-09-19T06:05:27.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:27.325+0000 7fd0467fc640 1 -- 172.21.15.37:0/3209425638 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd040031c30 con 0x7fd050102570 2024-09-19T06:05:27.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:27.325+0000 7fd0467fc640 1 -- 172.21.15.37:0/3209425638 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd040035030 con 0x7fd050102570 2024-09-19T06:05:27.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:27.325+0000 7fd057648640 1 -- 172.21.15.37:0/3209425638 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0501a50c0 con 0x7fd050102570 2024-09-19T06:05:27.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:27.326+0000 7fd057648640 1 -- 172.21.15.37:0/3209425638 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd050101200 con 0x7fd050102570 2024-09-19T06:05:27.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:27.328+0000 7fd0467fc640 1 -- 172.21.15.37:0/3209425638 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fd040042070 con 0x7fd050102570 2024-09-19T06:05:27.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:27.329+0000 7fd0467fc640 1 --2- 172.21.15.37:0/3209425638 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fd03c0a32d0 0x7fd03c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:27.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:27.329+0000 7fd0467fc640 1 -- 172.21.15.37:0/3209425638 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fd0400f0b60 con 0x7fd050102570 2024-09-19T06:05:27.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:27.329+0000 7fd0553e4640 1 --2- 172.21.15.37:0/3209425638 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fd03c0a32d0 0x7fd03c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:27.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:27.329+0000 7fd0553e4640 1 --2- 172.21.15.37:0/3209425638 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fd03c0a32d0 0x7fd03c0a5790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd04c005fd0 tx=0x7fd04c00b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:27.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:27.332+0000 7fd0467fc640 1 -- 172.21.15.37:0/3209425638 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd040031de0 con 0x7fd050102570 2024-09-19T06:05:27.488 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:05:27.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:27.520+0000 7fd057648640 1 -- 172.21.15.37:0/3209425638 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fd05010a0a0 con 0x7fd050102570 2024-09-19T06:05:27.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:27.520+0000 7fd0467fc640 1 -- 172.21.15.37:0/3209425638 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fd0400bcdd0 con 0x7fd050102570 2024-09-19T06:05:27.523 INFO:teuthology.orchestra.run.smithi037.stdout:158913790012 2024-09-19T06:05:27.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:27.523+0000 7fd057648640 1 -- 172.21.15.37:0/3209425638 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fd03c0a32d0 msgr2=0x7fd03c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:27.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:27.523+0000 7fd057648640 1 --2- 172.21.15.37:0/3209425638 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fd03c0a32d0 0x7fd03c0a5790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd04c005fd0 tx=0x7fd04c00b390 comp rx=0 tx=0).stop 2024-09-19T06:05:27.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:27.523+0000 7fd057648640 1 -- 172.21.15.37:0/3209425638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd050102570 msgr2=0x7fd050198a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:27.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:27.523+0000 7fd057648640 1 --2- 172.21.15.37:0/3209425638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd050102570 0x7fd050198a80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd040006010 tx=0x7fd040003c10 comp rx=0 tx=0).stop 2024-09-19T06:05:27.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:27.523+0000 7fd057648640 1 -- 172.21.15.37:0/3209425638 shutdown_connections 2024-09-19T06:05:27.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:27.523+0000 7fd057648640 1 --2- 172.21.15.37:0/3209425638 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fd03c0a32d0 0x7fd03c0a5790 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:27.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:27.523+0000 7fd057648640 1 --2- 172.21.15.37:0/3209425638 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd050102ef0 0x7fd05019ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:27.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:27.523+0000 7fd057648640 1 --2- 172.21.15.37:0/3209425638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd050102570 0x7fd050198a80 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:27.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:27.523+0000 7fd057648640 1 --2- 172.21.15.37:0/3209425638 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd050100e20 0x7fd050198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:27.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:27.523+0000 7fd057648640 1 -- 172.21.15.37:0/3209425638 >> 172.21.15.37:0/3209425638 conn(0x7fd0500fc7d0 msgr2=0x7fd05006a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:27.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:27.523+0000 7fd057648640 1 -- 172.21.15.37:0/3209425638 shutdown_connections 2024-09-19T06:05:27.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:27.523+0000 7fd057648640 1 -- 172.21.15.37:0/3209425638 wait complete. 2024-09-19T06:05:28.124 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:27 smithi037 ceph-mon[31211]: pgmap v326: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:05:28.124 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:27 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/3209425638' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T06:05:28.156 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411401 got 77309411403 for osd.2 2024-09-19T06:05:28.156 DEBUG:teuthology.parallel:result is None 2024-09-19T06:05:28.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:27 smithi099 ceph-mon[35300]: pgmap v326: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:05:28.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:27 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/3209425638' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T06:05:28.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:27 smithi117 ceph-mon[35050]: pgmap v326: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:05:28.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:27 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/3209425638' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T06:05:28.473 INFO:tasks.cephadm.ceph_manager.ceph:need seq 210453397552 got 210453397553 for osd.7 2024-09-19T06:05:28.474 DEBUG:teuthology.parallel:result is None 2024-09-19T06:05:29.727 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913790009 got 158913790012 for osd.5 2024-09-19T06:05:29.727 DEBUG:teuthology.parallel:result is None 2024-09-19T06:05:29.943 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:29 smithi037 ceph-mon[31211]: pgmap v327: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:05:30.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:29 smithi099 ceph-mon[35300]: pgmap v327: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:05:30.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:29 smithi117 ceph-mon[35050]: pgmap v327: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:05:30.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.564+0000 7f9315a04640 1 -- 172.21.15.37:0/46839042 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93101019f0 msgr2=0x7f9310101e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:30.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.564+0000 7f9315a04640 1 --2- 172.21.15.37:0/46839042 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93101019f0 0x7f9310101e50 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9304009930 tx=0x7f930402a420 comp rx=0 tx=0).stop 2024-09-19T06:05:30.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.564+0000 7f9315a04640 1 -- 172.21.15.37:0/46839042 shutdown_connections 2024-09-19T06:05:30.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.564+0000 7f9315a04640 1 --2- 172.21.15.37:0/46839042 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9310102390 0x7f931010e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:30.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.564+0000 7f9315a04640 1 --2- 172.21.15.37:0/46839042 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93101019f0 0x7f9310101e50 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:30.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.564+0000 7f9315a04640 1 --2- 172.21.15.37:0/46839042 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9310107b00 0x7f9310107ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:30.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.564+0000 7f9315a04640 1 -- 172.21.15.37:0/46839042 >> 172.21.15.37:0/46839042 conn(0x7f93100fd710 msgr2=0x7f93100ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:30.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.564+0000 7f9315a04640 1 -- 172.21.15.37:0/46839042 shutdown_connections 2024-09-19T06:05:30.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.564+0000 7f9315a04640 1 -- 172.21.15.37:0/46839042 wait complete. 2024-09-19T06:05:30.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.565+0000 7f9315a04640 1 Processor -- start 2024-09-19T06:05:30.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.565+0000 7f9315a04640 1 -- start start 2024-09-19T06:05:30.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.566+0000 7f9315a04640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93101019f0 0x7f93100744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:30.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.566+0000 7f9315a04640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9310102390 0x7f9310074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:30.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.566+0000 7f9315a04640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9310107b00 0x7f9310074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:30.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.566+0000 7f9315a04640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9310111f00 con 0x7f9310102390 2024-09-19T06:05:30.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.566+0000 7f9315a04640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f9310111d80 con 0x7f9310107b00 2024-09-19T06:05:30.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.566+0000 7f9315a04640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9310112080 con 0x7f93101019f0 2024-09-19T06:05:30.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.566+0000 7f930e7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9310102390 0x7f9310074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:30.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.566+0000 7f930e7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9310102390 0x7f9310074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50634/0 (socket says 172.21.15.37:50634) 2024-09-19T06:05:30.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.566+0000 7f930e7fc640 1 -- 172.21.15.37:0/1286015238 learned_addr learned my addr 172.21.15.37:0/1286015238 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:05:30.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.566+0000 7f930f7fe640 1 --2- 172.21.15.37:0/1286015238 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9310107b00 0x7f9310074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:30.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.566+0000 7f930effd640 1 --2- 172.21.15.37:0/1286015238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93101019f0 0x7f93100744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:30.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.566+0000 7f930e7fc640 1 -- 172.21.15.37:0/1286015238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93101019f0 msgr2=0x7f93100744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:30.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.566+0000 7f930e7fc640 1 --2- 172.21.15.37:0/1286015238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93101019f0 0x7f93100744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:30.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.566+0000 7f930e7fc640 1 -- 172.21.15.37:0/1286015238 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9310107b00 msgr2=0x7f9310074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:30.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.566+0000 7f930e7fc640 1 --2- 172.21.15.37:0/1286015238 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9310107b00 0x7f9310074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:30.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.566+0000 7f930e7fc640 1 -- 172.21.15.37:0/1286015238 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93101a6810 con 0x7f9310102390 2024-09-19T06:05:30.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.566+0000 7f930effd640 1 --2- 172.21.15.37:0/1286015238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93101019f0 0x7f93100744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:05:30.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.566+0000 7f930e7fc640 1 --2- 172.21.15.37:0/1286015238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9310102390 0x7f9310074a30 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9304009230 tx=0x7f9304004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:30.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.567+0000 7f9314a02640 1 -- 172.21.15.37:0/1286015238 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f930403f030 con 0x7f9310102390 2024-09-19T06:05:30.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.567+0000 7f9314a02640 1 -- 172.21.15.37:0/1286015238 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9304003ad0 con 0x7f9310102390 2024-09-19T06:05:30.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.567+0000 7f9315a04640 1 -- 172.21.15.37:0/1286015238 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93101a6aa0 con 0x7f9310102390 2024-09-19T06:05:30.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.567+0000 7f9314a02640 1 -- 172.21.15.37:0/1286015238 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9304035070 con 0x7f9310102390 2024-09-19T06:05:30.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.567+0000 7f9315a04640 1 -- 172.21.15.37:0/1286015238 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93101a6f80 con 0x7f9310102390 2024-09-19T06:05:30.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.568+0000 7f9315a04640 1 -- 172.21.15.37:0/1286015238 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9310101e50 con 0x7f9310102390 2024-09-19T06:05:30.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.569+0000 7f9314a02640 1 -- 172.21.15.37:0/1286015238 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f9304042030 con 0x7f9310102390 2024-09-19T06:05:30.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.570+0000 7f9314a02640 1 --2- 172.21.15.37:0/1286015238 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f92f80a32d0 0x7f92f80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:30.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.570+0000 7f930effd640 1 --2- 172.21.15.37:0/1286015238 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f92f80a32d0 0x7f92f80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:30.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.570+0000 7f9314a02640 1 -- 172.21.15.37:0/1286015238 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f93040efff0 con 0x7f9310102390 2024-09-19T06:05:30.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.570+0000 7f930effd640 1 --2- 172.21.15.37:0/1286015238 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f92f80a32d0 0x7f92f80a5790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9300007350 tx=0x7f93000072e0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:30.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.574+0000 7f9314a02640 1 -- 172.21.15.37:0/1286015238 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f93040bc7f0 con 0x7f9310102390 2024-09-19T06:05:30.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.752+0000 7f9315a04640 1 -- 172.21.15.37:0/1286015238 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f93101a7150 con 0x7f9310102390 2024-09-19T06:05:30.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.752+0000 7f9314a02640 1 -- 172.21.15.37:0/1286015238 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f93040bc0f0 con 0x7f9310102390 2024-09-19T06:05:30.754 INFO:teuthology.orchestra.run.smithi037.stdout:107374182470 2024-09-19T06:05:30.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.754+0000 7f9315a04640 1 -- 172.21.15.37:0/1286015238 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f92f80a32d0 msgr2=0x7f92f80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:30.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.754+0000 7f9315a04640 1 --2- 172.21.15.37:0/1286015238 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f92f80a32d0 0x7f92f80a5790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9300007350 tx=0x7f93000072e0 comp rx=0 tx=0).stop 2024-09-19T06:05:30.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.754+0000 7f9315a04640 1 -- 172.21.15.37:0/1286015238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9310102390 msgr2=0x7f9310074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:30.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.754+0000 7f9315a04640 1 --2- 172.21.15.37:0/1286015238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9310102390 0x7f9310074a30 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9304009230 tx=0x7f9304004270 comp rx=0 tx=0).stop 2024-09-19T06:05:30.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.754+0000 7f9315a04640 1 -- 172.21.15.37:0/1286015238 shutdown_connections 2024-09-19T06:05:30.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.754+0000 7f9315a04640 1 --2- 172.21.15.37:0/1286015238 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f92f80a32d0 0x7f92f80a5790 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:30.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.754+0000 7f9315a04640 1 --2- 172.21.15.37:0/1286015238 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9310107b00 0x7f9310074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:30.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.754+0000 7f9315a04640 1 --2- 172.21.15.37:0/1286015238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9310102390 0x7f9310074a30 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:30.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.754+0000 7f9315a04640 1 --2- 172.21.15.37:0/1286015238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93101019f0 0x7f93100744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:30.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.754+0000 7f9315a04640 1 -- 172.21.15.37:0/1286015238 >> 172.21.15.37:0/1286015238 conn(0x7f93100fd710 msgr2=0x7f93100fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:30.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.754+0000 7f9315a04640 1 -- 172.21.15.37:0/1286015238 shutdown_connections 2024-09-19T06:05:30.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.754+0000 7f9315a04640 1 -- 172.21.15.37:0/1286015238 wait complete. 2024-09-19T06:05:30.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.768+0000 7f271e346640 1 -- 172.21.15.37:0/1463163760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2718100aa0 msgr2=0x7f271810ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:30.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.768+0000 7f271e346640 1 --2- 172.21.15.37:0/1463163760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2718100aa0 0x7f271810ea20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2710009ca0 tx=0x7f271002a8c0 comp rx=0 tx=0).stop 2024-09-19T06:05:30.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.768+0000 7f271e346640 1 -- 172.21.15.37:0/1463163760 shutdown_connections 2024-09-19T06:05:30.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.768+0000 7f271e346640 1 --2- 172.21.15.37:0/1463163760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2718100aa0 0x7f271810ea20 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:30.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.768+0000 7f271e346640 1 --2- 172.21.15.37:0/1463163760 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2718100100 0x7f2718100560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:30.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.768+0000 7f271e346640 1 --2- 172.21.15.37:0/1463163760 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2718106b80 0x7f2718106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:30.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.768+0000 7f271e346640 1 -- 172.21.15.37:0/1463163760 >> 172.21.15.37:0/1463163760 conn(0x7f2718077230 msgr2=0x7f27180fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:30.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.768+0000 7f271e346640 1 -- 172.21.15.37:0/1463163760 shutdown_connections 2024-09-19T06:05:30.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.768+0000 7f271e346640 1 -- 172.21.15.37:0/1463163760 wait complete. 2024-09-19T06:05:30.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.769+0000 7f271e346640 1 Processor -- start 2024-09-19T06:05:30.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.769+0000 7f271e346640 1 -- start start 2024-09-19T06:05:30.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.769+0000 7f271e346640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2718100100 0x7f2718198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:30.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.769+0000 7f271e346640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2718100aa0 0x7f27181989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:30.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.769+0000 7f271e346640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2718106b80 0x7f271819cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:30.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.769+0000 7f271e346640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2718112050 con 0x7f2718100aa0 2024-09-19T06:05:30.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.769+0000 7f271e346640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f2718111ed0 con 0x7f2718106b80 2024-09-19T06:05:30.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.769+0000 7f271e346640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f27181121d0 con 0x7f2718100100 2024-09-19T06:05:30.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.769+0000 7f27177fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2718100aa0 0x7f27181989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:30.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.769+0000 7f27177fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2718100aa0 0x7f27181989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50640/0 (socket says 172.21.15.37:50640) 2024-09-19T06:05:30.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.769+0000 7f27177fe640 1 -- 172.21.15.37:0/1691542002 learned_addr learned my addr 172.21.15.37:0/1691542002 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:05:30.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.769+0000 7f2717fff640 1 --2- 172.21.15.37:0/1691542002 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2718100100 0x7f2718198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:30.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.769+0000 7f271c8e3640 1 --2- 172.21.15.37:0/1691542002 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2718106b80 0x7f271819cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:30.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.770+0000 7f27177fe640 1 -- 172.21.15.37:0/1691542002 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2718100100 msgr2=0x7f2718198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:30.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.770+0000 7f27177fe640 1 --2- 172.21.15.37:0/1691542002 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2718100100 0x7f2718198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:30.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.770+0000 7f27177fe640 1 -- 172.21.15.37:0/1691542002 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2718106b80 msgr2=0x7f271819cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:30.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.770+0000 7f27177fe640 1 --2- 172.21.15.37:0/1691542002 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2718106b80 0x7f271819cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:30.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.770+0000 7f27177fe640 1 -- 172.21.15.37:0/1691542002 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f271819d440 con 0x7f2718100aa0 2024-09-19T06:05:30.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.770+0000 7f2717fff640 1 --2- 172.21.15.37:0/1691542002 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2718100100 0x7f2718198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:05:30.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.770+0000 7f271c8e3640 1 --2- 172.21.15.37:0/1691542002 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2718106b80 0x7f271819cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:05:30.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.770+0000 7f27177fe640 1 --2- 172.21.15.37:0/1691542002 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2718100aa0 0x7f27181989d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f270c00e9f0 tx=0x7f270c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:30.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.770+0000 7f27157fa640 1 -- 172.21.15.37:0/1691542002 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f270c00cd80 con 0x7f2718100aa0 2024-09-19T06:05:30.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.770+0000 7f271e346640 1 -- 172.21.15.37:0/1691542002 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f271819d730 con 0x7f2718100aa0 2024-09-19T06:05:30.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.770+0000 7f27157fa640 1 -- 172.21.15.37:0/1691542002 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f270c005500 con 0x7f2718100aa0 2024-09-19T06:05:30.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.770+0000 7f27157fa640 1 -- 172.21.15.37:0/1691542002 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f270c010690 con 0x7f2718100aa0 2024-09-19T06:05:30.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.770+0000 7f271e346640 1 -- 172.21.15.37:0/1691542002 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27181a5010 con 0x7f2718100aa0 2024-09-19T06:05:30.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.771+0000 7f271e346640 1 -- 172.21.15.37:0/1691542002 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2718100560 con 0x7f2718100aa0 2024-09-19T06:05:30.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.773+0000 7f27157fa640 1 -- 172.21.15.37:0/1691542002 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f270c0046c0 con 0x7f2718100aa0 2024-09-19T06:05:30.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.774+0000 7f27157fa640 1 --2- 172.21.15.37:0/1691542002 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f27000a32d0 0x7f27000a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:30.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.774+0000 7f27157fa640 1 -- 172.21.15.37:0/1691542002 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f270c0d0610 con 0x7f2718100aa0 2024-09-19T06:05:30.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.774+0000 7f2717fff640 1 --2- 172.21.15.37:0/1691542002 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f27000a32d0 0x7f27000a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:30.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.775+0000 7f2717fff640 1 --2- 172.21.15.37:0/1691542002 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f27000a32d0 0x7f27000a5790 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2708005fd0 tx=0x7f270800b5f0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:30.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.778+0000 7f27157fa640 1 -- 172.21.15.37:0/1691542002 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f270c054210 con 0x7f2718100aa0 2024-09-19T06:05:30.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.958+0000 7f271e346640 1 -- 172.21.15.37:0/1691542002 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f27181997f0 con 0x7f2718100aa0 2024-09-19T06:05:30.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.959+0000 7f27157fa640 1 -- 172.21.15.37:0/1691542002 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f270c01f340 con 0x7f2718100aa0 2024-09-19T06:05:30.961 INFO:teuthology.orchestra.run.smithi037.stdout:137438953537 2024-09-19T06:05:30.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.961+0000 7f271e346640 1 -- 172.21.15.37:0/1691542002 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f27000a32d0 msgr2=0x7f27000a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:30.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.961+0000 7f271e346640 1 --2- 172.21.15.37:0/1691542002 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f27000a32d0 0x7f27000a5790 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2708005fd0 tx=0x7f270800b5f0 comp rx=0 tx=0).stop 2024-09-19T06:05:30.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.961+0000 7f271e346640 1 -- 172.21.15.37:0/1691542002 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2718100aa0 msgr2=0x7f27181989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:30.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.961+0000 7f271e346640 1 --2- 172.21.15.37:0/1691542002 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2718100aa0 0x7f27181989d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f270c00e9f0 tx=0x7f270c00edf0 comp rx=0 tx=0).stop 2024-09-19T06:05:30.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.961+0000 7f271e346640 1 -- 172.21.15.37:0/1691542002 shutdown_connections 2024-09-19T06:05:30.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.961+0000 7f271e346640 1 --2- 172.21.15.37:0/1691542002 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f27000a32d0 0x7f27000a5790 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:30.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.961+0000 7f271e346640 1 --2- 172.21.15.37:0/1691542002 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2718106b80 0x7f271819cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:30.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.961+0000 7f271e346640 1 --2- 172.21.15.37:0/1691542002 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2718100aa0 0x7f27181989d0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:30.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.961+0000 7f271e346640 1 --2- 172.21.15.37:0/1691542002 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2718100100 0x7f2718198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:30.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.961+0000 7f271e346640 1 -- 172.21.15.37:0/1691542002 >> 172.21.15.37:0/1691542002 conn(0x7f2718077230 msgr2=0x7f2718104b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:30.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.961+0000 7f271e346640 1 -- 172.21.15.37:0/1691542002 shutdown_connections 2024-09-19T06:05:30.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.961+0000 7f271e346640 1 -- 172.21.15.37:0/1691542002 wait complete. 2024-09-19T06:05:31.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.995+0000 7ff1f6ac4640 1 -- 172.21.15.37:0/4145904359 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1f0100e20 msgr2=0x7ff1f0101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:31.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.995+0000 7ff1f6ac4640 1 --2- 172.21.15.37:0/4145904359 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1f0100e20 0x7ff1f0101200 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff1e4009900 tx=0x7ff1e402a480 comp rx=0 tx=0).stop 2024-09-19T06:05:31.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.995+0000 7ff1f6ac4640 1 -- 172.21.15.37:0/4145904359 shutdown_connections 2024-09-19T06:05:31.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.995+0000 7ff1f6ac4640 1 --2- 172.21.15.37:0/4145904359 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1f0102ef0 0x7ff1f010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:31.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.995+0000 7ff1f6ac4640 1 --2- 172.21.15.37:0/4145904359 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1f0102570 0x7ff1f01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:31.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.995+0000 7ff1f6ac4640 1 --2- 172.21.15.37:0/4145904359 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1f0100e20 0x7ff1f0101200 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:31.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.995+0000 7ff1f6ac4640 1 -- 172.21.15.37:0/4145904359 >> 172.21.15.37:0/4145904359 conn(0x7ff1f00fc7d0 msgr2=0x7ff1f00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:31.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.995+0000 7ff1f6ac4640 1 -- 172.21.15.37:0/4145904359 shutdown_connections 2024-09-19T06:05:31.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.995+0000 7ff1f6ac4640 1 -- 172.21.15.37:0/4145904359 wait complete. 2024-09-19T06:05:31.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.995+0000 7ff1f6ac4640 1 Processor -- start 2024-09-19T06:05:31.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.995+0000 7ff1f6ac4640 1 -- start start 2024-09-19T06:05:31.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.996+0000 7ff1f6ac4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1f0100e20 0x7ff1f0103c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:31.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.996+0000 7ff1f6ac4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1f0102570 0x7ff1f01041b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:31.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.996+0000 7ff1f6ac4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1f0102ef0 0x7ff1f01046f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:31.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.996+0000 7ff1f6ac4640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f0110f80 con 0x7ff1f0102570 2024-09-19T06:05:31.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.996+0000 7ff1f6ac4640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f0110e00 con 0x7ff1f0100e20 2024-09-19T06:05:31.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.996+0000 7ff1f6ac4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f0111100 con 0x7ff1f0102ef0 2024-09-19T06:05:31.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.996+0000 7ff1effff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1f0102570 0x7ff1f01041b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:31.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.996+0000 7ff1effff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1f0102570 0x7ff1f01041b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50658/0 (socket says 172.21.15.37:50658) 2024-09-19T06:05:31.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.996+0000 7ff1effff640 1 -- 172.21.15.37:0/1369896730 learned_addr learned my addr 172.21.15.37:0/1369896730 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:05:31.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.996+0000 7ff1f5061640 1 --2- 172.21.15.37:0/1369896730 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1f0102ef0 0x7ff1f01046f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:31.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.996+0000 7ff1f4860640 1 --2- 172.21.15.37:0/1369896730 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1f0100e20 0x7ff1f0103c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:31.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.996+0000 7ff1effff640 1 -- 172.21.15.37:0/1369896730 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1f0102ef0 msgr2=0x7ff1f01046f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:31.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.996+0000 7ff1effff640 1 --2- 172.21.15.37:0/1369896730 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1f0102ef0 0x7ff1f01046f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:31.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.996+0000 7ff1effff640 1 -- 172.21.15.37:0/1369896730 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1f0100e20 msgr2=0x7ff1f0103c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:31.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.996+0000 7ff1effff640 1 --2- 172.21.15.37:0/1369896730 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1f0100e20 0x7ff1f0103c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:31.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.996+0000 7ff1effff640 1 -- 172.21.15.37:0/1369896730 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1f01a69c0 con 0x7ff1f0102570 2024-09-19T06:05:31.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.996+0000 7ff1f4860640 1 --2- 172.21.15.37:0/1369896730 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1f0100e20 0x7ff1f0103c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:05:31.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.996+0000 7ff1effff640 1 --2- 172.21.15.37:0/1369896730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1f0102570 0x7ff1f01041b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc00d770 tx=0x7ff1dc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:31.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.997+0000 7ff1edffb640 1 -- 172.21.15.37:0/1369896730 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1dc017070 con 0x7ff1f0102570 2024-09-19T06:05:31.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.997+0000 7ff1edffb640 1 -- 172.21.15.37:0/1369896730 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1dc005500 con 0x7ff1f0102570 2024-09-19T06:05:31.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.997+0000 7ff1f6ac4640 1 -- 172.21.15.37:0/1369896730 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1f01a6cb0 con 0x7ff1f0102570 2024-09-19T06:05:31.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.997+0000 7ff1edffb640 1 -- 172.21.15.37:0/1369896730 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1dc004e00 con 0x7ff1f0102570 2024-09-19T06:05:31.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.997+0000 7ff1f6ac4640 1 -- 172.21.15.37:0/1369896730 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1f01a71a0 con 0x7ff1f0102570 2024-09-19T06:05:31.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.998+0000 7ff1f6ac4640 1 -- 172.21.15.37:0/1369896730 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1f0101200 con 0x7ff1f0102570 2024-09-19T06:05:31.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:30.999+0000 7ff1edffb640 1 -- 172.21.15.37:0/1369896730 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7ff1dc004fa0 con 0x7ff1f0102570 2024-09-19T06:05:31.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:31.000+0000 7ff1edffb640 1 --2- 172.21.15.37:0/1369896730 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7ff1e00a32d0 0x7ff1e00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:31.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:31.000+0000 7ff1edffb640 1 -- 172.21.15.37:0/1369896730 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7ff1dc0cfc90 con 0x7ff1f0102570 2024-09-19T06:05:31.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:31.000+0000 7ff1f4860640 1 --2- 172.21.15.37:0/1369896730 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7ff1e00a32d0 0x7ff1e00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:31.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:31.000+0000 7ff1f4860640 1 --2- 172.21.15.37:0/1369896730 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7ff1e00a32d0 0x7ff1e00a5790 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff1e4005ab0 tx=0x7ff1e4005a20 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:31.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:31.003+0000 7ff1edffb640 1 -- 172.21.15.37:0/1369896730 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff1dc09c490 con 0x7ff1f0102570 2024-09-19T06:05:31.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:31.180+0000 7ff1f6ac4640 1 -- 172.21.15.37:0/1369896730 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7ff1f01a7370 con 0x7ff1f0102570 2024-09-19T06:05:31.182 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:30 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/1286015238' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T06:05:31.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:31.180+0000 7ff1edffb640 1 -- 172.21.15.37:0/1369896730 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7ff1dc09bd90 con 0x7ff1f0102570 2024-09-19T06:05:31.183 INFO:teuthology.orchestra.run.smithi037.stdout:322122547231 2024-09-19T06:05:31.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:31.182+0000 7ff1f6ac4640 1 -- 172.21.15.37:0/1369896730 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7ff1e00a32d0 msgr2=0x7ff1e00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:31.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:31.182+0000 7ff1f6ac4640 1 --2- 172.21.15.37:0/1369896730 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7ff1e00a32d0 0x7ff1e00a5790 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff1e4005ab0 tx=0x7ff1e4005a20 comp rx=0 tx=0).stop 2024-09-19T06:05:31.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:31.182+0000 7ff1f6ac4640 1 -- 172.21.15.37:0/1369896730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1f0102570 msgr2=0x7ff1f01041b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:31.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:31.182+0000 7ff1f6ac4640 1 --2- 172.21.15.37:0/1369896730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1f0102570 0x7ff1f01041b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc00d770 tx=0x7ff1dc00dc30 comp rx=0 tx=0).stop 2024-09-19T06:05:31.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:31.182+0000 7ff1f6ac4640 1 -- 172.21.15.37:0/1369896730 shutdown_connections 2024-09-19T06:05:31.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:31.182+0000 7ff1f6ac4640 1 --2- 172.21.15.37:0/1369896730 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7ff1e00a32d0 0x7ff1e00a5790 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:31.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:31.182+0000 7ff1f6ac4640 1 --2- 172.21.15.37:0/1369896730 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1f0102ef0 0x7ff1f01046f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:31.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:31.182+0000 7ff1f6ac4640 1 --2- 172.21.15.37:0/1369896730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1f0102570 0x7ff1f01041b0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:31.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:31.182+0000 7ff1f6ac4640 1 --2- 172.21.15.37:0/1369896730 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1f0100e20 0x7ff1f0103c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:31.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:31.182+0000 7ff1f6ac4640 1 -- 172.21.15.37:0/1369896730 >> 172.21.15.37:0/1369896730 conn(0x7ff1f00fc7d0 msgr2=0x7ff1f0105eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:31.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:31.182+0000 7ff1f6ac4640 1 -- 172.21.15.37:0/1369896730 shutdown_connections 2024-09-19T06:05:31.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:31.182+0000 7ff1f6ac4640 1 -- 172.21.15.37:0/1369896730 wait complete. 2024-09-19T06:05:31.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:30 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/1286015238' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T06:05:31.253 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:30 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/1286015238' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T06:05:31.344 INFO:tasks.cephadm.ceph_manager.ceph:need seq 292057776160 got 292057776163 for osd.10 2024-09-19T06:05:31.344 DEBUG:teuthology.parallel:result is None 2024-09-19T06:05:32.012 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:31 smithi037 ceph-mon[31211]: pgmap v328: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:05:32.012 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:31 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/1691542002' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T06:05:32.012 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:31 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/1369896730' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T06:05:32.042 INFO:tasks.cephadm.ceph_manager.ceph:need seq 322122547229 got 322122547231 for osd.11 2024-09-19T06:05:32.042 DEBUG:teuthology.parallel:result is None 2024-09-19T06:05:32.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:31 smithi099 ceph-mon[35300]: pgmap v328: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:05:32.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:31 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/1691542002' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T06:05:32.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:31 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/1369896730' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T06:05:32.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:31 smithi117 ceph-mon[35050]: pgmap v328: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:05:32.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:31 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/1691542002' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T06:05:32.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:31 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/1369896730' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T06:05:32.500 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953535 got 137438953537 for osd.4 2024-09-19T06:05:32.501 DEBUG:teuthology.parallel:result is None 2024-09-19T06:05:32.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:32.232+0000 7efd9e155640 1 -- 172.21.15.37:0/1624951066 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd98101420 msgr2=0x7efd9810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:32.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:32.232+0000 7efd9e155640 1 --2- 172.21.15.37:0/1624951066 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd98101420 0x7efd9810d950 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7efd90009cd0 tx=0x7efd9002a8e0 comp rx=0 tx=0).stop 2024-09-19T06:05:32.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:32.232+0000 7efd9e155640 1 -- 172.21.15.37:0/1624951066 shutdown_connections 2024-09-19T06:05:32.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:32.232+0000 7efd9e155640 1 --2- 172.21.15.37:0/1624951066 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd98101420 0x7efd9810d950 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:32.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:32.232+0000 7efd9e155640 1 --2- 172.21.15.37:0/1624951066 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efd98100a80 0x7efd98100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:32.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:32.232+0000 7efd9e155640 1 --2- 172.21.15.37:0/1624951066 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efd98106a80 0x7efd98106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:32.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:32.232+0000 7efd9e155640 1 -- 172.21.15.37:0/1624951066 >> 172.21.15.37:0/1624951066 conn(0x7efd980fc7a0 msgr2=0x7efd980febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:32.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:32.232+0000 7efd9e155640 1 -- 172.21.15.37:0/1624951066 shutdown_connections 2024-09-19T06:05:32.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:32.232+0000 7efd9e155640 1 -- 172.21.15.37:0/1624951066 wait complete. 2024-09-19T06:05:32.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:32.233+0000 7efd9e155640 1 Processor -- start 2024-09-19T06:05:32.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:32.233+0000 7efd9e155640 1 -- start start 2024-09-19T06:05:32.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:32.233+0000 7efd9e155640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efd98100a80 0x7efd98198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:32.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:32.233+0000 7efd9e155640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd98101420 0x7efd98198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:32.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:32.233+0000 7efd9e155640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efd98106a80 0x7efd9819ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:32.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:32.233+0000 7efd9e155640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7efd98110e80 con 0x7efd98101420 2024-09-19T06:05:32.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:32.233+0000 7efd9e155640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7efd98110d00 con 0x7efd98100a80 2024-09-19T06:05:32.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:32.233+0000 7efd9e155640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7efd98111000 con 0x7efd98106a80 2024-09-19T06:05:32.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:32.233+0000 7efd96ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd98101420 0x7efd98198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:32.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:32.234+0000 7efd96ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd98101420 0x7efd98198940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50674/0 (socket says 172.21.15.37:50674) 2024-09-19T06:05:32.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:32.234+0000 7efd96ffd640 1 -- 172.21.15.37:0/2143330613 learned_addr learned my addr 172.21.15.37:0/2143330613 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:05:32.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:32.234+0000 7efd97fff640 1 --2- 172.21.15.37:0/2143330613 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efd98106a80 0x7efd9819ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:32.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:32.234+0000 7efd977fe640 1 --2- 172.21.15.37:0/2143330613 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efd98100a80 0x7efd98198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:32.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:32.234+0000 7efd96ffd640 1 -- 172.21.15.37:0/2143330613 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efd98106a80 msgr2=0x7efd9819ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:32.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:32.234+0000 7efd96ffd640 1 --2- 172.21.15.37:0/2143330613 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efd98106a80 0x7efd9819ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:32.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:32.234+0000 7efd96ffd640 1 -- 172.21.15.37:0/2143330613 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efd98100a80 msgr2=0x7efd98198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:32.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:32.234+0000 7efd96ffd640 1 --2- 172.21.15.37:0/2143330613 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efd98100a80 0x7efd98198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:32.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:32.234+0000 7efd96ffd640 1 -- 172.21.15.37:0/2143330613 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd9819d3b0 con 0x7efd98101420 2024-09-19T06:05:32.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:32.234+0000 7efd96ffd640 1 --2- 172.21.15.37:0/2143330613 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd98101420 0x7efd98198940 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7efd8c00c890 tx=0x7efd8c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:32.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:32.234+0000 7efd94ff9640 1 -- 172.21.15.37:0/2143330613 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd8c004220 con 0x7efd98101420 2024-09-19T06:05:32.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:32.234+0000 7efd94ff9640 1 -- 172.21.15.37:0/2143330613 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd8c0043c0 con 0x7efd98101420 2024-09-19T06:05:32.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:32.234+0000 7efd94ff9640 1 -- 172.21.15.37:0/2143330613 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd8c0049e0 con 0x7efd98101420 2024-09-19T06:05:32.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:32.234+0000 7efd9e155640 1 -- 172.21.15.37:0/2143330613 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd9819d6a0 con 0x7efd98101420 2024-09-19T06:05:32.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:32.234+0000 7efd9e155640 1 -- 172.21.15.37:0/2143330613 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd981a4f80 con 0x7efd98101420 2024-09-19T06:05:32.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:32.235+0000 7efd9e155640 1 -- 172.21.15.37:0/2143330613 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd98100ee0 con 0x7efd98101420 2024-09-19T06:05:32.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:32.237+0000 7efd94ff9640 1 -- 172.21.15.37:0/2143330613 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7efd8c0079b0 con 0x7efd98101420 2024-09-19T06:05:32.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:32.238+0000 7efd94ff9640 1 --2- 172.21.15.37:0/2143330613 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7efd800a3350 0x7efd800a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:32.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:32.238+0000 7efd94ff9640 1 -- 172.21.15.37:0/2143330613 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7efd8c0cfec0 con 0x7efd98101420 2024-09-19T06:05:32.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:32.238+0000 7efd977fe640 1 --2- 172.21.15.37:0/2143330613 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7efd800a3350 0x7efd800a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:32.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:32.239+0000 7efd977fe640 1 --2- 172.21.15.37:0/2143330613 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7efd800a3350 0x7efd800a5810 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7efd88005d90 tx=0x7efd88005d20 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:32.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:32.241+0000 7efd94ff9640 1 -- 172.21.15.37:0/2143330613 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7efd8c014030 con 0x7efd98101420 2024-09-19T06:05:32.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:32.420+0000 7efd9e155640 1 -- 172.21.15.37:0/2143330613 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7efd98199760 con 0x7efd98101420 2024-09-19T06:05:32.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:32.421+0000 7efd94ff9640 1 -- 172.21.15.37:0/2143330613 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7efd98199760 con 0x7efd98101420 2024-09-19T06:05:32.586 INFO:teuthology.orchestra.run.smithi037.stdout:34359738454 2024-09-19T06:05:32.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:32.423+0000 7efd9e155640 1 -- 172.21.15.37:0/2143330613 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7efd800a3350 msgr2=0x7efd800a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:32.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:32.423+0000 7efd9e155640 1 --2- 172.21.15.37:0/2143330613 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7efd800a3350 0x7efd800a5810 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7efd88005d90 tx=0x7efd88005d20 comp rx=0 tx=0).stop 2024-09-19T06:05:32.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:32.423+0000 7efd9e155640 1 -- 172.21.15.37:0/2143330613 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd98101420 msgr2=0x7efd98198940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:32.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:32.423+0000 7efd9e155640 1 --2- 172.21.15.37:0/2143330613 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd98101420 0x7efd98198940 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7efd8c00c890 tx=0x7efd8c00cd50 comp rx=0 tx=0).stop 2024-09-19T06:05:32.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:32.423+0000 7efd9e155640 1 -- 172.21.15.37:0/2143330613 shutdown_connections 2024-09-19T06:05:32.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:32.423+0000 7efd9e155640 1 --2- 172.21.15.37:0/2143330613 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7efd800a3350 0x7efd800a5810 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:32.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:32.423+0000 7efd9e155640 1 --2- 172.21.15.37:0/2143330613 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efd98106a80 0x7efd9819ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:32.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:32.423+0000 7efd9e155640 1 --2- 172.21.15.37:0/2143330613 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd98101420 0x7efd98198940 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:32.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:32.423+0000 7efd9e155640 1 --2- 172.21.15.37:0/2143330613 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efd98100a80 0x7efd98198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:32.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:32.423+0000 7efd9e155640 1 -- 172.21.15.37:0/2143330613 >> 172.21.15.37:0/2143330613 conn(0x7efd980fc7a0 msgr2=0x7efd9806aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:32.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:32.423+0000 7efd9e155640 1 -- 172.21.15.37:0/2143330613 shutdown_connections 2024-09-19T06:05:32.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:32.423+0000 7efd9e155640 1 -- 172.21.15.37:0/2143330613 wait complete. 2024-09-19T06:05:33.171 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:32 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/2143330613' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T06:05:33.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:32 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/2143330613' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T06:05:33.199 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738451 got 34359738454 for osd.0 2024-09-19T06:05:33.199 DEBUG:teuthology.parallel:result is None 2024-09-19T06:05:33.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:32 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/2143330613' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T06:05:33.898 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182466 got 107374182470 for osd.3 2024-09-19T06:05:33.898 DEBUG:teuthology.parallel:result is None 2024-09-19T06:05:34.123 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:33 smithi037 ceph-mon[31211]: pgmap v329: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:05:34.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:33 smithi099 ceph-mon[35300]: pgmap v329: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:05:34.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:33 smithi117 ceph-mon[35050]: pgmap v329: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:05:34.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:34.347+0000 7f4404735640 1 -- 172.21.15.37:0/2722675317 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43fc106f10 msgr2=0x7f43fc10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:34.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:34.347+0000 7f4404735640 1 --2- 172.21.15.37:0/2722675317 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43fc106f10 0x7f43fc10ea90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f43f4009ca0 tx=0x7f43f402a8c0 comp rx=0 tx=0).stop 2024-09-19T06:05:34.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:34.347+0000 7f4404735640 1 -- 172.21.15.37:0/2722675317 shutdown_connections 2024-09-19T06:05:34.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:34.347+0000 7f4404735640 1 --2- 172.21.15.37:0/2722675317 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43fc106f10 0x7f43fc10ea90 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:34.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:34.347+0000 7f4404735640 1 --2- 172.21.15.37:0/2722675317 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f43fc102790 0x7f43fc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:34.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:34.347+0000 7f4404735640 1 --2- 172.21.15.37:0/2722675317 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f43fc101de0 0x7f43fc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:34.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:34.347+0000 7f4404735640 1 -- 172.21.15.37:0/2722675317 >> 172.21.15.37:0/2722675317 conn(0x7f43fc0fd8c0 msgr2=0x7f43fc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:34.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:34.347+0000 7f4404735640 1 -- 172.21.15.37:0/2722675317 shutdown_connections 2024-09-19T06:05:34.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:34.347+0000 7f4404735640 1 -- 172.21.15.37:0/2722675317 wait complete. 2024-09-19T06:05:34.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:34.348+0000 7f4404735640 1 Processor -- start 2024-09-19T06:05:34.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:34.348+0000 7f4404735640 1 -- start start 2024-09-19T06:05:34.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:34.348+0000 7f4404735640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43fc101de0 0x7f43fc198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:34.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:34.348+0000 7f4404735640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f43fc102790 0x7f43fc198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:34.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:34.348+0000 7f4404735640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f43fc106f10 0x7f43fc19cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:34.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:34.348+0000 7f4404735640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f43fc112060 con 0x7f43fc101de0 2024-09-19T06:05:34.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:34.348+0000 7f4404735640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f43fc111ee0 con 0x7f43fc102790 2024-09-19T06:05:34.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:34.348+0000 7f4404735640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f43fc1121e0 con 0x7f43fc106f10 2024-09-19T06:05:34.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:34.348+0000 7f44024d1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43fc101de0 0x7f43fc198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:34.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:34.348+0000 7f44024d1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43fc101de0 0x7f43fc198520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56728/0 (socket says 172.21.15.37:56728) 2024-09-19T06:05:34.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:34.348+0000 7f44024d1640 1 -- 172.21.15.37:0/2024771326 learned_addr learned my addr 172.21.15.37:0/2024771326 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:05:34.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:34.348+0000 7f4401cd0640 1 --2- 172.21.15.37:0/2024771326 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f43fc102790 0x7f43fc198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:34.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:34.348+0000 7f4402cd2640 1 --2- 172.21.15.37:0/2024771326 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f43fc106f10 0x7f43fc19cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:34.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:34.348+0000 7f44024d1640 1 -- 172.21.15.37:0/2024771326 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f43fc106f10 msgr2=0x7f43fc19cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:34.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:34.348+0000 7f44024d1640 1 --2- 172.21.15.37:0/2024771326 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f43fc106f10 0x7f43fc19cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:34.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:34.348+0000 7f44024d1640 1 -- 172.21.15.37:0/2024771326 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f43fc102790 msgr2=0x7f43fc198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:34.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:34.348+0000 7f44024d1640 1 --2- 172.21.15.37:0/2024771326 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f43fc102790 0x7f43fc198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:34.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:34.348+0000 7f44024d1640 1 -- 172.21.15.37:0/2024771326 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43fc19d4d0 con 0x7f43fc101de0 2024-09-19T06:05:34.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:34.348+0000 7f4402cd2640 1 --2- 172.21.15.37:0/2024771326 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f43fc106f10 0x7f43fc19cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:05:34.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:34.349+0000 7f44024d1640 1 --2- 172.21.15.37:0/2024771326 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43fc101de0 0x7f43fc198520 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f43f800b4a0 tx=0x7f43f800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:34.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:34.349+0000 7f43f37fe640 1 -- 172.21.15.37:0/2024771326 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43f8015020 con 0x7f43fc101de0 2024-09-19T06:05:34.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:34.349+0000 7f4404735640 1 -- 172.21.15.37:0/2024771326 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43fc19d7c0 con 0x7f43fc101de0 2024-09-19T06:05:34.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:34.349+0000 7f43f37fe640 1 -- 172.21.15.37:0/2024771326 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43f8011d10 con 0x7f43fc101de0 2024-09-19T06:05:34.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:34.349+0000 7f43f37fe640 1 -- 172.21.15.37:0/2024771326 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43f800f2e0 con 0x7f43fc101de0 2024-09-19T06:05:34.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:34.349+0000 7f4404735640 1 -- 172.21.15.37:0/2024771326 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43fc1a50a0 con 0x7f43fc101de0 2024-09-19T06:05:34.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:34.350+0000 7f4404735640 1 -- 172.21.15.37:0/2024771326 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43fc102240 con 0x7f43fc101de0 2024-09-19T06:05:34.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:34.351+0000 7f43f37fe640 1 -- 172.21.15.37:0/2024771326 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f43f8018020 con 0x7f43fc101de0 2024-09-19T06:05:34.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:34.352+0000 7f43f37fe640 1 --2- 172.21.15.37:0/2024771326 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f43e80a32d0 0x7f43e80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:34.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:34.352+0000 7f4401cd0640 1 --2- 172.21.15.37:0/2024771326 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f43e80a32d0 0x7f43e80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:34.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:34.352+0000 7f43f37fe640 1 -- 172.21.15.37:0/2024771326 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f43f80cfa60 con 0x7f43fc101de0 2024-09-19T06:05:34.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:34.352+0000 7f4401cd0640 1 --2- 172.21.15.37:0/2024771326 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f43e80a32d0 0x7f43e80a5790 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f43fc0fdce0 tx=0x7f43ec009110 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:34.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:34.355+0000 7f43f37fe640 1 -- 172.21.15.37:0/2024771326 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f43f801f020 con 0x7f43fc101de0 2024-09-19T06:05:34.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:34.532+0000 7f4404735640 1 -- 172.21.15.37:0/2024771326 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f43fc199880 con 0x7f43fc101de0 2024-09-19T06:05:34.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:34.533+0000 7f43f37fe640 1 -- 172.21.15.37:0/2024771326 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f43f809c370 con 0x7f43fc101de0 2024-09-19T06:05:34.534 INFO:teuthology.orchestra.run.smithi037.stdout:240518168622 2024-09-19T06:05:34.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:34.534+0000 7f4404735640 1 -- 172.21.15.37:0/2024771326 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f43e80a32d0 msgr2=0x7f43e80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:34.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:34.534+0000 7f4404735640 1 --2- 172.21.15.37:0/2024771326 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f43e80a32d0 0x7f43e80a5790 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f43fc0fdce0 tx=0x7f43ec009110 comp rx=0 tx=0).stop 2024-09-19T06:05:34.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:34.534+0000 7f4404735640 1 -- 172.21.15.37:0/2024771326 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43fc101de0 msgr2=0x7f43fc198520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:34.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:34.534+0000 7f4404735640 1 --2- 172.21.15.37:0/2024771326 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43fc101de0 0x7f43fc198520 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f43f800b4a0 tx=0x7f43f800b8a0 comp rx=0 tx=0).stop 2024-09-19T06:05:34.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:34.535+0000 7f4404735640 1 -- 172.21.15.37:0/2024771326 shutdown_connections 2024-09-19T06:05:34.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:34.535+0000 7f4404735640 1 --2- 172.21.15.37:0/2024771326 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f43e80a32d0 0x7f43e80a5790 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:34.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:34.535+0000 7f4404735640 1 --2- 172.21.15.37:0/2024771326 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f43fc102790 0x7f43fc198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:34.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:34.535+0000 7f4404735640 1 --2- 172.21.15.37:0/2024771326 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f43fc106f10 0x7f43fc19cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:34.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:34.535+0000 7f4404735640 1 --2- 172.21.15.37:0/2024771326 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43fc101de0 0x7f43fc198520 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:34.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:34.535+0000 7f4404735640 1 -- 172.21.15.37:0/2024771326 >> 172.21.15.37:0/2024771326 conn(0x7f43fc0fd8c0 msgr2=0x7f43fc0fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:34.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:34.535+0000 7f4404735640 1 -- 172.21.15.37:0/2024771326 shutdown_connections 2024-09-19T06:05:34.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:34.535+0000 7f4404735640 1 -- 172.21.15.37:0/2024771326 wait complete. 2024-09-19T06:05:35.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:34 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/2024771326' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T06:05:35.218 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:34 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/2024771326' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T06:05:35.248 INFO:tasks.cephadm.ceph_manager.ceph:need seq 240518168617 got 240518168622 for osd.8 2024-09-19T06:05:35.249 DEBUG:teuthology.parallel:result is None 2024-09-19T06:05:35.249 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T06:05:35.249 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T06:05:35.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:34 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/2024771326' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T06:05:35.510 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:05:35.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:35.978+0000 7f5857aa1640 1 -- 172.21.15.37:0/3588462600 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5850074f50 msgr2=0x7f585010df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:35.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:35.978+0000 7f5857aa1640 1 --2- 172.21.15.37:0/3588462600 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5850074f50 0x7f585010df30 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5844009900 tx=0x7f584402a410 comp rx=0 tx=0).stop 2024-09-19T06:05:35.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:35.979+0000 7f5857aa1640 1 -- 172.21.15.37:0/3588462600 shutdown_connections 2024-09-19T06:05:35.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:35.979+0000 7f5857aa1640 1 --2- 172.21.15.37:0/3588462600 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f585010e470 0x7f58501108a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:35.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:35.979+0000 7f5857aa1640 1 --2- 172.21.15.37:0/3588462600 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5850074f50 0x7f585010df30 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:35.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:35.979+0000 7f5857aa1640 1 --2- 172.21.15.37:0/3588462600 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f58500745a0 0x7f5850074980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:35.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:35.979+0000 7f5857aa1640 1 -- 172.21.15.37:0/3588462600 >> 172.21.15.37:0/3588462600 conn(0x7f58500fd8d0 msgr2=0x7f58500ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:35.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:35.979+0000 7f5857aa1640 1 -- 172.21.15.37:0/3588462600 shutdown_connections 2024-09-19T06:05:35.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:35.979+0000 7f5857aa1640 1 -- 172.21.15.37:0/3588462600 wait complete. 2024-09-19T06:05:35.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:35.979+0000 7f5857aa1640 1 Processor -- start 2024-09-19T06:05:35.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:35.979+0000 7f5857aa1640 1 -- start start 2024-09-19T06:05:35.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:35.980+0000 7f5857aa1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58500745a0 0x7f58501a0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:35.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:35.980+0000 7f5857aa1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5850074f50 0x7f58501a0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:35.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:35.980+0000 7f5857aa1640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f585010e470 0x7f585019a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:35.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:35.980+0000 7f5857aa1640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5850114310 con 0x7f5850074f50 2024-09-19T06:05:35.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:35.980+0000 7f5857aa1640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f5850114190 con 0x7f585010e470 2024-09-19T06:05:35.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:35.980+0000 7f5857aa1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5850114490 con 0x7f58500745a0 2024-09-19T06:05:35.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:35.980+0000 7f585503c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5850074f50 0x7f58501a0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:35.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:35.980+0000 7f585503c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5850074f50 0x7f58501a0960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56744/0 (socket says 172.21.15.37:56744) 2024-09-19T06:05:35.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:35.980+0000 7f585503c640 1 -- 172.21.15.37:0/211420676 learned_addr learned my addr 172.21.15.37:0/211420676 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:05:35.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:35.980+0000 7f585603e640 1 --2- 172.21.15.37:0/211420676 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f585010e470 0x7f585019a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:35.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:35.980+0000 7f585583d640 1 --2- 172.21.15.37:0/211420676 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58500745a0 0x7f58501a0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:35.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:35.980+0000 7f585503c640 1 -- 172.21.15.37:0/211420676 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58500745a0 msgr2=0x7f58501a0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:36.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:35.980+0000 7f585503c640 1 --2- 172.21.15.37:0/211420676 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58500745a0 0x7f58501a0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:36.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:35.980+0000 7f585503c640 1 -- 172.21.15.37:0/211420676 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f585010e470 msgr2=0x7f585019a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:36.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:35.980+0000 7f585503c640 1 --2- 172.21.15.37:0/211420676 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f585010e470 0x7f585019a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:36.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:35.980+0000 7f585503c640 1 -- 172.21.15.37:0/211420676 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f585019ad10 con 0x7f5850074f50 2024-09-19T06:05:36.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:35.980+0000 7f585603e640 1 --2- 172.21.15.37:0/211420676 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f585010e470 0x7f585019a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:05:36.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:35.980+0000 7f585503c640 1 --2- 172.21.15.37:0/211420676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5850074f50 0x7f58501a0960 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f5844006010 tx=0x7f5844003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:36.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:35.980+0000 7f584effd640 1 -- 172.21.15.37:0/211420676 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f584403f070 con 0x7f5850074f50 2024-09-19T06:05:36.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:35.981+0000 7f584effd640 1 -- 172.21.15.37:0/211420676 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5844031c90 con 0x7f5850074f50 2024-09-19T06:05:36.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:35.981+0000 7f5857aa1640 1 -- 172.21.15.37:0/211420676 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f585019afa0 con 0x7f5850074f50 2024-09-19T06:05:36.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:35.981+0000 7f584effd640 1 -- 172.21.15.37:0/211420676 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5844035030 con 0x7f5850074f50 2024-09-19T06:05:36.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:35.981+0000 7f5857aa1640 1 -- 172.21.15.37:0/211420676 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58501a72f0 con 0x7f5850074f50 2024-09-19T06:05:36.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:35.982+0000 7f5857aa1640 1 -- 172.21.15.37:0/211420676 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5850074980 con 0x7f5850074f50 2024-09-19T06:05:36.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:35.983+0000 7f584effd640 1 -- 172.21.15.37:0/211420676 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f5844042070 con 0x7f5850074f50 2024-09-19T06:05:36.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:35.984+0000 7f584effd640 1 --2- 172.21.15.37:0/211420676 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f58380a32d0 0x7f58380a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:36.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:35.984+0000 7f584effd640 1 -- 172.21.15.37:0/211420676 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f58440f0c80 con 0x7f5850074f50 2024-09-19T06:05:36.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:35.984+0000 7f585583d640 1 --2- 172.21.15.37:0/211420676 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f58380a32d0 0x7f58380a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:36.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:35.984+0000 7f585583d640 1 --2- 172.21.15.37:0/211420676 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f58380a32d0 0x7f58380a5790 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5848009f20 tx=0x7f58480094f0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:36.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:35.987+0000 7f584effd640 1 -- 172.21.15.37:0/211420676 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f58440bd4e0 con 0x7f5850074f50 2024-09-19T06:05:36.161 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:35 smithi037 ceph-mon[31211]: pgmap v330: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:05:36.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:36.160+0000 7f5857aa1640 1 -- 172.21.15.37:0/211420676 --> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5850062630 con 0x7f58380a32d0 2024-09-19T06:05:36.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:36.169+0000 7f584effd640 1 -- 172.21.15.37:0/211420676 <== mgr.14148 v2:172.21.15.37:6800/3797010169 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340282 (secure 0 0 0) 0x7f5850062630 con 0x7f58380a32d0 2024-09-19T06:05:36.174 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T06:05:36.175 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-19T06:05:36.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:36.173+0000 7f5857aa1640 1 -- 172.21.15.37:0/211420676 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f58380a32d0 msgr2=0x7f58380a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:36.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:36.173+0000 7f5857aa1640 1 --2- 172.21.15.37:0/211420676 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f58380a32d0 0x7f58380a5790 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5848009f20 tx=0x7f58480094f0 comp rx=0 tx=0).stop 2024-09-19T06:05:36.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:36.173+0000 7f5857aa1640 1 -- 172.21.15.37:0/211420676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5850074f50 msgr2=0x7f58501a0960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:36.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:36.173+0000 7f5857aa1640 1 --2- 172.21.15.37:0/211420676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5850074f50 0x7f58501a0960 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f5844006010 tx=0x7f5844003ba0 comp rx=0 tx=0).stop 2024-09-19T06:05:36.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:36.173+0000 7f5857aa1640 1 -- 172.21.15.37:0/211420676 shutdown_connections 2024-09-19T06:05:36.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:36.173+0000 7f5857aa1640 1 --2- 172.21.15.37:0/211420676 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f58380a32d0 0x7f58380a5790 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:36.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:36.173+0000 7f5857aa1640 1 --2- 172.21.15.37:0/211420676 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f585010e470 0x7f585019a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:36.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:36.173+0000 7f5857aa1640 1 --2- 172.21.15.37:0/211420676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5850074f50 0x7f58501a0960 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:36.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:36.173+0000 7f5857aa1640 1 --2- 172.21.15.37:0/211420676 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58500745a0 0x7f58501a0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:36.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:36.173+0000 7f5857aa1640 1 -- 172.21.15.37:0/211420676 >> 172.21.15.37:0/211420676 conn(0x7f58500fd8d0 msgr2=0x7f58500fe530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:36.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:36.173+0000 7f5857aa1640 1 -- 172.21.15.37:0/211420676 shutdown_connections 2024-09-19T06:05:36.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:36.173+0000 7f5857aa1640 1 -- 172.21.15.37:0/211420676 wait complete. 2024-09-19T06:05:36.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:35 smithi099 ceph-mon[35300]: pgmap v330: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:05:36.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:35 smithi117 ceph-mon[35050]: pgmap v330: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:05:36.890 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":330,"stamp":"2024-09-19T06:05:34.665973+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654911,"num_objects":26,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":245,"num_read_kb":233,"num_write":266,"num_write_kb":3031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180770,"num_keys_recovered":10,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":209,"ondisk_log_size":209,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":363096,"kb_used_data":13760,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124578728,"statfs":{"total":1151940427776,"available":1151568617472,"internally_reserved":0,"allocated":14090240,"data_stored":7920863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":357414202},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":15,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003354"},"pg_stats":[{"pgid":"2.1f","version":"81'4","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724453+0000","last_change":"2024-09-19T06:04:03.323722+0000","last_active":"2024-09-19T06:05:13.724453+0000","last_peered":"2024-09-19T06:05:13.724453+0000","last_clean":"2024-09-19T06:05:13.724453+0000","last_became_active":"2024-09-19T06:04:03.323380+0000","last_became_peered":"2024-09-19T06:04:03.323380+0000","last_unstale":"2024-09-19T06:05:13.724453+0000","last_undegraded":"2024-09-19T06:05:13.724453+0000","last_fullsized":"2024-09-19T06:05:13.724453+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:49:17.449780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.729375+0000","last_change":"2024-09-19T06:04:05.427994+0000","last_active":"2024-09-19T06:05:13.729375+0000","last_peered":"2024-09-19T06:05:13.729375+0000","last_clean":"2024-09-19T06:05:13.729375+0000","last_became_active":"2024-09-19T06:04:05.427745+0000","last_became_peered":"2024-09-19T06:04:05.427745+0000","last_unstale":"2024-09-19T06:05:13.729375+0000","last_undegraded":"2024-09-19T06:05:13.729375+0000","last_fullsized":"2024-09-19T06:05:13.729375+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:54.917003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727325+0000","last_change":"2024-09-19T06:04:12.463838+0000","last_active":"2024-09-19T06:05:13.727325+0000","last_peered":"2024-09-19T06:05:13.727325+0000","last_clean":"2024-09-19T06:05:13.727325+0000","last_became_active":"2024-09-19T06:04:12.463426+0000","last_became_peered":"2024-09-19T06:04:12.463426+0000","last_unstale":"2024-09-19T06:05:13.727325+0000","last_undegraded":"2024-09-19T06:05:13.727325+0000","last_fullsized":"2024-09-19T06:05:13.727325+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:40:37.994203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"81'1","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.729714+0000","last_change":"2024-09-19T06:04:03.378129+0000","last_active":"2024-09-19T06:05:13.729714+0000","last_peered":"2024-09-19T06:05:13.729714+0000","last_clean":"2024-09-19T06:05:13.729714+0000","last_became_active":"2024-09-19T06:04:03.377793+0000","last_became_peered":"2024-09-19T06:04:03.377793+0000","last_unstale":"2024-09-19T06:05:13.729714+0000","last_undegraded":"2024-09-19T06:05:13.729714+0000","last_fullsized":"2024-09-19T06:05:13.729714+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:38:22.739168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726880+0000","last_change":"2024-09-19T06:04:05.433909+0000","last_active":"2024-09-19T06:05:13.726880+0000","last_peered":"2024-09-19T06:05:13.726880+0000","last_clean":"2024-09-19T06:05:13.726880+0000","last_became_active":"2024-09-19T06:04:05.433591+0000","last_became_peered":"2024-09-19T06:04:05.433591+0000","last_unstale":"2024-09-19T06:05:13.726880+0000","last_undegraded":"2024-09-19T06:05:13.726880+0000","last_fullsized":"2024-09-19T06:05:13.726880+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:19:18.916703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.725870+0000","last_change":"2024-09-19T06:04:12.468984+0000","last_active":"2024-09-19T06:05:13.725870+0000","last_peered":"2024-09-19T06:05:13.725870+0000","last_clean":"2024-09-19T06:05:13.725870+0000","last_became_active":"2024-09-19T06:04:12.467287+0000","last_became_peered":"2024-09-19T06:04:12.467287+0000","last_unstale":"2024-09-19T06:05:13.725870+0000","last_undegraded":"2024-09-19T06:05:13.725870+0000","last_fullsized":"2024-09-19T06:05:13.725870+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:05:46.279679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.739408+0000","last_change":"2024-09-19T06:05:13.739034+0000","last_active":"2024-09-19T06:05:13.739408+0000","last_peered":"2024-09-19T06:05:13.739408+0000","last_clean":"2024-09-19T06:05:13.739408+0000","last_became_active":"2024-09-19T06:05:13.731532+0000","last_became_peered":"2024-09-19T06:05:13.731532+0000","last_unstale":"2024-09-19T06:05:13.739408+0000","last_undegraded":"2024-09-19T06:05:13.739408+0000","last_fullsized":"2024-09-19T06:05:13.739408+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:52:21.543579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:15.014328+0000","last_change":"2024-09-19T06:04:05.430288+0000","last_active":"2024-09-19T06:05:15.014328+0000","last_peered":"2024-09-19T06:05:15.014328+0000","last_clean":"2024-09-19T06:05:15.014328+0000","last_became_active":"2024-09-19T06:04:05.429947+0000","last_became_peered":"2024-09-19T06:04:05.429947+0000","last_unstale":"2024-09-19T06:05:15.014328+0000","last_undegraded":"2024-09-19T06:05:15.014328+0000","last_fullsized":"2024-09-19T06:05:15.014328+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:43:09.169658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726358+0000","last_change":"2024-09-19T06:04:12.465946+0000","last_active":"2024-09-19T06:05:13.726358+0000","last_peered":"2024-09-19T06:05:13.726358+0000","last_clean":"2024-09-19T06:05:13.726358+0000","last_became_active":"2024-09-19T06:04:12.465553+0000","last_became_peered":"2024-09-19T06:04:12.465553+0000","last_unstale":"2024-09-19T06:05:13.726358+0000","last_undegraded":"2024-09-19T06:05:13.726358+0000","last_fullsized":"2024-09-19T06:05:13.726358+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:50:41.181483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.728044+0000","last_change":"2024-09-19T06:04:03.318528+0000","last_active":"2024-09-19T06:05:13.728044+0000","last_peered":"2024-09-19T06:05:13.728044+0000","last_clean":"2024-09-19T06:05:13.728044+0000","last_became_active":"2024-09-19T06:04:03.318210+0000","last_became_peered":"2024-09-19T06:04:03.318210+0000","last_unstale":"2024-09-19T06:05:13.728044+0000","last_undegraded":"2024-09-19T06:05:13.728044+0000","last_fullsized":"2024-09-19T06:05:13.728044+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:06.766545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.475029+0000","last_change":"2024-09-19T06:04:05.427025+0000","last_active":"2024-09-19T06:05:14.475029+0000","last_peered":"2024-09-19T06:05:14.475029+0000","last_clean":"2024-09-19T06:05:14.475029+0000","last_became_active":"2024-09-19T06:04:05.425679+0000","last_became_peered":"2024-09-19T06:04:05.425679+0000","last_unstale":"2024-09-19T06:05:14.475029+0000","last_undegraded":"2024-09-19T06:05:14.475029+0000","last_fullsized":"2024-09-19T06:05:14.475029+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:26:06.480664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726043+0000","last_change":"2024-09-19T06:04:12.467065+0000","last_active":"2024-09-19T06:05:13.726043+0000","last_peered":"2024-09-19T06:05:13.726043+0000","last_clean":"2024-09-19T06:05:13.726043+0000","last_became_active":"2024-09-19T06:04:12.465961+0000","last_became_peered":"2024-09-19T06:04:12.465961+0000","last_unstale":"2024-09-19T06:05:13.726043+0000","last_undegraded":"2024-09-19T06:05:13.726043+0000","last_fullsized":"2024-09-19T06:05:13.726043+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:13:38.566692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724364+0000","last_change":"2024-09-19T06:04:05.436202+0000","last_active":"2024-09-19T06:05:13.724364+0000","last_peered":"2024-09-19T06:05:13.724364+0000","last_clean":"2024-09-19T06:05:13.724364+0000","last_became_active":"2024-09-19T06:04:05.435779+0000","last_became_peered":"2024-09-19T06:04:05.435779+0000","last_unstale":"2024-09-19T06:05:13.724364+0000","last_undegraded":"2024-09-19T06:05:13.724364+0000","last_fullsized":"2024-09-19T06:05:13.724364+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:27:56.463592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727084+0000","last_change":"2024-09-19T06:04:03.320472+0000","last_active":"2024-09-19T06:05:13.727084+0000","last_peered":"2024-09-19T06:05:13.727084+0000","last_clean":"2024-09-19T06:05:13.727084+0000","last_became_active":"2024-09-19T06:04:03.320178+0000","last_became_peered":"2024-09-19T06:04:03.320178+0000","last_unstale":"2024-09-19T06:05:13.727084+0000","last_undegraded":"2024-09-19T06:05:13.727084+0000","last_fullsized":"2024-09-19T06:05:13.727084+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:23.285302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727113+0000","last_change":"2024-09-19T06:04:12.635733+0000","last_active":"2024-09-19T06:05:13.727113+0000","last_peered":"2024-09-19T06:05:13.727113+0000","last_clean":"2024-09-19T06:05:13.727113+0000","last_became_active":"2024-09-19T06:04:12.634938+0000","last_became_peered":"2024-09-19T06:04:12.634938+0000","last_unstale":"2024-09-19T06:05:13.727113+0000","last_undegraded":"2024-09-19T06:05:13.727113+0000","last_fullsized":"2024-09-19T06:05:13.727113+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:44:09.015733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.729473+0000","last_change":"2024-09-19T06:04:05.418702+0000","last_active":"2024-09-19T06:05:13.729473+0000","last_peered":"2024-09-19T06:05:13.729473+0000","last_clean":"2024-09-19T06:05:13.729473+0000","last_became_active":"2024-09-19T06:04:05.418213+0000","last_became_peered":"2024-09-19T06:04:05.418213+0000","last_unstale":"2024-09-19T06:05:13.729473+0000","last_undegraded":"2024-09-19T06:05:13.729473+0000","last_fullsized":"2024-09-19T06:05:13.729473+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:46:01.865286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727965+0000","last_change":"2024-09-19T06:04:03.323683+0000","last_active":"2024-09-19T06:05:13.727965+0000","last_peered":"2024-09-19T06:05:13.727965+0000","last_clean":"2024-09-19T06:05:13.727965+0000","last_became_active":"2024-09-19T06:04:03.323166+0000","last_became_peered":"2024-09-19T06:04:03.323166+0000","last_unstale":"2024-09-19T06:05:13.727965+0000","last_undegraded":"2024-09-19T06:05:13.727965+0000","last_fullsized":"2024-09-19T06:05:13.727965+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:53.787307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"87'1","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726853+0000","last_change":"2024-09-19T06:04:12.467620+0000","last_active":"2024-09-19T06:05:13.726853+0000","last_peered":"2024-09-19T06:05:13.726853+0000","last_clean":"2024-09-19T06:05:13.726853+0000","last_became_active":"2024-09-19T06:04:12.467231+0000","last_became_peered":"2024-09-19T06:04:12.467231+0000","last_unstale":"2024-09-19T06:05:13.726853+0000","last_undegraded":"2024-09-19T06:05:13.726853+0000","last_fullsized":"2024-09-19T06:05:13.726853+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:12:07.731338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726950+0000","last_change":"2024-09-19T06:04:05.426415+0000","last_active":"2024-09-19T06:05:13.726950+0000","last_peered":"2024-09-19T06:05:13.726950+0000","last_clean":"2024-09-19T06:05:13.726950+0000","last_became_active":"2024-09-19T06:04:05.426061+0000","last_became_peered":"2024-09-19T06:04:05.426061+0000","last_unstale":"2024-09-19T06:05:13.726950+0000","last_undegraded":"2024-09-19T06:05:13.726950+0000","last_fullsized":"2024-09-19T06:05:13.726950+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:44.810600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.729834+0000","last_change":"2024-09-19T06:04:03.319185+0000","last_active":"2024-09-19T06:05:13.729834+0000","last_peered":"2024-09-19T06:05:13.729834+0000","last_clean":"2024-09-19T06:05:13.729834+0000","last_became_active":"2024-09-19T06:04:03.318788+0000","last_became_peered":"2024-09-19T06:04:03.318788+0000","last_unstale":"2024-09-19T06:05:13.729834+0000","last_undegraded":"2024-09-19T06:05:13.729834+0000","last_fullsized":"2024-09-19T06:05:13.729834+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:41:14.668303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.476753+0000","last_change":"2024-09-19T06:05:14.476214+0000","last_active":"2024-09-19T06:05:14.476753+0000","last_peered":"2024-09-19T06:05:14.476753+0000","last_clean":"2024-09-19T06:05:14.476753+0000","last_became_active":"2024-09-19T06:05:14.475721+0000","last_became_peered":"2024-09-19T06:05:14.475721+0000","last_unstale":"2024-09-19T06:05:14.476753+0000","last_undegraded":"2024-09-19T06:05:14.476753+0000","last_fullsized":"2024-09-19T06:05:14.476753+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:15:37.925870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,2,5],"acting":[8,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727210+0000","last_change":"2024-09-19T06:04:05.428027+0000","last_active":"2024-09-19T06:05:13.727210+0000","last_peered":"2024-09-19T06:05:13.727210+0000","last_clean":"2024-09-19T06:05:13.727210+0000","last_became_active":"2024-09-19T06:04:05.427698+0000","last_became_peered":"2024-09-19T06:04:05.427698+0000","last_unstale":"2024-09-19T06:05:13.727210+0000","last_undegraded":"2024-09-19T06:05:13.727210+0000","last_fullsized":"2024-09-19T06:05:13.727210+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:06:34.627086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:15.014128+0000","last_change":"2024-09-19T06:04:03.380435+0000","last_active":"2024-09-19T06:05:15.014128+0000","last_peered":"2024-09-19T06:05:15.014128+0000","last_clean":"2024-09-19T06:05:15.014128+0000","last_became_active":"2024-09-19T06:04:03.380102+0000","last_became_peered":"2024-09-19T06:04:03.380102+0000","last_unstale":"2024-09-19T06:05:15.014128+0000","last_undegraded":"2024-09-19T06:05:15.014128+0000","last_fullsized":"2024-09-19T06:05:15.014128+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:43.886466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.730251+0000","last_change":"2024-09-19T06:05:13.730251+0000","last_active":"2024-09-19T06:05:13.730251+0000","last_peered":"2024-09-19T06:05:13.730251+0000","last_clean":"2024-09-19T06:05:13.730251+0000","last_became_active":"2024-09-19T06:05:13.729757+0000","last_became_peered":"2024-09-19T06:05:13.729757+0000","last_unstale":"2024-09-19T06:05:13.730251+0000","last_undegraded":"2024-09-19T06:05:13.730251+0000","last_fullsized":"2024-09-19T06:05:13.730251+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:57:09.816160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,10,9],"acting":[4,8,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.160089+0000","last_change":"2024-09-19T06:05:14.160089+0000","last_active":"2024-09-19T06:05:14.160089+0000","last_peered":"2024-09-19T06:05:14.160089+0000","last_clean":"2024-09-19T06:05:14.160089+0000","last_became_active":"2024-09-19T06:05:14.159695+0000","last_became_peered":"2024-09-19T06:05:14.159695+0000","last_unstale":"2024-09-19T06:05:14.160089+0000","last_undegraded":"2024-09-19T06:05:14.160089+0000","last_fullsized":"2024-09-19T06:05:14.160089+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:12:52.838620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"81'2","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726594+0000","last_change":"2024-09-19T06:04:03.376510+0000","last_active":"2024-09-19T06:05:13.726594+0000","last_peered":"2024-09-19T06:05:13.726594+0000","last_clean":"2024-09-19T06:05:13.726594+0000","last_became_active":"2024-09-19T06:04:03.376241+0000","last_became_peered":"2024-09-19T06:04:03.376241+0000","last_unstale":"2024-09-19T06:05:13.726594+0000","last_undegraded":"2024-09-19T06:05:13.726594+0000","last_fullsized":"2024-09-19T06:05:13.726594+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:19:29.209233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727510+0000","last_change":"2024-09-19T06:04:12.462237+0000","last_active":"2024-09-19T06:05:13.727510+0000","last_peered":"2024-09-19T06:05:13.727510+0000","last_clean":"2024-09-19T06:05:13.727510+0000","last_became_active":"2024-09-19T06:04:12.461771+0000","last_became_peered":"2024-09-19T06:04:12.461771+0000","last_unstale":"2024-09-19T06:05:13.727510+0000","last_undegraded":"2024-09-19T06:05:13.727510+0000","last_fullsized":"2024-09-19T06:05:13.727510+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:46:42.780847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.730324+0000","last_change":"2024-09-19T06:04:05.420472+0000","last_active":"2024-09-19T06:05:13.730324+0000","last_peered":"2024-09-19T06:05:13.730324+0000","last_clean":"2024-09-19T06:05:13.730324+0000","last_became_active":"2024-09-19T06:04:05.420147+0000","last_became_peered":"2024-09-19T06:04:05.420147+0000","last_unstale":"2024-09-19T06:05:13.730324+0000","last_undegraded":"2024-09-19T06:05:13.730324+0000","last_fullsized":"2024-09-19T06:05:13.730324+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:38.616378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724491+0000","last_change":"2024-09-19T06:04:03.316655+0000","last_active":"2024-09-19T06:05:13.724491+0000","last_peered":"2024-09-19T06:05:13.724491+0000","last_clean":"2024-09-19T06:05:13.724491+0000","last_became_active":"2024-09-19T06:04:03.316296+0000","last_became_peered":"2024-09-19T06:04:03.316296+0000","last_unstale":"2024-09-19T06:05:13.724491+0000","last_undegraded":"2024-09-19T06:05:13.724491+0000","last_fullsized":"2024-09-19T06:05:13.724491+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:02:06.320482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.729377+0000","last_change":"2024-09-19T06:04:12.635106+0000","last_active":"2024-09-19T06:05:13.729377+0000","last_peered":"2024-09-19T06:05:13.729377+0000","last_clean":"2024-09-19T06:05:13.729377+0000","last_became_active":"2024-09-19T06:04:12.634671+0000","last_became_peered":"2024-09-19T06:04:12.634671+0000","last_unstale":"2024-09-19T06:05:13.729377+0000","last_undegraded":"2024-09-19T06:05:13.729377+0000","last_fullsized":"2024-09-19T06:05:13.729377+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:54:22.428102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.158760+0000","last_change":"2024-09-19T06:04:05.427483+0000","last_active":"2024-09-19T06:05:14.158760+0000","last_peered":"2024-09-19T06:05:14.158760+0000","last_clean":"2024-09-19T06:05:14.158760+0000","last_became_active":"2024-09-19T06:04:05.427092+0000","last_became_peered":"2024-09-19T06:04:05.427092+0000","last_unstale":"2024-09-19T06:05:14.158760+0000","last_undegraded":"2024-09-19T06:05:14.158760+0000","last_fullsized":"2024-09-19T06:05:14.158760+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:50:21.576757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727469+0000","last_change":"2024-09-19T06:04:03.377962+0000","last_active":"2024-09-19T06:05:13.727469+0000","last_peered":"2024-09-19T06:05:13.727469+0000","last_clean":"2024-09-19T06:05:13.727469+0000","last_became_active":"2024-09-19T06:04:03.377686+0000","last_became_peered":"2024-09-19T06:04:03.377686+0000","last_unstale":"2024-09-19T06:05:13.727469+0000","last_undegraded":"2024-09-19T06:05:13.727469+0000","last_fullsized":"2024-09-19T06:05:13.727469+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:00.635765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727360+0000","last_change":"2024-09-19T06:04:12.467349+0000","last_active":"2024-09-19T06:05:13.727360+0000","last_peered":"2024-09-19T06:05:13.727360+0000","last_clean":"2024-09-19T06:05:13.727360+0000","last_became_active":"2024-09-19T06:04:12.466117+0000","last_became_peered":"2024-09-19T06:04:12.466117+0000","last_unstale":"2024-09-19T06:05:13.727360+0000","last_undegraded":"2024-09-19T06:05:13.727360+0000","last_fullsized":"2024-09-19T06:05:13.727360+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:28:03.040586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.728256+0000","last_change":"2024-09-19T06:04:05.429656+0000","last_active":"2024-09-19T06:05:13.728256+0000","last_peered":"2024-09-19T06:05:13.728256+0000","last_clean":"2024-09-19T06:05:13.728256+0000","last_became_active":"2024-09-19T06:04:05.429023+0000","last_became_peered":"2024-09-19T06:04:05.429023+0000","last_unstale":"2024-09-19T06:05:13.728256+0000","last_undegraded":"2024-09-19T06:05:13.728256+0000","last_fullsized":"2024-09-19T06:05:13.728256+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:25:57.627940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724204+0000","last_change":"2024-09-19T06:04:03.378415+0000","last_active":"2024-09-19T06:05:13.724204+0000","last_peered":"2024-09-19T06:05:13.724204+0000","last_clean":"2024-09-19T06:05:13.724204+0000","last_became_active":"2024-09-19T06:04:03.378096+0000","last_became_peered":"2024-09-19T06:04:03.378096+0000","last_unstale":"2024-09-19T06:05:13.724204+0000","last_undegraded":"2024-09-19T06:05:13.724204+0000","last_fullsized":"2024-09-19T06:05:13.724204+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:14:33.988869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726970+0000","last_change":"2024-09-19T06:04:12.635410+0000","last_active":"2024-09-19T06:05:13.726970+0000","last_peered":"2024-09-19T06:05:13.726970+0000","last_clean":"2024-09-19T06:05:13.726970+0000","last_became_active":"2024-09-19T06:04:12.634852+0000","last_became_peered":"2024-09-19T06:04:12.634852+0000","last_unstale":"2024-09-19T06:05:13.726970+0000","last_undegraded":"2024-09-19T06:05:13.726970+0000","last_fullsized":"2024-09-19T06:05:13.726970+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:28:46.014324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.728365+0000","last_change":"2024-09-19T06:04:05.421348+0000","last_active":"2024-09-19T06:05:13.728365+0000","last_peered":"2024-09-19T06:05:13.728365+0000","last_clean":"2024-09-19T06:05:13.728365+0000","last_became_active":"2024-09-19T06:04:05.420999+0000","last_became_peered":"2024-09-19T06:04:05.420999+0000","last_unstale":"2024-09-19T06:05:13.728365+0000","last_undegraded":"2024-09-19T06:05:13.728365+0000","last_fullsized":"2024-09-19T06:05:13.728365+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:52:26.257580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724549+0000","last_change":"2024-09-19T06:04:03.321233+0000","last_active":"2024-09-19T06:05:13.724549+0000","last_peered":"2024-09-19T06:05:13.724549+0000","last_clean":"2024-09-19T06:05:13.724549+0000","last_became_active":"2024-09-19T06:04:03.320755+0000","last_became_peered":"2024-09-19T06:04:03.320755+0000","last_unstale":"2024-09-19T06:05:13.724549+0000","last_undegraded":"2024-09-19T06:05:13.724549+0000","last_fullsized":"2024-09-19T06:05:13.724549+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:46.661751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.158645+0000","last_change":"2024-09-19T06:04:12.463185+0000","last_active":"2024-09-19T06:05:14.158645+0000","last_peered":"2024-09-19T06:05:14.158645+0000","last_clean":"2024-09-19T06:05:14.158645+0000","last_became_active":"2024-09-19T06:04:12.462824+0000","last_became_peered":"2024-09-19T06:04:12.462824+0000","last_unstale":"2024-09-19T06:05:14.158645+0000","last_undegraded":"2024-09-19T06:05:14.158645+0000","last_fullsized":"2024-09-19T06:05:14.158645+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:54:05.634907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.474205+0000","last_change":"2024-09-19T06:04:05.427259+0000","last_active":"2024-09-19T06:05:14.474205+0000","last_peered":"2024-09-19T06:05:14.474205+0000","last_clean":"2024-09-19T06:05:14.474205+0000","last_became_active":"2024-09-19T06:04:05.426955+0000","last_became_peered":"2024-09-19T06:04:05.426955+0000","last_unstale":"2024-09-19T06:05:14.474205+0000","last_undegraded":"2024-09-19T06:05:14.474205+0000","last_fullsized":"2024-09-19T06:05:14.474205+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:34:22.085384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.158503+0000","last_change":"2024-09-19T06:04:03.378174+0000","last_active":"2024-09-19T06:05:14.158503+0000","last_peered":"2024-09-19T06:05:14.158503+0000","last_clean":"2024-09-19T06:05:14.158503+0000","last_became_active":"2024-09-19T06:04:03.377803+0000","last_became_peered":"2024-09-19T06:04:03.377803+0000","last_unstale":"2024-09-19T06:05:14.158503+0000","last_undegraded":"2024-09-19T06:05:14.158503+0000","last_fullsized":"2024-09-19T06:05:14.158503+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:24:26.087284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.158946+0000","last_change":"2024-09-19T06:04:12.635365+0000","last_active":"2024-09-19T06:05:14.158946+0000","last_peered":"2024-09-19T06:05:14.158946+0000","last_clean":"2024-09-19T06:05:14.158946+0000","last_became_active":"2024-09-19T06:04:12.634691+0000","last_became_peered":"2024-09-19T06:04:12.634691+0000","last_unstale":"2024-09-19T06:05:14.158946+0000","last_undegraded":"2024-09-19T06:05:14.158946+0000","last_fullsized":"2024-09-19T06:05:14.158946+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:20:58.523992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.158372+0000","last_change":"2024-09-19T06:04:05.425638+0000","last_active":"2024-09-19T06:05:14.158372+0000","last_peered":"2024-09-19T06:05:14.158372+0000","last_clean":"2024-09-19T06:05:14.158372+0000","last_became_active":"2024-09-19T06:04:05.425356+0000","last_became_peered":"2024-09-19T06:04:05.425356+0000","last_unstale":"2024-09-19T06:05:14.158372+0000","last_undegraded":"2024-09-19T06:05:14.158372+0000","last_fullsized":"2024-09-19T06:05:14.158372+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:51:11.857888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724273+0000","last_change":"2024-09-19T06:04:03.322432+0000","last_active":"2024-09-19T06:05:13.724273+0000","last_peered":"2024-09-19T06:05:13.724273+0000","last_clean":"2024-09-19T06:05:13.724273+0000","last_became_active":"2024-09-19T06:04:03.322071+0000","last_became_peered":"2024-09-19T06:04:03.322071+0000","last_unstale":"2024-09-19T06:05:13.724273+0000","last_undegraded":"2024-09-19T06:05:13.724273+0000","last_fullsized":"2024-09-19T06:05:13.724273+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:16:23.935470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.474787+0000","last_change":"2024-09-19T06:04:12.635970+0000","last_active":"2024-09-19T06:05:14.474787+0000","last_peered":"2024-09-19T06:05:14.474787+0000","last_clean":"2024-09-19T06:05:14.474787+0000","last_became_active":"2024-09-19T06:04:12.635283+0000","last_became_peered":"2024-09-19T06:04:12.635283+0000","last_unstale":"2024-09-19T06:05:14.474787+0000","last_undegraded":"2024-09-19T06:05:14.474787+0000","last_fullsized":"2024-09-19T06:05:14.474787+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:55:05.460652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.729589+0000","last_change":"2024-09-19T06:04:05.424335+0000","last_active":"2024-09-19T06:05:13.729589+0000","last_peered":"2024-09-19T06:05:13.729589+0000","last_clean":"2024-09-19T06:05:13.729589+0000","last_became_active":"2024-09-19T06:04:05.423868+0000","last_became_peered":"2024-09-19T06:04:05.423868+0000","last_unstale":"2024-09-19T06:05:13.729589+0000","last_undegraded":"2024-09-19T06:05:13.729589+0000","last_fullsized":"2024-09-19T06:05:13.729589+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:17:15.556240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727323+0000","last_change":"2024-09-19T06:04:03.315749+0000","last_active":"2024-09-19T06:05:13.727323+0000","last_peered":"2024-09-19T06:05:13.727323+0000","last_clean":"2024-09-19T06:05:13.727323+0000","last_became_active":"2024-09-19T06:04:03.315404+0000","last_became_peered":"2024-09-19T06:04:03.315404+0000","last_unstale":"2024-09-19T06:05:13.727323+0000","last_undegraded":"2024-09-19T06:05:13.727323+0000","last_fullsized":"2024-09-19T06:05:13.727323+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:43:35.485993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":344,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724492+0000","last_change":"2024-09-19T06:02:49.934106+0000","last_active":"2024-09-19T06:05:13.724492+0000","last_peered":"2024-09-19T06:05:13.724492+0000","last_clean":"2024-09-19T06:05:13.724492+0000","last_became_active":"2024-09-19T06:02:49.933684+0000","last_became_peered":"2024-09-19T06:02:49.933684+0000","last_unstale":"2024-09-19T06:05:13.724492+0000","last_undegraded":"2024-09-19T06:05:13.724492+0000","last_fullsized":"2024-09-19T06:05:13.724492+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:59:27.582796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:59:27.582796+0000","last_clean_scrub_stamp":"2024-09-19T05:59:27.582796+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:35:06.837740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"87'1","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724414+0000","last_change":"2024-09-19T06:04:12.468160+0000","last_active":"2024-09-19T06:05:13.724414+0000","last_peered":"2024-09-19T06:05:13.724414+0000","last_clean":"2024-09-19T06:05:13.724414+0000","last_became_active":"2024-09-19T06:04:12.467642+0000","last_became_peered":"2024-09-19T06:04:12.467642+0000","last_unstale":"2024-09-19T06:05:13.724414+0000","last_undegraded":"2024-09-19T06:05:13.724414+0000","last_fullsized":"2024-09-19T06:05:13.724414+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:40.053143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724738+0000","last_change":"2024-09-19T06:04:05.435815+0000","last_active":"2024-09-19T06:05:13.724738+0000","last_peered":"2024-09-19T06:05:13.724738+0000","last_clean":"2024-09-19T06:05:13.724738+0000","last_became_active":"2024-09-19T06:04:05.435498+0000","last_became_peered":"2024-09-19T06:04:05.435498+0000","last_unstale":"2024-09-19T06:05:13.724738+0000","last_undegraded":"2024-09-19T06:05:13.724738+0000","last_fullsized":"2024-09-19T06:05:13.724738+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:33:30.330877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.731805+0000","last_change":"2024-09-19T06:05:13.730770+0000","last_active":"2024-09-19T06:05:13.731805+0000","last_peered":"2024-09-19T06:05:13.731805+0000","last_clean":"2024-09-19T06:05:13.731805+0000","last_became_active":"2024-09-19T06:05:13.730360+0000","last_became_peered":"2024-09-19T06:05:13.730360+0000","last_unstale":"2024-09-19T06:05:13.731805+0000","last_undegraded":"2024-09-19T06:05:13.731805+0000","last_fullsized":"2024-09-19T06:05:13.731805+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:06:34.488351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:15.014149+0000","last_change":"2024-09-19T06:04:12.466249+0000","last_active":"2024-09-19T06:05:15.014149+0000","last_peered":"2024-09-19T06:05:15.014149+0000","last_clean":"2024-09-19T06:05:15.014149+0000","last_became_active":"2024-09-19T06:04:12.465709+0000","last_became_peered":"2024-09-19T06:04:12.465709+0000","last_unstale":"2024-09-19T06:05:15.014149+0000","last_undegraded":"2024-09-19T06:05:15.014149+0000","last_fullsized":"2024-09-19T06:05:15.014149+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:02:11.454334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724466+0000","last_change":"2024-09-19T06:04:05.425733+0000","last_active":"2024-09-19T06:05:13.724466+0000","last_peered":"2024-09-19T06:05:13.724466+0000","last_clean":"2024-09-19T06:05:13.724466+0000","last_became_active":"2024-09-19T06:04:05.425399+0000","last_became_peered":"2024-09-19T06:04:05.425399+0000","last_unstale":"2024-09-19T06:05:13.724466+0000","last_undegraded":"2024-09-19T06:05:13.724466+0000","last_fullsized":"2024-09-19T06:05:13.724466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:35:33.287456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.475134+0000","last_change":"2024-09-19T06:04:03.319361+0000","last_active":"2024-09-19T06:05:14.475134+0000","last_peered":"2024-09-19T06:05:14.475134+0000","last_clean":"2024-09-19T06:05:14.475134+0000","last_became_active":"2024-09-19T06:04:03.319053+0000","last_became_peered":"2024-09-19T06:04:03.319053+0000","last_unstale":"2024-09-19T06:05:14.475134+0000","last_undegraded":"2024-09-19T06:05:14.475134+0000","last_fullsized":"2024-09-19T06:05:14.475134+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:25:23.739392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726834+0000","last_change":"2024-09-19T06:04:12.468270+0000","last_active":"2024-09-19T06:05:13.726834+0000","last_peered":"2024-09-19T06:05:13.726834+0000","last_clean":"2024-09-19T06:05:13.726834+0000","last_became_active":"2024-09-19T06:04:12.467872+0000","last_became_peered":"2024-09-19T06:04:12.467872+0000","last_unstale":"2024-09-19T06:05:13.726834+0000","last_undegraded":"2024-09-19T06:05:13.726834+0000","last_fullsized":"2024-09-19T06:05:13.726834+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:35.476189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724645+0000","last_change":"2024-09-19T06:04:05.431360+0000","last_active":"2024-09-19T06:05:13.724645+0000","last_peered":"2024-09-19T06:05:13.724645+0000","last_clean":"2024-09-19T06:05:13.724645+0000","last_became_active":"2024-09-19T06:04:05.431067+0000","last_became_peered":"2024-09-19T06:04:05.431067+0000","last_unstale":"2024-09-19T06:05:13.724645+0000","last_undegraded":"2024-09-19T06:05:13.724645+0000","last_fullsized":"2024-09-19T06:05:13.724645+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:16:25.317086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.159080+0000","last_change":"2024-09-19T06:04:03.316793+0000","last_active":"2024-09-19T06:05:14.159080+0000","last_peered":"2024-09-19T06:05:14.159080+0000","last_clean":"2024-09-19T06:05:14.159080+0000","last_became_active":"2024-09-19T06:04:03.316485+0000","last_became_peered":"2024-09-19T06:04:03.316485+0000","last_unstale":"2024-09-19T06:05:14.159080+0000","last_undegraded":"2024-09-19T06:05:14.159080+0000","last_fullsized":"2024-09-19T06:05:14.159080+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:19:26.427025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.473926+0000","last_change":"2024-09-19T06:04:12.466322+0000","last_active":"2024-09-19T06:05:14.473926+0000","last_peered":"2024-09-19T06:05:14.473926+0000","last_clean":"2024-09-19T06:05:14.473926+0000","last_became_active":"2024-09-19T06:04:12.465806+0000","last_became_peered":"2024-09-19T06:04:12.465806+0000","last_unstale":"2024-09-19T06:05:14.473926+0000","last_undegraded":"2024-09-19T06:05:14.473926+0000","last_fullsized":"2024-09-19T06:05:14.473926+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:33:28.893570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727866+0000","last_change":"2024-09-19T06:04:05.424864+0000","last_active":"2024-09-19T06:05:13.727866+0000","last_peered":"2024-09-19T06:05:13.727866+0000","last_clean":"2024-09-19T06:05:13.727866+0000","last_became_active":"2024-09-19T06:04:05.424504+0000","last_became_peered":"2024-09-19T06:04:05.424504+0000","last_unstale":"2024-09-19T06:05:13.727866+0000","last_undegraded":"2024-09-19T06:05:13.727866+0000","last_fullsized":"2024-09-19T06:05:13.727866+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:30.471757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.728243+0000","last_change":"2024-09-19T06:04:03.321925+0000","last_active":"2024-09-19T06:05:13.728243+0000","last_peered":"2024-09-19T06:05:13.728243+0000","last_clean":"2024-09-19T06:05:13.728243+0000","last_became_active":"2024-09-19T06:04:03.321445+0000","last_became_peered":"2024-09-19T06:04:03.321445+0000","last_unstale":"2024-09-19T06:05:13.728243+0000","last_undegraded":"2024-09-19T06:05:13.728243+0000","last_fullsized":"2024-09-19T06:05:13.728243+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:15:55.621352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.474063+0000","last_change":"2024-09-19T06:04:12.471413+0000","last_active":"2024-09-19T06:05:14.474063+0000","last_peered":"2024-09-19T06:05:14.474063+0000","last_clean":"2024-09-19T06:05:14.474063+0000","last_became_active":"2024-09-19T06:04:12.471057+0000","last_became_peered":"2024-09-19T06:04:12.471057+0000","last_unstale":"2024-09-19T06:05:14.474063+0000","last_undegraded":"2024-09-19T06:05:14.474063+0000","last_fullsized":"2024-09-19T06:05:14.474063+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:08:47.259211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.474222+0000","last_change":"2024-09-19T06:04:05.429447+0000","last_active":"2024-09-19T06:05:14.474222+0000","last_peered":"2024-09-19T06:05:14.474222+0000","last_clean":"2024-09-19T06:05:14.474222+0000","last_became_active":"2024-09-19T06:04:05.428852+0000","last_became_peered":"2024-09-19T06:04:05.428852+0000","last_unstale":"2024-09-19T06:05:14.474222+0000","last_undegraded":"2024-09-19T06:05:14.474222+0000","last_fullsized":"2024-09-19T06:05:14.474222+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:01.466814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726844+0000","last_change":"2024-09-19T06:04:03.378586+0000","last_active":"2024-09-19T06:05:13.726844+0000","last_peered":"2024-09-19T06:05:13.726844+0000","last_clean":"2024-09-19T06:05:13.726844+0000","last_became_active":"2024-09-19T06:04:03.378292+0000","last_became_peered":"2024-09-19T06:04:03.378292+0000","last_unstale":"2024-09-19T06:05:13.726844+0000","last_undegraded":"2024-09-19T06:05:13.726844+0000","last_fullsized":"2024-09-19T06:05:13.726844+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:54.247070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.159022+0000","last_change":"2024-09-19T06:04:12.470914+0000","last_active":"2024-09-19T06:05:14.159022+0000","last_peered":"2024-09-19T06:05:14.159022+0000","last_clean":"2024-09-19T06:05:14.159022+0000","last_became_active":"2024-09-19T06:04:12.470563+0000","last_became_peered":"2024-09-19T06:04:12.470563+0000","last_unstale":"2024-09-19T06:05:14.159022+0000","last_undegraded":"2024-09-19T06:05:14.159022+0000","last_fullsized":"2024-09-19T06:05:14.159022+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:13.060646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724169+0000","last_change":"2024-09-19T06:04:05.424009+0000","last_active":"2024-09-19T06:05:13.724169+0000","last_peered":"2024-09-19T06:05:13.724169+0000","last_clean":"2024-09-19T06:05:13.724169+0000","last_became_active":"2024-09-19T06:04:05.423670+0000","last_became_peered":"2024-09-19T06:04:05.423670+0000","last_unstale":"2024-09-19T06:05:13.724169+0000","last_undegraded":"2024-09-19T06:05:13.724169+0000","last_fullsized":"2024-09-19T06:05:13.724169+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:30:15.165259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726323+0000","last_change":"2024-09-19T06:04:03.317089+0000","last_active":"2024-09-19T06:05:13.726323+0000","last_peered":"2024-09-19T06:05:13.726323+0000","last_clean":"2024-09-19T06:05:13.726323+0000","last_became_active":"2024-09-19T06:04:03.316575+0000","last_became_peered":"2024-09-19T06:04:03.316575+0000","last_unstale":"2024-09-19T06:05:13.726323+0000","last_undegraded":"2024-09-19T06:05:13.726323+0000","last_fullsized":"2024-09-19T06:05:13.726323+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:11:43.769660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.732957+0000","last_change":"2024-09-19T06:05:13.731879+0000","last_active":"2024-09-19T06:05:13.732957+0000","last_peered":"2024-09-19T06:05:13.732957+0000","last_clean":"2024-09-19T06:05:13.732957+0000","last_became_active":"2024-09-19T06:05:13.731373+0000","last_became_peered":"2024-09-19T06:05:13.731373+0000","last_unstale":"2024-09-19T06:05:13.732957+0000","last_undegraded":"2024-09-19T06:05:13.732957+0000","last_fullsized":"2024-09-19T06:05:13.732957+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:41:45.556733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724870+0000","last_change":"2024-09-19T06:04:05.430145+0000","last_active":"2024-09-19T06:05:13.724870+0000","last_peered":"2024-09-19T06:05:13.724870+0000","last_clean":"2024-09-19T06:05:13.724870+0000","last_became_active":"2024-09-19T06:04:05.429763+0000","last_became_peered":"2024-09-19T06:04:05.429763+0000","last_unstale":"2024-09-19T06:05:13.724870+0000","last_undegraded":"2024-09-19T06:05:13.724870+0000","last_fullsized":"2024-09-19T06:05:13.724870+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:44:38.783894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.474581+0000","last_change":"2024-09-19T06:04:03.317410+0000","last_active":"2024-09-19T06:05:14.474581+0000","last_peered":"2024-09-19T06:05:14.474581+0000","last_clean":"2024-09-19T06:05:14.474581+0000","last_became_active":"2024-09-19T06:04:03.317068+0000","last_became_peered":"2024-09-19T06:04:03.317068+0000","last_unstale":"2024-09-19T06:05:14.474581+0000","last_undegraded":"2024-09-19T06:05:14.474581+0000","last_fullsized":"2024-09-19T06:05:14.474581+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:23.209080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727395+0000","last_change":"2024-09-19T06:04:12.469867+0000","last_active":"2024-09-19T06:05:13.727395+0000","last_peered":"2024-09-19T06:05:13.727395+0000","last_clean":"2024-09-19T06:05:13.727395+0000","last_became_active":"2024-09-19T06:04:12.469391+0000","last_became_peered":"2024-09-19T06:04:12.469391+0000","last_unstale":"2024-09-19T06:05:13.727395+0000","last_undegraded":"2024-09-19T06:05:13.727395+0000","last_fullsized":"2024-09-19T06:05:13.727395+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:43:29.493247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.158639+0000","last_change":"2024-09-19T06:04:05.423515+0000","last_active":"2024-09-19T06:05:14.158639+0000","last_peered":"2024-09-19T06:05:14.158639+0000","last_clean":"2024-09-19T06:05:14.158639+0000","last_became_active":"2024-09-19T06:04:05.422185+0000","last_became_peered":"2024-09-19T06:04:05.422185+0000","last_unstale":"2024-09-19T06:05:14.158639+0000","last_undegraded":"2024-09-19T06:05:14.158639+0000","last_fullsized":"2024-09-19T06:05:14.158639+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:09:22.951171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"81'2","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.737281+0000","last_change":"2024-09-19T06:05:13.736876+0000","last_active":"2024-09-19T06:05:13.737281+0000","last_peered":"2024-09-19T06:05:13.737281+0000","last_clean":"2024-09-19T06:05:13.737281+0000","last_became_active":"2024-09-19T06:05:13.731079+0000","last_became_peered":"2024-09-19T06:05:13.731079+0000","last_unstale":"2024-09-19T06:05:13.737281+0000","last_undegraded":"2024-09-19T06:05:13.737281+0000","last_fullsized":"2024-09-19T06:05:13.737281+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:23.458684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.474836+0000","last_change":"2024-09-19T06:04:12.468569+0000","last_active":"2024-09-19T06:05:14.474836+0000","last_peered":"2024-09-19T06:05:14.474836+0000","last_clean":"2024-09-19T06:05:14.474836+0000","last_became_active":"2024-09-19T06:04:12.467759+0000","last_became_peered":"2024-09-19T06:04:12.467759+0000","last_unstale":"2024-09-19T06:05:14.474836+0000","last_undegraded":"2024-09-19T06:05:14.474836+0000","last_fullsized":"2024-09-19T06:05:14.474836+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:20:49.817163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727216+0000","last_change":"2024-09-19T06:04:05.425703+0000","last_active":"2024-09-19T06:05:13.727216+0000","last_peered":"2024-09-19T06:05:13.727216+0000","last_clean":"2024-09-19T06:05:13.727216+0000","last_became_active":"2024-09-19T06:04:05.425360+0000","last_became_peered":"2024-09-19T06:04:05.425360+0000","last_unstale":"2024-09-19T06:05:13.727216+0000","last_undegraded":"2024-09-19T06:05:13.727216+0000","last_fullsized":"2024-09-19T06:05:13.727216+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:33:25.457191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"87'30","reported_seq":177,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:32.619890+0000","last_change":"2024-09-19T06:04:03.319087+0000","last_active":"2024-09-19T06:05:32.619890+0000","last_peered":"2024-09-19T06:05:32.619890+0000","last_clean":"2024-09-19T06:05:32.619890+0000","last_became_active":"2024-09-19T06:04:03.318721+0000","last_became_peered":"2024-09-19T06:04:03.318721+0000","last_unstale":"2024-09-19T06:05:32.619890+0000","last_undegraded":"2024-09-19T06:05:32.619890+0000","last_fullsized":"2024-09-19T06:05:32.619890+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:14:32.337455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63511,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":113,"num_read_kb":118,"num_write":30,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.723734+0000","last_change":"2024-09-19T06:04:12.472008+0000","last_active":"2024-09-19T06:05:13.723734+0000","last_peered":"2024-09-19T06:05:13.723734+0000","last_clean":"2024-09-19T06:05:13.723734+0000","last_became_active":"2024-09-19T06:04:12.471623+0000","last_became_peered":"2024-09-19T06:04:12.471623+0000","last_unstale":"2024-09-19T06:05:13.723734+0000","last_undegraded":"2024-09-19T06:05:13.723734+0000","last_fullsized":"2024-09-19T06:05:13.723734+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:13:11.424242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:15.014354+0000","last_change":"2024-09-19T06:04:05.434865+0000","last_active":"2024-09-19T06:05:15.014354+0000","last_peered":"2024-09-19T06:05:15.014354+0000","last_clean":"2024-09-19T06:05:15.014354+0000","last_became_active":"2024-09-19T06:04:05.434472+0000","last_became_peered":"2024-09-19T06:04:05.434472+0000","last_unstale":"2024-09-19T06:05:15.014354+0000","last_undegraded":"2024-09-19T06:05:15.014354+0000","last_fullsized":"2024-09-19T06:05:15.014354+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:35.490406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"81'3","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.475083+0000","last_change":"2024-09-19T06:04:03.380447+0000","last_active":"2024-09-19T06:05:14.475083+0000","last_peered":"2024-09-19T06:05:14.475083+0000","last_clean":"2024-09-19T06:05:14.475083+0000","last_became_active":"2024-09-19T06:04:03.380154+0000","last_became_peered":"2024-09-19T06:04:03.380154+0000","last_unstale":"2024-09-19T06:05:14.475083+0000","last_undegraded":"2024-09-19T06:05:14.475083+0000","last_fullsized":"2024-09-19T06:05:14.475083+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:48:11.570148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726945+0000","last_change":"2024-09-19T06:04:12.467995+0000","last_active":"2024-09-19T06:05:13.726945+0000","last_peered":"2024-09-19T06:05:13.726945+0000","last_clean":"2024-09-19T06:05:13.726945+0000","last_became_active":"2024-09-19T06:04:12.467539+0000","last_became_peered":"2024-09-19T06:04:12.467539+0000","last_unstale":"2024-09-19T06:05:13.726945+0000","last_undegraded":"2024-09-19T06:05:13.726945+0000","last_fullsized":"2024-09-19T06:05:13.726945+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:13:29.285909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726884+0000","last_change":"2024-09-19T06:04:05.429919+0000","last_active":"2024-09-19T06:05:13.726884+0000","last_peered":"2024-09-19T06:05:13.726884+0000","last_clean":"2024-09-19T06:05:13.726884+0000","last_became_active":"2024-09-19T06:04:05.429597+0000","last_became_peered":"2024-09-19T06:04:05.429597+0000","last_unstale":"2024-09-19T06:05:13.726884+0000","last_undegraded":"2024-09-19T06:05:13.726884+0000","last_fullsized":"2024-09-19T06:05:13.726884+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:08:38.816272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724643+0000","last_change":"2024-09-19T06:04:03.320501+0000","last_active":"2024-09-19T06:05:13.724643+0000","last_peered":"2024-09-19T06:05:13.724643+0000","last_clean":"2024-09-19T06:05:13.724643+0000","last_became_active":"2024-09-19T06:04:03.320093+0000","last_became_peered":"2024-09-19T06:04:03.320093+0000","last_unstale":"2024-09-19T06:05:13.724643+0000","last_undegraded":"2024-09-19T06:05:13.724643+0000","last_fullsized":"2024-09-19T06:05:13.724643+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:31:11.896935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.723518+0000","last_change":"2024-09-19T06:04:12.468455+0000","last_active":"2024-09-19T06:05:13.723518+0000","last_peered":"2024-09-19T06:05:13.723518+0000","last_clean":"2024-09-19T06:05:13.723518+0000","last_became_active":"2024-09-19T06:04:12.468007+0000","last_became_peered":"2024-09-19T06:04:12.468007+0000","last_unstale":"2024-09-19T06:05:13.723518+0000","last_undegraded":"2024-09-19T06:05:13.723518+0000","last_fullsized":"2024-09-19T06:05:13.723518+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:50:58.995825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:15.014577+0000","last_change":"2024-09-19T06:04:05.427599+0000","last_active":"2024-09-19T06:05:15.014577+0000","last_peered":"2024-09-19T06:05:15.014577+0000","last_clean":"2024-09-19T06:05:15.014577+0000","last_became_active":"2024-09-19T06:04:05.425338+0000","last_became_peered":"2024-09-19T06:04:05.425338+0000","last_unstale":"2024-09-19T06:05:15.014577+0000","last_undegraded":"2024-09-19T06:05:15.014577+0000","last_fullsized":"2024-09-19T06:05:15.014577+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:44.547625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.728363+0000","last_change":"2024-09-19T06:04:03.322165+0000","last_active":"2024-09-19T06:05:13.728363+0000","last_peered":"2024-09-19T06:05:13.728363+0000","last_clean":"2024-09-19T06:05:13.728363+0000","last_became_active":"2024-09-19T06:04:03.321822+0000","last_became_peered":"2024-09-19T06:04:03.321822+0000","last_unstale":"2024-09-19T06:05:13.728363+0000","last_undegraded":"2024-09-19T06:05:13.728363+0000","last_fullsized":"2024-09-19T06:05:13.728363+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:58:00.943453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.729258+0000","last_change":"2024-09-19T06:04:12.465823+0000","last_active":"2024-09-19T06:05:13.729258+0000","last_peered":"2024-09-19T06:05:13.729258+0000","last_clean":"2024-09-19T06:05:13.729258+0000","last_became_active":"2024-09-19T06:04:12.465375+0000","last_became_peered":"2024-09-19T06:04:12.465375+0000","last_unstale":"2024-09-19T06:05:13.729258+0000","last_undegraded":"2024-09-19T06:05:13.729258+0000","last_fullsized":"2024-09-19T06:05:13.729258+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:26:25.428328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726852+0000","last_change":"2024-09-19T06:04:12.470023+0000","last_active":"2024-09-19T06:05:13.726852+0000","last_peered":"2024-09-19T06:05:13.726852+0000","last_clean":"2024-09-19T06:05:13.726852+0000","last_became_active":"2024-09-19T06:04:12.469651+0000","last_became_peered":"2024-09-19T06:04:12.469651+0000","last_unstale":"2024-09-19T06:05:13.726852+0000","last_undegraded":"2024-09-19T06:05:13.726852+0000","last_fullsized":"2024-09-19T06:05:13.726852+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:50:35.374437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.723642+0000","last_change":"2024-09-19T06:04:05.417466+0000","last_active":"2024-09-19T06:05:13.723642+0000","last_peered":"2024-09-19T06:05:13.723642+0000","last_clean":"2024-09-19T06:05:13.723642+0000","last_became_active":"2024-09-19T06:04:05.417026+0000","last_became_peered":"2024-09-19T06:04:05.417026+0000","last_unstale":"2024-09-19T06:05:13.723642+0000","last_undegraded":"2024-09-19T06:05:13.723642+0000","last_fullsized":"2024-09-19T06:05:13.723642+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:44:08.251755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.474542+0000","last_change":"2024-09-19T06:04:03.317466+0000","last_active":"2024-09-19T06:05:14.474542+0000","last_peered":"2024-09-19T06:05:14.474542+0000","last_clean":"2024-09-19T06:05:14.474542+0000","last_became_active":"2024-09-19T06:04:03.317148+0000","last_became_peered":"2024-09-19T06:04:03.317148+0000","last_unstale":"2024-09-19T06:05:14.474542+0000","last_undegraded":"2024-09-19T06:05:14.474542+0000","last_fullsized":"2024-09-19T06:05:14.474542+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:45:50.789900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727976+0000","last_change":"2024-09-19T06:04:12.469279+0000","last_active":"2024-09-19T06:05:13.727976+0000","last_peered":"2024-09-19T06:05:13.727976+0000","last_clean":"2024-09-19T06:05:13.727976+0000","last_became_active":"2024-09-19T06:04:12.467928+0000","last_became_peered":"2024-09-19T06:04:12.467928+0000","last_unstale":"2024-09-19T06:05:13.727976+0000","last_undegraded":"2024-09-19T06:05:13.727976+0000","last_fullsized":"2024-09-19T06:05:13.727976+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:52:25.839433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.729399+0000","last_change":"2024-09-19T06:04:05.420425+0000","last_active":"2024-09-19T06:05:13.729399+0000","last_peered":"2024-09-19T06:05:13.729399+0000","last_clean":"2024-09-19T06:05:13.729399+0000","last_became_active":"2024-09-19T06:04:05.420107+0000","last_became_peered":"2024-09-19T06:04:05.420107+0000","last_unstale":"2024-09-19T06:05:13.729399+0000","last_undegraded":"2024-09-19T06:05:13.729399+0000","last_fullsized":"2024-09-19T06:05:13.729399+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:49:24.566302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.158396+0000","last_change":"2024-09-19T06:04:03.315704+0000","last_active":"2024-09-19T06:05:14.158396+0000","last_peered":"2024-09-19T06:05:14.158396+0000","last_clean":"2024-09-19T06:05:14.158396+0000","last_became_active":"2024-09-19T06:04:03.315392+0000","last_became_peered":"2024-09-19T06:04:03.315392+0000","last_unstale":"2024-09-19T06:05:14.158396+0000","last_undegraded":"2024-09-19T06:05:14.158396+0000","last_fullsized":"2024-09-19T06:05:14.158396+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:52:14.417470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"81'1","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.728460+0000","last_change":"2024-09-19T06:04:03.323560+0000","last_active":"2024-09-19T06:05:13.728460+0000","last_peered":"2024-09-19T06:05:13.728460+0000","last_clean":"2024-09-19T06:05:13.728460+0000","last_became_active":"2024-09-19T06:04:03.323188+0000","last_became_peered":"2024-09-19T06:04:03.323188+0000","last_unstale":"2024-09-19T06:05:13.728460+0000","last_undegraded":"2024-09-19T06:05:13.728460+0000","last_fullsized":"2024-09-19T06:05:13.728460+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:02:50.426435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.474822+0000","last_change":"2024-09-19T06:04:05.430677+0000","last_active":"2024-09-19T06:05:14.474822+0000","last_peered":"2024-09-19T06:05:14.474822+0000","last_clean":"2024-09-19T06:05:14.474822+0000","last_became_active":"2024-09-19T06:04:05.430257+0000","last_became_peered":"2024-09-19T06:04:05.430257+0000","last_unstale":"2024-09-19T06:05:14.474822+0000","last_undegraded":"2024-09-19T06:05:14.474822+0000","last_fullsized":"2024-09-19T06:05:14.474822+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:38:42.138770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727118+0000","last_change":"2024-09-19T06:04:12.465252+0000","last_active":"2024-09-19T06:05:13.727118+0000","last_peered":"2024-09-19T06:05:13.727118+0000","last_clean":"2024-09-19T06:05:13.727118+0000","last_became_active":"2024-09-19T06:04:12.464649+0000","last_became_peered":"2024-09-19T06:04:12.464649+0000","last_unstale":"2024-09-19T06:05:13.727118+0000","last_undegraded":"2024-09-19T06:05:13.727118+0000","last_fullsized":"2024-09-19T06:05:13.727118+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:11:43.137148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"81'1","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.474959+0000","last_change":"2024-09-19T06:04:03.317584+0000","last_active":"2024-09-19T06:05:14.474959+0000","last_peered":"2024-09-19T06:05:14.474959+0000","last_clean":"2024-09-19T06:05:14.474959+0000","last_became_active":"2024-09-19T06:04:03.317250+0000","last_became_peered":"2024-09-19T06:04:03.317250+0000","last_unstale":"2024-09-19T06:05:14.474959+0000","last_undegraded":"2024-09-19T06:05:14.474959+0000","last_fullsized":"2024-09-19T06:05:14.474959+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:22.353887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727268+0000","last_change":"2024-09-19T06:04:05.431102+0000","last_active":"2024-09-19T06:05:13.727268+0000","last_peered":"2024-09-19T06:05:13.727268+0000","last_clean":"2024-09-19T06:05:13.727268+0000","last_became_active":"2024-09-19T06:04:05.430792+0000","last_became_peered":"2024-09-19T06:04:05.430792+0000","last_unstale":"2024-09-19T06:05:13.727268+0000","last_undegraded":"2024-09-19T06:05:13.727268+0000","last_fullsized":"2024-09-19T06:05:13.727268+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:48:48.682273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727983+0000","last_change":"2024-09-19T06:04:12.467143+0000","last_active":"2024-09-19T06:05:13.727983+0000","last_peered":"2024-09-19T06:05:13.727983+0000","last_clean":"2024-09-19T06:05:13.727983+0000","last_became_active":"2024-09-19T06:04:12.466672+0000","last_became_peered":"2024-09-19T06:04:12.466672+0000","last_unstale":"2024-09-19T06:05:13.727983+0000","last_undegraded":"2024-09-19T06:05:13.727983+0000","last_fullsized":"2024-09-19T06:05:13.727983+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:57:36.710316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726828+0000","last_change":"2024-09-19T06:04:05.427387+0000","last_active":"2024-09-19T06:05:13.726828+0000","last_peered":"2024-09-19T06:05:13.726828+0000","last_clean":"2024-09-19T06:05:13.726828+0000","last_became_active":"2024-09-19T06:04:05.427082+0000","last_became_peered":"2024-09-19T06:04:05.427082+0000","last_unstale":"2024-09-19T06:05:13.726828+0000","last_undegraded":"2024-09-19T06:05:13.726828+0000","last_fullsized":"2024-09-19T06:05:13.726828+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:55.931289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.728393+0000","last_change":"2024-09-19T06:04:05.434396+0000","last_active":"2024-09-19T06:05:13.728393+0000","last_peered":"2024-09-19T06:05:13.728393+0000","last_clean":"2024-09-19T06:05:13.728393+0000","last_became_active":"2024-09-19T06:04:05.433907+0000","last_became_peered":"2024-09-19T06:04:05.433907+0000","last_unstale":"2024-09-19T06:05:13.728393+0000","last_undegraded":"2024-09-19T06:05:13.728393+0000","last_fullsized":"2024-09-19T06:05:13.728393+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:02:40.885820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727853+0000","last_change":"2024-09-19T06:04:05.435813+0000","last_active":"2024-09-19T06:05:13.727853+0000","last_peered":"2024-09-19T06:05:13.727853+0000","last_clean":"2024-09-19T06:05:13.727853+0000","last_became_active":"2024-09-19T06:04:05.435441+0000","last_became_peered":"2024-09-19T06:04:05.435441+0000","last_unstale":"2024-09-19T06:05:13.727853+0000","last_undegraded":"2024-09-19T06:05:13.727853+0000","last_fullsized":"2024-09-19T06:05:13.727853+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:11:20.071732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726943+0000","last_change":"2024-09-19T06:04:05.433045+0000","last_active":"2024-09-19T06:05:13.726943+0000","last_peered":"2024-09-19T06:05:13.726943+0000","last_clean":"2024-09-19T06:05:13.726943+0000","last_became_active":"2024-09-19T06:04:05.432674+0000","last_became_peered":"2024-09-19T06:04:05.432674+0000","last_unstale":"2024-09-19T06:05:13.726943+0000","last_undegraded":"2024-09-19T06:05:13.726943+0000","last_fullsized":"2024-09-19T06:05:13.726943+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:33:06.743886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.158713+0000","last_change":"2024-09-19T06:04:05.431702+0000","last_active":"2024-09-19T06:05:14.158713+0000","last_peered":"2024-09-19T06:05:14.158713+0000","last_clean":"2024-09-19T06:05:14.158713+0000","last_became_active":"2024-09-19T06:04:05.431394+0000","last_became_peered":"2024-09-19T06:04:05.431394+0000","last_unstale":"2024-09-19T06:05:14.158713+0000","last_undegraded":"2024-09-19T06:05:14.158713+0000","last_fullsized":"2024-09-19T06:05:14.158713+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:42:18.692549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.733030+0000","last_change":"2024-09-19T06:05:13.733030+0000","last_active":"2024-09-19T06:05:13.733030+0000","last_peered":"2024-09-19T06:05:13.733030+0000","last_clean":"2024-09-19T06:05:13.733030+0000","last_became_active":"2024-09-19T06:05:13.732680+0000","last_became_peered":"2024-09-19T06:05:13.732680+0000","last_unstale":"2024-09-19T06:05:13.733030+0000","last_undegraded":"2024-09-19T06:05:13.733030+0000","last_fullsized":"2024-09-19T06:05:13.733030+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:53:24.299931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727345+0000","last_change":"2024-09-19T06:04:05.430104+0000","last_active":"2024-09-19T06:05:13.727345+0000","last_peered":"2024-09-19T06:05:13.727345+0000","last_clean":"2024-09-19T06:05:13.727345+0000","last_became_active":"2024-09-19T06:04:05.429779+0000","last_became_peered":"2024-09-19T06:04:05.429779+0000","last_unstale":"2024-09-19T06:05:13.727345+0000","last_undegraded":"2024-09-19T06:05:13.727345+0000","last_fullsized":"2024-09-19T06:05:13.727345+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:52:46.191484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.730313+0000","last_change":"2024-09-19T06:04:05.427235+0000","last_active":"2024-09-19T06:05:13.730313+0000","last_peered":"2024-09-19T06:05:13.730313+0000","last_clean":"2024-09-19T06:05:13.730313+0000","last_became_active":"2024-09-19T06:04:05.426937+0000","last_became_peered":"2024-09-19T06:04:05.426937+0000","last_unstale":"2024-09-19T06:05:13.730313+0000","last_undegraded":"2024-09-19T06:05:13.730313+0000","last_fullsized":"2024-09-19T06:05:13.730313+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:55.949564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.474156+0000","last_change":"2024-09-19T06:04:05.422199+0000","last_active":"2024-09-19T06:05:14.474156+0000","last_peered":"2024-09-19T06:05:14.474156+0000","last_clean":"2024-09-19T06:05:14.474156+0000","last_became_active":"2024-09-19T06:04:05.421681+0000","last_became_peered":"2024-09-19T06:04:05.421681+0000","last_unstale":"2024-09-19T06:05:14.474156+0000","last_undegraded":"2024-09-19T06:05:14.474156+0000","last_fullsized":"2024-09-19T06:05:14.474156+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:27:54.774211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.729451+0000","last_change":"2024-09-19T06:04:05.426559+0000","last_active":"2024-09-19T06:05:13.729451+0000","last_peered":"2024-09-19T06:05:13.729451+0000","last_clean":"2024-09-19T06:05:13.729451+0000","last_became_active":"2024-09-19T06:04:05.423197+0000","last_became_peered":"2024-09-19T06:04:05.423197+0000","last_unstale":"2024-09-19T06:05:13.729451+0000","last_undegraded":"2024-09-19T06:05:13.729451+0000","last_fullsized":"2024-09-19T06:05:13.729451+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:43.964457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:15.014232+0000","last_change":"2024-09-19T06:04:05.435779+0000","last_active":"2024-09-19T06:05:15.014232+0000","last_peered":"2024-09-19T06:05:15.014232+0000","last_clean":"2024-09-19T06:05:15.014232+0000","last_became_active":"2024-09-19T06:04:05.435436+0000","last_became_peered":"2024-09-19T06:04:05.435436+0000","last_unstale":"2024-09-19T06:05:15.014232+0000","last_undegraded":"2024-09-19T06:05:15.014232+0000","last_fullsized":"2024-09-19T06:05:15.014232+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:13:03.341438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.158694+0000","last_change":"2024-09-19T06:04:05.431718+0000","last_active":"2024-09-19T06:05:14.158694+0000","last_peered":"2024-09-19T06:05:14.158694+0000","last_clean":"2024-09-19T06:05:14.158694+0000","last_became_active":"2024-09-19T06:04:05.431429+0000","last_became_peered":"2024-09-19T06:04:05.431429+0000","last_unstale":"2024-09-19T06:05:14.158694+0000","last_undegraded":"2024-09-19T06:05:14.158694+0000","last_fullsized":"2024-09-19T06:05:14.158694+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:11:42.818368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727494+0000","last_change":"2024-09-19T06:04:05.429575+0000","last_active":"2024-09-19T06:05:13.727494+0000","last_peered":"2024-09-19T06:05:13.727494+0000","last_clean":"2024-09-19T06:05:13.727494+0000","last_became_active":"2024-09-19T06:04:05.429226+0000","last_became_peered":"2024-09-19T06:04:05.429226+0000","last_unstale":"2024-09-19T06:05:13.727494+0000","last_undegraded":"2024-09-19T06:05:13.727494+0000","last_fullsized":"2024-09-19T06:05:13.727494+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:29:19.680433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.728155+0000","last_change":"2024-09-19T06:04:05.431612+0000","last_active":"2024-09-19T06:05:13.728155+0000","last_peered":"2024-09-19T06:05:13.728155+0000","last_clean":"2024-09-19T06:05:13.728155+0000","last_became_active":"2024-09-19T06:04:05.431240+0000","last_became_peered":"2024-09-19T06:04:05.431240+0000","last_unstale":"2024-09-19T06:05:13.728155+0000","last_undegraded":"2024-09-19T06:05:13.728155+0000","last_fullsized":"2024-09-19T06:05:13.728155+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:46:14.138603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724293+0000","last_change":"2024-09-19T06:04:05.428849+0000","last_active":"2024-09-19T06:05:13.724293+0000","last_peered":"2024-09-19T06:05:13.724293+0000","last_clean":"2024-09-19T06:05:13.724293+0000","last_became_active":"2024-09-19T06:04:05.428516+0000","last_became_peered":"2024-09-19T06:04:05.428516+0000","last_unstale":"2024-09-19T06:05:13.724293+0000","last_undegraded":"2024-09-19T06:05:13.724293+0000","last_fullsized":"2024-09-19T06:05:13.724293+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:58:00.323959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.728373+0000","last_change":"2024-09-19T06:04:05.436409+0000","last_active":"2024-09-19T06:05:13.728373+0000","last_peered":"2024-09-19T06:05:13.728373+0000","last_clean":"2024-09-19T06:05:13.728373+0000","last_became_active":"2024-09-19T06:04:05.436058+0000","last_became_peered":"2024-09-19T06:04:05.436058+0000","last_unstale":"2024-09-19T06:05:13.728373+0000","last_undegraded":"2024-09-19T06:05:13.728373+0000","last_fullsized":"2024-09-19T06:05:13.728373+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:20:45.227159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:15.014023+0000","last_change":"2024-09-19T06:04:05.434398+0000","last_active":"2024-09-19T06:05:15.014023+0000","last_peered":"2024-09-19T06:05:15.014023+0000","last_clean":"2024-09-19T06:05:15.014023+0000","last_became_active":"2024-09-19T06:04:05.433635+0000","last_became_peered":"2024-09-19T06:04:05.433635+0000","last_unstale":"2024-09-19T06:05:15.014023+0000","last_undegraded":"2024-09-19T06:05:15.014023+0000","last_fullsized":"2024-09-19T06:05:15.014023+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:10:42.104705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726446+0000","last_change":"2024-09-19T06:04:05.423447+0000","last_active":"2024-09-19T06:05:13.726446+0000","last_peered":"2024-09-19T06:05:13.726446+0000","last_clean":"2024-09-19T06:05:13.726446+0000","last_became_active":"2024-09-19T06:04:05.423081+0000","last_became_peered":"2024-09-19T06:04:05.423081+0000","last_unstale":"2024-09-19T06:05:13.726446+0000","last_undegraded":"2024-09-19T06:05:13.726446+0000","last_fullsized":"2024-09-19T06:05:13.726446+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:03:54.856251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726503+0000","last_change":"2024-09-19T06:04:05.426371+0000","last_active":"2024-09-19T06:05:13.726503+0000","last_peered":"2024-09-19T06:05:13.726503+0000","last_clean":"2024-09-19T06:05:13.726503+0000","last_became_active":"2024-09-19T06:04:05.425601+0000","last_became_peered":"2024-09-19T06:04:05.425601+0000","last_unstale":"2024-09-19T06:05:13.726503+0000","last_undegraded":"2024-09-19T06:05:13.726503+0000","last_fullsized":"2024-09-19T06:05:13.726503+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:55:05.677121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.158746+0000","last_change":"2024-09-19T06:04:05.426264+0000","last_active":"2024-09-19T06:05:14.158746+0000","last_peered":"2024-09-19T06:05:14.158746+0000","last_clean":"2024-09-19T06:05:14.158746+0000","last_became_active":"2024-09-19T06:04:05.425939+0000","last_became_peered":"2024-09-19T06:04:05.425939+0000","last_unstale":"2024-09-19T06:05:14.158746+0000","last_undegraded":"2024-09-19T06:05:14.158746+0000","last_fullsized":"2024-09-19T06:05:14.158746+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:18:43.250682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727245+0000","last_change":"2024-09-19T06:04:05.432654+0000","last_active":"2024-09-19T06:05:13.727245+0000","last_peered":"2024-09-19T06:05:13.727245+0000","last_clean":"2024-09-19T06:05:13.727245+0000","last_became_active":"2024-09-19T06:04:05.431489+0000","last_became_peered":"2024-09-19T06:04:05.431489+0000","last_unstale":"2024-09-19T06:05:13.727245+0000","last_undegraded":"2024-09-19T06:05:13.727245+0000","last_fullsized":"2024-09-19T06:05:13.727245+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:15:41.251538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724637+0000","last_change":"2024-09-19T06:04:05.435221+0000","last_active":"2024-09-19T06:05:13.724637+0000","last_peered":"2024-09-19T06:05:13.724637+0000","last_clean":"2024-09-19T06:05:13.724637+0000","last_became_active":"2024-09-19T06:04:05.434909+0000","last_became_peered":"2024-09-19T06:04:05.434909+0000","last_unstale":"2024-09-19T06:05:13.724637+0000","last_undegraded":"2024-09-19T06:05:13.724637+0000","last_fullsized":"2024-09-19T06:05:13.724637+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:15:20.414499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.731152+0000","last_change":"2024-09-19T06:05:13.731152+0000","last_active":"2024-09-19T06:05:13.731152+0000","last_peered":"2024-09-19T06:05:13.731152+0000","last_clean":"2024-09-19T06:05:13.731152+0000","last_became_active":"2024-09-19T06:05:13.730810+0000","last_became_peered":"2024-09-19T06:05:13.730810+0000","last_unstale":"2024-09-19T06:05:13.731152+0000","last_undegraded":"2024-09-19T06:05:13.731152+0000","last_fullsized":"2024-09-19T06:05:13.731152+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:55:13.359784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:15.014646+0000","last_change":"2024-09-19T06:04:05.432940+0000","last_active":"2024-09-19T06:05:15.014646+0000","last_peered":"2024-09-19T06:05:15.014646+0000","last_clean":"2024-09-19T06:05:15.014646+0000","last_became_active":"2024-09-19T06:04:05.432579+0000","last_became_peered":"2024-09-19T06:04:05.432579+0000","last_unstale":"2024-09-19T06:05:15.014646+0000","last_undegraded":"2024-09-19T06:05:15.014646+0000","last_fullsized":"2024-09-19T06:05:15.014646+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:56.740048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.729272+0000","last_change":"2024-09-19T06:04:05.417967+0000","last_active":"2024-09-19T06:05:13.729272+0000","last_peered":"2024-09-19T06:05:13.729272+0000","last_clean":"2024-09-19T06:05:13.729272+0000","last_became_active":"2024-09-19T06:04:05.417658+0000","last_became_peered":"2024-09-19T06:04:05.417658+0000","last_unstale":"2024-09-19T06:05:13.729272+0000","last_undegraded":"2024-09-19T06:05:13.729272+0000","last_fullsized":"2024-09-19T06:05:13.729272+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:55.571313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724281+0000","last_change":"2024-09-19T06:04:05.424627+0000","last_active":"2024-09-19T06:05:13.724281+0000","last_peered":"2024-09-19T06:05:13.724281+0000","last_clean":"2024-09-19T06:05:13.724281+0000","last_became_active":"2024-09-19T06:04:05.424301+0000","last_became_peered":"2024-09-19T06:04:05.424301+0000","last_unstale":"2024-09-19T06:05:13.724281+0000","last_undegraded":"2024-09-19T06:05:13.724281+0000","last_fullsized":"2024-09-19T06:05:13.724281+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:48:00.964989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.728349+0000","last_change":"2024-09-19T06:04:05.423635+0000","last_active":"2024-09-19T06:05:13.728349+0000","last_peered":"2024-09-19T06:05:13.728349+0000","last_clean":"2024-09-19T06:05:13.728349+0000","last_became_active":"2024-09-19T06:04:05.422625+0000","last_became_peered":"2024-09-19T06:04:05.422625+0000","last_unstale":"2024-09-19T06:05:13.728349+0000","last_undegraded":"2024-09-19T06:05:13.728349+0000","last_fullsized":"2024-09-19T06:05:13.728349+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:33:34.099443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726970+0000","last_change":"2024-09-19T06:04:05.428933+0000","last_active":"2024-09-19T06:05:13.726970+0000","last_peered":"2024-09-19T06:05:13.726970+0000","last_clean":"2024-09-19T06:05:13.726970+0000","last_became_active":"2024-09-19T06:04:05.428598+0000","last_became_peered":"2024-09-19T06:04:05.428598+0000","last_unstale":"2024-09-19T06:05:13.726970+0000","last_undegraded":"2024-09-19T06:05:13.726970+0000","last_fullsized":"2024-09-19T06:05:13.726970+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:27:15.111954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.731274+0000","last_change":"2024-09-19T06:05:13.730637+0000","last_active":"2024-09-19T06:05:13.731274+0000","last_peered":"2024-09-19T06:05:13.731274+0000","last_clean":"2024-09-19T06:05:13.731274+0000","last_became_active":"2024-09-19T06:05:13.730224+0000","last_became_peered":"2024-09-19T06:05:13.730224+0000","last_unstale":"2024-09-19T06:05:13.731274+0000","last_undegraded":"2024-09-19T06:05:13.731274+0000","last_fullsized":"2024-09-19T06:05:13.731274+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:14:08.175943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726586+0000","last_change":"2024-09-19T06:04:05.430427+0000","last_active":"2024-09-19T06:05:13.726586+0000","last_peered":"2024-09-19T06:05:13.726586+0000","last_clean":"2024-09-19T06:05:13.726586+0000","last_became_active":"2024-09-19T06:04:05.430106+0000","last_became_peered":"2024-09-19T06:04:05.430106+0000","last_unstale":"2024-09-19T06:05:13.726586+0000","last_undegraded":"2024-09-19T06:05:13.726586+0000","last_fullsized":"2024-09-19T06:05:13.726586+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:03:00.764689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726972+0000","last_change":"2024-09-19T06:04:05.427189+0000","last_active":"2024-09-19T06:05:13.726972+0000","last_peered":"2024-09-19T06:05:13.726972+0000","last_clean":"2024-09-19T06:05:13.726972+0000","last_became_active":"2024-09-19T06:04:05.426874+0000","last_became_peered":"2024-09-19T06:04:05.426874+0000","last_unstale":"2024-09-19T06:05:13.726972+0000","last_undegraded":"2024-09-19T06:05:13.726972+0000","last_fullsized":"2024-09-19T06:05:13.726972+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:37:10.910723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.728272+0000","last_change":"2024-09-19T06:04:05.435803+0000","last_active":"2024-09-19T06:05:13.728272+0000","last_peered":"2024-09-19T06:05:13.728272+0000","last_clean":"2024-09-19T06:05:13.728272+0000","last_became_active":"2024-09-19T06:04:05.435430+0000","last_became_peered":"2024-09-19T06:04:05.435430+0000","last_unstale":"2024-09-19T06:05:13.728272+0000","last_undegraded":"2024-09-19T06:05:13.728272+0000","last_fullsized":"2024-09-19T06:05:13.728272+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:41.828016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64309,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":119,"num_read_kb":124,"num_write":83,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":192927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":70,"ondisk_log_size":70,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547232,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1007616,"data_stored":497802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776165,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36992,"kb_used_data":1640,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708160,"statfs":{"total":95995035648,"available":95957155840,"internally_reserved":0,"allocated":1679360,"data_stored":1147745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939690,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1011712,"data_stored":502446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168622,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1011712,"data_stored":498372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397555,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36920,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708232,"statfs":{"total":95995035648,"available":95957229568,"internally_reserved":0,"allocated":1605632,"data_stored":1092814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561081,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":999424,"data_stored":493672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790013,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28604,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716548,"statfs":{"total":95995035648,"available":95965745152,"internally_reserved":0,"allocated":1609728,"data_stored":1088318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953538,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1007616,"data_stored":497790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182471,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36336,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708816,"statfs":{"total":95995035648,"available":95957827584,"internally_reserved":0,"allocated":1007616,"data_stored":493776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411405,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28080,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717072,"statfs":{"total":95995035648,"available":95966281728,"internally_reserved":0,"allocated":1073152,"data_stored":557183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574930,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28080,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717072,"statfs":{"total":95995035648,"available":95966281728,"internally_reserved":0,"allocated":1073152,"data_stored":557183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738455,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1003520,"data_stored":493762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":63511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":63511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":63705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T06:05:36.896 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T06:05:37.149 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:05:37.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:36 smithi099 ceph-mon[35300]: from='client.14988 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:05:37.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:36 smithi117 ceph-mon[35050]: from='client.14988 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:05:37.271 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:36 smithi037 ceph-mon[31211]: from='client.14988 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:05:37.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:37.680+0000 7f83e2719640 1 -- 172.21.15.37:0/2730493680 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83dc106f10 msgr2=0x7f83dc10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:37.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:37.680+0000 7f83e2719640 1 --2- 172.21.15.37:0/2730493680 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83dc106f10 0x7f83dc10ea90 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f83d4009ca0 tx=0x7f83d402a8c0 comp rx=0 tx=0).stop 2024-09-19T06:05:37.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:37.680+0000 7f83e2719640 1 -- 172.21.15.37:0/2730493680 shutdown_connections 2024-09-19T06:05:37.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:37.680+0000 7f83e2719640 1 --2- 172.21.15.37:0/2730493680 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83dc102790 0x7f83dc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:37.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:37.680+0000 7f83e2719640 1 --2- 172.21.15.37:0/2730493680 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83dc106f10 0x7f83dc10ea90 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:37.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:37.680+0000 7f83e2719640 1 --2- 172.21.15.37:0/2730493680 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83dc101de0 0x7f83dc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:37.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:37.680+0000 7f83e2719640 1 -- 172.21.15.37:0/2730493680 >> 172.21.15.37:0/2730493680 conn(0x7f83dc0fd8c0 msgr2=0x7f83dc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:37.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:37.680+0000 7f83e2719640 1 -- 172.21.15.37:0/2730493680 shutdown_connections 2024-09-19T06:05:37.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:37.680+0000 7f83e2719640 1 -- 172.21.15.37:0/2730493680 wait complete. 2024-09-19T06:05:37.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:37.681+0000 7f83e2719640 1 Processor -- start 2024-09-19T06:05:37.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:37.681+0000 7f83e2719640 1 -- start start 2024-09-19T06:05:37.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:37.681+0000 7f83e2719640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83dc101de0 0x7f83dc198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:37.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:37.681+0000 7f83e2719640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83dc102790 0x7f83dc1989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:37.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:37.681+0000 7f83e2719640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83dc106f10 0x7f83dc19cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:37.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:37.681+0000 7f83e2719640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f83dc111f90 con 0x7f83dc106f10 2024-09-19T06:05:37.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:37.681+0000 7f83e2719640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f83dc111e10 con 0x7f83dc102790 2024-09-19T06:05:37.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:37.681+0000 7f83e2719640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f83dc112110 con 0x7f83dc101de0 2024-09-19T06:05:37.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:37.681+0000 7f83e0cb6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83dc106f10 0x7f83dc19cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:37.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:37.681+0000 7f83e0cb6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83dc106f10 0x7f83dc19cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56766/0 (socket says 172.21.15.37:56766) 2024-09-19T06:05:37.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:37.681+0000 7f83e0cb6640 1 -- 172.21.15.37:0/631940073 learned_addr learned my addr 172.21.15.37:0/631940073 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:05:37.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:37.681+0000 7f83d3fff640 1 --2- 172.21.15.37:0/631940073 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83dc102790 0x7f83dc1989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:37.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:37.681+0000 7f83dbfff640 1 --2- 172.21.15.37:0/631940073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83dc101de0 0x7f83dc198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:37.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:37.682+0000 7f83e0cb6640 1 -- 172.21.15.37:0/631940073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83dc101de0 msgr2=0x7f83dc198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:37.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:37.682+0000 7f83e0cb6640 1 --2- 172.21.15.37:0/631940073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83dc101de0 0x7f83dc198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:37.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:37.682+0000 7f83e0cb6640 1 -- 172.21.15.37:0/631940073 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83dc102790 msgr2=0x7f83dc1989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:37.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:37.682+0000 7f83e0cb6640 1 --2- 172.21.15.37:0/631940073 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83dc102790 0x7f83dc1989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:37.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:37.682+0000 7f83e0cb6640 1 -- 172.21.15.37:0/631940073 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83dc19d420 con 0x7f83dc106f10 2024-09-19T06:05:37.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:37.682+0000 7f83e0cb6640 1 --2- 172.21.15.37:0/631940073 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83dc106f10 0x7f83dc19cd40 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f83d4031a20 tx=0x7f83d4031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:37.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:37.682+0000 7f83d9ffb640 1 -- 172.21.15.37:0/631940073 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83d4003c30 con 0x7f83dc106f10 2024-09-19T06:05:37.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:37.682+0000 7f83d9ffb640 1 -- 172.21.15.37:0/631940073 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f83d4003dd0 con 0x7f83dc106f10 2024-09-19T06:05:37.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:37.682+0000 7f83e2719640 1 -- 172.21.15.37:0/631940073 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83dc19d6b0 con 0x7f83dc106f10 2024-09-19T06:05:37.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:37.682+0000 7f83d9ffb640 1 -- 172.21.15.37:0/631940073 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83d402fcf0 con 0x7f83dc106f10 2024-09-19T06:05:37.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:37.682+0000 7f83e2719640 1 -- 172.21.15.37:0/631940073 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83dc1a4ff0 con 0x7f83dc106f10 2024-09-19T06:05:37.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:37.683+0000 7f83e2719640 1 -- 172.21.15.37:0/631940073 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83dc1021c0 con 0x7f83dc106f10 2024-09-19T06:05:37.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:37.684+0000 7f83d9ffb640 1 -- 172.21.15.37:0/631940073 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f83d4004050 con 0x7f83dc106f10 2024-09-19T06:05:37.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:37.685+0000 7f83d9ffb640 1 --2- 172.21.15.37:0/631940073 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f83c80a3350 0x7f83c80a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:37.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:37.685+0000 7f83dbfff640 1 --2- 172.21.15.37:0/631940073 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f83c80a3350 0x7f83c80a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:37.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:37.685+0000 7f83d9ffb640 1 -- 172.21.15.37:0/631940073 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f83d40f1120 con 0x7f83dc106f10 2024-09-19T06:05:37.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:37.686+0000 7f83dbfff640 1 --2- 172.21.15.37:0/631940073 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f83c80a3350 0x7f83c80a5810 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f83cc009890 tx=0x7f83cc008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:37.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:37.689+0000 7f83d9ffb640 1 -- 172.21.15.37:0/631940073 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f83d40bdac0 con 0x7f83dc106f10 2024-09-19T06:05:37.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:37.866+0000 7f83e2719640 1 -- 172.21.15.37:0/631940073 --> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f83dc062630 con 0x7f83c80a3350 2024-09-19T06:05:37.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:37.874+0000 7f83d9ffb640 1 -- 172.21.15.37:0/631940073 <== mgr.14148 v2:172.21.15.37:6800/3797010169 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340282 (secure 0 0 0) 0x7f83dc062630 con 0x7f83c80a3350 2024-09-19T06:05:37.880 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T06:05:37.882 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-19T06:05:37.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:37.878+0000 7f83e2719640 1 -- 172.21.15.37:0/631940073 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f83c80a3350 msgr2=0x7f83c80a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:37.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:37.878+0000 7f83e2719640 1 --2- 172.21.15.37:0/631940073 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f83c80a3350 0x7f83c80a5810 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f83cc009890 tx=0x7f83cc008040 comp rx=0 tx=0).stop 2024-09-19T06:05:37.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:37.878+0000 7f83e2719640 1 -- 172.21.15.37:0/631940073 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83dc106f10 msgr2=0x7f83dc19cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:37.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:37.878+0000 7f83e2719640 1 --2- 172.21.15.37:0/631940073 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83dc106f10 0x7f83dc19cd40 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f83d4031a20 tx=0x7f83d4031a50 comp rx=0 tx=0).stop 2024-09-19T06:05:37.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:37.878+0000 7f83e2719640 1 -- 172.21.15.37:0/631940073 shutdown_connections 2024-09-19T06:05:37.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:37.878+0000 7f83e2719640 1 --2- 172.21.15.37:0/631940073 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f83c80a3350 0x7f83c80a5810 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:37.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:37.878+0000 7f83e2719640 1 --2- 172.21.15.37:0/631940073 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83dc102790 0x7f83dc1989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:37.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:37.878+0000 7f83e2719640 1 --2- 172.21.15.37:0/631940073 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83dc106f10 0x7f83dc19cd40 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:37.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:37.878+0000 7f83e2719640 1 --2- 172.21.15.37:0/631940073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83dc101de0 0x7f83dc198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:37.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:37.878+0000 7f83e2719640 1 -- 172.21.15.37:0/631940073 >> 172.21.15.37:0/631940073 conn(0x7f83dc0fd8c0 msgr2=0x7f83dc0fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:37.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:37.878+0000 7f83e2719640 1 -- 172.21.15.37:0/631940073 shutdown_connections 2024-09-19T06:05:37.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:37.878+0000 7f83e2719640 1 -- 172.21.15.37:0/631940073 wait complete. 2024-09-19T06:05:38.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:37 smithi099 ceph-mon[35300]: pgmap v331: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:05:38.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:37 smithi117 ceph-mon[35050]: pgmap v331: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:05:38.281 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:37 smithi037 ceph-mon[31211]: pgmap v331: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:05:38.724 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":331,"stamp":"2024-09-19T06:05:36.666599+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654911,"num_objects":26,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":245,"num_read_kb":233,"num_write":266,"num_write_kb":3031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180770,"num_keys_recovered":10,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":209,"ondisk_log_size":209,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":363096,"kb_used_data":13760,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124578728,"statfs":{"total":1151940427776,"available":1151568617472,"internally_reserved":0,"allocated":14090240,"data_stored":7920863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":357414202},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003455"},"pg_stats":[{"pgid":"2.1f","version":"81'4","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724453+0000","last_change":"2024-09-19T06:04:03.323722+0000","last_active":"2024-09-19T06:05:13.724453+0000","last_peered":"2024-09-19T06:05:13.724453+0000","last_clean":"2024-09-19T06:05:13.724453+0000","last_became_active":"2024-09-19T06:04:03.323380+0000","last_became_peered":"2024-09-19T06:04:03.323380+0000","last_unstale":"2024-09-19T06:05:13.724453+0000","last_undegraded":"2024-09-19T06:05:13.724453+0000","last_fullsized":"2024-09-19T06:05:13.724453+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:49:17.449780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.729375+0000","last_change":"2024-09-19T06:04:05.427994+0000","last_active":"2024-09-19T06:05:13.729375+0000","last_peered":"2024-09-19T06:05:13.729375+0000","last_clean":"2024-09-19T06:05:13.729375+0000","last_became_active":"2024-09-19T06:04:05.427745+0000","last_became_peered":"2024-09-19T06:04:05.427745+0000","last_unstale":"2024-09-19T06:05:13.729375+0000","last_undegraded":"2024-09-19T06:05:13.729375+0000","last_fullsized":"2024-09-19T06:05:13.729375+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:54.917003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727325+0000","last_change":"2024-09-19T06:04:12.463838+0000","last_active":"2024-09-19T06:05:13.727325+0000","last_peered":"2024-09-19T06:05:13.727325+0000","last_clean":"2024-09-19T06:05:13.727325+0000","last_became_active":"2024-09-19T06:04:12.463426+0000","last_became_peered":"2024-09-19T06:04:12.463426+0000","last_unstale":"2024-09-19T06:05:13.727325+0000","last_undegraded":"2024-09-19T06:05:13.727325+0000","last_fullsized":"2024-09-19T06:05:13.727325+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:40:37.994203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"81'1","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.729714+0000","last_change":"2024-09-19T06:04:03.378129+0000","last_active":"2024-09-19T06:05:13.729714+0000","last_peered":"2024-09-19T06:05:13.729714+0000","last_clean":"2024-09-19T06:05:13.729714+0000","last_became_active":"2024-09-19T06:04:03.377793+0000","last_became_peered":"2024-09-19T06:04:03.377793+0000","last_unstale":"2024-09-19T06:05:13.729714+0000","last_undegraded":"2024-09-19T06:05:13.729714+0000","last_fullsized":"2024-09-19T06:05:13.729714+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:38:22.739168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726880+0000","last_change":"2024-09-19T06:04:05.433909+0000","last_active":"2024-09-19T06:05:13.726880+0000","last_peered":"2024-09-19T06:05:13.726880+0000","last_clean":"2024-09-19T06:05:13.726880+0000","last_became_active":"2024-09-19T06:04:05.433591+0000","last_became_peered":"2024-09-19T06:04:05.433591+0000","last_unstale":"2024-09-19T06:05:13.726880+0000","last_undegraded":"2024-09-19T06:05:13.726880+0000","last_fullsized":"2024-09-19T06:05:13.726880+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:19:18.916703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.725870+0000","last_change":"2024-09-19T06:04:12.468984+0000","last_active":"2024-09-19T06:05:13.725870+0000","last_peered":"2024-09-19T06:05:13.725870+0000","last_clean":"2024-09-19T06:05:13.725870+0000","last_became_active":"2024-09-19T06:04:12.467287+0000","last_became_peered":"2024-09-19T06:04:12.467287+0000","last_unstale":"2024-09-19T06:05:13.725870+0000","last_undegraded":"2024-09-19T06:05:13.725870+0000","last_fullsized":"2024-09-19T06:05:13.725870+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:05:46.279679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.739408+0000","last_change":"2024-09-19T06:05:13.739034+0000","last_active":"2024-09-19T06:05:13.739408+0000","last_peered":"2024-09-19T06:05:13.739408+0000","last_clean":"2024-09-19T06:05:13.739408+0000","last_became_active":"2024-09-19T06:05:13.731532+0000","last_became_peered":"2024-09-19T06:05:13.731532+0000","last_unstale":"2024-09-19T06:05:13.739408+0000","last_undegraded":"2024-09-19T06:05:13.739408+0000","last_fullsized":"2024-09-19T06:05:13.739408+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:52:21.543579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:15.014328+0000","last_change":"2024-09-19T06:04:05.430288+0000","last_active":"2024-09-19T06:05:15.014328+0000","last_peered":"2024-09-19T06:05:15.014328+0000","last_clean":"2024-09-19T06:05:15.014328+0000","last_became_active":"2024-09-19T06:04:05.429947+0000","last_became_peered":"2024-09-19T06:04:05.429947+0000","last_unstale":"2024-09-19T06:05:15.014328+0000","last_undegraded":"2024-09-19T06:05:15.014328+0000","last_fullsized":"2024-09-19T06:05:15.014328+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:43:09.169658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726358+0000","last_change":"2024-09-19T06:04:12.465946+0000","last_active":"2024-09-19T06:05:13.726358+0000","last_peered":"2024-09-19T06:05:13.726358+0000","last_clean":"2024-09-19T06:05:13.726358+0000","last_became_active":"2024-09-19T06:04:12.465553+0000","last_became_peered":"2024-09-19T06:04:12.465553+0000","last_unstale":"2024-09-19T06:05:13.726358+0000","last_undegraded":"2024-09-19T06:05:13.726358+0000","last_fullsized":"2024-09-19T06:05:13.726358+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:50:41.181483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.728044+0000","last_change":"2024-09-19T06:04:03.318528+0000","last_active":"2024-09-19T06:05:13.728044+0000","last_peered":"2024-09-19T06:05:13.728044+0000","last_clean":"2024-09-19T06:05:13.728044+0000","last_became_active":"2024-09-19T06:04:03.318210+0000","last_became_peered":"2024-09-19T06:04:03.318210+0000","last_unstale":"2024-09-19T06:05:13.728044+0000","last_undegraded":"2024-09-19T06:05:13.728044+0000","last_fullsized":"2024-09-19T06:05:13.728044+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:06.766545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.475029+0000","last_change":"2024-09-19T06:04:05.427025+0000","last_active":"2024-09-19T06:05:14.475029+0000","last_peered":"2024-09-19T06:05:14.475029+0000","last_clean":"2024-09-19T06:05:14.475029+0000","last_became_active":"2024-09-19T06:04:05.425679+0000","last_became_peered":"2024-09-19T06:04:05.425679+0000","last_unstale":"2024-09-19T06:05:14.475029+0000","last_undegraded":"2024-09-19T06:05:14.475029+0000","last_fullsized":"2024-09-19T06:05:14.475029+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:26:06.480664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726043+0000","last_change":"2024-09-19T06:04:12.467065+0000","last_active":"2024-09-19T06:05:13.726043+0000","last_peered":"2024-09-19T06:05:13.726043+0000","last_clean":"2024-09-19T06:05:13.726043+0000","last_became_active":"2024-09-19T06:04:12.465961+0000","last_became_peered":"2024-09-19T06:04:12.465961+0000","last_unstale":"2024-09-19T06:05:13.726043+0000","last_undegraded":"2024-09-19T06:05:13.726043+0000","last_fullsized":"2024-09-19T06:05:13.726043+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:13:38.566692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724364+0000","last_change":"2024-09-19T06:04:05.436202+0000","last_active":"2024-09-19T06:05:13.724364+0000","last_peered":"2024-09-19T06:05:13.724364+0000","last_clean":"2024-09-19T06:05:13.724364+0000","last_became_active":"2024-09-19T06:04:05.435779+0000","last_became_peered":"2024-09-19T06:04:05.435779+0000","last_unstale":"2024-09-19T06:05:13.724364+0000","last_undegraded":"2024-09-19T06:05:13.724364+0000","last_fullsized":"2024-09-19T06:05:13.724364+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:27:56.463592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727084+0000","last_change":"2024-09-19T06:04:03.320472+0000","last_active":"2024-09-19T06:05:13.727084+0000","last_peered":"2024-09-19T06:05:13.727084+0000","last_clean":"2024-09-19T06:05:13.727084+0000","last_became_active":"2024-09-19T06:04:03.320178+0000","last_became_peered":"2024-09-19T06:04:03.320178+0000","last_unstale":"2024-09-19T06:05:13.727084+0000","last_undegraded":"2024-09-19T06:05:13.727084+0000","last_fullsized":"2024-09-19T06:05:13.727084+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:23.285302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727113+0000","last_change":"2024-09-19T06:04:12.635733+0000","last_active":"2024-09-19T06:05:13.727113+0000","last_peered":"2024-09-19T06:05:13.727113+0000","last_clean":"2024-09-19T06:05:13.727113+0000","last_became_active":"2024-09-19T06:04:12.634938+0000","last_became_peered":"2024-09-19T06:04:12.634938+0000","last_unstale":"2024-09-19T06:05:13.727113+0000","last_undegraded":"2024-09-19T06:05:13.727113+0000","last_fullsized":"2024-09-19T06:05:13.727113+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:44:09.015733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.729473+0000","last_change":"2024-09-19T06:04:05.418702+0000","last_active":"2024-09-19T06:05:13.729473+0000","last_peered":"2024-09-19T06:05:13.729473+0000","last_clean":"2024-09-19T06:05:13.729473+0000","last_became_active":"2024-09-19T06:04:05.418213+0000","last_became_peered":"2024-09-19T06:04:05.418213+0000","last_unstale":"2024-09-19T06:05:13.729473+0000","last_undegraded":"2024-09-19T06:05:13.729473+0000","last_fullsized":"2024-09-19T06:05:13.729473+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:46:01.865286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727965+0000","last_change":"2024-09-19T06:04:03.323683+0000","last_active":"2024-09-19T06:05:13.727965+0000","last_peered":"2024-09-19T06:05:13.727965+0000","last_clean":"2024-09-19T06:05:13.727965+0000","last_became_active":"2024-09-19T06:04:03.323166+0000","last_became_peered":"2024-09-19T06:04:03.323166+0000","last_unstale":"2024-09-19T06:05:13.727965+0000","last_undegraded":"2024-09-19T06:05:13.727965+0000","last_fullsized":"2024-09-19T06:05:13.727965+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:53.787307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"87'1","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726853+0000","last_change":"2024-09-19T06:04:12.467620+0000","last_active":"2024-09-19T06:05:13.726853+0000","last_peered":"2024-09-19T06:05:13.726853+0000","last_clean":"2024-09-19T06:05:13.726853+0000","last_became_active":"2024-09-19T06:04:12.467231+0000","last_became_peered":"2024-09-19T06:04:12.467231+0000","last_unstale":"2024-09-19T06:05:13.726853+0000","last_undegraded":"2024-09-19T06:05:13.726853+0000","last_fullsized":"2024-09-19T06:05:13.726853+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:12:07.731338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726950+0000","last_change":"2024-09-19T06:04:05.426415+0000","last_active":"2024-09-19T06:05:13.726950+0000","last_peered":"2024-09-19T06:05:13.726950+0000","last_clean":"2024-09-19T06:05:13.726950+0000","last_became_active":"2024-09-19T06:04:05.426061+0000","last_became_peered":"2024-09-19T06:04:05.426061+0000","last_unstale":"2024-09-19T06:05:13.726950+0000","last_undegraded":"2024-09-19T06:05:13.726950+0000","last_fullsized":"2024-09-19T06:05:13.726950+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:44.810600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.729834+0000","last_change":"2024-09-19T06:04:03.319185+0000","last_active":"2024-09-19T06:05:13.729834+0000","last_peered":"2024-09-19T06:05:13.729834+0000","last_clean":"2024-09-19T06:05:13.729834+0000","last_became_active":"2024-09-19T06:04:03.318788+0000","last_became_peered":"2024-09-19T06:04:03.318788+0000","last_unstale":"2024-09-19T06:05:13.729834+0000","last_undegraded":"2024-09-19T06:05:13.729834+0000","last_fullsized":"2024-09-19T06:05:13.729834+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:41:14.668303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.476753+0000","last_change":"2024-09-19T06:05:14.476214+0000","last_active":"2024-09-19T06:05:14.476753+0000","last_peered":"2024-09-19T06:05:14.476753+0000","last_clean":"2024-09-19T06:05:14.476753+0000","last_became_active":"2024-09-19T06:05:14.475721+0000","last_became_peered":"2024-09-19T06:05:14.475721+0000","last_unstale":"2024-09-19T06:05:14.476753+0000","last_undegraded":"2024-09-19T06:05:14.476753+0000","last_fullsized":"2024-09-19T06:05:14.476753+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:15:37.925870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,2,5],"acting":[8,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727210+0000","last_change":"2024-09-19T06:04:05.428027+0000","last_active":"2024-09-19T06:05:13.727210+0000","last_peered":"2024-09-19T06:05:13.727210+0000","last_clean":"2024-09-19T06:05:13.727210+0000","last_became_active":"2024-09-19T06:04:05.427698+0000","last_became_peered":"2024-09-19T06:04:05.427698+0000","last_unstale":"2024-09-19T06:05:13.727210+0000","last_undegraded":"2024-09-19T06:05:13.727210+0000","last_fullsized":"2024-09-19T06:05:13.727210+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:06:34.627086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:15.014128+0000","last_change":"2024-09-19T06:04:03.380435+0000","last_active":"2024-09-19T06:05:15.014128+0000","last_peered":"2024-09-19T06:05:15.014128+0000","last_clean":"2024-09-19T06:05:15.014128+0000","last_became_active":"2024-09-19T06:04:03.380102+0000","last_became_peered":"2024-09-19T06:04:03.380102+0000","last_unstale":"2024-09-19T06:05:15.014128+0000","last_undegraded":"2024-09-19T06:05:15.014128+0000","last_fullsized":"2024-09-19T06:05:15.014128+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:43.886466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.730251+0000","last_change":"2024-09-19T06:05:13.730251+0000","last_active":"2024-09-19T06:05:13.730251+0000","last_peered":"2024-09-19T06:05:13.730251+0000","last_clean":"2024-09-19T06:05:13.730251+0000","last_became_active":"2024-09-19T06:05:13.729757+0000","last_became_peered":"2024-09-19T06:05:13.729757+0000","last_unstale":"2024-09-19T06:05:13.730251+0000","last_undegraded":"2024-09-19T06:05:13.730251+0000","last_fullsized":"2024-09-19T06:05:13.730251+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:57:09.816160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,10,9],"acting":[4,8,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.160089+0000","last_change":"2024-09-19T06:05:14.160089+0000","last_active":"2024-09-19T06:05:14.160089+0000","last_peered":"2024-09-19T06:05:14.160089+0000","last_clean":"2024-09-19T06:05:14.160089+0000","last_became_active":"2024-09-19T06:05:14.159695+0000","last_became_peered":"2024-09-19T06:05:14.159695+0000","last_unstale":"2024-09-19T06:05:14.160089+0000","last_undegraded":"2024-09-19T06:05:14.160089+0000","last_fullsized":"2024-09-19T06:05:14.160089+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:12:52.838620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"81'2","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726594+0000","last_change":"2024-09-19T06:04:03.376510+0000","last_active":"2024-09-19T06:05:13.726594+0000","last_peered":"2024-09-19T06:05:13.726594+0000","last_clean":"2024-09-19T06:05:13.726594+0000","last_became_active":"2024-09-19T06:04:03.376241+0000","last_became_peered":"2024-09-19T06:04:03.376241+0000","last_unstale":"2024-09-19T06:05:13.726594+0000","last_undegraded":"2024-09-19T06:05:13.726594+0000","last_fullsized":"2024-09-19T06:05:13.726594+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:19:29.209233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727510+0000","last_change":"2024-09-19T06:04:12.462237+0000","last_active":"2024-09-19T06:05:13.727510+0000","last_peered":"2024-09-19T06:05:13.727510+0000","last_clean":"2024-09-19T06:05:13.727510+0000","last_became_active":"2024-09-19T06:04:12.461771+0000","last_became_peered":"2024-09-19T06:04:12.461771+0000","last_unstale":"2024-09-19T06:05:13.727510+0000","last_undegraded":"2024-09-19T06:05:13.727510+0000","last_fullsized":"2024-09-19T06:05:13.727510+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:46:42.780847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.730324+0000","last_change":"2024-09-19T06:04:05.420472+0000","last_active":"2024-09-19T06:05:13.730324+0000","last_peered":"2024-09-19T06:05:13.730324+0000","last_clean":"2024-09-19T06:05:13.730324+0000","last_became_active":"2024-09-19T06:04:05.420147+0000","last_became_peered":"2024-09-19T06:04:05.420147+0000","last_unstale":"2024-09-19T06:05:13.730324+0000","last_undegraded":"2024-09-19T06:05:13.730324+0000","last_fullsized":"2024-09-19T06:05:13.730324+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:38.616378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724491+0000","last_change":"2024-09-19T06:04:03.316655+0000","last_active":"2024-09-19T06:05:13.724491+0000","last_peered":"2024-09-19T06:05:13.724491+0000","last_clean":"2024-09-19T06:05:13.724491+0000","last_became_active":"2024-09-19T06:04:03.316296+0000","last_became_peered":"2024-09-19T06:04:03.316296+0000","last_unstale":"2024-09-19T06:05:13.724491+0000","last_undegraded":"2024-09-19T06:05:13.724491+0000","last_fullsized":"2024-09-19T06:05:13.724491+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:02:06.320482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.729377+0000","last_change":"2024-09-19T06:04:12.635106+0000","last_active":"2024-09-19T06:05:13.729377+0000","last_peered":"2024-09-19T06:05:13.729377+0000","last_clean":"2024-09-19T06:05:13.729377+0000","last_became_active":"2024-09-19T06:04:12.634671+0000","last_became_peered":"2024-09-19T06:04:12.634671+0000","last_unstale":"2024-09-19T06:05:13.729377+0000","last_undegraded":"2024-09-19T06:05:13.729377+0000","last_fullsized":"2024-09-19T06:05:13.729377+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:54:22.428102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.158760+0000","last_change":"2024-09-19T06:04:05.427483+0000","last_active":"2024-09-19T06:05:14.158760+0000","last_peered":"2024-09-19T06:05:14.158760+0000","last_clean":"2024-09-19T06:05:14.158760+0000","last_became_active":"2024-09-19T06:04:05.427092+0000","last_became_peered":"2024-09-19T06:04:05.427092+0000","last_unstale":"2024-09-19T06:05:14.158760+0000","last_undegraded":"2024-09-19T06:05:14.158760+0000","last_fullsized":"2024-09-19T06:05:14.158760+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:50:21.576757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727469+0000","last_change":"2024-09-19T06:04:03.377962+0000","last_active":"2024-09-19T06:05:13.727469+0000","last_peered":"2024-09-19T06:05:13.727469+0000","last_clean":"2024-09-19T06:05:13.727469+0000","last_became_active":"2024-09-19T06:04:03.377686+0000","last_became_peered":"2024-09-19T06:04:03.377686+0000","last_unstale":"2024-09-19T06:05:13.727469+0000","last_undegraded":"2024-09-19T06:05:13.727469+0000","last_fullsized":"2024-09-19T06:05:13.727469+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:00.635765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727360+0000","last_change":"2024-09-19T06:04:12.467349+0000","last_active":"2024-09-19T06:05:13.727360+0000","last_peered":"2024-09-19T06:05:13.727360+0000","last_clean":"2024-09-19T06:05:13.727360+0000","last_became_active":"2024-09-19T06:04:12.466117+0000","last_became_peered":"2024-09-19T06:04:12.466117+0000","last_unstale":"2024-09-19T06:05:13.727360+0000","last_undegraded":"2024-09-19T06:05:13.727360+0000","last_fullsized":"2024-09-19T06:05:13.727360+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:28:03.040586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.728256+0000","last_change":"2024-09-19T06:04:05.429656+0000","last_active":"2024-09-19T06:05:13.728256+0000","last_peered":"2024-09-19T06:05:13.728256+0000","last_clean":"2024-09-19T06:05:13.728256+0000","last_became_active":"2024-09-19T06:04:05.429023+0000","last_became_peered":"2024-09-19T06:04:05.429023+0000","last_unstale":"2024-09-19T06:05:13.728256+0000","last_undegraded":"2024-09-19T06:05:13.728256+0000","last_fullsized":"2024-09-19T06:05:13.728256+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:25:57.627940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724204+0000","last_change":"2024-09-19T06:04:03.378415+0000","last_active":"2024-09-19T06:05:13.724204+0000","last_peered":"2024-09-19T06:05:13.724204+0000","last_clean":"2024-09-19T06:05:13.724204+0000","last_became_active":"2024-09-19T06:04:03.378096+0000","last_became_peered":"2024-09-19T06:04:03.378096+0000","last_unstale":"2024-09-19T06:05:13.724204+0000","last_undegraded":"2024-09-19T06:05:13.724204+0000","last_fullsized":"2024-09-19T06:05:13.724204+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:14:33.988869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726970+0000","last_change":"2024-09-19T06:04:12.635410+0000","last_active":"2024-09-19T06:05:13.726970+0000","last_peered":"2024-09-19T06:05:13.726970+0000","last_clean":"2024-09-19T06:05:13.726970+0000","last_became_active":"2024-09-19T06:04:12.634852+0000","last_became_peered":"2024-09-19T06:04:12.634852+0000","last_unstale":"2024-09-19T06:05:13.726970+0000","last_undegraded":"2024-09-19T06:05:13.726970+0000","last_fullsized":"2024-09-19T06:05:13.726970+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:28:46.014324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.728365+0000","last_change":"2024-09-19T06:04:05.421348+0000","last_active":"2024-09-19T06:05:13.728365+0000","last_peered":"2024-09-19T06:05:13.728365+0000","last_clean":"2024-09-19T06:05:13.728365+0000","last_became_active":"2024-09-19T06:04:05.420999+0000","last_became_peered":"2024-09-19T06:04:05.420999+0000","last_unstale":"2024-09-19T06:05:13.728365+0000","last_undegraded":"2024-09-19T06:05:13.728365+0000","last_fullsized":"2024-09-19T06:05:13.728365+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:52:26.257580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724549+0000","last_change":"2024-09-19T06:04:03.321233+0000","last_active":"2024-09-19T06:05:13.724549+0000","last_peered":"2024-09-19T06:05:13.724549+0000","last_clean":"2024-09-19T06:05:13.724549+0000","last_became_active":"2024-09-19T06:04:03.320755+0000","last_became_peered":"2024-09-19T06:04:03.320755+0000","last_unstale":"2024-09-19T06:05:13.724549+0000","last_undegraded":"2024-09-19T06:05:13.724549+0000","last_fullsized":"2024-09-19T06:05:13.724549+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:46.661751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.158645+0000","last_change":"2024-09-19T06:04:12.463185+0000","last_active":"2024-09-19T06:05:14.158645+0000","last_peered":"2024-09-19T06:05:14.158645+0000","last_clean":"2024-09-19T06:05:14.158645+0000","last_became_active":"2024-09-19T06:04:12.462824+0000","last_became_peered":"2024-09-19T06:04:12.462824+0000","last_unstale":"2024-09-19T06:05:14.158645+0000","last_undegraded":"2024-09-19T06:05:14.158645+0000","last_fullsized":"2024-09-19T06:05:14.158645+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:54:05.634907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.474205+0000","last_change":"2024-09-19T06:04:05.427259+0000","last_active":"2024-09-19T06:05:14.474205+0000","last_peered":"2024-09-19T06:05:14.474205+0000","last_clean":"2024-09-19T06:05:14.474205+0000","last_became_active":"2024-09-19T06:04:05.426955+0000","last_became_peered":"2024-09-19T06:04:05.426955+0000","last_unstale":"2024-09-19T06:05:14.474205+0000","last_undegraded":"2024-09-19T06:05:14.474205+0000","last_fullsized":"2024-09-19T06:05:14.474205+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:34:22.085384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.158503+0000","last_change":"2024-09-19T06:04:03.378174+0000","last_active":"2024-09-19T06:05:14.158503+0000","last_peered":"2024-09-19T06:05:14.158503+0000","last_clean":"2024-09-19T06:05:14.158503+0000","last_became_active":"2024-09-19T06:04:03.377803+0000","last_became_peered":"2024-09-19T06:04:03.377803+0000","last_unstale":"2024-09-19T06:05:14.158503+0000","last_undegraded":"2024-09-19T06:05:14.158503+0000","last_fullsized":"2024-09-19T06:05:14.158503+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:24:26.087284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.158946+0000","last_change":"2024-09-19T06:04:12.635365+0000","last_active":"2024-09-19T06:05:14.158946+0000","last_peered":"2024-09-19T06:05:14.158946+0000","last_clean":"2024-09-19T06:05:14.158946+0000","last_became_active":"2024-09-19T06:04:12.634691+0000","last_became_peered":"2024-09-19T06:04:12.634691+0000","last_unstale":"2024-09-19T06:05:14.158946+0000","last_undegraded":"2024-09-19T06:05:14.158946+0000","last_fullsized":"2024-09-19T06:05:14.158946+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:20:58.523992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.158372+0000","last_change":"2024-09-19T06:04:05.425638+0000","last_active":"2024-09-19T06:05:14.158372+0000","last_peered":"2024-09-19T06:05:14.158372+0000","last_clean":"2024-09-19T06:05:14.158372+0000","last_became_active":"2024-09-19T06:04:05.425356+0000","last_became_peered":"2024-09-19T06:04:05.425356+0000","last_unstale":"2024-09-19T06:05:14.158372+0000","last_undegraded":"2024-09-19T06:05:14.158372+0000","last_fullsized":"2024-09-19T06:05:14.158372+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:51:11.857888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724273+0000","last_change":"2024-09-19T06:04:03.322432+0000","last_active":"2024-09-19T06:05:13.724273+0000","last_peered":"2024-09-19T06:05:13.724273+0000","last_clean":"2024-09-19T06:05:13.724273+0000","last_became_active":"2024-09-19T06:04:03.322071+0000","last_became_peered":"2024-09-19T06:04:03.322071+0000","last_unstale":"2024-09-19T06:05:13.724273+0000","last_undegraded":"2024-09-19T06:05:13.724273+0000","last_fullsized":"2024-09-19T06:05:13.724273+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:16:23.935470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.474787+0000","last_change":"2024-09-19T06:04:12.635970+0000","last_active":"2024-09-19T06:05:14.474787+0000","last_peered":"2024-09-19T06:05:14.474787+0000","last_clean":"2024-09-19T06:05:14.474787+0000","last_became_active":"2024-09-19T06:04:12.635283+0000","last_became_peered":"2024-09-19T06:04:12.635283+0000","last_unstale":"2024-09-19T06:05:14.474787+0000","last_undegraded":"2024-09-19T06:05:14.474787+0000","last_fullsized":"2024-09-19T06:05:14.474787+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:55:05.460652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.729589+0000","last_change":"2024-09-19T06:04:05.424335+0000","last_active":"2024-09-19T06:05:13.729589+0000","last_peered":"2024-09-19T06:05:13.729589+0000","last_clean":"2024-09-19T06:05:13.729589+0000","last_became_active":"2024-09-19T06:04:05.423868+0000","last_became_peered":"2024-09-19T06:04:05.423868+0000","last_unstale":"2024-09-19T06:05:13.729589+0000","last_undegraded":"2024-09-19T06:05:13.729589+0000","last_fullsized":"2024-09-19T06:05:13.729589+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:17:15.556240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727323+0000","last_change":"2024-09-19T06:04:03.315749+0000","last_active":"2024-09-19T06:05:13.727323+0000","last_peered":"2024-09-19T06:05:13.727323+0000","last_clean":"2024-09-19T06:05:13.727323+0000","last_became_active":"2024-09-19T06:04:03.315404+0000","last_became_peered":"2024-09-19T06:04:03.315404+0000","last_unstale":"2024-09-19T06:05:13.727323+0000","last_undegraded":"2024-09-19T06:05:13.727323+0000","last_fullsized":"2024-09-19T06:05:13.727323+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:43:35.485993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":345,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724597+0000","last_change":"2024-09-19T06:02:49.934106+0000","last_active":"2024-09-19T06:05:13.724597+0000","last_peered":"2024-09-19T06:05:13.724597+0000","last_clean":"2024-09-19T06:05:13.724597+0000","last_became_active":"2024-09-19T06:02:49.933684+0000","last_became_peered":"2024-09-19T06:02:49.933684+0000","last_unstale":"2024-09-19T06:05:13.724597+0000","last_undegraded":"2024-09-19T06:05:13.724597+0000","last_fullsized":"2024-09-19T06:05:13.724597+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:59:27.582796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:59:27.582796+0000","last_clean_scrub_stamp":"2024-09-19T05:59:27.582796+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:35:06.837740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"87'1","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724414+0000","last_change":"2024-09-19T06:04:12.468160+0000","last_active":"2024-09-19T06:05:13.724414+0000","last_peered":"2024-09-19T06:05:13.724414+0000","last_clean":"2024-09-19T06:05:13.724414+0000","last_became_active":"2024-09-19T06:04:12.467642+0000","last_became_peered":"2024-09-19T06:04:12.467642+0000","last_unstale":"2024-09-19T06:05:13.724414+0000","last_undegraded":"2024-09-19T06:05:13.724414+0000","last_fullsized":"2024-09-19T06:05:13.724414+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:40.053143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724738+0000","last_change":"2024-09-19T06:04:05.435815+0000","last_active":"2024-09-19T06:05:13.724738+0000","last_peered":"2024-09-19T06:05:13.724738+0000","last_clean":"2024-09-19T06:05:13.724738+0000","last_became_active":"2024-09-19T06:04:05.435498+0000","last_became_peered":"2024-09-19T06:04:05.435498+0000","last_unstale":"2024-09-19T06:05:13.724738+0000","last_undegraded":"2024-09-19T06:05:13.724738+0000","last_fullsized":"2024-09-19T06:05:13.724738+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:33:30.330877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.731805+0000","last_change":"2024-09-19T06:05:13.730770+0000","last_active":"2024-09-19T06:05:13.731805+0000","last_peered":"2024-09-19T06:05:13.731805+0000","last_clean":"2024-09-19T06:05:13.731805+0000","last_became_active":"2024-09-19T06:05:13.730360+0000","last_became_peered":"2024-09-19T06:05:13.730360+0000","last_unstale":"2024-09-19T06:05:13.731805+0000","last_undegraded":"2024-09-19T06:05:13.731805+0000","last_fullsized":"2024-09-19T06:05:13.731805+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:06:34.488351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:15.014149+0000","last_change":"2024-09-19T06:04:12.466249+0000","last_active":"2024-09-19T06:05:15.014149+0000","last_peered":"2024-09-19T06:05:15.014149+0000","last_clean":"2024-09-19T06:05:15.014149+0000","last_became_active":"2024-09-19T06:04:12.465709+0000","last_became_peered":"2024-09-19T06:04:12.465709+0000","last_unstale":"2024-09-19T06:05:15.014149+0000","last_undegraded":"2024-09-19T06:05:15.014149+0000","last_fullsized":"2024-09-19T06:05:15.014149+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:02:11.454334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724466+0000","last_change":"2024-09-19T06:04:05.425733+0000","last_active":"2024-09-19T06:05:13.724466+0000","last_peered":"2024-09-19T06:05:13.724466+0000","last_clean":"2024-09-19T06:05:13.724466+0000","last_became_active":"2024-09-19T06:04:05.425399+0000","last_became_peered":"2024-09-19T06:04:05.425399+0000","last_unstale":"2024-09-19T06:05:13.724466+0000","last_undegraded":"2024-09-19T06:05:13.724466+0000","last_fullsized":"2024-09-19T06:05:13.724466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:35:33.287456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.475134+0000","last_change":"2024-09-19T06:04:03.319361+0000","last_active":"2024-09-19T06:05:14.475134+0000","last_peered":"2024-09-19T06:05:14.475134+0000","last_clean":"2024-09-19T06:05:14.475134+0000","last_became_active":"2024-09-19T06:04:03.319053+0000","last_became_peered":"2024-09-19T06:04:03.319053+0000","last_unstale":"2024-09-19T06:05:14.475134+0000","last_undegraded":"2024-09-19T06:05:14.475134+0000","last_fullsized":"2024-09-19T06:05:14.475134+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:25:23.739392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726834+0000","last_change":"2024-09-19T06:04:12.468270+0000","last_active":"2024-09-19T06:05:13.726834+0000","last_peered":"2024-09-19T06:05:13.726834+0000","last_clean":"2024-09-19T06:05:13.726834+0000","last_became_active":"2024-09-19T06:04:12.467872+0000","last_became_peered":"2024-09-19T06:04:12.467872+0000","last_unstale":"2024-09-19T06:05:13.726834+0000","last_undegraded":"2024-09-19T06:05:13.726834+0000","last_fullsized":"2024-09-19T06:05:13.726834+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:35.476189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724645+0000","last_change":"2024-09-19T06:04:05.431360+0000","last_active":"2024-09-19T06:05:13.724645+0000","last_peered":"2024-09-19T06:05:13.724645+0000","last_clean":"2024-09-19T06:05:13.724645+0000","last_became_active":"2024-09-19T06:04:05.431067+0000","last_became_peered":"2024-09-19T06:04:05.431067+0000","last_unstale":"2024-09-19T06:05:13.724645+0000","last_undegraded":"2024-09-19T06:05:13.724645+0000","last_fullsized":"2024-09-19T06:05:13.724645+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:16:25.317086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.159080+0000","last_change":"2024-09-19T06:04:03.316793+0000","last_active":"2024-09-19T06:05:14.159080+0000","last_peered":"2024-09-19T06:05:14.159080+0000","last_clean":"2024-09-19T06:05:14.159080+0000","last_became_active":"2024-09-19T06:04:03.316485+0000","last_became_peered":"2024-09-19T06:04:03.316485+0000","last_unstale":"2024-09-19T06:05:14.159080+0000","last_undegraded":"2024-09-19T06:05:14.159080+0000","last_fullsized":"2024-09-19T06:05:14.159080+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:19:26.427025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.473926+0000","last_change":"2024-09-19T06:04:12.466322+0000","last_active":"2024-09-19T06:05:14.473926+0000","last_peered":"2024-09-19T06:05:14.473926+0000","last_clean":"2024-09-19T06:05:14.473926+0000","last_became_active":"2024-09-19T06:04:12.465806+0000","last_became_peered":"2024-09-19T06:04:12.465806+0000","last_unstale":"2024-09-19T06:05:14.473926+0000","last_undegraded":"2024-09-19T06:05:14.473926+0000","last_fullsized":"2024-09-19T06:05:14.473926+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:33:28.893570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727866+0000","last_change":"2024-09-19T06:04:05.424864+0000","last_active":"2024-09-19T06:05:13.727866+0000","last_peered":"2024-09-19T06:05:13.727866+0000","last_clean":"2024-09-19T06:05:13.727866+0000","last_became_active":"2024-09-19T06:04:05.424504+0000","last_became_peered":"2024-09-19T06:04:05.424504+0000","last_unstale":"2024-09-19T06:05:13.727866+0000","last_undegraded":"2024-09-19T06:05:13.727866+0000","last_fullsized":"2024-09-19T06:05:13.727866+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:30.471757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.728243+0000","last_change":"2024-09-19T06:04:03.321925+0000","last_active":"2024-09-19T06:05:13.728243+0000","last_peered":"2024-09-19T06:05:13.728243+0000","last_clean":"2024-09-19T06:05:13.728243+0000","last_became_active":"2024-09-19T06:04:03.321445+0000","last_became_peered":"2024-09-19T06:04:03.321445+0000","last_unstale":"2024-09-19T06:05:13.728243+0000","last_undegraded":"2024-09-19T06:05:13.728243+0000","last_fullsized":"2024-09-19T06:05:13.728243+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:15:55.621352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.474063+0000","last_change":"2024-09-19T06:04:12.471413+0000","last_active":"2024-09-19T06:05:14.474063+0000","last_peered":"2024-09-19T06:05:14.474063+0000","last_clean":"2024-09-19T06:05:14.474063+0000","last_became_active":"2024-09-19T06:04:12.471057+0000","last_became_peered":"2024-09-19T06:04:12.471057+0000","last_unstale":"2024-09-19T06:05:14.474063+0000","last_undegraded":"2024-09-19T06:05:14.474063+0000","last_fullsized":"2024-09-19T06:05:14.474063+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:08:47.259211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.474222+0000","last_change":"2024-09-19T06:04:05.429447+0000","last_active":"2024-09-19T06:05:14.474222+0000","last_peered":"2024-09-19T06:05:14.474222+0000","last_clean":"2024-09-19T06:05:14.474222+0000","last_became_active":"2024-09-19T06:04:05.428852+0000","last_became_peered":"2024-09-19T06:04:05.428852+0000","last_unstale":"2024-09-19T06:05:14.474222+0000","last_undegraded":"2024-09-19T06:05:14.474222+0000","last_fullsized":"2024-09-19T06:05:14.474222+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:01.466814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726844+0000","last_change":"2024-09-19T06:04:03.378586+0000","last_active":"2024-09-19T06:05:13.726844+0000","last_peered":"2024-09-19T06:05:13.726844+0000","last_clean":"2024-09-19T06:05:13.726844+0000","last_became_active":"2024-09-19T06:04:03.378292+0000","last_became_peered":"2024-09-19T06:04:03.378292+0000","last_unstale":"2024-09-19T06:05:13.726844+0000","last_undegraded":"2024-09-19T06:05:13.726844+0000","last_fullsized":"2024-09-19T06:05:13.726844+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:54.247070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.159022+0000","last_change":"2024-09-19T06:04:12.470914+0000","last_active":"2024-09-19T06:05:14.159022+0000","last_peered":"2024-09-19T06:05:14.159022+0000","last_clean":"2024-09-19T06:05:14.159022+0000","last_became_active":"2024-09-19T06:04:12.470563+0000","last_became_peered":"2024-09-19T06:04:12.470563+0000","last_unstale":"2024-09-19T06:05:14.159022+0000","last_undegraded":"2024-09-19T06:05:14.159022+0000","last_fullsized":"2024-09-19T06:05:14.159022+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:13.060646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724169+0000","last_change":"2024-09-19T06:04:05.424009+0000","last_active":"2024-09-19T06:05:13.724169+0000","last_peered":"2024-09-19T06:05:13.724169+0000","last_clean":"2024-09-19T06:05:13.724169+0000","last_became_active":"2024-09-19T06:04:05.423670+0000","last_became_peered":"2024-09-19T06:04:05.423670+0000","last_unstale":"2024-09-19T06:05:13.724169+0000","last_undegraded":"2024-09-19T06:05:13.724169+0000","last_fullsized":"2024-09-19T06:05:13.724169+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:30:15.165259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726323+0000","last_change":"2024-09-19T06:04:03.317089+0000","last_active":"2024-09-19T06:05:13.726323+0000","last_peered":"2024-09-19T06:05:13.726323+0000","last_clean":"2024-09-19T06:05:13.726323+0000","last_became_active":"2024-09-19T06:04:03.316575+0000","last_became_peered":"2024-09-19T06:04:03.316575+0000","last_unstale":"2024-09-19T06:05:13.726323+0000","last_undegraded":"2024-09-19T06:05:13.726323+0000","last_fullsized":"2024-09-19T06:05:13.726323+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:11:43.769660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.732957+0000","last_change":"2024-09-19T06:05:13.731879+0000","last_active":"2024-09-19T06:05:13.732957+0000","last_peered":"2024-09-19T06:05:13.732957+0000","last_clean":"2024-09-19T06:05:13.732957+0000","last_became_active":"2024-09-19T06:05:13.731373+0000","last_became_peered":"2024-09-19T06:05:13.731373+0000","last_unstale":"2024-09-19T06:05:13.732957+0000","last_undegraded":"2024-09-19T06:05:13.732957+0000","last_fullsized":"2024-09-19T06:05:13.732957+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:41:45.556733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724870+0000","last_change":"2024-09-19T06:04:05.430145+0000","last_active":"2024-09-19T06:05:13.724870+0000","last_peered":"2024-09-19T06:05:13.724870+0000","last_clean":"2024-09-19T06:05:13.724870+0000","last_became_active":"2024-09-19T06:04:05.429763+0000","last_became_peered":"2024-09-19T06:04:05.429763+0000","last_unstale":"2024-09-19T06:05:13.724870+0000","last_undegraded":"2024-09-19T06:05:13.724870+0000","last_fullsized":"2024-09-19T06:05:13.724870+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:44:38.783894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.474581+0000","last_change":"2024-09-19T06:04:03.317410+0000","last_active":"2024-09-19T06:05:14.474581+0000","last_peered":"2024-09-19T06:05:14.474581+0000","last_clean":"2024-09-19T06:05:14.474581+0000","last_became_active":"2024-09-19T06:04:03.317068+0000","last_became_peered":"2024-09-19T06:04:03.317068+0000","last_unstale":"2024-09-19T06:05:14.474581+0000","last_undegraded":"2024-09-19T06:05:14.474581+0000","last_fullsized":"2024-09-19T06:05:14.474581+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:23.209080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727395+0000","last_change":"2024-09-19T06:04:12.469867+0000","last_active":"2024-09-19T06:05:13.727395+0000","last_peered":"2024-09-19T06:05:13.727395+0000","last_clean":"2024-09-19T06:05:13.727395+0000","last_became_active":"2024-09-19T06:04:12.469391+0000","last_became_peered":"2024-09-19T06:04:12.469391+0000","last_unstale":"2024-09-19T06:05:13.727395+0000","last_undegraded":"2024-09-19T06:05:13.727395+0000","last_fullsized":"2024-09-19T06:05:13.727395+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:43:29.493247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.158639+0000","last_change":"2024-09-19T06:04:05.423515+0000","last_active":"2024-09-19T06:05:14.158639+0000","last_peered":"2024-09-19T06:05:14.158639+0000","last_clean":"2024-09-19T06:05:14.158639+0000","last_became_active":"2024-09-19T06:04:05.422185+0000","last_became_peered":"2024-09-19T06:04:05.422185+0000","last_unstale":"2024-09-19T06:05:14.158639+0000","last_undegraded":"2024-09-19T06:05:14.158639+0000","last_fullsized":"2024-09-19T06:05:14.158639+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:09:22.951171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"81'2","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.737281+0000","last_change":"2024-09-19T06:05:13.736876+0000","last_active":"2024-09-19T06:05:13.737281+0000","last_peered":"2024-09-19T06:05:13.737281+0000","last_clean":"2024-09-19T06:05:13.737281+0000","last_became_active":"2024-09-19T06:05:13.731079+0000","last_became_peered":"2024-09-19T06:05:13.731079+0000","last_unstale":"2024-09-19T06:05:13.737281+0000","last_undegraded":"2024-09-19T06:05:13.737281+0000","last_fullsized":"2024-09-19T06:05:13.737281+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:23.458684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.474836+0000","last_change":"2024-09-19T06:04:12.468569+0000","last_active":"2024-09-19T06:05:14.474836+0000","last_peered":"2024-09-19T06:05:14.474836+0000","last_clean":"2024-09-19T06:05:14.474836+0000","last_became_active":"2024-09-19T06:04:12.467759+0000","last_became_peered":"2024-09-19T06:04:12.467759+0000","last_unstale":"2024-09-19T06:05:14.474836+0000","last_undegraded":"2024-09-19T06:05:14.474836+0000","last_fullsized":"2024-09-19T06:05:14.474836+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:20:49.817163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727216+0000","last_change":"2024-09-19T06:04:05.425703+0000","last_active":"2024-09-19T06:05:13.727216+0000","last_peered":"2024-09-19T06:05:13.727216+0000","last_clean":"2024-09-19T06:05:13.727216+0000","last_became_active":"2024-09-19T06:04:05.425360+0000","last_became_peered":"2024-09-19T06:04:05.425360+0000","last_unstale":"2024-09-19T06:05:13.727216+0000","last_undegraded":"2024-09-19T06:05:13.727216+0000","last_fullsized":"2024-09-19T06:05:13.727216+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:33:25.457191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"87'30","reported_seq":177,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:32.619890+0000","last_change":"2024-09-19T06:04:03.319087+0000","last_active":"2024-09-19T06:05:32.619890+0000","last_peered":"2024-09-19T06:05:32.619890+0000","last_clean":"2024-09-19T06:05:32.619890+0000","last_became_active":"2024-09-19T06:04:03.318721+0000","last_became_peered":"2024-09-19T06:04:03.318721+0000","last_unstale":"2024-09-19T06:05:32.619890+0000","last_undegraded":"2024-09-19T06:05:32.619890+0000","last_fullsized":"2024-09-19T06:05:32.619890+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:14:32.337455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63511,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":113,"num_read_kb":118,"num_write":30,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.723734+0000","last_change":"2024-09-19T06:04:12.472008+0000","last_active":"2024-09-19T06:05:13.723734+0000","last_peered":"2024-09-19T06:05:13.723734+0000","last_clean":"2024-09-19T06:05:13.723734+0000","last_became_active":"2024-09-19T06:04:12.471623+0000","last_became_peered":"2024-09-19T06:04:12.471623+0000","last_unstale":"2024-09-19T06:05:13.723734+0000","last_undegraded":"2024-09-19T06:05:13.723734+0000","last_fullsized":"2024-09-19T06:05:13.723734+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:13:11.424242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:15.014354+0000","last_change":"2024-09-19T06:04:05.434865+0000","last_active":"2024-09-19T06:05:15.014354+0000","last_peered":"2024-09-19T06:05:15.014354+0000","last_clean":"2024-09-19T06:05:15.014354+0000","last_became_active":"2024-09-19T06:04:05.434472+0000","last_became_peered":"2024-09-19T06:04:05.434472+0000","last_unstale":"2024-09-19T06:05:15.014354+0000","last_undegraded":"2024-09-19T06:05:15.014354+0000","last_fullsized":"2024-09-19T06:05:15.014354+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:35.490406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"81'3","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.475083+0000","last_change":"2024-09-19T06:04:03.380447+0000","last_active":"2024-09-19T06:05:14.475083+0000","last_peered":"2024-09-19T06:05:14.475083+0000","last_clean":"2024-09-19T06:05:14.475083+0000","last_became_active":"2024-09-19T06:04:03.380154+0000","last_became_peered":"2024-09-19T06:04:03.380154+0000","last_unstale":"2024-09-19T06:05:14.475083+0000","last_undegraded":"2024-09-19T06:05:14.475083+0000","last_fullsized":"2024-09-19T06:05:14.475083+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:48:11.570148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726945+0000","last_change":"2024-09-19T06:04:12.467995+0000","last_active":"2024-09-19T06:05:13.726945+0000","last_peered":"2024-09-19T06:05:13.726945+0000","last_clean":"2024-09-19T06:05:13.726945+0000","last_became_active":"2024-09-19T06:04:12.467539+0000","last_became_peered":"2024-09-19T06:04:12.467539+0000","last_unstale":"2024-09-19T06:05:13.726945+0000","last_undegraded":"2024-09-19T06:05:13.726945+0000","last_fullsized":"2024-09-19T06:05:13.726945+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:13:29.285909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726884+0000","last_change":"2024-09-19T06:04:05.429919+0000","last_active":"2024-09-19T06:05:13.726884+0000","last_peered":"2024-09-19T06:05:13.726884+0000","last_clean":"2024-09-19T06:05:13.726884+0000","last_became_active":"2024-09-19T06:04:05.429597+0000","last_became_peered":"2024-09-19T06:04:05.429597+0000","last_unstale":"2024-09-19T06:05:13.726884+0000","last_undegraded":"2024-09-19T06:05:13.726884+0000","last_fullsized":"2024-09-19T06:05:13.726884+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:08:38.816272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724643+0000","last_change":"2024-09-19T06:04:03.320501+0000","last_active":"2024-09-19T06:05:13.724643+0000","last_peered":"2024-09-19T06:05:13.724643+0000","last_clean":"2024-09-19T06:05:13.724643+0000","last_became_active":"2024-09-19T06:04:03.320093+0000","last_became_peered":"2024-09-19T06:04:03.320093+0000","last_unstale":"2024-09-19T06:05:13.724643+0000","last_undegraded":"2024-09-19T06:05:13.724643+0000","last_fullsized":"2024-09-19T06:05:13.724643+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:31:11.896935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.723518+0000","last_change":"2024-09-19T06:04:12.468455+0000","last_active":"2024-09-19T06:05:13.723518+0000","last_peered":"2024-09-19T06:05:13.723518+0000","last_clean":"2024-09-19T06:05:13.723518+0000","last_became_active":"2024-09-19T06:04:12.468007+0000","last_became_peered":"2024-09-19T06:04:12.468007+0000","last_unstale":"2024-09-19T06:05:13.723518+0000","last_undegraded":"2024-09-19T06:05:13.723518+0000","last_fullsized":"2024-09-19T06:05:13.723518+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:50:58.995825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:15.014577+0000","last_change":"2024-09-19T06:04:05.427599+0000","last_active":"2024-09-19T06:05:15.014577+0000","last_peered":"2024-09-19T06:05:15.014577+0000","last_clean":"2024-09-19T06:05:15.014577+0000","last_became_active":"2024-09-19T06:04:05.425338+0000","last_became_peered":"2024-09-19T06:04:05.425338+0000","last_unstale":"2024-09-19T06:05:15.014577+0000","last_undegraded":"2024-09-19T06:05:15.014577+0000","last_fullsized":"2024-09-19T06:05:15.014577+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:44.547625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.728363+0000","last_change":"2024-09-19T06:04:03.322165+0000","last_active":"2024-09-19T06:05:13.728363+0000","last_peered":"2024-09-19T06:05:13.728363+0000","last_clean":"2024-09-19T06:05:13.728363+0000","last_became_active":"2024-09-19T06:04:03.321822+0000","last_became_peered":"2024-09-19T06:04:03.321822+0000","last_unstale":"2024-09-19T06:05:13.728363+0000","last_undegraded":"2024-09-19T06:05:13.728363+0000","last_fullsized":"2024-09-19T06:05:13.728363+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:58:00.943453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.729258+0000","last_change":"2024-09-19T06:04:12.465823+0000","last_active":"2024-09-19T06:05:13.729258+0000","last_peered":"2024-09-19T06:05:13.729258+0000","last_clean":"2024-09-19T06:05:13.729258+0000","last_became_active":"2024-09-19T06:04:12.465375+0000","last_became_peered":"2024-09-19T06:04:12.465375+0000","last_unstale":"2024-09-19T06:05:13.729258+0000","last_undegraded":"2024-09-19T06:05:13.729258+0000","last_fullsized":"2024-09-19T06:05:13.729258+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:26:25.428328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726852+0000","last_change":"2024-09-19T06:04:12.470023+0000","last_active":"2024-09-19T06:05:13.726852+0000","last_peered":"2024-09-19T06:05:13.726852+0000","last_clean":"2024-09-19T06:05:13.726852+0000","last_became_active":"2024-09-19T06:04:12.469651+0000","last_became_peered":"2024-09-19T06:04:12.469651+0000","last_unstale":"2024-09-19T06:05:13.726852+0000","last_undegraded":"2024-09-19T06:05:13.726852+0000","last_fullsized":"2024-09-19T06:05:13.726852+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:50:35.374437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.723642+0000","last_change":"2024-09-19T06:04:05.417466+0000","last_active":"2024-09-19T06:05:13.723642+0000","last_peered":"2024-09-19T06:05:13.723642+0000","last_clean":"2024-09-19T06:05:13.723642+0000","last_became_active":"2024-09-19T06:04:05.417026+0000","last_became_peered":"2024-09-19T06:04:05.417026+0000","last_unstale":"2024-09-19T06:05:13.723642+0000","last_undegraded":"2024-09-19T06:05:13.723642+0000","last_fullsized":"2024-09-19T06:05:13.723642+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:44:08.251755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.474542+0000","last_change":"2024-09-19T06:04:03.317466+0000","last_active":"2024-09-19T06:05:14.474542+0000","last_peered":"2024-09-19T06:05:14.474542+0000","last_clean":"2024-09-19T06:05:14.474542+0000","last_became_active":"2024-09-19T06:04:03.317148+0000","last_became_peered":"2024-09-19T06:04:03.317148+0000","last_unstale":"2024-09-19T06:05:14.474542+0000","last_undegraded":"2024-09-19T06:05:14.474542+0000","last_fullsized":"2024-09-19T06:05:14.474542+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:45:50.789900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727976+0000","last_change":"2024-09-19T06:04:12.469279+0000","last_active":"2024-09-19T06:05:13.727976+0000","last_peered":"2024-09-19T06:05:13.727976+0000","last_clean":"2024-09-19T06:05:13.727976+0000","last_became_active":"2024-09-19T06:04:12.467928+0000","last_became_peered":"2024-09-19T06:04:12.467928+0000","last_unstale":"2024-09-19T06:05:13.727976+0000","last_undegraded":"2024-09-19T06:05:13.727976+0000","last_fullsized":"2024-09-19T06:05:13.727976+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:52:25.839433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.729399+0000","last_change":"2024-09-19T06:04:05.420425+0000","last_active":"2024-09-19T06:05:13.729399+0000","last_peered":"2024-09-19T06:05:13.729399+0000","last_clean":"2024-09-19T06:05:13.729399+0000","last_became_active":"2024-09-19T06:04:05.420107+0000","last_became_peered":"2024-09-19T06:04:05.420107+0000","last_unstale":"2024-09-19T06:05:13.729399+0000","last_undegraded":"2024-09-19T06:05:13.729399+0000","last_fullsized":"2024-09-19T06:05:13.729399+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:49:24.566302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.158396+0000","last_change":"2024-09-19T06:04:03.315704+0000","last_active":"2024-09-19T06:05:14.158396+0000","last_peered":"2024-09-19T06:05:14.158396+0000","last_clean":"2024-09-19T06:05:14.158396+0000","last_became_active":"2024-09-19T06:04:03.315392+0000","last_became_peered":"2024-09-19T06:04:03.315392+0000","last_unstale":"2024-09-19T06:05:14.158396+0000","last_undegraded":"2024-09-19T06:05:14.158396+0000","last_fullsized":"2024-09-19T06:05:14.158396+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:52:14.417470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"81'1","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.728460+0000","last_change":"2024-09-19T06:04:03.323560+0000","last_active":"2024-09-19T06:05:13.728460+0000","last_peered":"2024-09-19T06:05:13.728460+0000","last_clean":"2024-09-19T06:05:13.728460+0000","last_became_active":"2024-09-19T06:04:03.323188+0000","last_became_peered":"2024-09-19T06:04:03.323188+0000","last_unstale":"2024-09-19T06:05:13.728460+0000","last_undegraded":"2024-09-19T06:05:13.728460+0000","last_fullsized":"2024-09-19T06:05:13.728460+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:02:50.426435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.474822+0000","last_change":"2024-09-19T06:04:05.430677+0000","last_active":"2024-09-19T06:05:14.474822+0000","last_peered":"2024-09-19T06:05:14.474822+0000","last_clean":"2024-09-19T06:05:14.474822+0000","last_became_active":"2024-09-19T06:04:05.430257+0000","last_became_peered":"2024-09-19T06:04:05.430257+0000","last_unstale":"2024-09-19T06:05:14.474822+0000","last_undegraded":"2024-09-19T06:05:14.474822+0000","last_fullsized":"2024-09-19T06:05:14.474822+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:38:42.138770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727118+0000","last_change":"2024-09-19T06:04:12.465252+0000","last_active":"2024-09-19T06:05:13.727118+0000","last_peered":"2024-09-19T06:05:13.727118+0000","last_clean":"2024-09-19T06:05:13.727118+0000","last_became_active":"2024-09-19T06:04:12.464649+0000","last_became_peered":"2024-09-19T06:04:12.464649+0000","last_unstale":"2024-09-19T06:05:13.727118+0000","last_undegraded":"2024-09-19T06:05:13.727118+0000","last_fullsized":"2024-09-19T06:05:13.727118+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:11:43.137148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"81'1","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.474959+0000","last_change":"2024-09-19T06:04:03.317584+0000","last_active":"2024-09-19T06:05:14.474959+0000","last_peered":"2024-09-19T06:05:14.474959+0000","last_clean":"2024-09-19T06:05:14.474959+0000","last_became_active":"2024-09-19T06:04:03.317250+0000","last_became_peered":"2024-09-19T06:04:03.317250+0000","last_unstale":"2024-09-19T06:05:14.474959+0000","last_undegraded":"2024-09-19T06:05:14.474959+0000","last_fullsized":"2024-09-19T06:05:14.474959+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:22.353887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727268+0000","last_change":"2024-09-19T06:04:05.431102+0000","last_active":"2024-09-19T06:05:13.727268+0000","last_peered":"2024-09-19T06:05:13.727268+0000","last_clean":"2024-09-19T06:05:13.727268+0000","last_became_active":"2024-09-19T06:04:05.430792+0000","last_became_peered":"2024-09-19T06:04:05.430792+0000","last_unstale":"2024-09-19T06:05:13.727268+0000","last_undegraded":"2024-09-19T06:05:13.727268+0000","last_fullsized":"2024-09-19T06:05:13.727268+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:48:48.682273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727983+0000","last_change":"2024-09-19T06:04:12.467143+0000","last_active":"2024-09-19T06:05:13.727983+0000","last_peered":"2024-09-19T06:05:13.727983+0000","last_clean":"2024-09-19T06:05:13.727983+0000","last_became_active":"2024-09-19T06:04:12.466672+0000","last_became_peered":"2024-09-19T06:04:12.466672+0000","last_unstale":"2024-09-19T06:05:13.727983+0000","last_undegraded":"2024-09-19T06:05:13.727983+0000","last_fullsized":"2024-09-19T06:05:13.727983+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:57:36.710316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726828+0000","last_change":"2024-09-19T06:04:05.427387+0000","last_active":"2024-09-19T06:05:13.726828+0000","last_peered":"2024-09-19T06:05:13.726828+0000","last_clean":"2024-09-19T06:05:13.726828+0000","last_became_active":"2024-09-19T06:04:05.427082+0000","last_became_peered":"2024-09-19T06:04:05.427082+0000","last_unstale":"2024-09-19T06:05:13.726828+0000","last_undegraded":"2024-09-19T06:05:13.726828+0000","last_fullsized":"2024-09-19T06:05:13.726828+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:55.931289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.728393+0000","last_change":"2024-09-19T06:04:05.434396+0000","last_active":"2024-09-19T06:05:13.728393+0000","last_peered":"2024-09-19T06:05:13.728393+0000","last_clean":"2024-09-19T06:05:13.728393+0000","last_became_active":"2024-09-19T06:04:05.433907+0000","last_became_peered":"2024-09-19T06:04:05.433907+0000","last_unstale":"2024-09-19T06:05:13.728393+0000","last_undegraded":"2024-09-19T06:05:13.728393+0000","last_fullsized":"2024-09-19T06:05:13.728393+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:02:40.885820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727853+0000","last_change":"2024-09-19T06:04:05.435813+0000","last_active":"2024-09-19T06:05:13.727853+0000","last_peered":"2024-09-19T06:05:13.727853+0000","last_clean":"2024-09-19T06:05:13.727853+0000","last_became_active":"2024-09-19T06:04:05.435441+0000","last_became_peered":"2024-09-19T06:04:05.435441+0000","last_unstale":"2024-09-19T06:05:13.727853+0000","last_undegraded":"2024-09-19T06:05:13.727853+0000","last_fullsized":"2024-09-19T06:05:13.727853+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:11:20.071732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726943+0000","last_change":"2024-09-19T06:04:05.433045+0000","last_active":"2024-09-19T06:05:13.726943+0000","last_peered":"2024-09-19T06:05:13.726943+0000","last_clean":"2024-09-19T06:05:13.726943+0000","last_became_active":"2024-09-19T06:04:05.432674+0000","last_became_peered":"2024-09-19T06:04:05.432674+0000","last_unstale":"2024-09-19T06:05:13.726943+0000","last_undegraded":"2024-09-19T06:05:13.726943+0000","last_fullsized":"2024-09-19T06:05:13.726943+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:33:06.743886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.158713+0000","last_change":"2024-09-19T06:04:05.431702+0000","last_active":"2024-09-19T06:05:14.158713+0000","last_peered":"2024-09-19T06:05:14.158713+0000","last_clean":"2024-09-19T06:05:14.158713+0000","last_became_active":"2024-09-19T06:04:05.431394+0000","last_became_peered":"2024-09-19T06:04:05.431394+0000","last_unstale":"2024-09-19T06:05:14.158713+0000","last_undegraded":"2024-09-19T06:05:14.158713+0000","last_fullsized":"2024-09-19T06:05:14.158713+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:42:18.692549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.733030+0000","last_change":"2024-09-19T06:05:13.733030+0000","last_active":"2024-09-19T06:05:13.733030+0000","last_peered":"2024-09-19T06:05:13.733030+0000","last_clean":"2024-09-19T06:05:13.733030+0000","last_became_active":"2024-09-19T06:05:13.732680+0000","last_became_peered":"2024-09-19T06:05:13.732680+0000","last_unstale":"2024-09-19T06:05:13.733030+0000","last_undegraded":"2024-09-19T06:05:13.733030+0000","last_fullsized":"2024-09-19T06:05:13.733030+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:53:24.299931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727345+0000","last_change":"2024-09-19T06:04:05.430104+0000","last_active":"2024-09-19T06:05:13.727345+0000","last_peered":"2024-09-19T06:05:13.727345+0000","last_clean":"2024-09-19T06:05:13.727345+0000","last_became_active":"2024-09-19T06:04:05.429779+0000","last_became_peered":"2024-09-19T06:04:05.429779+0000","last_unstale":"2024-09-19T06:05:13.727345+0000","last_undegraded":"2024-09-19T06:05:13.727345+0000","last_fullsized":"2024-09-19T06:05:13.727345+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:52:46.191484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.730313+0000","last_change":"2024-09-19T06:04:05.427235+0000","last_active":"2024-09-19T06:05:13.730313+0000","last_peered":"2024-09-19T06:05:13.730313+0000","last_clean":"2024-09-19T06:05:13.730313+0000","last_became_active":"2024-09-19T06:04:05.426937+0000","last_became_peered":"2024-09-19T06:04:05.426937+0000","last_unstale":"2024-09-19T06:05:13.730313+0000","last_undegraded":"2024-09-19T06:05:13.730313+0000","last_fullsized":"2024-09-19T06:05:13.730313+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:55.949564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.474156+0000","last_change":"2024-09-19T06:04:05.422199+0000","last_active":"2024-09-19T06:05:14.474156+0000","last_peered":"2024-09-19T06:05:14.474156+0000","last_clean":"2024-09-19T06:05:14.474156+0000","last_became_active":"2024-09-19T06:04:05.421681+0000","last_became_peered":"2024-09-19T06:04:05.421681+0000","last_unstale":"2024-09-19T06:05:14.474156+0000","last_undegraded":"2024-09-19T06:05:14.474156+0000","last_fullsized":"2024-09-19T06:05:14.474156+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:27:54.774211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.729451+0000","last_change":"2024-09-19T06:04:05.426559+0000","last_active":"2024-09-19T06:05:13.729451+0000","last_peered":"2024-09-19T06:05:13.729451+0000","last_clean":"2024-09-19T06:05:13.729451+0000","last_became_active":"2024-09-19T06:04:05.423197+0000","last_became_peered":"2024-09-19T06:04:05.423197+0000","last_unstale":"2024-09-19T06:05:13.729451+0000","last_undegraded":"2024-09-19T06:05:13.729451+0000","last_fullsized":"2024-09-19T06:05:13.729451+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:43.964457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:15.014232+0000","last_change":"2024-09-19T06:04:05.435779+0000","last_active":"2024-09-19T06:05:15.014232+0000","last_peered":"2024-09-19T06:05:15.014232+0000","last_clean":"2024-09-19T06:05:15.014232+0000","last_became_active":"2024-09-19T06:04:05.435436+0000","last_became_peered":"2024-09-19T06:04:05.435436+0000","last_unstale":"2024-09-19T06:05:15.014232+0000","last_undegraded":"2024-09-19T06:05:15.014232+0000","last_fullsized":"2024-09-19T06:05:15.014232+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:13:03.341438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.158694+0000","last_change":"2024-09-19T06:04:05.431718+0000","last_active":"2024-09-19T06:05:14.158694+0000","last_peered":"2024-09-19T06:05:14.158694+0000","last_clean":"2024-09-19T06:05:14.158694+0000","last_became_active":"2024-09-19T06:04:05.431429+0000","last_became_peered":"2024-09-19T06:04:05.431429+0000","last_unstale":"2024-09-19T06:05:14.158694+0000","last_undegraded":"2024-09-19T06:05:14.158694+0000","last_fullsized":"2024-09-19T06:05:14.158694+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:11:42.818368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727494+0000","last_change":"2024-09-19T06:04:05.429575+0000","last_active":"2024-09-19T06:05:13.727494+0000","last_peered":"2024-09-19T06:05:13.727494+0000","last_clean":"2024-09-19T06:05:13.727494+0000","last_became_active":"2024-09-19T06:04:05.429226+0000","last_became_peered":"2024-09-19T06:04:05.429226+0000","last_unstale":"2024-09-19T06:05:13.727494+0000","last_undegraded":"2024-09-19T06:05:13.727494+0000","last_fullsized":"2024-09-19T06:05:13.727494+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:29:19.680433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.728155+0000","last_change":"2024-09-19T06:04:05.431612+0000","last_active":"2024-09-19T06:05:13.728155+0000","last_peered":"2024-09-19T06:05:13.728155+0000","last_clean":"2024-09-19T06:05:13.728155+0000","last_became_active":"2024-09-19T06:04:05.431240+0000","last_became_peered":"2024-09-19T06:04:05.431240+0000","last_unstale":"2024-09-19T06:05:13.728155+0000","last_undegraded":"2024-09-19T06:05:13.728155+0000","last_fullsized":"2024-09-19T06:05:13.728155+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:46:14.138603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724293+0000","last_change":"2024-09-19T06:04:05.428849+0000","last_active":"2024-09-19T06:05:13.724293+0000","last_peered":"2024-09-19T06:05:13.724293+0000","last_clean":"2024-09-19T06:05:13.724293+0000","last_became_active":"2024-09-19T06:04:05.428516+0000","last_became_peered":"2024-09-19T06:04:05.428516+0000","last_unstale":"2024-09-19T06:05:13.724293+0000","last_undegraded":"2024-09-19T06:05:13.724293+0000","last_fullsized":"2024-09-19T06:05:13.724293+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:58:00.323959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.728373+0000","last_change":"2024-09-19T06:04:05.436409+0000","last_active":"2024-09-19T06:05:13.728373+0000","last_peered":"2024-09-19T06:05:13.728373+0000","last_clean":"2024-09-19T06:05:13.728373+0000","last_became_active":"2024-09-19T06:04:05.436058+0000","last_became_peered":"2024-09-19T06:04:05.436058+0000","last_unstale":"2024-09-19T06:05:13.728373+0000","last_undegraded":"2024-09-19T06:05:13.728373+0000","last_fullsized":"2024-09-19T06:05:13.728373+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:20:45.227159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:15.014023+0000","last_change":"2024-09-19T06:04:05.434398+0000","last_active":"2024-09-19T06:05:15.014023+0000","last_peered":"2024-09-19T06:05:15.014023+0000","last_clean":"2024-09-19T06:05:15.014023+0000","last_became_active":"2024-09-19T06:04:05.433635+0000","last_became_peered":"2024-09-19T06:04:05.433635+0000","last_unstale":"2024-09-19T06:05:15.014023+0000","last_undegraded":"2024-09-19T06:05:15.014023+0000","last_fullsized":"2024-09-19T06:05:15.014023+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:10:42.104705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726446+0000","last_change":"2024-09-19T06:04:05.423447+0000","last_active":"2024-09-19T06:05:13.726446+0000","last_peered":"2024-09-19T06:05:13.726446+0000","last_clean":"2024-09-19T06:05:13.726446+0000","last_became_active":"2024-09-19T06:04:05.423081+0000","last_became_peered":"2024-09-19T06:04:05.423081+0000","last_unstale":"2024-09-19T06:05:13.726446+0000","last_undegraded":"2024-09-19T06:05:13.726446+0000","last_fullsized":"2024-09-19T06:05:13.726446+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:03:54.856251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726503+0000","last_change":"2024-09-19T06:04:05.426371+0000","last_active":"2024-09-19T06:05:13.726503+0000","last_peered":"2024-09-19T06:05:13.726503+0000","last_clean":"2024-09-19T06:05:13.726503+0000","last_became_active":"2024-09-19T06:04:05.425601+0000","last_became_peered":"2024-09-19T06:04:05.425601+0000","last_unstale":"2024-09-19T06:05:13.726503+0000","last_undegraded":"2024-09-19T06:05:13.726503+0000","last_fullsized":"2024-09-19T06:05:13.726503+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:55:05.677121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.158746+0000","last_change":"2024-09-19T06:04:05.426264+0000","last_active":"2024-09-19T06:05:14.158746+0000","last_peered":"2024-09-19T06:05:14.158746+0000","last_clean":"2024-09-19T06:05:14.158746+0000","last_became_active":"2024-09-19T06:04:05.425939+0000","last_became_peered":"2024-09-19T06:04:05.425939+0000","last_unstale":"2024-09-19T06:05:14.158746+0000","last_undegraded":"2024-09-19T06:05:14.158746+0000","last_fullsized":"2024-09-19T06:05:14.158746+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:18:43.250682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727245+0000","last_change":"2024-09-19T06:04:05.432654+0000","last_active":"2024-09-19T06:05:13.727245+0000","last_peered":"2024-09-19T06:05:13.727245+0000","last_clean":"2024-09-19T06:05:13.727245+0000","last_became_active":"2024-09-19T06:04:05.431489+0000","last_became_peered":"2024-09-19T06:04:05.431489+0000","last_unstale":"2024-09-19T06:05:13.727245+0000","last_undegraded":"2024-09-19T06:05:13.727245+0000","last_fullsized":"2024-09-19T06:05:13.727245+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:15:41.251538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724637+0000","last_change":"2024-09-19T06:04:05.435221+0000","last_active":"2024-09-19T06:05:13.724637+0000","last_peered":"2024-09-19T06:05:13.724637+0000","last_clean":"2024-09-19T06:05:13.724637+0000","last_became_active":"2024-09-19T06:04:05.434909+0000","last_became_peered":"2024-09-19T06:04:05.434909+0000","last_unstale":"2024-09-19T06:05:13.724637+0000","last_undegraded":"2024-09-19T06:05:13.724637+0000","last_fullsized":"2024-09-19T06:05:13.724637+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:15:20.414499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.731152+0000","last_change":"2024-09-19T06:05:13.731152+0000","last_active":"2024-09-19T06:05:13.731152+0000","last_peered":"2024-09-19T06:05:13.731152+0000","last_clean":"2024-09-19T06:05:13.731152+0000","last_became_active":"2024-09-19T06:05:13.730810+0000","last_became_peered":"2024-09-19T06:05:13.730810+0000","last_unstale":"2024-09-19T06:05:13.731152+0000","last_undegraded":"2024-09-19T06:05:13.731152+0000","last_fullsized":"2024-09-19T06:05:13.731152+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:55:13.359784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:15.014646+0000","last_change":"2024-09-19T06:04:05.432940+0000","last_active":"2024-09-19T06:05:15.014646+0000","last_peered":"2024-09-19T06:05:15.014646+0000","last_clean":"2024-09-19T06:05:15.014646+0000","last_became_active":"2024-09-19T06:04:05.432579+0000","last_became_peered":"2024-09-19T06:04:05.432579+0000","last_unstale":"2024-09-19T06:05:15.014646+0000","last_undegraded":"2024-09-19T06:05:15.014646+0000","last_fullsized":"2024-09-19T06:05:15.014646+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:56.740048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.729272+0000","last_change":"2024-09-19T06:04:05.417967+0000","last_active":"2024-09-19T06:05:13.729272+0000","last_peered":"2024-09-19T06:05:13.729272+0000","last_clean":"2024-09-19T06:05:13.729272+0000","last_became_active":"2024-09-19T06:04:05.417658+0000","last_became_peered":"2024-09-19T06:04:05.417658+0000","last_unstale":"2024-09-19T06:05:13.729272+0000","last_undegraded":"2024-09-19T06:05:13.729272+0000","last_fullsized":"2024-09-19T06:05:13.729272+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:55.571313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724281+0000","last_change":"2024-09-19T06:04:05.424627+0000","last_active":"2024-09-19T06:05:13.724281+0000","last_peered":"2024-09-19T06:05:13.724281+0000","last_clean":"2024-09-19T06:05:13.724281+0000","last_became_active":"2024-09-19T06:04:05.424301+0000","last_became_peered":"2024-09-19T06:04:05.424301+0000","last_unstale":"2024-09-19T06:05:13.724281+0000","last_undegraded":"2024-09-19T06:05:13.724281+0000","last_fullsized":"2024-09-19T06:05:13.724281+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:48:00.964989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.728349+0000","last_change":"2024-09-19T06:04:05.423635+0000","last_active":"2024-09-19T06:05:13.728349+0000","last_peered":"2024-09-19T06:05:13.728349+0000","last_clean":"2024-09-19T06:05:13.728349+0000","last_became_active":"2024-09-19T06:04:05.422625+0000","last_became_peered":"2024-09-19T06:04:05.422625+0000","last_unstale":"2024-09-19T06:05:13.728349+0000","last_undegraded":"2024-09-19T06:05:13.728349+0000","last_fullsized":"2024-09-19T06:05:13.728349+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:33:34.099443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726970+0000","last_change":"2024-09-19T06:04:05.428933+0000","last_active":"2024-09-19T06:05:13.726970+0000","last_peered":"2024-09-19T06:05:13.726970+0000","last_clean":"2024-09-19T06:05:13.726970+0000","last_became_active":"2024-09-19T06:04:05.428598+0000","last_became_peered":"2024-09-19T06:04:05.428598+0000","last_unstale":"2024-09-19T06:05:13.726970+0000","last_undegraded":"2024-09-19T06:05:13.726970+0000","last_fullsized":"2024-09-19T06:05:13.726970+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:27:15.111954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.731274+0000","last_change":"2024-09-19T06:05:13.730637+0000","last_active":"2024-09-19T06:05:13.731274+0000","last_peered":"2024-09-19T06:05:13.731274+0000","last_clean":"2024-09-19T06:05:13.731274+0000","last_became_active":"2024-09-19T06:05:13.730224+0000","last_became_peered":"2024-09-19T06:05:13.730224+0000","last_unstale":"2024-09-19T06:05:13.731274+0000","last_undegraded":"2024-09-19T06:05:13.731274+0000","last_fullsized":"2024-09-19T06:05:13.731274+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:14:08.175943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726586+0000","last_change":"2024-09-19T06:04:05.430427+0000","last_active":"2024-09-19T06:05:13.726586+0000","last_peered":"2024-09-19T06:05:13.726586+0000","last_clean":"2024-09-19T06:05:13.726586+0000","last_became_active":"2024-09-19T06:04:05.430106+0000","last_became_peered":"2024-09-19T06:04:05.430106+0000","last_unstale":"2024-09-19T06:05:13.726586+0000","last_undegraded":"2024-09-19T06:05:13.726586+0000","last_fullsized":"2024-09-19T06:05:13.726586+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:03:00.764689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726972+0000","last_change":"2024-09-19T06:04:05.427189+0000","last_active":"2024-09-19T06:05:13.726972+0000","last_peered":"2024-09-19T06:05:13.726972+0000","last_clean":"2024-09-19T06:05:13.726972+0000","last_became_active":"2024-09-19T06:04:05.426874+0000","last_became_peered":"2024-09-19T06:04:05.426874+0000","last_unstale":"2024-09-19T06:05:13.726972+0000","last_undegraded":"2024-09-19T06:05:13.726972+0000","last_fullsized":"2024-09-19T06:05:13.726972+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:37:10.910723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.728272+0000","last_change":"2024-09-19T06:04:05.435803+0000","last_active":"2024-09-19T06:05:13.728272+0000","last_peered":"2024-09-19T06:05:13.728272+0000","last_clean":"2024-09-19T06:05:13.728272+0000","last_became_active":"2024-09-19T06:04:05.435430+0000","last_became_peered":"2024-09-19T06:04:05.435430+0000","last_unstale":"2024-09-19T06:05:13.728272+0000","last_undegraded":"2024-09-19T06:05:13.728272+0000","last_fullsized":"2024-09-19T06:05:13.728272+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:41.828016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64309,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":119,"num_read_kb":124,"num_write":83,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":192927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":70,"ondisk_log_size":70,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547232,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1007616,"data_stored":497802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776165,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36992,"kb_used_data":1640,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708160,"statfs":{"total":95995035648,"available":95957155840,"internally_reserved":0,"allocated":1679360,"data_stored":1147745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939690,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1011712,"data_stored":502446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168622,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1011712,"data_stored":498372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397556,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36920,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708232,"statfs":{"total":95995035648,"available":95957229568,"internally_reserved":0,"allocated":1605632,"data_stored":1092814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561081,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":999424,"data_stored":493672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790014,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28604,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716548,"statfs":{"total":95995035648,"available":95965745152,"internally_reserved":0,"allocated":1609728,"data_stored":1088318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953538,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1007616,"data_stored":497790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182472,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36336,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708816,"statfs":{"total":95995035648,"available":95957827584,"internally_reserved":0,"allocated":1007616,"data_stored":493776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411406,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28080,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717072,"statfs":{"total":95995035648,"available":95966281728,"internally_reserved":0,"allocated":1073152,"data_stored":557183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574930,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28080,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717072,"statfs":{"total":95995035648,"available":95966281728,"internally_reserved":0,"allocated":1073152,"data_stored":557183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738456,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1003520,"data_stored":493762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":63511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":63511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":63705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T06:05:38.729 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T06:05:38.730 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-19T06:05:38.730 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-19T06:05:38.730 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-19T06:05:38.996 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:05:39.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:38 smithi037 ceph-mon[31211]: from='client.14994 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:05:39.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:38 smithi099 ceph-mon[35300]: from='client.14994 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:05:39.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:38 smithi117 ceph-mon[35050]: from='client.14994 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:05:39.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:39.463+0000 7f1049ef8640 1 -- 172.21.15.37:0/1578791741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1044102d40 msgr2=0x7f1044103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:39.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:39.463+0000 7f1049ef8640 1 --2- 172.21.15.37:0/1578791741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1044102d40 0x7f1044103120 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f1034009900 tx=0x7f103402a480 comp rx=0 tx=0).stop 2024-09-19T06:05:39.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:39.463+0000 7f1049ef8640 1 -- 172.21.15.37:0/1578791741 shutdown_connections 2024-09-19T06:05:39.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:39.463+0000 7f1049ef8640 1 --2- 172.21.15.37:0/1578791741 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f104410c170 0x7f104410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:39.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:39.463+0000 7f1049ef8640 1 --2- 172.21.15.37:0/1578791741 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1044103660 0x7f104410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:39.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:39.463+0000 7f1049ef8640 1 --2- 172.21.15.37:0/1578791741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1044102d40 0x7f1044103120 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:39.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:39.463+0000 7f1049ef8640 1 -- 172.21.15.37:0/1578791741 >> 172.21.15.37:0/1578791741 conn(0x7f10440fc7a0 msgr2=0x7f10440febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:39.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:39.463+0000 7f1049ef8640 1 -- 172.21.15.37:0/1578791741 shutdown_connections 2024-09-19T06:05:39.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:39.463+0000 7f1049ef8640 1 -- 172.21.15.37:0/1578791741 wait complete. 2024-09-19T06:05:39.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:39.464+0000 7f1049ef8640 1 Processor -- start 2024-09-19T06:05:39.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:39.464+0000 7f1049ef8640 1 -- start start 2024-09-19T06:05:39.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:39.464+0000 7f1049ef8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1044102d40 0x7f1044198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:39.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:39.464+0000 7f1049ef8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1044103660 0x7f1044198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:39.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:39.464+0000 7f1049ef8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f104410c170 0x7f104419ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:39.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:39.464+0000 7f1049ef8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1044112030 con 0x7f1044102d40 2024-09-19T06:05:39.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:39.464+0000 7f1049ef8640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f1044111eb0 con 0x7f1044103660 2024-09-19T06:05:39.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:39.464+0000 7f1049ef8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f10441121b0 con 0x7f104410c170 2024-09-19T06:05:39.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:39.464+0000 7f10437fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1044102d40 0x7f1044198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:39.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:39.464+0000 7f10437fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1044102d40 0x7f1044198590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56780/0 (socket says 172.21.15.37:56780) 2024-09-19T06:05:39.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:39.464+0000 7f10437fe640 1 -- 172.21.15.37:0/1724606794 learned_addr learned my addr 172.21.15.37:0/1724606794 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:05:39.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:39.464+0000 7f1043fff640 1 --2- 172.21.15.37:0/1724606794 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f104410c170 0x7f104419ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:39.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:39.464+0000 7f1042ffd640 1 --2- 172.21.15.37:0/1724606794 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1044103660 0x7f1044198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:39.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:39.465+0000 7f10437fe640 1 -- 172.21.15.37:0/1724606794 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f104410c170 msgr2=0x7f104419ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:39.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:39.465+0000 7f10437fe640 1 --2- 172.21.15.37:0/1724606794 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f104410c170 0x7f104419ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:39.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:39.465+0000 7f10437fe640 1 -- 172.21.15.37:0/1724606794 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1044103660 msgr2=0x7f1044198ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:39.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:39.465+0000 7f10437fe640 1 --2- 172.21.15.37:0/1724606794 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1044103660 0x7f1044198ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:39.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:39.465+0000 7f10437fe640 1 -- 172.21.15.37:0/1724606794 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f104419d540 con 0x7f1044102d40 2024-09-19T06:05:39.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:39.465+0000 7f1043fff640 1 --2- 172.21.15.37:0/1724606794 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f104410c170 0x7f104419ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:05:39.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:39.465+0000 7f10437fe640 1 --2- 172.21.15.37:0/1724606794 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1044102d40 0x7f1044198590 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f1034005ab0 tx=0x7f10340042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:39.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:39.465+0000 7f1040ff9640 1 -- 172.21.15.37:0/1724606794 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f103403f030 con 0x7f1044102d40 2024-09-19T06:05:39.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:39.465+0000 7f1049ef8640 1 -- 172.21.15.37:0/1724606794 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f104419d7d0 con 0x7f1044102d40 2024-09-19T06:05:39.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:39.465+0000 7f1040ff9640 1 -- 172.21.15.37:0/1724606794 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1034003ce0 con 0x7f1044102d40 2024-09-19T06:05:39.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:39.465+0000 7f1040ff9640 1 -- 172.21.15.37:0/1724606794 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1034035070 con 0x7f1044102d40 2024-09-19T06:05:39.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:39.465+0000 7f1049ef8640 1 -- 172.21.15.37:0/1724606794 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10441a5110 con 0x7f1044102d40 2024-09-19T06:05:39.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:39.466+0000 7f1049ef8640 1 -- 172.21.15.37:0/1724606794 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f104406b070 con 0x7f1044102d40 2024-09-19T06:05:39.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:39.467+0000 7f1040ff9640 1 -- 172.21.15.37:0/1724606794 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f1034042030 con 0x7f1044102d40 2024-09-19T06:05:39.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:39.468+0000 7f1040ff9640 1 --2- 172.21.15.37:0/1724606794 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f102c0a3350 0x7f102c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:39.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:39.468+0000 7f1042ffd640 1 --2- 172.21.15.37:0/1724606794 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f102c0a3350 0x7f102c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:39.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:39.468+0000 7f1040ff9640 1 -- 172.21.15.37:0/1724606794 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f10340f0ab0 con 0x7f1044102d40 2024-09-19T06:05:39.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:39.469+0000 7f1042ffd640 1 --2- 172.21.15.37:0/1724606794 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f102c0a3350 0x7f102c0a5810 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f10440fee10 tx=0x7f1038008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:39.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:39.471+0000 7f1040ff9640 1 -- 172.21.15.37:0/1724606794 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f10340bd2b0 con 0x7f1044102d40 2024-09-19T06:05:39.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:39.684+0000 7f1049ef8640 1 -- 172.21.15.37:0/1724606794 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f10441031a0 con 0x7f1044102d40 2024-09-19T06:05:39.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:39.685+0000 7f1040ff9640 1 -- 172.21.15.37:0/1724606794 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f10340bcbb0 con 0x7f1044102d40 2024-09-19T06:05:39.686 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T06:05:39.686 INFO:teuthology.orchestra.run.smithi037.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-19T06:05:39.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:39.687+0000 7f1049ef8640 1 -- 172.21.15.37:0/1724606794 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f102c0a3350 msgr2=0x7f102c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:39.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:39.687+0000 7f1049ef8640 1 --2- 172.21.15.37:0/1724606794 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f102c0a3350 0x7f102c0a5810 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f10440fee10 tx=0x7f1038008040 comp rx=0 tx=0).stop 2024-09-19T06:05:39.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:39.687+0000 7f1049ef8640 1 -- 172.21.15.37:0/1724606794 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1044102d40 msgr2=0x7f1044198590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:39.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:39.687+0000 7f1049ef8640 1 --2- 172.21.15.37:0/1724606794 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1044102d40 0x7f1044198590 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f1034005ab0 tx=0x7f10340042f0 comp rx=0 tx=0).stop 2024-09-19T06:05:39.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:39.687+0000 7f1049ef8640 1 -- 172.21.15.37:0/1724606794 shutdown_connections 2024-09-19T06:05:39.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:39.687+0000 7f1049ef8640 1 --2- 172.21.15.37:0/1724606794 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f102c0a3350 0x7f102c0a5810 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:39.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:39.687+0000 7f1049ef8640 1 --2- 172.21.15.37:0/1724606794 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1044103660 0x7f1044198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:39.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:39.687+0000 7f1049ef8640 1 --2- 172.21.15.37:0/1724606794 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f104410c170 0x7f104419ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:39.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:39.687+0000 7f1049ef8640 1 --2- 172.21.15.37:0/1724606794 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1044102d40 0x7f1044198590 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:39.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:39.687+0000 7f1049ef8640 1 -- 172.21.15.37:0/1724606794 >> 172.21.15.37:0/1724606794 conn(0x7f10440fc7a0 msgr2=0x7f10440fe000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:39.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:39.687+0000 7f1049ef8640 1 -- 172.21.15.37:0/1724606794 shutdown_connections 2024-09-19T06:05:39.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:39.687+0000 7f1049ef8640 1 -- 172.21.15.37:0/1724606794 wait complete. 2024-09-19T06:05:40.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:39 smithi037 ceph-mon[31211]: pgmap v332: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:05:40.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:39 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/1724606794' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T06:05:40.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:39 smithi099 ceph-mon[35300]: pgmap v332: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:05:40.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:39 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/1724606794' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T06:05:40.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:39 smithi117 ceph-mon[35050]: pgmap v332: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:05:40.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:39 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/1724606794' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T06:05:40.547 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-19T06:05:40.548 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:05:40.809 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:05:41.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:41.249+0000 7f91d01d4640 1 -- 172.21.15.37:0/3719329045 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91c8101de0 msgr2=0x7f91c81021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:41.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:41.249+0000 7f91d01d4640 1 --2- 172.21.15.37:0/3719329045 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91c8101de0 0x7f91c81021c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f91c4009900 tx=0x7f91c402a3f0 comp rx=0 tx=0).stop 2024-09-19T06:05:41.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:41.249+0000 7f91d01d4640 1 -- 172.21.15.37:0/3719329045 shutdown_connections 2024-09-19T06:05:41.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:41.249+0000 7f91d01d4640 1 --2- 172.21.15.37:0/3719329045 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f91c8106f10 0x7f91c810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:41.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:41.249+0000 7f91d01d4640 1 --2- 172.21.15.37:0/3719329045 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f91c8102790 0x7f91c81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:41.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:41.249+0000 7f91d01d4640 1 --2- 172.21.15.37:0/3719329045 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91c8101de0 0x7f91c81021c0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:41.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:41.249+0000 7f91d01d4640 1 -- 172.21.15.37:0/3719329045 >> 172.21.15.37:0/3719329045 conn(0x7f91c80fd8c0 msgr2=0x7f91c80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:41.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:41.249+0000 7f91d01d4640 1 -- 172.21.15.37:0/3719329045 shutdown_connections 2024-09-19T06:05:41.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:41.249+0000 7f91d01d4640 1 -- 172.21.15.37:0/3719329045 wait complete. 2024-09-19T06:05:41.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:41.250+0000 7f91d01d4640 1 Processor -- start 2024-09-19T06:05:41.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:41.250+0000 7f91d01d4640 1 -- start start 2024-09-19T06:05:41.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:41.250+0000 7f91d01d4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91c8101de0 0x7f91c8198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:41.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:41.250+0000 7f91d01d4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f91c8102790 0x7f91c8198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:41.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:41.250+0000 7f91d01d4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f91c8106f10 0x7f91c819cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:41.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:41.250+0000 7f91d01d4640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f91c8111f70 con 0x7f91c8101de0 2024-09-19T06:05:41.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:41.250+0000 7f91d01d4640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f91c8111df0 con 0x7f91c8106f10 2024-09-19T06:05:41.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:41.250+0000 7f91d01d4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f91c81120f0 con 0x7f91c8102790 2024-09-19T06:05:41.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:41.250+0000 7f91cdf70640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91c8101de0 0x7f91c8198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:41.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:41.250+0000 7f91cdf70640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91c8101de0 0x7f91c8198300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56800/0 (socket says 172.21.15.37:56800) 2024-09-19T06:05:41.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:41.250+0000 7f91cdf70640 1 -- 172.21.15.37:0/2806514348 learned_addr learned my addr 172.21.15.37:0/2806514348 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:05:41.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:41.250+0000 7f91cd76f640 1 --2- 172.21.15.37:0/2806514348 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f91c8102790 0x7f91c8198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:41.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:41.250+0000 7f91ce771640 1 --2- 172.21.15.37:0/2806514348 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f91c8106f10 0x7f91c819cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:41.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:41.251+0000 7f91cdf70640 1 -- 172.21.15.37:0/2806514348 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f91c8102790 msgr2=0x7f91c8198840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:41.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:41.251+0000 7f91cdf70640 1 --2- 172.21.15.37:0/2806514348 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f91c8102790 0x7f91c8198840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:41.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:41.251+0000 7f91cdf70640 1 -- 172.21.15.37:0/2806514348 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f91c8106f10 msgr2=0x7f91c819cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:41.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:41.251+0000 7f91cdf70640 1 --2- 172.21.15.37:0/2806514348 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f91c8106f10 0x7f91c819cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:41.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:41.251+0000 7f91cdf70640 1 -- 172.21.15.37:0/2806514348 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91c819d2b0 con 0x7f91c8101de0 2024-09-19T06:05:41.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:41.251+0000 7f91ce771640 1 --2- 172.21.15.37:0/2806514348 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f91c8106f10 0x7f91c819cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:05:41.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:41.251+0000 7f91cd76f640 1 --2- 172.21.15.37:0/2806514348 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f91c8102790 0x7f91c8198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:05:41.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:41.251+0000 7f91cdf70640 1 --2- 172.21.15.37:0/2806514348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91c8101de0 0x7f91c8198300 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f91c4005ab0 tx=0x7f91c40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:41.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:41.251+0000 7f91beffd640 1 -- 172.21.15.37:0/2806514348 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c403f030 con 0x7f91c8101de0 2024-09-19T06:05:41.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:41.251+0000 7f91d01d4640 1 -- 172.21.15.37:0/2806514348 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91c819d540 con 0x7f91c8101de0 2024-09-19T06:05:41.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:41.251+0000 7f91beffd640 1 -- 172.21.15.37:0/2806514348 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91c4003ce0 con 0x7f91c8101de0 2024-09-19T06:05:41.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:41.251+0000 7f91beffd640 1 -- 172.21.15.37:0/2806514348 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c4035070 con 0x7f91c8101de0 2024-09-19T06:05:41.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:41.251+0000 7f91d01d4640 1 -- 172.21.15.37:0/2806514348 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91c81a4e80 con 0x7f91c8101de0 2024-09-19T06:05:41.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:41.252+0000 7f91d01d4640 1 -- 172.21.15.37:0/2806514348 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91c81021c0 con 0x7f91c8101de0 2024-09-19T06:05:41.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:41.253+0000 7f91beffd640 1 -- 172.21.15.37:0/2806514348 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f91c4042030 con 0x7f91c8101de0 2024-09-19T06:05:41.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:41.254+0000 7f91beffd640 1 --2- 172.21.15.37:0/2806514348 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f91b40a32d0 0x7f91b40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:41.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:41.254+0000 7f91cd76f640 1 --2- 172.21.15.37:0/2806514348 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f91b40a32d0 0x7f91b40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:41.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:41.254+0000 7f91beffd640 1 -- 172.21.15.37:0/2806514348 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f91c40f07c0 con 0x7f91c8101de0 2024-09-19T06:05:41.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:41.255+0000 7f91cd76f640 1 --2- 172.21.15.37:0/2806514348 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f91b40a32d0 0x7f91b40a5790 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f91c8108880 tx=0x7f91b800a5c0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:41.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:41.258+0000 7f91beffd640 1 -- 172.21.15.37:0/2806514348 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f91c40bd020 con 0x7f91c8101de0 2024-09-19T06:05:41.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:41.471+0000 7f91d01d4640 1 -- 172.21.15.37:0/2806514348 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f91c810a0f0 con 0x7f91c8101de0 2024-09-19T06:05:41.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:41.472+0000 7f91beffd640 1 -- 172.21.15.37:0/2806514348 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11842 (secure 0 0 0) 0x7f91c40bc920 con 0x7f91c8101de0 2024-09-19T06:05:41.474 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T06:05:41.474 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"btime":"2024-09-19T06:04:42:531480+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14514,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2864247978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2864247978},{"type":"v1","addr":"172.21.15.37:6835","nonce":2864247978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14526,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/633000932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":633000932},{"type":"v1","addr":"172.21.15.37:6837","nonce":633000932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14574,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/3753800615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":3753800615},{"type":"v1","addr":"172.21.15.37:6839","nonce":3753800615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/2718998355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":2718998355},{"type":"v1","addr":"172.21.15.37:6841","nonce":2718998355}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6833/866590207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":866590207},{"type":"v1","addr":"172.21.15.99:6833","nonce":866590207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3898668400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3898668400},{"type":"v1","addr":"172.21.15.117:6833","nonce":3898668400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2650673320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2650673320},{"type":"v1","addr":"172.21.15.99:6835","nonce":2650673320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1097471349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1097471349},{"type":"v1","addr":"172.21.15.117:6835","nonce":1097471349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24457,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1001392672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1001392672},{"type":"v1","addr":"172.21.15.117:6837","nonce":1001392672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/23570935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":23570935},{"type":"v1","addr":"172.21.15.99:6837","nonce":23570935}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:04:06.253034+0000","modified":"2024-09-19T06:04:42.196783+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24485},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24478":{"gid":24478,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6839/1269518339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":1269518339},{"type":"v1","addr":"172.21.15.117:6839","nonce":1269518339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.99:6839/3404812329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":3404812329},{"type":"v1","addr":"172.21.15.99:6839","nonce":3404812329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24485,"qdb_cluster":[24485]},"id":1}]} 2024-09-19T06:05:41.475 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 20 2024-09-19T06:05:41.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:41.474+0000 7f91d01d4640 1 -- 172.21.15.37:0/2806514348 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f91b40a32d0 msgr2=0x7f91b40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:41.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:41.474+0000 7f91d01d4640 1 --2- 172.21.15.37:0/2806514348 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f91b40a32d0 0x7f91b40a5790 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f91c8108880 tx=0x7f91b800a5c0 comp rx=0 tx=0).stop 2024-09-19T06:05:41.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:41.474+0000 7f91d01d4640 1 -- 172.21.15.37:0/2806514348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91c8101de0 msgr2=0x7f91c8198300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:41.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:41.474+0000 7f91d01d4640 1 --2- 172.21.15.37:0/2806514348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91c8101de0 0x7f91c8198300 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f91c4005ab0 tx=0x7f91c40042f0 comp rx=0 tx=0).stop 2024-09-19T06:05:41.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:41.474+0000 7f91d01d4640 1 -- 172.21.15.37:0/2806514348 shutdown_connections 2024-09-19T06:05:41.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:41.474+0000 7f91d01d4640 1 --2- 172.21.15.37:0/2806514348 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f91b40a32d0 0x7f91b40a5790 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:41.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:41.474+0000 7f91d01d4640 1 --2- 172.21.15.37:0/2806514348 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f91c8106f10 0x7f91c819cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:41.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:41.474+0000 7f91d01d4640 1 --2- 172.21.15.37:0/2806514348 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f91c8102790 0x7f91c8198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:41.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:41.474+0000 7f91d01d4640 1 --2- 172.21.15.37:0/2806514348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91c8101de0 0x7f91c8198300 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:41.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:41.474+0000 7f91d01d4640 1 -- 172.21.15.37:0/2806514348 >> 172.21.15.37:0/2806514348 conn(0x7f91c80fd8c0 msgr2=0x7f91c80fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:41.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:41.474+0000 7f91d01d4640 1 -- 172.21.15.37:0/2806514348 shutdown_connections 2024-09-19T06:05:41.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:41.474+0000 7f91d01d4640 1 -- 172.21.15.37:0/2806514348 wait complete. 2024-09-19T06:05:42.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:41 smithi099 ceph-mon[35300]: pgmap v333: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:05:42.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:41 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/2806514348' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:05:42.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:41 smithi117 ceph-mon[35050]: pgmap v333: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:05:42.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:41 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/2806514348' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:05:42.257 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:41 smithi037 ceph-mon[31211]: pgmap v333: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:05:42.257 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:41 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/2806514348' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:05:42.293 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:05:42.558 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:05:43.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:43.050+0000 7fb5e8ff9640 1 -- 172.21.15.37:0/3297071362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5e4100a80 msgr2=0x7fb5e4100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:43.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:43.050+0000 7fb5e8ff9640 1 --2- 172.21.15.37:0/3297071362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5e4100a80 0x7fb5e4100ee0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb5d8009930 tx=0x7fb5d802a420 comp rx=0 tx=0).stop 2024-09-19T06:05:43.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:43.050+0000 7fb5e8ff9640 1 -- 172.21.15.37:0/3297071362 shutdown_connections 2024-09-19T06:05:43.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:43.050+0000 7fb5e8ff9640 1 --2- 172.21.15.37:0/3297071362 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5e4101420 0x7fb5e410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:43.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:43.050+0000 7fb5e8ff9640 1 --2- 172.21.15.37:0/3297071362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5e4100a80 0x7fb5e4100ee0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:43.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:43.050+0000 7fb5e8ff9640 1 --2- 172.21.15.37:0/3297071362 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5e4106a80 0x7fb5e4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:43.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:43.050+0000 7fb5e8ff9640 1 -- 172.21.15.37:0/3297071362 >> 172.21.15.37:0/3297071362 conn(0x7fb5e40fc7a0 msgr2=0x7fb5e40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:43.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:43.051+0000 7fb5e8ff9640 1 -- 172.21.15.37:0/3297071362 shutdown_connections 2024-09-19T06:05:43.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:43.051+0000 7fb5e8ff9640 1 -- 172.21.15.37:0/3297071362 wait complete. 2024-09-19T06:05:43.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:43.051+0000 7fb5e8ff9640 1 Processor -- start 2024-09-19T06:05:43.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:43.051+0000 7fb5e8ff9640 1 -- start start 2024-09-19T06:05:43.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:43.051+0000 7fb5e8ff9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5e4100a80 0x7fb5e41983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:43.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:43.051+0000 7fb5e8ff9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5e4101420 0x7fb5e4198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:43.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:43.051+0000 7fb5e8ff9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5e4106a80 0x7fb5e419ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:43.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:43.051+0000 7fb5e8ff9640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e4110e80 con 0x7fb5e4100a80 2024-09-19T06:05:43.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:43.051+0000 7fb5e8ff9640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e4110d00 con 0x7fb5e4101420 2024-09-19T06:05:43.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:43.051+0000 7fb5e8ff9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e4111000 con 0x7fb5e4106a80 2024-09-19T06:05:43.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:43.052+0000 7fb5e259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5e4100a80 0x7fb5e41983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:43.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:43.052+0000 7fb5e259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5e4100a80 0x7fb5e41983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56824/0 (socket says 172.21.15.37:56824) 2024-09-19T06:05:43.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:43.052+0000 7fb5e259c640 1 -- 172.21.15.37:0/479057474 learned_addr learned my addr 172.21.15.37:0/479057474 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:05:43.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:43.052+0000 7fb5e1d9b640 1 --2- 172.21.15.37:0/479057474 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5e4101420 0x7fb5e4198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:43.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:43.052+0000 7fb5e2d9d640 1 --2- 172.21.15.37:0/479057474 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5e4106a80 0x7fb5e419ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:43.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:43.052+0000 7fb5e259c640 1 -- 172.21.15.37:0/479057474 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5e4106a80 msgr2=0x7fb5e419ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:43.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:43.052+0000 7fb5e259c640 1 --2- 172.21.15.37:0/479057474 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5e4106a80 0x7fb5e419ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:43.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:43.052+0000 7fb5e259c640 1 -- 172.21.15.37:0/479057474 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5e4101420 msgr2=0x7fb5e4198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:43.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:43.052+0000 7fb5e259c640 1 --2- 172.21.15.37:0/479057474 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5e4101420 0x7fb5e4198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:43.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:43.052+0000 7fb5e259c640 1 -- 172.21.15.37:0/479057474 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5e419d390 con 0x7fb5e4100a80 2024-09-19T06:05:43.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:43.052+0000 7fb5e2d9d640 1 --2- 172.21.15.37:0/479057474 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5e4106a80 0x7fb5e419ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:05:43.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:43.052+0000 7fb5e1d9b640 1 --2- 172.21.15.37:0/479057474 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5e4101420 0x7fb5e4198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:05:43.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:43.052+0000 7fb5e259c640 1 --2- 172.21.15.37:0/479057474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5e4100a80 0x7fb5e41983e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb5d400c920 tx=0x7fb5d400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:43.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:43.052+0000 7fb5d37fe640 1 -- 172.21.15.37:0/479057474 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5d4007c70 con 0x7fb5e4100a80 2024-09-19T06:05:43.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:43.052+0000 7fb5e8ff9640 1 -- 172.21.15.37:0/479057474 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5e419d680 con 0x7fb5e4100a80 2024-09-19T06:05:43.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:43.052+0000 7fb5d37fe640 1 -- 172.21.15.37:0/479057474 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb5d4007e10 con 0x7fb5e4100a80 2024-09-19T06:05:43.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:43.052+0000 7fb5d37fe640 1 -- 172.21.15.37:0/479057474 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5d4018890 con 0x7fb5e4100a80 2024-09-19T06:05:43.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:43.052+0000 7fb5e8ff9640 1 -- 172.21.15.37:0/479057474 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5e41a4f60 con 0x7fb5e4100a80 2024-09-19T06:05:43.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:43.053+0000 7fb5e8ff9640 1 -- 172.21.15.37:0/479057474 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5e4100ee0 con 0x7fb5e4100a80 2024-09-19T06:05:43.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:43.055+0000 7fb5d37fe640 1 -- 172.21.15.37:0/479057474 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fb5d4018a50 con 0x7fb5e4100a80 2024-09-19T06:05:43.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:43.055+0000 7fb5d37fe640 1 --2- 172.21.15.37:0/479057474 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fb5cc0a32d0 0x7fb5cc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:43.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:43.055+0000 7fb5d37fe640 1 -- 172.21.15.37:0/479057474 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fb5d40d0220 con 0x7fb5e4100a80 2024-09-19T06:05:43.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:43.055+0000 7fb5e1d9b640 1 --2- 172.21.15.37:0/479057474 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fb5cc0a32d0 0x7fb5cc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:43.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:43.056+0000 7fb5e1d9b640 1 --2- 172.21.15.37:0/479057474 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fb5cc0a32d0 0x7fb5cc0a5790 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb5d8000c00 tx=0x7fb5d8032c70 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:43.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:43.059+0000 7fb5d37fe640 1 -- 172.21.15.37:0/479057474 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb5d4014030 con 0x7fb5e4100a80 2024-09-19T06:05:43.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:43.271+0000 7fb5e8ff9640 1 -- 172.21.15.37:0/479057474 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb5e402d7c0 con 0x7fb5e4100a80 2024-09-19T06:05:43.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:43.272+0000 7fb5d37fe640 1 -- 172.21.15.37:0/479057474 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11842 (secure 0 0 0) 0x7fb5d400de20 con 0x7fb5e4100a80 2024-09-19T06:05:43.273 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T06:05:43.274 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"btime":"2024-09-19T06:04:42:531480+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14514,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2864247978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2864247978},{"type":"v1","addr":"172.21.15.37:6835","nonce":2864247978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14526,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/633000932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":633000932},{"type":"v1","addr":"172.21.15.37:6837","nonce":633000932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14574,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/3753800615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":3753800615},{"type":"v1","addr":"172.21.15.37:6839","nonce":3753800615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/2718998355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":2718998355},{"type":"v1","addr":"172.21.15.37:6841","nonce":2718998355}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6833/866590207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":866590207},{"type":"v1","addr":"172.21.15.99:6833","nonce":866590207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3898668400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3898668400},{"type":"v1","addr":"172.21.15.117:6833","nonce":3898668400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2650673320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2650673320},{"type":"v1","addr":"172.21.15.99:6835","nonce":2650673320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1097471349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1097471349},{"type":"v1","addr":"172.21.15.117:6835","nonce":1097471349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24457,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1001392672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1001392672},{"type":"v1","addr":"172.21.15.117:6837","nonce":1001392672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/23570935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":23570935},{"type":"v1","addr":"172.21.15.99:6837","nonce":23570935}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:04:06.253034+0000","modified":"2024-09-19T06:04:42.196783+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24485},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24478":{"gid":24478,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6839/1269518339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":1269518339},{"type":"v1","addr":"172.21.15.117:6839","nonce":1269518339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.99:6839/3404812329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":3404812329},{"type":"v1","addr":"172.21.15.99:6839","nonce":3404812329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24485,"qdb_cluster":[24485]},"id":1}]} 2024-09-19T06:05:43.274 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 20 2024-09-19T06:05:43.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:43.274+0000 7fb5e8ff9640 1 -- 172.21.15.37:0/479057474 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fb5cc0a32d0 msgr2=0x7fb5cc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:43.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:43.274+0000 7fb5e8ff9640 1 --2- 172.21.15.37:0/479057474 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fb5cc0a32d0 0x7fb5cc0a5790 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb5d8000c00 tx=0x7fb5d8032c70 comp rx=0 tx=0).stop 2024-09-19T06:05:43.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:43.274+0000 7fb5e8ff9640 1 -- 172.21.15.37:0/479057474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5e4100a80 msgr2=0x7fb5e41983e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:43.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:43.274+0000 7fb5e8ff9640 1 --2- 172.21.15.37:0/479057474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5e4100a80 0x7fb5e41983e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb5d400c920 tx=0x7fb5d400cde0 comp rx=0 tx=0).stop 2024-09-19T06:05:43.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:43.274+0000 7fb5e8ff9640 1 -- 172.21.15.37:0/479057474 shutdown_connections 2024-09-19T06:05:43.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:43.274+0000 7fb5e8ff9640 1 --2- 172.21.15.37:0/479057474 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fb5cc0a32d0 0x7fb5cc0a5790 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:43.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:43.274+0000 7fb5e8ff9640 1 --2- 172.21.15.37:0/479057474 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5e4101420 0x7fb5e4198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:43.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:43.274+0000 7fb5e8ff9640 1 --2- 172.21.15.37:0/479057474 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5e4106a80 0x7fb5e419ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:43.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:43.274+0000 7fb5e8ff9640 1 --2- 172.21.15.37:0/479057474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5e4100a80 0x7fb5e41983e0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:43.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:43.274+0000 7fb5e8ff9640 1 -- 172.21.15.37:0/479057474 >> 172.21.15.37:0/479057474 conn(0x7fb5e40fc7a0 msgr2=0x7fb5e406a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:43.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:43.274+0000 7fb5e8ff9640 1 -- 172.21.15.37:0/479057474 shutdown_connections 2024-09-19T06:05:43.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:43.274+0000 7fb5e8ff9640 1 -- 172.21.15.37:0/479057474 wait complete. 2024-09-19T06:05:43.918 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T06:05:44.177 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:05:44.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:43 smithi099 ceph-mon[35300]: pgmap v334: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:05:44.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:43 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/479057474' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:05:44.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:43 smithi117 ceph-mon[35050]: pgmap v334: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:05:44.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:43 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/479057474' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:05:44.298 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:43 smithi037 ceph-mon[31211]: pgmap v334: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:05:44.298 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:43 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/479057474' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:05:44.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:44.624+0000 7fba8c9b2640 1 -- 172.21.15.37:0/3668130489 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba88100e20 msgr2=0x7fba88101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:44.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:44.624+0000 7fba8c9b2640 1 --2- 172.21.15.37:0/3668130489 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba88100e20 0x7fba88101200 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fba78009900 tx=0x7fba7802a480 comp rx=0 tx=0).stop 2024-09-19T06:05:44.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:44.624+0000 7fba8c9b2640 1 -- 172.21.15.37:0/3668130489 shutdown_connections 2024-09-19T06:05:44.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:44.624+0000 7fba8c9b2640 1 --2- 172.21.15.37:0/3668130489 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba88102ef0 0x7fba8810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:44.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:44.624+0000 7fba8c9b2640 1 --2- 172.21.15.37:0/3668130489 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba88102570 0x7fba881029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:44.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:44.624+0000 7fba8c9b2640 1 --2- 172.21.15.37:0/3668130489 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba88100e20 0x7fba88101200 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:44.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:44.624+0000 7fba8c9b2640 1 -- 172.21.15.37:0/3668130489 >> 172.21.15.37:0/3668130489 conn(0x7fba880fc7d0 msgr2=0x7fba880febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:44.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:44.624+0000 7fba8c9b2640 1 -- 172.21.15.37:0/3668130489 shutdown_connections 2024-09-19T06:05:44.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:44.624+0000 7fba8c9b2640 1 -- 172.21.15.37:0/3668130489 wait complete. 2024-09-19T06:05:44.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:44.625+0000 7fba8c9b2640 1 Processor -- start 2024-09-19T06:05:44.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:44.625+0000 7fba8c9b2640 1 -- start start 2024-09-19T06:05:44.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:44.625+0000 7fba8c9b2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba88100e20 0x7fba88199430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:44.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:44.625+0000 7fba8c9b2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba88102570 0x7fba88199970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:44.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:44.625+0000 7fba8c9b2640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba88102ef0 0x7fba881a44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:44.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:44.625+0000 7fba8c9b2640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fba88110fa0 con 0x7fba88102570 2024-09-19T06:05:44.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:44.625+0000 7fba8c9b2640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fba88110e20 con 0x7fba88102ef0 2024-09-19T06:05:44.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:44.625+0000 7fba8c9b2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fba88111120 con 0x7fba88100e20 2024-09-19T06:05:44.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:44.625+0000 7fba85d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba88102570 0x7fba88199970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:44.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:44.625+0000 7fba85d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba88102570 0x7fba88199970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41678/0 (socket says 172.21.15.37:41678) 2024-09-19T06:05:44.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:44.625+0000 7fba85d9b640 1 -- 172.21.15.37:0/2038879416 learned_addr learned my addr 172.21.15.37:0/2038879416 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:05:44.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:44.625+0000 7fba8659c640 1 --2- 172.21.15.37:0/2038879416 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba88100e20 0x7fba88199430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:44.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:44.625+0000 7fba86d9d640 1 --2- 172.21.15.37:0/2038879416 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba88102ef0 0x7fba881a44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:44.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:44.626+0000 7fba85d9b640 1 -- 172.21.15.37:0/2038879416 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba88100e20 msgr2=0x7fba88199430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:44.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:44.626+0000 7fba85d9b640 1 --2- 172.21.15.37:0/2038879416 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba88100e20 0x7fba88199430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:44.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:44.626+0000 7fba85d9b640 1 -- 172.21.15.37:0/2038879416 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba88102ef0 msgr2=0x7fba881a44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:44.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:44.626+0000 7fba85d9b640 1 --2- 172.21.15.37:0/2038879416 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba88102ef0 0x7fba881a44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:44.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:44.626+0000 7fba85d9b640 1 -- 172.21.15.37:0/2038879416 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba881a49f0 con 0x7fba88102570 2024-09-19T06:05:44.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:44.626+0000 7fba85d9b640 1 --2- 172.21.15.37:0/2038879416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba88102570 0x7fba88199970 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fba7c00b4a0 tx=0x7fba7c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:44.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:44.626+0000 7fba777fe640 1 -- 172.21.15.37:0/2038879416 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba7c014070 con 0x7fba88102570 2024-09-19T06:05:44.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:44.626+0000 7fba8c9b2640 1 -- 172.21.15.37:0/2038879416 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba881a4bc0 con 0x7fba88102570 2024-09-19T06:05:44.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:44.626+0000 7fba777fe640 1 -- 172.21.15.37:0/2038879416 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba7c010af0 con 0x7fba88102570 2024-09-19T06:05:44.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:44.626+0000 7fba777fe640 1 -- 172.21.15.37:0/2038879416 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba7c017d10 con 0x7fba88102570 2024-09-19T06:05:44.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:44.626+0000 7fba8c9b2640 1 -- 172.21.15.37:0/2038879416 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba881a50d0 con 0x7fba88102570 2024-09-19T06:05:44.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:44.627+0000 7fba8c9b2640 1 -- 172.21.15.37:0/2038879416 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba88101200 con 0x7fba88102570 2024-09-19T06:05:44.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:44.628+0000 7fba777fe640 1 -- 172.21.15.37:0/2038879416 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fba7c017070 con 0x7fba88102570 2024-09-19T06:05:44.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:44.629+0000 7fba777fe640 1 --2- 172.21.15.37:0/2038879416 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fba700a32d0 0x7fba700a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:44.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:44.629+0000 7fba777fe640 1 -- 172.21.15.37:0/2038879416 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fba7c0cefd0 con 0x7fba88102570 2024-09-19T06:05:44.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:44.629+0000 7fba8659c640 1 --2- 172.21.15.37:0/2038879416 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fba700a32d0 0x7fba700a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:44.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:44.629+0000 7fba8659c640 1 --2- 172.21.15.37:0/2038879416 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fba700a32d0 0x7fba700a5790 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fba78009230 tx=0x7fba780058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:44.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:44.633+0000 7fba777fe640 1 -- 172.21.15.37:0/2038879416 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fba7c09b2f0 con 0x7fba88102570 2024-09-19T06:05:44.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:44.815+0000 7fba8c9b2640 1 -- 172.21.15.37:0/2038879416 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fba88109090 con 0x7fba88102570 2024-09-19T06:05:44.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:44.816+0000 7fba777fe640 1 -- 172.21.15.37:0/2038879416 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24726 (secure 0 0 0) 0x7fba7c09f5f0 con 0x7fba88102570 2024-09-19T06:05:44.819 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T06:05:44.819 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":89,"fsid":"b8c8bdae-764b-11ef-bceb-c7b262605968","created":"2024-09-19T05:56:22.523060+0000","modified":"2024-09-19T06:05:13.720782+0000","last_up_change":"2024-09-19T06:03:12.771014+0000","last_in_change":"2024-09-19T06:02:49.926626+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:59:27.062607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:04:01.918234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:04:04.392543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T06:04:10.877951+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"455bc11d-2b6e-4a0c-90d9-8ab4ef4f9e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1783875173},{"type":"v1","addr":"172.21.15.37:6803","nonce":1783875173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1783875173},{"type":"v1","addr":"172.21.15.37:6805","nonce":1783875173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1783875173},{"type":"v1","addr":"172.21.15.37:6809","nonce":1783875173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1783875173},{"type":"v1","addr":"172.21.15.37:6807","nonce":1783875173}]},"public_addr":"172.21.15.37:6803/1783875173","cluster_addr":"172.21.15.37:6805/1783875173","heartbeat_back_addr":"172.21.15.37:6809/1783875173","heartbeat_front_addr":"172.21.15.37:6807/1783875173","state":["exists","up"]},{"osd":1,"uuid":"3505c162-c342-479d-8ea2-15b7a9d625cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":3414373360},{"type":"v1","addr":"172.21.15.99:6801","nonce":3414373360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":3414373360},{"type":"v1","addr":"172.21.15.99:6803","nonce":3414373360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":3414373360},{"type":"v1","addr":"172.21.15.99:6807","nonce":3414373360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":3414373360},{"type":"v1","addr":"172.21.15.99:6805","nonce":3414373360}]},"public_addr":"172.21.15.99:6801/3414373360","cluster_addr":"172.21.15.99:6803/3414373360","heartbeat_back_addr":"172.21.15.99:6807/3414373360","heartbeat_front_addr":"172.21.15.99:6805/3414373360","state":["exists","up"]},{"osd":2,"uuid":"736ec67f-b5e7-43f0-9303-0c88878ead6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3794943081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3794943081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3794943081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3794943081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3794943081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3794943081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3794943081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3794943081}]},"public_addr":"172.21.15.117:6801/3794943081","cluster_addr":"172.21.15.117:6803/3794943081","heartbeat_back_addr":"172.21.15.117:6807/3794943081","heartbeat_front_addr":"172.21.15.117:6805/3794943081","state":["exists","up"]},{"osd":3,"uuid":"3f784ef7-0cc1-4c86-a03a-b8f13396c835","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2121011955},{"type":"v1","addr":"172.21.15.37:6811","nonce":2121011955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2121011955},{"type":"v1","addr":"172.21.15.37:6813","nonce":2121011955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2121011955},{"type":"v1","addr":"172.21.15.37:6817","nonce":2121011955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2121011955},{"type":"v1","addr":"172.21.15.37:6815","nonce":2121011955}]},"public_addr":"172.21.15.37:6811/2121011955","cluster_addr":"172.21.15.37:6813/2121011955","heartbeat_back_addr":"172.21.15.37:6817/2121011955","heartbeat_front_addr":"172.21.15.37:6815/2121011955","state":["exists","up"]},{"osd":4,"uuid":"d7c16e7f-f599-419b-b4a2-fd6c1cafa0d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":1881025735},{"type":"v1","addr":"172.21.15.99:6809","nonce":1881025735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1881025735},{"type":"v1","addr":"172.21.15.99:6811","nonce":1881025735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1881025735},{"type":"v1","addr":"172.21.15.99:6815","nonce":1881025735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":1881025735},{"type":"v1","addr":"172.21.15.99:6813","nonce":1881025735}]},"public_addr":"172.21.15.99:6809/1881025735","cluster_addr":"172.21.15.99:6811/1881025735","heartbeat_back_addr":"172.21.15.99:6815/1881025735","heartbeat_front_addr":"172.21.15.99:6813/1881025735","state":["exists","up"]},{"osd":5,"uuid":"2f499ab4-3d09-4f96-a709-b4229865c690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1141976511},{"type":"v1","addr":"172.21.15.117:6809","nonce":1141976511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1141976511},{"type":"v1","addr":"172.21.15.117:6811","nonce":1141976511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1141976511},{"type":"v1","addr":"172.21.15.117:6815","nonce":1141976511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1141976511},{"type":"v1","addr":"172.21.15.117:6813","nonce":1141976511}]},"public_addr":"172.21.15.117:6809/1141976511","cluster_addr":"172.21.15.117:6811/1141976511","heartbeat_back_addr":"172.21.15.117:6815/1141976511","heartbeat_front_addr":"172.21.15.117:6813/1141976511","state":["exists","up"]},{"osd":6,"uuid":"10f7fd72-1ae8-4efd-a448-75f4b5054be3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":770433145},{"type":"v1","addr":"172.21.15.37:6819","nonce":770433145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":770433145},{"type":"v1","addr":"172.21.15.37:6821","nonce":770433145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":770433145},{"type":"v1","addr":"172.21.15.37:6825","nonce":770433145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":770433145},{"type":"v1","addr":"172.21.15.37:6823","nonce":770433145}]},"public_addr":"172.21.15.37:6819/770433145","cluster_addr":"172.21.15.37:6821/770433145","heartbeat_back_addr":"172.21.15.37:6825/770433145","heartbeat_front_addr":"172.21.15.37:6823/770433145","state":["exists","up"]},{"osd":7,"uuid":"7199a267-c486-417c-b530-3ff03fc9eb1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1694360992},{"type":"v1","addr":"172.21.15.99:6817","nonce":1694360992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1694360992},{"type":"v1","addr":"172.21.15.99:6819","nonce":1694360992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":1694360992},{"type":"v1","addr":"172.21.15.99:6823","nonce":1694360992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":1694360992},{"type":"v1","addr":"172.21.15.99:6821","nonce":1694360992}]},"public_addr":"172.21.15.99:6817/1694360992","cluster_addr":"172.21.15.99:6819/1694360992","heartbeat_back_addr":"172.21.15.99:6823/1694360992","heartbeat_front_addr":"172.21.15.99:6821/1694360992","state":["exists","up"]},{"osd":8,"uuid":"8d5bb83c-62eb-4ded-8a16-e8d57ab102c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2005866772},{"type":"v1","addr":"172.21.15.117:6817","nonce":2005866772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2005866772},{"type":"v1","addr":"172.21.15.117:6819","nonce":2005866772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2005866772},{"type":"v1","addr":"172.21.15.117:6823","nonce":2005866772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2005866772},{"type":"v1","addr":"172.21.15.117:6821","nonce":2005866772}]},"public_addr":"172.21.15.117:6817/2005866772","cluster_addr":"172.21.15.117:6819/2005866772","heartbeat_back_addr":"172.21.15.117:6823/2005866772","heartbeat_front_addr":"172.21.15.117:6821/2005866772","state":["exists","up"]},{"osd":9,"uuid":"04b6203d-a10c-4a55-8e59-b30012dee02b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1398779376},{"type":"v1","addr":"172.21.15.37:6827","nonce":1398779376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1398779376},{"type":"v1","addr":"172.21.15.37:6829","nonce":1398779376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1398779376},{"type":"v1","addr":"172.21.15.37:6833","nonce":1398779376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1398779376},{"type":"v1","addr":"172.21.15.37:6831","nonce":1398779376}]},"public_addr":"172.21.15.37:6827/1398779376","cluster_addr":"172.21.15.37:6829/1398779376","heartbeat_back_addr":"172.21.15.37:6833/1398779376","heartbeat_front_addr":"172.21.15.37:6831/1398779376","state":["exists","up"]},{"osd":10,"uuid":"bbf8ff4b-29cd-4d56-a30e-ff2de3555f78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2200957302},{"type":"v1","addr":"172.21.15.99:6825","nonce":2200957302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2200957302},{"type":"v1","addr":"172.21.15.99:6827","nonce":2200957302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2200957302},{"type":"v1","addr":"172.21.15.99:6831","nonce":2200957302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2200957302},{"type":"v1","addr":"172.21.15.99:6829","nonce":2200957302}]},"public_addr":"172.21.15.99:6825/2200957302","cluster_addr":"172.21.15.99:6827/2200957302","heartbeat_back_addr":"172.21.15.99:6831/2200957302","heartbeat_front_addr":"172.21.15.99:6829/2200957302","state":["exists","up"]},{"osd":11,"uuid":"041d54f4-a274-47b5-a467-0ce86efd363b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":1354423136},{"type":"v1","addr":"172.21.15.117:6825","nonce":1354423136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":1354423136},{"type":"v1","addr":"172.21.15.117:6827","nonce":1354423136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":1354423136},{"type":"v1","addr":"172.21.15.117:6831","nonce":1354423136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":1354423136},{"type":"v1","addr":"172.21.15.117:6829","nonce":1354423136}]},"public_addr":"172.21.15.117:6825/1354423136","cluster_addr":"172.21.15.117:6827/1354423136","heartbeat_back_addr":"172.21.15.117:6831/1354423136","heartbeat_front_addr":"172.21.15.117:6829/1354423136","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:58:33.697099+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:58:59.641549+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:59:23.811178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:59:49.550214+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:00:15.034610+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:00:39.399651+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:01:05.106379+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:01:30.375956+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:01:54.881549+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:02:21.519316+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:02:46.125918+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:03:11.310862+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.f","mappings":[{"from":9,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6801/133577710":"2024-09-20T05:57:12.560771+0000","172.21.15.37:6800/133577710":"2024-09-20T05:57:12.560771+0000","172.21.15.37:0/2877363162":"2024-09-20T05:57:12.560771+0000","172.21.15.37:0/1053171617":"2024-09-20T05:57:12.560771+0000","172.21.15.37:6800/3277805697":"2024-09-20T05:56:49.335334+0000","172.21.15.37:0/1280697705":"2024-09-20T05:56:49.335334+0000","172.21.15.37:0/1106526058":"2024-09-20T05:57:12.560771+0000","172.21.15.37:0/1978184693":"2024-09-20T05:56:49.335334+0000","172.21.15.37:6801/3277805697":"2024-09-20T05:56:49.335334+0000","172.21.15.37:0/3650338877":"2024-09-20T05:56:49.335334+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:05:44.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:44.818+0000 7fba8c9b2640 1 -- 172.21.15.37:0/2038879416 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fba700a32d0 msgr2=0x7fba700a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:44.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:44.818+0000 7fba8c9b2640 1 --2- 172.21.15.37:0/2038879416 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fba700a32d0 0x7fba700a5790 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fba78009230 tx=0x7fba780058d0 comp rx=0 tx=0).stop 2024-09-19T06:05:44.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:44.818+0000 7fba8c9b2640 1 -- 172.21.15.37:0/2038879416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba88102570 msgr2=0x7fba88199970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:44.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:44.818+0000 7fba8c9b2640 1 --2- 172.21.15.37:0/2038879416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba88102570 0x7fba88199970 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fba7c00b4a0 tx=0x7fba7c00b960 comp rx=0 tx=0).stop 2024-09-19T06:05:44.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:44.819+0000 7fba8c9b2640 1 -- 172.21.15.37:0/2038879416 shutdown_connections 2024-09-19T06:05:44.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:44.819+0000 7fba8c9b2640 1 --2- 172.21.15.37:0/2038879416 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fba700a32d0 0x7fba700a5790 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:44.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:44.819+0000 7fba8c9b2640 1 --2- 172.21.15.37:0/2038879416 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba88102ef0 0x7fba881a44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:44.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:44.819+0000 7fba8c9b2640 1 --2- 172.21.15.37:0/2038879416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba88102570 0x7fba88199970 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:44.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:44.819+0000 7fba8c9b2640 1 --2- 172.21.15.37:0/2038879416 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba88100e20 0x7fba88199430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:44.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:44.819+0000 7fba8c9b2640 1 -- 172.21.15.37:0/2038879416 >> 172.21.15.37:0/2038879416 conn(0x7fba880fc7d0 msgr2=0x7fba880febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:44.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:44.819+0000 7fba8c9b2640 1 -- 172.21.15.37:0/2038879416 shutdown_connections 2024-09-19T06:05:44.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:44.819+0000 7fba8c9b2640 1 -- 172.21.15.37:0/2038879416 wait complete. 2024-09-19T06:05:45.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:44 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/2038879416' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:05:45.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:44 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/2038879416' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:05:45.302 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:44 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/2038879416' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:05:45.617 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:05:45.882 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:05:46.162 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:45 smithi037 ceph-mon[31211]: pgmap v335: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:05:46.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:45 smithi099 ceph-mon[35300]: pgmap v335: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:05:46.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:45 smithi117 ceph-mon[35050]: pgmap v335: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:05:46.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:46.361+0000 7fc8bdea0640 1 -- 172.21.15.37:0/652547990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8b81082a0 msgr2=0x7fc8b810ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:46.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:46.361+0000 7fc8bdea0640 1 --2- 172.21.15.37:0/652547990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8b81082a0 0x7fc8b810ec40 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0009cd0 tx=0x7fc8b002a8e0 comp rx=0 tx=0).stop 2024-09-19T06:05:46.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:46.362+0000 7fc8bdea0640 1 -- 172.21.15.37:0/652547990 shutdown_connections 2024-09-19T06:05:46.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:46.362+0000 7fc8bdea0640 1 --2- 172.21.15.37:0/652547990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8b81082a0 0x7fc8b810ec40 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:46.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:46.362+0000 7fc8bdea0640 1 --2- 172.21.15.37:0/652547990 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8b81036e0 0x7fc8b8107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:46.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:46.362+0000 7fc8bdea0640 1 --2- 172.21.15.37:0/652547990 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8b8102d30 0x7fc8b8103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:46.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:46.362+0000 7fc8bdea0640 1 -- 172.21.15.37:0/652547990 >> 172.21.15.37:0/652547990 conn(0x7fc8b80fc7d0 msgr2=0x7fc8b80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:46.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:46.362+0000 7fc8bdea0640 1 -- 172.21.15.37:0/652547990 shutdown_connections 2024-09-19T06:05:46.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:46.362+0000 7fc8bdea0640 1 -- 172.21.15.37:0/652547990 wait complete. 2024-09-19T06:05:46.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:46.362+0000 7fc8bdea0640 1 Processor -- start 2024-09-19T06:05:46.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:46.362+0000 7fc8bdea0640 1 -- start start 2024-09-19T06:05:46.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:46.363+0000 7fc8bdea0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8b8102d30 0x7fc8b8198630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:46.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:46.363+0000 7fc8bdea0640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8b81036e0 0x7fc8b8198b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:46.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:46.363+0000 7fc8bdea0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8b81082a0 0x7fc8b819cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:46.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:46.363+0000 7fc8bdea0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b81120f0 con 0x7fc8b8102d30 2024-09-19T06:05:46.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:46.363+0000 7fc8bdea0640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b8111f70 con 0x7fc8b81036e0 2024-09-19T06:05:46.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:46.363+0000 7fc8bdea0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b8112270 con 0x7fc8b81082a0 2024-09-19T06:05:46.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:46.363+0000 7fc8b77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8b8102d30 0x7fc8b8198630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:46.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:46.363+0000 7fc8b77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8b8102d30 0x7fc8b8198630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41708/0 (socket says 172.21.15.37:41708) 2024-09-19T06:05:46.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:46.363+0000 7fc8b77fe640 1 -- 172.21.15.37:0/812600501 learned_addr learned my addr 172.21.15.37:0/812600501 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:05:46.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:46.363+0000 7fc8aeffd640 1 --2- 172.21.15.37:0/812600501 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8b81036e0 0x7fc8b8198b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:46.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:46.363+0000 7fc8b7fff640 1 --2- 172.21.15.37:0/812600501 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8b81082a0 0x7fc8b819cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:46.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:46.363+0000 7fc8b77fe640 1 -- 172.21.15.37:0/812600501 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8b81082a0 msgr2=0x7fc8b819cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:46.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:46.363+0000 7fc8b77fe640 1 --2- 172.21.15.37:0/812600501 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8b81082a0 0x7fc8b819cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:46.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:46.363+0000 7fc8b77fe640 1 -- 172.21.15.37:0/812600501 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8b81036e0 msgr2=0x7fc8b8198b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:46.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:46.363+0000 7fc8b77fe640 1 --2- 172.21.15.37:0/812600501 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8b81036e0 0x7fc8b8198b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:46.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:46.363+0000 7fc8b77fe640 1 -- 172.21.15.37:0/812600501 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8b819d5e0 con 0x7fc8b8102d30 2024-09-19T06:05:46.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:46.363+0000 7fc8b77fe640 1 --2- 172.21.15.37:0/812600501 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8b8102d30 0x7fc8b8198630 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc8a800c890 tx=0x7fc8a800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:46.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:46.364+0000 7fc8b57fa640 1 -- 172.21.15.37:0/812600501 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a8004220 con 0x7fc8b8102d30 2024-09-19T06:05:46.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:46.364+0000 7fc8b57fa640 1 -- 172.21.15.37:0/812600501 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc8a80043c0 con 0x7fc8b8102d30 2024-09-19T06:05:46.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:46.364+0000 7fc8bdea0640 1 -- 172.21.15.37:0/812600501 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8b819d8d0 con 0x7fc8b8102d30 2024-09-19T06:05:46.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:46.364+0000 7fc8b57fa640 1 -- 172.21.15.37:0/812600501 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a80049e0 con 0x7fc8b8102d30 2024-09-19T06:05:46.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:46.364+0000 7fc8bdea0640 1 -- 172.21.15.37:0/812600501 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8b81a51b0 con 0x7fc8b8102d30 2024-09-19T06:05:46.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:46.365+0000 7fc8bdea0640 1 -- 172.21.15.37:0/812600501 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8b8103110 con 0x7fc8b8102d30 2024-09-19T06:05:46.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:46.367+0000 7fc8b57fa640 1 -- 172.21.15.37:0/812600501 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fc8a80079b0 con 0x7fc8b8102d30 2024-09-19T06:05:46.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:46.368+0000 7fc8b57fa640 1 --2- 172.21.15.37:0/812600501 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fc8a40a32d0 0x7fc8a40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:46.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:46.368+0000 7fc8b57fa640 1 -- 172.21.15.37:0/812600501 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fc8a80cff70 con 0x7fc8b8102d30 2024-09-19T06:05:46.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:46.368+0000 7fc8aeffd640 1 --2- 172.21.15.37:0/812600501 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fc8a40a32d0 0x7fc8a40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:46.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:46.369+0000 7fc8aeffd640 1 --2- 172.21.15.37:0/812600501 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fc8a40a32d0 0x7fc8a40a5790 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc8b8107440 tx=0x7fc8a000a250 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:46.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:46.371+0000 7fc8b57fa640 1 -- 172.21.15.37:0/812600501 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc8a8014030 con 0x7fc8b8102d30 2024-09-19T06:05:46.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:46.587+0000 7fc8bdea0640 1 -- 172.21.15.37:0/812600501 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc8b8199990 con 0x7fc8b8102d30 2024-09-19T06:05:46.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:46.588+0000 7fc8b57fa640 1 -- 172.21.15.37:0/812600501 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11842 (secure 0 0 0) 0x7fc8b8199990 con 0x7fc8b8102d30 2024-09-19T06:05:46.590 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T06:05:46.590 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"btime":"2024-09-19T06:04:42:531480+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14514,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2864247978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2864247978},{"type":"v1","addr":"172.21.15.37:6835","nonce":2864247978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14526,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/633000932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":633000932},{"type":"v1","addr":"172.21.15.37:6837","nonce":633000932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14574,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/3753800615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":3753800615},{"type":"v1","addr":"172.21.15.37:6839","nonce":3753800615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/2718998355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":2718998355},{"type":"v1","addr":"172.21.15.37:6841","nonce":2718998355}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6833/866590207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":866590207},{"type":"v1","addr":"172.21.15.99:6833","nonce":866590207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3898668400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3898668400},{"type":"v1","addr":"172.21.15.117:6833","nonce":3898668400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2650673320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2650673320},{"type":"v1","addr":"172.21.15.99:6835","nonce":2650673320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1097471349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1097471349},{"type":"v1","addr":"172.21.15.117:6835","nonce":1097471349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24457,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1001392672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1001392672},{"type":"v1","addr":"172.21.15.117:6837","nonce":1001392672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/23570935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":23570935},{"type":"v1","addr":"172.21.15.99:6837","nonce":23570935}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:04:06.253034+0000","modified":"2024-09-19T06:04:42.196783+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24485},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24478":{"gid":24478,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6839/1269518339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":1269518339},{"type":"v1","addr":"172.21.15.117:6839","nonce":1269518339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.99:6839/3404812329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":3404812329},{"type":"v1","addr":"172.21.15.99:6839","nonce":3404812329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24485,"qdb_cluster":[24485]},"id":1}]} 2024-09-19T06:05:46.591 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 20 2024-09-19T06:05:46.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:46.590+0000 7fc8bdea0640 1 -- 172.21.15.37:0/812600501 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fc8a40a32d0 msgr2=0x7fc8a40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:46.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:46.590+0000 7fc8bdea0640 1 --2- 172.21.15.37:0/812600501 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fc8a40a32d0 0x7fc8a40a5790 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc8b8107440 tx=0x7fc8a000a250 comp rx=0 tx=0).stop 2024-09-19T06:05:46.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:46.590+0000 7fc8bdea0640 1 -- 172.21.15.37:0/812600501 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8b8102d30 msgr2=0x7fc8b8198630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:46.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:46.590+0000 7fc8bdea0640 1 --2- 172.21.15.37:0/812600501 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8b8102d30 0x7fc8b8198630 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc8a800c890 tx=0x7fc8a800cd50 comp rx=0 tx=0).stop 2024-09-19T06:05:46.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:46.590+0000 7fc8bdea0640 1 -- 172.21.15.37:0/812600501 shutdown_connections 2024-09-19T06:05:46.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:46.590+0000 7fc8bdea0640 1 --2- 172.21.15.37:0/812600501 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fc8a40a32d0 0x7fc8a40a5790 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:46.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:46.590+0000 7fc8bdea0640 1 --2- 172.21.15.37:0/812600501 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8b81036e0 0x7fc8b8198b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:46.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:46.590+0000 7fc8bdea0640 1 --2- 172.21.15.37:0/812600501 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8b81082a0 0x7fc8b819cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:46.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:46.590+0000 7fc8bdea0640 1 --2- 172.21.15.37:0/812600501 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8b8102d30 0x7fc8b8198630 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:46.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:46.590+0000 7fc8bdea0640 1 -- 172.21.15.37:0/812600501 >> 172.21.15.37:0/812600501 conn(0x7fc8b80fc7d0 msgr2=0x7fc8b80fe3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:46.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:46.590+0000 7fc8bdea0640 1 -- 172.21.15.37:0/812600501 shutdown_connections 2024-09-19T06:05:46.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:46.590+0000 7fc8bdea0640 1 -- 172.21.15.37:0/812600501 wait complete. 2024-09-19T06:05:47.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:46 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/812600501' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:05:47.242 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:46 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/812600501' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:05:47.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:46 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/812600501' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:05:47.272 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 20, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T06:04:06.253034+0000', 'modified': '2024-09-19T06:04:42.196783+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24485}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24478': {'gid': 24478, 'name': 'i', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.117:6839/1269518339', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6838', 'nonce': 1269518339}, {'type': 'v1', 'addr': '172.21.15.117:6839', 'nonce': 1269518339}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24485': {'gid': 24485, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.99:6839/3404812329', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6838', 'nonce': 3404812329}, {'type': 'v1', 'addr': '172.21.15.99:6839', 'nonce': 3404812329}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24485, 'qdb_cluster': [24485]} 2024-09-19T06:05:47.272 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-19T06:05:47.272 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-19T06:05:47.532 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:05:48.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.004+0000 7f793a84d640 1 -- 172.21.15.37:0/3506041538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7934102790 msgr2=0x7f79341067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:48.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.004+0000 7f793a84d640 1 --2- 172.21.15.37:0/3506041538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7934102790 0x7f79341067e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f791c009900 tx=0x7f791c02a410 comp rx=0 tx=0).stop 2024-09-19T06:05:48.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.004+0000 7f793a84d640 1 -- 172.21.15.37:0/3506041538 shutdown_connections 2024-09-19T06:05:48.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.004+0000 7f793a84d640 1 --2- 172.21.15.37:0/3506041538 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7934106f10 0x7f793410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:48.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.004+0000 7f793a84d640 1 --2- 172.21.15.37:0/3506041538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7934102790 0x7f79341067e0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:48.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.004+0000 7f793a84d640 1 --2- 172.21.15.37:0/3506041538 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7934101de0 0x7f79341021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:48.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.004+0000 7f793a84d640 1 -- 172.21.15.37:0/3506041538 >> 172.21.15.37:0/3506041538 conn(0x7f79340fd8c0 msgr2=0x7f79340ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:48.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.004+0000 7f793a84d640 1 -- 172.21.15.37:0/3506041538 shutdown_connections 2024-09-19T06:05:48.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.004+0000 7f793a84d640 1 -- 172.21.15.37:0/3506041538 wait complete. 2024-09-19T06:05:48.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.005+0000 7f793a84d640 1 Processor -- start 2024-09-19T06:05:48.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.005+0000 7f793a84d640 1 -- start start 2024-09-19T06:05:48.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.005+0000 7f793a84d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7934101de0 0x7f7934198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:48.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.005+0000 7f793a84d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7934102790 0x7f7934198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:48.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.005+0000 7f793a84d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7934106f10 0x7f793419ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:48.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.005+0000 7f793a84d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7934111f90 con 0x7f7934102790 2024-09-19T06:05:48.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.005+0000 7f793a84d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f7934111e10 con 0x7f7934101de0 2024-09-19T06:05:48.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.005+0000 7f793a84d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7934112110 con 0x7f7934106f10 2024-09-19T06:05:48.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.005+0000 7f792bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7934102790 0x7f7934198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:48.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.005+0000 7f792bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7934102790 0x7f7934198a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41732/0 (socket says 172.21.15.37:41732) 2024-09-19T06:05:48.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.005+0000 7f792bfff640 1 -- 172.21.15.37:0/4138713266 learned_addr learned my addr 172.21.15.37:0/4138713266 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:05:48.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.005+0000 7f7938dea640 1 --2- 172.21.15.37:0/4138713266 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7934106f10 0x7f793419ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:48.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.005+0000 7f7933fff640 1 --2- 172.21.15.37:0/4138713266 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7934101de0 0x7f7934198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:48.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.006+0000 7f792bfff640 1 -- 172.21.15.37:0/4138713266 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7934106f10 msgr2=0x7f793419ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:48.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.006+0000 7f792bfff640 1 --2- 172.21.15.37:0/4138713266 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7934106f10 0x7f793419ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:48.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.006+0000 7f792bfff640 1 -- 172.21.15.37:0/4138713266 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7934101de0 msgr2=0x7f7934198550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:48.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.006+0000 7f792bfff640 1 --2- 172.21.15.37:0/4138713266 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7934101de0 0x7f7934198550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:48.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.006+0000 7f792bfff640 1 -- 172.21.15.37:0/4138713266 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f793419d500 con 0x7f7934102790 2024-09-19T06:05:48.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.006+0000 7f792bfff640 1 --2- 172.21.15.37:0/4138713266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7934102790 0x7f7934198a90 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f791c005ab0 tx=0x7f791c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:48.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.006+0000 7f7931ffb640 1 -- 172.21.15.37:0/4138713266 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f791c03f030 con 0x7f7934102790 2024-09-19T06:05:48.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.006+0000 7f7931ffb640 1 -- 172.21.15.37:0/4138713266 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f791c003ce0 con 0x7f7934102790 2024-09-19T06:05:48.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.006+0000 7f7931ffb640 1 -- 172.21.15.37:0/4138713266 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f791c035070 con 0x7f7934102790 2024-09-19T06:05:48.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.006+0000 7f793a84d640 1 -- 172.21.15.37:0/4138713266 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f793419d790 con 0x7f7934102790 2024-09-19T06:05:48.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.006+0000 7f793a84d640 1 -- 172.21.15.37:0/4138713266 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79341a50d0 con 0x7f7934102790 2024-09-19T06:05:48.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.008+0000 7f7931ffb640 1 -- 172.21.15.37:0/4138713266 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f791c042030 con 0x7f7934102790 2024-09-19T06:05:48.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.009+0000 7f793cc26740 1 Processor -- start 2024-09-19T06:05:48.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.009+0000 7f793cc26740 1 -- start start 2024-09-19T06:05:48.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.009+0000 7f793cc26740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5637790358d0 0x563779035cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:48.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.009+0000 7f793cc26740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5637790361f0 0x563779044a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:48.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.009+0000 7f793cc26740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563779044fc0 0x5637790473b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:48.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.009+0000 7f793cc26740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563778f9c090 con 0x563779044fc0 2024-09-19T06:05:48.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.009+0000 7f793cc26740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x563778f43a70 con 0x5637790358d0 2024-09-19T06:05:48.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.009+0000 7f793cc26740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x563778f98050 con 0x5637790361f0 2024-09-19T06:05:48.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.009+0000 7f792bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563779044fc0 0x5637790473b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:48.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.009+0000 7f7931ffb640 1 --2- 172.21.15.37:0/4138713266 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f79200a3350 0x7f79200a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:48.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.009+0000 7f792bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563779044fc0 0x5637790473b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41748/0 (socket says 172.21.15.37:41748) 2024-09-19T06:05:48.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.009+0000 7f792bfff640 1 -- 172.21.15.37:0/3152510783 learned_addr learned my addr 172.21.15.37:0/3152510783 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:05:48.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.009+0000 7f7933fff640 1 --2- 172.21.15.37:0/3152510783 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5637790361f0 0x563779044a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:48.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.009+0000 7f7938dea640 1 --2- 172.21.15.37:0/4138713266 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f79200a3350 0x7f79200a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:48.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.010+0000 7f7938dea640 1 --2- 172.21.15.37:0/3152510783 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5637790358d0 0x563779035cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:48.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.010+0000 7f7931ffb640 1 -- 172.21.15.37:0/4138713266 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f791c0f02a0 con 0x7f7934102790 2024-09-19T06:05:48.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.010+0000 7f7933fff640 1 -- 172.21.15.37:0/3152510783 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5637790358d0 msgr2=0x563779035cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:05:48.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.010+0000 7f7933fff640 1 --2- 172.21.15.37:0/3152510783 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5637790358d0 0x563779035cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:48.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.010+0000 7f7933fff640 1 -- 172.21.15.37:0/3152510783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563779044fc0 msgr2=0x5637790473b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:05:48.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.010+0000 7f7933fff640 1 --2- 172.21.15.37:0/3152510783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563779044fc0 0x5637790473b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:48.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.010+0000 7f7933fff640 1 -- 172.21.15.37:0/3152510783 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563778f50130 con 0x5637790361f0 2024-09-19T06:05:48.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.010+0000 7f7933fff640 1 --2- 172.21.15.37:0/3152510783 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5637790361f0 0x563779044a80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f79240099a0 tx=0x7f7924009e60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d3d1c3b591e53ff server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:48.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.010+0000 7f7938dea640 1 --2- 172.21.15.37:0/4138713266 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f79200a3350 0x7f79200a5810 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f792c005c40 tx=0x7f792c005bd0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:48.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.010+0000 7f792a7fc640 1 -- 172.21.15.37:0/3152510783 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7924017070 con 0x5637790361f0 2024-09-19T06:05:48.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.010+0000 7f792a7fc640 1 -- 172.21.15.37:0/3152510783 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7924013470 con 0x5637790361f0 2024-09-19T06:05:48.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.010+0000 7f792a7fc640 1 -- 172.21.15.37:0/3152510783 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7924012610 con 0x5637790361f0 2024-09-19T06:05:48.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.011+0000 7f793cc26740 1 -- 172.21.15.37:0/3152510783 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5637790361f0 msgr2=0x563779044a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:48.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.011+0000 7f793cc26740 1 --2- 172.21.15.37:0/3152510783 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5637790361f0 0x563779044a80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f79240099a0 tx=0x7f7924009e60 comp rx=0 tx=0).stop 2024-09-19T06:05:48.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.011+0000 7f793cc26740 1 -- 172.21.15.37:0/3152510783 shutdown_connections 2024-09-19T06:05:48.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.011+0000 7f793cc26740 1 --2- 172.21.15.37:0/3152510783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563779044fc0 0x5637790473b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:48.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.011+0000 7f793cc26740 1 --2- 172.21.15.37:0/3152510783 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5637790361f0 0x563779044a80 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:48.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.011+0000 7f793cc26740 1 --2- 172.21.15.37:0/3152510783 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5637790358d0 0x563779035cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:48.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.011+0000 7f793cc26740 1 -- 172.21.15.37:0/3152510783 >> 172.21.15.37:0/3152510783 conn(0x563779031f60 msgr2=0x563779032340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:48.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.011+0000 7f793cc26740 1 -- 172.21.15.37:0/3152510783 shutdown_connections 2024-09-19T06:05:48.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.011+0000 7f793cc26740 1 -- 172.21.15.37:0/3152510783 wait complete. 2024-09-19T06:05:48.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.011+0000 7f793cc26740 1 -- start start 2024-09-19T06:05:48.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.012+0000 7f793cc26740 1 Processor -- start 2024-09-19T06:05:48.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.012+0000 7f793cc26740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5637790358d0 0x563779044810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:48.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.012+0000 7f793cc26740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5637790361f0 0x563779041b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:48.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.012+0000 7f793cc26740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563779044fc0 0x5637790420a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:48.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.012+0000 7f793cc26740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563779047bf0 con 0x5637790361f0 2024-09-19T06:05:48.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.012+0000 7f793cc26740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x563778f56f20 con 0x563779044fc0 2024-09-19T06:05:48.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.012+0000 7f793cc26740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x563779047d70 con 0x5637790358d0 2024-09-19T06:05:48.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.012+0000 7f793cc26740 10 client.0 _ll_register_callbacks cb 0x563778f20030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:05:48.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.012+0000 7f792bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5637790361f0 0x563779041b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:48.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.012+0000 7f792bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5637790361f0 0x563779041b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41756/0 (socket says 172.21.15.37:41756) 2024-09-19T06:05:48.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.012+0000 7f792bfff640 1 -- 172.21.15.37:0/1910423335 learned_addr learned my addr 172.21.15.37:0/1910423335 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:05:48.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.012+0000 7f7933fff640 1 --2- 172.21.15.37:0/1910423335 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5637790358d0 0x563779044810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:48.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.012+0000 7f7938dea640 1 --2- 172.21.15.37:0/1910423335 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563779044fc0 0x5637790420a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:48.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.012+0000 7f792bfff640 1 -- 172.21.15.37:0/1910423335 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5637790358d0 msgr2=0x563779044810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:05:48.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.012+0000 7f792bfff640 1 --2- 172.21.15.37:0/1910423335 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5637790358d0 0x563779044810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:48.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.012+0000 7f792bfff640 1 -- 172.21.15.37:0/1910423335 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563779044fc0 msgr2=0x5637790420a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:05:48.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.012+0000 7f792bfff640 1 --2- 172.21.15.37:0/1910423335 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563779044fc0 0x5637790420a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:48.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.012+0000 7f792bfff640 1 -- 172.21.15.37:0/1910423335 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563778d0d2b0 con 0x5637790361f0 2024-09-19T06:05:48.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.012+0000 7f7938dea640 1 --2- 172.21.15.37:0/1910423335 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563779044fc0 0x5637790420a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:05:48.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.012+0000 7f7933fff640 1 --2- 172.21.15.37:0/1910423335 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5637790358d0 0x563779044810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:05:48.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.013+0000 7f792bfff640 1 --2- 172.21.15.37:0/1910423335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5637790361f0 0x563779041b60 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f791c0c4ae0 tx=0x7f791c003e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c61c038a99ec413c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:48.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.013+0000 7f79137fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-19T06:05:48.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.013+0000 7f79137fe640 1 -- 172.21.15.37:0/1910423335 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f791c049070 con 0x5637790361f0 2024-09-19T06:05:48.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.013+0000 7f79137fe640 1 -- 172.21.15.37:0/1910423335 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f791c0b8a10 con 0x5637790361f0 2024-09-19T06:05:48.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.013+0000 7f793cc26740 1 -- 172.21.15.37:0/1910423335 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7924013470 con 0x5637790361f0 2024-09-19T06:05:48.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.013+0000 7f79137fe640 1 -- 172.21.15.37:0/1910423335 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f791c0bbd00 con 0x5637790361f0 2024-09-19T06:05:48.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.013+0000 7f793cc26740 10 client.15036 fetch_fsmap learned FSMap version 20 2024-09-19T06:05:48.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.013+0000 7f793cc26740 1 -- 172.21.15.37:0/1910423335 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x563779053500 con 0x5637790361f0 2024-09-19T06:05:48.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.013+0000 7f79137fe640 1 -- 172.21.15.37:0/1910423335 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7924013470 con 0x5637790361f0 2024-09-19T06:05:48.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.013+0000 7f79137fe640 1 -- 172.21.15.37:0/1910423335 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 20) ==== 8338+0+0 (secure 0 0 0) 0x7f791c0d5200 con 0x5637790361f0 2024-09-19T06:05:48.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.013+0000 7f793cc26740 10 client.15036 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:05:48.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.014+0000 7f793cc26740 10 client.15036 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T06:05:48.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.014+0000 7f793cc26740 20 client.15036 populate_metadata read hostname 'smithi037' 2024-09-19T06:05:48.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.014+0000 7f793cc26740 1 --2- 172.21.15.37:0/1910423335 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x563779055b00 0x563779056f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:48.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.014+0000 7f793cc26740 4 client.15036 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:05:48.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.014+0000 7f793cc26740 1 -- 172.21.15.37:0/1910423335 --> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563778fa9600 con 0x563779055b00 2024-09-19T06:05:48.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.014+0000 7f7933fff640 1 --2- 172.21.15.37:0/1910423335 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x563779055b00 0x563779056f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:48.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.014+0000 7f7933fff640 1 --2- 172.21.15.37:0/1910423335 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x563779055b00 0x563779056f70 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=baae71d13aade7bd server_cookie=3e526cea31903e83 in_seq=0 out_seq=0 2024-09-19T06:05:48.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.014+0000 7f79137fe640 10 client.15036 ms_handle_connect on v2:172.21.15.99:6838/3404812329 2024-09-19T06:05:48.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.015+0000 7f79137fe640 1 -- 172.21.15.37:0/1910423335 <== mds.0 v2:172.21.15.99:6838/3404812329 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563778fa9600 con 0x563779055b00 2024-09-19T06:05:48.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.015+0000 7f79137fe640 10 client.15036 handle_command_reply: tid=0 2024-09-19T06:05:48.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.015+0000 7f793cc26740 1 client.15036 shutdown 2024-09-19T06:05:48.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.015+0000 7f793cc26740 1 -- 172.21.15.37:0/1910423335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5637790361f0 msgr2=0x563779041b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:48.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.015+0000 7f793cc26740 1 --2- 172.21.15.37:0/1910423335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5637790361f0 0x563779041b60 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f791c0c4ae0 tx=0x7f791c003e90 comp rx=0 tx=0).stop 2024-09-19T06:05:48.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.015+0000 7f793cc26740 1 -- 172.21.15.37:0/1910423335 shutdown_connections 2024-09-19T06:05:48.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.015+0000 7f793cc26740 1 --2- 172.21.15.37:0/1910423335 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x563779055b00 0x563779056f70 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:48.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.015+0000 7f79137fe640 0 client.15036 ms_handle_reset on v2:172.21.15.99:6838/3404812329 2024-09-19T06:05:48.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.015+0000 7f793cc26740 1 --2- 172.21.15.37:0/1910423335 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563779044fc0 0x5637790420a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:48.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.015+0000 7f793cc26740 1 --2- 172.21.15.37:0/1910423335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5637790361f0 0x563779041b60 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:48.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.015+0000 7f793cc26740 1 --2- 172.21.15.37:0/1910423335 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5637790358d0 0x563779044810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:48.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.015+0000 7f793cc26740 1 -- 172.21.15.37:0/1910423335 >> 172.21.15.37:0/1910423335 conn(0x563779031f60 msgr2=0x563779037c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:48.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.015+0000 7f793cc26740 1 -- 172.21.15.37:0/1910423335 shutdown_connections 2024-09-19T06:05:48.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.015+0000 7f793cc26740 1 -- 172.21.15.37:0/1910423335 wait complete. 2024-09-19T06:05:48.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.016+0000 7f793cc26740 20 client.15036 trim_cache size 0 max 16384 2024-09-19T06:05:48.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.033+0000 7f793cc26740 1 Processor -- start 2024-09-19T06:05:48.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.033+0000 7f793cc26740 1 -- start start 2024-09-19T06:05:48.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.033+0000 7f793cc26740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5637790358d0 0x563779055430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:48.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.033+0000 7f793cc26740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5637790361f0 0x563779056f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:48.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.033+0000 7f793cc26740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563779044fc0 0x563779036a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:48.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.033+0000 7f793cc26740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5637790552b0 con 0x563779044fc0 2024-09-19T06:05:48.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.033+0000 7f793cc26740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x563779055980 con 0x5637790361f0 2024-09-19T06:05:48.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.033+0000 7f793cc26740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x563779056050 con 0x5637790358d0 2024-09-19T06:05:48.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.034+0000 7f7938dea640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563779044fc0 0x563779036a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:48.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.034+0000 7f7938dea640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563779044fc0 0x563779036a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41772/0 (socket says 172.21.15.37:41772) 2024-09-19T06:05:48.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.034+0000 7f7938dea640 1 -- 172.21.15.37:0/2277136385 learned_addr learned my addr 172.21.15.37:0/2277136385 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:05:48.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.034+0000 7f7933fff640 1 --2- 172.21.15.37:0/2277136385 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5637790358d0 0x563779055430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:48.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.034+0000 7f792bfff640 1 --2- 172.21.15.37:0/2277136385 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5637790361f0 0x563779056f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:48.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.034+0000 7f7938dea640 1 -- 172.21.15.37:0/2277136385 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5637790358d0 msgr2=0x563779055430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:05:48.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.034+0000 7f7938dea640 1 --2- 172.21.15.37:0/2277136385 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5637790358d0 0x563779055430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:48.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.034+0000 7f7938dea640 1 -- 172.21.15.37:0/2277136385 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5637790361f0 msgr2=0x563779056f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:05:48.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.034+0000 7f7938dea640 1 --2- 172.21.15.37:0/2277136385 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5637790361f0 0x563779056f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:48.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.034+0000 7f7938dea640 1 -- 172.21.15.37:0/2277136385 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563779036020 con 0x563779044fc0 2024-09-19T06:05:48.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.034+0000 7f7938dea640 1 --2- 172.21.15.37:0/2277136385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563779044fc0 0x563779036a20 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f792c00e940 tx=0x7f792c00a4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=306cc65228edfeac server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:48.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.034+0000 7f7929ffb640 1 -- 172.21.15.37:0/2277136385 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f792c024030 con 0x563779044fc0 2024-09-19T06:05:48.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.034+0000 7f7929ffb640 1 -- 172.21.15.37:0/2277136385 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f792c0109b0 con 0x563779044fc0 2024-09-19T06:05:48.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.034+0000 7f7929ffb640 1 -- 172.21.15.37:0/2277136385 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f792c018040 con 0x563779044fc0 2024-09-19T06:05:48.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.035+0000 7f793cc26740 1 -- 172.21.15.37:0/2277136385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563779044fc0 msgr2=0x563779036a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:48.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.035+0000 7f793cc26740 1 --2- 172.21.15.37:0/2277136385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563779044fc0 0x563779036a20 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f792c00e940 tx=0x7f792c00a4d0 comp rx=0 tx=0).stop 2024-09-19T06:05:48.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.035+0000 7f793cc26740 1 -- 172.21.15.37:0/2277136385 shutdown_connections 2024-09-19T06:05:48.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.035+0000 7f793cc26740 1 --2- 172.21.15.37:0/2277136385 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5637790361f0 0x563779056f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:48.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.035+0000 7f793cc26740 1 --2- 172.21.15.37:0/2277136385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563779044fc0 0x563779036a20 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:48.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.035+0000 7f793cc26740 1 --2- 172.21.15.37:0/2277136385 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5637790358d0 0x563779055430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:48.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.035+0000 7f793cc26740 1 -- 172.21.15.37:0/2277136385 >> 172.21.15.37:0/2277136385 conn(0x563779031f60 msgr2=0x563779032340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:48.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.035+0000 7f793cc26740 1 -- 172.21.15.37:0/2277136385 shutdown_connections 2024-09-19T06:05:48.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.035+0000 7f793cc26740 1 -- 172.21.15.37:0/2277136385 wait complete. 2024-09-19T06:05:48.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.035+0000 7f793cc26740 1 -- start start 2024-09-19T06:05:48.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.036+0000 7f793cc26740 1 Processor -- start 2024-09-19T06:05:48.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.036+0000 7f793cc26740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5637790358d0 0x563779058170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:48.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.036+0000 7f793cc26740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5637790361f0 0x5637790586b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:48.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.036+0000 7f793cc26740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563779044fc0 0x563779058bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:48.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.036+0000 7f793cc26740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563779056df0 con 0x5637790361f0 2024-09-19T06:05:48.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.036+0000 7f793cc26740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x563779056720 con 0x563779044fc0 2024-09-19T06:05:48.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.036+0000 7f793cc26740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5637790574c0 con 0x5637790358d0 2024-09-19T06:05:48.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.036+0000 7f793cc26740 10 client.0 _ll_register_callbacks cb 0x7f791c005b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:05:48.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.036+0000 7f792bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5637790361f0 0x5637790586b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:48.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.036+0000 7f792bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5637790361f0 0x5637790586b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41788/0 (socket says 172.21.15.37:41788) 2024-09-19T06:05:48.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.036+0000 7f792bfff640 1 -- 172.21.15.37:0/1150790104 learned_addr learned my addr 172.21.15.37:0/1150790104 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:05:48.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.036+0000 7f7933fff640 1 --2- 172.21.15.37:0/1150790104 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5637790358d0 0x563779058170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:48.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.036+0000 7f7938dea640 1 --2- 172.21.15.37:0/1150790104 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563779044fc0 0x563779058bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:48.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.036+0000 7f792bfff640 1 -- 172.21.15.37:0/1150790104 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5637790358d0 msgr2=0x563779058170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:05:48.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.036+0000 7f792bfff640 1 --2- 172.21.15.37:0/1150790104 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5637790358d0 0x563779058170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:48.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.036+0000 7f792bfff640 1 -- 172.21.15.37:0/1150790104 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563779044fc0 msgr2=0x563779058bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:05:48.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.036+0000 7f792bfff640 1 --2- 172.21.15.37:0/1150790104 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563779044fc0 0x563779058bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:48.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.036+0000 7f792bfff640 1 -- 172.21.15.37:0/1150790104 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637790be230 con 0x5637790361f0 2024-09-19T06:05:48.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.037+0000 7f792bfff640 1 --2- 172.21.15.37:0/1150790104 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5637790361f0 0x5637790586b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f791c000c00 tx=0x7f791c0b8c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53a8b7ce84d5299a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:48.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.037+0000 7f79137fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-19T06:05:48.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.037+0000 7f79137fe640 1 -- 172.21.15.37:0/1150790104 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f791c049040 con 0x5637790361f0 2024-09-19T06:05:48.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.037+0000 7f79137fe640 1 -- 172.21.15.37:0/1150790104 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f791c0bc800 con 0x5637790361f0 2024-09-19T06:05:48.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.037+0000 7f793cc26740 1 -- 172.21.15.37:0/1150790104 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f792c0109b0 con 0x5637790361f0 2024-09-19T06:05:48.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.037+0000 7f79137fe640 1 -- 172.21.15.37:0/1150790104 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f791c0bcaa0 con 0x5637790361f0 2024-09-19T06:05:48.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.037+0000 7f793cc26740 10 client.15042 fetch_fsmap learned FSMap version 20 2024-09-19T06:05:48.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.037+0000 7f793cc26740 1 -- 172.21.15.37:0/1150790104 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5637790bf530 con 0x5637790361f0 2024-09-19T06:05:48.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.037+0000 7f79137fe640 1 -- 172.21.15.37:0/1150790104 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f792c0109b0 con 0x5637790361f0 2024-09-19T06:05:48.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.037+0000 7f79137fe640 1 -- 172.21.15.37:0/1150790104 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 20) ==== 8338+0+0 (secure 0 0 0) 0x7f791c0c4b80 con 0x5637790361f0 2024-09-19T06:05:48.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.037+0000 7f793cc26740 10 client.15042 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:05:48.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.037+0000 7f793cc26740 10 client.15042 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T06:05:48.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.037+0000 7f793cc26740 20 client.15042 populate_metadata read hostname 'smithi037' 2024-09-19T06:05:48.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.037+0000 7f793cc26740 1 --2- 172.21.15.37:0/1150790104 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x563779055b00 0x5637790c2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:48.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.037+0000 7f793cc26740 4 client.15042 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T06:05:48.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.037+0000 7f793cc26740 1 -- 172.21.15.37:0/1150790104 --> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] -- command(tid 0: {"prefix": "status"}) -- 0x563778fa3b10 con 0x563779055b00 2024-09-19T06:05:48.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.038+0000 7f7933fff640 1 --2- 172.21.15.37:0/1150790104 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x563779055b00 0x5637790c2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:48.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.038+0000 7f7933fff640 1 --2- 172.21.15.37:0/1150790104 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x563779055b00 0x5637790c2be0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9319e5f04628eb74 server_cookie=907c4d4bdf7e9bb8 in_seq=0 out_seq=0 2024-09-19T06:05:48.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.038+0000 7f79137fe640 10 client.15042 ms_handle_connect on v2:172.21.15.99:6838/3404812329 2024-09-19T06:05:48.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.038+0000 7f79137fe640 1 -- 172.21.15.37:0/1150790104 <== mds.0 v2:172.21.15.99:6838/3404812329 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x563778fa3b10 con 0x563779055b00 2024-09-19T06:05:48.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.038+0000 7f79137fe640 10 client.15042 handle_command_reply: tid=0 2024-09-19T06:05:48.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.038+0000 7f793cc26740 1 client.15042 shutdown 2024-09-19T06:05:48.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.038+0000 7f793cc26740 1 -- 172.21.15.37:0/1150790104 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5637790361f0 msgr2=0x5637790586b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:48.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.038+0000 7f793cc26740 1 --2- 172.21.15.37:0/1150790104 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5637790361f0 0x5637790586b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f791c000c00 tx=0x7f791c0b8c40 comp rx=0 tx=0).stop 2024-09-19T06:05:48.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.039+0000 7f793cc26740 1 -- 172.21.15.37:0/1150790104 shutdown_connections 2024-09-19T06:05:48.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.039+0000 7f793cc26740 1 --2- 172.21.15.37:0/1150790104 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x563779055b00 0x5637790c2be0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:48.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.039+0000 7f793cc26740 1 --2- 172.21.15.37:0/1150790104 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563779044fc0 0x563779058bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:48.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.039+0000 7f793cc26740 1 --2- 172.21.15.37:0/1150790104 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5637790361f0 0x5637790586b0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:48.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.039+0000 7f793cc26740 1 --2- 172.21.15.37:0/1150790104 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5637790358d0 0x563779058170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:48.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.039+0000 7f793cc26740 1 -- 172.21.15.37:0/1150790104 >> 172.21.15.37:0/1150790104 conn(0x563779031f60 msgr2=0x5637790402c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:48.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.039+0000 7f79137fe640 0 client.15042 ms_handle_reset on v2:172.21.15.99:6838/3404812329 2024-09-19T06:05:48.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.039+0000 7f793cc26740 1 -- 172.21.15.37:0/1150790104 shutdown_connections 2024-09-19T06:05:48.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.039+0000 7f793cc26740 1 -- 172.21.15.37:0/1150790104 wait complete. 2024-09-19T06:05:48.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.039+0000 7f793cc26740 20 client.15042 trim_cache size 0 max 16384 2024-09-19T06:05:48.048 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-19T06:05:48.048 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "b8c8bdae-764b-11ef-bceb-c7b262605968", 2024-09-19T06:05:48.048 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2024-09-19T06:05:48.048 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 24485, 2024-09-19T06:05:48.048 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-09-19T06:05:48.048 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-09-19T06:05:48.048 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-09-19T06:05:48.048 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 101.628332341, 2024-09-19T06:05:48.048 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 20, 2024-09-19T06:05:48.048 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 89, 2024-09-19T06:05:48.048 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 87, 2024-09-19T06:05:48.048 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 112.86578773399999 2024-09-19T06:05:48.049 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-19T06:05:48.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.039+0000 7f793a84d640 1 -- 172.21.15.37:0/4138713266 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f79200a3350 msgr2=0x7f79200a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:48.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.039+0000 7f793a84d640 1 --2- 172.21.15.37:0/4138713266 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f79200a3350 0x7f79200a5810 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f792c005c40 tx=0x7f792c005bd0 comp rx=0 tx=0).stop 2024-09-19T06:05:48.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.039+0000 7f793a84d640 1 -- 172.21.15.37:0/4138713266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7934102790 msgr2=0x7f7934198a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:48.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.039+0000 7f793a84d640 1 --2- 172.21.15.37:0/4138713266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7934102790 0x7f7934198a90 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f791c005ab0 tx=0x7f791c0042f0 comp rx=0 tx=0).stop 2024-09-19T06:05:48.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.039+0000 7f793a84d640 1 -- 172.21.15.37:0/4138713266 shutdown_connections 2024-09-19T06:05:48.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.039+0000 7f793a84d640 1 --2- 172.21.15.37:0/4138713266 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f79200a3350 0x7f79200a5810 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:48.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.039+0000 7f793a84d640 1 --2- 172.21.15.37:0/4138713266 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7934106f10 0x7f793419ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:48.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.039+0000 7f793a84d640 1 --2- 172.21.15.37:0/4138713266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7934102790 0x7f7934198a90 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:48.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.039+0000 7f793a84d640 1 --2- 172.21.15.37:0/4138713266 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7934101de0 0x7f7934198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:48.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.039+0000 7f793a84d640 1 -- 172.21.15.37:0/4138713266 >> 172.21.15.37:0/4138713266 conn(0x7f79340fd8c0 msgr2=0x7f79340fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:48.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.040+0000 7f793a84d640 1 -- 172.21.15.37:0/4138713266 shutdown_connections 2024-09-19T06:05:48.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:48.040+0000 7f793a84d640 1 -- 172.21.15.37:0/4138713266 wait complete. 2024-09-19T06:05:48.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:47 smithi099 ceph-mon[35300]: pgmap v336: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:05:48.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:47 smithi117 ceph-mon[35050]: pgmap v336: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:05:48.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:47 smithi037 ceph-mon[31211]: pgmap v336: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:05:49.010 INFO:tasks.cephadm:Setup complete, yielding 2024-09-19T06:05:49.010 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T06:05:49.020 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi037.front.sepia.ceph.com 2024-09-19T06:05:49.020 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- bash -c 'ceph orch status' 2024-09-19T06:05:49.283 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:05:49.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:49.763+0000 7f8e9f6ef640 1 -- 172.21.15.37:0/2730592118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e98074c50 msgr2=0x7f8e980750b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:49.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:49.763+0000 7f8e9f6ef640 1 --2- 172.21.15.37:0/2730592118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e98074c50 0x7f8e980750b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8e88009900 tx=0x7f8e8802a410 comp rx=0 tx=0).stop 2024-09-19T06:05:49.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:49.763+0000 7f8e9f6ef640 1 -- 172.21.15.37:0/2730592118 shutdown_connections 2024-09-19T06:05:49.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:49.763+0000 7f8e9f6ef640 1 --2- 172.21.15.37:0/2730592118 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8e9810e1e0 0x7f8e981105d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:49.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:49.763+0000 7f8e9f6ef640 1 --2- 172.21.15.37:0/2730592118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e98074c50 0x7f8e980750b0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:49.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:49.763+0000 7f8e9f6ef640 1 --2- 172.21.15.37:0/2730592118 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8e98076220 0x7f8e98074680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:49.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:49.763+0000 7f8e9f6ef640 1 -- 172.21.15.37:0/2730592118 >> 172.21.15.37:0/2730592118 conn(0x7f8e980fd390 msgr2=0x7f8e980ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:49.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:49.763+0000 7f8e9f6ef640 1 -- 172.21.15.37:0/2730592118 shutdown_connections 2024-09-19T06:05:49.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:49.763+0000 7f8e9f6ef640 1 -- 172.21.15.37:0/2730592118 wait complete. 2024-09-19T06:05:49.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:49.764+0000 7f8e9f6ef640 1 Processor -- start 2024-09-19T06:05:49.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:49.764+0000 7f8e9f6ef640 1 -- start start 2024-09-19T06:05:49.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:49.764+0000 7f8e9f6ef640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8e98074c50 0x7f8e9819e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:49.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:49.764+0000 7f8e9f6ef640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8e98076220 0x7f8e9819ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:49.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:49.764+0000 7f8e9f6ef640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e9810e1e0 0x7f8e981a5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:49.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:49.764+0000 7f8e9f6ef640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8e98113f00 con 0x7f8e9810e1e0 2024-09-19T06:05:49.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:49.764+0000 7f8e9f6ef640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f8e98113d80 con 0x7f8e98074c50 2024-09-19T06:05:49.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:49.764+0000 7f8e9f6ef640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8e98114080 con 0x7f8e98076220 2024-09-19T06:05:49.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:49.764+0000 7f8e9dc8c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e9810e1e0 0x7f8e981a5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:49.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:49.764+0000 7f8e9dc8c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e9810e1e0 0x7f8e981a5b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41796/0 (socket says 172.21.15.37:41796) 2024-09-19T06:05:49.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:49.764+0000 7f8e9dc8c640 1 -- 172.21.15.37:0/1178012827 learned_addr learned my addr 172.21.15.37:0/1178012827 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:05:49.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:49.764+0000 7f8e9d48b640 1 --2- 172.21.15.37:0/1178012827 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8e98074c50 0x7f8e9819e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:49.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:49.764+0000 7f8e9cc8a640 1 --2- 172.21.15.37:0/1178012827 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8e98076220 0x7f8e9819ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:49.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:49.764+0000 7f8e9dc8c640 1 -- 172.21.15.37:0/1178012827 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8e98076220 msgr2=0x7f8e9819ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:49.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:49.764+0000 7f8e9dc8c640 1 --2- 172.21.15.37:0/1178012827 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8e98076220 0x7f8e9819ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:49.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:49.764+0000 7f8e9dc8c640 1 -- 172.21.15.37:0/1178012827 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8e98074c50 msgr2=0x7f8e9819e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:49.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:49.764+0000 7f8e9dc8c640 1 --2- 172.21.15.37:0/1178012827 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8e98074c50 0x7f8e9819e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:49.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:49.764+0000 7f8e9dc8c640 1 -- 172.21.15.37:0/1178012827 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e981a6180 con 0x7f8e9810e1e0 2024-09-19T06:05:49.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:49.765+0000 7f8e9dc8c640 1 --2- 172.21.15.37:0/1178012827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e9810e1e0 0x7f8e981a5b10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f8e9000b970 tx=0x7f8e9000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:49.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:49.765+0000 7f8e8e7fc640 1 -- 172.21.15.37:0/1178012827 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e90019070 con 0x7f8e9810e1e0 2024-09-19T06:05:49.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:49.765+0000 7f8e9f6ef640 1 -- 172.21.15.37:0/1178012827 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e981a6470 con 0x7f8e9810e1e0 2024-09-19T06:05:49.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:49.765+0000 7f8e8e7fc640 1 -- 172.21.15.37:0/1178012827 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e9000cb40 con 0x7f8e9810e1e0 2024-09-19T06:05:49.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:49.765+0000 7f8e9f6ef640 1 -- 172.21.15.37:0/1178012827 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e981a6a50 con 0x7f8e9810e1e0 2024-09-19T06:05:49.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:49.765+0000 7f8e8e7fc640 1 -- 172.21.15.37:0/1178012827 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e90007610 con 0x7f8e9810e1e0 2024-09-19T06:05:49.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:49.766+0000 7f8e9f6ef640 1 -- 172.21.15.37:0/1178012827 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e981043b0 con 0x7f8e9810e1e0 2024-09-19T06:05:49.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:49.767+0000 7f8e8e7fc640 1 -- 172.21.15.37:0/1178012827 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f8e9001c070 con 0x7f8e9810e1e0 2024-09-19T06:05:49.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:49.768+0000 7f8e8e7fc640 1 --2- 172.21.15.37:0/1178012827 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f8e840a3380 0x7f8e840a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:49.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:49.768+0000 7f8e9d48b640 1 --2- 172.21.15.37:0/1178012827 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f8e840a3380 0x7f8e840a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:49.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:49.768+0000 7f8e8e7fc640 1 -- 172.21.15.37:0/1178012827 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f8e900cf1b0 con 0x7f8e9810e1e0 2024-09-19T06:05:49.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:49.768+0000 7f8e9d48b640 1 --2- 172.21.15.37:0/1178012827 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f8e840a3380 0x7f8e840a5840 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8e940058c0 tx=0x7f8e9400a2d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:49.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:49.772+0000 7f8e8e7fc640 1 -- 172.21.15.37:0/1178012827 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8e9009b4d0 con 0x7f8e9810e1e0 2024-09-19T06:05:49.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:49.965+0000 7f8e9f6ef640 1 -- 172.21.15.37:0/1178012827 --> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f8e98062630 con 0x7f8e840a3380 2024-09-19T06:05:49.967 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:49 smithi037 ceph-mon[31211]: pgmap v337: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:05:49.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:49.966+0000 7f8e8e7fc640 1 -- 172.21.15.37:0/1178012827 <== mgr.14148 v2:172.21.15.37:6800/3797010169 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f8e98062630 con 0x7f8e840a3380 2024-09-19T06:05:49.968 INFO:teuthology.orchestra.run.smithi037.stdout:Backend: cephadm 2024-09-19T06:05:49.968 INFO:teuthology.orchestra.run.smithi037.stdout:Available: Yes 2024-09-19T06:05:49.969 INFO:teuthology.orchestra.run.smithi037.stdout:Paused: No 2024-09-19T06:05:49.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:49.969+0000 7f8e9f6ef640 1 -- 172.21.15.37:0/1178012827 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f8e840a3380 msgr2=0x7f8e840a5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:49.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:49.969+0000 7f8e9f6ef640 1 --2- 172.21.15.37:0/1178012827 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f8e840a3380 0x7f8e840a5840 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8e940058c0 tx=0x7f8e9400a2d0 comp rx=0 tx=0).stop 2024-09-19T06:05:49.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:49.969+0000 7f8e9f6ef640 1 -- 172.21.15.37:0/1178012827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e9810e1e0 msgr2=0x7f8e981a5b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:49.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:49.969+0000 7f8e9f6ef640 1 --2- 172.21.15.37:0/1178012827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e9810e1e0 0x7f8e981a5b10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f8e9000b970 tx=0x7f8e9000be30 comp rx=0 tx=0).stop 2024-09-19T06:05:49.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:49.969+0000 7f8e9f6ef640 1 -- 172.21.15.37:0/1178012827 shutdown_connections 2024-09-19T06:05:49.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:49.969+0000 7f8e9f6ef640 1 --2- 172.21.15.37:0/1178012827 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f8e840a3380 0x7f8e840a5840 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:49.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:49.969+0000 7f8e9f6ef640 1 --2- 172.21.15.37:0/1178012827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e9810e1e0 0x7f8e981a5b10 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:49.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:49.969+0000 7f8e9f6ef640 1 --2- 172.21.15.37:0/1178012827 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8e98076220 0x7f8e9819ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:49.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:49.969+0000 7f8e9f6ef640 1 --2- 172.21.15.37:0/1178012827 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8e98074c50 0x7f8e9819e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:49.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:49.969+0000 7f8e9f6ef640 1 -- 172.21.15.37:0/1178012827 >> 172.21.15.37:0/1178012827 conn(0x7f8e980fd390 msgr2=0x7f8e98101580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:49.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:49.969+0000 7f8e9f6ef640 1 -- 172.21.15.37:0/1178012827 shutdown_connections 2024-09-19T06:05:49.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:49.969+0000 7f8e9f6ef640 1 -- 172.21.15.37:0/1178012827 wait complete. 2024-09-19T06:05:50.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:49 smithi099 ceph-mon[35300]: pgmap v337: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:05:50.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:49 smithi117 ceph-mon[35050]: pgmap v337: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:05:50.710 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-19T06:05:50.972 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:05:51.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:50 smithi099 ceph-mon[35300]: from='client.15048 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:05:51.244 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:50 smithi037 ceph-mon[31211]: from='client.15048 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:05:51.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:50 smithi117 ceph-mon[35050]: from='client.15048 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:05:51.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:51.480+0000 7f7d03385640 1 -- 172.21.15.37:0/296668321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cfc104f90 msgr2=0x7f7cfc107380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:51.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:51.480+0000 7f7d03385640 1 --2- 172.21.15.37:0/296668321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cfc104f90 0x7f7cfc107380 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f7cec009900 tx=0x7f7cec02a410 comp rx=0 tx=0).stop 2024-09-19T06:05:51.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:51.480+0000 7f7d03385640 1 -- 172.21.15.37:0/296668321 shutdown_connections 2024-09-19T06:05:51.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:51.480+0000 7f7d03385640 1 --2- 172.21.15.37:0/296668321 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7cfc1078c0 0x7f7cfc109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:51.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:51.480+0000 7f7d03385640 1 --2- 172.21.15.37:0/296668321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cfc104f90 0x7f7cfc107380 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:51.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:51.480+0000 7f7d03385640 1 --2- 172.21.15.37:0/296668321 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7cfc102660 0x7f7cfc104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:51.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:51.480+0000 7f7d03385640 1 -- 172.21.15.37:0/296668321 >> 172.21.15.37:0/296668321 conn(0x7f7cfc0fc280 msgr2=0x7f7cfc0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:51.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:51.480+0000 7f7d03385640 1 -- 172.21.15.37:0/296668321 shutdown_connections 2024-09-19T06:05:51.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:51.480+0000 7f7d03385640 1 -- 172.21.15.37:0/296668321 wait complete. 2024-09-19T06:05:51.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:51.481+0000 7f7d03385640 1 Processor -- start 2024-09-19T06:05:51.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:51.481+0000 7f7d03385640 1 -- start start 2024-09-19T06:05:51.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:51.481+0000 7f7d03385640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7cfc102660 0x7f7cfc19a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:51.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:51.481+0000 7f7d03385640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cfc104f90 0x7f7cfc19a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:51.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:51.481+0000 7f7d03385640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7cfc1078c0 0x7f7cfc1a1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:51.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:51.481+0000 7f7d03385640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7cfc10d860 con 0x7f7cfc104f90 2024-09-19T06:05:51.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:51.481+0000 7f7d03385640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f7cfc10d6e0 con 0x7f7cfc1078c0 2024-09-19T06:05:51.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:51.481+0000 7f7d03385640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7cfc10d9e0 con 0x7f7cfc102660 2024-09-19T06:05:51.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:51.481+0000 7f7d00920640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cfc104f90 0x7f7cfc19a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:51.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:51.481+0000 7f7d00920640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cfc104f90 0x7f7cfc19a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41814/0 (socket says 172.21.15.37:41814) 2024-09-19T06:05:51.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:51.481+0000 7f7d00920640 1 -- 172.21.15.37:0/3261295851 learned_addr learned my addr 172.21.15.37:0/3261295851 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:05:51.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:51.481+0000 7f7d00920640 1 -- 172.21.15.37:0/3261295851 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7cfc102660 msgr2=0x7f7cfc19a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:51.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:51.481+0000 7f7d01121640 1 --2- 172.21.15.37:0/3261295851 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7cfc102660 0x7f7cfc19a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:51.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:51.481+0000 7f7d00920640 1 --2- 172.21.15.37:0/3261295851 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7cfc102660 0x7f7cfc19a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:51.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:51.481+0000 7f7d00920640 1 -- 172.21.15.37:0/3261295851 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7cfc1078c0 msgr2=0x7f7cfc1a1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:51.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:51.481+0000 7f7d00920640 1 --2- 172.21.15.37:0/3261295851 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7cfc1078c0 0x7f7cfc1a1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:51.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:51.481+0000 7f7d00920640 1 -- 172.21.15.37:0/3261295851 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cfc1a1d80 con 0x7f7cfc104f90 2024-09-19T06:05:51.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:51.481+0000 7f7d00920640 1 --2- 172.21.15.37:0/3261295851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cfc104f90 0x7f7cfc19a690 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f7cec031610 tx=0x7f7cec004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:51.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:51.482+0000 7f7cf27fc640 1 -- 172.21.15.37:0/3261295851 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cec03f030 con 0x7f7cfc104f90 2024-09-19T06:05:51.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:51.482+0000 7f7cf27fc640 1 -- 172.21.15.37:0/3261295851 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7cec003ad0 con 0x7f7cfc104f90 2024-09-19T06:05:51.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:51.482+0000 7f7cf27fc640 1 -- 172.21.15.37:0/3261295851 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cec035070 con 0x7f7cfc104f90 2024-09-19T06:05:51.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:51.482+0000 7f7d03385640 1 -- 172.21.15.37:0/3261295851 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cfc1a2010 con 0x7f7cfc104f90 2024-09-19T06:05:51.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:51.482+0000 7f7d03385640 1 -- 172.21.15.37:0/3261295851 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cfc1a24a0 con 0x7f7cfc104f90 2024-09-19T06:05:51.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:51.483+0000 7f7d03385640 1 -- 172.21.15.37:0/3261295851 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cfc109410 con 0x7f7cfc104f90 2024-09-19T06:05:51.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:51.485+0000 7f7cf27fc640 1 -- 172.21.15.37:0/3261295851 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f7cec042030 con 0x7f7cfc104f90 2024-09-19T06:05:51.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:51.485+0000 7f7cf27fc640 1 --2- 172.21.15.37:0/3261295851 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f7ce80a3380 0x7f7ce80a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:51.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:51.485+0000 7f7d01121640 1 --2- 172.21.15.37:0/3261295851 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f7ce80a3380 0x7f7ce80a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:51.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:51.485+0000 7f7cf27fc640 1 -- 172.21.15.37:0/3261295851 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f7cec0f0790 con 0x7f7cfc104f90 2024-09-19T06:05:51.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:51.486+0000 7f7d01121640 1 --2- 172.21.15.37:0/3261295851 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f7ce80a3380 0x7f7ce80a5840 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7cf8009aa0 tx=0x7f7cf8005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:51.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:51.488+0000 7f7cf27fc640 1 -- 172.21.15.37:0/3261295851 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7cec0bcff0 con 0x7f7cfc104f90 2024-09-19T06:05:51.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:51.674+0000 7f7d03385640 1 -- 172.21.15.37:0/3261295851 --> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f7cfc062630 con 0x7f7ce80a3380 2024-09-19T06:05:51.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:51.686+0000 7f7cf27fc640 1 -- 172.21.15.37:0/3261295851 <== mgr.14148 v2:172.21.15.37:6800/3797010169 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4154 (secure 0 0 0) 0x7f7cfc062630 con 0x7f7ce80a3380 2024-09-19T06:05:51.688 INFO:teuthology.orchestra.run.smithi037.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T06:05:51.689 INFO:teuthology.orchestra.run.smithi037.stdout:mds.a smithi037 running (119s) 49s ago 119s 13.5M - 19.1.1-361-g2f599a46 d2baa855c067 2e1b94af7032 2024-09-19T06:05:51.689 INFO:teuthology.orchestra.run.smithi037.stdout:mds.b smithi099 running (116s) 49s ago 116s 28.5M - 19.1.1-361-g2f599a46 d2baa855c067 3620b432be0d 2024-09-19T06:05:51.689 INFO:teuthology.orchestra.run.smithi037.stdout:mds.c smithi117 running (2m) 49s ago 2m 14.1M - 19.1.1-361-g2f599a46 d2baa855c067 5eacfd090aec 2024-09-19T06:05:51.689 INFO:teuthology.orchestra.run.smithi037.stdout:mds.d smithi037 running (2m) 49s ago 2m 14.4M - 19.1.1-361-g2f599a46 d2baa855c067 a98194e40add 2024-09-19T06:05:51.689 INFO:teuthology.orchestra.run.smithi037.stdout:mds.e smithi099 running (2m) 49s ago 2m 14.4M - 19.1.1-361-g2f599a46 d2baa855c067 89344c0a6c60 2024-09-19T06:05:51.689 INFO:teuthology.orchestra.run.smithi037.stdout:mds.f smithi117 running (2m) 49s ago 2m 14.2M - 19.1.1-361-g2f599a46 d2baa855c067 1d97abc4ce75 2024-09-19T06:05:51.689 INFO:teuthology.orchestra.run.smithi037.stdout:mds.g smithi037 running (2m) 49s ago 2m 15.7M - 19.1.1-361-g2f599a46 d2baa855c067 303106ce620b 2024-09-19T06:05:51.689 INFO:teuthology.orchestra.run.smithi037.stdout:mds.h smithi099 running (2m) 49s ago 2m 15.9M - 19.1.1-361-g2f599a46 d2baa855c067 991db6a336b6 2024-09-19T06:05:51.689 INFO:teuthology.orchestra.run.smithi037.stdout:mds.i smithi117 running (2m) 49s ago 2m 18.3M - 19.1.1-361-g2f599a46 d2baa855c067 c4a6e6593f4b 2024-09-19T06:05:51.689 INFO:teuthology.orchestra.run.smithi037.stdout:mds.j smithi037 running (2m) 49s ago 2m 13.5M - 19.1.1-361-g2f599a46 d2baa855c067 6a8c6eb360b5 2024-09-19T06:05:51.689 INFO:teuthology.orchestra.run.smithi037.stdout:mds.k smithi099 running (2m) 49s ago 2m 15.9M - 19.1.1-361-g2f599a46 d2baa855c067 10770bcb93c1 2024-09-19T06:05:51.689 INFO:teuthology.orchestra.run.smithi037.stdout:mds.l smithi117 running (2m) 49s ago 2m 14.5M - 19.1.1-361-g2f599a46 d2baa855c067 3fac02c7c848 2024-09-19T06:05:51.689 INFO:teuthology.orchestra.run.smithi037.stdout:mgr.x smithi037 *:9283,8765 running (9m) 49s ago 9m 508M - 19.1.1-361-g2f599a46 d2baa855c067 404ceebffacf 2024-09-19T06:05:51.689 INFO:teuthology.orchestra.run.smithi037.stdout:mgr.y smithi099 *:8443,8765 running (7m) 49s ago 7m 442M - 19.1.1-361-g2f599a46 d2baa855c067 41de606078ec 2024-09-19T06:05:51.690 INFO:teuthology.orchestra.run.smithi037.stdout:mgr.z smithi117 *:8443,8765 running (7m) 49s ago 7m 444M - 19.1.1-361-g2f599a46 d2baa855c067 adb3e14db55e 2024-09-19T06:05:51.690 INFO:teuthology.orchestra.run.smithi037.stdout:mon.a smithi037 running (9m) 49s ago 9m 49.0M 2048M 19.1.1-361-g2f599a46 d2baa855c067 916a85ee7b21 2024-09-19T06:05:51.690 INFO:teuthology.orchestra.run.smithi037.stdout:mon.b smithi099 running (7m) 49s ago 7m 39.1M 2048M 19.1.1-361-g2f599a46 d2baa855c067 19e1b3a28475 2024-09-19T06:05:51.690 INFO:teuthology.orchestra.run.smithi037.stdout:mon.c smithi117 running (8m) 49s ago 8m 38.5M 2048M 19.1.1-361-g2f599a46 d2baa855c067 c427aab2cd0b 2024-09-19T06:05:51.690 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0 smithi037 running (7m) 49s ago 7m 45.7M 4273M 19.1.1-361-g2f599a46 d2baa855c067 9b68ffdf327c 2024-09-19T06:05:51.690 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1 smithi099 running (6m) 49s ago 6m 46.7M 4272M 19.1.1-361-g2f599a46 d2baa855c067 409f7bdf7f97 2024-09-19T06:05:51.690 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2 smithi117 running (6m) 49s ago 6m 47.0M 4272M 19.1.1-361-g2f599a46 d2baa855c067 f49356cbcf32 2024-09-19T06:05:51.690 INFO:teuthology.orchestra.run.smithi037.stdout:osd.3 smithi037 running (6m) 49s ago 6m 52.2M 4273M 19.1.1-361-g2f599a46 d2baa855c067 f1fa334c09d9 2024-09-19T06:05:51.690 INFO:teuthology.orchestra.run.smithi037.stdout:osd.4 smithi099 running (5m) 49s ago 5m 43.1M 4272M 19.1.1-361-g2f599a46 d2baa855c067 b605011ee64f 2024-09-19T06:05:51.690 INFO:teuthology.orchestra.run.smithi037.stdout:osd.5 smithi117 running (5m) 49s ago 5m 44.4M 4272M 19.1.1-361-g2f599a46 d2baa855c067 531b4ea4f7fa 2024-09-19T06:05:51.690 INFO:teuthology.orchestra.run.smithi037.stdout:osd.6 smithi037 running (4m) 49s ago 4m 42.2M 4273M 19.1.1-361-g2f599a46 d2baa855c067 031c46ad9181 2024-09-19T06:05:51.690 INFO:teuthology.orchestra.run.smithi037.stdout:osd.7 smithi099 running (4m) 49s ago 4m 51.8M 4272M 19.1.1-361-g2f599a46 d2baa855c067 bf6fc8373575 2024-09-19T06:05:51.690 INFO:teuthology.orchestra.run.smithi037.stdout:osd.8 smithi117 running (4m) 49s ago 4m 46.6M 4272M 19.1.1-361-g2f599a46 d2baa855c067 bddfe45a26c8 2024-09-19T06:05:51.690 INFO:teuthology.orchestra.run.smithi037.stdout:osd.9 smithi037 running (3m) 49s ago 3m 42.6M 4273M 19.1.1-361-g2f599a46 d2baa855c067 edb926ddda6b 2024-09-19T06:05:51.691 INFO:teuthology.orchestra.run.smithi037.stdout:osd.10 smithi099 running (3m) 49s ago 3m 54.2M 4272M 19.1.1-361-g2f599a46 d2baa855c067 15900c6330fc 2024-09-19T06:05:51.691 INFO:teuthology.orchestra.run.smithi037.stdout:osd.11 smithi117 running (2m) 49s ago 2m 41.7M 4272M 19.1.1-361-g2f599a46 d2baa855c067 ddcaba36e239 2024-09-19T06:05:51.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:51.688+0000 7f7d03385640 1 -- 172.21.15.37:0/3261295851 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f7ce80a3380 msgr2=0x7f7ce80a5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:51.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:51.688+0000 7f7d03385640 1 --2- 172.21.15.37:0/3261295851 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f7ce80a3380 0x7f7ce80a5840 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7cf8009aa0 tx=0x7f7cf8005f90 comp rx=0 tx=0).stop 2024-09-19T06:05:51.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:51.688+0000 7f7d03385640 1 -- 172.21.15.37:0/3261295851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cfc104f90 msgr2=0x7f7cfc19a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:51.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:51.688+0000 7f7d03385640 1 --2- 172.21.15.37:0/3261295851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cfc104f90 0x7f7cfc19a690 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f7cec031610 tx=0x7f7cec004270 comp rx=0 tx=0).stop 2024-09-19T06:05:51.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:51.689+0000 7f7d03385640 1 -- 172.21.15.37:0/3261295851 shutdown_connections 2024-09-19T06:05:51.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:51.689+0000 7f7d03385640 1 --2- 172.21.15.37:0/3261295851 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f7ce80a3380 0x7f7ce80a5840 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:51.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:51.689+0000 7f7d03385640 1 --2- 172.21.15.37:0/3261295851 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7cfc1078c0 0x7f7cfc1a1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:51.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:51.689+0000 7f7d03385640 1 --2- 172.21.15.37:0/3261295851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cfc104f90 0x7f7cfc19a690 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:51.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:51.689+0000 7f7d03385640 1 --2- 172.21.15.37:0/3261295851 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7cfc102660 0x7f7cfc19a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:51.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:51.689+0000 7f7d03385640 1 -- 172.21.15.37:0/3261295851 >> 172.21.15.37:0/3261295851 conn(0x7f7cfc0fc280 msgr2=0x7f7cfc101de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:51.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:51.689+0000 7f7d03385640 1 -- 172.21.15.37:0/3261295851 shutdown_connections 2024-09-19T06:05:51.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:51.689+0000 7f7d03385640 1 -- 172.21.15.37:0/3261295851 wait complete. 2024-09-19T06:05:52.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:51 smithi099 ceph-mon[35300]: pgmap v338: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:05:52.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:51 smithi117 ceph-mon[35050]: pgmap v338: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:05:52.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:51 smithi037 ceph-mon[31211]: pgmap v338: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:05:52.428 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-19T06:05:52.688 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:05:53.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:52 smithi037 ceph-mon[31211]: from='client.15054 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:05:53.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:53.186+0000 7f7bb13a3640 1 -- 172.21.15.37:0/3944645596 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bac101cd0 msgr2=0x7f7bac102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:53.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:53.186+0000 7f7bb13a3640 1 --2- 172.21.15.37:0/3944645596 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bac101cd0 0x7f7bac102150 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f7b94009900 tx=0x7f7b9402a410 comp rx=0 tx=0).stop 2024-09-19T06:05:53.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:53.187+0000 7f7bb13a3640 1 -- 172.21.15.37:0/3944645596 shutdown_connections 2024-09-19T06:05:53.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:53.187+0000 7f7bb13a3640 1 --2- 172.21.15.37:0/3944645596 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bac102690 0x7f7bac108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:53.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:53.187+0000 7f7bb13a3640 1 --2- 172.21.15.37:0/3944645596 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bac101cd0 0x7f7bac102150 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:53.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:53.187+0000 7f7bb13a3640 1 --2- 172.21.15.37:0/3944645596 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7bac100ad0 0x7f7bac100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:53.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:53.187+0000 7f7bb13a3640 1 -- 172.21.15.37:0/3944645596 >> 172.21.15.37:0/3944645596 conn(0x7f7bac0fc280 msgr2=0x7f7bac0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:53.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:53.187+0000 7f7bb13a3640 1 -- 172.21.15.37:0/3944645596 shutdown_connections 2024-09-19T06:05:53.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:53.187+0000 7f7bb13a3640 1 -- 172.21.15.37:0/3944645596 wait complete. 2024-09-19T06:05:53.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:53.187+0000 7f7bb13a3640 1 Processor -- start 2024-09-19T06:05:53.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:53.187+0000 7f7bb13a3640 1 -- start start 2024-09-19T06:05:53.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:53.187+0000 7f7bb13a3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7bac100ad0 0x7f7bac197e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:53.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:53.187+0000 7f7bb13a3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bac101cd0 0x7f7bac1983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:53.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:53.187+0000 7f7bb13a3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bac102690 0x7f7bac19f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:53.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:53.188+0000 7f7bb13a3640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7bac10d880 con 0x7f7bac101cd0 2024-09-19T06:05:53.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:53.188+0000 7f7bb13a3640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f7bac10d700 con 0x7f7bac100ad0 2024-09-19T06:05:53.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:53.188+0000 7f7bb13a3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7bac10da00 con 0x7f7bac102690 2024-09-19T06:05:53.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:53.188+0000 7f7baa7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bac101cd0 0x7f7bac1983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:53.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:53.188+0000 7f7baa7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bac101cd0 0x7f7bac1983c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41826/0 (socket says 172.21.15.37:41826) 2024-09-19T06:05:53.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:53.188+0000 7f7baa7fc640 1 -- 172.21.15.37:0/2098450025 learned_addr learned my addr 172.21.15.37:0/2098450025 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:05:53.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:53.188+0000 7f7baaffd640 1 --2- 172.21.15.37:0/2098450025 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7bac100ad0 0x7f7bac197e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:53.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:53.188+0000 7f7bab7fe640 1 --2- 172.21.15.37:0/2098450025 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bac102690 0x7f7bac19f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:53.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:53.188+0000 7f7baa7fc640 1 -- 172.21.15.37:0/2098450025 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bac102690 msgr2=0x7f7bac19f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:53.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:53.188+0000 7f7baa7fc640 1 --2- 172.21.15.37:0/2098450025 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bac102690 0x7f7bac19f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:53.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:53.188+0000 7f7baa7fc640 1 -- 172.21.15.37:0/2098450025 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7bac100ad0 msgr2=0x7f7bac197e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:53.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:53.188+0000 7f7baa7fc640 1 --2- 172.21.15.37:0/2098450025 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7bac100ad0 0x7f7bac197e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:53.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:53.188+0000 7f7baa7fc640 1 -- 172.21.15.37:0/2098450025 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bac19fab0 con 0x7f7bac101cd0 2024-09-19T06:05:53.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:53.188+0000 7f7baa7fc640 1 --2- 172.21.15.37:0/2098450025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bac101cd0 0x7f7bac1983c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7b94009230 tx=0x7f7b94004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:53.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:53.188+0000 7f7ba3fff640 1 -- 172.21.15.37:0/2098450025 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b9403f030 con 0x7f7bac101cd0 2024-09-19T06:05:53.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:53.188+0000 7f7ba3fff640 1 -- 172.21.15.37:0/2098450025 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7b94003ce0 con 0x7f7bac101cd0 2024-09-19T06:05:53.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:53.188+0000 7f7ba3fff640 1 -- 172.21.15.37:0/2098450025 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b94035070 con 0x7f7bac101cd0 2024-09-19T06:05:53.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:53.188+0000 7f7bb13a3640 1 -- 172.21.15.37:0/2098450025 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bac19fd40 con 0x7f7bac101cd0 2024-09-19T06:05:53.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:53.188+0000 7f7bb13a3640 1 -- 172.21.15.37:0/2098450025 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bac1a01c0 con 0x7f7bac101cd0 2024-09-19T06:05:53.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:53.189+0000 7f7bb13a3640 1 -- 172.21.15.37:0/2098450025 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bac107e70 con 0x7f7bac101cd0 2024-09-19T06:05:53.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:53.191+0000 7f7ba3fff640 1 -- 172.21.15.37:0/2098450025 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f7b94042030 con 0x7f7bac101cd0 2024-09-19T06:05:53.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:53.191+0000 7f7ba3fff640 1 --2- 172.21.15.37:0/2098450025 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f7b980a3300 0x7f7b980a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:53.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:53.191+0000 7f7baaffd640 1 --2- 172.21.15.37:0/2098450025 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f7b980a3300 0x7f7b980a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:53.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:53.191+0000 7f7ba3fff640 1 -- 172.21.15.37:0/2098450025 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f7b940f0410 con 0x7f7bac101cd0 2024-09-19T06:05:53.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:53.192+0000 7f7baaffd640 1 --2- 172.21.15.37:0/2098450025 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f7b980a3300 0x7f7b980a57c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7bac101b30 tx=0x7f7b9c009670 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:53.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:53.196+0000 7f7ba3fff640 1 -- 172.21.15.37:0/2098450025 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7b940bcc70 con 0x7f7bac101cd0 2024-09-19T06:05:53.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:52 smithi117 ceph-mon[35050]: from='client.15054 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:05:53.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:53.378+0000 7f7bb13a3640 1 -- 172.21.15.37:0/2098450025 --> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f7bac062630 con 0x7f7b980a3300 2024-09-19T06:05:53.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:53.384+0000 7f7ba3fff640 1 -- 172.21.15.37:0/2098450025 <== mgr.14148 v2:172.21.15.37:6800/3797010169 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f7bac062630 con 0x7f7b980a3300 2024-09-19T06:05:53.386 INFO:teuthology.orchestra.run.smithi037.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-19T06:05:53.386 INFO:teuthology.orchestra.run.smithi037.stdout:mds.all 12/12 51s ago 2m smithi037=a;smithi037=d;smithi037=g;smithi037=j;smithi099=b;smithi099=e;smithi099=h;smithi099=k;smithi117=c;smithi117=f;smithi117=i;smithi117=l;count:12 2024-09-19T06:05:53.386 INFO:teuthology.orchestra.run.smithi037.stdout:mgr 3/3 51s ago 7m smithi037=x;smithi099=y;smithi117=z;count:3 2024-09-19T06:05:53.386 INFO:teuthology.orchestra.run.smithi037.stdout:mon 3/3 51s ago 8m smithi037:172.21.15.37=a;smithi099:172.21.15.99=b;smithi117:172.21.15.117=c;count:3 2024-09-19T06:05:53.386 INFO:teuthology.orchestra.run.smithi037.stdout:osd 12 51s ago - 2024-09-19T06:05:53.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:53.386+0000 7f7bb13a3640 1 -- 172.21.15.37:0/2098450025 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f7b980a3300 msgr2=0x7f7b980a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:53.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:53.386+0000 7f7bb13a3640 1 --2- 172.21.15.37:0/2098450025 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f7b980a3300 0x7f7b980a57c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7bac101b30 tx=0x7f7b9c009670 comp rx=0 tx=0).stop 2024-09-19T06:05:53.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:53.386+0000 7f7bb13a3640 1 -- 172.21.15.37:0/2098450025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bac101cd0 msgr2=0x7f7bac1983c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:53.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:53.386+0000 7f7bb13a3640 1 --2- 172.21.15.37:0/2098450025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bac101cd0 0x7f7bac1983c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7b94009230 tx=0x7f7b94004360 comp rx=0 tx=0).stop 2024-09-19T06:05:53.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:53.386+0000 7f7bb13a3640 1 -- 172.21.15.37:0/2098450025 shutdown_connections 2024-09-19T06:05:53.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:53.386+0000 7f7bb13a3640 1 --2- 172.21.15.37:0/2098450025 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f7b980a3300 0x7f7b980a57c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:53.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:53.387+0000 7f7bb13a3640 1 --2- 172.21.15.37:0/2098450025 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bac102690 0x7f7bac19f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:53.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:53.387+0000 7f7bb13a3640 1 --2- 172.21.15.37:0/2098450025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bac101cd0 0x7f7bac1983c0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:53.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:53.387+0000 7f7bb13a3640 1 --2- 172.21.15.37:0/2098450025 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7bac100ad0 0x7f7bac197e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:53.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:53.387+0000 7f7bb13a3640 1 -- 172.21.15.37:0/2098450025 >> 172.21.15.37:0/2098450025 conn(0x7f7bac0fc280 msgr2=0x7f7bac105040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:53.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:53.387+0000 7f7bb13a3640 1 -- 172.21.15.37:0/2098450025 shutdown_connections 2024-09-19T06:05:53.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:53.387+0000 7f7bb13a3640 1 -- 172.21.15.37:0/2098450025 wait complete. 2024-09-19T06:05:53.438 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:52 smithi099 ceph-mon[35300]: from='client.15054 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:05:54.072 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:53 smithi037 ceph-mon[31211]: pgmap v339: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:05:54.072 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:53 smithi037 ceph-mon[31211]: from='client.15060 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:05:54.101 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-19T06:05:54.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:53 smithi099 ceph-mon[35300]: pgmap v339: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:05:54.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:53 smithi099 ceph-mon[35300]: from='client.15060 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:05:54.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:53 smithi117 ceph-mon[35050]: pgmap v339: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:05:54.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:53 smithi117 ceph-mon[35050]: from='client.15060 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:05:54.358 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:05:54.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:54.824+0000 7f3901341640 1 -- 172.21.15.37:0/1124470756 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38fc107900 msgr2=0x7f38fc109d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:54.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:54.824+0000 7f3901341640 1 --2- 172.21.15.37:0/1124470756 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38fc107900 0x7f38fc109d50 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f38f4009ca0 tx=0x7f38f402a8c0 comp rx=0 tx=0).stop 2024-09-19T06:05:54.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:54.824+0000 7f3901341640 1 -- 172.21.15.37:0/1124470756 shutdown_connections 2024-09-19T06:05:54.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:54.824+0000 7f3901341640 1 --2- 172.21.15.37:0/1124470756 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38fc107900 0x7f38fc109d50 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:54.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:54.824+0000 7f3901341640 1 --2- 172.21.15.37:0/1124470756 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38fc104fd0 0x7f38fc1073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:54.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:54.824+0000 7f3901341640 1 --2- 172.21.15.37:0/1124470756 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f38fc1026a0 0x7f38fc104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:54.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:54.824+0000 7f3901341640 1 -- 172.21.15.37:0/1124470756 >> 172.21.15.37:0/1124470756 conn(0x7f38fc0fc2a0 msgr2=0x7f38fc0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:54.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:54.824+0000 7f3901341640 1 -- 172.21.15.37:0/1124470756 shutdown_connections 2024-09-19T06:05:54.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:54.824+0000 7f3901341640 1 -- 172.21.15.37:0/1124470756 wait complete. 2024-09-19T06:05:54.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:54.825+0000 7f3901341640 1 Processor -- start 2024-09-19T06:05:54.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:54.825+0000 7f3901341640 1 -- start start 2024-09-19T06:05:54.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:54.825+0000 7f3901341640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f38fc1026a0 0x7f38fc102000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:54.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:54.825+0000 7f3901341640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38fc104fd0 0x7f38fc100650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:54.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:54.825+0000 7f3901341640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38fc107900 0x7f38fc100b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:54.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:54.825+0000 7f3901341640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f38fc10d8c0 con 0x7f38fc107900 2024-09-19T06:05:54.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:54.825+0000 7f3901341640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f38fc10d740 con 0x7f38fc1026a0 2024-09-19T06:05:54.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:54.825+0000 7f3901341640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f38fc10da40 con 0x7f38fc104fd0 2024-09-19T06:05:54.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:54.825+0000 7f38fb7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38fc107900 0x7f38fc100b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:54.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:54.825+0000 7f38fb7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38fc107900 0x7f38fc100b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45062/0 (socket says 172.21.15.37:45062) 2024-09-19T06:05:54.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:54.825+0000 7f38fb7fe640 1 -- 172.21.15.37:0/805439410 learned_addr learned my addr 172.21.15.37:0/805439410 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:05:54.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:54.826+0000 7f38f27fc640 1 --2- 172.21.15.37:0/805439410 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38fc104fd0 0x7f38fc100650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:54.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:54.826+0000 7f38faffd640 1 --2- 172.21.15.37:0/805439410 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f38fc1026a0 0x7f38fc102000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:54.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:54.826+0000 7f38fb7fe640 1 -- 172.21.15.37:0/805439410 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38fc104fd0 msgr2=0x7f38fc100650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:54.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:54.826+0000 7f38fb7fe640 1 --2- 172.21.15.37:0/805439410 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38fc104fd0 0x7f38fc100650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:54.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:54.826+0000 7f38fb7fe640 1 -- 172.21.15.37:0/805439410 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f38fc1026a0 msgr2=0x7f38fc102000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:54.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:54.826+0000 7f38fb7fe640 1 --2- 172.21.15.37:0/805439410 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f38fc1026a0 0x7f38fc102000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:54.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:54.826+0000 7f38fb7fe640 1 -- 172.21.15.37:0/805439410 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38fc101450 con 0x7f38fc107900 2024-09-19T06:05:54.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:54.826+0000 7f38faffd640 1 --2- 172.21.15.37:0/805439410 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f38fc1026a0 0x7f38fc102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:05:54.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:54.826+0000 7f38fb7fe640 1 --2- 172.21.15.37:0/805439410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38fc107900 0x7f38fc100b90 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f38f4005e30 tx=0x7f38f4031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:54.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:54.826+0000 7f38f8ff9640 1 -- 172.21.15.37:0/805439410 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f4003c30 con 0x7f38fc107900 2024-09-19T06:05:54.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:54.826+0000 7f3901341640 1 -- 172.21.15.37:0/805439410 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38fc1a1ff0 con 0x7f38fc107900 2024-09-19T06:05:54.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:54.826+0000 7f38f8ff9640 1 -- 172.21.15.37:0/805439410 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38f4003dd0 con 0x7f38fc107900 2024-09-19T06:05:54.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:54.826+0000 7f38f8ff9640 1 -- 172.21.15.37:0/805439410 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f402fde0 con 0x7f38fc107900 2024-09-19T06:05:54.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:54.826+0000 7f3901341640 1 -- 172.21.15.37:0/805439410 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38fc1a24a0 con 0x7f38fc107900 2024-09-19T06:05:54.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:54.827+0000 7f3901341640 1 -- 172.21.15.37:0/805439410 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38fc0fdd90 con 0x7f38fc107900 2024-09-19T06:05:54.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:54.829+0000 7f38f8ff9640 1 -- 172.21.15.37:0/805439410 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f38f4004050 con 0x7f38fc107900 2024-09-19T06:05:54.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:54.829+0000 7f38f8ff9640 1 --2- 172.21.15.37:0/805439410 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f38e80a32d0 0x7f38e80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:54.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:54.829+0000 7f38f8ff9640 1 -- 172.21.15.37:0/805439410 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f38f40f0f30 con 0x7f38fc107900 2024-09-19T06:05:54.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:54.829+0000 7f38faffd640 1 --2- 172.21.15.37:0/805439410 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f38e80a32d0 0x7f38e80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:54.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:54.830+0000 7f38faffd640 1 --2- 172.21.15.37:0/805439410 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f38e80a32d0 0x7f38e80a5790 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f38ec0058c0 tx=0x7f38ec005850 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:54.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:54.834+0000 7f38f8ff9640 1 -- 172.21.15.37:0/805439410 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f38f40bd8a0 con 0x7f38fc107900 2024-09-19T06:05:55.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:55.014+0000 7f3901341640 1 -- 172.21.15.37:0/805439410 --> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f38fc062630 con 0x7f38e80a32d0 2024-09-19T06:05:55.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:55.016+0000 7f38f8ff9640 1 -- 172.21.15.37:0/805439410 <== mgr.14148 v2:172.21.15.37:6800/3797010169 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f38fc062630 con 0x7f38e80a32d0 2024-09-19T06:05:55.018 INFO:teuthology.orchestra.run.smithi037.stdout:HOST ADDR LABELS STATUS 2024-09-19T06:05:55.018 INFO:teuthology.orchestra.run.smithi037.stdout:smithi037 172.21.15.37 2024-09-19T06:05:55.018 INFO:teuthology.orchestra.run.smithi037.stdout:smithi099 172.21.15.99 2024-09-19T06:05:55.018 INFO:teuthology.orchestra.run.smithi037.stdout:smithi117 172.21.15.117 2024-09-19T06:05:55.018 INFO:teuthology.orchestra.run.smithi037.stdout:3 hosts in cluster 2024-09-19T06:05:55.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:55.018+0000 7f3901341640 1 -- 172.21.15.37:0/805439410 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f38e80a32d0 msgr2=0x7f38e80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:55.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:55.018+0000 7f3901341640 1 --2- 172.21.15.37:0/805439410 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f38e80a32d0 0x7f38e80a5790 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f38ec0058c0 tx=0x7f38ec005850 comp rx=0 tx=0).stop 2024-09-19T06:05:55.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:55.018+0000 7f3901341640 1 -- 172.21.15.37:0/805439410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38fc107900 msgr2=0x7f38fc100b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:55.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:55.018+0000 7f3901341640 1 --2- 172.21.15.37:0/805439410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38fc107900 0x7f38fc100b90 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f38f4005e30 tx=0x7f38f4031ee0 comp rx=0 tx=0).stop 2024-09-19T06:05:55.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:55.019+0000 7f3901341640 1 -- 172.21.15.37:0/805439410 shutdown_connections 2024-09-19T06:05:55.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:55.019+0000 7f3901341640 1 --2- 172.21.15.37:0/805439410 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f38e80a32d0 0x7f38e80a5790 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:55.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:55.019+0000 7f3901341640 1 --2- 172.21.15.37:0/805439410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38fc107900 0x7f38fc100b90 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:55.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:55.019+0000 7f3901341640 1 --2- 172.21.15.37:0/805439410 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38fc104fd0 0x7f38fc100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:55.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:55.019+0000 7f3901341640 1 --2- 172.21.15.37:0/805439410 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f38fc1026a0 0x7f38fc102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:55.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:55.019+0000 7f3901341640 1 -- 172.21.15.37:0/805439410 >> 172.21.15.37:0/805439410 conn(0x7f38fc0fc2a0 msgr2=0x7f38fc102f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:55.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:55.019+0000 7f3901341640 1 -- 172.21.15.37:0/805439410 shutdown_connections 2024-09-19T06:05:55.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:55.019+0000 7f3901341640 1 -- 172.21.15.37:0/805439410 wait complete. 2024-09-19T06:05:55.777 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-19T06:05:56.045 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:05:56.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:55 smithi037 ceph-mon[31211]: pgmap v340: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:05:56.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:55 smithi037 ceph-mon[31211]: from='client.15066 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:05:56.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:55 smithi117 ceph-mon[35050]: pgmap v340: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:05:56.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:55 smithi117 ceph-mon[35050]: from='client.15066 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:05:56.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:55 smithi099 ceph-mon[35300]: pgmap v340: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:05:56.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:55 smithi099 ceph-mon[35300]: from='client.15066 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:05:56.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:56.494+0000 7fdb6c1be640 1 -- 172.21.15.37:0/2868893178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb64100dd0 msgr2=0x7fdb64101230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:56.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:56.494+0000 7fdb6c1be640 1 --2- 172.21.15.37:0/2868893178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb64100dd0 0x7fdb64101230 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fdb54009900 tx=0x7fdb5402a410 comp rx=0 tx=0).stop 2024-09-19T06:05:56.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:56.494+0000 7fdb6c1be640 1 -- 172.21.15.37:0/2868893178 shutdown_connections 2024-09-19T06:05:56.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:56.494+0000 7fdb6c1be640 1 --2- 172.21.15.37:0/2868893178 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdb64101770 0x7fdb64101c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:56.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:56.494+0000 7fdb6c1be640 1 --2- 172.21.15.37:0/2868893178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb64100dd0 0x7fdb64101230 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:56.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:56.494+0000 7fdb6c1be640 1 --2- 172.21.15.37:0/2868893178 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb64100490 0x7fdb64100890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:56.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:56.494+0000 7fdb6c1be640 1 -- 172.21.15.37:0/2868893178 >> 172.21.15.37:0/2868893178 conn(0x7fdb640fc2a0 msgr2=0x7fdb640fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:56.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:56.495+0000 7fdb6c1be640 1 -- 172.21.15.37:0/2868893178 shutdown_connections 2024-09-19T06:05:56.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:56.495+0000 7fdb6c1be640 1 -- 172.21.15.37:0/2868893178 wait complete. 2024-09-19T06:05:56.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:56.495+0000 7fdb6c1be640 1 Processor -- start 2024-09-19T06:05:56.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:56.495+0000 7fdb6c1be640 1 -- start start 2024-09-19T06:05:56.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:56.495+0000 7fdb6c1be640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb64100490 0x7fdb6419a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:56.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:56.495+0000 7fdb6c1be640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb64100dd0 0x7fdb6419a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:56.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:56.495+0000 7fdb6c1be640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdb64101770 0x7fdb641a1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:56.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:56.495+0000 7fdb6c1be640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdb6410fa80 con 0x7fdb64100490 2024-09-19T06:05:56.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:56.495+0000 7fdb6c1be640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fdb6410f900 con 0x7fdb64101770 2024-09-19T06:05:56.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:56.495+0000 7fdb6c1be640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fdb6410fc00 con 0x7fdb64100dd0 2024-09-19T06:05:56.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:56.496+0000 7fdb69f5a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb64100490 0x7fdb6419a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:56.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:56.496+0000 7fdb69f5a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb64100490 0x7fdb6419a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45084/0 (socket says 172.21.15.37:45084) 2024-09-19T06:05:56.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:56.496+0000 7fdb69f5a640 1 -- 172.21.15.37:0/3901087777 learned_addr learned my addr 172.21.15.37:0/3901087777 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:05:56.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:56.496+0000 7fdb69759640 1 --2- 172.21.15.37:0/3901087777 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb64100dd0 0x7fdb6419a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:56.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:56.496+0000 7fdb6a75b640 1 --2- 172.21.15.37:0/3901087777 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdb64101770 0x7fdb641a1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:56.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:56.496+0000 7fdb69f5a640 1 -- 172.21.15.37:0/3901087777 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb64100dd0 msgr2=0x7fdb6419a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:56.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:56.496+0000 7fdb69f5a640 1 --2- 172.21.15.37:0/3901087777 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb64100dd0 0x7fdb6419a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:56.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:56.496+0000 7fdb69f5a640 1 -- 172.21.15.37:0/3901087777 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdb64101770 msgr2=0x7fdb641a1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:56.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:56.496+0000 7fdb69f5a640 1 --2- 172.21.15.37:0/3901087777 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdb64101770 0x7fdb641a1730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:56.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:56.496+0000 7fdb69f5a640 1 -- 172.21.15.37:0/3901087777 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb641a1da0 con 0x7fdb64100490 2024-09-19T06:05:56.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:56.496+0000 7fdb69f5a640 1 --2- 172.21.15.37:0/3901087777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb64100490 0x7fdb6419a170 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fdb6000e9f0 tx=0x7fdb6000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:56.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:56.496+0000 7fdb5affd640 1 -- 172.21.15.37:0/3901087777 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb6000cd80 con 0x7fdb64100490 2024-09-19T06:05:56.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:56.496+0000 7fdb6c1be640 1 -- 172.21.15.37:0/3901087777 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb641a2090 con 0x7fdb64100490 2024-09-19T06:05:56.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:56.496+0000 7fdb5affd640 1 -- 172.21.15.37:0/3901087777 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb60005500 con 0x7fdb64100490 2024-09-19T06:05:56.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:56.496+0000 7fdb5affd640 1 -- 172.21.15.37:0/3901087777 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb60010690 con 0x7fdb64100490 2024-09-19T06:05:56.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:56.496+0000 7fdb6c1be640 1 -- 172.21.15.37:0/3901087777 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb641a25a0 con 0x7fdb64100490 2024-09-19T06:05:56.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:56.497+0000 7fdb6c1be640 1 -- 172.21.15.37:0/3901087777 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb6410b1e0 con 0x7fdb64100490 2024-09-19T06:05:56.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:56.498+0000 7fdb5affd640 1 -- 172.21.15.37:0/3901087777 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fdb600046c0 con 0x7fdb64100490 2024-09-19T06:05:56.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:56.499+0000 7fdb5affd640 1 --2- 172.21.15.37:0/3901087777 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fdb500a3300 0x7fdb500a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:56.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:56.499+0000 7fdb69759640 1 --2- 172.21.15.37:0/3901087777 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fdb500a3300 0x7fdb500a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:56.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:56.499+0000 7fdb5affd640 1 -- 172.21.15.37:0/3901087777 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fdb600d0290 con 0x7fdb64100490 2024-09-19T06:05:56.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:56.500+0000 7fdb69759640 1 --2- 172.21.15.37:0/3901087777 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fdb500a3300 0x7fdb500a57c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fdb540314e0 tx=0x7fdb54000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:56.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:56.503+0000 7fdb5affd640 1 -- 172.21.15.37:0/3901087777 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdb6009caf0 con 0x7fdb64100490 2024-09-19T06:05:56.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:56.686+0000 7fdb6c1be640 1 -- 172.21.15.37:0/3901087777 --> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7fdb64062630 con 0x7fdb500a3300 2024-09-19T06:05:56.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:56.688+0000 7fdb5affd640 1 -- 172.21.15.37:0/3901087777 <== mgr.14148 v2:172.21.15.37:6800/3797010169 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7fdb64062630 con 0x7fdb500a3300 2024-09-19T06:05:56.690 INFO:teuthology.orchestra.run.smithi037.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-19T06:05:56.690 INFO:teuthology.orchestra.run.smithi037.stdout:smithi037 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT5331005T400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-19T06:05:56.690 INFO:teuthology.orchestra.run.smithi037.stdout:smithi099 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT62040101400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-19T06:05:56.690 INFO:teuthology.orchestra.run.smithi037.stdout:smithi117 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400V6400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-19T06:05:56.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:56.690+0000 7fdb6c1be640 1 -- 172.21.15.37:0/3901087777 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fdb500a3300 msgr2=0x7fdb500a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:56.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:56.690+0000 7fdb6c1be640 1 --2- 172.21.15.37:0/3901087777 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fdb500a3300 0x7fdb500a57c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fdb540314e0 tx=0x7fdb54000bc0 comp rx=0 tx=0).stop 2024-09-19T06:05:56.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:56.690+0000 7fdb6c1be640 1 -- 172.21.15.37:0/3901087777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb64100490 msgr2=0x7fdb6419a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:56.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:56.690+0000 7fdb6c1be640 1 --2- 172.21.15.37:0/3901087777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb64100490 0x7fdb6419a170 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fdb6000e9f0 tx=0x7fdb6000edf0 comp rx=0 tx=0).stop 2024-09-19T06:05:56.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:56.690+0000 7fdb6c1be640 1 -- 172.21.15.37:0/3901087777 shutdown_connections 2024-09-19T06:05:56.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:56.690+0000 7fdb6c1be640 1 --2- 172.21.15.37:0/3901087777 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fdb500a3300 0x7fdb500a57c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:56.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:56.690+0000 7fdb6c1be640 1 --2- 172.21.15.37:0/3901087777 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdb64101770 0x7fdb641a1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:56.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:56.690+0000 7fdb6c1be640 1 --2- 172.21.15.37:0/3901087777 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdb64100dd0 0x7fdb6419a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:56.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:56.690+0000 7fdb6c1be640 1 --2- 172.21.15.37:0/3901087777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb64100490 0x7fdb6419a170 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:56.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:56.690+0000 7fdb6c1be640 1 -- 172.21.15.37:0/3901087777 >> 172.21.15.37:0/3901087777 conn(0x7fdb640fc2a0 msgr2=0x7fdb640fdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:56.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:56.690+0000 7fdb6c1be640 1 -- 172.21.15.37:0/3901087777 shutdown_connections 2024-09-19T06:05:56.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:56.690+0000 7fdb6c1be640 1 -- 172.21.15.37:0/3901087777 wait complete. 2024-09-19T06:05:57.529 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T06:05:57.538 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi037.front.sepia.ceph.com 2024-09-19T06:05:57.539 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-19T06:05:57.797 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:05:58.204 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:57 smithi037 ceph-mon[31211]: pgmap v341: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:05:58.204 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:57 smithi037 ceph-mon[31211]: from='client.15072 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:05:58.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:57 smithi117 ceph-mon[35050]: pgmap v341: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:05:58.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:57 smithi117 ceph-mon[35050]: from='client.15072 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:05:58.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:58.284+0000 7ff6a2c91640 1 -- 172.21.15.37:0/1367002613 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff69c105050 msgr2=0x7ff69c107440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:58.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:58.284+0000 7ff6a2c91640 1 --2- 172.21.15.37:0/1367002613 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff69c105050 0x7ff69c107440 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ff690009900 tx=0x7ff69002a410 comp rx=0 tx=0).stop 2024-09-19T06:05:58.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:58.284+0000 7ff6a2c91640 1 -- 172.21.15.37:0/1367002613 shutdown_connections 2024-09-19T06:05:58.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:58.284+0000 7ff6a2c91640 1 --2- 172.21.15.37:0/1367002613 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff69c107980 0x7ff69c109d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:58.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:58.284+0000 7ff6a2c91640 1 --2- 172.21.15.37:0/1367002613 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff69c105050 0x7ff69c107440 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:58.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:58.284+0000 7ff6a2c91640 1 --2- 172.21.15.37:0/1367002613 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff69c102720 0x7ff69c104b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:58.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:58.284+0000 7ff6a2c91640 1 -- 172.21.15.37:0/1367002613 >> 172.21.15.37:0/1367002613 conn(0x7ff69c0fc280 msgr2=0x7ff69c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:58.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:58.285+0000 7ff6a2c91640 1 -- 172.21.15.37:0/1367002613 shutdown_connections 2024-09-19T06:05:58.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:58.285+0000 7ff6a2c91640 1 -- 172.21.15.37:0/1367002613 wait complete. 2024-09-19T06:05:58.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:58.285+0000 7ff6a2c91640 1 Processor -- start 2024-09-19T06:05:58.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:58.285+0000 7ff6a2c91640 1 -- start start 2024-09-19T06:05:58.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:58.285+0000 7ff6a2c91640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff69c102720 0x7ff69c102080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:58.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:58.285+0000 7ff6a2c91640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff69c105050 0x7ff69c1006d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:58.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:58.285+0000 7ff6a2c91640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff69c107980 0x7ff69c100c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:58.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:58.285+0000 7ff6a2c91640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff69c10d8b0 con 0x7ff69c105050 2024-09-19T06:05:58.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:58.285+0000 7ff6a2c91640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff69c10d730 con 0x7ff69c107980 2024-09-19T06:05:58.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:58.286+0000 7ff6a2c91640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff69c10da30 con 0x7ff69c102720 2024-09-19T06:05:58.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:58.286+0000 7ff69bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff69c105050 0x7ff69c1006d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:58.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:58.286+0000 7ff69bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff69c105050 0x7ff69c1006d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45104/0 (socket says 172.21.15.37:45104) 2024-09-19T06:05:58.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:58.286+0000 7ff69bfff640 1 -- 172.21.15.37:0/3589987343 learned_addr learned my addr 172.21.15.37:0/3589987343 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:05:58.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:58.286+0000 7ff6a0a2d640 1 --2- 172.21.15.37:0/3589987343 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff69c102720 0x7ff69c102080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:58.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:58.286+0000 7ff6a122e640 1 --2- 172.21.15.37:0/3589987343 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff69c107980 0x7ff69c100c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:58.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:58.286+0000 7ff69bfff640 1 -- 172.21.15.37:0/3589987343 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff69c102720 msgr2=0x7ff69c102080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:58.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:58.286+0000 7ff69bfff640 1 --2- 172.21.15.37:0/3589987343 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff69c102720 0x7ff69c102080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:58.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:58.286+0000 7ff69bfff640 1 -- 172.21.15.37:0/3589987343 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff69c107980 msgr2=0x7ff69c100c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:58.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:58.286+0000 7ff69bfff640 1 --2- 172.21.15.37:0/3589987343 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff69c107980 0x7ff69c100c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:58.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:58.286+0000 7ff69bfff640 1 -- 172.21.15.37:0/3589987343 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff69c1014d0 con 0x7ff69c105050 2024-09-19T06:05:58.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:58.286+0000 7ff6a122e640 1 --2- 172.21.15.37:0/3589987343 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff69c107980 0x7ff69c100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:05:58.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:58.286+0000 7ff69bfff640 1 --2- 172.21.15.37:0/3589987343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff69c105050 0x7ff69c1006d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff69002aa00 tx=0x7ff690032da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:58.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:58.286+0000 7ff699ffb640 1 -- 172.21.15.37:0/3589987343 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff69003f030 con 0x7ff69c105050 2024-09-19T06:05:58.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:58.287+0000 7ff699ffb640 1 -- 172.21.15.37:0/3589987343 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff690003ce0 con 0x7ff69c105050 2024-09-19T06:05:58.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:58.287+0000 7ff6a2c91640 1 -- 172.21.15.37:0/3589987343 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff69c1a2070 con 0x7ff69c105050 2024-09-19T06:05:58.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:58.287+0000 7ff699ffb640 1 -- 172.21.15.37:0/3589987343 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff690035070 con 0x7ff69c105050 2024-09-19T06:05:58.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:58.287+0000 7ff6a2c91640 1 -- 172.21.15.37:0/3589987343 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff69c1a2520 con 0x7ff69c105050 2024-09-19T06:05:58.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:58.288+0000 7ff6a2c91640 1 -- 172.21.15.37:0/3589987343 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff69c0fdd70 con 0x7ff69c105050 2024-09-19T06:05:58.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:58.290+0000 7ff699ffb640 1 -- 172.21.15.37:0/3589987343 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7ff690042030 con 0x7ff69c105050 2024-09-19T06:05:58.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:58.290+0000 7ff699ffb640 1 --2- 172.21.15.37:0/3589987343 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7ff6840a32d0 0x7ff6840a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:58.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:58.290+0000 7ff699ffb640 1 -- 172.21.15.37:0/3589987343 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7ff6900f0890 con 0x7ff69c105050 2024-09-19T06:05:58.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:58.290+0000 7ff6a0a2d640 1 --2- 172.21.15.37:0/3589987343 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7ff6840a32d0 0x7ff6840a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:58.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:58.291+0000 7ff6a0a2d640 1 --2- 172.21.15.37:0/3589987343 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7ff6840a32d0 0x7ff6840a5790 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff68c0058c0 tx=0x7ff68c00a2d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:58.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:58.294+0000 7ff699ffb640 1 -- 172.21.15.37:0/3589987343 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff6900bd0f0 con 0x7ff69c105050 2024-09-19T06:05:58.438 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:57 smithi099 ceph-mon[35300]: pgmap v341: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:05:58.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:57 smithi099 ceph-mon[35300]: from='client.15072 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:05:58.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:58.507+0000 7ff6a2c91640 1 -- 172.21.15.37:0/3589987343 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7ff69c02da10 con 0x7ff69c105050 2024-09-19T06:05:58.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:58.507+0000 7ff699ffb640 1 -- 172.21.15.37:0/3589987343 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) ==== 76+0+3042 (secure 0 0 0) 0x7ff6900bc9f0 con 0x7ff69c105050 2024-09-19T06:05:58.510 INFO:teuthology.orchestra.run.smithi037.stdout:e20 2024-09-19T06:05:58.510 INFO:teuthology.orchestra.run.smithi037.stdout:btime 2024-09-19T06:04:42:531480+0000 2024-09-19T06:05:58.510 INFO:teuthology.orchestra.run.smithi037.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T06:05:58.510 INFO:teuthology.orchestra.run.smithi037.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T06:05:58.510 INFO:teuthology.orchestra.run.smithi037.stdout:legacy client fscid: 1 2024-09-19T06:05:58.510 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T06:05:58.510 INFO:teuthology.orchestra.run.smithi037.stdout:Filesystem 'cephfs' (1) 2024-09-19T06:05:58.510 INFO:teuthology.orchestra.run.smithi037.stdout:fs_name cephfs 2024-09-19T06:05:58.510 INFO:teuthology.orchestra.run.smithi037.stdout:epoch 20 2024-09-19T06:05:58.510 INFO:teuthology.orchestra.run.smithi037.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-19T06:05:58.510 INFO:teuthology.orchestra.run.smithi037.stdout:created 2024-09-19T06:04:06.253034+0000 2024-09-19T06:05:58.510 INFO:teuthology.orchestra.run.smithi037.stdout:modified 2024-09-19T06:04:42.196783+0000 2024-09-19T06:05:58.511 INFO:teuthology.orchestra.run.smithi037.stdout:tableserver 0 2024-09-19T06:05:58.511 INFO:teuthology.orchestra.run.smithi037.stdout:root 0 2024-09-19T06:05:58.511 INFO:teuthology.orchestra.run.smithi037.stdout:session_timeout 300 2024-09-19T06:05:58.511 INFO:teuthology.orchestra.run.smithi037.stdout:session_autoclose 300 2024-09-19T06:05:58.511 INFO:teuthology.orchestra.run.smithi037.stdout:max_file_size 1099511627776 2024-09-19T06:05:58.511 INFO:teuthology.orchestra.run.smithi037.stdout:max_xattr_size 65536 2024-09-19T06:05:58.511 INFO:teuthology.orchestra.run.smithi037.stdout:required_client_features {} 2024-09-19T06:05:58.511 INFO:teuthology.orchestra.run.smithi037.stdout:last_failure 0 2024-09-19T06:05:58.511 INFO:teuthology.orchestra.run.smithi037.stdout:last_failure_osd_epoch 0 2024-09-19T06:05:58.511 INFO:teuthology.orchestra.run.smithi037.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T06:05:58.511 INFO:teuthology.orchestra.run.smithi037.stdout:max_mds 1 2024-09-19T06:05:58.511 INFO:teuthology.orchestra.run.smithi037.stdout:in 0 2024-09-19T06:05:58.511 INFO:teuthology.orchestra.run.smithi037.stdout:up {0=24485} 2024-09-19T06:05:58.511 INFO:teuthology.orchestra.run.smithi037.stdout:failed 2024-09-19T06:05:58.512 INFO:teuthology.orchestra.run.smithi037.stdout:damaged 2024-09-19T06:05:58.512 INFO:teuthology.orchestra.run.smithi037.stdout:stopped 2024-09-19T06:05:58.512 INFO:teuthology.orchestra.run.smithi037.stdout:data_pools [3,4] 2024-09-19T06:05:58.512 INFO:teuthology.orchestra.run.smithi037.stdout:metadata_pool 2 2024-09-19T06:05:58.512 INFO:teuthology.orchestra.run.smithi037.stdout:inline_data disabled 2024-09-19T06:05:58.512 INFO:teuthology.orchestra.run.smithi037.stdout:balancer 2024-09-19T06:05:58.512 INFO:teuthology.orchestra.run.smithi037.stdout:bal_rank_mask -1 2024-09-19T06:05:58.512 INFO:teuthology.orchestra.run.smithi037.stdout:standby_count_wanted 0 2024-09-19T06:05:58.512 INFO:teuthology.orchestra.run.smithi037.stdout:qdb_cluster leader: 24485 members: 24485 2024-09-19T06:05:58.512 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.b{0:24485} state up:active seq 4 addr [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:05:58.512 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.i{0:24478} state up:standby-replay seq 1 addr [v2:172.21.15.117:6838/1269518339,v1:172.21.15.117:6839/1269518339] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:05:58.512 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T06:05:58.512 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T06:05:58.513 INFO:teuthology.orchestra.run.smithi037.stdout:Standby daemons: 2024-09-19T06:05:58.513 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T06:05:58.513 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.j{-1:14514} state up:standby seq 1 addr [v2:172.21.15.37:6834/2864247978,v1:172.21.15.37:6835/2864247978] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:05:58.513 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.d{-1:14526} state up:standby seq 1 addr [v2:172.21.15.37:6836/633000932,v1:172.21.15.37:6837/633000932] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:05:58.513 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.g{-1:14574} state up:standby seq 1 addr [v2:172.21.15.37:6838/3753800615,v1:172.21.15.37:6839/3753800615] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:05:58.513 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.a{-1:14586} state up:standby seq 1 addr [v2:172.21.15.37:6840/2718998355,v1:172.21.15.37:6841/2718998355] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:05:58.513 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.k{-1:24404} state up:standby seq 1 addr [v2:172.21.15.99:6832/866590207,v1:172.21.15.99:6833/866590207] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:05:58.513 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.l{-1:24412} state up:standby seq 1 addr [v2:172.21.15.117:6832/3898668400,v1:172.21.15.117:6833/3898668400] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:05:58.513 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.e{-1:24434} state up:standby seq 1 addr [v2:172.21.15.99:6834/2650673320,v1:172.21.15.99:6835/2650673320] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:05:58.513 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.f{-1:24445} state up:standby seq 1 addr [v2:172.21.15.117:6834/1097471349,v1:172.21.15.117:6835/1097471349] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:05:58.513 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.c{-1:24457} state up:standby seq 1 addr [v2:172.21.15.117:6836/1001392672,v1:172.21.15.117:6837/1001392672] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:05:58.513 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.h{-1:24458} state up:standby seq 1 addr [v2:172.21.15.99:6836/23570935,v1:172.21.15.99:6837/23570935] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:05:58.514 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 20 2024-09-19T06:05:58.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:58.509+0000 7ff6a2c91640 1 -- 172.21.15.37:0/3589987343 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7ff6840a32d0 msgr2=0x7ff6840a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:58.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:58.509+0000 7ff6a2c91640 1 --2- 172.21.15.37:0/3589987343 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7ff6840a32d0 0x7ff6840a5790 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff68c0058c0 tx=0x7ff68c00a2d0 comp rx=0 tx=0).stop 2024-09-19T06:05:58.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:58.509+0000 7ff6a2c91640 1 -- 172.21.15.37:0/3589987343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff69c105050 msgr2=0x7ff69c1006d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:58.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:58.509+0000 7ff6a2c91640 1 --2- 172.21.15.37:0/3589987343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff69c105050 0x7ff69c1006d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff69002aa00 tx=0x7ff690032da0 comp rx=0 tx=0).stop 2024-09-19T06:05:58.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:58.509+0000 7ff6a2c91640 1 -- 172.21.15.37:0/3589987343 shutdown_connections 2024-09-19T06:05:58.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:58.509+0000 7ff6a2c91640 1 --2- 172.21.15.37:0/3589987343 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7ff6840a32d0 0x7ff6840a5790 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:58.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:58.509+0000 7ff6a2c91640 1 --2- 172.21.15.37:0/3589987343 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff69c107980 0x7ff69c100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:58.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:58.509+0000 7ff6a2c91640 1 --2- 172.21.15.37:0/3589987343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff69c105050 0x7ff69c1006d0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:58.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:58.509+0000 7ff6a2c91640 1 --2- 172.21.15.37:0/3589987343 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff69c102720 0x7ff69c102080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:58.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:58.509+0000 7ff6a2c91640 1 -- 172.21.15.37:0/3589987343 >> 172.21.15.37:0/3589987343 conn(0x7ff69c0fc280 msgr2=0x7ff69c103100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:58.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:58.510+0000 7ff6a2c91640 1 -- 172.21.15.37:0/3589987343 shutdown_connections 2024-09-19T06:05:58.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:58.510+0000 7ff6a2c91640 1 -- 172.21.15.37:0/3589987343 wait complete. 2024-09-19T06:05:59.151 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:58 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/3589987343' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:05:59.180 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-19T06:05:59.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:58 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/3589987343' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:05:59.438 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:05:59.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:58 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/3589987343' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:05:59.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:59.927+0000 7f48ce88d640 1 -- 172.21.15.37:0/556281256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48c81037c0 msgr2=0x7f48c810a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:59.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:59.927+0000 7f48ce88d640 1 --2- 172.21.15.37:0/556281256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48c81037c0 0x7f48c810a050 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f48c0009ca0 tx=0x7f48c002a8c0 comp rx=0 tx=0).stop 2024-09-19T06:05:59.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:59.927+0000 7f48ce88d640 1 -- 172.21.15.37:0/556281256 shutdown_connections 2024-09-19T06:05:59.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:59.927+0000 7f48ce88d640 1 --2- 172.21.15.37:0/556281256 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48c8102e00 0x7f48c8103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:59.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:59.927+0000 7f48ce88d640 1 --2- 172.21.15.37:0/556281256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48c81037c0 0x7f48c810a050 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:59.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:59.927+0000 7f48ce88d640 1 --2- 172.21.15.37:0/556281256 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48c8101c00 0x7f48c8102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:59.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:59.927+0000 7f48ce88d640 1 -- 172.21.15.37:0/556281256 >> 172.21.15.37:0/556281256 conn(0x7f48c80fd390 msgr2=0x7f48c80ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:59.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:59.927+0000 7f48ce88d640 1 -- 172.21.15.37:0/556281256 shutdown_connections 2024-09-19T06:05:59.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:59.927+0000 7f48ce88d640 1 -- 172.21.15.37:0/556281256 wait complete. 2024-09-19T06:05:59.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:59.927+0000 7f48ce88d640 1 Processor -- start 2024-09-19T06:05:59.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:59.928+0000 7f48ce88d640 1 -- start start 2024-09-19T06:05:59.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:59.928+0000 7f48ce88d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48c8101c00 0x7f48c8197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:59.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:59.928+0000 7f48ce88d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48c8102e00 0x7f48c8198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:59.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:59.928+0000 7f48ce88d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48c81037c0 0x7f48c819f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:59.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:59.928+0000 7f48ce88d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f48c810d860 con 0x7f48c81037c0 2024-09-19T06:05:59.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:59.928+0000 7f48ce88d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f48c810d6e0 con 0x7f48c8101c00 2024-09-19T06:05:59.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:59.928+0000 7f48ce88d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f48c810d9e0 con 0x7f48c8102e00 2024-09-19T06:05:59.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:59.928+0000 7f48cce2a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48c81037c0 0x7f48c819f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:59.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:59.928+0000 7f48cce2a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48c81037c0 0x7f48c819f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45120/0 (socket says 172.21.15.37:45120) 2024-09-19T06:05:59.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:59.928+0000 7f48cce2a640 1 -- 172.21.15.37:0/294862020 learned_addr learned my addr 172.21.15.37:0/294862020 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:05:59.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:59.928+0000 7f48c7fff640 1 --2- 172.21.15.37:0/294862020 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48c8101c00 0x7f48c8197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:59.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:59.928+0000 7f48c77fe640 1 --2- 172.21.15.37:0/294862020 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48c8102e00 0x7f48c8198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:59.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:59.928+0000 7f48cce2a640 1 -- 172.21.15.37:0/294862020 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48c8102e00 msgr2=0x7f48c8198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:59.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:59.928+0000 7f48cce2a640 1 --2- 172.21.15.37:0/294862020 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48c8102e00 0x7f48c8198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:59.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:59.928+0000 7f48cce2a640 1 -- 172.21.15.37:0/294862020 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48c8101c00 msgr2=0x7f48c8197dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:59.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:59.928+0000 7f48cce2a640 1 --2- 172.21.15.37:0/294862020 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48c8101c00 0x7f48c8197dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:59.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:59.928+0000 7f48cce2a640 1 -- 172.21.15.37:0/294862020 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48c819fa00 con 0x7f48c81037c0 2024-09-19T06:05:59.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:59.929+0000 7f48cce2a640 1 --2- 172.21.15.37:0/294862020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48c81037c0 0x7f48c819f390 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f48c0005e30 tx=0x7f48c0031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:59.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:59.929+0000 7f48c57fa640 1 -- 172.21.15.37:0/294862020 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c0003c30 con 0x7f48c81037c0 2024-09-19T06:05:59.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:59.929+0000 7f48ce88d640 1 -- 172.21.15.37:0/294862020 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48c819fc90 con 0x7f48c81037c0 2024-09-19T06:05:59.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:59.929+0000 7f48c57fa640 1 -- 172.21.15.37:0/294862020 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48c0003dd0 con 0x7f48c81037c0 2024-09-19T06:05:59.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:59.929+0000 7f48c57fa640 1 -- 172.21.15.37:0/294862020 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c002fde0 con 0x7f48c81037c0 2024-09-19T06:05:59.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:59.929+0000 7f48ce88d640 1 -- 172.21.15.37:0/294862020 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48c81a0170 con 0x7f48c81037c0 2024-09-19T06:05:59.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:59.930+0000 7f48ce88d640 1 -- 172.21.15.37:0/294862020 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48c8108f30 con 0x7f48c81037c0 2024-09-19T06:05:59.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:59.931+0000 7f48c57fa640 1 -- 172.21.15.37:0/294862020 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f48c0004050 con 0x7f48c81037c0 2024-09-19T06:05:59.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:59.932+0000 7f48c57fa640 1 --2- 172.21.15.37:0/294862020 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f48b00a3300 0x7f48b00a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:59.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:59.932+0000 7f48c7fff640 1 --2- 172.21.15.37:0/294862020 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f48b00a3300 0x7f48b00a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:59.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:59.932+0000 7f48c57fa640 1 -- 172.21.15.37:0/294862020 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f48c00f10f0 con 0x7f48c81037c0 2024-09-19T06:05:59.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:59.932+0000 7f48c7fff640 1 --2- 172.21.15.37:0/294862020 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f48b00a3300 0x7f48b00a57c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f48c8102c60 tx=0x7f48b8005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:59.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:05:59.936+0000 7f48c57fa640 1 -- 172.21.15.37:0/294862020 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f48c00bda60 con 0x7f48c81037c0 2024-09-19T06:06:00.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:00.114+0000 7f48ce88d640 1 -- 172.21.15.37:0/294862020 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f48c8062e90 con 0x7f48c81037c0 2024-09-19T06:06:00.116 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:05:59 smithi037 ceph-mon[31211]: pgmap v342: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:06:00.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:00.115+0000 7f48c57fa640 1 -- 172.21.15.37:0/294862020 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v89) ==== 56+0+5593 (secure 0 0 0) 0x7f48c00bd360 con 0x7f48c81037c0 2024-09-19T06:06:00.117 INFO:teuthology.orchestra.run.smithi037.stdout:epoch 89 2024-09-19T06:06:00.117 INFO:teuthology.orchestra.run.smithi037.stdout:fsid b8c8bdae-764b-11ef-bceb-c7b262605968 2024-09-19T06:06:00.117 INFO:teuthology.orchestra.run.smithi037.stdout:created 2024-09-19T05:56:22.523060+0000 2024-09-19T06:06:00.117 INFO:teuthology.orchestra.run.smithi037.stdout:modified 2024-09-19T06:05:13.720782+0000 2024-09-19T06:06:00.117 INFO:teuthology.orchestra.run.smithi037.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-19T06:06:00.117 INFO:teuthology.orchestra.run.smithi037.stdout:crush_version 27 2024-09-19T06:06:00.118 INFO:teuthology.orchestra.run.smithi037.stdout:full_ratio 0.95 2024-09-19T06:06:00.118 INFO:teuthology.orchestra.run.smithi037.stdout:backfillfull_ratio 0.9 2024-09-19T06:06:00.118 INFO:teuthology.orchestra.run.smithi037.stdout:nearfull_ratio 0.85 2024-09-19T06:06:00.118 INFO:teuthology.orchestra.run.smithi037.stdout:require_min_compat_client luminous 2024-09-19T06:06:00.118 INFO:teuthology.orchestra.run.smithi037.stdout:min_compat_client luminous 2024-09-19T06:06:00.118 INFO:teuthology.orchestra.run.smithi037.stdout:require_osd_release squid 2024-09-19T06:06:00.118 INFO:teuthology.orchestra.run.smithi037.stdout:stretch_mode_enabled false 2024-09-19T06:06:00.118 INFO:teuthology.orchestra.run.smithi037.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-19T06:06:00.118 INFO:teuthology.orchestra.run.smithi037.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 81 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-19T06:06:00.118 INFO:teuthology.orchestra.run.smithi037.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 81 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2024-09-19T06:06:00.118 INFO:teuthology.orchestra.run.smithi037.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 87 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2024-09-19T06:06:00.118 INFO:teuthology.orchestra.run.smithi037.stdout:max_osd 12 2024-09-19T06:06:00.118 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0 up in weight 1 up_from 8 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.37:6802/1783875173,v1:172.21.15.37:6803/1783875173] [v2:172.21.15.37:6804/1783875173,v1:172.21.15.37:6805/1783875173] exists,up 455bc11d-2b6e-4a0c-90d9-8ab4ef4f9e02 2024-09-19T06:06:00.119 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1 up in weight 1 up_from 13 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.99:6800/3414373360,v1:172.21.15.99:6801/3414373360] [v2:172.21.15.99:6802/3414373360,v1:172.21.15.99:6803/3414373360] exists,up 3505c162-c342-479d-8ea2-15b7a9d625cd 2024-09-19T06:06:00.119 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2 up in weight 1 up_from 18 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.117:6800/3794943081,v1:172.21.15.117:6801/3794943081] [v2:172.21.15.117:6802/3794943081,v1:172.21.15.117:6803/3794943081] exists,up 736ec67f-b5e7-43f0-9303-0c88878ead6d 2024-09-19T06:06:00.119 INFO:teuthology.orchestra.run.smithi037.stdout:osd.3 up in weight 1 up_from 25 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.37:6810/2121011955,v1:172.21.15.37:6811/2121011955] [v2:172.21.15.37:6812/2121011955,v1:172.21.15.37:6813/2121011955] exists,up 3f784ef7-0cc1-4c86-a03a-b8f13396c835 2024-09-19T06:06:00.119 INFO:teuthology.orchestra.run.smithi037.stdout:osd.4 up in weight 1 up_from 32 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.99:6808/1881025735,v1:172.21.15.99:6809/1881025735] [v2:172.21.15.99:6810/1881025735,v1:172.21.15.99:6811/1881025735] exists,up d7c16e7f-f599-419b-b4a2-fd6c1cafa0d8 2024-09-19T06:06:00.119 INFO:teuthology.orchestra.run.smithi037.stdout:osd.5 up in weight 1 up_from 37 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.117:6808/1141976511,v1:172.21.15.117:6809/1141976511] [v2:172.21.15.117:6810/1141976511,v1:172.21.15.117:6811/1141976511] exists,up 2f499ab4-3d09-4f96-a709-b4229865c690 2024-09-19T06:06:00.119 INFO:teuthology.orchestra.run.smithi037.stdout:osd.6 up in weight 1 up_from 44 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.37:6818/770433145,v1:172.21.15.37:6819/770433145] [v2:172.21.15.37:6820/770433145,v1:172.21.15.37:6821/770433145] exists,up 10f7fd72-1ae8-4efd-a448-75f4b5054be3 2024-09-19T06:06:00.119 INFO:teuthology.orchestra.run.smithi037.stdout:osd.7 up in weight 1 up_from 49 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.99:6816/1694360992,v1:172.21.15.99:6817/1694360992] [v2:172.21.15.99:6818/1694360992,v1:172.21.15.99:6819/1694360992] exists,up 7199a267-c486-417c-b530-3ff03fc9eb1e 2024-09-19T06:06:00.119 INFO:teuthology.orchestra.run.smithi037.stdout:osd.8 up in weight 1 up_from 56 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.117:6816/2005866772,v1:172.21.15.117:6817/2005866772] [v2:172.21.15.117:6818/2005866772,v1:172.21.15.117:6819/2005866772] exists,up 8d5bb83c-62eb-4ded-8a16-e8d57ab102c9 2024-09-19T06:06:00.119 INFO:teuthology.orchestra.run.smithi037.stdout:osd.9 up in weight 1 up_from 63 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.37:6826/1398779376,v1:172.21.15.37:6827/1398779376] [v2:172.21.15.37:6828/1398779376,v1:172.21.15.37:6829/1398779376] exists,up 04b6203d-a10c-4a55-8e59-b30012dee02b 2024-09-19T06:06:00.119 INFO:teuthology.orchestra.run.smithi037.stdout:osd.10 up in weight 1 up_from 68 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.99:6824/2200957302,v1:172.21.15.99:6825/2200957302] [v2:172.21.15.99:6826/2200957302,v1:172.21.15.99:6827/2200957302] exists,up bbf8ff4b-29cd-4d56-a30e-ff2de3555f78 2024-09-19T06:06:00.119 INFO:teuthology.orchestra.run.smithi037.stdout:osd.11 up in weight 1 up_from 75 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.117:6824/1354423136,v1:172.21.15.117:6825/1354423136] [v2:172.21.15.117:6826/1354423136,v1:172.21.15.117:6827/1354423136] exists,up 041d54f4-a274-47b5-a467-0ce86efd363b 2024-09-19T06:06:00.119 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 2.c [2,4] 2024-09-19T06:06:00.119 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 2.13 [2,11] 2024-09-19T06:06:00.120 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 2.1d [8,11] 2024-09-19T06:06:00.120 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 3.6 [4,6] 2024-09-19T06:06:00.120 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 3.25 [5,9] 2024-09-19T06:06:00.120 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 3.36 [4,9] 2024-09-19T06:06:00.120 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 3.3c [4,9] 2024-09-19T06:06:00.120 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 4.e [5,8] 2024-09-19T06:06:00.120 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 4.f [9,8] 2024-09-19T06:06:00.120 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 4.17 [9,8] 2024-09-19T06:06:00.120 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:6801/133577710 expires 2024-09-20T05:57:12.560771+0000 2024-09-19T06:06:00.120 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:6800/133577710 expires 2024-09-20T05:57:12.560771+0000 2024-09-19T06:06:00.120 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:0/2877363162 expires 2024-09-20T05:57:12.560771+0000 2024-09-19T06:06:00.120 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:0/1053171617 expires 2024-09-20T05:57:12.560771+0000 2024-09-19T06:06:00.120 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:6800/3277805697 expires 2024-09-20T05:56:49.335334+0000 2024-09-19T06:06:00.120 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:0/1280697705 expires 2024-09-20T05:56:49.335334+0000 2024-09-19T06:06:00.121 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:0/1106526058 expires 2024-09-20T05:57:12.560771+0000 2024-09-19T06:06:00.121 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:0/1978184693 expires 2024-09-20T05:56:49.335334+0000 2024-09-19T06:06:00.121 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:6801/3277805697 expires 2024-09-20T05:56:49.335334+0000 2024-09-19T06:06:00.121 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:0/3650338877 expires 2024-09-20T05:56:49.335334+0000 2024-09-19T06:06:00.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:00.117+0000 7f48ce88d640 1 -- 172.21.15.37:0/294862020 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f48b00a3300 msgr2=0x7f48b00a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:00.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:00.117+0000 7f48ce88d640 1 --2- 172.21.15.37:0/294862020 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f48b00a3300 0x7f48b00a57c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f48c8102c60 tx=0x7f48b8005f90 comp rx=0 tx=0).stop 2024-09-19T06:06:00.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:00.117+0000 7f48ce88d640 1 -- 172.21.15.37:0/294862020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48c81037c0 msgr2=0x7f48c819f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:00.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:00.117+0000 7f48ce88d640 1 --2- 172.21.15.37:0/294862020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48c81037c0 0x7f48c819f390 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f48c0005e30 tx=0x7f48c0031ee0 comp rx=0 tx=0).stop 2024-09-19T06:06:00.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:00.117+0000 7f48ce88d640 1 -- 172.21.15.37:0/294862020 shutdown_connections 2024-09-19T06:06:00.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:00.117+0000 7f48ce88d640 1 --2- 172.21.15.37:0/294862020 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f48b00a3300 0x7f48b00a57c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:00.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:00.117+0000 7f48ce88d640 1 --2- 172.21.15.37:0/294862020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48c81037c0 0x7f48c819f390 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:00.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:00.117+0000 7f48ce88d640 1 --2- 172.21.15.37:0/294862020 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48c8102e00 0x7f48c8198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:00.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:00.117+0000 7f48ce88d640 1 --2- 172.21.15.37:0/294862020 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48c8101c00 0x7f48c8197dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:00.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:00.117+0000 7f48ce88d640 1 -- 172.21.15.37:0/294862020 >> 172.21.15.37:0/294862020 conn(0x7f48c80fd390 msgr2=0x7f48c8106100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:00.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:00.117+0000 7f48ce88d640 1 -- 172.21.15.37:0/294862020 shutdown_connections 2024-09-19T06:06:00.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:00.117+0000 7f48ce88d640 1 -- 172.21.15.37:0/294862020 wait complete. 2024-09-19T06:06:00.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:05:59 smithi117 ceph-mon[35050]: pgmap v342: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:06:00.438 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:05:59 smithi099 ceph-mon[35300]: pgmap v342: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:06:00.885 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-19T06:06:00.897 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:06:01.162 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:06:01.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:06:00 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/294862020' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T06:06:01.284 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:06:00 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/294862020' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T06:06:01.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:06:00 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/294862020' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T06:06:01.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:01.643+0000 7f4e0b130640 1 -- 172.21.15.37:0/1643213375 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e04106f10 msgr2=0x7f4e0410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:01.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:01.643+0000 7f4e0b130640 1 --2- 172.21.15.37:0/1643213375 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e04106f10 0x7f4e0410ea90 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc009ca0 tx=0x7f4dfc02a8c0 comp rx=0 tx=0).stop 2024-09-19T06:06:01.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:01.643+0000 7f4e0b130640 1 -- 172.21.15.37:0/1643213375 shutdown_connections 2024-09-19T06:06:01.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:01.643+0000 7f4e0b130640 1 --2- 172.21.15.37:0/1643213375 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e04106f10 0x7f4e0410ea90 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:01.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:01.643+0000 7f4e0b130640 1 --2- 172.21.15.37:0/1643213375 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e04102790 0x7f4e041067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:01.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:01.643+0000 7f4e0b130640 1 --2- 172.21.15.37:0/1643213375 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e04101de0 0x7f4e041021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:01.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:01.643+0000 7f4e0b130640 1 -- 172.21.15.37:0/1643213375 >> 172.21.15.37:0/1643213375 conn(0x7f4e040fd8c0 msgr2=0x7f4e040ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:01.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:01.643+0000 7f4e0b130640 1 -- 172.21.15.37:0/1643213375 shutdown_connections 2024-09-19T06:06:01.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:01.643+0000 7f4e0b130640 1 -- 172.21.15.37:0/1643213375 wait complete. 2024-09-19T06:06:01.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:01.644+0000 7f4e0b130640 1 Processor -- start 2024-09-19T06:06:01.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:01.644+0000 7f4e0b130640 1 -- start start 2024-09-19T06:06:01.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:01.644+0000 7f4e0b130640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e04101de0 0x7f4e0419a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:01.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:01.644+0000 7f4e0b130640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e04102790 0x7f4e0419ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:01.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:01.644+0000 7f4e0b130640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e04106f10 0x7f4e0419eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:01.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:01.644+0000 7f4e0b130640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4e04111f70 con 0x7f4e04101de0 2024-09-19T06:06:01.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:01.644+0000 7f4e0b130640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f4e04111df0 con 0x7f4e04102790 2024-09-19T06:06:01.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:01.644+0000 7f4e0b130640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4e041120f0 con 0x7f4e04106f10 2024-09-19T06:06:01.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:01.644+0000 7f4e08ecc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e04101de0 0x7f4e0419a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:01.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:01.644+0000 7f4e08ecc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e04101de0 0x7f4e0419a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45136/0 (socket says 172.21.15.37:45136) 2024-09-19T06:06:01.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:01.644+0000 7f4e08ecc640 1 -- 172.21.15.37:0/2926645911 learned_addr learned my addr 172.21.15.37:0/2926645911 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:06:01.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:01.645+0000 7f4e03fff640 1 --2- 172.21.15.37:0/2926645911 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e04102790 0x7f4e0419ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:01.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:01.645+0000 7f4e096cd640 1 --2- 172.21.15.37:0/2926645911 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e04106f10 0x7f4e0419eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:01.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:01.645+0000 7f4e08ecc640 1 -- 172.21.15.37:0/2926645911 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e04106f10 msgr2=0x7f4e0419eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:01.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:01.645+0000 7f4e08ecc640 1 --2- 172.21.15.37:0/2926645911 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e04106f10 0x7f4e0419eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:01.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:01.645+0000 7f4e08ecc640 1 -- 172.21.15.37:0/2926645911 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e04102790 msgr2=0x7f4e0419ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:01.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:01.645+0000 7f4e08ecc640 1 --2- 172.21.15.37:0/2926645911 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e04102790 0x7f4e0419ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:01.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:01.645+0000 7f4e08ecc640 1 -- 172.21.15.37:0/2926645911 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e0419f5c0 con 0x7f4e04101de0 2024-09-19T06:06:01.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:01.645+0000 7f4e08ecc640 1 --2- 172.21.15.37:0/2926645911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e04101de0 0x7f4e0419a610 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f4df800d950 tx=0x7f4df800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:01.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:01.645+0000 7f4e01ffb640 1 -- 172.21.15.37:0/2926645911 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df8017070 con 0x7f4e04101de0 2024-09-19T06:06:01.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:01.645+0000 7f4e01ffb640 1 -- 172.21.15.37:0/2926645911 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4df8009c30 con 0x7f4e04101de0 2024-09-19T06:06:01.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:01.645+0000 7f4e0b130640 1 -- 172.21.15.37:0/2926645911 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e0419f8b0 con 0x7f4e04101de0 2024-09-19T06:06:01.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:01.645+0000 7f4e01ffb640 1 -- 172.21.15.37:0/2926645911 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df800f6b0 con 0x7f4e04101de0 2024-09-19T06:06:01.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:01.645+0000 7f4e0b130640 1 -- 172.21.15.37:0/2926645911 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e041a7190 con 0x7f4e04101de0 2024-09-19T06:06:01.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:01.646+0000 7f4e0b130640 1 -- 172.21.15.37:0/2926645911 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e041021c0 con 0x7f4e04101de0 2024-09-19T06:06:01.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:01.647+0000 7f4e01ffb640 1 -- 172.21.15.37:0/2926645911 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f4df80109d0 con 0x7f4e04101de0 2024-09-19T06:06:01.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:01.648+0000 7f4e01ffb640 1 --2- 172.21.15.37:0/2926645911 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f4df40a3350 0x7f4df40a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:01.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:01.648+0000 7f4e03fff640 1 --2- 172.21.15.37:0/2926645911 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f4df40a3350 0x7f4df40a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:01.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:01.648+0000 7f4e01ffb640 1 -- 172.21.15.37:0/2926645911 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f4df80cfa50 con 0x7f4e04101de0 2024-09-19T06:06:01.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:01.649+0000 7f4e03fff640 1 --2- 172.21.15.37:0/2926645911 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f4df40a3350 0x7f4df40a5810 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4e0410eeb0 tx=0x7f4df0005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:01.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:01.652+0000 7f4e01ffb640 1 -- 172.21.15.37:0/2926645911 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4df8009de0 con 0x7f4e04101de0 2024-09-19T06:06:01.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:01.868+0000 7f4e0b130640 1 -- 172.21.15.37:0/2926645911 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4e0419b970 con 0x7f4e04101de0 2024-09-19T06:06:01.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:01.869+0000 7f4e01ffb640 1 -- 172.21.15.37:0/2926645911 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11842 (secure 0 0 0) 0x7f4df809c250 con 0x7f4e04101de0 2024-09-19T06:06:01.871 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T06:06:01.871 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"btime":"2024-09-19T06:04:42:531480+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14514,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2864247978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2864247978},{"type":"v1","addr":"172.21.15.37:6835","nonce":2864247978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14526,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/633000932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":633000932},{"type":"v1","addr":"172.21.15.37:6837","nonce":633000932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14574,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/3753800615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":3753800615},{"type":"v1","addr":"172.21.15.37:6839","nonce":3753800615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/2718998355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":2718998355},{"type":"v1","addr":"172.21.15.37:6841","nonce":2718998355}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6833/866590207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":866590207},{"type":"v1","addr":"172.21.15.99:6833","nonce":866590207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3898668400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3898668400},{"type":"v1","addr":"172.21.15.117:6833","nonce":3898668400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2650673320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2650673320},{"type":"v1","addr":"172.21.15.99:6835","nonce":2650673320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1097471349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1097471349},{"type":"v1","addr":"172.21.15.117:6835","nonce":1097471349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24457,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1001392672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1001392672},{"type":"v1","addr":"172.21.15.117:6837","nonce":1001392672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/23570935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":23570935},{"type":"v1","addr":"172.21.15.99:6837","nonce":23570935}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:04:06.253034+0000","modified":"2024-09-19T06:04:42.196783+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24485},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24478":{"gid":24478,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6839/1269518339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":1269518339},{"type":"v1","addr":"172.21.15.117:6839","nonce":1269518339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.99:6839/3404812329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":3404812329},{"type":"v1","addr":"172.21.15.99:6839","nonce":3404812329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24485,"qdb_cluster":[24485]},"id":1}]} 2024-09-19T06:06:01.871 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 20 2024-09-19T06:06:01.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:01.871+0000 7f4e0b130640 1 -- 172.21.15.37:0/2926645911 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f4df40a3350 msgr2=0x7f4df40a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:01.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:01.871+0000 7f4e0b130640 1 --2- 172.21.15.37:0/2926645911 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f4df40a3350 0x7f4df40a5810 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4e0410eeb0 tx=0x7f4df0005f90 comp rx=0 tx=0).stop 2024-09-19T06:06:01.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:01.871+0000 7f4e0b130640 1 -- 172.21.15.37:0/2926645911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e04101de0 msgr2=0x7f4e0419a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:01.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:01.871+0000 7f4e0b130640 1 --2- 172.21.15.37:0/2926645911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e04101de0 0x7f4e0419a610 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f4df800d950 tx=0x7f4df800de10 comp rx=0 tx=0).stop 2024-09-19T06:06:01.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:01.871+0000 7f4e0b130640 1 -- 172.21.15.37:0/2926645911 shutdown_connections 2024-09-19T06:06:01.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:01.871+0000 7f4e0b130640 1 --2- 172.21.15.37:0/2926645911 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f4df40a3350 0x7f4df40a5810 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:01.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:01.871+0000 7f4e0b130640 1 --2- 172.21.15.37:0/2926645911 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e04102790 0x7f4e0419ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:01.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:01.871+0000 7f4e0b130640 1 --2- 172.21.15.37:0/2926645911 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e04106f10 0x7f4e0419eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:01.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:01.871+0000 7f4e0b130640 1 --2- 172.21.15.37:0/2926645911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e04101de0 0x7f4e0419a610 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:01.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:01.871+0000 7f4e0b130640 1 -- 172.21.15.37:0/2926645911 >> 172.21.15.37:0/2926645911 conn(0x7f4e040fd8c0 msgr2=0x7f4e040ffc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:01.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:01.871+0000 7f4e0b130640 1 -- 172.21.15.37:0/2926645911 shutdown_connections 2024-09-19T06:06:01.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:01.871+0000 7f4e0b130640 1 -- 172.21.15.37:0/2926645911 wait complete. 2024-09-19T06:06:02.242 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:06:01 smithi037 ceph-mon[31211]: pgmap v343: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:06:02.243 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:06:01 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/2926645911' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:06:02.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:06:01 smithi117 ceph-mon[35050]: pgmap v343: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:06:02.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:06:01 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/2926645911' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:06:02.438 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:06:01 smithi099 ceph-mon[35300]: pgmap v343: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:06:02.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:06:01 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/2926645911' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:06:02.681 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:06:02.944 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:06:03.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:03.429+0000 7f2c14766640 1 -- 172.21.15.37:0/4229779648 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c0c102d40 msgr2=0x7f2c0c103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:03.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:03.429+0000 7f2c14766640 1 --2- 172.21.15.37:0/4229779648 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c0c102d40 0x7f2c0c103120 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2c08009900 tx=0x7f2c0802a480 comp rx=0 tx=0).stop 2024-09-19T06:06:03.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:03.430+0000 7f2c14766640 1 -- 172.21.15.37:0/4229779648 shutdown_connections 2024-09-19T06:06:03.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:03.430+0000 7f2c14766640 1 --2- 172.21.15.37:0/4229779648 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c0c103660 0x7f2c0c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:03.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:03.430+0000 7f2c14766640 1 --2- 172.21.15.37:0/4229779648 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c0c10c170 0x7f2c0c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:03.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:03.430+0000 7f2c14766640 1 --2- 172.21.15.37:0/4229779648 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c0c102d40 0x7f2c0c103120 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:03.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:03.430+0000 7f2c14766640 1 -- 172.21.15.37:0/4229779648 >> 172.21.15.37:0/4229779648 conn(0x7f2c0c0fc7a0 msgr2=0x7f2c0c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:03.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:03.430+0000 7f2c14766640 1 -- 172.21.15.37:0/4229779648 shutdown_connections 2024-09-19T06:06:03.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:03.430+0000 7f2c14766640 1 -- 172.21.15.37:0/4229779648 wait complete. 2024-09-19T06:06:03.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:03.430+0000 7f2c14766640 1 Processor -- start 2024-09-19T06:06:03.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:03.430+0000 7f2c14766640 1 -- start start 2024-09-19T06:06:03.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:03.430+0000 7f2c14766640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c0c102d40 0x7f2c0c198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:03.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:03.430+0000 7f2c14766640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c0c103660 0x7f2c0c198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:03.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:03.430+0000 7f2c14766640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c0c10c170 0x7f2c0c19cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:03.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:03.430+0000 7f2c14766640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2c0c111f70 con 0x7f2c0c102d40 2024-09-19T06:06:03.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:03.430+0000 7f2c14766640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f2c0c111df0 con 0x7f2c0c103660 2024-09-19T06:06:03.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:03.431+0000 7f2c14766640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2c0c1120f0 con 0x7f2c0c10c170 2024-09-19T06:06:03.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:03.431+0000 7f2c12502640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c0c102d40 0x7f2c0c198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:03.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:03.431+0000 7f2c12502640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c0c102d40 0x7f2c0c198430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35630/0 (socket says 172.21.15.37:35630) 2024-09-19T06:06:03.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:03.431+0000 7f2c12502640 1 -- 172.21.15.37:0/922077280 learned_addr learned my addr 172.21.15.37:0/922077280 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:06:03.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:03.431+0000 7f2c12d03640 1 --2- 172.21.15.37:0/922077280 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c0c10c170 0x7f2c0c19cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:03.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:03.431+0000 7f2c11d01640 1 --2- 172.21.15.37:0/922077280 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c0c103660 0x7f2c0c198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:03.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:03.431+0000 7f2c12502640 1 -- 172.21.15.37:0/922077280 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c0c10c170 msgr2=0x7f2c0c19cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:03.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:03.431+0000 7f2c12502640 1 --2- 172.21.15.37:0/922077280 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c0c10c170 0x7f2c0c19cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:03.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:03.431+0000 7f2c12502640 1 -- 172.21.15.37:0/922077280 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c0c103660 msgr2=0x7f2c0c198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:03.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:03.431+0000 7f2c12502640 1 --2- 172.21.15.37:0/922077280 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c0c103660 0x7f2c0c198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:03.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:03.431+0000 7f2c12502640 1 -- 172.21.15.37:0/922077280 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c0c19d3e0 con 0x7f2c0c102d40 2024-09-19T06:06:03.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:03.431+0000 7f2c12502640 1 --2- 172.21.15.37:0/922077280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c0c102d40 0x7f2c0c198430 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f2c08006010 tx=0x7f2c08004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:03.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:03.431+0000 7f2c037fe640 1 -- 172.21.15.37:0/922077280 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c0803f030 con 0x7f2c0c102d40 2024-09-19T06:06:03.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:03.431+0000 7f2c037fe640 1 -- 172.21.15.37:0/922077280 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c08004440 con 0x7f2c0c102d40 2024-09-19T06:06:03.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:03.431+0000 7f2c14766640 1 -- 172.21.15.37:0/922077280 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c0c19d670 con 0x7f2c0c102d40 2024-09-19T06:06:03.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:03.431+0000 7f2c037fe640 1 -- 172.21.15.37:0/922077280 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c08035070 con 0x7f2c0c102d40 2024-09-19T06:06:03.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:03.431+0000 7f2c14766640 1 -- 172.21.15.37:0/922077280 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c0c1a4fb0 con 0x7f2c0c102d40 2024-09-19T06:06:03.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:03.432+0000 7f2c14766640 1 -- 172.21.15.37:0/922077280 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c0c103120 con 0x7f2c0c102d40 2024-09-19T06:06:03.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:03.434+0000 7f2c037fe640 1 -- 172.21.15.37:0/922077280 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f2c08042030 con 0x7f2c0c102d40 2024-09-19T06:06:03.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:03.434+0000 7f2c037fe640 1 --2- 172.21.15.37:0/922077280 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f2bf80a3350 0x7f2bf80a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:03.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:03.434+0000 7f2c11d01640 1 --2- 172.21.15.37:0/922077280 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f2bf80a3350 0x7f2bf80a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:03.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:03.434+0000 7f2c037fe640 1 -- 172.21.15.37:0/922077280 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f2c080f0350 con 0x7f2c0c102d40 2024-09-19T06:06:03.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:03.435+0000 7f2c11d01640 1 --2- 172.21.15.37:0/922077280 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f2bf80a3350 0x7f2bf80a5810 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c10d5b0 tx=0x7f2bfc005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:03.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:03.438+0000 7f2c037fe640 1 -- 172.21.15.37:0/922077280 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2c080bc6c0 con 0x7f2c0c102d40 2024-09-19T06:06:03.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:03.663+0000 7f2c14766640 1 -- 172.21.15.37:0/922077280 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2c0c107210 con 0x7f2c0c102d40 2024-09-19T06:06:03.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:03.664+0000 7f2c037fe640 1 -- 172.21.15.37:0/922077280 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11842 (secure 0 0 0) 0x7f2c080c09c0 con 0x7f2c0c102d40 2024-09-19T06:06:03.667 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T06:06:03.667 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"btime":"2024-09-19T06:04:42:531480+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14514,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2864247978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2864247978},{"type":"v1","addr":"172.21.15.37:6835","nonce":2864247978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14526,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/633000932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":633000932},{"type":"v1","addr":"172.21.15.37:6837","nonce":633000932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14574,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/3753800615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":3753800615},{"type":"v1","addr":"172.21.15.37:6839","nonce":3753800615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/2718998355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":2718998355},{"type":"v1","addr":"172.21.15.37:6841","nonce":2718998355}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6833/866590207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":866590207},{"type":"v1","addr":"172.21.15.99:6833","nonce":866590207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3898668400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3898668400},{"type":"v1","addr":"172.21.15.117:6833","nonce":3898668400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2650673320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2650673320},{"type":"v1","addr":"172.21.15.99:6835","nonce":2650673320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1097471349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1097471349},{"type":"v1","addr":"172.21.15.117:6835","nonce":1097471349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24457,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1001392672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1001392672},{"type":"v1","addr":"172.21.15.117:6837","nonce":1001392672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/23570935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":23570935},{"type":"v1","addr":"172.21.15.99:6837","nonce":23570935}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:04:06.253034+0000","modified":"2024-09-19T06:04:42.196783+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24485},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24478":{"gid":24478,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6839/1269518339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":1269518339},{"type":"v1","addr":"172.21.15.117:6839","nonce":1269518339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.99:6839/3404812329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":3404812329},{"type":"v1","addr":"172.21.15.99:6839","nonce":3404812329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24485,"qdb_cluster":[24485]},"id":1}]} 2024-09-19T06:06:03.667 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 20 2024-09-19T06:06:03.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:03.666+0000 7f2c14766640 1 -- 172.21.15.37:0/922077280 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f2bf80a3350 msgr2=0x7f2bf80a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:03.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:03.666+0000 7f2c14766640 1 --2- 172.21.15.37:0/922077280 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f2bf80a3350 0x7f2bf80a5810 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c10d5b0 tx=0x7f2bfc005f90 comp rx=0 tx=0).stop 2024-09-19T06:06:03.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:03.666+0000 7f2c14766640 1 -- 172.21.15.37:0/922077280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c0c102d40 msgr2=0x7f2c0c198430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:03.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:03.666+0000 7f2c14766640 1 --2- 172.21.15.37:0/922077280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c0c102d40 0x7f2c0c198430 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f2c08006010 tx=0x7f2c08004040 comp rx=0 tx=0).stop 2024-09-19T06:06:03.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:03.666+0000 7f2c14766640 1 -- 172.21.15.37:0/922077280 shutdown_connections 2024-09-19T06:06:03.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:03.666+0000 7f2c14766640 1 --2- 172.21.15.37:0/922077280 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f2bf80a3350 0x7f2bf80a5810 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:03.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:03.666+0000 7f2c14766640 1 --2- 172.21.15.37:0/922077280 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c0c103660 0x7f2c0c198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:03.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:03.666+0000 7f2c14766640 1 --2- 172.21.15.37:0/922077280 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c0c10c170 0x7f2c0c19cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:03.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:03.666+0000 7f2c14766640 1 --2- 172.21.15.37:0/922077280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c0c102d40 0x7f2c0c198430 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:03.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:03.666+0000 7f2c14766640 1 -- 172.21.15.37:0/922077280 >> 172.21.15.37:0/922077280 conn(0x7f2c0c0fc7a0 msgr2=0x7f2c0c0fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:03.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:03.666+0000 7f2c14766640 1 -- 172.21.15.37:0/922077280 shutdown_connections 2024-09-19T06:06:03.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:03.666+0000 7f2c14766640 1 -- 172.21.15.37:0/922077280 wait complete. 2024-09-19T06:06:03.999 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:06:03 smithi099 ceph-mon[35300]: pgmap v344: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:06:04.000 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:06:03 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:06:04.000 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:06:03 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/922077280' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:06:04.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:06:03 smithi117 ceph-mon[35050]: pgmap v344: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:06:04.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:06:03 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:06:04.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:06:03 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/922077280' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:06:04.307 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:06:03 smithi037 ceph-mon[31211]: pgmap v344: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:06:04.307 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:06:03 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:06:04.308 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:06:03 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/922077280' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:06:05.178 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T06:06:05.481 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:06:05.879 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:06:05 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:06:05.879 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:06:05 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:06:05.879 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:06:05 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:06:05.879 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:06:05 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:06:05.879 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:06:05 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:06:05.880 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:06:05 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:06:05.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:06:05 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:06:05.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:06:05 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:06:05.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:06:05 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:06:05.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:06:05 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:06:05.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:06:05 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:06:05.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:06:05 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:06:05.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:05.959+0000 7fb95fbbc640 1 -- 172.21.15.37:0/2789195801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb958106f10 msgr2=0x7fb95810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:05.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:05.959+0000 7fb95fbbc640 1 --2- 172.21.15.37:0/2789195801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb958106f10 0x7fb95810ea90 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb950009ca0 tx=0x7fb95002a8c0 comp rx=0 tx=0).stop 2024-09-19T06:06:05.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:05.959+0000 7fb95fbbc640 1 -- 172.21.15.37:0/2789195801 shutdown_connections 2024-09-19T06:06:05.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:05.959+0000 7fb95fbbc640 1 --2- 172.21.15.37:0/2789195801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb958106f10 0x7fb95810ea90 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:05.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:05.959+0000 7fb95fbbc640 1 --2- 172.21.15.37:0/2789195801 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb958102790 0x7fb9581067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:05.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:05.959+0000 7fb95fbbc640 1 --2- 172.21.15.37:0/2789195801 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb958101de0 0x7fb9581021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:05.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:05.959+0000 7fb95fbbc640 1 -- 172.21.15.37:0/2789195801 >> 172.21.15.37:0/2789195801 conn(0x7fb9580fd8c0 msgr2=0x7fb9580ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:05.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:05.959+0000 7fb95fbbc640 1 -- 172.21.15.37:0/2789195801 shutdown_connections 2024-09-19T06:06:05.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:05.959+0000 7fb95fbbc640 1 -- 172.21.15.37:0/2789195801 wait complete. 2024-09-19T06:06:05.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:05.960+0000 7fb95fbbc640 1 Processor -- start 2024-09-19T06:06:05.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:05.960+0000 7fb95fbbc640 1 -- start start 2024-09-19T06:06:05.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:05.960+0000 7fb95fbbc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb958101de0 0x7fb9580744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:05.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:05.960+0000 7fb95fbbc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb958102790 0x7fb958074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:05.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:05.960+0000 7fb95fbbc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb958106f10 0x7fb958074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:05.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:05.960+0000 7fb95fbbc640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb958111fb0 con 0x7fb958102790 2024-09-19T06:06:05.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:05.960+0000 7fb95fbbc640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb958111e30 con 0x7fb958106f10 2024-09-19T06:06:05.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:05.960+0000 7fb95fbbc640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb958112130 con 0x7fb958101de0 2024-09-19T06:06:05.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:05.960+0000 7fb95d157640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb958102790 0x7fb958074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:05.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:05.960+0000 7fb95d157640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb958102790 0x7fb958074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35634/0 (socket says 172.21.15.37:35634) 2024-09-19T06:06:05.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:05.960+0000 7fb95d157640 1 -- 172.21.15.37:0/3367211919 learned_addr learned my addr 172.21.15.37:0/3367211919 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:06:05.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:05.960+0000 7fb95d958640 1 --2- 172.21.15.37:0/3367211919 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb958101de0 0x7fb9580744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:05.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:05.960+0000 7fb95e159640 1 --2- 172.21.15.37:0/3367211919 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb958106f10 0x7fb958074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:05.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:05.960+0000 7fb95d157640 1 -- 172.21.15.37:0/3367211919 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb958101de0 msgr2=0x7fb9580744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:05.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:05.960+0000 7fb95d157640 1 --2- 172.21.15.37:0/3367211919 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb958101de0 0x7fb9580744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:05.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:05.960+0000 7fb95d157640 1 -- 172.21.15.37:0/3367211919 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb958106f10 msgr2=0x7fb958074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:05.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:05.960+0000 7fb95d157640 1 --2- 172.21.15.37:0/3367211919 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb958106f10 0x7fb958074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:05.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:05.960+0000 7fb95d157640 1 -- 172.21.15.37:0/3367211919 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9581a6980 con 0x7fb958102790 2024-09-19T06:06:05.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:05.960+0000 7fb95d157640 1 --2- 172.21.15.37:0/3367211919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb958102790 0x7fb958074a30 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb94800d770 tx=0x7fb94800db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:05.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:05.961+0000 7fb94effd640 1 -- 172.21.15.37:0/3367211919 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb948017070 con 0x7fb958102790 2024-09-19T06:06:05.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:05.961+0000 7fb94effd640 1 -- 172.21.15.37:0/3367211919 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb948009820 con 0x7fb958102790 2024-09-19T06:06:05.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:05.961+0000 7fb95fbbc640 1 -- 172.21.15.37:0/3367211919 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9581a6c70 con 0x7fb958102790 2024-09-19T06:06:05.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:05.961+0000 7fb94effd640 1 -- 172.21.15.37:0/3367211919 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb948004cd0 con 0x7fb958102790 2024-09-19T06:06:05.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:05.961+0000 7fb95fbbc640 1 -- 172.21.15.37:0/3367211919 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9581a71b0 con 0x7fb958102790 2024-09-19T06:06:05.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:05.962+0000 7fb95fbbc640 1 -- 172.21.15.37:0/3367211919 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9581021c0 con 0x7fb958102790 2024-09-19T06:06:05.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:05.963+0000 7fb94effd640 1 -- 172.21.15.37:0/3367211919 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fb9480099d0 con 0x7fb958102790 2024-09-19T06:06:05.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:05.964+0000 7fb94effd640 1 --2- 172.21.15.37:0/3367211919 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fb9440a3350 0x7fb9440a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:05.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:05.964+0000 7fb95d958640 1 --2- 172.21.15.37:0/3367211919 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fb9440a3350 0x7fb9440a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:05.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:05.964+0000 7fb94effd640 1 -- 172.21.15.37:0/3367211919 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fb9480cfbf0 con 0x7fb958102790 2024-09-19T06:06:05.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:05.964+0000 7fb95d958640 1 --2- 172.21.15.37:0/3367211919 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fb9440a3350 0x7fb9440a5810 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb954009990 tx=0x7fb954009110 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:05.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:05.967+0000 7fb94effd640 1 -- 172.21.15.37:0/3367211919 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb94809c470 con 0x7fb958102790 2024-09-19T06:06:05.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:06:05 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:06:06.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:06:05 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:06:06.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:06:05 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:06:06.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:06:05 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:06:06.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:06:05 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:06:06.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:06:05 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:06:06.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:06.146+0000 7fb95fbbc640 1 -- 172.21.15.37:0/3367211919 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb95810a0f0 con 0x7fb958102790 2024-09-19T06:06:06.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:06.148+0000 7fb94effd640 1 -- 172.21.15.37:0/3367211919 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24726 (secure 0 0 0) 0x7fb94809bd70 con 0x7fb958102790 2024-09-19T06:06:06.150 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T06:06:06.151 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":89,"fsid":"b8c8bdae-764b-11ef-bceb-c7b262605968","created":"2024-09-19T05:56:22.523060+0000","modified":"2024-09-19T06:05:13.720782+0000","last_up_change":"2024-09-19T06:03:12.771014+0000","last_in_change":"2024-09-19T06:02:49.926626+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:59:27.062607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:04:01.918234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:04:04.392543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T06:04:10.877951+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"455bc11d-2b6e-4a0c-90d9-8ab4ef4f9e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1783875173},{"type":"v1","addr":"172.21.15.37:6803","nonce":1783875173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1783875173},{"type":"v1","addr":"172.21.15.37:6805","nonce":1783875173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1783875173},{"type":"v1","addr":"172.21.15.37:6809","nonce":1783875173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1783875173},{"type":"v1","addr":"172.21.15.37:6807","nonce":1783875173}]},"public_addr":"172.21.15.37:6803/1783875173","cluster_addr":"172.21.15.37:6805/1783875173","heartbeat_back_addr":"172.21.15.37:6809/1783875173","heartbeat_front_addr":"172.21.15.37:6807/1783875173","state":["exists","up"]},{"osd":1,"uuid":"3505c162-c342-479d-8ea2-15b7a9d625cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":3414373360},{"type":"v1","addr":"172.21.15.99:6801","nonce":3414373360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":3414373360},{"type":"v1","addr":"172.21.15.99:6803","nonce":3414373360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":3414373360},{"type":"v1","addr":"172.21.15.99:6807","nonce":3414373360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":3414373360},{"type":"v1","addr":"172.21.15.99:6805","nonce":3414373360}]},"public_addr":"172.21.15.99:6801/3414373360","cluster_addr":"172.21.15.99:6803/3414373360","heartbeat_back_addr":"172.21.15.99:6807/3414373360","heartbeat_front_addr":"172.21.15.99:6805/3414373360","state":["exists","up"]},{"osd":2,"uuid":"736ec67f-b5e7-43f0-9303-0c88878ead6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3794943081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3794943081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3794943081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3794943081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3794943081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3794943081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3794943081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3794943081}]},"public_addr":"172.21.15.117:6801/3794943081","cluster_addr":"172.21.15.117:6803/3794943081","heartbeat_back_addr":"172.21.15.117:6807/3794943081","heartbeat_front_addr":"172.21.15.117:6805/3794943081","state":["exists","up"]},{"osd":3,"uuid":"3f784ef7-0cc1-4c86-a03a-b8f13396c835","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2121011955},{"type":"v1","addr":"172.21.15.37:6811","nonce":2121011955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2121011955},{"type":"v1","addr":"172.21.15.37:6813","nonce":2121011955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2121011955},{"type":"v1","addr":"172.21.15.37:6817","nonce":2121011955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2121011955},{"type":"v1","addr":"172.21.15.37:6815","nonce":2121011955}]},"public_addr":"172.21.15.37:6811/2121011955","cluster_addr":"172.21.15.37:6813/2121011955","heartbeat_back_addr":"172.21.15.37:6817/2121011955","heartbeat_front_addr":"172.21.15.37:6815/2121011955","state":["exists","up"]},{"osd":4,"uuid":"d7c16e7f-f599-419b-b4a2-fd6c1cafa0d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":1881025735},{"type":"v1","addr":"172.21.15.99:6809","nonce":1881025735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1881025735},{"type":"v1","addr":"172.21.15.99:6811","nonce":1881025735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1881025735},{"type":"v1","addr":"172.21.15.99:6815","nonce":1881025735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":1881025735},{"type":"v1","addr":"172.21.15.99:6813","nonce":1881025735}]},"public_addr":"172.21.15.99:6809/1881025735","cluster_addr":"172.21.15.99:6811/1881025735","heartbeat_back_addr":"172.21.15.99:6815/1881025735","heartbeat_front_addr":"172.21.15.99:6813/1881025735","state":["exists","up"]},{"osd":5,"uuid":"2f499ab4-3d09-4f96-a709-b4229865c690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1141976511},{"type":"v1","addr":"172.21.15.117:6809","nonce":1141976511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1141976511},{"type":"v1","addr":"172.21.15.117:6811","nonce":1141976511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1141976511},{"type":"v1","addr":"172.21.15.117:6815","nonce":1141976511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1141976511},{"type":"v1","addr":"172.21.15.117:6813","nonce":1141976511}]},"public_addr":"172.21.15.117:6809/1141976511","cluster_addr":"172.21.15.117:6811/1141976511","heartbeat_back_addr":"172.21.15.117:6815/1141976511","heartbeat_front_addr":"172.21.15.117:6813/1141976511","state":["exists","up"]},{"osd":6,"uuid":"10f7fd72-1ae8-4efd-a448-75f4b5054be3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":770433145},{"type":"v1","addr":"172.21.15.37:6819","nonce":770433145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":770433145},{"type":"v1","addr":"172.21.15.37:6821","nonce":770433145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":770433145},{"type":"v1","addr":"172.21.15.37:6825","nonce":770433145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":770433145},{"type":"v1","addr":"172.21.15.37:6823","nonce":770433145}]},"public_addr":"172.21.15.37:6819/770433145","cluster_addr":"172.21.15.37:6821/770433145","heartbeat_back_addr":"172.21.15.37:6825/770433145","heartbeat_front_addr":"172.21.15.37:6823/770433145","state":["exists","up"]},{"osd":7,"uuid":"7199a267-c486-417c-b530-3ff03fc9eb1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1694360992},{"type":"v1","addr":"172.21.15.99:6817","nonce":1694360992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1694360992},{"type":"v1","addr":"172.21.15.99:6819","nonce":1694360992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":1694360992},{"type":"v1","addr":"172.21.15.99:6823","nonce":1694360992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":1694360992},{"type":"v1","addr":"172.21.15.99:6821","nonce":1694360992}]},"public_addr":"172.21.15.99:6817/1694360992","cluster_addr":"172.21.15.99:6819/1694360992","heartbeat_back_addr":"172.21.15.99:6823/1694360992","heartbeat_front_addr":"172.21.15.99:6821/1694360992","state":["exists","up"]},{"osd":8,"uuid":"8d5bb83c-62eb-4ded-8a16-e8d57ab102c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2005866772},{"type":"v1","addr":"172.21.15.117:6817","nonce":2005866772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2005866772},{"type":"v1","addr":"172.21.15.117:6819","nonce":2005866772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2005866772},{"type":"v1","addr":"172.21.15.117:6823","nonce":2005866772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2005866772},{"type":"v1","addr":"172.21.15.117:6821","nonce":2005866772}]},"public_addr":"172.21.15.117:6817/2005866772","cluster_addr":"172.21.15.117:6819/2005866772","heartbeat_back_addr":"172.21.15.117:6823/2005866772","heartbeat_front_addr":"172.21.15.117:6821/2005866772","state":["exists","up"]},{"osd":9,"uuid":"04b6203d-a10c-4a55-8e59-b30012dee02b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1398779376},{"type":"v1","addr":"172.21.15.37:6827","nonce":1398779376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1398779376},{"type":"v1","addr":"172.21.15.37:6829","nonce":1398779376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1398779376},{"type":"v1","addr":"172.21.15.37:6833","nonce":1398779376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1398779376},{"type":"v1","addr":"172.21.15.37:6831","nonce":1398779376}]},"public_addr":"172.21.15.37:6827/1398779376","cluster_addr":"172.21.15.37:6829/1398779376","heartbeat_back_addr":"172.21.15.37:6833/1398779376","heartbeat_front_addr":"172.21.15.37:6831/1398779376","state":["exists","up"]},{"osd":10,"uuid":"bbf8ff4b-29cd-4d56-a30e-ff2de3555f78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2200957302},{"type":"v1","addr":"172.21.15.99:6825","nonce":2200957302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2200957302},{"type":"v1","addr":"172.21.15.99:6827","nonce":2200957302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2200957302},{"type":"v1","addr":"172.21.15.99:6831","nonce":2200957302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2200957302},{"type":"v1","addr":"172.21.15.99:6829","nonce":2200957302}]},"public_addr":"172.21.15.99:6825/2200957302","cluster_addr":"172.21.15.99:6827/2200957302","heartbeat_back_addr":"172.21.15.99:6831/2200957302","heartbeat_front_addr":"172.21.15.99:6829/2200957302","state":["exists","up"]},{"osd":11,"uuid":"041d54f4-a274-47b5-a467-0ce86efd363b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":1354423136},{"type":"v1","addr":"172.21.15.117:6825","nonce":1354423136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":1354423136},{"type":"v1","addr":"172.21.15.117:6827","nonce":1354423136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":1354423136},{"type":"v1","addr":"172.21.15.117:6831","nonce":1354423136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":1354423136},{"type":"v1","addr":"172.21.15.117:6829","nonce":1354423136}]},"public_addr":"172.21.15.117:6825/1354423136","cluster_addr":"172.21.15.117:6827/1354423136","heartbeat_back_addr":"172.21.15.117:6831/1354423136","heartbeat_front_addr":"172.21.15.117:6829/1354423136","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:58:33.697099+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:58:59.641549+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:59:23.811178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:59:49.550214+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:00:15.034610+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:00:39.399651+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:01:05.106379+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:01:30.375956+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:01:54.881549+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:02:21.519316+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:02:46.125918+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:03:11.310862+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.f","mappings":[{"from":9,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6801/133577710":"2024-09-20T05:57:12.560771+0000","172.21.15.37:6800/133577710":"2024-09-20T05:57:12.560771+0000","172.21.15.37:0/2877363162":"2024-09-20T05:57:12.560771+0000","172.21.15.37:0/1053171617":"2024-09-20T05:57:12.560771+0000","172.21.15.37:6800/3277805697":"2024-09-20T05:56:49.335334+0000","172.21.15.37:0/1280697705":"2024-09-20T05:56:49.335334+0000","172.21.15.37:0/1106526058":"2024-09-20T05:57:12.560771+0000","172.21.15.37:0/1978184693":"2024-09-20T05:56:49.335334+0000","172.21.15.37:6801/3277805697":"2024-09-20T05:56:49.335334+0000","172.21.15.37:0/3650338877":"2024-09-20T05:56:49.335334+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:06:06.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:06.150+0000 7fb95fbbc640 1 -- 172.21.15.37:0/3367211919 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fb9440a3350 msgr2=0x7fb9440a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:06.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:06.150+0000 7fb95fbbc640 1 --2- 172.21.15.37:0/3367211919 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fb9440a3350 0x7fb9440a5810 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb954009990 tx=0x7fb954009110 comp rx=0 tx=0).stop 2024-09-19T06:06:06.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:06.150+0000 7fb95fbbc640 1 -- 172.21.15.37:0/3367211919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb958102790 msgr2=0x7fb958074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:06.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:06.150+0000 7fb95fbbc640 1 --2- 172.21.15.37:0/3367211919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb958102790 0x7fb958074a30 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb94800d770 tx=0x7fb94800db70 comp rx=0 tx=0).stop 2024-09-19T06:06:06.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:06.150+0000 7fb95fbbc640 1 -- 172.21.15.37:0/3367211919 shutdown_connections 2024-09-19T06:06:06.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:06.150+0000 7fb95fbbc640 1 --2- 172.21.15.37:0/3367211919 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fb9440a3350 0x7fb9440a5810 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:06.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:06.150+0000 7fb95fbbc640 1 --2- 172.21.15.37:0/3367211919 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb958106f10 0x7fb958074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:06.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:06.150+0000 7fb95fbbc640 1 --2- 172.21.15.37:0/3367211919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb958102790 0x7fb958074a30 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:06.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:06.150+0000 7fb95fbbc640 1 --2- 172.21.15.37:0/3367211919 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb958101de0 0x7fb9580744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:06.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:06.150+0000 7fb95fbbc640 1 -- 172.21.15.37:0/3367211919 >> 172.21.15.37:0/3367211919 conn(0x7fb9580fd8c0 msgr2=0x7fb9580fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:06.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:06.150+0000 7fb95fbbc640 1 -- 172.21.15.37:0/3367211919 shutdown_connections 2024-09-19T06:06:06.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:06.150+0000 7fb95fbbc640 1 -- 172.21.15.37:0/3367211919 wait complete. 2024-09-19T06:06:06.818 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:06:06 smithi037 ceph-mon[31211]: pgmap v345: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:06:06.818 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:06:06 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/3367211919' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:06:06.819 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:06:06 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:06:06.819 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:06:06 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:06:06.819 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:06:06 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:06:06.848 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 20, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T06:04:06.253034+0000', 'modified': '2024-09-19T06:04:42.196783+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24485}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24478': {'gid': 24478, 'name': 'i', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.117:6839/1269518339', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6838', 'nonce': 1269518339}, {'type': 'v1', 'addr': '172.21.15.117:6839', 'nonce': 1269518339}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24485': {'gid': 24485, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.99:6839/3404812329', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6838', 'nonce': 3404812329}, {'type': 'v1', 'addr': '172.21.15.99:6839', 'nonce': 3404812329}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24485, 'qdb_cluster': [24485]} 2024-09-19T06:06:06.848 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-19T06:06:06.848 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-19T06:06:06.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:06:06 smithi099 ceph-mon[35300]: pgmap v345: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:06:06.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:06:06 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/3367211919' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:06:06.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:06:06 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:06:06.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:06:06 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:06:06.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:06:06 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:06:07.001 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:06:06 smithi117 ceph-mon[35050]: pgmap v345: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:06:07.002 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:06:06 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/3367211919' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:06:07.002 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:06:06 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:06:07.002 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:06:06 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:06:07.002 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:06:06 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:06:07.106 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:06:07.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.569+0000 7ff867c74640 1 -- 172.21.15.37:0/3483060238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff860106f10 msgr2=0x7ff86010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:07.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.569+0000 7ff867c74640 1 --2- 172.21.15.37:0/3483060238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff860106f10 0x7ff86010ea90 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff858009ca0 tx=0x7ff85802a8c0 comp rx=0 tx=0).stop 2024-09-19T06:06:07.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.569+0000 7ff867c74640 1 -- 172.21.15.37:0/3483060238 shutdown_connections 2024-09-19T06:06:07.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.569+0000 7ff867c74640 1 --2- 172.21.15.37:0/3483060238 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff860102790 0x7ff8601067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:07.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.569+0000 7ff867c74640 1 --2- 172.21.15.37:0/3483060238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff860106f10 0x7ff86010ea90 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:07.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.569+0000 7ff867c74640 1 --2- 172.21.15.37:0/3483060238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff860101de0 0x7ff8601021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:07.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.569+0000 7ff867c74640 1 -- 172.21.15.37:0/3483060238 >> 172.21.15.37:0/3483060238 conn(0x7ff8600fd8c0 msgr2=0x7ff8600ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:07.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.569+0000 7ff867c74640 1 -- 172.21.15.37:0/3483060238 shutdown_connections 2024-09-19T06:06:07.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.569+0000 7ff867c74640 1 -- 172.21.15.37:0/3483060238 wait complete. 2024-09-19T06:06:07.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.570+0000 7ff867c74640 1 Processor -- start 2024-09-19T06:06:07.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.570+0000 7ff867c74640 1 -- start start 2024-09-19T06:06:07.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.570+0000 7ff867c74640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff860101de0 0x7ff8601983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:07.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.570+0000 7ff867c74640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff860102790 0x7ff8601988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:07.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.570+0000 7ff867c74640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff860106f10 0x7ff86019cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:07.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.570+0000 7ff867c74640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff860111f70 con 0x7ff860106f10 2024-09-19T06:06:07.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.570+0000 7ff867c74640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff860111df0 con 0x7ff860101de0 2024-09-19T06:06:07.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.570+0000 7ff867c74640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff8601120f0 con 0x7ff860102790 2024-09-19T06:06:07.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.570+0000 7ff866211640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff860106f10 0x7ff86019cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:07.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.570+0000 7ff866211640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff860106f10 0x7ff86019cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35650/0 (socket says 172.21.15.37:35650) 2024-09-19T06:06:07.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.570+0000 7ff866211640 1 -- 172.21.15.37:0/2296651857 learned_addr learned my addr 172.21.15.37:0/2296651857 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:06:07.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.571+0000 7ff86520f640 1 --2- 172.21.15.37:0/2296651857 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff860102790 0x7ff8601988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:07.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.571+0000 7ff865a10640 1 --2- 172.21.15.37:0/2296651857 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff860101de0 0x7ff8601983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:07.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.571+0000 7ff866211640 1 -- 172.21.15.37:0/2296651857 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff860102790 msgr2=0x7ff8601988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:07.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.571+0000 7ff866211640 1 --2- 172.21.15.37:0/2296651857 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff860102790 0x7ff8601988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:07.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.571+0000 7ff866211640 1 -- 172.21.15.37:0/2296651857 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff860101de0 msgr2=0x7ff8601983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:07.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.571+0000 7ff866211640 1 --2- 172.21.15.37:0/2296651857 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff860101de0 0x7ff8601983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:07.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.571+0000 7ff866211640 1 -- 172.21.15.37:0/2296651857 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff86019d350 con 0x7ff860106f10 2024-09-19T06:06:07.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.571+0000 7ff86520f640 1 --2- 172.21.15.37:0/2296651857 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff860102790 0x7ff8601988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:06:07.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.571+0000 7ff866211640 1 --2- 172.21.15.37:0/2296651857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff860106f10 0x7ff86019cc70 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ff858031a20 tx=0x7ff858031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:07.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.571+0000 7ff856ffd640 1 -- 172.21.15.37:0/2296651857 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff858003c30 con 0x7ff860106f10 2024-09-19T06:06:07.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.571+0000 7ff856ffd640 1 -- 172.21.15.37:0/2296651857 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff858003dd0 con 0x7ff860106f10 2024-09-19T06:06:07.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.571+0000 7ff856ffd640 1 -- 172.21.15.37:0/2296651857 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff85802fc40 con 0x7ff860106f10 2024-09-19T06:06:07.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.571+0000 7ff867c74640 1 -- 172.21.15.37:0/2296651857 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff86019d5e0 con 0x7ff860106f10 2024-09-19T06:06:07.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.571+0000 7ff867c74640 1 -- 172.21.15.37:0/2296651857 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8601a4f20 con 0x7ff860106f10 2024-09-19T06:06:07.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.573+0000 7ff856ffd640 1 -- 172.21.15.37:0/2296651857 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7ff858004050 con 0x7ff860106f10 2024-09-19T06:06:07.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.574+0000 7ff86a04d740 1 Processor -- start 2024-09-19T06:06:07.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.574+0000 7ff86a04d740 1 -- start start 2024-09-19T06:06:07.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.574+0000 7ff86a04d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5652084c8de0 0x5652084c91c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:07.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.574+0000 7ff86a04d740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5652084c9700 0x5652084d3a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:07.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.574+0000 7ff86a04d740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5652084d3fc0 0x5652084d63b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:07.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.574+0000 7ff86a04d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56520842b090 con 0x5652084c8de0 2024-09-19T06:06:07.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.574+0000 7ff86a04d740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5652083d2a70 con 0x5652084c9700 2024-09-19T06:06:07.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.574+0000 7ff86a04d740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x565208427050 con 0x5652084d3fc0 2024-09-19T06:06:07.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.574+0000 7ff86520f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5652084c8de0 0x5652084c91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:07.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.574+0000 7ff86520f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5652084c8de0 0x5652084c91c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35656/0 (socket says 172.21.15.37:35656) 2024-09-19T06:06:07.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.574+0000 7ff86520f640 1 -- 172.21.15.37:0/1332035915 learned_addr learned my addr 172.21.15.37:0/1332035915 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:06:07.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.574+0000 7ff856ffd640 1 --2- 172.21.15.37:0/2296651857 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7ff84c0a3350 0x7ff84c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:07.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.574+0000 7ff865a10640 1 --2- 172.21.15.37:0/1332035915 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5652084c9700 0x5652084d3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:07.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.574+0000 7ff86520f640 1 --2- 172.21.15.37:0/1332035915 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5652084d3fc0 0x5652084d63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:07.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.575+0000 7ff86520f640 1 -- 172.21.15.37:0/1332035915 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5652084d3fc0 msgr2=0x5652084d63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:06:07.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.575+0000 7ff86520f640 1 --2- 172.21.15.37:0/1332035915 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5652084d3fc0 0x5652084d63b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:07.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.575+0000 7ff86520f640 1 -- 172.21.15.37:0/1332035915 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5652084c9700 msgr2=0x5652084d3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:06:07.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.575+0000 7ff86520f640 1 --2- 172.21.15.37:0/1332035915 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5652084c9700 0x5652084d3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:07.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.575+0000 7ff866211640 1 --2- 172.21.15.37:0/2296651857 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7ff84c0a3350 0x7ff84c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:07.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.575+0000 7ff86520f640 1 -- 172.21.15.37:0/1332035915 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652083df130 con 0x5652084c8de0 2024-09-19T06:06:07.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.575+0000 7ff856ffd640 1 -- 172.21.15.37:0/2296651857 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7ff8580f0f50 con 0x7ff860106f10 2024-09-19T06:06:07.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.575+0000 7ff86520f640 1 --2- 172.21.15.37:0/1332035915 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5652084c8de0 0x5652084c91c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff850009fd0 tx=0x7ff850009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd32f63c44bff8d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:07.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.575+0000 7ff84bfff640 1 -- 172.21.15.37:0/1332035915 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff850010490 con 0x5652084c8de0 2024-09-19T06:06:07.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.575+0000 7ff84bfff640 1 -- 172.21.15.37:0/1332035915 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff850010b10 con 0x5652084c8de0 2024-09-19T06:06:07.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.575+0000 7ff84bfff640 1 -- 172.21.15.37:0/1332035915 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff850011aa0 con 0x5652084c8de0 2024-09-19T06:06:07.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.576+0000 7ff86a04d740 1 -- 172.21.15.37:0/1332035915 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5652084c8de0 msgr2=0x5652084c91c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:07.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.576+0000 7ff866211640 1 --2- 172.21.15.37:0/2296651857 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7ff84c0a3350 0x7ff84c0a5810 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff8580bcf50 tx=0x7ff85808f020 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:07.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.576+0000 7ff86a04d740 1 --2- 172.21.15.37:0/1332035915 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5652084c8de0 0x5652084c91c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff850009fd0 tx=0x7ff850009780 comp rx=0 tx=0).stop 2024-09-19T06:06:07.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.576+0000 7ff86a04d740 1 -- 172.21.15.37:0/1332035915 shutdown_connections 2024-09-19T06:06:07.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.576+0000 7ff86a04d740 1 --2- 172.21.15.37:0/1332035915 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5652084c9700 0x5652084d3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:07.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.576+0000 7ff86a04d740 1 --2- 172.21.15.37:0/1332035915 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5652084d3fc0 0x5652084d63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:07.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.576+0000 7ff86a04d740 1 --2- 172.21.15.37:0/1332035915 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5652084c8de0 0x5652084c91c0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:07.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.576+0000 7ff86a04d740 1 -- 172.21.15.37:0/1332035915 >> 172.21.15.37:0/1332035915 conn(0x5652084c5370 msgr2=0x5652084c5750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:07.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.576+0000 7ff86a04d740 1 -- 172.21.15.37:0/1332035915 shutdown_connections 2024-09-19T06:06:07.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.576+0000 7ff86a04d740 1 -- 172.21.15.37:0/1332035915 wait complete. 2024-09-19T06:06:07.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.576+0000 7ff86a04d740 1 -- start start 2024-09-19T06:06:07.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.576+0000 7ff86a04d740 1 Processor -- start 2024-09-19T06:06:07.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.577+0000 7ff86a04d740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5652084c8de0 0x5652084d3840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:07.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.577+0000 7ff86a04d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5652084c9700 0x5652084d0b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:07.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.577+0000 7ff86a04d740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5652084d3fc0 0x5652084d10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:07.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.577+0000 7ff86a04d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5652084d6b90 con 0x5652084c9700 2024-09-19T06:06:07.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.577+0000 7ff86a04d740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5652083e5f20 con 0x5652084d3fc0 2024-09-19T06:06:07.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.577+0000 7ff86a04d740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5652084d6d10 con 0x5652084c8de0 2024-09-19T06:06:07.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.577+0000 7ff86a04d740 10 client.0 _ll_register_callbacks cb 0x5652083af030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:06:07.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.577+0000 7ff865a10640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5652084c9700 0x5652084d0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:07.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.577+0000 7ff865a10640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5652084c9700 0x5652084d0b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35666/0 (socket says 172.21.15.37:35666) 2024-09-19T06:06:07.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.577+0000 7ff865a10640 1 -- 172.21.15.37:0/3139867901 learned_addr learned my addr 172.21.15.37:0/3139867901 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:06:07.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.577+0000 7ff86520f640 1 --2- 172.21.15.37:0/3139867901 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5652084c8de0 0x5652084d3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:07.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.577+0000 7ff86520f640 1 --2- 172.21.15.37:0/3139867901 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5652084d3fc0 0x5652084d10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:07.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.577+0000 7ff865a10640 1 -- 172.21.15.37:0/3139867901 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5652084c8de0 msgr2=0x5652084d3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:06:07.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.577+0000 7ff865a10640 1 --2- 172.21.15.37:0/3139867901 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5652084c8de0 0x5652084d3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:07.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.577+0000 7ff865a10640 1 -- 172.21.15.37:0/3139867901 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5652084d3fc0 msgr2=0x5652084d10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:06:07.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.577+0000 7ff865a10640 1 --2- 172.21.15.37:0/3139867901 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5652084d3fc0 0x5652084d10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:07.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.577+0000 7ff865a10640 1 -- 172.21.15.37:0/3139867901 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56520819c2b0 con 0x5652084c9700 2024-09-19T06:06:07.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.577+0000 7ff86520f640 1 --2- 172.21.15.37:0/3139867901 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5652084d3fc0 0x5652084d10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:06:07.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.577+0000 7ff865a10640 1 --2- 172.21.15.37:0/3139867901 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5652084c9700 0x5652084d0b90 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff85c00bed0 tx=0x7ff85c0117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d545bb9e552dc292 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:07.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.577+0000 7ff8497fa640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-19T06:06:07.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.577+0000 7ff8497fa640 1 -- 172.21.15.37:0/3139867901 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff85c012650 con 0x5652084c9700 2024-09-19T06:06:07.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.577+0000 7ff8497fa640 1 -- 172.21.15.37:0/3139867901 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7ff85c0127f0 con 0x5652084c9700 2024-09-19T06:06:07.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.577+0000 7ff86a04d740 1 -- 172.21.15.37:0/3139867901 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff850010b10 con 0x5652084c9700 2024-09-19T06:06:07.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.578+0000 7ff8497fa640 1 -- 172.21.15.37:0/3139867901 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ff85c0129f0 con 0x5652084c9700 2024-09-19T06:06:07.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.578+0000 7ff86a04d740 10 client.15114 fetch_fsmap learned FSMap version 20 2024-09-19T06:06:07.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.578+0000 7ff86a04d740 1 -- 172.21.15.37:0/3139867901 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5652084e2500 con 0x5652084c9700 2024-09-19T06:06:07.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.578+0000 7ff8497fa640 1 -- 172.21.15.37:0/3139867901 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff850010b10 con 0x5652084c9700 2024-09-19T06:06:07.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.578+0000 7ff8497fa640 1 -- 172.21.15.37:0/3139867901 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 20) ==== 8338+0+0 (secure 0 0 0) 0x7ff85c01a3d0 con 0x5652084c9700 2024-09-19T06:06:07.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.578+0000 7ff86a04d740 10 client.15114 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:06:07.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.578+0000 7ff86a04d740 10 client.15114 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T06:06:07.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.578+0000 7ff86a04d740 20 client.15114 populate_metadata read hostname 'smithi037' 2024-09-19T06:06:07.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.578+0000 7ff86a04d740 1 --2- 172.21.15.37:0/3139867901 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x5652084e4b90 0x5652084e6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:07.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.578+0000 7ff86a04d740 4 client.15114 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:06:07.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.578+0000 7ff86a04d740 1 -- 172.21.15.37:0/3139867901 --> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565208438600 con 0x5652084e4b90 2024-09-19T06:06:07.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.578+0000 7ff86520f640 1 --2- 172.21.15.37:0/3139867901 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x5652084e4b90 0x5652084e6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:07.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.579+0000 7ff8497fa640 10 client.15114 ms_handle_connect on v2:172.21.15.99:6838/3404812329 2024-09-19T06:06:07.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.579+0000 7ff86520f640 1 --2- 172.21.15.37:0/3139867901 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x5652084e4b90 0x5652084e6000 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2626a369cccae36d server_cookie=be50012cf3bd2e69 in_seq=0 out_seq=0 2024-09-19T06:06:07.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.579+0000 7ff8497fa640 1 -- 172.21.15.37:0/3139867901 <== mds.0 v2:172.21.15.99:6838/3404812329 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x565208438600 con 0x5652084e4b90 2024-09-19T06:06:07.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.580+0000 7ff8497fa640 10 client.15114 handle_command_reply: tid=0 2024-09-19T06:06:07.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.580+0000 7ff86a04d740 1 client.15114 shutdown 2024-09-19T06:06:07.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.580+0000 7ff86a04d740 1 -- 172.21.15.37:0/3139867901 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5652084c9700 msgr2=0x5652084d0b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:07.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.580+0000 7ff86a04d740 1 --2- 172.21.15.37:0/3139867901 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5652084c9700 0x5652084d0b90 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff85c00bed0 tx=0x7ff85c0117b0 comp rx=0 tx=0).stop 2024-09-19T06:06:07.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.580+0000 7ff86a04d740 1 -- 172.21.15.37:0/3139867901 shutdown_connections 2024-09-19T06:06:07.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.580+0000 7ff86a04d740 1 --2- 172.21.15.37:0/3139867901 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x5652084e4b90 0x5652084e6000 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:07.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.580+0000 7ff86a04d740 1 --2- 172.21.15.37:0/3139867901 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5652084d3fc0 0x5652084d10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:07.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.580+0000 7ff86a04d740 1 --2- 172.21.15.37:0/3139867901 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5652084c9700 0x5652084d0b90 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:07.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.580+0000 7ff86a04d740 1 --2- 172.21.15.37:0/3139867901 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5652084c8de0 0x5652084d3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:07.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.580+0000 7ff8497fa640 0 client.15114 ms_handle_reset on v2:172.21.15.99:6838/3404812329 2024-09-19T06:06:07.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.580+0000 7ff86a04d740 1 -- 172.21.15.37:0/3139867901 >> 172.21.15.37:0/3139867901 conn(0x5652084c5370 msgr2=0x5652084cb0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:07.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.580+0000 7ff86a04d740 1 -- 172.21.15.37:0/3139867901 shutdown_connections 2024-09-19T06:06:07.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.580+0000 7ff86a04d740 1 -- 172.21.15.37:0/3139867901 wait complete. 2024-09-19T06:06:07.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.580+0000 7ff86a04d740 20 client.15114 trim_cache size 0 max 16384 2024-09-19T06:06:07.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.598+0000 7ff86a04d740 1 Processor -- start 2024-09-19T06:06:07.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.598+0000 7ff86a04d740 1 -- start start 2024-09-19T06:06:07.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.598+0000 7ff86a04d740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5652084c8de0 0x5652084e6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:07.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.598+0000 7ff86a04d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5652084c9700 0x5652084ee2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:07.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.598+0000 7ff86a04d740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5652084d3fc0 0x5652084ee820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:07.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.598+0000 7ff86a04d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5652084e4340 con 0x5652084c9700 2024-09-19T06:06:07.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.598+0000 7ff86a04d740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5652084e4a10 con 0x5652084c8de0 2024-09-19T06:06:07.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.598+0000 7ff86a04d740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5652084e50e0 con 0x5652084d3fc0 2024-09-19T06:06:07.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.598+0000 7ff865a10640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5652084c9700 0x5652084ee2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:07.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.598+0000 7ff865a10640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5652084c9700 0x5652084ee2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35682/0 (socket says 172.21.15.37:35682) 2024-09-19T06:06:07.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.598+0000 7ff865a10640 1 -- 172.21.15.37:0/969193212 learned_addr learned my addr 172.21.15.37:0/969193212 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:06:07.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.598+0000 7ff86520f640 1 --2- 172.21.15.37:0/969193212 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5652084d3fc0 0x5652084ee820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:07.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.598+0000 7ff86520f640 1 --2- 172.21.15.37:0/969193212 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5652084c8de0 0x5652084e6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:07.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.599+0000 7ff865a10640 1 -- 172.21.15.37:0/969193212 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5652084d3fc0 msgr2=0x5652084ee820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:06:07.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.599+0000 7ff865a10640 1 --2- 172.21.15.37:0/969193212 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5652084d3fc0 0x5652084ee820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:07.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.599+0000 7ff865a10640 1 -- 172.21.15.37:0/969193212 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5652084c8de0 msgr2=0x5652084e6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:06:07.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.599+0000 7ff865a10640 1 --2- 172.21.15.37:0/969193212 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5652084c8de0 0x5652084e6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:07.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.599+0000 7ff865a10640 1 -- 172.21.15.37:0/969193212 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652084c4e10 con 0x5652084c9700 2024-09-19T06:06:07.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.599+0000 7ff86520f640 1 --2- 172.21.15.37:0/969193212 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5652084c8de0 0x5652084e6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:06:07.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.599+0000 7ff865a10640 1 --2- 172.21.15.37:0/969193212 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5652084c9700 0x5652084ee2e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff85c005cd0 tx=0x7ff85c00ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6cb7f8d791c16b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:07.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.599+0000 7ff84b7fe640 1 -- 172.21.15.37:0/969193212 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff85c01acb0 con 0x5652084c9700 2024-09-19T06:06:07.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.599+0000 7ff84b7fe640 1 -- 172.21.15.37:0/969193212 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff85c02f070 con 0x5652084c9700 2024-09-19T06:06:07.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.599+0000 7ff84b7fe640 1 -- 172.21.15.37:0/969193212 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff85c0052a0 con 0x5652084c9700 2024-09-19T06:06:07.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.600+0000 7ff86a04d740 1 -- 172.21.15.37:0/969193212 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5652084c9700 msgr2=0x5652084ee2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:07.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.600+0000 7ff86a04d740 1 --2- 172.21.15.37:0/969193212 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5652084c9700 0x5652084ee2e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff85c005cd0 tx=0x7ff85c00ba70 comp rx=0 tx=0).stop 2024-09-19T06:06:07.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.600+0000 7ff86a04d740 1 -- 172.21.15.37:0/969193212 shutdown_connections 2024-09-19T06:06:07.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.600+0000 7ff86a04d740 1 --2- 172.21.15.37:0/969193212 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5652084d3fc0 0x5652084ee820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:07.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.600+0000 7ff86a04d740 1 --2- 172.21.15.37:0/969193212 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5652084c9700 0x5652084ee2e0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:07.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.600+0000 7ff86a04d740 1 --2- 172.21.15.37:0/969193212 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5652084c8de0 0x5652084e6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:07.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.600+0000 7ff86a04d740 1 -- 172.21.15.37:0/969193212 >> 172.21.15.37:0/969193212 conn(0x5652084c5370 msgr2=0x5652084cf460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:07.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.600+0000 7ff86a04d740 1 -- 172.21.15.37:0/969193212 shutdown_connections 2024-09-19T06:06:07.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.600+0000 7ff86a04d740 1 -- 172.21.15.37:0/969193212 wait complete. 2024-09-19T06:06:07.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.600+0000 7ff86a04d740 1 -- start start 2024-09-19T06:06:07.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.600+0000 7ff86a04d740 1 Processor -- start 2024-09-19T06:06:07.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.601+0000 7ff86a04d740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5652084c8de0 0x5652084e9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:07.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.601+0000 7ff86a04d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5652084c9700 0x5652084e9970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:07.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.601+0000 7ff86a04d740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5652084d3fc0 0x56520854d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:07.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.601+0000 7ff86a04d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5652084e5e80 con 0x5652084c9700 2024-09-19T06:06:07.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.601+0000 7ff86a04d740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5652084e57b0 con 0x5652084c8de0 2024-09-19T06:06:07.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.601+0000 7ff86a04d740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5652084e6550 con 0x5652084d3fc0 2024-09-19T06:06:07.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.601+0000 7ff86a04d740 10 client.0 _ll_register_callbacks cb 0x7ff85c00b400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:06:07.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.601+0000 7ff865a10640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5652084c9700 0x5652084e9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:07.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.601+0000 7ff865a10640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5652084c9700 0x5652084e9970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35690/0 (socket says 172.21.15.37:35690) 2024-09-19T06:06:07.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.601+0000 7ff865a10640 1 -- 172.21.15.37:0/1002646853 learned_addr learned my addr 172.21.15.37:0/1002646853 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:06:07.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.601+0000 7ff86520f640 1 --2- 172.21.15.37:0/1002646853 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5652084d3fc0 0x56520854d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:07.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.601+0000 7ff86520f640 1 --2- 172.21.15.37:0/1002646853 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5652084c8de0 0x5652084e9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:07.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.601+0000 7ff865a10640 1 -- 172.21.15.37:0/1002646853 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5652084d3fc0 msgr2=0x56520854d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:06:07.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.601+0000 7ff865a10640 1 --2- 172.21.15.37:0/1002646853 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5652084d3fc0 0x56520854d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:07.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.601+0000 7ff865a10640 1 -- 172.21.15.37:0/1002646853 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5652084c8de0 msgr2=0x5652084e9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:06:07.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.601+0000 7ff865a10640 1 --2- 172.21.15.37:0/1002646853 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5652084c8de0 0x5652084e9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:07.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.601+0000 7ff865a10640 1 -- 172.21.15.37:0/1002646853 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56520854d7d0 con 0x5652084c9700 2024-09-19T06:06:07.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.601+0000 7ff86520f640 1 --2- 172.21.15.37:0/1002646853 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5652084c8de0 0x5652084e9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:06:07.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.601+0000 7ff865a10640 1 --2- 172.21.15.37:0/1002646853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5652084c9700 0x5652084e9970 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ff85c01a960 tx=0x7ff85c00b380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=211a941dab7a8e48 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:07.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.601+0000 7ff8497fa640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-19T06:06:07.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.601+0000 7ff8497fa640 1 -- 172.21.15.37:0/1002646853 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff85c01a5d0 con 0x5652084c9700 2024-09-19T06:06:07.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.602+0000 7ff8497fa640 1 -- 172.21.15.37:0/1002646853 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7ff85c012450 con 0x5652084c9700 2024-09-19T06:06:07.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.602+0000 7ff86a04d740 1 -- 172.21.15.37:0/1002646853 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff85c02f070 con 0x5652084c9700 2024-09-19T06:06:07.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.602+0000 7ff8497fa640 1 -- 172.21.15.37:0/1002646853 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ff85c044050 con 0x5652084c9700 2024-09-19T06:06:07.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.602+0000 7ff86a04d740 10 client.15120 fetch_fsmap learned FSMap version 20 2024-09-19T06:06:07.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.602+0000 7ff86a04d740 1 -- 172.21.15.37:0/1002646853 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x56520854e9f0 con 0x5652084c9700 2024-09-19T06:06:07.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.602+0000 7ff8497fa640 1 -- 172.21.15.37:0/1002646853 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff85c02f070 con 0x5652084c9700 2024-09-19T06:06:07.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.602+0000 7ff8497fa640 1 -- 172.21.15.37:0/1002646853 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 20) ==== 8338+0+0 (secure 0 0 0) 0x7ff85c004760 con 0x5652084c9700 2024-09-19T06:06:07.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.602+0000 7ff86a04d740 10 client.15120 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:06:07.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.602+0000 7ff86a04d740 10 client.15120 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T06:06:07.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.602+0000 7ff86a04d740 20 client.15120 populate_metadata read hostname 'smithi037' 2024-09-19T06:06:07.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.602+0000 7ff86a04d740 1 --2- 172.21.15.37:0/1002646853 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x565208553310 0x565208552020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:07.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.602+0000 7ff86a04d740 4 client.15120 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T06:06:07.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.602+0000 7ff86a04d740 1 -- 172.21.15.37:0/1002646853 --> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] -- command(tid 0: {"prefix": "status"}) -- 0x565208432b10 con 0x565208553310 2024-09-19T06:06:07.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.603+0000 7ff86520f640 1 --2- 172.21.15.37:0/1002646853 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x565208553310 0x565208552020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:07.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.603+0000 7ff86520f640 1 --2- 172.21.15.37:0/1002646853 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x565208553310 0x565208552020 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=453f9c0f114016f7 server_cookie=dc7206c79271c06d in_seq=0 out_seq=0 2024-09-19T06:06:07.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.603+0000 7ff8497fa640 10 client.15120 ms_handle_connect on v2:172.21.15.99:6838/3404812329 2024-09-19T06:06:07.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.603+0000 7ff8497fa640 1 -- 172.21.15.37:0/1002646853 <== mds.0 v2:172.21.15.99:6838/3404812329 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x565208432b10 con 0x565208553310 2024-09-19T06:06:07.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.603+0000 7ff8497fa640 10 client.15120 handle_command_reply: tid=0 2024-09-19T06:06:07.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.603+0000 7ff86a04d740 1 client.15120 shutdown 2024-09-19T06:06:07.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.603+0000 7ff86a04d740 1 -- 172.21.15.37:0/1002646853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5652084c9700 msgr2=0x5652084e9970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:07.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.603+0000 7ff86a04d740 1 --2- 172.21.15.37:0/1002646853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5652084c9700 0x5652084e9970 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ff85c01a960 tx=0x7ff85c00b380 comp rx=0 tx=0).stop 2024-09-19T06:06:07.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.603+0000 7ff86a04d740 1 -- 172.21.15.37:0/1002646853 shutdown_connections 2024-09-19T06:06:07.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.603+0000 7ff86a04d740 1 --2- 172.21.15.37:0/1002646853 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x565208553310 0x565208552020 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:07.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.603+0000 7ff86a04d740 1 --2- 172.21.15.37:0/1002646853 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5652084d3fc0 0x56520854d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:07.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.603+0000 7ff86a04d740 1 --2- 172.21.15.37:0/1002646853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5652084c9700 0x5652084e9970 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:07.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.603+0000 7ff86a04d740 1 --2- 172.21.15.37:0/1002646853 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5652084c8de0 0x5652084e9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:07.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.603+0000 7ff8497fa640 0 client.15120 ms_handle_reset on v2:172.21.15.99:6838/3404812329 2024-09-19T06:06:07.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.603+0000 7ff86a04d740 1 -- 172.21.15.37:0/1002646853 >> 172.21.15.37:0/1002646853 conn(0x5652084c5370 msgr2=0x5652084cf850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:07.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.603+0000 7ff86a04d740 1 -- 172.21.15.37:0/1002646853 shutdown_connections 2024-09-19T06:06:07.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.603+0000 7ff86a04d740 1 -- 172.21.15.37:0/1002646853 wait complete. 2024-09-19T06:06:07.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.604+0000 7ff86a04d740 20 client.15120 trim_cache size 0 max 16384 2024-09-19T06:06:07.611 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-19T06:06:07.611 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "b8c8bdae-764b-11ef-bceb-c7b262605968", 2024-09-19T06:06:07.611 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2024-09-19T06:06:07.611 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 24485, 2024-09-19T06:06:07.611 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-09-19T06:06:07.612 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-09-19T06:06:07.612 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-09-19T06:06:07.612 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 121.193120798, 2024-09-19T06:06:07.612 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 20, 2024-09-19T06:06:07.612 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 89, 2024-09-19T06:06:07.612 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 87, 2024-09-19T06:06:07.612 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 132.43057585299999 2024-09-19T06:06:07.612 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-19T06:06:07.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.604+0000 7ff867c74640 1 -- 172.21.15.37:0/2296651857 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7ff84c0a3350 msgr2=0x7ff84c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:07.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.604+0000 7ff867c74640 1 --2- 172.21.15.37:0/2296651857 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7ff84c0a3350 0x7ff84c0a5810 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff8580bcf50 tx=0x7ff85808f020 comp rx=0 tx=0).stop 2024-09-19T06:06:07.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.604+0000 7ff867c74640 1 -- 172.21.15.37:0/2296651857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff860106f10 msgr2=0x7ff86019cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:07.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.604+0000 7ff867c74640 1 --2- 172.21.15.37:0/2296651857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff860106f10 0x7ff86019cc70 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ff858031a20 tx=0x7ff858031a50 comp rx=0 tx=0).stop 2024-09-19T06:06:07.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.604+0000 7ff867c74640 1 -- 172.21.15.37:0/2296651857 shutdown_connections 2024-09-19T06:06:07.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.604+0000 7ff867c74640 1 --2- 172.21.15.37:0/2296651857 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7ff84c0a3350 0x7ff84c0a5810 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:07.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.604+0000 7ff867c74640 1 --2- 172.21.15.37:0/2296651857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff860106f10 0x7ff86019cc70 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:07.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.604+0000 7ff867c74640 1 --2- 172.21.15.37:0/2296651857 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff860102790 0x7ff8601988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:07.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.604+0000 7ff867c74640 1 --2- 172.21.15.37:0/2296651857 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff860101de0 0x7ff8601983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:07.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.604+0000 7ff867c74640 1 -- 172.21.15.37:0/2296651857 >> 172.21.15.37:0/2296651857 conn(0x7ff8600fd8c0 msgr2=0x7ff8600fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:07.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.604+0000 7ff867c74640 1 -- 172.21.15.37:0/2296651857 shutdown_connections 2024-09-19T06:06:07.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:07.604+0000 7ff867c74640 1 -- 172.21.15.37:0/2296651857 wait complete. 2024-09-19T06:06:08.395 INFO:teuthology.run_tasks:Running task sequential... 2024-09-19T06:06:08.404 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-19T06:06:08.405 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-19T06:06:08.405 INFO:teuthology.task.print:Enabling mgr modules 2024-09-19T06:06:08.405 INFO:teuthology.run_tasks:Running task kclient... 2024-09-19T06:06:08.420 INFO:tasks.kclient:Mounting kernel clients... 2024-09-19T06:06:08.420 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-19T06:06:08.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:06:08.420 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2024-09-19T06:06:08.440 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-19T06:06:08.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:06:08.441 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-19T06:06:08.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:06:08.513 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link delete ceph-brx 2024-09-19T06:06:08.610 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'wsync'], 'syntax': 'v1', 'mount_subvol_num': 1} 2024-09-19T06:06:08.610 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-19T06:06:08.610 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T06:06:08.610 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-19T06:06:08.874 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:06:08.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:06:08 smithi099 ceph-mon[35300]: pgmap v346: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:06:08.996 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:06:08 smithi037 ceph-mon[31211]: pgmap v346: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:06:08.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:06:08 smithi117 ceph-mon[35050]: pgmap v346: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:06:09.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:09.388+0000 7f225aa53640 1 -- 172.21.15.37:0/3588155439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2254100e20 msgr2=0x7f2254101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:09.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:09.388+0000 7f225aa53640 1 --2- 172.21.15.37:0/3588155439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2254100e20 0x7f2254101200 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2244009900 tx=0x7f224402a480 comp rx=0 tx=0).stop 2024-09-19T06:06:09.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:09.388+0000 7f225aa53640 1 -- 172.21.15.37:0/3588155439 shutdown_connections 2024-09-19T06:06:09.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:09.388+0000 7f225aa53640 1 --2- 172.21.15.37:0/3588155439 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2254102570 0x7f22541029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:09.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:09.388+0000 7f225aa53640 1 --2- 172.21.15.37:0/3588155439 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2254102ef0 0x7f225410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:09.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:09.388+0000 7f225aa53640 1 --2- 172.21.15.37:0/3588155439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2254100e20 0x7f2254101200 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:09.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:09.388+0000 7f225aa53640 1 -- 172.21.15.37:0/3588155439 >> 172.21.15.37:0/3588155439 conn(0x7f22540fc7d0 msgr2=0x7f22540febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:09.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:09.388+0000 7f225aa53640 1 -- 172.21.15.37:0/3588155439 shutdown_connections 2024-09-19T06:06:09.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:09.388+0000 7f225aa53640 1 -- 172.21.15.37:0/3588155439 wait complete. 2024-09-19T06:06:09.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:09.389+0000 7f225aa53640 1 Processor -- start 2024-09-19T06:06:09.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:09.389+0000 7f225aa53640 1 -- start start 2024-09-19T06:06:09.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:09.389+0000 7f225aa53640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2254100e20 0x7f2254199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:09.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:09.389+0000 7f225aa53640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2254102570 0x7f2254199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:09.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:09.389+0000 7f225aa53640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2254102ef0 0x7f22541a43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:09.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:09.389+0000 7f225aa53640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2254110fa0 con 0x7f2254102ef0 2024-09-19T06:06:09.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:09.389+0000 7f225aa53640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f2254110e20 con 0x7f2254102570 2024-09-19T06:06:09.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:09.389+0000 7f225aa53640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2254111120 con 0x7f2254100e20 2024-09-19T06:06:09.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:09.389+0000 7f2258ff0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2254102ef0 0x7f22541a43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:09.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:09.389+0000 7f2258ff0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2254102ef0 0x7f22541a43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35698/0 (socket says 172.21.15.37:35698) 2024-09-19T06:06:09.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:09.389+0000 7f2258ff0640 1 -- 172.21.15.37:0/2228709997 learned_addr learned my addr 172.21.15.37:0/2228709997 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:06:09.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:09.389+0000 7f2253fff640 1 --2- 172.21.15.37:0/2228709997 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2254100e20 0x7f2254199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:09.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:09.389+0000 7f22537fe640 1 --2- 172.21.15.37:0/2228709997 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2254102570 0x7f2254199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:09.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:09.389+0000 7f2258ff0640 1 -- 172.21.15.37:0/2228709997 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2254100e20 msgr2=0x7f2254199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:09.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:09.389+0000 7f2258ff0640 1 --2- 172.21.15.37:0/2228709997 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2254100e20 0x7f2254199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:09.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:09.389+0000 7f2258ff0640 1 -- 172.21.15.37:0/2228709997 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2254102570 msgr2=0x7f2254199890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:09.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:09.389+0000 7f2258ff0640 1 --2- 172.21.15.37:0/2228709997 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2254102570 0x7f2254199890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:09.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:09.389+0000 7f2258ff0640 1 -- 172.21.15.37:0/2228709997 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22541a4910 con 0x7f2254102ef0 2024-09-19T06:06:09.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:09.389+0000 7f2253fff640 1 --2- 172.21.15.37:0/2228709997 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2254100e20 0x7f2254199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:06:09.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:09.390+0000 7f2258ff0640 1 --2- 172.21.15.37:0/2228709997 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2254102ef0 0x7f22541a43d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f224c00b970 tx=0x7f224c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:09.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:09.390+0000 7f22517fa640 1 -- 172.21.15.37:0/2228709997 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f224c019070 con 0x7f2254102ef0 2024-09-19T06:06:09.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:09.390+0000 7f22517fa640 1 -- 172.21.15.37:0/2228709997 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f224c00cb40 con 0x7f2254102ef0 2024-09-19T06:06:09.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:09.390+0000 7f225aa53640 1 -- 172.21.15.37:0/2228709997 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22541a4ae0 con 0x7f2254102ef0 2024-09-19T06:06:09.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:09.390+0000 7f22517fa640 1 -- 172.21.15.37:0/2228709997 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f224c007650 con 0x7f2254102ef0 2024-09-19T06:06:09.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:09.390+0000 7f225aa53640 1 -- 172.21.15.37:0/2228709997 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22541a5020 con 0x7f2254102ef0 2024-09-19T06:06:09.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:09.391+0000 7f225aa53640 1 -- 172.21.15.37:0/2228709997 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2254101200 con 0x7f2254102ef0 2024-09-19T06:06:09.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:09.392+0000 7f22517fa640 1 -- 172.21.15.37:0/2228709997 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f224c01c070 con 0x7f2254102ef0 2024-09-19T06:06:09.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:09.393+0000 7f22517fa640 1 --2- 172.21.15.37:0/2228709997 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f223c0a3350 0x7f223c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:09.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:09.393+0000 7f2253fff640 1 --2- 172.21.15.37:0/2228709997 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f223c0a3350 0x7f223c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:09.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:09.393+0000 7f22517fa640 1 -- 172.21.15.37:0/2228709997 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f224c0cf2b0 con 0x7f2254102ef0 2024-09-19T06:06:09.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:09.393+0000 7f2253fff640 1 --2- 172.21.15.37:0/2228709997 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f223c0a3350 0x7f223c0a5810 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2244000c00 tx=0x7f2244004100 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:09.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:09.397+0000 7f22517fa640 1 -- 172.21.15.37:0/2228709997 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f224c09bc20 con 0x7f2254102ef0 2024-09-19T06:06:09.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:09.611+0000 7f225aa53640 1 -- 172.21.15.37:0/2228709997 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f2254109090 con 0x7f2254102ef0 2024-09-19T06:06:09.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:09.611+0000 7f22517fa640 1 -- 172.21.15.37:0/2228709997 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v20) ==== 53+0+88 (secure 0 0 0) 0x7f224c09b520 con 0x7f2254102ef0 2024-09-19T06:06:09.613 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-19T06:06:09.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:09.613+0000 7f225aa53640 1 -- 172.21.15.37:0/2228709997 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f223c0a3350 msgr2=0x7f223c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:09.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:09.613+0000 7f225aa53640 1 --2- 172.21.15.37:0/2228709997 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f223c0a3350 0x7f223c0a5810 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2244000c00 tx=0x7f2244004100 comp rx=0 tx=0).stop 2024-09-19T06:06:09.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:09.613+0000 7f225aa53640 1 -- 172.21.15.37:0/2228709997 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2254102ef0 msgr2=0x7f22541a43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:09.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:09.613+0000 7f225aa53640 1 --2- 172.21.15.37:0/2228709997 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2254102ef0 0x7f22541a43d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f224c00b970 tx=0x7f224c00be30 comp rx=0 tx=0).stop 2024-09-19T06:06:09.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:09.613+0000 7f225aa53640 1 -- 172.21.15.37:0/2228709997 shutdown_connections 2024-09-19T06:06:09.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:09.613+0000 7f225aa53640 1 --2- 172.21.15.37:0/2228709997 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f223c0a3350 0x7f223c0a5810 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:09.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:09.613+0000 7f225aa53640 1 --2- 172.21.15.37:0/2228709997 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2254102570 0x7f2254199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:09.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:09.613+0000 7f225aa53640 1 --2- 172.21.15.37:0/2228709997 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2254102ef0 0x7f22541a43d0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:09.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:09.613+0000 7f225aa53640 1 --2- 172.21.15.37:0/2228709997 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2254100e20 0x7f2254199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:09.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:09.613+0000 7f225aa53640 1 -- 172.21.15.37:0/2228709997 >> 172.21.15.37:0/2228709997 conn(0x7f22540fc7d0 msgr2=0x7f22540febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:09.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:09.614+0000 7f225aa53640 1 -- 172.21.15.37:0/2228709997 shutdown_connections 2024-09-19T06:06:09.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:09.614+0000 7f225aa53640 1 -- 172.21.15.37:0/2228709997 wait complete. 2024-09-19T06:06:09.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:06:09 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/2228709997' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T06:06:09.968 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:06:09 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/2228709997' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T06:06:10.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:06:09 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/2228709997' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T06:06:10.331 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-19T06:06:10.332 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T06:06:10.332 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2024-09-19T06:06:10.332 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-19T06:06:10.332 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T06:06:10.332 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-19T06:06:10.332 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T06:06:10.332 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T06:06:10.332 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T06:06:10.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:06:10.333 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2024-09-19T06:06:10.350 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T06:06:10.350 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T06:06:10.350 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T06:06:10.350 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-09-19T06:06:10.350 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2024-09-19T06:06:10.350 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-09-19T06:06:10.350 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T06:06:10.350 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2024-09-19T06:06:10.350 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2024-09-19T06:06:10.351 INFO:teuthology.orchestra.run.smithi037.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T06:06:10.351 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2024-09-19T06:06:10.351 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2024-09-19T06:06:10.351 INFO:teuthology.orchestra.run.smithi037.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T06:06:10.351 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2024-09-19T06:06:10.351 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2024-09-19T06:06:10.351 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-19T06:06:10.351 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 42172sec preferred_lft 42172sec 2024-09-19T06:06:10.351 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link 2024-09-19T06:06:10.351 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-09-19T06:06:10.351 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T06:06:10.351 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2024-09-19T06:06:10.351 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2024-09-19T06:06:10.352 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-19T06:06:10.352 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T06:06:10.352 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-09-19T06:06:10.352 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link add name ceph-brx type bridge 2024-09-19T06:06:10.352 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip addr flush dev ceph-brx 2024-09-19T06:06:10.352 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set ceph-brx up 2024-09-19T06:06:10.352 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-19T06:06:10.352 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-09-19T06:06:10.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T06:06:10.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:06:10.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:06:10.495 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T06:06:10.521 INFO:teuthology.orchestra.run.smithi037.stdout:1 2024-09-19T06:06:10.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:06:10.524 DEBUG:teuthology.orchestra.run.smithi037:> route 2024-09-19T06:06:10.581 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2024-09-19T06:06:10.582 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T06:06:10.582 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-19T06:06:10.582 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-19T06:06:10.582 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T06:06:10.582 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T06:06:10.582 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-09-19T06:06:10.582 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-19T06:06:10.582 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-19T06:06:10.582 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-19T06:06:10.583 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-09-19T06:06:10.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T06:06:10.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:06:10.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:06:10.711 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2024-09-19T06:06:10.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:06:10.727 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list-id 2024-09-19T06:06:10.783 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T06:06:10.783 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-09-19T06:06:10.783 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T06:06:10.783 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-19T06:06:10.783 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-09-19T06:06:10.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T06:06:10.880 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:06:10 smithi037 ceph-mon[31211]: pgmap v347: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:06:10.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:06:10.902 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-19T06:06:10.902 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T06:06:10.902 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-09-19T06:06:10.902 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-19T06:06:10.902 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-19T06:06:10.903 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-19T06:06:10.903 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-19T06:06:10.903 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-19T06:06:10.903 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-09-19T06:06:10.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:06:10 smithi099 ceph-mon[35300]: pgmap v347: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:06:10.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T06:06:11.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:06:10 smithi117 ceph-mon[35050]: pgmap v347: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:06:11.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:06:11.019 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T06:06:11.020 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-09-19T06:06:11.020 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2024-09-19T06:06:11.020 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set dev brx.0 master ceph-brx 2024-09-19T06:06:11.020 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-09-19T06:06:11.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T06:06:11.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:06:11.099 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T06:06:11.099 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-19T06:06:11.115 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-19T06:06:11.115 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T06:06:11.115 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-19T06:06:11.171 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-19T06:06:11.172 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-19T06:06:11.172 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/d38e3a0f-a8c2-42d8-99c9-0f41a22bbbfc 2024-09-19T06:06:11.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:06:11.172 DEBUG:teuthology.orchestra.run.smithi037:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/d38e3a0f-a8c2-42d8-99c9-0f41a22bbbfc /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2024-09-19T06:06:11.256 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2024-09-19T06:06:11.257 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync". 2024-09-19T06:06:11.257 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2024-09-19T06:06:11.392 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2024-09-19T06:06:11.392 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync". 2024-09-19T06:06:11.392 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2024-09-19T06:06:11.392 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.99:3300,172.21.15.117:3300" 2024-09-19T06:06:11.392 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.37:3300,172.21.15.99:3300,172.21.15.117:3300:/volumes/qa/sv_1/d38e3a0f-a8c2-42d8-99c9-0f41a22bbbfc 2024-09-19T06:06:11.393 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync,key=0,fsid=b8c8bdae-764b-11ef-bceb-c7b262605968" will pass to kernel 2024-09-19T06:06:11.393 INFO:teuthology.orchestra.run.smithi037.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-19T06:06:11.393 INFO:teuthology.orchestra.run.smithi037.stdout: You just mounted a file system that supports labels which does not 2024-09-19T06:06:11.393 INFO:teuthology.orchestra.run.smithi037.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-19T06:06:11.394 INFO:teuthology.orchestra.run.smithi037.stdout: applications will generate AVC messages and not be allowed access to 2024-09-19T06:06:11.394 INFO:teuthology.orchestra.run.smithi037.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-19T06:06:11.395 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-19T06:06:11.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:06:11.395 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-19T06:06:11.423 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T06:06:11.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T06:06:11.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:06:11.529 INFO:teuthology.orchestra.run.smithi037.stdout:client24836 2024-09-19T06:06:11.530 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-19T06:06:11.530 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T06:06:11.547 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T06:06:11.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T06:06:11.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:06:11.653 INFO:teuthology.orchestra.run.smithi037.stdout:client24836 2024-09-19T06:06:11.654 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T06:06:11.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T06:06:11.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:06:11.718 INFO:teuthology.orchestra.run.smithi037.stdout:client24836 2024-09-19T06:06:11.719 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968.client24836/status') 2024-09-19T06:06:11.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T06:06:11.784 INFO:teuthology.orchestra.run.smithi037.stdout:instance: client.24836 (3)172.21.15.37:0/2852601848 2024-09-19T06:06:11.785 INFO:teuthology.orchestra.run.smithi037.stdout:blocklisted: false 2024-09-19T06:06:11.785 INFO:teuthology.orchestra.run.smithi037.stderr:0+1 records in 2024-09-19T06:06:11.785 INFO:teuthology.orchestra.run.smithi037.stderr:0+1 records out 2024-09-19T06:06:11.785 INFO:teuthology.orchestra.run.smithi037.stderr:71 bytes copied, 2.6026e-05 s, 2.7 MB/s 2024-09-19T06:06:11.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:06:11.792 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-19T06:06:11.804 INFO:teuthology.run_tasks:Running task quiescer... 2024-09-19T06:06:11.833 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T06:06:11.833 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T06:06:12.090 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:06:12.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:12.590+0000 7fbc078b8640 1 -- 172.21.15.37:0/2107218135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc00101de0 msgr2=0x7fbc001021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:12.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:12.590+0000 7fbc078b8640 1 --2- 172.21.15.37:0/2107218135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc00101de0 0x7fbc001021c0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fbbf8009900 tx=0x7fbbf802a410 comp rx=0 tx=0).stop 2024-09-19T06:06:12.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:12.590+0000 7fbc078b8640 1 -- 172.21.15.37:0/2107218135 shutdown_connections 2024-09-19T06:06:12.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:12.590+0000 7fbc078b8640 1 --2- 172.21.15.37:0/2107218135 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc00102790 0x7fbc001067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:12.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:12.590+0000 7fbc078b8640 1 --2- 172.21.15.37:0/2107218135 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc00106f10 0x7fbc0010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:12.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:12.590+0000 7fbc078b8640 1 --2- 172.21.15.37:0/2107218135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc00101de0 0x7fbc001021c0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:12.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:12.590+0000 7fbc078b8640 1 -- 172.21.15.37:0/2107218135 >> 172.21.15.37:0/2107218135 conn(0x7fbc000fd8c0 msgr2=0x7fbc000ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:12.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:12.590+0000 7fbc078b8640 1 -- 172.21.15.37:0/2107218135 shutdown_connections 2024-09-19T06:06:12.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:12.590+0000 7fbc078b8640 1 -- 172.21.15.37:0/2107218135 wait complete. 2024-09-19T06:06:12.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:12.591+0000 7fbc078b8640 1 Processor -- start 2024-09-19T06:06:12.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:12.591+0000 7fbc078b8640 1 -- start start 2024-09-19T06:06:12.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:12.591+0000 7fbc078b8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc00101de0 0x7fbc001985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:12.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:12.591+0000 7fbc078b8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc00102790 0x7fbc00198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:12.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:12.591+0000 7fbc078b8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc00106f10 0x7fbc0019ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:12.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:12.591+0000 7fbc078b8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbc00112010 con 0x7fbc00106f10 2024-09-19T06:06:12.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:12.591+0000 7fbc078b8640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fbc00111e90 con 0x7fbc00101de0 2024-09-19T06:06:12.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:12.591+0000 7fbc078b8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbc00112190 con 0x7fbc00102790 2024-09-19T06:06:12.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:12.591+0000 7fbc05e55640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc00106f10 0x7fbc0019ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:12.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:12.591+0000 7fbc05e55640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc00106f10 0x7fbc0019ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35724/0 (socket says 172.21.15.37:35724) 2024-09-19T06:06:12.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:12.591+0000 7fbc05e55640 1 -- 172.21.15.37:0/3360975249 learned_addr learned my addr 172.21.15.37:0/3360975249 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:06:12.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:12.591+0000 7fbc05654640 1 --2- 172.21.15.37:0/3360975249 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc00101de0 0x7fbc001985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:12.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:12.591+0000 7fbc04e53640 1 --2- 172.21.15.37:0/3360975249 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc00102790 0x7fbc00198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:12.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:12.591+0000 7fbc05e55640 1 -- 172.21.15.37:0/3360975249 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc00102790 msgr2=0x7fbc00198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:12.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:12.591+0000 7fbc05e55640 1 --2- 172.21.15.37:0/3360975249 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc00102790 0x7fbc00198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:12.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:12.591+0000 7fbc05e55640 1 -- 172.21.15.37:0/3360975249 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc00101de0 msgr2=0x7fbc001985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:12.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:12.591+0000 7fbc05e55640 1 --2- 172.21.15.37:0/3360975249 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc00101de0 0x7fbc001985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:12.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:12.591+0000 7fbc05e55640 1 -- 172.21.15.37:0/3360975249 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc0019d560 con 0x7fbc00106f10 2024-09-19T06:06:12.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:12.591+0000 7fbc04e53640 1 --2- 172.21.15.37:0/3360975249 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc00102790 0x7fbc00198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:06:12.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:12.592+0000 7fbc05e55640 1 --2- 172.21.15.37:0/3360975249 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc00106f10 0x7fbc0019ce80 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fbbf000b970 tx=0x7fbbf000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:12.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:12.592+0000 7fbbfe7fc640 1 -- 172.21.15.37:0/3360975249 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbf0019070 con 0x7fbc00106f10 2024-09-19T06:06:12.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:12.592+0000 7fbc078b8640 1 -- 172.21.15.37:0/3360975249 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc0019d850 con 0x7fbc00106f10 2024-09-19T06:06:12.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:12.592+0000 7fbbfe7fc640 1 -- 172.21.15.37:0/3360975249 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbbf000cb40 con 0x7fbc00106f10 2024-09-19T06:06:12.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:12.592+0000 7fbbfe7fc640 1 -- 172.21.15.37:0/3360975249 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbf0007610 con 0x7fbc00106f10 2024-09-19T06:06:12.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:12.592+0000 7fbc078b8640 1 -- 172.21.15.37:0/3360975249 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc001a5130 con 0x7fbc00106f10 2024-09-19T06:06:12.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:12.593+0000 7fbc078b8640 1 -- 172.21.15.37:0/3360975249 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc00102240 con 0x7fbc00106f10 2024-09-19T06:06:12.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:12.594+0000 7fbbfe7fc640 1 -- 172.21.15.37:0/3360975249 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fbbf001c070 con 0x7fbc00106f10 2024-09-19T06:06:12.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:12.595+0000 7fbbfe7fc640 1 --2- 172.21.15.37:0/3360975249 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fbbe80a32d0 0x7fbbe80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:12.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:12.595+0000 7fbbfe7fc640 1 -- 172.21.15.37:0/3360975249 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fbbf00cf730 con 0x7fbc00106f10 2024-09-19T06:06:12.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:12.595+0000 7fbc05654640 1 --2- 172.21.15.37:0/3360975249 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fbbe80a32d0 0x7fbbe80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:12.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:12.595+0000 7fbc05654640 1 --2- 172.21.15.37:0/3360975249 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fbbe80a32d0 0x7fbbe80a5790 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fbbf8000c00 tx=0x7fbbf80058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:12.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:12.598+0000 7fbbfe7fc640 1 -- 172.21.15.37:0/3360975249 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbbf009ba50 con 0x7fbc00106f10 2024-09-19T06:06:12.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:12.806+0000 7fbc078b8640 1 -- 172.21.15.37:0/3360975249 --> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbc00062630 con 0x7fbbe80a32d0 2024-09-19T06:06:12.809 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:06:12 smithi037 ceph-mon[31211]: pgmap v348: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:06:12.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:12.815+0000 7fbbfe7fc640 1 -- 172.21.15.37:0/3360975249 <== mgr.14148 v2:172.21.15.37:6800/3797010169 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340282 (secure 0 0 0) 0x7fbc00062630 con 0x7fbbe80a32d0 2024-09-19T06:06:12.821 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T06:06:12.823 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-19T06:06:12.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:12.818+0000 7fbc078b8640 1 -- 172.21.15.37:0/3360975249 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fbbe80a32d0 msgr2=0x7fbbe80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:12.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:12.818+0000 7fbc078b8640 1 --2- 172.21.15.37:0/3360975249 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fbbe80a32d0 0x7fbbe80a5790 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fbbf8000c00 tx=0x7fbbf80058d0 comp rx=0 tx=0).stop 2024-09-19T06:06:12.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:12.818+0000 7fbc078b8640 1 -- 172.21.15.37:0/3360975249 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc00106f10 msgr2=0x7fbc0019ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:12.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:12.818+0000 7fbc078b8640 1 --2- 172.21.15.37:0/3360975249 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc00106f10 0x7fbc0019ce80 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fbbf000b970 tx=0x7fbbf000be30 comp rx=0 tx=0).stop 2024-09-19T06:06:12.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:12.819+0000 7fbc078b8640 1 -- 172.21.15.37:0/3360975249 shutdown_connections 2024-09-19T06:06:12.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:12.819+0000 7fbc078b8640 1 --2- 172.21.15.37:0/3360975249 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fbbe80a32d0 0x7fbbe80a5790 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:12.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:12.819+0000 7fbc078b8640 1 --2- 172.21.15.37:0/3360975249 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc00106f10 0x7fbc0019ce80 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:12.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:12.819+0000 7fbc078b8640 1 --2- 172.21.15.37:0/3360975249 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc00102790 0x7fbc00198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:12.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:12.819+0000 7fbc078b8640 1 --2- 172.21.15.37:0/3360975249 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc00101de0 0x7fbc001985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:12.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:12.819+0000 7fbc078b8640 1 -- 172.21.15.37:0/3360975249 >> 172.21.15.37:0/3360975249 conn(0x7fbc000fd8c0 msgr2=0x7fbc000fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:12.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:12.819+0000 7fbc078b8640 1 -- 172.21.15.37:0/3360975249 shutdown_connections 2024-09-19T06:06:12.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:12.819+0000 7fbc078b8640 1 -- 172.21.15.37:0/3360975249 wait complete. 2024-09-19T06:06:12.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:06:12 smithi099 ceph-mon[35300]: pgmap v348: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:06:12.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:06:12 smithi117 ceph-mon[35050]: pgmap v348: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:06:13.461 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":349,"stamp":"2024-09-19T06:06:12.676605+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654911,"num_objects":26,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":315,"num_read_kb":268,"num_write":266,"num_write_kb":3031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180770,"num_keys_recovered":10,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":209,"ondisk_log_size":209,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":363088,"kb_used_data":13760,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124578736,"statfs":{"total":1151940427776,"available":1151568625664,"internally_reserved":0,"allocated":14090240,"data_stored":7921171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":357414202},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003161"},"pg_stats":[{"pgid":"2.1f","version":"81'4","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724504+0000","last_change":"2024-09-19T06:04:03.323722+0000","last_active":"2024-09-19T06:05:13.724504+0000","last_peered":"2024-09-19T06:05:13.724504+0000","last_clean":"2024-09-19T06:05:13.724504+0000","last_became_active":"2024-09-19T06:04:03.323380+0000","last_became_peered":"2024-09-19T06:04:03.323380+0000","last_unstale":"2024-09-19T06:05:13.724504+0000","last_undegraded":"2024-09-19T06:05:13.724504+0000","last_fullsized":"2024-09-19T06:05:13.724504+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:49:17.449780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.729434+0000","last_change":"2024-09-19T06:04:05.427994+0000","last_active":"2024-09-19T06:05:13.729434+0000","last_peered":"2024-09-19T06:05:13.729434+0000","last_clean":"2024-09-19T06:05:13.729434+0000","last_became_active":"2024-09-19T06:04:05.427745+0000","last_became_peered":"2024-09-19T06:04:05.427745+0000","last_unstale":"2024-09-19T06:05:13.729434+0000","last_undegraded":"2024-09-19T06:05:13.729434+0000","last_fullsized":"2024-09-19T06:05:13.729434+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:54.917003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727325+0000","last_change":"2024-09-19T06:04:12.463838+0000","last_active":"2024-09-19T06:05:13.727325+0000","last_peered":"2024-09-19T06:05:13.727325+0000","last_clean":"2024-09-19T06:05:13.727325+0000","last_became_active":"2024-09-19T06:04:12.463426+0000","last_became_peered":"2024-09-19T06:04:12.463426+0000","last_unstale":"2024-09-19T06:05:13.727325+0000","last_undegraded":"2024-09-19T06:05:13.727325+0000","last_fullsized":"2024-09-19T06:05:13.727325+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:40:37.994203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"81'1","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.729765+0000","last_change":"2024-09-19T06:04:03.378129+0000","last_active":"2024-09-19T06:05:13.729765+0000","last_peered":"2024-09-19T06:05:13.729765+0000","last_clean":"2024-09-19T06:05:13.729765+0000","last_became_active":"2024-09-19T06:04:03.377793+0000","last_became_peered":"2024-09-19T06:04:03.377793+0000","last_unstale":"2024-09-19T06:05:13.729765+0000","last_undegraded":"2024-09-19T06:05:13.729765+0000","last_fullsized":"2024-09-19T06:05:13.729765+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:38:22.739168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727550+0000","last_change":"2024-09-19T06:04:05.433909+0000","last_active":"2024-09-19T06:05:13.727550+0000","last_peered":"2024-09-19T06:05:13.727550+0000","last_clean":"2024-09-19T06:05:13.727550+0000","last_became_active":"2024-09-19T06:04:05.433591+0000","last_became_peered":"2024-09-19T06:04:05.433591+0000","last_unstale":"2024-09-19T06:05:13.727550+0000","last_undegraded":"2024-09-19T06:05:13.727550+0000","last_fullsized":"2024-09-19T06:05:13.727550+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:19:18.916703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.725870+0000","last_change":"2024-09-19T06:04:12.468984+0000","last_active":"2024-09-19T06:05:13.725870+0000","last_peered":"2024-09-19T06:05:13.725870+0000","last_clean":"2024-09-19T06:05:13.725870+0000","last_became_active":"2024-09-19T06:04:12.467287+0000","last_became_peered":"2024-09-19T06:04:12.467287+0000","last_unstale":"2024-09-19T06:05:13.725870+0000","last_undegraded":"2024-09-19T06:05:13.725870+0000","last_fullsized":"2024-09-19T06:05:13.725870+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:05:46.279679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.739408+0000","last_change":"2024-09-19T06:05:13.739034+0000","last_active":"2024-09-19T06:05:13.739408+0000","last_peered":"2024-09-19T06:05:13.739408+0000","last_clean":"2024-09-19T06:05:13.739408+0000","last_became_active":"2024-09-19T06:05:13.731532+0000","last_became_peered":"2024-09-19T06:05:13.731532+0000","last_unstale":"2024-09-19T06:05:13.739408+0000","last_undegraded":"2024-09-19T06:05:13.739408+0000","last_fullsized":"2024-09-19T06:05:13.739408+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:52:21.543579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:15.014328+0000","last_change":"2024-09-19T06:04:05.430288+0000","last_active":"2024-09-19T06:05:15.014328+0000","last_peered":"2024-09-19T06:05:15.014328+0000","last_clean":"2024-09-19T06:05:15.014328+0000","last_became_active":"2024-09-19T06:04:05.429947+0000","last_became_peered":"2024-09-19T06:04:05.429947+0000","last_unstale":"2024-09-19T06:05:15.014328+0000","last_undegraded":"2024-09-19T06:05:15.014328+0000","last_fullsized":"2024-09-19T06:05:15.014328+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:43:09.169658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726358+0000","last_change":"2024-09-19T06:04:12.465946+0000","last_active":"2024-09-19T06:05:13.726358+0000","last_peered":"2024-09-19T06:05:13.726358+0000","last_clean":"2024-09-19T06:05:13.726358+0000","last_became_active":"2024-09-19T06:04:12.465553+0000","last_became_peered":"2024-09-19T06:04:12.465553+0000","last_unstale":"2024-09-19T06:05:13.726358+0000","last_undegraded":"2024-09-19T06:05:13.726358+0000","last_fullsized":"2024-09-19T06:05:13.726358+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:50:41.181483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.728044+0000","last_change":"2024-09-19T06:04:03.318528+0000","last_active":"2024-09-19T06:05:13.728044+0000","last_peered":"2024-09-19T06:05:13.728044+0000","last_clean":"2024-09-19T06:05:13.728044+0000","last_became_active":"2024-09-19T06:04:03.318210+0000","last_became_peered":"2024-09-19T06:04:03.318210+0000","last_unstale":"2024-09-19T06:05:13.728044+0000","last_undegraded":"2024-09-19T06:05:13.728044+0000","last_fullsized":"2024-09-19T06:05:13.728044+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:06.766545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.475029+0000","last_change":"2024-09-19T06:04:05.427025+0000","last_active":"2024-09-19T06:05:14.475029+0000","last_peered":"2024-09-19T06:05:14.475029+0000","last_clean":"2024-09-19T06:05:14.475029+0000","last_became_active":"2024-09-19T06:04:05.425679+0000","last_became_peered":"2024-09-19T06:04:05.425679+0000","last_unstale":"2024-09-19T06:05:14.475029+0000","last_undegraded":"2024-09-19T06:05:14.475029+0000","last_fullsized":"2024-09-19T06:05:14.475029+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:26:06.480664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726043+0000","last_change":"2024-09-19T06:04:12.467065+0000","last_active":"2024-09-19T06:05:13.726043+0000","last_peered":"2024-09-19T06:05:13.726043+0000","last_clean":"2024-09-19T06:05:13.726043+0000","last_became_active":"2024-09-19T06:04:12.465961+0000","last_became_peered":"2024-09-19T06:04:12.465961+0000","last_unstale":"2024-09-19T06:05:13.726043+0000","last_undegraded":"2024-09-19T06:05:13.726043+0000","last_fullsized":"2024-09-19T06:05:13.726043+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:13:38.566692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724364+0000","last_change":"2024-09-19T06:04:05.436202+0000","last_active":"2024-09-19T06:05:13.724364+0000","last_peered":"2024-09-19T06:05:13.724364+0000","last_clean":"2024-09-19T06:05:13.724364+0000","last_became_active":"2024-09-19T06:04:05.435779+0000","last_became_peered":"2024-09-19T06:04:05.435779+0000","last_unstale":"2024-09-19T06:05:13.724364+0000","last_undegraded":"2024-09-19T06:05:13.724364+0000","last_fullsized":"2024-09-19T06:05:13.724364+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:27:56.463592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727084+0000","last_change":"2024-09-19T06:04:03.320472+0000","last_active":"2024-09-19T06:05:13.727084+0000","last_peered":"2024-09-19T06:05:13.727084+0000","last_clean":"2024-09-19T06:05:13.727084+0000","last_became_active":"2024-09-19T06:04:03.320178+0000","last_became_peered":"2024-09-19T06:04:03.320178+0000","last_unstale":"2024-09-19T06:05:13.727084+0000","last_undegraded":"2024-09-19T06:05:13.727084+0000","last_fullsized":"2024-09-19T06:05:13.727084+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:23.285302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727113+0000","last_change":"2024-09-19T06:04:12.635733+0000","last_active":"2024-09-19T06:05:13.727113+0000","last_peered":"2024-09-19T06:05:13.727113+0000","last_clean":"2024-09-19T06:05:13.727113+0000","last_became_active":"2024-09-19T06:04:12.634938+0000","last_became_peered":"2024-09-19T06:04:12.634938+0000","last_unstale":"2024-09-19T06:05:13.727113+0000","last_undegraded":"2024-09-19T06:05:13.727113+0000","last_fullsized":"2024-09-19T06:05:13.727113+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:44:09.015733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.729473+0000","last_change":"2024-09-19T06:04:05.418702+0000","last_active":"2024-09-19T06:05:13.729473+0000","last_peered":"2024-09-19T06:05:13.729473+0000","last_clean":"2024-09-19T06:05:13.729473+0000","last_became_active":"2024-09-19T06:04:05.418213+0000","last_became_peered":"2024-09-19T06:04:05.418213+0000","last_unstale":"2024-09-19T06:05:13.729473+0000","last_undegraded":"2024-09-19T06:05:13.729473+0000","last_fullsized":"2024-09-19T06:05:13.729473+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:46:01.865286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727965+0000","last_change":"2024-09-19T06:04:03.323683+0000","last_active":"2024-09-19T06:05:13.727965+0000","last_peered":"2024-09-19T06:05:13.727965+0000","last_clean":"2024-09-19T06:05:13.727965+0000","last_became_active":"2024-09-19T06:04:03.323166+0000","last_became_peered":"2024-09-19T06:04:03.323166+0000","last_unstale":"2024-09-19T06:05:13.727965+0000","last_undegraded":"2024-09-19T06:05:13.727965+0000","last_fullsized":"2024-09-19T06:05:13.727965+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:53.787307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"87'1","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726853+0000","last_change":"2024-09-19T06:04:12.467620+0000","last_active":"2024-09-19T06:05:13.726853+0000","last_peered":"2024-09-19T06:05:13.726853+0000","last_clean":"2024-09-19T06:05:13.726853+0000","last_became_active":"2024-09-19T06:04:12.467231+0000","last_became_peered":"2024-09-19T06:04:12.467231+0000","last_unstale":"2024-09-19T06:05:13.726853+0000","last_undegraded":"2024-09-19T06:05:13.726853+0000","last_fullsized":"2024-09-19T06:05:13.726853+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:12:07.731338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726950+0000","last_change":"2024-09-19T06:04:05.426415+0000","last_active":"2024-09-19T06:05:13.726950+0000","last_peered":"2024-09-19T06:05:13.726950+0000","last_clean":"2024-09-19T06:05:13.726950+0000","last_became_active":"2024-09-19T06:04:05.426061+0000","last_became_peered":"2024-09-19T06:04:05.426061+0000","last_unstale":"2024-09-19T06:05:13.726950+0000","last_undegraded":"2024-09-19T06:05:13.726950+0000","last_fullsized":"2024-09-19T06:05:13.726950+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:44.810600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.729834+0000","last_change":"2024-09-19T06:04:03.319185+0000","last_active":"2024-09-19T06:05:13.729834+0000","last_peered":"2024-09-19T06:05:13.729834+0000","last_clean":"2024-09-19T06:05:13.729834+0000","last_became_active":"2024-09-19T06:04:03.318788+0000","last_became_peered":"2024-09-19T06:04:03.318788+0000","last_unstale":"2024-09-19T06:05:13.729834+0000","last_undegraded":"2024-09-19T06:05:13.729834+0000","last_fullsized":"2024-09-19T06:05:13.729834+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:41:14.668303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.476753+0000","last_change":"2024-09-19T06:05:14.476214+0000","last_active":"2024-09-19T06:05:14.476753+0000","last_peered":"2024-09-19T06:05:14.476753+0000","last_clean":"2024-09-19T06:05:14.476753+0000","last_became_active":"2024-09-19T06:05:14.475721+0000","last_became_peered":"2024-09-19T06:05:14.475721+0000","last_unstale":"2024-09-19T06:05:14.476753+0000","last_undegraded":"2024-09-19T06:05:14.476753+0000","last_fullsized":"2024-09-19T06:05:14.476753+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:15:37.925870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,2,5],"acting":[8,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727210+0000","last_change":"2024-09-19T06:04:05.428027+0000","last_active":"2024-09-19T06:05:13.727210+0000","last_peered":"2024-09-19T06:05:13.727210+0000","last_clean":"2024-09-19T06:05:13.727210+0000","last_became_active":"2024-09-19T06:04:05.427698+0000","last_became_peered":"2024-09-19T06:04:05.427698+0000","last_unstale":"2024-09-19T06:05:13.727210+0000","last_undegraded":"2024-09-19T06:05:13.727210+0000","last_fullsized":"2024-09-19T06:05:13.727210+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:06:34.627086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:15.014198+0000","last_change":"2024-09-19T06:04:03.380435+0000","last_active":"2024-09-19T06:05:15.014198+0000","last_peered":"2024-09-19T06:05:15.014198+0000","last_clean":"2024-09-19T06:05:15.014198+0000","last_became_active":"2024-09-19T06:04:03.380102+0000","last_became_peered":"2024-09-19T06:04:03.380102+0000","last_unstale":"2024-09-19T06:05:15.014198+0000","last_undegraded":"2024-09-19T06:05:15.014198+0000","last_fullsized":"2024-09-19T06:05:15.014198+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:43.886466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.730251+0000","last_change":"2024-09-19T06:05:13.730251+0000","last_active":"2024-09-19T06:05:13.730251+0000","last_peered":"2024-09-19T06:05:13.730251+0000","last_clean":"2024-09-19T06:05:13.730251+0000","last_became_active":"2024-09-19T06:05:13.729757+0000","last_became_peered":"2024-09-19T06:05:13.729757+0000","last_unstale":"2024-09-19T06:05:13.730251+0000","last_undegraded":"2024-09-19T06:05:13.730251+0000","last_fullsized":"2024-09-19T06:05:13.730251+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:57:09.816160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,10,9],"acting":[4,8,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.160089+0000","last_change":"2024-09-19T06:05:14.160089+0000","last_active":"2024-09-19T06:05:14.160089+0000","last_peered":"2024-09-19T06:05:14.160089+0000","last_clean":"2024-09-19T06:05:14.160089+0000","last_became_active":"2024-09-19T06:05:14.159695+0000","last_became_peered":"2024-09-19T06:05:14.159695+0000","last_unstale":"2024-09-19T06:05:14.160089+0000","last_undegraded":"2024-09-19T06:05:14.160089+0000","last_fullsized":"2024-09-19T06:05:14.160089+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:12:52.838620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"81'2","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726594+0000","last_change":"2024-09-19T06:04:03.376510+0000","last_active":"2024-09-19T06:05:13.726594+0000","last_peered":"2024-09-19T06:05:13.726594+0000","last_clean":"2024-09-19T06:05:13.726594+0000","last_became_active":"2024-09-19T06:04:03.376241+0000","last_became_peered":"2024-09-19T06:04:03.376241+0000","last_unstale":"2024-09-19T06:05:13.726594+0000","last_undegraded":"2024-09-19T06:05:13.726594+0000","last_fullsized":"2024-09-19T06:05:13.726594+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:19:29.209233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727510+0000","last_change":"2024-09-19T06:04:12.462237+0000","last_active":"2024-09-19T06:05:13.727510+0000","last_peered":"2024-09-19T06:05:13.727510+0000","last_clean":"2024-09-19T06:05:13.727510+0000","last_became_active":"2024-09-19T06:04:12.461771+0000","last_became_peered":"2024-09-19T06:04:12.461771+0000","last_unstale":"2024-09-19T06:05:13.727510+0000","last_undegraded":"2024-09-19T06:05:13.727510+0000","last_fullsized":"2024-09-19T06:05:13.727510+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:46:42.780847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.730324+0000","last_change":"2024-09-19T06:04:05.420472+0000","last_active":"2024-09-19T06:05:13.730324+0000","last_peered":"2024-09-19T06:05:13.730324+0000","last_clean":"2024-09-19T06:05:13.730324+0000","last_became_active":"2024-09-19T06:04:05.420147+0000","last_became_peered":"2024-09-19T06:04:05.420147+0000","last_unstale":"2024-09-19T06:05:13.730324+0000","last_undegraded":"2024-09-19T06:05:13.730324+0000","last_fullsized":"2024-09-19T06:05:13.730324+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:38.616378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724491+0000","last_change":"2024-09-19T06:04:03.316655+0000","last_active":"2024-09-19T06:05:13.724491+0000","last_peered":"2024-09-19T06:05:13.724491+0000","last_clean":"2024-09-19T06:05:13.724491+0000","last_became_active":"2024-09-19T06:04:03.316296+0000","last_became_peered":"2024-09-19T06:04:03.316296+0000","last_unstale":"2024-09-19T06:05:13.724491+0000","last_undegraded":"2024-09-19T06:05:13.724491+0000","last_fullsized":"2024-09-19T06:05:13.724491+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:02:06.320482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.729377+0000","last_change":"2024-09-19T06:04:12.635106+0000","last_active":"2024-09-19T06:05:13.729377+0000","last_peered":"2024-09-19T06:05:13.729377+0000","last_clean":"2024-09-19T06:05:13.729377+0000","last_became_active":"2024-09-19T06:04:12.634671+0000","last_became_peered":"2024-09-19T06:04:12.634671+0000","last_unstale":"2024-09-19T06:05:13.729377+0000","last_undegraded":"2024-09-19T06:05:13.729377+0000","last_fullsized":"2024-09-19T06:05:13.729377+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:54:22.428102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.158806+0000","last_change":"2024-09-19T06:04:05.427483+0000","last_active":"2024-09-19T06:05:14.158806+0000","last_peered":"2024-09-19T06:05:14.158806+0000","last_clean":"2024-09-19T06:05:14.158806+0000","last_became_active":"2024-09-19T06:04:05.427092+0000","last_became_peered":"2024-09-19T06:04:05.427092+0000","last_unstale":"2024-09-19T06:05:14.158806+0000","last_undegraded":"2024-09-19T06:05:14.158806+0000","last_fullsized":"2024-09-19T06:05:14.158806+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:50:21.576757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727515+0000","last_change":"2024-09-19T06:04:03.377962+0000","last_active":"2024-09-19T06:05:13.727515+0000","last_peered":"2024-09-19T06:05:13.727515+0000","last_clean":"2024-09-19T06:05:13.727515+0000","last_became_active":"2024-09-19T06:04:03.377686+0000","last_became_peered":"2024-09-19T06:04:03.377686+0000","last_unstale":"2024-09-19T06:05:13.727515+0000","last_undegraded":"2024-09-19T06:05:13.727515+0000","last_fullsized":"2024-09-19T06:05:13.727515+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:00.635765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727360+0000","last_change":"2024-09-19T06:04:12.467349+0000","last_active":"2024-09-19T06:05:13.727360+0000","last_peered":"2024-09-19T06:05:13.727360+0000","last_clean":"2024-09-19T06:05:13.727360+0000","last_became_active":"2024-09-19T06:04:12.466117+0000","last_became_peered":"2024-09-19T06:04:12.466117+0000","last_unstale":"2024-09-19T06:05:13.727360+0000","last_undegraded":"2024-09-19T06:05:13.727360+0000","last_fullsized":"2024-09-19T06:05:13.727360+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:28:03.040586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.728256+0000","last_change":"2024-09-19T06:04:05.429656+0000","last_active":"2024-09-19T06:05:13.728256+0000","last_peered":"2024-09-19T06:05:13.728256+0000","last_clean":"2024-09-19T06:05:13.728256+0000","last_became_active":"2024-09-19T06:04:05.429023+0000","last_became_peered":"2024-09-19T06:04:05.429023+0000","last_unstale":"2024-09-19T06:05:13.728256+0000","last_undegraded":"2024-09-19T06:05:13.728256+0000","last_fullsized":"2024-09-19T06:05:13.728256+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:25:57.627940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724250+0000","last_change":"2024-09-19T06:04:03.378415+0000","last_active":"2024-09-19T06:05:13.724250+0000","last_peered":"2024-09-19T06:05:13.724250+0000","last_clean":"2024-09-19T06:05:13.724250+0000","last_became_active":"2024-09-19T06:04:03.378096+0000","last_became_peered":"2024-09-19T06:04:03.378096+0000","last_unstale":"2024-09-19T06:05:13.724250+0000","last_undegraded":"2024-09-19T06:05:13.724250+0000","last_fullsized":"2024-09-19T06:05:13.724250+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:14:33.988869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726970+0000","last_change":"2024-09-19T06:04:12.635410+0000","last_active":"2024-09-19T06:05:13.726970+0000","last_peered":"2024-09-19T06:05:13.726970+0000","last_clean":"2024-09-19T06:05:13.726970+0000","last_became_active":"2024-09-19T06:04:12.634852+0000","last_became_peered":"2024-09-19T06:04:12.634852+0000","last_unstale":"2024-09-19T06:05:13.726970+0000","last_undegraded":"2024-09-19T06:05:13.726970+0000","last_fullsized":"2024-09-19T06:05:13.726970+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:28:46.014324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.728365+0000","last_change":"2024-09-19T06:04:05.421348+0000","last_active":"2024-09-19T06:05:13.728365+0000","last_peered":"2024-09-19T06:05:13.728365+0000","last_clean":"2024-09-19T06:05:13.728365+0000","last_became_active":"2024-09-19T06:04:05.420999+0000","last_became_peered":"2024-09-19T06:04:05.420999+0000","last_unstale":"2024-09-19T06:05:13.728365+0000","last_undegraded":"2024-09-19T06:05:13.728365+0000","last_fullsized":"2024-09-19T06:05:13.728365+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:52:26.257580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724594+0000","last_change":"2024-09-19T06:04:03.321233+0000","last_active":"2024-09-19T06:05:13.724594+0000","last_peered":"2024-09-19T06:05:13.724594+0000","last_clean":"2024-09-19T06:05:13.724594+0000","last_became_active":"2024-09-19T06:04:03.320755+0000","last_became_peered":"2024-09-19T06:04:03.320755+0000","last_unstale":"2024-09-19T06:05:13.724594+0000","last_undegraded":"2024-09-19T06:05:13.724594+0000","last_fullsized":"2024-09-19T06:05:13.724594+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:46.661751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.158645+0000","last_change":"2024-09-19T06:04:12.463185+0000","last_active":"2024-09-19T06:05:14.158645+0000","last_peered":"2024-09-19T06:05:14.158645+0000","last_clean":"2024-09-19T06:05:14.158645+0000","last_became_active":"2024-09-19T06:04:12.462824+0000","last_became_peered":"2024-09-19T06:04:12.462824+0000","last_unstale":"2024-09-19T06:05:14.158645+0000","last_undegraded":"2024-09-19T06:05:14.158645+0000","last_fullsized":"2024-09-19T06:05:14.158645+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:54:05.634907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.474286+0000","last_change":"2024-09-19T06:04:05.427259+0000","last_active":"2024-09-19T06:05:14.474286+0000","last_peered":"2024-09-19T06:05:14.474286+0000","last_clean":"2024-09-19T06:05:14.474286+0000","last_became_active":"2024-09-19T06:04:05.426955+0000","last_became_peered":"2024-09-19T06:04:05.426955+0000","last_unstale":"2024-09-19T06:05:14.474286+0000","last_undegraded":"2024-09-19T06:05:14.474286+0000","last_fullsized":"2024-09-19T06:05:14.474286+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:34:22.085384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.158553+0000","last_change":"2024-09-19T06:04:03.378174+0000","last_active":"2024-09-19T06:05:14.158553+0000","last_peered":"2024-09-19T06:05:14.158553+0000","last_clean":"2024-09-19T06:05:14.158553+0000","last_became_active":"2024-09-19T06:04:03.377803+0000","last_became_peered":"2024-09-19T06:04:03.377803+0000","last_unstale":"2024-09-19T06:05:14.158553+0000","last_undegraded":"2024-09-19T06:05:14.158553+0000","last_fullsized":"2024-09-19T06:05:14.158553+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:24:26.087284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.158946+0000","last_change":"2024-09-19T06:04:12.635365+0000","last_active":"2024-09-19T06:05:14.158946+0000","last_peered":"2024-09-19T06:05:14.158946+0000","last_clean":"2024-09-19T06:05:14.158946+0000","last_became_active":"2024-09-19T06:04:12.634691+0000","last_became_peered":"2024-09-19T06:04:12.634691+0000","last_unstale":"2024-09-19T06:05:14.158946+0000","last_undegraded":"2024-09-19T06:05:14.158946+0000","last_fullsized":"2024-09-19T06:05:14.158946+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:20:58.523992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.158431+0000","last_change":"2024-09-19T06:04:05.425638+0000","last_active":"2024-09-19T06:05:14.158431+0000","last_peered":"2024-09-19T06:05:14.158431+0000","last_clean":"2024-09-19T06:05:14.158431+0000","last_became_active":"2024-09-19T06:04:05.425356+0000","last_became_peered":"2024-09-19T06:04:05.425356+0000","last_unstale":"2024-09-19T06:05:14.158431+0000","last_undegraded":"2024-09-19T06:05:14.158431+0000","last_fullsized":"2024-09-19T06:05:14.158431+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:51:11.857888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.725170+0000","last_change":"2024-09-19T06:04:03.322432+0000","last_active":"2024-09-19T06:05:13.725170+0000","last_peered":"2024-09-19T06:05:13.725170+0000","last_clean":"2024-09-19T06:05:13.725170+0000","last_became_active":"2024-09-19T06:04:03.322071+0000","last_became_peered":"2024-09-19T06:04:03.322071+0000","last_unstale":"2024-09-19T06:05:13.725170+0000","last_undegraded":"2024-09-19T06:05:13.725170+0000","last_fullsized":"2024-09-19T06:05:13.725170+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:16:23.935470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.474787+0000","last_change":"2024-09-19T06:04:12.635970+0000","last_active":"2024-09-19T06:05:14.474787+0000","last_peered":"2024-09-19T06:05:14.474787+0000","last_clean":"2024-09-19T06:05:14.474787+0000","last_became_active":"2024-09-19T06:04:12.635283+0000","last_became_peered":"2024-09-19T06:04:12.635283+0000","last_unstale":"2024-09-19T06:05:14.474787+0000","last_undegraded":"2024-09-19T06:05:14.474787+0000","last_fullsized":"2024-09-19T06:05:14.474787+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:55:05.460652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.729630+0000","last_change":"2024-09-19T06:04:05.424335+0000","last_active":"2024-09-19T06:05:13.729630+0000","last_peered":"2024-09-19T06:05:13.729630+0000","last_clean":"2024-09-19T06:05:13.729630+0000","last_became_active":"2024-09-19T06:04:05.423868+0000","last_became_peered":"2024-09-19T06:04:05.423868+0000","last_unstale":"2024-09-19T06:05:13.729630+0000","last_undegraded":"2024-09-19T06:05:13.729630+0000","last_fullsized":"2024-09-19T06:05:13.729630+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:17:15.556240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727369+0000","last_change":"2024-09-19T06:04:03.315749+0000","last_active":"2024-09-19T06:05:13.727369+0000","last_peered":"2024-09-19T06:05:13.727369+0000","last_clean":"2024-09-19T06:05:13.727369+0000","last_became_active":"2024-09-19T06:04:03.315404+0000","last_became_peered":"2024-09-19T06:04:03.315404+0000","last_unstale":"2024-09-19T06:05:13.727369+0000","last_undegraded":"2024-09-19T06:05:13.727369+0000","last_fullsized":"2024-09-19T06:05:13.727369+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:43:35.485993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":345,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724597+0000","last_change":"2024-09-19T06:02:49.934106+0000","last_active":"2024-09-19T06:05:13.724597+0000","last_peered":"2024-09-19T06:05:13.724597+0000","last_clean":"2024-09-19T06:05:13.724597+0000","last_became_active":"2024-09-19T06:02:49.933684+0000","last_became_peered":"2024-09-19T06:02:49.933684+0000","last_unstale":"2024-09-19T06:05:13.724597+0000","last_undegraded":"2024-09-19T06:05:13.724597+0000","last_fullsized":"2024-09-19T06:05:13.724597+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:59:27.582796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:59:27.582796+0000","last_clean_scrub_stamp":"2024-09-19T05:59:27.582796+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:35:06.837740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"87'1","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724414+0000","last_change":"2024-09-19T06:04:12.468160+0000","last_active":"2024-09-19T06:05:13.724414+0000","last_peered":"2024-09-19T06:05:13.724414+0000","last_clean":"2024-09-19T06:05:13.724414+0000","last_became_active":"2024-09-19T06:04:12.467642+0000","last_became_peered":"2024-09-19T06:04:12.467642+0000","last_unstale":"2024-09-19T06:05:13.724414+0000","last_undegraded":"2024-09-19T06:05:13.724414+0000","last_fullsized":"2024-09-19T06:05:13.724414+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:40.053143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724738+0000","last_change":"2024-09-19T06:04:05.435815+0000","last_active":"2024-09-19T06:05:13.724738+0000","last_peered":"2024-09-19T06:05:13.724738+0000","last_clean":"2024-09-19T06:05:13.724738+0000","last_became_active":"2024-09-19T06:04:05.435498+0000","last_became_peered":"2024-09-19T06:04:05.435498+0000","last_unstale":"2024-09-19T06:05:13.724738+0000","last_undegraded":"2024-09-19T06:05:13.724738+0000","last_fullsized":"2024-09-19T06:05:13.724738+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:33:30.330877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.731805+0000","last_change":"2024-09-19T06:05:13.730770+0000","last_active":"2024-09-19T06:05:13.731805+0000","last_peered":"2024-09-19T06:05:13.731805+0000","last_clean":"2024-09-19T06:05:13.731805+0000","last_became_active":"2024-09-19T06:05:13.730360+0000","last_became_peered":"2024-09-19T06:05:13.730360+0000","last_unstale":"2024-09-19T06:05:13.731805+0000","last_undegraded":"2024-09-19T06:05:13.731805+0000","last_fullsized":"2024-09-19T06:05:13.731805+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:06:34.488351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:15.014149+0000","last_change":"2024-09-19T06:04:12.466249+0000","last_active":"2024-09-19T06:05:15.014149+0000","last_peered":"2024-09-19T06:05:15.014149+0000","last_clean":"2024-09-19T06:05:15.014149+0000","last_became_active":"2024-09-19T06:04:12.465709+0000","last_became_peered":"2024-09-19T06:04:12.465709+0000","last_unstale":"2024-09-19T06:05:15.014149+0000","last_undegraded":"2024-09-19T06:05:15.014149+0000","last_fullsized":"2024-09-19T06:05:15.014149+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:02:11.454334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724466+0000","last_change":"2024-09-19T06:04:05.425733+0000","last_active":"2024-09-19T06:05:13.724466+0000","last_peered":"2024-09-19T06:05:13.724466+0000","last_clean":"2024-09-19T06:05:13.724466+0000","last_became_active":"2024-09-19T06:04:05.425399+0000","last_became_peered":"2024-09-19T06:04:05.425399+0000","last_unstale":"2024-09-19T06:05:13.724466+0000","last_undegraded":"2024-09-19T06:05:13.724466+0000","last_fullsized":"2024-09-19T06:05:13.724466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:35:33.287456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.475134+0000","last_change":"2024-09-19T06:04:03.319361+0000","last_active":"2024-09-19T06:05:14.475134+0000","last_peered":"2024-09-19T06:05:14.475134+0000","last_clean":"2024-09-19T06:05:14.475134+0000","last_became_active":"2024-09-19T06:04:03.319053+0000","last_became_peered":"2024-09-19T06:04:03.319053+0000","last_unstale":"2024-09-19T06:05:14.475134+0000","last_undegraded":"2024-09-19T06:05:14.475134+0000","last_fullsized":"2024-09-19T06:05:14.475134+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:25:23.739392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726834+0000","last_change":"2024-09-19T06:04:12.468270+0000","last_active":"2024-09-19T06:05:13.726834+0000","last_peered":"2024-09-19T06:05:13.726834+0000","last_clean":"2024-09-19T06:05:13.726834+0000","last_became_active":"2024-09-19T06:04:12.467872+0000","last_became_peered":"2024-09-19T06:04:12.467872+0000","last_unstale":"2024-09-19T06:05:13.726834+0000","last_undegraded":"2024-09-19T06:05:13.726834+0000","last_fullsized":"2024-09-19T06:05:13.726834+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:35.476189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724645+0000","last_change":"2024-09-19T06:04:05.431360+0000","last_active":"2024-09-19T06:05:13.724645+0000","last_peered":"2024-09-19T06:05:13.724645+0000","last_clean":"2024-09-19T06:05:13.724645+0000","last_became_active":"2024-09-19T06:04:05.431067+0000","last_became_peered":"2024-09-19T06:04:05.431067+0000","last_unstale":"2024-09-19T06:05:13.724645+0000","last_undegraded":"2024-09-19T06:05:13.724645+0000","last_fullsized":"2024-09-19T06:05:13.724645+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:16:25.317086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.159080+0000","last_change":"2024-09-19T06:04:03.316793+0000","last_active":"2024-09-19T06:05:14.159080+0000","last_peered":"2024-09-19T06:05:14.159080+0000","last_clean":"2024-09-19T06:05:14.159080+0000","last_became_active":"2024-09-19T06:04:03.316485+0000","last_became_peered":"2024-09-19T06:04:03.316485+0000","last_unstale":"2024-09-19T06:05:14.159080+0000","last_undegraded":"2024-09-19T06:05:14.159080+0000","last_fullsized":"2024-09-19T06:05:14.159080+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:19:26.427025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.473926+0000","last_change":"2024-09-19T06:04:12.466322+0000","last_active":"2024-09-19T06:05:14.473926+0000","last_peered":"2024-09-19T06:05:14.473926+0000","last_clean":"2024-09-19T06:05:14.473926+0000","last_became_active":"2024-09-19T06:04:12.465806+0000","last_became_peered":"2024-09-19T06:04:12.465806+0000","last_unstale":"2024-09-19T06:05:14.473926+0000","last_undegraded":"2024-09-19T06:05:14.473926+0000","last_fullsized":"2024-09-19T06:05:14.473926+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:33:28.893570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727866+0000","last_change":"2024-09-19T06:04:05.424864+0000","last_active":"2024-09-19T06:05:13.727866+0000","last_peered":"2024-09-19T06:05:13.727866+0000","last_clean":"2024-09-19T06:05:13.727866+0000","last_became_active":"2024-09-19T06:04:05.424504+0000","last_became_peered":"2024-09-19T06:04:05.424504+0000","last_unstale":"2024-09-19T06:05:13.727866+0000","last_undegraded":"2024-09-19T06:05:13.727866+0000","last_fullsized":"2024-09-19T06:05:13.727866+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:30.471757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.728243+0000","last_change":"2024-09-19T06:04:03.321925+0000","last_active":"2024-09-19T06:05:13.728243+0000","last_peered":"2024-09-19T06:05:13.728243+0000","last_clean":"2024-09-19T06:05:13.728243+0000","last_became_active":"2024-09-19T06:04:03.321445+0000","last_became_peered":"2024-09-19T06:04:03.321445+0000","last_unstale":"2024-09-19T06:05:13.728243+0000","last_undegraded":"2024-09-19T06:05:13.728243+0000","last_fullsized":"2024-09-19T06:05:13.728243+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:15:55.621352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.474063+0000","last_change":"2024-09-19T06:04:12.471413+0000","last_active":"2024-09-19T06:05:14.474063+0000","last_peered":"2024-09-19T06:05:14.474063+0000","last_clean":"2024-09-19T06:05:14.474063+0000","last_became_active":"2024-09-19T06:04:12.471057+0000","last_became_peered":"2024-09-19T06:04:12.471057+0000","last_unstale":"2024-09-19T06:05:14.474063+0000","last_undegraded":"2024-09-19T06:05:14.474063+0000","last_fullsized":"2024-09-19T06:05:14.474063+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:08:47.259211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.474222+0000","last_change":"2024-09-19T06:04:05.429447+0000","last_active":"2024-09-19T06:05:14.474222+0000","last_peered":"2024-09-19T06:05:14.474222+0000","last_clean":"2024-09-19T06:05:14.474222+0000","last_became_active":"2024-09-19T06:04:05.428852+0000","last_became_peered":"2024-09-19T06:04:05.428852+0000","last_unstale":"2024-09-19T06:05:14.474222+0000","last_undegraded":"2024-09-19T06:05:14.474222+0000","last_fullsized":"2024-09-19T06:05:14.474222+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:01.466814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726844+0000","last_change":"2024-09-19T06:04:03.378586+0000","last_active":"2024-09-19T06:05:13.726844+0000","last_peered":"2024-09-19T06:05:13.726844+0000","last_clean":"2024-09-19T06:05:13.726844+0000","last_became_active":"2024-09-19T06:04:03.378292+0000","last_became_peered":"2024-09-19T06:04:03.378292+0000","last_unstale":"2024-09-19T06:05:13.726844+0000","last_undegraded":"2024-09-19T06:05:13.726844+0000","last_fullsized":"2024-09-19T06:05:13.726844+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:54.247070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.159022+0000","last_change":"2024-09-19T06:04:12.470914+0000","last_active":"2024-09-19T06:05:14.159022+0000","last_peered":"2024-09-19T06:05:14.159022+0000","last_clean":"2024-09-19T06:05:14.159022+0000","last_became_active":"2024-09-19T06:04:12.470563+0000","last_became_peered":"2024-09-19T06:04:12.470563+0000","last_unstale":"2024-09-19T06:05:14.159022+0000","last_undegraded":"2024-09-19T06:05:14.159022+0000","last_fullsized":"2024-09-19T06:05:14.159022+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:13.060646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724169+0000","last_change":"2024-09-19T06:04:05.424009+0000","last_active":"2024-09-19T06:05:13.724169+0000","last_peered":"2024-09-19T06:05:13.724169+0000","last_clean":"2024-09-19T06:05:13.724169+0000","last_became_active":"2024-09-19T06:04:05.423670+0000","last_became_peered":"2024-09-19T06:04:05.423670+0000","last_unstale":"2024-09-19T06:05:13.724169+0000","last_undegraded":"2024-09-19T06:05:13.724169+0000","last_fullsized":"2024-09-19T06:05:13.724169+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:30:15.165259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726323+0000","last_change":"2024-09-19T06:04:03.317089+0000","last_active":"2024-09-19T06:05:13.726323+0000","last_peered":"2024-09-19T06:05:13.726323+0000","last_clean":"2024-09-19T06:05:13.726323+0000","last_became_active":"2024-09-19T06:04:03.316575+0000","last_became_peered":"2024-09-19T06:04:03.316575+0000","last_unstale":"2024-09-19T06:05:13.726323+0000","last_undegraded":"2024-09-19T06:05:13.726323+0000","last_fullsized":"2024-09-19T06:05:13.726323+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:11:43.769660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.732957+0000","last_change":"2024-09-19T06:05:13.731879+0000","last_active":"2024-09-19T06:05:13.732957+0000","last_peered":"2024-09-19T06:05:13.732957+0000","last_clean":"2024-09-19T06:05:13.732957+0000","last_became_active":"2024-09-19T06:05:13.731373+0000","last_became_peered":"2024-09-19T06:05:13.731373+0000","last_unstale":"2024-09-19T06:05:13.732957+0000","last_undegraded":"2024-09-19T06:05:13.732957+0000","last_fullsized":"2024-09-19T06:05:13.732957+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:41:45.556733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724870+0000","last_change":"2024-09-19T06:04:05.430145+0000","last_active":"2024-09-19T06:05:13.724870+0000","last_peered":"2024-09-19T06:05:13.724870+0000","last_clean":"2024-09-19T06:05:13.724870+0000","last_became_active":"2024-09-19T06:04:05.429763+0000","last_became_peered":"2024-09-19T06:04:05.429763+0000","last_unstale":"2024-09-19T06:05:13.724870+0000","last_undegraded":"2024-09-19T06:05:13.724870+0000","last_fullsized":"2024-09-19T06:05:13.724870+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:44:38.783894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.474581+0000","last_change":"2024-09-19T06:04:03.317410+0000","last_active":"2024-09-19T06:05:14.474581+0000","last_peered":"2024-09-19T06:05:14.474581+0000","last_clean":"2024-09-19T06:05:14.474581+0000","last_became_active":"2024-09-19T06:04:03.317068+0000","last_became_peered":"2024-09-19T06:04:03.317068+0000","last_unstale":"2024-09-19T06:05:14.474581+0000","last_undegraded":"2024-09-19T06:05:14.474581+0000","last_fullsized":"2024-09-19T06:05:14.474581+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:23.209080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727395+0000","last_change":"2024-09-19T06:04:12.469867+0000","last_active":"2024-09-19T06:05:13.727395+0000","last_peered":"2024-09-19T06:05:13.727395+0000","last_clean":"2024-09-19T06:05:13.727395+0000","last_became_active":"2024-09-19T06:04:12.469391+0000","last_became_peered":"2024-09-19T06:04:12.469391+0000","last_unstale":"2024-09-19T06:05:13.727395+0000","last_undegraded":"2024-09-19T06:05:13.727395+0000","last_fullsized":"2024-09-19T06:05:13.727395+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:43:29.493247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.158639+0000","last_change":"2024-09-19T06:04:05.423515+0000","last_active":"2024-09-19T06:05:14.158639+0000","last_peered":"2024-09-19T06:05:14.158639+0000","last_clean":"2024-09-19T06:05:14.158639+0000","last_became_active":"2024-09-19T06:04:05.422185+0000","last_became_peered":"2024-09-19T06:04:05.422185+0000","last_unstale":"2024-09-19T06:05:14.158639+0000","last_undegraded":"2024-09-19T06:05:14.158639+0000","last_fullsized":"2024-09-19T06:05:14.158639+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:09:22.951171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"81'2","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.737281+0000","last_change":"2024-09-19T06:05:13.736876+0000","last_active":"2024-09-19T06:05:13.737281+0000","last_peered":"2024-09-19T06:05:13.737281+0000","last_clean":"2024-09-19T06:05:13.737281+0000","last_became_active":"2024-09-19T06:05:13.731079+0000","last_became_peered":"2024-09-19T06:05:13.731079+0000","last_unstale":"2024-09-19T06:05:13.737281+0000","last_undegraded":"2024-09-19T06:05:13.737281+0000","last_fullsized":"2024-09-19T06:05:13.737281+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:23.458684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.474836+0000","last_change":"2024-09-19T06:04:12.468569+0000","last_active":"2024-09-19T06:05:14.474836+0000","last_peered":"2024-09-19T06:05:14.474836+0000","last_clean":"2024-09-19T06:05:14.474836+0000","last_became_active":"2024-09-19T06:04:12.467759+0000","last_became_peered":"2024-09-19T06:04:12.467759+0000","last_unstale":"2024-09-19T06:05:14.474836+0000","last_undegraded":"2024-09-19T06:05:14.474836+0000","last_fullsized":"2024-09-19T06:05:14.474836+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:20:49.817163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727216+0000","last_change":"2024-09-19T06:04:05.425703+0000","last_active":"2024-09-19T06:05:13.727216+0000","last_peered":"2024-09-19T06:05:13.727216+0000","last_clean":"2024-09-19T06:05:13.727216+0000","last_became_active":"2024-09-19T06:04:05.425360+0000","last_became_peered":"2024-09-19T06:04:05.425360+0000","last_unstale":"2024-09-19T06:05:13.727216+0000","last_undegraded":"2024-09-19T06:05:13.727216+0000","last_fullsized":"2024-09-19T06:05:13.727216+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:33:25.457191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"87'30","reported_seq":247,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:06:07.673809+0000","last_change":"2024-09-19T06:04:03.319087+0000","last_active":"2024-09-19T06:06:07.673809+0000","last_peered":"2024-09-19T06:06:07.673809+0000","last_clean":"2024-09-19T06:06:07.673809+0000","last_became_active":"2024-09-19T06:04:03.318721+0000","last_became_peered":"2024-09-19T06:04:03.318721+0000","last_unstale":"2024-09-19T06:06:07.673809+0000","last_undegraded":"2024-09-19T06:06:07.673809+0000","last_fullsized":"2024-09-19T06:06:07.673809+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:14:32.337455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63511,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":183,"num_read_kb":153,"num_write":30,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.723734+0000","last_change":"2024-09-19T06:04:12.472008+0000","last_active":"2024-09-19T06:05:13.723734+0000","last_peered":"2024-09-19T06:05:13.723734+0000","last_clean":"2024-09-19T06:05:13.723734+0000","last_became_active":"2024-09-19T06:04:12.471623+0000","last_became_peered":"2024-09-19T06:04:12.471623+0000","last_unstale":"2024-09-19T06:05:13.723734+0000","last_undegraded":"2024-09-19T06:05:13.723734+0000","last_fullsized":"2024-09-19T06:05:13.723734+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:13:11.424242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:15.014354+0000","last_change":"2024-09-19T06:04:05.434865+0000","last_active":"2024-09-19T06:05:15.014354+0000","last_peered":"2024-09-19T06:05:15.014354+0000","last_clean":"2024-09-19T06:05:15.014354+0000","last_became_active":"2024-09-19T06:04:05.434472+0000","last_became_peered":"2024-09-19T06:04:05.434472+0000","last_unstale":"2024-09-19T06:05:15.014354+0000","last_undegraded":"2024-09-19T06:05:15.014354+0000","last_fullsized":"2024-09-19T06:05:15.014354+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:35.490406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"81'3","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.475083+0000","last_change":"2024-09-19T06:04:03.380447+0000","last_active":"2024-09-19T06:05:14.475083+0000","last_peered":"2024-09-19T06:05:14.475083+0000","last_clean":"2024-09-19T06:05:14.475083+0000","last_became_active":"2024-09-19T06:04:03.380154+0000","last_became_peered":"2024-09-19T06:04:03.380154+0000","last_unstale":"2024-09-19T06:05:14.475083+0000","last_undegraded":"2024-09-19T06:05:14.475083+0000","last_fullsized":"2024-09-19T06:05:14.475083+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:48:11.570148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726945+0000","last_change":"2024-09-19T06:04:12.467995+0000","last_active":"2024-09-19T06:05:13.726945+0000","last_peered":"2024-09-19T06:05:13.726945+0000","last_clean":"2024-09-19T06:05:13.726945+0000","last_became_active":"2024-09-19T06:04:12.467539+0000","last_became_peered":"2024-09-19T06:04:12.467539+0000","last_unstale":"2024-09-19T06:05:13.726945+0000","last_undegraded":"2024-09-19T06:05:13.726945+0000","last_fullsized":"2024-09-19T06:05:13.726945+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:13:29.285909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726884+0000","last_change":"2024-09-19T06:04:05.429919+0000","last_active":"2024-09-19T06:05:13.726884+0000","last_peered":"2024-09-19T06:05:13.726884+0000","last_clean":"2024-09-19T06:05:13.726884+0000","last_became_active":"2024-09-19T06:04:05.429597+0000","last_became_peered":"2024-09-19T06:04:05.429597+0000","last_unstale":"2024-09-19T06:05:13.726884+0000","last_undegraded":"2024-09-19T06:05:13.726884+0000","last_fullsized":"2024-09-19T06:05:13.726884+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:08:38.816272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724643+0000","last_change":"2024-09-19T06:04:03.320501+0000","last_active":"2024-09-19T06:05:13.724643+0000","last_peered":"2024-09-19T06:05:13.724643+0000","last_clean":"2024-09-19T06:05:13.724643+0000","last_became_active":"2024-09-19T06:04:03.320093+0000","last_became_peered":"2024-09-19T06:04:03.320093+0000","last_unstale":"2024-09-19T06:05:13.724643+0000","last_undegraded":"2024-09-19T06:05:13.724643+0000","last_fullsized":"2024-09-19T06:05:13.724643+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:31:11.896935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.723518+0000","last_change":"2024-09-19T06:04:12.468455+0000","last_active":"2024-09-19T06:05:13.723518+0000","last_peered":"2024-09-19T06:05:13.723518+0000","last_clean":"2024-09-19T06:05:13.723518+0000","last_became_active":"2024-09-19T06:04:12.468007+0000","last_became_peered":"2024-09-19T06:04:12.468007+0000","last_unstale":"2024-09-19T06:05:13.723518+0000","last_undegraded":"2024-09-19T06:05:13.723518+0000","last_fullsized":"2024-09-19T06:05:13.723518+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:50:58.995825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:15.014577+0000","last_change":"2024-09-19T06:04:05.427599+0000","last_active":"2024-09-19T06:05:15.014577+0000","last_peered":"2024-09-19T06:05:15.014577+0000","last_clean":"2024-09-19T06:05:15.014577+0000","last_became_active":"2024-09-19T06:04:05.425338+0000","last_became_peered":"2024-09-19T06:04:05.425338+0000","last_unstale":"2024-09-19T06:05:15.014577+0000","last_undegraded":"2024-09-19T06:05:15.014577+0000","last_fullsized":"2024-09-19T06:05:15.014577+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:44.547625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.728363+0000","last_change":"2024-09-19T06:04:03.322165+0000","last_active":"2024-09-19T06:05:13.728363+0000","last_peered":"2024-09-19T06:05:13.728363+0000","last_clean":"2024-09-19T06:05:13.728363+0000","last_became_active":"2024-09-19T06:04:03.321822+0000","last_became_peered":"2024-09-19T06:04:03.321822+0000","last_unstale":"2024-09-19T06:05:13.728363+0000","last_undegraded":"2024-09-19T06:05:13.728363+0000","last_fullsized":"2024-09-19T06:05:13.728363+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:58:00.943453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.729258+0000","last_change":"2024-09-19T06:04:12.465823+0000","last_active":"2024-09-19T06:05:13.729258+0000","last_peered":"2024-09-19T06:05:13.729258+0000","last_clean":"2024-09-19T06:05:13.729258+0000","last_became_active":"2024-09-19T06:04:12.465375+0000","last_became_peered":"2024-09-19T06:04:12.465375+0000","last_unstale":"2024-09-19T06:05:13.729258+0000","last_undegraded":"2024-09-19T06:05:13.729258+0000","last_fullsized":"2024-09-19T06:05:13.729258+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:26:25.428328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726852+0000","last_change":"2024-09-19T06:04:12.470023+0000","last_active":"2024-09-19T06:05:13.726852+0000","last_peered":"2024-09-19T06:05:13.726852+0000","last_clean":"2024-09-19T06:05:13.726852+0000","last_became_active":"2024-09-19T06:04:12.469651+0000","last_became_peered":"2024-09-19T06:04:12.469651+0000","last_unstale":"2024-09-19T06:05:13.726852+0000","last_undegraded":"2024-09-19T06:05:13.726852+0000","last_fullsized":"2024-09-19T06:05:13.726852+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:50:35.374437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.723642+0000","last_change":"2024-09-19T06:04:05.417466+0000","last_active":"2024-09-19T06:05:13.723642+0000","last_peered":"2024-09-19T06:05:13.723642+0000","last_clean":"2024-09-19T06:05:13.723642+0000","last_became_active":"2024-09-19T06:04:05.417026+0000","last_became_peered":"2024-09-19T06:04:05.417026+0000","last_unstale":"2024-09-19T06:05:13.723642+0000","last_undegraded":"2024-09-19T06:05:13.723642+0000","last_fullsized":"2024-09-19T06:05:13.723642+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:44:08.251755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.474542+0000","last_change":"2024-09-19T06:04:03.317466+0000","last_active":"2024-09-19T06:05:14.474542+0000","last_peered":"2024-09-19T06:05:14.474542+0000","last_clean":"2024-09-19T06:05:14.474542+0000","last_became_active":"2024-09-19T06:04:03.317148+0000","last_became_peered":"2024-09-19T06:04:03.317148+0000","last_unstale":"2024-09-19T06:05:14.474542+0000","last_undegraded":"2024-09-19T06:05:14.474542+0000","last_fullsized":"2024-09-19T06:05:14.474542+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:45:50.789900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727976+0000","last_change":"2024-09-19T06:04:12.469279+0000","last_active":"2024-09-19T06:05:13.727976+0000","last_peered":"2024-09-19T06:05:13.727976+0000","last_clean":"2024-09-19T06:05:13.727976+0000","last_became_active":"2024-09-19T06:04:12.467928+0000","last_became_peered":"2024-09-19T06:04:12.467928+0000","last_unstale":"2024-09-19T06:05:13.727976+0000","last_undegraded":"2024-09-19T06:05:13.727976+0000","last_fullsized":"2024-09-19T06:05:13.727976+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:52:25.839433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.729399+0000","last_change":"2024-09-19T06:04:05.420425+0000","last_active":"2024-09-19T06:05:13.729399+0000","last_peered":"2024-09-19T06:05:13.729399+0000","last_clean":"2024-09-19T06:05:13.729399+0000","last_became_active":"2024-09-19T06:04:05.420107+0000","last_became_peered":"2024-09-19T06:04:05.420107+0000","last_unstale":"2024-09-19T06:05:13.729399+0000","last_undegraded":"2024-09-19T06:05:13.729399+0000","last_fullsized":"2024-09-19T06:05:13.729399+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:49:24.566302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.158396+0000","last_change":"2024-09-19T06:04:03.315704+0000","last_active":"2024-09-19T06:05:14.158396+0000","last_peered":"2024-09-19T06:05:14.158396+0000","last_clean":"2024-09-19T06:05:14.158396+0000","last_became_active":"2024-09-19T06:04:03.315392+0000","last_became_peered":"2024-09-19T06:04:03.315392+0000","last_unstale":"2024-09-19T06:05:14.158396+0000","last_undegraded":"2024-09-19T06:05:14.158396+0000","last_fullsized":"2024-09-19T06:05:14.158396+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:52:14.417470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"81'1","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.728460+0000","last_change":"2024-09-19T06:04:03.323560+0000","last_active":"2024-09-19T06:05:13.728460+0000","last_peered":"2024-09-19T06:05:13.728460+0000","last_clean":"2024-09-19T06:05:13.728460+0000","last_became_active":"2024-09-19T06:04:03.323188+0000","last_became_peered":"2024-09-19T06:04:03.323188+0000","last_unstale":"2024-09-19T06:05:13.728460+0000","last_undegraded":"2024-09-19T06:05:13.728460+0000","last_fullsized":"2024-09-19T06:05:13.728460+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:02:50.426435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.474822+0000","last_change":"2024-09-19T06:04:05.430677+0000","last_active":"2024-09-19T06:05:14.474822+0000","last_peered":"2024-09-19T06:05:14.474822+0000","last_clean":"2024-09-19T06:05:14.474822+0000","last_became_active":"2024-09-19T06:04:05.430257+0000","last_became_peered":"2024-09-19T06:04:05.430257+0000","last_unstale":"2024-09-19T06:05:14.474822+0000","last_undegraded":"2024-09-19T06:05:14.474822+0000","last_fullsized":"2024-09-19T06:05:14.474822+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:38:42.138770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727118+0000","last_change":"2024-09-19T06:04:12.465252+0000","last_active":"2024-09-19T06:05:13.727118+0000","last_peered":"2024-09-19T06:05:13.727118+0000","last_clean":"2024-09-19T06:05:13.727118+0000","last_became_active":"2024-09-19T06:04:12.464649+0000","last_became_peered":"2024-09-19T06:04:12.464649+0000","last_unstale":"2024-09-19T06:05:13.727118+0000","last_undegraded":"2024-09-19T06:05:13.727118+0000","last_fullsized":"2024-09-19T06:05:13.727118+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:11:43.137148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"81'1","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.474959+0000","last_change":"2024-09-19T06:04:03.317584+0000","last_active":"2024-09-19T06:05:14.474959+0000","last_peered":"2024-09-19T06:05:14.474959+0000","last_clean":"2024-09-19T06:05:14.474959+0000","last_became_active":"2024-09-19T06:04:03.317250+0000","last_became_peered":"2024-09-19T06:04:03.317250+0000","last_unstale":"2024-09-19T06:05:14.474959+0000","last_undegraded":"2024-09-19T06:05:14.474959+0000","last_fullsized":"2024-09-19T06:05:14.474959+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:22.353887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727268+0000","last_change":"2024-09-19T06:04:05.431102+0000","last_active":"2024-09-19T06:05:13.727268+0000","last_peered":"2024-09-19T06:05:13.727268+0000","last_clean":"2024-09-19T06:05:13.727268+0000","last_became_active":"2024-09-19T06:04:05.430792+0000","last_became_peered":"2024-09-19T06:04:05.430792+0000","last_unstale":"2024-09-19T06:05:13.727268+0000","last_undegraded":"2024-09-19T06:05:13.727268+0000","last_fullsized":"2024-09-19T06:05:13.727268+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:48:48.682273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727983+0000","last_change":"2024-09-19T06:04:12.467143+0000","last_active":"2024-09-19T06:05:13.727983+0000","last_peered":"2024-09-19T06:05:13.727983+0000","last_clean":"2024-09-19T06:05:13.727983+0000","last_became_active":"2024-09-19T06:04:12.466672+0000","last_became_peered":"2024-09-19T06:04:12.466672+0000","last_unstale":"2024-09-19T06:05:13.727983+0000","last_undegraded":"2024-09-19T06:05:13.727983+0000","last_fullsized":"2024-09-19T06:05:13.727983+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:57:36.710316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726828+0000","last_change":"2024-09-19T06:04:05.427387+0000","last_active":"2024-09-19T06:05:13.726828+0000","last_peered":"2024-09-19T06:05:13.726828+0000","last_clean":"2024-09-19T06:05:13.726828+0000","last_became_active":"2024-09-19T06:04:05.427082+0000","last_became_peered":"2024-09-19T06:04:05.427082+0000","last_unstale":"2024-09-19T06:05:13.726828+0000","last_undegraded":"2024-09-19T06:05:13.726828+0000","last_fullsized":"2024-09-19T06:05:13.726828+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:55.931289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.728442+0000","last_change":"2024-09-19T06:04:05.434396+0000","last_active":"2024-09-19T06:05:13.728442+0000","last_peered":"2024-09-19T06:05:13.728442+0000","last_clean":"2024-09-19T06:05:13.728442+0000","last_became_active":"2024-09-19T06:04:05.433907+0000","last_became_peered":"2024-09-19T06:04:05.433907+0000","last_unstale":"2024-09-19T06:05:13.728442+0000","last_undegraded":"2024-09-19T06:05:13.728442+0000","last_fullsized":"2024-09-19T06:05:13.728442+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:02:40.885820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727903+0000","last_change":"2024-09-19T06:04:05.435813+0000","last_active":"2024-09-19T06:05:13.727903+0000","last_peered":"2024-09-19T06:05:13.727903+0000","last_clean":"2024-09-19T06:05:13.727903+0000","last_became_active":"2024-09-19T06:04:05.435441+0000","last_became_peered":"2024-09-19T06:04:05.435441+0000","last_unstale":"2024-09-19T06:05:13.727903+0000","last_undegraded":"2024-09-19T06:05:13.727903+0000","last_fullsized":"2024-09-19T06:05:13.727903+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:11:20.071732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727073+0000","last_change":"2024-09-19T06:04:05.433045+0000","last_active":"2024-09-19T06:05:13.727073+0000","last_peered":"2024-09-19T06:05:13.727073+0000","last_clean":"2024-09-19T06:05:13.727073+0000","last_became_active":"2024-09-19T06:04:05.432674+0000","last_became_peered":"2024-09-19T06:04:05.432674+0000","last_unstale":"2024-09-19T06:05:13.727073+0000","last_undegraded":"2024-09-19T06:05:13.727073+0000","last_fullsized":"2024-09-19T06:05:13.727073+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:33:06.743886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.158713+0000","last_change":"2024-09-19T06:04:05.431702+0000","last_active":"2024-09-19T06:05:14.158713+0000","last_peered":"2024-09-19T06:05:14.158713+0000","last_clean":"2024-09-19T06:05:14.158713+0000","last_became_active":"2024-09-19T06:04:05.431394+0000","last_became_peered":"2024-09-19T06:04:05.431394+0000","last_unstale":"2024-09-19T06:05:14.158713+0000","last_undegraded":"2024-09-19T06:05:14.158713+0000","last_fullsized":"2024-09-19T06:05:14.158713+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:42:18.692549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.733030+0000","last_change":"2024-09-19T06:05:13.733030+0000","last_active":"2024-09-19T06:05:13.733030+0000","last_peered":"2024-09-19T06:05:13.733030+0000","last_clean":"2024-09-19T06:05:13.733030+0000","last_became_active":"2024-09-19T06:05:13.732680+0000","last_became_peered":"2024-09-19T06:05:13.732680+0000","last_unstale":"2024-09-19T06:05:13.733030+0000","last_undegraded":"2024-09-19T06:05:13.733030+0000","last_fullsized":"2024-09-19T06:05:13.733030+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:53:24.299931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727345+0000","last_change":"2024-09-19T06:04:05.430104+0000","last_active":"2024-09-19T06:05:13.727345+0000","last_peered":"2024-09-19T06:05:13.727345+0000","last_clean":"2024-09-19T06:05:13.727345+0000","last_became_active":"2024-09-19T06:04:05.429779+0000","last_became_peered":"2024-09-19T06:04:05.429779+0000","last_unstale":"2024-09-19T06:05:13.727345+0000","last_undegraded":"2024-09-19T06:05:13.727345+0000","last_fullsized":"2024-09-19T06:05:13.727345+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:52:46.191484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.730313+0000","last_change":"2024-09-19T06:04:05.427235+0000","last_active":"2024-09-19T06:05:13.730313+0000","last_peered":"2024-09-19T06:05:13.730313+0000","last_clean":"2024-09-19T06:05:13.730313+0000","last_became_active":"2024-09-19T06:04:05.426937+0000","last_became_peered":"2024-09-19T06:04:05.426937+0000","last_unstale":"2024-09-19T06:05:13.730313+0000","last_undegraded":"2024-09-19T06:05:13.730313+0000","last_fullsized":"2024-09-19T06:05:13.730313+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:55.949564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.474156+0000","last_change":"2024-09-19T06:04:05.422199+0000","last_active":"2024-09-19T06:05:14.474156+0000","last_peered":"2024-09-19T06:05:14.474156+0000","last_clean":"2024-09-19T06:05:14.474156+0000","last_became_active":"2024-09-19T06:04:05.421681+0000","last_became_peered":"2024-09-19T06:04:05.421681+0000","last_unstale":"2024-09-19T06:05:14.474156+0000","last_undegraded":"2024-09-19T06:05:14.474156+0000","last_fullsized":"2024-09-19T06:05:14.474156+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:27:54.774211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.729451+0000","last_change":"2024-09-19T06:04:05.426559+0000","last_active":"2024-09-19T06:05:13.729451+0000","last_peered":"2024-09-19T06:05:13.729451+0000","last_clean":"2024-09-19T06:05:13.729451+0000","last_became_active":"2024-09-19T06:04:05.423197+0000","last_became_peered":"2024-09-19T06:04:05.423197+0000","last_unstale":"2024-09-19T06:05:13.729451+0000","last_undegraded":"2024-09-19T06:05:13.729451+0000","last_fullsized":"2024-09-19T06:05:13.729451+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:43.964457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:15.014232+0000","last_change":"2024-09-19T06:04:05.435779+0000","last_active":"2024-09-19T06:05:15.014232+0000","last_peered":"2024-09-19T06:05:15.014232+0000","last_clean":"2024-09-19T06:05:15.014232+0000","last_became_active":"2024-09-19T06:04:05.435436+0000","last_became_peered":"2024-09-19T06:04:05.435436+0000","last_unstale":"2024-09-19T06:05:15.014232+0000","last_undegraded":"2024-09-19T06:05:15.014232+0000","last_fullsized":"2024-09-19T06:05:15.014232+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:13:03.341438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.158694+0000","last_change":"2024-09-19T06:04:05.431718+0000","last_active":"2024-09-19T06:05:14.158694+0000","last_peered":"2024-09-19T06:05:14.158694+0000","last_clean":"2024-09-19T06:05:14.158694+0000","last_became_active":"2024-09-19T06:04:05.431429+0000","last_became_peered":"2024-09-19T06:04:05.431429+0000","last_unstale":"2024-09-19T06:05:14.158694+0000","last_undegraded":"2024-09-19T06:05:14.158694+0000","last_fullsized":"2024-09-19T06:05:14.158694+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:11:42.818368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727494+0000","last_change":"2024-09-19T06:04:05.429575+0000","last_active":"2024-09-19T06:05:13.727494+0000","last_peered":"2024-09-19T06:05:13.727494+0000","last_clean":"2024-09-19T06:05:13.727494+0000","last_became_active":"2024-09-19T06:04:05.429226+0000","last_became_peered":"2024-09-19T06:04:05.429226+0000","last_unstale":"2024-09-19T06:05:13.727494+0000","last_undegraded":"2024-09-19T06:05:13.727494+0000","last_fullsized":"2024-09-19T06:05:13.727494+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:29:19.680433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.728155+0000","last_change":"2024-09-19T06:04:05.431612+0000","last_active":"2024-09-19T06:05:13.728155+0000","last_peered":"2024-09-19T06:05:13.728155+0000","last_clean":"2024-09-19T06:05:13.728155+0000","last_became_active":"2024-09-19T06:04:05.431240+0000","last_became_peered":"2024-09-19T06:04:05.431240+0000","last_unstale":"2024-09-19T06:05:13.728155+0000","last_undegraded":"2024-09-19T06:05:13.728155+0000","last_fullsized":"2024-09-19T06:05:13.728155+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:46:14.138603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724293+0000","last_change":"2024-09-19T06:04:05.428849+0000","last_active":"2024-09-19T06:05:13.724293+0000","last_peered":"2024-09-19T06:05:13.724293+0000","last_clean":"2024-09-19T06:05:13.724293+0000","last_became_active":"2024-09-19T06:04:05.428516+0000","last_became_peered":"2024-09-19T06:04:05.428516+0000","last_unstale":"2024-09-19T06:05:13.724293+0000","last_undegraded":"2024-09-19T06:05:13.724293+0000","last_fullsized":"2024-09-19T06:05:13.724293+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:58:00.323959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.728373+0000","last_change":"2024-09-19T06:04:05.436409+0000","last_active":"2024-09-19T06:05:13.728373+0000","last_peered":"2024-09-19T06:05:13.728373+0000","last_clean":"2024-09-19T06:05:13.728373+0000","last_became_active":"2024-09-19T06:04:05.436058+0000","last_became_peered":"2024-09-19T06:04:05.436058+0000","last_unstale":"2024-09-19T06:05:13.728373+0000","last_undegraded":"2024-09-19T06:05:13.728373+0000","last_fullsized":"2024-09-19T06:05:13.728373+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:20:45.227159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:15.014023+0000","last_change":"2024-09-19T06:04:05.434398+0000","last_active":"2024-09-19T06:05:15.014023+0000","last_peered":"2024-09-19T06:05:15.014023+0000","last_clean":"2024-09-19T06:05:15.014023+0000","last_became_active":"2024-09-19T06:04:05.433635+0000","last_became_peered":"2024-09-19T06:04:05.433635+0000","last_unstale":"2024-09-19T06:05:15.014023+0000","last_undegraded":"2024-09-19T06:05:15.014023+0000","last_fullsized":"2024-09-19T06:05:15.014023+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:10:42.104705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726446+0000","last_change":"2024-09-19T06:04:05.423447+0000","last_active":"2024-09-19T06:05:13.726446+0000","last_peered":"2024-09-19T06:05:13.726446+0000","last_clean":"2024-09-19T06:05:13.726446+0000","last_became_active":"2024-09-19T06:04:05.423081+0000","last_became_peered":"2024-09-19T06:04:05.423081+0000","last_unstale":"2024-09-19T06:05:13.726446+0000","last_undegraded":"2024-09-19T06:05:13.726446+0000","last_fullsized":"2024-09-19T06:05:13.726446+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:03:54.856251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726503+0000","last_change":"2024-09-19T06:04:05.426371+0000","last_active":"2024-09-19T06:05:13.726503+0000","last_peered":"2024-09-19T06:05:13.726503+0000","last_clean":"2024-09-19T06:05:13.726503+0000","last_became_active":"2024-09-19T06:04:05.425601+0000","last_became_peered":"2024-09-19T06:04:05.425601+0000","last_unstale":"2024-09-19T06:05:13.726503+0000","last_undegraded":"2024-09-19T06:05:13.726503+0000","last_fullsized":"2024-09-19T06:05:13.726503+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:55:05.677121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.158746+0000","last_change":"2024-09-19T06:04:05.426264+0000","last_active":"2024-09-19T06:05:14.158746+0000","last_peered":"2024-09-19T06:05:14.158746+0000","last_clean":"2024-09-19T06:05:14.158746+0000","last_became_active":"2024-09-19T06:04:05.425939+0000","last_became_peered":"2024-09-19T06:04:05.425939+0000","last_unstale":"2024-09-19T06:05:14.158746+0000","last_undegraded":"2024-09-19T06:05:14.158746+0000","last_fullsized":"2024-09-19T06:05:14.158746+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:18:43.250682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727245+0000","last_change":"2024-09-19T06:04:05.432654+0000","last_active":"2024-09-19T06:05:13.727245+0000","last_peered":"2024-09-19T06:05:13.727245+0000","last_clean":"2024-09-19T06:05:13.727245+0000","last_became_active":"2024-09-19T06:04:05.431489+0000","last_became_peered":"2024-09-19T06:04:05.431489+0000","last_unstale":"2024-09-19T06:05:13.727245+0000","last_undegraded":"2024-09-19T06:05:13.727245+0000","last_fullsized":"2024-09-19T06:05:13.727245+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:15:41.251538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724637+0000","last_change":"2024-09-19T06:04:05.435221+0000","last_active":"2024-09-19T06:05:13.724637+0000","last_peered":"2024-09-19T06:05:13.724637+0000","last_clean":"2024-09-19T06:05:13.724637+0000","last_became_active":"2024-09-19T06:04:05.434909+0000","last_became_peered":"2024-09-19T06:04:05.434909+0000","last_unstale":"2024-09-19T06:05:13.724637+0000","last_undegraded":"2024-09-19T06:05:13.724637+0000","last_fullsized":"2024-09-19T06:05:13.724637+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:15:20.414499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.731152+0000","last_change":"2024-09-19T06:05:13.731152+0000","last_active":"2024-09-19T06:05:13.731152+0000","last_peered":"2024-09-19T06:05:13.731152+0000","last_clean":"2024-09-19T06:05:13.731152+0000","last_became_active":"2024-09-19T06:05:13.730810+0000","last_became_peered":"2024-09-19T06:05:13.730810+0000","last_unstale":"2024-09-19T06:05:13.731152+0000","last_undegraded":"2024-09-19T06:05:13.731152+0000","last_fullsized":"2024-09-19T06:05:13.731152+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:55:13.359784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:15.014646+0000","last_change":"2024-09-19T06:04:05.432940+0000","last_active":"2024-09-19T06:05:15.014646+0000","last_peered":"2024-09-19T06:05:15.014646+0000","last_clean":"2024-09-19T06:05:15.014646+0000","last_became_active":"2024-09-19T06:04:05.432579+0000","last_became_peered":"2024-09-19T06:04:05.432579+0000","last_unstale":"2024-09-19T06:05:15.014646+0000","last_undegraded":"2024-09-19T06:05:15.014646+0000","last_fullsized":"2024-09-19T06:05:15.014646+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:56.740048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.729272+0000","last_change":"2024-09-19T06:04:05.417967+0000","last_active":"2024-09-19T06:05:13.729272+0000","last_peered":"2024-09-19T06:05:13.729272+0000","last_clean":"2024-09-19T06:05:13.729272+0000","last_became_active":"2024-09-19T06:04:05.417658+0000","last_became_peered":"2024-09-19T06:04:05.417658+0000","last_unstale":"2024-09-19T06:05:13.729272+0000","last_undegraded":"2024-09-19T06:05:13.729272+0000","last_fullsized":"2024-09-19T06:05:13.729272+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:55.571313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724281+0000","last_change":"2024-09-19T06:04:05.424627+0000","last_active":"2024-09-19T06:05:13.724281+0000","last_peered":"2024-09-19T06:05:13.724281+0000","last_clean":"2024-09-19T06:05:13.724281+0000","last_became_active":"2024-09-19T06:04:05.424301+0000","last_became_peered":"2024-09-19T06:04:05.424301+0000","last_unstale":"2024-09-19T06:05:13.724281+0000","last_undegraded":"2024-09-19T06:05:13.724281+0000","last_fullsized":"2024-09-19T06:05:13.724281+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:48:00.964989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.728349+0000","last_change":"2024-09-19T06:04:05.423635+0000","last_active":"2024-09-19T06:05:13.728349+0000","last_peered":"2024-09-19T06:05:13.728349+0000","last_clean":"2024-09-19T06:05:13.728349+0000","last_became_active":"2024-09-19T06:04:05.422625+0000","last_became_peered":"2024-09-19T06:04:05.422625+0000","last_unstale":"2024-09-19T06:05:13.728349+0000","last_undegraded":"2024-09-19T06:05:13.728349+0000","last_fullsized":"2024-09-19T06:05:13.728349+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:33:34.099443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726970+0000","last_change":"2024-09-19T06:04:05.428933+0000","last_active":"2024-09-19T06:05:13.726970+0000","last_peered":"2024-09-19T06:05:13.726970+0000","last_clean":"2024-09-19T06:05:13.726970+0000","last_became_active":"2024-09-19T06:04:05.428598+0000","last_became_peered":"2024-09-19T06:04:05.428598+0000","last_unstale":"2024-09-19T06:05:13.726970+0000","last_undegraded":"2024-09-19T06:05:13.726970+0000","last_fullsized":"2024-09-19T06:05:13.726970+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:27:15.111954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.731274+0000","last_change":"2024-09-19T06:05:13.730637+0000","last_active":"2024-09-19T06:05:13.731274+0000","last_peered":"2024-09-19T06:05:13.731274+0000","last_clean":"2024-09-19T06:05:13.731274+0000","last_became_active":"2024-09-19T06:05:13.730224+0000","last_became_peered":"2024-09-19T06:05:13.730224+0000","last_unstale":"2024-09-19T06:05:13.731274+0000","last_undegraded":"2024-09-19T06:05:13.731274+0000","last_fullsized":"2024-09-19T06:05:13.731274+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:14:08.175943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726638+0000","last_change":"2024-09-19T06:04:05.430427+0000","last_active":"2024-09-19T06:05:13.726638+0000","last_peered":"2024-09-19T06:05:13.726638+0000","last_clean":"2024-09-19T06:05:13.726638+0000","last_became_active":"2024-09-19T06:04:05.430106+0000","last_became_peered":"2024-09-19T06:04:05.430106+0000","last_unstale":"2024-09-19T06:05:13.726638+0000","last_undegraded":"2024-09-19T06:05:13.726638+0000","last_fullsized":"2024-09-19T06:05:13.726638+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:03:00.764689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727017+0000","last_change":"2024-09-19T06:04:05.427189+0000","last_active":"2024-09-19T06:05:13.727017+0000","last_peered":"2024-09-19T06:05:13.727017+0000","last_clean":"2024-09-19T06:05:13.727017+0000","last_became_active":"2024-09-19T06:04:05.426874+0000","last_became_peered":"2024-09-19T06:04:05.426874+0000","last_unstale":"2024-09-19T06:05:13.727017+0000","last_undegraded":"2024-09-19T06:05:13.727017+0000","last_fullsized":"2024-09-19T06:05:13.727017+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:37:10.910723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.728272+0000","last_change":"2024-09-19T06:04:05.435803+0000","last_active":"2024-09-19T06:05:13.728272+0000","last_peered":"2024-09-19T06:05:13.728272+0000","last_clean":"2024-09-19T06:05:13.728272+0000","last_became_active":"2024-09-19T06:04:05.435430+0000","last_became_peered":"2024-09-19T06:04:05.435430+0000","last_unstale":"2024-09-19T06:05:13.728272+0000","last_undegraded":"2024-09-19T06:05:13.728272+0000","last_fullsized":"2024-09-19T06:05:13.728272+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:41.828016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64309,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":189,"num_read_kb":159,"num_write":83,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":193235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":70,"ondisk_log_size":70,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547239,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1007616,"data_stored":497802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776172,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36992,"kb_used_data":1640,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708160,"statfs":{"total":95995035648,"available":95957155840,"internally_reserved":0,"allocated":1679360,"data_stored":1147745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939697,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1011712,"data_stored":502446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168630,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1011712,"data_stored":498372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397563,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36920,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708232,"statfs":{"total":95995035648,"available":95957229568,"internally_reserved":0,"allocated":1605632,"data_stored":1092814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561089,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":999424,"data_stored":493672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790021,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28604,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716548,"statfs":{"total":95995035648,"available":95965745152,"internally_reserved":0,"allocated":1609728,"data_stored":1088318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953545,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1007616,"data_stored":497790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182479,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36336,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708816,"statfs":{"total":95995035648,"available":95957827584,"internally_reserved":0,"allocated":1007616,"data_stored":493776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411413,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28080,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717072,"statfs":{"total":95995035648,"available":95966281728,"internally_reserved":0,"allocated":1073152,"data_stored":557183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574938,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28072,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717080,"statfs":{"total":95995035648,"available":95966289920,"internally_reserved":0,"allocated":1073152,"data_stored":557491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738463,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1003520,"data_stored":493762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":63819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":63511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":63705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T06:06:13.467 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T06:06:13.731 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:06:13.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:06:13 smithi037 ceph-mon[31211]: pgmap v349: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:06:13.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:06:13 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]: dispatch 2024-09-19T06:06:13.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:06:13 smithi037 ceph-mon[31211]: from='client.15132 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:06:13.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:06:13 smithi099 ceph-mon[35300]: pgmap v349: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:06:13.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:06:13 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]: dispatch 2024-09-19T06:06:13.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:06:13 smithi099 ceph-mon[35300]: from='client.15132 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:06:13.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:06:13 smithi117 ceph-mon[35050]: pgmap v349: 129 pgs: 129 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:06:14.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:06:13 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]: dispatch 2024-09-19T06:06:14.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:06:13 smithi117 ceph-mon[35050]: from='client.15132 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:06:14.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:14.200+0000 7f84f5a55640 1 -- 172.21.15.37:0/1305427891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84f0102ef0 msgr2=0x7f84f010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:14.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:14.200+0000 7f84f5a55640 1 --2- 172.21.15.37:0/1305427891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84f0102ef0 0x7f84f010da40 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f84e8009ca0 tx=0x7f84e802a950 comp rx=0 tx=0).stop 2024-09-19T06:06:14.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:14.200+0000 7f84f5a55640 1 -- 172.21.15.37:0/1305427891 shutdown_connections 2024-09-19T06:06:14.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:14.200+0000 7f84f5a55640 1 --2- 172.21.15.37:0/1305427891 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f84f0102570 0x7f84f01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:14.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:14.200+0000 7f84f5a55640 1 --2- 172.21.15.37:0/1305427891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84f0102ef0 0x7f84f010da40 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:14.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:14.200+0000 7f84f5a55640 1 --2- 172.21.15.37:0/1305427891 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84f0100e20 0x7f84f0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:14.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:14.200+0000 7f84f5a55640 1 -- 172.21.15.37:0/1305427891 >> 172.21.15.37:0/1305427891 conn(0x7f84f00fc7d0 msgr2=0x7f84f00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:14.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:14.200+0000 7f84f5a55640 1 -- 172.21.15.37:0/1305427891 shutdown_connections 2024-09-19T06:06:14.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:14.200+0000 7f84f5a55640 1 -- 172.21.15.37:0/1305427891 wait complete. 2024-09-19T06:06:14.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:14.201+0000 7f84f5a55640 1 Processor -- start 2024-09-19T06:06:14.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:14.201+0000 7f84f5a55640 1 -- start start 2024-09-19T06:06:14.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:14.201+0000 7f84f5a55640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f84f0100e20 0x7f84f019a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:14.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:14.201+0000 7f84f5a55640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84f0102570 0x7f84f019ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:14.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:14.201+0000 7f84f5a55640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84f0102ef0 0x7f84f019eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:14.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:14.201+0000 7f84f5a55640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f84f0110fd0 con 0x7f84f0102570 2024-09-19T06:06:14.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:14.201+0000 7f84f5a55640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f84f0110e50 con 0x7f84f0100e20 2024-09-19T06:06:14.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:14.201+0000 7f84f5a55640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f84f0111150 con 0x7f84f0102ef0 2024-09-19T06:06:14.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:14.201+0000 7f84ee7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84f0102570 0x7f84f019ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:14.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:14.201+0000 7f84ee7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84f0102570 0x7f84f019ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47060/0 (socket says 172.21.15.37:47060) 2024-09-19T06:06:14.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:14.201+0000 7f84ee7fc640 1 -- 172.21.15.37:0/3005389841 learned_addr learned my addr 172.21.15.37:0/3005389841 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:06:14.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:14.201+0000 7f84ef7fe640 1 --2- 172.21.15.37:0/3005389841 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84f0102ef0 0x7f84f019eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:14.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:14.202+0000 7f84eeffd640 1 --2- 172.21.15.37:0/3005389841 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f84f0100e20 0x7f84f019a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:14.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:14.202+0000 7f84ee7fc640 1 -- 172.21.15.37:0/3005389841 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84f0102ef0 msgr2=0x7f84f019eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:14.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:14.202+0000 7f84ee7fc640 1 --2- 172.21.15.37:0/3005389841 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84f0102ef0 0x7f84f019eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:14.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:14.202+0000 7f84ee7fc640 1 -- 172.21.15.37:0/3005389841 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f84f0100e20 msgr2=0x7f84f019a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:14.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:14.202+0000 7f84ee7fc640 1 --2- 172.21.15.37:0/3005389841 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f84f0100e20 0x7f84f019a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:14.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:14.202+0000 7f84ee7fc640 1 -- 172.21.15.37:0/3005389841 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84f019f5d0 con 0x7f84f0102570 2024-09-19T06:06:14.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:14.202+0000 7f84ee7fc640 1 --2- 172.21.15.37:0/3005389841 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84f0102570 0x7f84f019ab60 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f84e400d950 tx=0x7f84e400dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:14.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:14.202+0000 7f84f4a53640 1 -- 172.21.15.37:0/3005389841 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e4017070 con 0x7f84f0102570 2024-09-19T06:06:14.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:14.202+0000 7f84f4a53640 1 -- 172.21.15.37:0/3005389841 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84e400de80 con 0x7f84f0102570 2024-09-19T06:06:14.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:14.202+0000 7f84f5a55640 1 -- 172.21.15.37:0/3005389841 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84f019f8c0 con 0x7f84f0102570 2024-09-19T06:06:14.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:14.202+0000 7f84f4a53640 1 -- 172.21.15.37:0/3005389841 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e400f620 con 0x7f84f0102570 2024-09-19T06:06:14.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:14.202+0000 7f84f5a55640 1 -- 172.21.15.37:0/3005389841 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84f01a71a0 con 0x7f84f0102570 2024-09-19T06:06:14.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:14.204+0000 7f84f5a55640 1 -- 172.21.15.37:0/3005389841 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84f0101200 con 0x7f84f0102570 2024-09-19T06:06:14.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:14.204+0000 7f84f4a53640 1 -- 172.21.15.37:0/3005389841 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f84e4009c30 con 0x7f84f0102570 2024-09-19T06:06:14.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:14.205+0000 7f84f4a53640 1 --2- 172.21.15.37:0/3005389841 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f84d80a3240 0x7f84d80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:14.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:14.205+0000 7f84eeffd640 1 --2- 172.21.15.37:0/3005389841 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f84d80a3240 0x7f84d80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:14.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:14.206+0000 7f84f4a53640 1 -- 172.21.15.37:0/3005389841 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9121+0+0 (secure 0 0 0) 0x7f84e40cf860 con 0x7f84f0102570 2024-09-19T06:06:14.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:14.206+0000 7f84eeffd640 1 --2- 172.21.15.37:0/3005389841 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f84d80a3240 0x7f84d80a5700 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f84e000abe0 tx=0x7f84e000a2d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:14.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:14.210+0000 7f84f4a53640 1 -- 172.21.15.37:0/3005389841 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f84e409c1a0 con 0x7f84f0102570 2024-09-19T06:06:14.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:14.382+0000 7f84f5a55640 1 -- 172.21.15.37:0/3005389841 --> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f84f00fdc50 con 0x7f84d80a3240 2024-09-19T06:06:14.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:14.391+0000 7f84f4a53640 1 -- 172.21.15.37:0/3005389841 <== mgr.14148 v2:172.21.15.37:6800/3797010169 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340319 (secure 0 0 0) 0x7f84f00fdc50 con 0x7f84d80a3240 2024-09-19T06:06:14.397 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T06:06:14.398 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-19T06:06:14.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:14.395+0000 7f84f5a55640 1 -- 172.21.15.37:0/3005389841 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f84d80a3240 msgr2=0x7f84d80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:14.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:14.395+0000 7f84f5a55640 1 --2- 172.21.15.37:0/3005389841 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f84d80a3240 0x7f84d80a5700 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f84e000abe0 tx=0x7f84e000a2d0 comp rx=0 tx=0).stop 2024-09-19T06:06:14.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:14.395+0000 7f84f5a55640 1 -- 172.21.15.37:0/3005389841 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84f0102570 msgr2=0x7f84f019ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:14.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:14.395+0000 7f84f5a55640 1 --2- 172.21.15.37:0/3005389841 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84f0102570 0x7f84f019ab60 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f84e400d950 tx=0x7f84e400dd50 comp rx=0 tx=0).stop 2024-09-19T06:06:14.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:14.396+0000 7f84f5a55640 1 -- 172.21.15.37:0/3005389841 shutdown_connections 2024-09-19T06:06:14.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:14.396+0000 7f84f5a55640 1 --2- 172.21.15.37:0/3005389841 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f84d80a3240 0x7f84d80a5700 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:14.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:14.396+0000 7f84f5a55640 1 --2- 172.21.15.37:0/3005389841 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84f0102ef0 0x7f84f019eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:14.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:14.396+0000 7f84f5a55640 1 --2- 172.21.15.37:0/3005389841 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84f0102570 0x7f84f019ab60 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:14.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:14.396+0000 7f84f5a55640 1 --2- 172.21.15.37:0/3005389841 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f84f0100e20 0x7f84f019a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:14.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:14.396+0000 7f84f5a55640 1 -- 172.21.15.37:0/3005389841 >> 172.21.15.37:0/3005389841 conn(0x7f84f00fc7d0 msgr2=0x7f84f006a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:14.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:14.396+0000 7f84f5a55640 1 -- 172.21.15.37:0/3005389841 shutdown_connections 2024-09-19T06:06:14.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:14.396+0000 7f84f5a55640 1 -- 172.21.15.37:0/3005389841 wait complete. 2024-09-19T06:06:14.660 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:06:14 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]': finished 2024-09-19T06:06:14.660 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:06:14 smithi037 ceph-mon[31211]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-19T06:06:14.660 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:06:14 smithi037 ceph-mon[31211]: osdmap e90: 12 total, 12 up, 12 in 2024-09-19T06:06:14.660 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:06:14 smithi037 ceph-mon[31211]: from='client.15138 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:06:14.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:06:14 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]': finished 2024-09-19T06:06:14.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:06:14 smithi099 ceph-mon[35300]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-19T06:06:14.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:06:14 smithi099 ceph-mon[35300]: osdmap e90: 12 total, 12 up, 12 in 2024-09-19T06:06:14.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:06:14 smithi099 ceph-mon[35300]: from='client.15138 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:06:15.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:06:14 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]': finished 2024-09-19T06:06:15.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:06:14 smithi117 ceph-mon[35050]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-19T06:06:15.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:06:14 smithi117 ceph-mon[35050]: osdmap e90: 12 total, 12 up, 12 in 2024-09-19T06:06:15.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:06:14 smithi117 ceph-mon[35050]: from='client.15138 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:06:15.097 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":350,"stamp":"2024-09-19T06:06:13.642631+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659782,"num_objects":26,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":327,"num_read_kb":279,"num_write":270,"num_write_kb":3039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180770,"num_keys_recovered":10,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":253,"ondisk_log_size":253,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":363084,"kb_used_data":13764,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124578740,"statfs":{"total":1151940427776,"available":1151568629760,"internally_reserved":0,"allocated":14094336,"data_stored":7926042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":357414202},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4871,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":4,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.968729"},"pg_stats":[{"pgid":"2.1f","version":"81'4","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724504+0000","last_change":"2024-09-19T06:04:03.323722+0000","last_active":"2024-09-19T06:05:13.724504+0000","last_peered":"2024-09-19T06:05:13.724504+0000","last_clean":"2024-09-19T06:05:13.724504+0000","last_became_active":"2024-09-19T06:04:03.323380+0000","last_became_peered":"2024-09-19T06:04:03.323380+0000","last_unstale":"2024-09-19T06:05:13.724504+0000","last_undegraded":"2024-09-19T06:05:13.724504+0000","last_fullsized":"2024-09-19T06:05:13.724504+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:49:17.449780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.729434+0000","last_change":"2024-09-19T06:04:05.427994+0000","last_active":"2024-09-19T06:05:13.729434+0000","last_peered":"2024-09-19T06:05:13.729434+0000","last_clean":"2024-09-19T06:05:13.729434+0000","last_became_active":"2024-09-19T06:04:05.427745+0000","last_became_peered":"2024-09-19T06:04:05.427745+0000","last_unstale":"2024-09-19T06:05:13.729434+0000","last_undegraded":"2024-09-19T06:05:13.729434+0000","last_fullsized":"2024-09-19T06:05:13.729434+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:54.917003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727325+0000","last_change":"2024-09-19T06:04:12.463838+0000","last_active":"2024-09-19T06:05:13.727325+0000","last_peered":"2024-09-19T06:05:13.727325+0000","last_clean":"2024-09-19T06:05:13.727325+0000","last_became_active":"2024-09-19T06:04:12.463426+0000","last_became_peered":"2024-09-19T06:04:12.463426+0000","last_unstale":"2024-09-19T06:05:13.727325+0000","last_undegraded":"2024-09-19T06:05:13.727325+0000","last_fullsized":"2024-09-19T06:05:13.727325+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:40:37.994203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"81'1","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.729765+0000","last_change":"2024-09-19T06:04:03.378129+0000","last_active":"2024-09-19T06:05:13.729765+0000","last_peered":"2024-09-19T06:05:13.729765+0000","last_clean":"2024-09-19T06:05:13.729765+0000","last_became_active":"2024-09-19T06:04:03.377793+0000","last_became_peered":"2024-09-19T06:04:03.377793+0000","last_unstale":"2024-09-19T06:05:13.729765+0000","last_undegraded":"2024-09-19T06:05:13.729765+0000","last_fullsized":"2024-09-19T06:05:13.729765+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:38:22.739168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727550+0000","last_change":"2024-09-19T06:04:05.433909+0000","last_active":"2024-09-19T06:05:13.727550+0000","last_peered":"2024-09-19T06:05:13.727550+0000","last_clean":"2024-09-19T06:05:13.727550+0000","last_became_active":"2024-09-19T06:04:05.433591+0000","last_became_peered":"2024-09-19T06:04:05.433591+0000","last_unstale":"2024-09-19T06:05:13.727550+0000","last_undegraded":"2024-09-19T06:05:13.727550+0000","last_fullsized":"2024-09-19T06:05:13.727550+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:19:18.916703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.725870+0000","last_change":"2024-09-19T06:04:12.468984+0000","last_active":"2024-09-19T06:05:13.725870+0000","last_peered":"2024-09-19T06:05:13.725870+0000","last_clean":"2024-09-19T06:05:13.725870+0000","last_became_active":"2024-09-19T06:04:12.467287+0000","last_became_peered":"2024-09-19T06:04:12.467287+0000","last_unstale":"2024-09-19T06:05:13.725870+0000","last_undegraded":"2024-09-19T06:05:13.725870+0000","last_fullsized":"2024-09-19T06:05:13.725870+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:05:46.279679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.739408+0000","last_change":"2024-09-19T06:05:13.739034+0000","last_active":"2024-09-19T06:05:13.739408+0000","last_peered":"2024-09-19T06:05:13.739408+0000","last_clean":"2024-09-19T06:05:13.739408+0000","last_became_active":"2024-09-19T06:05:13.731532+0000","last_became_peered":"2024-09-19T06:05:13.731532+0000","last_unstale":"2024-09-19T06:05:13.739408+0000","last_undegraded":"2024-09-19T06:05:13.739408+0000","last_fullsized":"2024-09-19T06:05:13.739408+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:52:21.543579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:15.014328+0000","last_change":"2024-09-19T06:04:05.430288+0000","last_active":"2024-09-19T06:05:15.014328+0000","last_peered":"2024-09-19T06:05:15.014328+0000","last_clean":"2024-09-19T06:05:15.014328+0000","last_became_active":"2024-09-19T06:04:05.429947+0000","last_became_peered":"2024-09-19T06:04:05.429947+0000","last_unstale":"2024-09-19T06:05:15.014328+0000","last_undegraded":"2024-09-19T06:05:15.014328+0000","last_fullsized":"2024-09-19T06:05:15.014328+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:43:09.169658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726358+0000","last_change":"2024-09-19T06:04:12.465946+0000","last_active":"2024-09-19T06:05:13.726358+0000","last_peered":"2024-09-19T06:05:13.726358+0000","last_clean":"2024-09-19T06:05:13.726358+0000","last_became_active":"2024-09-19T06:04:12.465553+0000","last_became_peered":"2024-09-19T06:04:12.465553+0000","last_unstale":"2024-09-19T06:05:13.726358+0000","last_undegraded":"2024-09-19T06:05:13.726358+0000","last_fullsized":"2024-09-19T06:05:13.726358+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:50:41.181483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.728044+0000","last_change":"2024-09-19T06:04:03.318528+0000","last_active":"2024-09-19T06:05:13.728044+0000","last_peered":"2024-09-19T06:05:13.728044+0000","last_clean":"2024-09-19T06:05:13.728044+0000","last_became_active":"2024-09-19T06:04:03.318210+0000","last_became_peered":"2024-09-19T06:04:03.318210+0000","last_unstale":"2024-09-19T06:05:13.728044+0000","last_undegraded":"2024-09-19T06:05:13.728044+0000","last_fullsized":"2024-09-19T06:05:13.728044+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:06.766545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.475029+0000","last_change":"2024-09-19T06:04:05.427025+0000","last_active":"2024-09-19T06:05:14.475029+0000","last_peered":"2024-09-19T06:05:14.475029+0000","last_clean":"2024-09-19T06:05:14.475029+0000","last_became_active":"2024-09-19T06:04:05.425679+0000","last_became_peered":"2024-09-19T06:04:05.425679+0000","last_unstale":"2024-09-19T06:05:14.475029+0000","last_undegraded":"2024-09-19T06:05:14.475029+0000","last_fullsized":"2024-09-19T06:05:14.475029+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:26:06.480664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726043+0000","last_change":"2024-09-19T06:04:12.467065+0000","last_active":"2024-09-19T06:05:13.726043+0000","last_peered":"2024-09-19T06:05:13.726043+0000","last_clean":"2024-09-19T06:05:13.726043+0000","last_became_active":"2024-09-19T06:04:12.465961+0000","last_became_peered":"2024-09-19T06:04:12.465961+0000","last_unstale":"2024-09-19T06:05:13.726043+0000","last_undegraded":"2024-09-19T06:05:13.726043+0000","last_fullsized":"2024-09-19T06:05:13.726043+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:13:38.566692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724364+0000","last_change":"2024-09-19T06:04:05.436202+0000","last_active":"2024-09-19T06:05:13.724364+0000","last_peered":"2024-09-19T06:05:13.724364+0000","last_clean":"2024-09-19T06:05:13.724364+0000","last_became_active":"2024-09-19T06:04:05.435779+0000","last_became_peered":"2024-09-19T06:04:05.435779+0000","last_unstale":"2024-09-19T06:05:13.724364+0000","last_undegraded":"2024-09-19T06:05:13.724364+0000","last_fullsized":"2024-09-19T06:05:13.724364+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:27:56.463592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727084+0000","last_change":"2024-09-19T06:04:03.320472+0000","last_active":"2024-09-19T06:05:13.727084+0000","last_peered":"2024-09-19T06:05:13.727084+0000","last_clean":"2024-09-19T06:05:13.727084+0000","last_became_active":"2024-09-19T06:04:03.320178+0000","last_became_peered":"2024-09-19T06:04:03.320178+0000","last_unstale":"2024-09-19T06:05:13.727084+0000","last_undegraded":"2024-09-19T06:05:13.727084+0000","last_fullsized":"2024-09-19T06:05:13.727084+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:23.285302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727113+0000","last_change":"2024-09-19T06:04:12.635733+0000","last_active":"2024-09-19T06:05:13.727113+0000","last_peered":"2024-09-19T06:05:13.727113+0000","last_clean":"2024-09-19T06:05:13.727113+0000","last_became_active":"2024-09-19T06:04:12.634938+0000","last_became_peered":"2024-09-19T06:04:12.634938+0000","last_unstale":"2024-09-19T06:05:13.727113+0000","last_undegraded":"2024-09-19T06:05:13.727113+0000","last_fullsized":"2024-09-19T06:05:13.727113+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:44:09.015733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.729473+0000","last_change":"2024-09-19T06:04:05.418702+0000","last_active":"2024-09-19T06:05:13.729473+0000","last_peered":"2024-09-19T06:05:13.729473+0000","last_clean":"2024-09-19T06:05:13.729473+0000","last_became_active":"2024-09-19T06:04:05.418213+0000","last_became_peered":"2024-09-19T06:04:05.418213+0000","last_unstale":"2024-09-19T06:05:13.729473+0000","last_undegraded":"2024-09-19T06:05:13.729473+0000","last_fullsized":"2024-09-19T06:05:13.729473+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:46:01.865286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727965+0000","last_change":"2024-09-19T06:04:03.323683+0000","last_active":"2024-09-19T06:05:13.727965+0000","last_peered":"2024-09-19T06:05:13.727965+0000","last_clean":"2024-09-19T06:05:13.727965+0000","last_became_active":"2024-09-19T06:04:03.323166+0000","last_became_peered":"2024-09-19T06:04:03.323166+0000","last_unstale":"2024-09-19T06:05:13.727965+0000","last_undegraded":"2024-09-19T06:05:13.727965+0000","last_fullsized":"2024-09-19T06:05:13.727965+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:53.787307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"87'1","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726853+0000","last_change":"2024-09-19T06:04:12.467620+0000","last_active":"2024-09-19T06:05:13.726853+0000","last_peered":"2024-09-19T06:05:13.726853+0000","last_clean":"2024-09-19T06:05:13.726853+0000","last_became_active":"2024-09-19T06:04:12.467231+0000","last_became_peered":"2024-09-19T06:04:12.467231+0000","last_unstale":"2024-09-19T06:05:13.726853+0000","last_undegraded":"2024-09-19T06:05:13.726853+0000","last_fullsized":"2024-09-19T06:05:13.726853+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:12:07.731338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726950+0000","last_change":"2024-09-19T06:04:05.426415+0000","last_active":"2024-09-19T06:05:13.726950+0000","last_peered":"2024-09-19T06:05:13.726950+0000","last_clean":"2024-09-19T06:05:13.726950+0000","last_became_active":"2024-09-19T06:04:05.426061+0000","last_became_peered":"2024-09-19T06:04:05.426061+0000","last_unstale":"2024-09-19T06:05:13.726950+0000","last_undegraded":"2024-09-19T06:05:13.726950+0000","last_fullsized":"2024-09-19T06:05:13.726950+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:44.810600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.729834+0000","last_change":"2024-09-19T06:04:03.319185+0000","last_active":"2024-09-19T06:05:13.729834+0000","last_peered":"2024-09-19T06:05:13.729834+0000","last_clean":"2024-09-19T06:05:13.729834+0000","last_became_active":"2024-09-19T06:04:03.318788+0000","last_became_peered":"2024-09-19T06:04:03.318788+0000","last_unstale":"2024-09-19T06:05:13.729834+0000","last_undegraded":"2024-09-19T06:05:13.729834+0000","last_fullsized":"2024-09-19T06:05:13.729834+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:41:14.668303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.476753+0000","last_change":"2024-09-19T06:05:14.476214+0000","last_active":"2024-09-19T06:05:14.476753+0000","last_peered":"2024-09-19T06:05:14.476753+0000","last_clean":"2024-09-19T06:05:14.476753+0000","last_became_active":"2024-09-19T06:05:14.475721+0000","last_became_peered":"2024-09-19T06:05:14.475721+0000","last_unstale":"2024-09-19T06:05:14.476753+0000","last_undegraded":"2024-09-19T06:05:14.476753+0000","last_fullsized":"2024-09-19T06:05:14.476753+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:15:37.925870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,2,5],"acting":[8,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727210+0000","last_change":"2024-09-19T06:04:05.428027+0000","last_active":"2024-09-19T06:05:13.727210+0000","last_peered":"2024-09-19T06:05:13.727210+0000","last_clean":"2024-09-19T06:05:13.727210+0000","last_became_active":"2024-09-19T06:04:05.427698+0000","last_became_peered":"2024-09-19T06:04:05.427698+0000","last_unstale":"2024-09-19T06:05:13.727210+0000","last_undegraded":"2024-09-19T06:05:13.727210+0000","last_fullsized":"2024-09-19T06:05:13.727210+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:06:34.627086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:15.014198+0000","last_change":"2024-09-19T06:04:03.380435+0000","last_active":"2024-09-19T06:05:15.014198+0000","last_peered":"2024-09-19T06:05:15.014198+0000","last_clean":"2024-09-19T06:05:15.014198+0000","last_became_active":"2024-09-19T06:04:03.380102+0000","last_became_peered":"2024-09-19T06:04:03.380102+0000","last_unstale":"2024-09-19T06:05:15.014198+0000","last_undegraded":"2024-09-19T06:05:15.014198+0000","last_fullsized":"2024-09-19T06:05:15.014198+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:43.886466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.730251+0000","last_change":"2024-09-19T06:05:13.730251+0000","last_active":"2024-09-19T06:05:13.730251+0000","last_peered":"2024-09-19T06:05:13.730251+0000","last_clean":"2024-09-19T06:05:13.730251+0000","last_became_active":"2024-09-19T06:05:13.729757+0000","last_became_peered":"2024-09-19T06:05:13.729757+0000","last_unstale":"2024-09-19T06:05:13.730251+0000","last_undegraded":"2024-09-19T06:05:13.730251+0000","last_fullsized":"2024-09-19T06:05:13.730251+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:57:09.816160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,10,9],"acting":[4,8,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.160089+0000","last_change":"2024-09-19T06:05:14.160089+0000","last_active":"2024-09-19T06:05:14.160089+0000","last_peered":"2024-09-19T06:05:14.160089+0000","last_clean":"2024-09-19T06:05:14.160089+0000","last_became_active":"2024-09-19T06:05:14.159695+0000","last_became_peered":"2024-09-19T06:05:14.159695+0000","last_unstale":"2024-09-19T06:05:14.160089+0000","last_undegraded":"2024-09-19T06:05:14.160089+0000","last_fullsized":"2024-09-19T06:05:14.160089+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:12:52.838620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"81'2","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726647+0000","last_change":"2024-09-19T06:04:03.376510+0000","last_active":"2024-09-19T06:05:13.726647+0000","last_peered":"2024-09-19T06:05:13.726647+0000","last_clean":"2024-09-19T06:05:13.726647+0000","last_became_active":"2024-09-19T06:04:03.376241+0000","last_became_peered":"2024-09-19T06:04:03.376241+0000","last_unstale":"2024-09-19T06:05:13.726647+0000","last_undegraded":"2024-09-19T06:05:13.726647+0000","last_fullsized":"2024-09-19T06:05:13.726647+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:19:29.209233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727510+0000","last_change":"2024-09-19T06:04:12.462237+0000","last_active":"2024-09-19T06:05:13.727510+0000","last_peered":"2024-09-19T06:05:13.727510+0000","last_clean":"2024-09-19T06:05:13.727510+0000","last_became_active":"2024-09-19T06:04:12.461771+0000","last_became_peered":"2024-09-19T06:04:12.461771+0000","last_unstale":"2024-09-19T06:05:13.727510+0000","last_undegraded":"2024-09-19T06:05:13.727510+0000","last_fullsized":"2024-09-19T06:05:13.727510+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:46:42.780847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.730324+0000","last_change":"2024-09-19T06:04:05.420472+0000","last_active":"2024-09-19T06:05:13.730324+0000","last_peered":"2024-09-19T06:05:13.730324+0000","last_clean":"2024-09-19T06:05:13.730324+0000","last_became_active":"2024-09-19T06:04:05.420147+0000","last_became_peered":"2024-09-19T06:04:05.420147+0000","last_unstale":"2024-09-19T06:05:13.730324+0000","last_undegraded":"2024-09-19T06:05:13.730324+0000","last_fullsized":"2024-09-19T06:05:13.730324+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:38.616378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"87'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724491+0000","last_change":"2024-09-19T06:04:03.316655+0000","last_active":"2024-09-19T06:05:13.724491+0000","last_peered":"2024-09-19T06:05:13.724491+0000","last_clean":"2024-09-19T06:05:13.724491+0000","last_became_active":"2024-09-19T06:04:03.316296+0000","last_became_peered":"2024-09-19T06:04:03.316296+0000","last_unstale":"2024-09-19T06:05:13.724491+0000","last_undegraded":"2024-09-19T06:05:13.724491+0000","last_fullsized":"2024-09-19T06:05:13.724491+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:02:06.320482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.729377+0000","last_change":"2024-09-19T06:04:12.635106+0000","last_active":"2024-09-19T06:05:13.729377+0000","last_peered":"2024-09-19T06:05:13.729377+0000","last_clean":"2024-09-19T06:05:13.729377+0000","last_became_active":"2024-09-19T06:04:12.634671+0000","last_became_peered":"2024-09-19T06:04:12.634671+0000","last_unstale":"2024-09-19T06:05:13.729377+0000","last_undegraded":"2024-09-19T06:05:13.729377+0000","last_fullsized":"2024-09-19T06:05:13.729377+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:54:22.428102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.158806+0000","last_change":"2024-09-19T06:04:05.427483+0000","last_active":"2024-09-19T06:05:14.158806+0000","last_peered":"2024-09-19T06:05:14.158806+0000","last_clean":"2024-09-19T06:05:14.158806+0000","last_became_active":"2024-09-19T06:04:05.427092+0000","last_became_peered":"2024-09-19T06:04:05.427092+0000","last_unstale":"2024-09-19T06:05:14.158806+0000","last_undegraded":"2024-09-19T06:05:14.158806+0000","last_fullsized":"2024-09-19T06:05:14.158806+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:50:21.576757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727515+0000","last_change":"2024-09-19T06:04:03.377962+0000","last_active":"2024-09-19T06:05:13.727515+0000","last_peered":"2024-09-19T06:05:13.727515+0000","last_clean":"2024-09-19T06:05:13.727515+0000","last_became_active":"2024-09-19T06:04:03.377686+0000","last_became_peered":"2024-09-19T06:04:03.377686+0000","last_unstale":"2024-09-19T06:05:13.727515+0000","last_undegraded":"2024-09-19T06:05:13.727515+0000","last_fullsized":"2024-09-19T06:05:13.727515+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:00.635765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727360+0000","last_change":"2024-09-19T06:04:12.467349+0000","last_active":"2024-09-19T06:05:13.727360+0000","last_peered":"2024-09-19T06:05:13.727360+0000","last_clean":"2024-09-19T06:05:13.727360+0000","last_became_active":"2024-09-19T06:04:12.466117+0000","last_became_peered":"2024-09-19T06:04:12.466117+0000","last_unstale":"2024-09-19T06:05:13.727360+0000","last_undegraded":"2024-09-19T06:05:13.727360+0000","last_fullsized":"2024-09-19T06:05:13.727360+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:28:03.040586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"89'4","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:06:12.648854+0000","last_change":"2024-09-19T06:04:05.429656+0000","last_active":"2024-09-19T06:06:12.648854+0000","last_peered":"2024-09-19T06:06:12.648854+0000","last_clean":"2024-09-19T06:06:12.648854+0000","last_became_active":"2024-09-19T06:04:05.429023+0000","last_became_peered":"2024-09-19T06:04:05.429023+0000","last_unstale":"2024-09-19T06:06:12.648854+0000","last_undegraded":"2024-09-19T06:06:12.648854+0000","last_fullsized":"2024-09-19T06:06:12.648854+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:25:57.627940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724250+0000","last_change":"2024-09-19T06:04:03.378415+0000","last_active":"2024-09-19T06:05:13.724250+0000","last_peered":"2024-09-19T06:05:13.724250+0000","last_clean":"2024-09-19T06:05:13.724250+0000","last_became_active":"2024-09-19T06:04:03.378096+0000","last_became_peered":"2024-09-19T06:04:03.378096+0000","last_unstale":"2024-09-19T06:05:13.724250+0000","last_undegraded":"2024-09-19T06:05:13.724250+0000","last_fullsized":"2024-09-19T06:05:13.724250+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:14:33.988869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726970+0000","last_change":"2024-09-19T06:04:12.635410+0000","last_active":"2024-09-19T06:05:13.726970+0000","last_peered":"2024-09-19T06:05:13.726970+0000","last_clean":"2024-09-19T06:05:13.726970+0000","last_became_active":"2024-09-19T06:04:12.634852+0000","last_became_peered":"2024-09-19T06:04:12.634852+0000","last_unstale":"2024-09-19T06:05:13.726970+0000","last_undegraded":"2024-09-19T06:05:13.726970+0000","last_fullsized":"2024-09-19T06:05:13.726970+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:28:46.014324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"89'7","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:06:12.648293+0000","last_change":"2024-09-19T06:04:05.421348+0000","last_active":"2024-09-19T06:06:12.648293+0000","last_peered":"2024-09-19T06:06:12.648293+0000","last_clean":"2024-09-19T06:06:12.648293+0000","last_became_active":"2024-09-19T06:04:05.420999+0000","last_became_peered":"2024-09-19T06:04:05.420999+0000","last_unstale":"2024-09-19T06:06:12.648293+0000","last_undegraded":"2024-09-19T06:06:12.648293+0000","last_fullsized":"2024-09-19T06:06:12.648293+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:52:26.257580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724594+0000","last_change":"2024-09-19T06:04:03.321233+0000","last_active":"2024-09-19T06:05:13.724594+0000","last_peered":"2024-09-19T06:05:13.724594+0000","last_clean":"2024-09-19T06:05:13.724594+0000","last_became_active":"2024-09-19T06:04:03.320755+0000","last_became_peered":"2024-09-19T06:04:03.320755+0000","last_unstale":"2024-09-19T06:05:13.724594+0000","last_undegraded":"2024-09-19T06:05:13.724594+0000","last_fullsized":"2024-09-19T06:05:13.724594+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:46.661751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.158645+0000","last_change":"2024-09-19T06:04:12.463185+0000","last_active":"2024-09-19T06:05:14.158645+0000","last_peered":"2024-09-19T06:05:14.158645+0000","last_clean":"2024-09-19T06:05:14.158645+0000","last_became_active":"2024-09-19T06:04:12.462824+0000","last_became_peered":"2024-09-19T06:04:12.462824+0000","last_unstale":"2024-09-19T06:05:14.158645+0000","last_undegraded":"2024-09-19T06:05:14.158645+0000","last_fullsized":"2024-09-19T06:05:14.158645+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:54:05.634907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.474286+0000","last_change":"2024-09-19T06:04:05.427259+0000","last_active":"2024-09-19T06:05:14.474286+0000","last_peered":"2024-09-19T06:05:14.474286+0000","last_clean":"2024-09-19T06:05:14.474286+0000","last_became_active":"2024-09-19T06:04:05.426955+0000","last_became_peered":"2024-09-19T06:04:05.426955+0000","last_unstale":"2024-09-19T06:05:14.474286+0000","last_undegraded":"2024-09-19T06:05:14.474286+0000","last_fullsized":"2024-09-19T06:05:14.474286+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:34:22.085384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.158553+0000","last_change":"2024-09-19T06:04:03.378174+0000","last_active":"2024-09-19T06:05:14.158553+0000","last_peered":"2024-09-19T06:05:14.158553+0000","last_clean":"2024-09-19T06:05:14.158553+0000","last_became_active":"2024-09-19T06:04:03.377803+0000","last_became_peered":"2024-09-19T06:04:03.377803+0000","last_unstale":"2024-09-19T06:05:14.158553+0000","last_undegraded":"2024-09-19T06:05:14.158553+0000","last_fullsized":"2024-09-19T06:05:14.158553+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:24:26.087284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.158946+0000","last_change":"2024-09-19T06:04:12.635365+0000","last_active":"2024-09-19T06:05:14.158946+0000","last_peered":"2024-09-19T06:05:14.158946+0000","last_clean":"2024-09-19T06:05:14.158946+0000","last_became_active":"2024-09-19T06:04:12.634691+0000","last_became_peered":"2024-09-19T06:04:12.634691+0000","last_unstale":"2024-09-19T06:05:14.158946+0000","last_undegraded":"2024-09-19T06:05:14.158946+0000","last_fullsized":"2024-09-19T06:05:14.158946+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:20:58.523992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.158431+0000","last_change":"2024-09-19T06:04:05.425638+0000","last_active":"2024-09-19T06:05:14.158431+0000","last_peered":"2024-09-19T06:05:14.158431+0000","last_clean":"2024-09-19T06:05:14.158431+0000","last_became_active":"2024-09-19T06:04:05.425356+0000","last_became_peered":"2024-09-19T06:04:05.425356+0000","last_unstale":"2024-09-19T06:05:14.158431+0000","last_undegraded":"2024-09-19T06:05:14.158431+0000","last_fullsized":"2024-09-19T06:05:14.158431+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:51:11.857888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.725170+0000","last_change":"2024-09-19T06:04:03.322432+0000","last_active":"2024-09-19T06:05:13.725170+0000","last_peered":"2024-09-19T06:05:13.725170+0000","last_clean":"2024-09-19T06:05:13.725170+0000","last_became_active":"2024-09-19T06:04:03.322071+0000","last_became_peered":"2024-09-19T06:04:03.322071+0000","last_unstale":"2024-09-19T06:05:13.725170+0000","last_undegraded":"2024-09-19T06:05:13.725170+0000","last_fullsized":"2024-09-19T06:05:13.725170+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:16:23.935470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.474787+0000","last_change":"2024-09-19T06:04:12.635970+0000","last_active":"2024-09-19T06:05:14.474787+0000","last_peered":"2024-09-19T06:05:14.474787+0000","last_clean":"2024-09-19T06:05:14.474787+0000","last_became_active":"2024-09-19T06:04:12.635283+0000","last_became_peered":"2024-09-19T06:04:12.635283+0000","last_unstale":"2024-09-19T06:05:14.474787+0000","last_undegraded":"2024-09-19T06:05:14.474787+0000","last_fullsized":"2024-09-19T06:05:14.474787+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:55:05.460652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.729630+0000","last_change":"2024-09-19T06:04:05.424335+0000","last_active":"2024-09-19T06:05:13.729630+0000","last_peered":"2024-09-19T06:05:13.729630+0000","last_clean":"2024-09-19T06:05:13.729630+0000","last_became_active":"2024-09-19T06:04:05.423868+0000","last_became_peered":"2024-09-19T06:04:05.423868+0000","last_unstale":"2024-09-19T06:05:13.729630+0000","last_undegraded":"2024-09-19T06:05:13.729630+0000","last_fullsized":"2024-09-19T06:05:13.729630+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:17:15.556240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727369+0000","last_change":"2024-09-19T06:04:03.315749+0000","last_active":"2024-09-19T06:05:13.727369+0000","last_peered":"2024-09-19T06:05:13.727369+0000","last_clean":"2024-09-19T06:05:13.727369+0000","last_became_active":"2024-09-19T06:04:03.315404+0000","last_became_peered":"2024-09-19T06:04:03.315404+0000","last_unstale":"2024-09-19T06:05:13.727369+0000","last_undegraded":"2024-09-19T06:05:13.727369+0000","last_fullsized":"2024-09-19T06:05:13.727369+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:43:35.485993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":345,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724597+0000","last_change":"2024-09-19T06:02:49.934106+0000","last_active":"2024-09-19T06:05:13.724597+0000","last_peered":"2024-09-19T06:05:13.724597+0000","last_clean":"2024-09-19T06:05:13.724597+0000","last_became_active":"2024-09-19T06:02:49.933684+0000","last_became_peered":"2024-09-19T06:02:49.933684+0000","last_unstale":"2024-09-19T06:05:13.724597+0000","last_undegraded":"2024-09-19T06:05:13.724597+0000","last_fullsized":"2024-09-19T06:05:13.724597+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:59:27.582796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:59:27.582796+0000","last_clean_scrub_stamp":"2024-09-19T05:59:27.582796+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:35:06.837740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"87'1","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724414+0000","last_change":"2024-09-19T06:04:12.468160+0000","last_active":"2024-09-19T06:05:13.724414+0000","last_peered":"2024-09-19T06:05:13.724414+0000","last_clean":"2024-09-19T06:05:13.724414+0000","last_became_active":"2024-09-19T06:04:12.467642+0000","last_became_peered":"2024-09-19T06:04:12.467642+0000","last_unstale":"2024-09-19T06:05:13.724414+0000","last_undegraded":"2024-09-19T06:05:13.724414+0000","last_fullsized":"2024-09-19T06:05:13.724414+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:40.053143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724738+0000","last_change":"2024-09-19T06:04:05.435815+0000","last_active":"2024-09-19T06:05:13.724738+0000","last_peered":"2024-09-19T06:05:13.724738+0000","last_clean":"2024-09-19T06:05:13.724738+0000","last_became_active":"2024-09-19T06:04:05.435498+0000","last_became_peered":"2024-09-19T06:04:05.435498+0000","last_unstale":"2024-09-19T06:05:13.724738+0000","last_undegraded":"2024-09-19T06:05:13.724738+0000","last_fullsized":"2024-09-19T06:05:13.724738+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:33:30.330877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.731805+0000","last_change":"2024-09-19T06:05:13.730770+0000","last_active":"2024-09-19T06:05:13.731805+0000","last_peered":"2024-09-19T06:05:13.731805+0000","last_clean":"2024-09-19T06:05:13.731805+0000","last_became_active":"2024-09-19T06:05:13.730360+0000","last_became_peered":"2024-09-19T06:05:13.730360+0000","last_unstale":"2024-09-19T06:05:13.731805+0000","last_undegraded":"2024-09-19T06:05:13.731805+0000","last_fullsized":"2024-09-19T06:05:13.731805+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:06:34.488351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:15.014149+0000","last_change":"2024-09-19T06:04:12.466249+0000","last_active":"2024-09-19T06:05:15.014149+0000","last_peered":"2024-09-19T06:05:15.014149+0000","last_clean":"2024-09-19T06:05:15.014149+0000","last_became_active":"2024-09-19T06:04:12.465709+0000","last_became_peered":"2024-09-19T06:04:12.465709+0000","last_unstale":"2024-09-19T06:05:15.014149+0000","last_undegraded":"2024-09-19T06:05:15.014149+0000","last_fullsized":"2024-09-19T06:05:15.014149+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:02:11.454334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724466+0000","last_change":"2024-09-19T06:04:05.425733+0000","last_active":"2024-09-19T06:05:13.724466+0000","last_peered":"2024-09-19T06:05:13.724466+0000","last_clean":"2024-09-19T06:05:13.724466+0000","last_became_active":"2024-09-19T06:04:05.425399+0000","last_became_peered":"2024-09-19T06:04:05.425399+0000","last_unstale":"2024-09-19T06:05:13.724466+0000","last_undegraded":"2024-09-19T06:05:13.724466+0000","last_fullsized":"2024-09-19T06:05:13.724466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:35:33.287456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.475134+0000","last_change":"2024-09-19T06:04:03.319361+0000","last_active":"2024-09-19T06:05:14.475134+0000","last_peered":"2024-09-19T06:05:14.475134+0000","last_clean":"2024-09-19T06:05:14.475134+0000","last_became_active":"2024-09-19T06:04:03.319053+0000","last_became_peered":"2024-09-19T06:04:03.319053+0000","last_unstale":"2024-09-19T06:05:14.475134+0000","last_undegraded":"2024-09-19T06:05:14.475134+0000","last_fullsized":"2024-09-19T06:05:14.475134+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:25:23.739392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726834+0000","last_change":"2024-09-19T06:04:12.468270+0000","last_active":"2024-09-19T06:05:13.726834+0000","last_peered":"2024-09-19T06:05:13.726834+0000","last_clean":"2024-09-19T06:05:13.726834+0000","last_became_active":"2024-09-19T06:04:12.467872+0000","last_became_peered":"2024-09-19T06:04:12.467872+0000","last_unstale":"2024-09-19T06:05:13.726834+0000","last_undegraded":"2024-09-19T06:05:13.726834+0000","last_fullsized":"2024-09-19T06:05:13.726834+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:35.476189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724645+0000","last_change":"2024-09-19T06:04:05.431360+0000","last_active":"2024-09-19T06:05:13.724645+0000","last_peered":"2024-09-19T06:05:13.724645+0000","last_clean":"2024-09-19T06:05:13.724645+0000","last_became_active":"2024-09-19T06:04:05.431067+0000","last_became_peered":"2024-09-19T06:04:05.431067+0000","last_unstale":"2024-09-19T06:05:13.724645+0000","last_undegraded":"2024-09-19T06:05:13.724645+0000","last_fullsized":"2024-09-19T06:05:13.724645+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:16:25.317086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.159080+0000","last_change":"2024-09-19T06:04:03.316793+0000","last_active":"2024-09-19T06:05:14.159080+0000","last_peered":"2024-09-19T06:05:14.159080+0000","last_clean":"2024-09-19T06:05:14.159080+0000","last_became_active":"2024-09-19T06:04:03.316485+0000","last_became_peered":"2024-09-19T06:04:03.316485+0000","last_unstale":"2024-09-19T06:05:14.159080+0000","last_undegraded":"2024-09-19T06:05:14.159080+0000","last_fullsized":"2024-09-19T06:05:14.159080+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:19:26.427025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.473926+0000","last_change":"2024-09-19T06:04:12.466322+0000","last_active":"2024-09-19T06:05:14.473926+0000","last_peered":"2024-09-19T06:05:14.473926+0000","last_clean":"2024-09-19T06:05:14.473926+0000","last_became_active":"2024-09-19T06:04:12.465806+0000","last_became_peered":"2024-09-19T06:04:12.465806+0000","last_unstale":"2024-09-19T06:05:14.473926+0000","last_undegraded":"2024-09-19T06:05:14.473926+0000","last_fullsized":"2024-09-19T06:05:14.473926+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:33:28.893570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727866+0000","last_change":"2024-09-19T06:04:05.424864+0000","last_active":"2024-09-19T06:05:13.727866+0000","last_peered":"2024-09-19T06:05:13.727866+0000","last_clean":"2024-09-19T06:05:13.727866+0000","last_became_active":"2024-09-19T06:04:05.424504+0000","last_became_peered":"2024-09-19T06:04:05.424504+0000","last_unstale":"2024-09-19T06:05:13.727866+0000","last_undegraded":"2024-09-19T06:05:13.727866+0000","last_fullsized":"2024-09-19T06:05:13.727866+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:30.471757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.728243+0000","last_change":"2024-09-19T06:04:03.321925+0000","last_active":"2024-09-19T06:05:13.728243+0000","last_peered":"2024-09-19T06:05:13.728243+0000","last_clean":"2024-09-19T06:05:13.728243+0000","last_became_active":"2024-09-19T06:04:03.321445+0000","last_became_peered":"2024-09-19T06:04:03.321445+0000","last_unstale":"2024-09-19T06:05:13.728243+0000","last_undegraded":"2024-09-19T06:05:13.728243+0000","last_fullsized":"2024-09-19T06:05:13.728243+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:15:55.621352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.474063+0000","last_change":"2024-09-19T06:04:12.471413+0000","last_active":"2024-09-19T06:05:14.474063+0000","last_peered":"2024-09-19T06:05:14.474063+0000","last_clean":"2024-09-19T06:05:14.474063+0000","last_became_active":"2024-09-19T06:04:12.471057+0000","last_became_peered":"2024-09-19T06:04:12.471057+0000","last_unstale":"2024-09-19T06:05:14.474063+0000","last_undegraded":"2024-09-19T06:05:14.474063+0000","last_fullsized":"2024-09-19T06:05:14.474063+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:08:47.259211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.474222+0000","last_change":"2024-09-19T06:04:05.429447+0000","last_active":"2024-09-19T06:05:14.474222+0000","last_peered":"2024-09-19T06:05:14.474222+0000","last_clean":"2024-09-19T06:05:14.474222+0000","last_became_active":"2024-09-19T06:04:05.428852+0000","last_became_peered":"2024-09-19T06:04:05.428852+0000","last_unstale":"2024-09-19T06:05:14.474222+0000","last_undegraded":"2024-09-19T06:05:14.474222+0000","last_fullsized":"2024-09-19T06:05:14.474222+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:01.466814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726844+0000","last_change":"2024-09-19T06:04:03.378586+0000","last_active":"2024-09-19T06:05:13.726844+0000","last_peered":"2024-09-19T06:05:13.726844+0000","last_clean":"2024-09-19T06:05:13.726844+0000","last_became_active":"2024-09-19T06:04:03.378292+0000","last_became_peered":"2024-09-19T06:04:03.378292+0000","last_unstale":"2024-09-19T06:05:13.726844+0000","last_undegraded":"2024-09-19T06:05:13.726844+0000","last_fullsized":"2024-09-19T06:05:13.726844+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:54.247070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.159022+0000","last_change":"2024-09-19T06:04:12.470914+0000","last_active":"2024-09-19T06:05:14.159022+0000","last_peered":"2024-09-19T06:05:14.159022+0000","last_clean":"2024-09-19T06:05:14.159022+0000","last_became_active":"2024-09-19T06:04:12.470563+0000","last_became_peered":"2024-09-19T06:04:12.470563+0000","last_unstale":"2024-09-19T06:05:14.159022+0000","last_undegraded":"2024-09-19T06:05:14.159022+0000","last_fullsized":"2024-09-19T06:05:14.159022+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:13.060646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724169+0000","last_change":"2024-09-19T06:04:05.424009+0000","last_active":"2024-09-19T06:05:13.724169+0000","last_peered":"2024-09-19T06:05:13.724169+0000","last_clean":"2024-09-19T06:05:13.724169+0000","last_became_active":"2024-09-19T06:04:05.423670+0000","last_became_peered":"2024-09-19T06:04:05.423670+0000","last_unstale":"2024-09-19T06:05:13.724169+0000","last_undegraded":"2024-09-19T06:05:13.724169+0000","last_fullsized":"2024-09-19T06:05:13.724169+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:30:15.165259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726323+0000","last_change":"2024-09-19T06:04:03.317089+0000","last_active":"2024-09-19T06:05:13.726323+0000","last_peered":"2024-09-19T06:05:13.726323+0000","last_clean":"2024-09-19T06:05:13.726323+0000","last_became_active":"2024-09-19T06:04:03.316575+0000","last_became_peered":"2024-09-19T06:04:03.316575+0000","last_unstale":"2024-09-19T06:05:13.726323+0000","last_undegraded":"2024-09-19T06:05:13.726323+0000","last_fullsized":"2024-09-19T06:05:13.726323+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:11:43.769660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.732957+0000","last_change":"2024-09-19T06:05:13.731879+0000","last_active":"2024-09-19T06:05:13.732957+0000","last_peered":"2024-09-19T06:05:13.732957+0000","last_clean":"2024-09-19T06:05:13.732957+0000","last_became_active":"2024-09-19T06:05:13.731373+0000","last_became_peered":"2024-09-19T06:05:13.731373+0000","last_unstale":"2024-09-19T06:05:13.732957+0000","last_undegraded":"2024-09-19T06:05:13.732957+0000","last_fullsized":"2024-09-19T06:05:13.732957+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:41:45.556733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724870+0000","last_change":"2024-09-19T06:04:05.430145+0000","last_active":"2024-09-19T06:05:13.724870+0000","last_peered":"2024-09-19T06:05:13.724870+0000","last_clean":"2024-09-19T06:05:13.724870+0000","last_became_active":"2024-09-19T06:04:05.429763+0000","last_became_peered":"2024-09-19T06:04:05.429763+0000","last_unstale":"2024-09-19T06:05:13.724870+0000","last_undegraded":"2024-09-19T06:05:13.724870+0000","last_fullsized":"2024-09-19T06:05:13.724870+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:44:38.783894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.474581+0000","last_change":"2024-09-19T06:04:03.317410+0000","last_active":"2024-09-19T06:05:14.474581+0000","last_peered":"2024-09-19T06:05:14.474581+0000","last_clean":"2024-09-19T06:05:14.474581+0000","last_became_active":"2024-09-19T06:04:03.317068+0000","last_became_peered":"2024-09-19T06:04:03.317068+0000","last_unstale":"2024-09-19T06:05:14.474581+0000","last_undegraded":"2024-09-19T06:05:14.474581+0000","last_fullsized":"2024-09-19T06:05:14.474581+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:23.209080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727395+0000","last_change":"2024-09-19T06:04:12.469867+0000","last_active":"2024-09-19T06:05:13.727395+0000","last_peered":"2024-09-19T06:05:13.727395+0000","last_clean":"2024-09-19T06:05:13.727395+0000","last_became_active":"2024-09-19T06:04:12.469391+0000","last_became_peered":"2024-09-19T06:04:12.469391+0000","last_unstale":"2024-09-19T06:05:13.727395+0000","last_undegraded":"2024-09-19T06:05:13.727395+0000","last_fullsized":"2024-09-19T06:05:13.727395+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:43:29.493247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.158639+0000","last_change":"2024-09-19T06:04:05.423515+0000","last_active":"2024-09-19T06:05:14.158639+0000","last_peered":"2024-09-19T06:05:14.158639+0000","last_clean":"2024-09-19T06:05:14.158639+0000","last_became_active":"2024-09-19T06:04:05.422185+0000","last_became_peered":"2024-09-19T06:04:05.422185+0000","last_unstale":"2024-09-19T06:05:14.158639+0000","last_undegraded":"2024-09-19T06:05:14.158639+0000","last_fullsized":"2024-09-19T06:05:14.158639+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:09:22.951171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"81'2","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.737281+0000","last_change":"2024-09-19T06:05:13.736876+0000","last_active":"2024-09-19T06:05:13.737281+0000","last_peered":"2024-09-19T06:05:13.737281+0000","last_clean":"2024-09-19T06:05:13.737281+0000","last_became_active":"2024-09-19T06:05:13.731079+0000","last_became_peered":"2024-09-19T06:05:13.731079+0000","last_unstale":"2024-09-19T06:05:13.737281+0000","last_undegraded":"2024-09-19T06:05:13.737281+0000","last_fullsized":"2024-09-19T06:05:13.737281+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:23.458684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.474836+0000","last_change":"2024-09-19T06:04:12.468569+0000","last_active":"2024-09-19T06:05:14.474836+0000","last_peered":"2024-09-19T06:05:14.474836+0000","last_clean":"2024-09-19T06:05:14.474836+0000","last_became_active":"2024-09-19T06:04:12.467759+0000","last_became_peered":"2024-09-19T06:04:12.467759+0000","last_unstale":"2024-09-19T06:05:14.474836+0000","last_undegraded":"2024-09-19T06:05:14.474836+0000","last_fullsized":"2024-09-19T06:05:14.474836+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:20:49.817163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727216+0000","last_change":"2024-09-19T06:04:05.425703+0000","last_active":"2024-09-19T06:05:13.727216+0000","last_peered":"2024-09-19T06:05:13.727216+0000","last_clean":"2024-09-19T06:05:13.727216+0000","last_became_active":"2024-09-19T06:04:05.425360+0000","last_became_peered":"2024-09-19T06:04:05.425360+0000","last_unstale":"2024-09-19T06:05:13.727216+0000","last_undegraded":"2024-09-19T06:05:13.727216+0000","last_fullsized":"2024-09-19T06:05:13.727216+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:33:25.457191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"89'34","reported_seq":263,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:06:12.682978+0000","last_change":"2024-09-19T06:04:03.319087+0000","last_active":"2024-09-19T06:06:12.682978+0000","last_peered":"2024-09-19T06:06:12.682978+0000","last_clean":"2024-09-19T06:06:12.682978+0000","last_became_active":"2024-09-19T06:04:03.318721+0000","last_became_peered":"2024-09-19T06:04:03.318721+0000","last_unstale":"2024-09-19T06:06:12.682978+0000","last_undegraded":"2024-09-19T06:06:12.682978+0000","last_fullsized":"2024-09-19T06:06:12.682978+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:14:32.337455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68382,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":195,"num_read_kb":164,"num_write":34,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.723734+0000","last_change":"2024-09-19T06:04:12.472008+0000","last_active":"2024-09-19T06:05:13.723734+0000","last_peered":"2024-09-19T06:05:13.723734+0000","last_clean":"2024-09-19T06:05:13.723734+0000","last_became_active":"2024-09-19T06:04:12.471623+0000","last_became_peered":"2024-09-19T06:04:12.471623+0000","last_unstale":"2024-09-19T06:05:13.723734+0000","last_undegraded":"2024-09-19T06:05:13.723734+0000","last_fullsized":"2024-09-19T06:05:13.723734+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:13:11.424242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:15.014354+0000","last_change":"2024-09-19T06:04:05.434865+0000","last_active":"2024-09-19T06:05:15.014354+0000","last_peered":"2024-09-19T06:05:15.014354+0000","last_clean":"2024-09-19T06:05:15.014354+0000","last_became_active":"2024-09-19T06:04:05.434472+0000","last_became_peered":"2024-09-19T06:04:05.434472+0000","last_unstale":"2024-09-19T06:05:15.014354+0000","last_undegraded":"2024-09-19T06:05:15.014354+0000","last_fullsized":"2024-09-19T06:05:15.014354+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:35.490406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"81'3","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.475083+0000","last_change":"2024-09-19T06:04:03.380447+0000","last_active":"2024-09-19T06:05:14.475083+0000","last_peered":"2024-09-19T06:05:14.475083+0000","last_clean":"2024-09-19T06:05:14.475083+0000","last_became_active":"2024-09-19T06:04:03.380154+0000","last_became_peered":"2024-09-19T06:04:03.380154+0000","last_unstale":"2024-09-19T06:05:14.475083+0000","last_undegraded":"2024-09-19T06:05:14.475083+0000","last_fullsized":"2024-09-19T06:05:14.475083+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:48:11.570148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726945+0000","last_change":"2024-09-19T06:04:12.467995+0000","last_active":"2024-09-19T06:05:13.726945+0000","last_peered":"2024-09-19T06:05:13.726945+0000","last_clean":"2024-09-19T06:05:13.726945+0000","last_became_active":"2024-09-19T06:04:12.467539+0000","last_became_peered":"2024-09-19T06:04:12.467539+0000","last_unstale":"2024-09-19T06:05:13.726945+0000","last_undegraded":"2024-09-19T06:05:13.726945+0000","last_fullsized":"2024-09-19T06:05:13.726945+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:13:29.285909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726884+0000","last_change":"2024-09-19T06:04:05.429919+0000","last_active":"2024-09-19T06:05:13.726884+0000","last_peered":"2024-09-19T06:05:13.726884+0000","last_clean":"2024-09-19T06:05:13.726884+0000","last_became_active":"2024-09-19T06:04:05.429597+0000","last_became_peered":"2024-09-19T06:04:05.429597+0000","last_unstale":"2024-09-19T06:05:13.726884+0000","last_undegraded":"2024-09-19T06:05:13.726884+0000","last_fullsized":"2024-09-19T06:05:13.726884+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:08:38.816272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724643+0000","last_change":"2024-09-19T06:04:03.320501+0000","last_active":"2024-09-19T06:05:13.724643+0000","last_peered":"2024-09-19T06:05:13.724643+0000","last_clean":"2024-09-19T06:05:13.724643+0000","last_became_active":"2024-09-19T06:04:03.320093+0000","last_became_peered":"2024-09-19T06:04:03.320093+0000","last_unstale":"2024-09-19T06:05:13.724643+0000","last_undegraded":"2024-09-19T06:05:13.724643+0000","last_fullsized":"2024-09-19T06:05:13.724643+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:31:11.896935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.723518+0000","last_change":"2024-09-19T06:04:12.468455+0000","last_active":"2024-09-19T06:05:13.723518+0000","last_peered":"2024-09-19T06:05:13.723518+0000","last_clean":"2024-09-19T06:05:13.723518+0000","last_became_active":"2024-09-19T06:04:12.468007+0000","last_became_peered":"2024-09-19T06:04:12.468007+0000","last_unstale":"2024-09-19T06:05:13.723518+0000","last_undegraded":"2024-09-19T06:05:13.723518+0000","last_fullsized":"2024-09-19T06:05:13.723518+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:50:58.995825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:15.014577+0000","last_change":"2024-09-19T06:04:05.427599+0000","last_active":"2024-09-19T06:05:15.014577+0000","last_peered":"2024-09-19T06:05:15.014577+0000","last_clean":"2024-09-19T06:05:15.014577+0000","last_became_active":"2024-09-19T06:04:05.425338+0000","last_became_peered":"2024-09-19T06:04:05.425338+0000","last_unstale":"2024-09-19T06:05:15.014577+0000","last_undegraded":"2024-09-19T06:05:15.014577+0000","last_fullsized":"2024-09-19T06:05:15.014577+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:44.547625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.728363+0000","last_change":"2024-09-19T06:04:03.322165+0000","last_active":"2024-09-19T06:05:13.728363+0000","last_peered":"2024-09-19T06:05:13.728363+0000","last_clean":"2024-09-19T06:05:13.728363+0000","last_became_active":"2024-09-19T06:04:03.321822+0000","last_became_peered":"2024-09-19T06:04:03.321822+0000","last_unstale":"2024-09-19T06:05:13.728363+0000","last_undegraded":"2024-09-19T06:05:13.728363+0000","last_fullsized":"2024-09-19T06:05:13.728363+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:58:00.943453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.729258+0000","last_change":"2024-09-19T06:04:12.465823+0000","last_active":"2024-09-19T06:05:13.729258+0000","last_peered":"2024-09-19T06:05:13.729258+0000","last_clean":"2024-09-19T06:05:13.729258+0000","last_became_active":"2024-09-19T06:04:12.465375+0000","last_became_peered":"2024-09-19T06:04:12.465375+0000","last_unstale":"2024-09-19T06:05:13.729258+0000","last_undegraded":"2024-09-19T06:05:13.729258+0000","last_fullsized":"2024-09-19T06:05:13.729258+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:26:25.428328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726852+0000","last_change":"2024-09-19T06:04:12.470023+0000","last_active":"2024-09-19T06:05:13.726852+0000","last_peered":"2024-09-19T06:05:13.726852+0000","last_clean":"2024-09-19T06:05:13.726852+0000","last_became_active":"2024-09-19T06:04:12.469651+0000","last_became_peered":"2024-09-19T06:04:12.469651+0000","last_unstale":"2024-09-19T06:05:13.726852+0000","last_undegraded":"2024-09-19T06:05:13.726852+0000","last_fullsized":"2024-09-19T06:05:13.726852+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:50:35.374437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.723642+0000","last_change":"2024-09-19T06:04:05.417466+0000","last_active":"2024-09-19T06:05:13.723642+0000","last_peered":"2024-09-19T06:05:13.723642+0000","last_clean":"2024-09-19T06:05:13.723642+0000","last_became_active":"2024-09-19T06:04:05.417026+0000","last_became_peered":"2024-09-19T06:04:05.417026+0000","last_unstale":"2024-09-19T06:05:13.723642+0000","last_undegraded":"2024-09-19T06:05:13.723642+0000","last_fullsized":"2024-09-19T06:05:13.723642+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:44:08.251755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.474542+0000","last_change":"2024-09-19T06:04:03.317466+0000","last_active":"2024-09-19T06:05:14.474542+0000","last_peered":"2024-09-19T06:05:14.474542+0000","last_clean":"2024-09-19T06:05:14.474542+0000","last_became_active":"2024-09-19T06:04:03.317148+0000","last_became_peered":"2024-09-19T06:04:03.317148+0000","last_unstale":"2024-09-19T06:05:14.474542+0000","last_undegraded":"2024-09-19T06:05:14.474542+0000","last_fullsized":"2024-09-19T06:05:14.474542+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:45:50.789900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727976+0000","last_change":"2024-09-19T06:04:12.469279+0000","last_active":"2024-09-19T06:05:13.727976+0000","last_peered":"2024-09-19T06:05:13.727976+0000","last_clean":"2024-09-19T06:05:13.727976+0000","last_became_active":"2024-09-19T06:04:12.467928+0000","last_became_peered":"2024-09-19T06:04:12.467928+0000","last_unstale":"2024-09-19T06:05:13.727976+0000","last_undegraded":"2024-09-19T06:05:13.727976+0000","last_fullsized":"2024-09-19T06:05:13.727976+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:52:25.839433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.729399+0000","last_change":"2024-09-19T06:04:05.420425+0000","last_active":"2024-09-19T06:05:13.729399+0000","last_peered":"2024-09-19T06:05:13.729399+0000","last_clean":"2024-09-19T06:05:13.729399+0000","last_became_active":"2024-09-19T06:04:05.420107+0000","last_became_peered":"2024-09-19T06:04:05.420107+0000","last_unstale":"2024-09-19T06:05:13.729399+0000","last_undegraded":"2024-09-19T06:05:13.729399+0000","last_fullsized":"2024-09-19T06:05:13.729399+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:49:24.566302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.158396+0000","last_change":"2024-09-19T06:04:03.315704+0000","last_active":"2024-09-19T06:05:14.158396+0000","last_peered":"2024-09-19T06:05:14.158396+0000","last_clean":"2024-09-19T06:05:14.158396+0000","last_became_active":"2024-09-19T06:04:03.315392+0000","last_became_peered":"2024-09-19T06:04:03.315392+0000","last_unstale":"2024-09-19T06:05:14.158396+0000","last_undegraded":"2024-09-19T06:05:14.158396+0000","last_fullsized":"2024-09-19T06:05:14.158396+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:52:14.417470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"81'1","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.728460+0000","last_change":"2024-09-19T06:04:03.323560+0000","last_active":"2024-09-19T06:05:13.728460+0000","last_peered":"2024-09-19T06:05:13.728460+0000","last_clean":"2024-09-19T06:05:13.728460+0000","last_became_active":"2024-09-19T06:04:03.323188+0000","last_became_peered":"2024-09-19T06:04:03.323188+0000","last_unstale":"2024-09-19T06:05:13.728460+0000","last_undegraded":"2024-09-19T06:05:13.728460+0000","last_fullsized":"2024-09-19T06:05:13.728460+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:02:50.426435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.474822+0000","last_change":"2024-09-19T06:04:05.430677+0000","last_active":"2024-09-19T06:05:14.474822+0000","last_peered":"2024-09-19T06:05:14.474822+0000","last_clean":"2024-09-19T06:05:14.474822+0000","last_became_active":"2024-09-19T06:04:05.430257+0000","last_became_peered":"2024-09-19T06:04:05.430257+0000","last_unstale":"2024-09-19T06:05:14.474822+0000","last_undegraded":"2024-09-19T06:05:14.474822+0000","last_fullsized":"2024-09-19T06:05:14.474822+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:38:42.138770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727118+0000","last_change":"2024-09-19T06:04:12.465252+0000","last_active":"2024-09-19T06:05:13.727118+0000","last_peered":"2024-09-19T06:05:13.727118+0000","last_clean":"2024-09-19T06:05:13.727118+0000","last_became_active":"2024-09-19T06:04:12.464649+0000","last_became_peered":"2024-09-19T06:04:12.464649+0000","last_unstale":"2024-09-19T06:05:13.727118+0000","last_undegraded":"2024-09-19T06:05:13.727118+0000","last_fullsized":"2024-09-19T06:05:13.727118+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:11:43.137148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"81'1","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.474959+0000","last_change":"2024-09-19T06:04:03.317584+0000","last_active":"2024-09-19T06:05:14.474959+0000","last_peered":"2024-09-19T06:05:14.474959+0000","last_clean":"2024-09-19T06:05:14.474959+0000","last_became_active":"2024-09-19T06:04:03.317250+0000","last_became_peered":"2024-09-19T06:04:03.317250+0000","last_unstale":"2024-09-19T06:05:14.474959+0000","last_undegraded":"2024-09-19T06:05:14.474959+0000","last_fullsized":"2024-09-19T06:05:14.474959+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:22.353887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727268+0000","last_change":"2024-09-19T06:04:05.431102+0000","last_active":"2024-09-19T06:05:13.727268+0000","last_peered":"2024-09-19T06:05:13.727268+0000","last_clean":"2024-09-19T06:05:13.727268+0000","last_became_active":"2024-09-19T06:04:05.430792+0000","last_became_peered":"2024-09-19T06:04:05.430792+0000","last_unstale":"2024-09-19T06:05:13.727268+0000","last_undegraded":"2024-09-19T06:05:13.727268+0000","last_fullsized":"2024-09-19T06:05:13.727268+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:48:48.682273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727983+0000","last_change":"2024-09-19T06:04:12.467143+0000","last_active":"2024-09-19T06:05:13.727983+0000","last_peered":"2024-09-19T06:05:13.727983+0000","last_clean":"2024-09-19T06:05:13.727983+0000","last_became_active":"2024-09-19T06:04:12.466672+0000","last_became_peered":"2024-09-19T06:04:12.466672+0000","last_unstale":"2024-09-19T06:05:13.727983+0000","last_undegraded":"2024-09-19T06:05:13.727983+0000","last_fullsized":"2024-09-19T06:05:13.727983+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:57:36.710316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726828+0000","last_change":"2024-09-19T06:04:05.427387+0000","last_active":"2024-09-19T06:05:13.726828+0000","last_peered":"2024-09-19T06:05:13.726828+0000","last_clean":"2024-09-19T06:05:13.726828+0000","last_became_active":"2024-09-19T06:04:05.427082+0000","last_became_peered":"2024-09-19T06:04:05.427082+0000","last_unstale":"2024-09-19T06:05:13.726828+0000","last_undegraded":"2024-09-19T06:05:13.726828+0000","last_fullsized":"2024-09-19T06:05:13.726828+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:55.931289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.728442+0000","last_change":"2024-09-19T06:04:05.434396+0000","last_active":"2024-09-19T06:05:13.728442+0000","last_peered":"2024-09-19T06:05:13.728442+0000","last_clean":"2024-09-19T06:05:13.728442+0000","last_became_active":"2024-09-19T06:04:05.433907+0000","last_became_peered":"2024-09-19T06:04:05.433907+0000","last_unstale":"2024-09-19T06:05:13.728442+0000","last_undegraded":"2024-09-19T06:05:13.728442+0000","last_fullsized":"2024-09-19T06:05:13.728442+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:02:40.885820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727903+0000","last_change":"2024-09-19T06:04:05.435813+0000","last_active":"2024-09-19T06:05:13.727903+0000","last_peered":"2024-09-19T06:05:13.727903+0000","last_clean":"2024-09-19T06:05:13.727903+0000","last_became_active":"2024-09-19T06:04:05.435441+0000","last_became_peered":"2024-09-19T06:04:05.435441+0000","last_unstale":"2024-09-19T06:05:13.727903+0000","last_undegraded":"2024-09-19T06:05:13.727903+0000","last_fullsized":"2024-09-19T06:05:13.727903+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:11:20.071732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727073+0000","last_change":"2024-09-19T06:04:05.433045+0000","last_active":"2024-09-19T06:05:13.727073+0000","last_peered":"2024-09-19T06:05:13.727073+0000","last_clean":"2024-09-19T06:05:13.727073+0000","last_became_active":"2024-09-19T06:04:05.432674+0000","last_became_peered":"2024-09-19T06:04:05.432674+0000","last_unstale":"2024-09-19T06:05:13.727073+0000","last_undegraded":"2024-09-19T06:05:13.727073+0000","last_fullsized":"2024-09-19T06:05:13.727073+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:33:06.743886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.158713+0000","last_change":"2024-09-19T06:04:05.431702+0000","last_active":"2024-09-19T06:05:14.158713+0000","last_peered":"2024-09-19T06:05:14.158713+0000","last_clean":"2024-09-19T06:05:14.158713+0000","last_became_active":"2024-09-19T06:04:05.431394+0000","last_became_peered":"2024-09-19T06:04:05.431394+0000","last_unstale":"2024-09-19T06:05:14.158713+0000","last_undegraded":"2024-09-19T06:05:14.158713+0000","last_fullsized":"2024-09-19T06:05:14.158713+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:42:18.692549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.733030+0000","last_change":"2024-09-19T06:05:13.733030+0000","last_active":"2024-09-19T06:05:13.733030+0000","last_peered":"2024-09-19T06:05:13.733030+0000","last_clean":"2024-09-19T06:05:13.733030+0000","last_became_active":"2024-09-19T06:05:13.732680+0000","last_became_peered":"2024-09-19T06:05:13.732680+0000","last_unstale":"2024-09-19T06:05:13.733030+0000","last_undegraded":"2024-09-19T06:05:13.733030+0000","last_fullsized":"2024-09-19T06:05:13.733030+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:53:24.299931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727345+0000","last_change":"2024-09-19T06:04:05.430104+0000","last_active":"2024-09-19T06:05:13.727345+0000","last_peered":"2024-09-19T06:05:13.727345+0000","last_clean":"2024-09-19T06:05:13.727345+0000","last_became_active":"2024-09-19T06:04:05.429779+0000","last_became_peered":"2024-09-19T06:04:05.429779+0000","last_unstale":"2024-09-19T06:05:13.727345+0000","last_undegraded":"2024-09-19T06:05:13.727345+0000","last_fullsized":"2024-09-19T06:05:13.727345+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:52:46.191484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.730313+0000","last_change":"2024-09-19T06:04:05.427235+0000","last_active":"2024-09-19T06:05:13.730313+0000","last_peered":"2024-09-19T06:05:13.730313+0000","last_clean":"2024-09-19T06:05:13.730313+0000","last_became_active":"2024-09-19T06:04:05.426937+0000","last_became_peered":"2024-09-19T06:04:05.426937+0000","last_unstale":"2024-09-19T06:05:13.730313+0000","last_undegraded":"2024-09-19T06:05:13.730313+0000","last_fullsized":"2024-09-19T06:05:13.730313+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:55.949564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.474156+0000","last_change":"2024-09-19T06:04:05.422199+0000","last_active":"2024-09-19T06:05:14.474156+0000","last_peered":"2024-09-19T06:05:14.474156+0000","last_clean":"2024-09-19T06:05:14.474156+0000","last_became_active":"2024-09-19T06:04:05.421681+0000","last_became_peered":"2024-09-19T06:04:05.421681+0000","last_unstale":"2024-09-19T06:05:14.474156+0000","last_undegraded":"2024-09-19T06:05:14.474156+0000","last_fullsized":"2024-09-19T06:05:14.474156+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:27:54.774211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.729451+0000","last_change":"2024-09-19T06:04:05.426559+0000","last_active":"2024-09-19T06:05:13.729451+0000","last_peered":"2024-09-19T06:05:13.729451+0000","last_clean":"2024-09-19T06:05:13.729451+0000","last_became_active":"2024-09-19T06:04:05.423197+0000","last_became_peered":"2024-09-19T06:04:05.423197+0000","last_unstale":"2024-09-19T06:05:13.729451+0000","last_undegraded":"2024-09-19T06:05:13.729451+0000","last_fullsized":"2024-09-19T06:05:13.729451+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:43.964457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:15.014232+0000","last_change":"2024-09-19T06:04:05.435779+0000","last_active":"2024-09-19T06:05:15.014232+0000","last_peered":"2024-09-19T06:05:15.014232+0000","last_clean":"2024-09-19T06:05:15.014232+0000","last_became_active":"2024-09-19T06:04:05.435436+0000","last_became_peered":"2024-09-19T06:04:05.435436+0000","last_unstale":"2024-09-19T06:05:15.014232+0000","last_undegraded":"2024-09-19T06:05:15.014232+0000","last_fullsized":"2024-09-19T06:05:15.014232+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:13:03.341438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.158694+0000","last_change":"2024-09-19T06:04:05.431718+0000","last_active":"2024-09-19T06:05:14.158694+0000","last_peered":"2024-09-19T06:05:14.158694+0000","last_clean":"2024-09-19T06:05:14.158694+0000","last_became_active":"2024-09-19T06:04:05.431429+0000","last_became_peered":"2024-09-19T06:04:05.431429+0000","last_unstale":"2024-09-19T06:05:14.158694+0000","last_undegraded":"2024-09-19T06:05:14.158694+0000","last_fullsized":"2024-09-19T06:05:14.158694+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:11:42.818368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727494+0000","last_change":"2024-09-19T06:04:05.429575+0000","last_active":"2024-09-19T06:05:13.727494+0000","last_peered":"2024-09-19T06:05:13.727494+0000","last_clean":"2024-09-19T06:05:13.727494+0000","last_became_active":"2024-09-19T06:04:05.429226+0000","last_became_peered":"2024-09-19T06:04:05.429226+0000","last_unstale":"2024-09-19T06:05:13.727494+0000","last_undegraded":"2024-09-19T06:05:13.727494+0000","last_fullsized":"2024-09-19T06:05:13.727494+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:29:19.680433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.728155+0000","last_change":"2024-09-19T06:04:05.431612+0000","last_active":"2024-09-19T06:05:13.728155+0000","last_peered":"2024-09-19T06:05:13.728155+0000","last_clean":"2024-09-19T06:05:13.728155+0000","last_became_active":"2024-09-19T06:04:05.431240+0000","last_became_peered":"2024-09-19T06:04:05.431240+0000","last_unstale":"2024-09-19T06:05:13.728155+0000","last_undegraded":"2024-09-19T06:05:13.728155+0000","last_fullsized":"2024-09-19T06:05:13.728155+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:46:14.138603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724293+0000","last_change":"2024-09-19T06:04:05.428849+0000","last_active":"2024-09-19T06:05:13.724293+0000","last_peered":"2024-09-19T06:05:13.724293+0000","last_clean":"2024-09-19T06:05:13.724293+0000","last_became_active":"2024-09-19T06:04:05.428516+0000","last_became_peered":"2024-09-19T06:04:05.428516+0000","last_unstale":"2024-09-19T06:05:13.724293+0000","last_undegraded":"2024-09-19T06:05:13.724293+0000","last_fullsized":"2024-09-19T06:05:13.724293+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:58:00.323959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.728373+0000","last_change":"2024-09-19T06:04:05.436409+0000","last_active":"2024-09-19T06:05:13.728373+0000","last_peered":"2024-09-19T06:05:13.728373+0000","last_clean":"2024-09-19T06:05:13.728373+0000","last_became_active":"2024-09-19T06:04:05.436058+0000","last_became_peered":"2024-09-19T06:04:05.436058+0000","last_unstale":"2024-09-19T06:05:13.728373+0000","last_undegraded":"2024-09-19T06:05:13.728373+0000","last_fullsized":"2024-09-19T06:05:13.728373+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:20:45.227159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:15.014023+0000","last_change":"2024-09-19T06:04:05.434398+0000","last_active":"2024-09-19T06:05:15.014023+0000","last_peered":"2024-09-19T06:05:15.014023+0000","last_clean":"2024-09-19T06:05:15.014023+0000","last_became_active":"2024-09-19T06:04:05.433635+0000","last_became_peered":"2024-09-19T06:04:05.433635+0000","last_unstale":"2024-09-19T06:05:15.014023+0000","last_undegraded":"2024-09-19T06:05:15.014023+0000","last_fullsized":"2024-09-19T06:05:15.014023+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:10:42.104705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726446+0000","last_change":"2024-09-19T06:04:05.423447+0000","last_active":"2024-09-19T06:05:13.726446+0000","last_peered":"2024-09-19T06:05:13.726446+0000","last_clean":"2024-09-19T06:05:13.726446+0000","last_became_active":"2024-09-19T06:04:05.423081+0000","last_became_peered":"2024-09-19T06:04:05.423081+0000","last_unstale":"2024-09-19T06:05:13.726446+0000","last_undegraded":"2024-09-19T06:05:13.726446+0000","last_fullsized":"2024-09-19T06:05:13.726446+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:03:54.856251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726503+0000","last_change":"2024-09-19T06:04:05.426371+0000","last_active":"2024-09-19T06:05:13.726503+0000","last_peered":"2024-09-19T06:05:13.726503+0000","last_clean":"2024-09-19T06:05:13.726503+0000","last_became_active":"2024-09-19T06:04:05.425601+0000","last_became_peered":"2024-09-19T06:04:05.425601+0000","last_unstale":"2024-09-19T06:05:13.726503+0000","last_undegraded":"2024-09-19T06:05:13.726503+0000","last_fullsized":"2024-09-19T06:05:13.726503+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:55:05.677121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.158746+0000","last_change":"2024-09-19T06:04:05.426264+0000","last_active":"2024-09-19T06:05:14.158746+0000","last_peered":"2024-09-19T06:05:14.158746+0000","last_clean":"2024-09-19T06:05:14.158746+0000","last_became_active":"2024-09-19T06:04:05.425939+0000","last_became_peered":"2024-09-19T06:04:05.425939+0000","last_unstale":"2024-09-19T06:05:14.158746+0000","last_undegraded":"2024-09-19T06:05:14.158746+0000","last_fullsized":"2024-09-19T06:05:14.158746+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:18:43.250682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"89'7","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:06:12.651015+0000","last_change":"2024-09-19T06:04:05.432654+0000","last_active":"2024-09-19T06:06:12.651015+0000","last_peered":"2024-09-19T06:06:12.651015+0000","last_clean":"2024-09-19T06:06:12.651015+0000","last_became_active":"2024-09-19T06:04:05.431489+0000","last_became_peered":"2024-09-19T06:04:05.431489+0000","last_unstale":"2024-09-19T06:06:12.651015+0000","last_undegraded":"2024-09-19T06:06:12.651015+0000","last_fullsized":"2024-09-19T06:06:12.651015+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:15:41.251538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724637+0000","last_change":"2024-09-19T06:04:05.435221+0000","last_active":"2024-09-19T06:05:13.724637+0000","last_peered":"2024-09-19T06:05:13.724637+0000","last_clean":"2024-09-19T06:05:13.724637+0000","last_became_active":"2024-09-19T06:04:05.434909+0000","last_became_peered":"2024-09-19T06:04:05.434909+0000","last_unstale":"2024-09-19T06:05:13.724637+0000","last_undegraded":"2024-09-19T06:05:13.724637+0000","last_fullsized":"2024-09-19T06:05:13.724637+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:15:20.414499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"89'16","reported_seq":51,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:06:12.656382+0000","last_change":"2024-09-19T06:05:13.731152+0000","last_active":"2024-09-19T06:06:12.656382+0000","last_peered":"2024-09-19T06:06:12.656382+0000","last_clean":"2024-09-19T06:06:12.656382+0000","last_became_active":"2024-09-19T06:05:13.730810+0000","last_became_peered":"2024-09-19T06:05:13.730810+0000","last_unstale":"2024-09-19T06:06:12.656382+0000","last_undegraded":"2024-09-19T06:06:12.656382+0000","last_fullsized":"2024-09-19T06:06:12.656382+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:55:13.359784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:15.014646+0000","last_change":"2024-09-19T06:04:05.432940+0000","last_active":"2024-09-19T06:05:15.014646+0000","last_peered":"2024-09-19T06:05:15.014646+0000","last_clean":"2024-09-19T06:05:15.014646+0000","last_became_active":"2024-09-19T06:04:05.432579+0000","last_became_peered":"2024-09-19T06:04:05.432579+0000","last_unstale":"2024-09-19T06:05:15.014646+0000","last_undegraded":"2024-09-19T06:05:15.014646+0000","last_fullsized":"2024-09-19T06:05:15.014646+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:56.740048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.729272+0000","last_change":"2024-09-19T06:04:05.417967+0000","last_active":"2024-09-19T06:05:13.729272+0000","last_peered":"2024-09-19T06:05:13.729272+0000","last_clean":"2024-09-19T06:05:13.729272+0000","last_became_active":"2024-09-19T06:04:05.417658+0000","last_became_peered":"2024-09-19T06:04:05.417658+0000","last_unstale":"2024-09-19T06:05:13.729272+0000","last_undegraded":"2024-09-19T06:05:13.729272+0000","last_fullsized":"2024-09-19T06:05:13.729272+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:55.571313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724281+0000","last_change":"2024-09-19T06:04:05.424627+0000","last_active":"2024-09-19T06:05:13.724281+0000","last_peered":"2024-09-19T06:05:13.724281+0000","last_clean":"2024-09-19T06:05:13.724281+0000","last_became_active":"2024-09-19T06:04:05.424301+0000","last_became_peered":"2024-09-19T06:04:05.424301+0000","last_unstale":"2024-09-19T06:05:13.724281+0000","last_undegraded":"2024-09-19T06:05:13.724281+0000","last_fullsized":"2024-09-19T06:05:13.724281+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:48:00.964989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"89'6","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:06:12.662195+0000","last_change":"2024-09-19T06:04:05.423635+0000","last_active":"2024-09-19T06:06:12.662195+0000","last_peered":"2024-09-19T06:06:12.662195+0000","last_clean":"2024-09-19T06:06:12.662195+0000","last_became_active":"2024-09-19T06:04:05.422625+0000","last_became_peered":"2024-09-19T06:04:05.422625+0000","last_unstale":"2024-09-19T06:06:12.662195+0000","last_undegraded":"2024-09-19T06:06:12.662195+0000","last_fullsized":"2024-09-19T06:06:12.662195+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:33:34.099443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726970+0000","last_change":"2024-09-19T06:04:05.428933+0000","last_active":"2024-09-19T06:05:13.726970+0000","last_peered":"2024-09-19T06:05:13.726970+0000","last_clean":"2024-09-19T06:05:13.726970+0000","last_became_active":"2024-09-19T06:04:05.428598+0000","last_became_peered":"2024-09-19T06:04:05.428598+0000","last_unstale":"2024-09-19T06:05:13.726970+0000","last_undegraded":"2024-09-19T06:05:13.726970+0000","last_fullsized":"2024-09-19T06:05:13.726970+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:27:15.111954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.731274+0000","last_change":"2024-09-19T06:05:13.730637+0000","last_active":"2024-09-19T06:05:13.731274+0000","last_peered":"2024-09-19T06:05:13.731274+0000","last_clean":"2024-09-19T06:05:13.731274+0000","last_became_active":"2024-09-19T06:05:13.730224+0000","last_became_peered":"2024-09-19T06:05:13.730224+0000","last_unstale":"2024-09-19T06:05:13.731274+0000","last_undegraded":"2024-09-19T06:05:13.731274+0000","last_fullsized":"2024-09-19T06:05:13.731274+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:14:08.175943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726638+0000","last_change":"2024-09-19T06:04:05.430427+0000","last_active":"2024-09-19T06:05:13.726638+0000","last_peered":"2024-09-19T06:05:13.726638+0000","last_clean":"2024-09-19T06:05:13.726638+0000","last_became_active":"2024-09-19T06:04:05.430106+0000","last_became_peered":"2024-09-19T06:04:05.430106+0000","last_unstale":"2024-09-19T06:05:13.726638+0000","last_undegraded":"2024-09-19T06:05:13.726638+0000","last_fullsized":"2024-09-19T06:05:13.726638+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:03:00.764689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727017+0000","last_change":"2024-09-19T06:04:05.427189+0000","last_active":"2024-09-19T06:05:13.727017+0000","last_peered":"2024-09-19T06:05:13.727017+0000","last_clean":"2024-09-19T06:05:13.727017+0000","last_became_active":"2024-09-19T06:04:05.426874+0000","last_became_peered":"2024-09-19T06:04:05.426874+0000","last_unstale":"2024-09-19T06:05:13.727017+0000","last_undegraded":"2024-09-19T06:05:13.727017+0000","last_fullsized":"2024-09-19T06:05:13.727017+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:37:10.910723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.728272+0000","last_change":"2024-09-19T06:04:05.435803+0000","last_active":"2024-09-19T06:05:13.728272+0000","last_peered":"2024-09-19T06:05:13.728272+0000","last_clean":"2024-09-19T06:05:13.728272+0000","last_became_active":"2024-09-19T06:04:05.435430+0000","last_became_peered":"2024-09-19T06:04:05.435430+0000","last_unstale":"2024-09-19T06:05:13.728272+0000","last_undegraded":"2024-09-19T06:05:13.728272+0000","last_fullsized":"2024-09-19T06:05:13.728272+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:41.828016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":40,"ondisk_log_size":40,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69180,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":201,"num_read_kb":170,"num_write":87,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":198106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547239,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1007616,"data_stored":497802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776173,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36988,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708164,"statfs":{"total":95995035648,"available":95957159936,"internally_reserved":0,"allocated":1683456,"data_stored":1152616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939697,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1011712,"data_stored":502446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168630,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1011712,"data_stored":498372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397563,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36920,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708232,"statfs":{"total":95995035648,"available":95957229568,"internally_reserved":0,"allocated":1605632,"data_stored":1092814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561089,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":999424,"data_stored":493672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790021,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28604,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716548,"statfs":{"total":95995035648,"available":95965745152,"internally_reserved":0,"allocated":1609728,"data_stored":1088318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953546,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1007616,"data_stored":497790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182479,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36336,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708816,"statfs":{"total":95995035648,"available":95957827584,"internally_reserved":0,"allocated":1007616,"data_stored":493776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411413,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28080,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717072,"statfs":{"total":95995035648,"available":95966281728,"internally_reserved":0,"allocated":1073152,"data_stored":557183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574938,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28072,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717080,"statfs":{"total":95995035648,"available":95966289920,"internally_reserved":0,"allocated":1073152,"data_stored":557491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738463,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1003520,"data_stored":493762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":63819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":63511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":68576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T06:06:15.103 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T06:06:15.103 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T06:06:15.382 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:06:15.786 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:06:15 smithi037 ceph-mon[31211]: osdmap e91: 12 total, 12 up, 12 in 2024-09-19T06:06:15.786 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:06:15 smithi037 ceph-mon[31211]: pgmap v352: 129 pgs: 129 active+clean; 644 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-09-19T06:06:15.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:15.867+0000 7f189c0a4640 1 -- 172.21.15.37:0/2559685514 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1894074620 msgr2=0x7f1894074a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:15.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:15.867+0000 7f189c0a4640 1 --2- 172.21.15.37:0/2559685514 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1894074620 0x7f1894074a00 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f1890009900 tx=0x7f189002a480 comp rx=0 tx=0).stop 2024-09-19T06:06:15.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:15.867+0000 7f189c0a4640 1 -- 172.21.15.37:0/2559685514 shutdown_connections 2024-09-19T06:06:15.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:15.867+0000 7f189c0a4640 1 --2- 172.21.15.37:0/2559685514 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1894074f40 0x7f189410de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:15.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:15.867+0000 7f189c0a4640 1 --2- 172.21.15.37:0/2559685514 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f189410e3c0 0x7f1894110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:15.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:15.867+0000 7f189c0a4640 1 --2- 172.21.15.37:0/2559685514 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1894074620 0x7f1894074a00 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:15.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:15.867+0000 7f189c0a4640 1 -- 172.21.15.37:0/2559685514 >> 172.21.15.37:0/2559685514 conn(0x7f18940fd8c0 msgr2=0x7f18940ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:15.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:15.867+0000 7f189c0a4640 1 -- 172.21.15.37:0/2559685514 shutdown_connections 2024-09-19T06:06:15.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:15.867+0000 7f189c0a4640 1 -- 172.21.15.37:0/2559685514 wait complete. 2024-09-19T06:06:15.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:15.868+0000 7f189c0a4640 1 Processor -- start 2024-09-19T06:06:15.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:15.868+0000 7f189c0a4640 1 -- start start 2024-09-19T06:06:15.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:15.868+0000 7f189c0a4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1894074620 0x7f189419a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:15.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:15.868+0000 7f189c0a4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1894074f40 0x7f189419ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:15.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:15.868+0000 7f189c0a4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f189410e3c0 0x7f189419ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:15.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:15.868+0000 7f189c0a4640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f18941141c0 con 0x7f189410e3c0 2024-09-19T06:06:15.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:15.868+0000 7f189c0a4640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f1894114040 con 0x7f1894074f40 2024-09-19T06:06:15.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:15.868+0000 7f189c0a4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1894114340 con 0x7f1894074620 2024-09-19T06:06:15.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:15.868+0000 7f189a641640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f189410e3c0 0x7f189419ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:15.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:15.868+0000 7f189a641640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f189410e3c0 0x7f189419ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47080/0 (socket says 172.21.15.37:47080) 2024-09-19T06:06:15.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:15.868+0000 7f189a641640 1 -- 172.21.15.37:0/2651480841 learned_addr learned my addr 172.21.15.37:0/2651480841 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:06:15.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:15.868+0000 7f189963f640 1 --2- 172.21.15.37:0/2651480841 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1894074f40 0x7f189419ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:15.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:15.868+0000 7f1899e40640 1 --2- 172.21.15.37:0/2651480841 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1894074620 0x7f189419a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:15.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:15.868+0000 7f189a641640 1 -- 172.21.15.37:0/2651480841 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1894074620 msgr2=0x7f189419a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:15.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:15.868+0000 7f189a641640 1 --2- 172.21.15.37:0/2651480841 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1894074620 0x7f189419a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:15.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:15.868+0000 7f189a641640 1 -- 172.21.15.37:0/2651480841 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1894074f40 msgr2=0x7f189419ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:15.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:15.868+0000 7f189a641640 1 --2- 172.21.15.37:0/2651480841 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1894074f40 0x7f189419ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:15.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:15.868+0000 7f189a641640 1 -- 172.21.15.37:0/2651480841 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f189419f5f0 con 0x7f189410e3c0 2024-09-19T06:06:15.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:15.869+0000 7f189a641640 1 --2- 172.21.15.37:0/2651480841 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f189410e3c0 0x7f189419ef10 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f188c00b970 tx=0x7f188c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:15.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:15.869+0000 7f188affd640 1 -- 172.21.15.37:0/2651480841 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f188c019070 con 0x7f189410e3c0 2024-09-19T06:06:15.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:15.869+0000 7f188affd640 1 -- 172.21.15.37:0/2651480841 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f188c00cb40 con 0x7f189410e3c0 2024-09-19T06:06:15.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:15.869+0000 7f189c0a4640 1 -- 172.21.15.37:0/2651480841 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f189419f8e0 con 0x7f189410e3c0 2024-09-19T06:06:15.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:15.869+0000 7f188affd640 1 -- 172.21.15.37:0/2651480841 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f188c007650 con 0x7f189410e3c0 2024-09-19T06:06:15.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:15.869+0000 7f189c0a4640 1 -- 172.21.15.37:0/2651480841 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18941a71c0 con 0x7f189410e3c0 2024-09-19T06:06:15.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:15.870+0000 7f189c0a4640 1 -- 172.21.15.37:0/2651480841 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1894074a00 con 0x7f189410e3c0 2024-09-19T06:06:15.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:15.871+0000 7f188affd640 1 -- 172.21.15.37:0/2651480841 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f188c01c070 con 0x7f189410e3c0 2024-09-19T06:06:15.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:15.872+0000 7f188affd640 1 --2- 172.21.15.37:0/2651480841 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f18800a3240 0x7f18800a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:15.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:15.872+0000 7f1899e40640 1 --2- 172.21.15.37:0/2651480841 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f18800a3240 0x7f18800a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:15.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:15.872+0000 7f188affd640 1 -- 172.21.15.37:0/2651480841 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9121+0+0 (secure 0 0 0) 0x7f188c0cf790 con 0x7f189410e3c0 2024-09-19T06:06:15.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:15.873+0000 7f1899e40640 1 --2- 172.21.15.37:0/2651480841 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f18800a3240 0x7f18800a5700 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f18900096c0 tx=0x7f1890031490 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:15.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:15.875+0000 7f188affd640 1 -- 172.21.15.37:0/2651480841 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f188c09c130 con 0x7f189410e3c0 2024-09-19T06:06:15.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:06:15 smithi099 ceph-mon[35300]: osdmap e91: 12 total, 12 up, 12 in 2024-09-19T06:06:15.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:06:15 smithi099 ceph-mon[35300]: pgmap v352: 129 pgs: 129 active+clean; 644 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-09-19T06:06:16.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:06:15 smithi117 ceph-mon[35050]: osdmap e91: 12 total, 12 up, 12 in 2024-09-19T06:06:16.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:06:15 smithi117 ceph-mon[35050]: pgmap v352: 129 pgs: 129 active+clean; 644 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-09-19T06:06:16.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:16.050+0000 7f189c0a4640 1 -- 172.21.15.37:0/2651480841 --> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1894062630 con 0x7f18800a3240 2024-09-19T06:06:16.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:16.060+0000 7f188affd640 1 -- 172.21.15.37:0/2651480841 <== mgr.14148 v2:172.21.15.37:6800/3797010169 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340362 (secure 0 0 0) 0x7f1894062630 con 0x7f18800a3240 2024-09-19T06:06:16.067 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T06:06:16.068 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-19T06:06:16.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:16.064+0000 7f189c0a4640 1 -- 172.21.15.37:0/2651480841 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f18800a3240 msgr2=0x7f18800a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:16.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:16.064+0000 7f189c0a4640 1 --2- 172.21.15.37:0/2651480841 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f18800a3240 0x7f18800a5700 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f18900096c0 tx=0x7f1890031490 comp rx=0 tx=0).stop 2024-09-19T06:06:16.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:16.064+0000 7f189c0a4640 1 -- 172.21.15.37:0/2651480841 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f189410e3c0 msgr2=0x7f189419ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:16.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:16.064+0000 7f189c0a4640 1 --2- 172.21.15.37:0/2651480841 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f189410e3c0 0x7f189419ef10 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f188c00b970 tx=0x7f188c00be30 comp rx=0 tx=0).stop 2024-09-19T06:06:16.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:16.064+0000 7f189c0a4640 1 -- 172.21.15.37:0/2651480841 shutdown_connections 2024-09-19T06:06:16.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:16.064+0000 7f189c0a4640 1 --2- 172.21.15.37:0/2651480841 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f18800a3240 0x7f18800a5700 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:16.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:16.064+0000 7f189c0a4640 1 --2- 172.21.15.37:0/2651480841 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1894074f40 0x7f189419ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:16.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:16.064+0000 7f189c0a4640 1 --2- 172.21.15.37:0/2651480841 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f189410e3c0 0x7f189419ef10 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:16.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:16.064+0000 7f189c0a4640 1 --2- 172.21.15.37:0/2651480841 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1894074620 0x7f189419a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:16.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:16.064+0000 7f189c0a4640 1 -- 172.21.15.37:0/2651480841 >> 172.21.15.37:0/2651480841 conn(0x7f18940fd8c0 msgr2=0x7f18940fefa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:16.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:16.064+0000 7f189c0a4640 1 -- 172.21.15.37:0/2651480841 shutdown_connections 2024-09-19T06:06:16.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:16.064+0000 7f189c0a4640 1 -- 172.21.15.37:0/2651480841 wait complete. 2024-09-19T06:06:16.777 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":352,"stamp":"2024-09-19T06:06:14.677302+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659782,"num_objects":26,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":327,"num_read_kb":279,"num_write":273,"num_write_kb":3040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180770,"num_keys_recovered":10,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":336,"ondisk_log_size":336,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":363092,"kb_used_data":13780,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124578732,"statfs":{"total":1151940427776,"available":1151568621568,"internally_reserved":0,"allocated":14110720,"data_stored":7935392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":357414202},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4871,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":7,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002029"},"pg_stats":[{"pgid":"2.1f","version":"81'4","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T06:06:13.690430+0000","last_change":"2024-09-19T06:04:03.323722+0000","last_active":"2024-09-19T06:06:13.690430+0000","last_peered":"2024-09-19T06:06:13.690430+0000","last_clean":"2024-09-19T06:06:13.690430+0000","last_became_active":"2024-09-19T06:04:03.323380+0000","last_became_peered":"2024-09-19T06:04:03.323380+0000","last_unstale":"2024-09-19T06:06:13.690430+0000","last_undegraded":"2024-09-19T06:06:13.690430+0000","last_fullsized":"2024-09-19T06:06:13.690430+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:49:17.449780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.729434+0000","last_change":"2024-09-19T06:04:05.427994+0000","last_active":"2024-09-19T06:05:13.729434+0000","last_peered":"2024-09-19T06:05:13.729434+0000","last_clean":"2024-09-19T06:05:13.729434+0000","last_became_active":"2024-09-19T06:04:05.427745+0000","last_became_peered":"2024-09-19T06:04:05.427745+0000","last_unstale":"2024-09-19T06:05:13.729434+0000","last_undegraded":"2024-09-19T06:05:13.729434+0000","last_fullsized":"2024-09-19T06:05:13.729434+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:54.917003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727325+0000","last_change":"2024-09-19T06:04:12.463838+0000","last_active":"2024-09-19T06:05:13.727325+0000","last_peered":"2024-09-19T06:05:13.727325+0000","last_clean":"2024-09-19T06:05:13.727325+0000","last_became_active":"2024-09-19T06:04:12.463426+0000","last_became_peered":"2024-09-19T06:04:12.463426+0000","last_unstale":"2024-09-19T06:05:13.727325+0000","last_undegraded":"2024-09-19T06:05:13.727325+0000","last_fullsized":"2024-09-19T06:05:13.727325+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:40:37.994203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"81'1","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.729765+0000","last_change":"2024-09-19T06:04:03.378129+0000","last_active":"2024-09-19T06:05:13.729765+0000","last_peered":"2024-09-19T06:05:13.729765+0000","last_clean":"2024-09-19T06:05:13.729765+0000","last_became_active":"2024-09-19T06:04:03.377793+0000","last_became_peered":"2024-09-19T06:04:03.377793+0000","last_unstale":"2024-09-19T06:05:13.729765+0000","last_undegraded":"2024-09-19T06:05:13.729765+0000","last_fullsized":"2024-09-19T06:05:13.729765+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:38:22.739168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727550+0000","last_change":"2024-09-19T06:04:05.433909+0000","last_active":"2024-09-19T06:05:13.727550+0000","last_peered":"2024-09-19T06:05:13.727550+0000","last_clean":"2024-09-19T06:05:13.727550+0000","last_became_active":"2024-09-19T06:04:05.433591+0000","last_became_peered":"2024-09-19T06:04:05.433591+0000","last_unstale":"2024-09-19T06:05:13.727550+0000","last_undegraded":"2024-09-19T06:05:13.727550+0000","last_fullsized":"2024-09-19T06:05:13.727550+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:19:18.916703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.725870+0000","last_change":"2024-09-19T06:04:12.468984+0000","last_active":"2024-09-19T06:05:13.725870+0000","last_peered":"2024-09-19T06:05:13.725870+0000","last_clean":"2024-09-19T06:05:13.725870+0000","last_became_active":"2024-09-19T06:04:12.467287+0000","last_became_peered":"2024-09-19T06:04:12.467287+0000","last_unstale":"2024-09-19T06:05:13.725870+0000","last_undegraded":"2024-09-19T06:05:13.725870+0000","last_fullsized":"2024-09-19T06:05:13.725870+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:05:46.279679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T06:06:13.690094+0000","last_change":"2024-09-19T06:05:13.739034+0000","last_active":"2024-09-19T06:06:13.690094+0000","last_peered":"2024-09-19T06:06:13.690094+0000","last_clean":"2024-09-19T06:06:13.690094+0000","last_became_active":"2024-09-19T06:05:13.731532+0000","last_became_peered":"2024-09-19T06:05:13.731532+0000","last_unstale":"2024-09-19T06:06:13.690094+0000","last_undegraded":"2024-09-19T06:06:13.690094+0000","last_fullsized":"2024-09-19T06:06:13.690094+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:52:21.543579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:15.014328+0000","last_change":"2024-09-19T06:04:05.430288+0000","last_active":"2024-09-19T06:05:15.014328+0000","last_peered":"2024-09-19T06:05:15.014328+0000","last_clean":"2024-09-19T06:05:15.014328+0000","last_became_active":"2024-09-19T06:04:05.429947+0000","last_became_peered":"2024-09-19T06:04:05.429947+0000","last_unstale":"2024-09-19T06:05:15.014328+0000","last_undegraded":"2024-09-19T06:05:15.014328+0000","last_fullsized":"2024-09-19T06:05:15.014328+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:43:09.169658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726358+0000","last_change":"2024-09-19T06:04:12.465946+0000","last_active":"2024-09-19T06:05:13.726358+0000","last_peered":"2024-09-19T06:05:13.726358+0000","last_clean":"2024-09-19T06:05:13.726358+0000","last_became_active":"2024-09-19T06:04:12.465553+0000","last_became_peered":"2024-09-19T06:04:12.465553+0000","last_unstale":"2024-09-19T06:05:13.726358+0000","last_undegraded":"2024-09-19T06:05:13.726358+0000","last_fullsized":"2024-09-19T06:05:13.726358+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:50:41.181483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.728044+0000","last_change":"2024-09-19T06:04:03.318528+0000","last_active":"2024-09-19T06:05:13.728044+0000","last_peered":"2024-09-19T06:05:13.728044+0000","last_clean":"2024-09-19T06:05:13.728044+0000","last_became_active":"2024-09-19T06:04:03.318210+0000","last_became_peered":"2024-09-19T06:04:03.318210+0000","last_unstale":"2024-09-19T06:05:13.728044+0000","last_undegraded":"2024-09-19T06:05:13.728044+0000","last_fullsized":"2024-09-19T06:05:13.728044+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:06.766545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.475029+0000","last_change":"2024-09-19T06:04:05.427025+0000","last_active":"2024-09-19T06:05:14.475029+0000","last_peered":"2024-09-19T06:05:14.475029+0000","last_clean":"2024-09-19T06:05:14.475029+0000","last_became_active":"2024-09-19T06:04:05.425679+0000","last_became_peered":"2024-09-19T06:04:05.425679+0000","last_unstale":"2024-09-19T06:05:14.475029+0000","last_undegraded":"2024-09-19T06:05:14.475029+0000","last_fullsized":"2024-09-19T06:05:14.475029+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:26:06.480664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726043+0000","last_change":"2024-09-19T06:04:12.467065+0000","last_active":"2024-09-19T06:05:13.726043+0000","last_peered":"2024-09-19T06:05:13.726043+0000","last_clean":"2024-09-19T06:05:13.726043+0000","last_became_active":"2024-09-19T06:04:12.465961+0000","last_became_peered":"2024-09-19T06:04:12.465961+0000","last_unstale":"2024-09-19T06:05:13.726043+0000","last_undegraded":"2024-09-19T06:05:13.726043+0000","last_fullsized":"2024-09-19T06:05:13.726043+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:13:38.566692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724364+0000","last_change":"2024-09-19T06:04:05.436202+0000","last_active":"2024-09-19T06:05:13.724364+0000","last_peered":"2024-09-19T06:05:13.724364+0000","last_clean":"2024-09-19T06:05:13.724364+0000","last_became_active":"2024-09-19T06:04:05.435779+0000","last_became_peered":"2024-09-19T06:04:05.435779+0000","last_unstale":"2024-09-19T06:05:13.724364+0000","last_undegraded":"2024-09-19T06:05:13.724364+0000","last_fullsized":"2024-09-19T06:05:13.724364+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:27:56.463592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727084+0000","last_change":"2024-09-19T06:04:03.320472+0000","last_active":"2024-09-19T06:05:13.727084+0000","last_peered":"2024-09-19T06:05:13.727084+0000","last_clean":"2024-09-19T06:05:13.727084+0000","last_became_active":"2024-09-19T06:04:03.320178+0000","last_became_peered":"2024-09-19T06:04:03.320178+0000","last_unstale":"2024-09-19T06:05:13.727084+0000","last_undegraded":"2024-09-19T06:05:13.727084+0000","last_fullsized":"2024-09-19T06:05:13.727084+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:23.285302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727113+0000","last_change":"2024-09-19T06:04:12.635733+0000","last_active":"2024-09-19T06:05:13.727113+0000","last_peered":"2024-09-19T06:05:13.727113+0000","last_clean":"2024-09-19T06:05:13.727113+0000","last_became_active":"2024-09-19T06:04:12.634938+0000","last_became_peered":"2024-09-19T06:04:12.634938+0000","last_unstale":"2024-09-19T06:05:13.727113+0000","last_undegraded":"2024-09-19T06:05:13.727113+0000","last_fullsized":"2024-09-19T06:05:13.727113+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:44:09.015733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.729473+0000","last_change":"2024-09-19T06:04:05.418702+0000","last_active":"2024-09-19T06:05:13.729473+0000","last_peered":"2024-09-19T06:05:13.729473+0000","last_clean":"2024-09-19T06:05:13.729473+0000","last_became_active":"2024-09-19T06:04:05.418213+0000","last_became_peered":"2024-09-19T06:04:05.418213+0000","last_unstale":"2024-09-19T06:05:13.729473+0000","last_undegraded":"2024-09-19T06:05:13.729473+0000","last_fullsized":"2024-09-19T06:05:13.729473+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:46:01.865286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727965+0000","last_change":"2024-09-19T06:04:03.323683+0000","last_active":"2024-09-19T06:05:13.727965+0000","last_peered":"2024-09-19T06:05:13.727965+0000","last_clean":"2024-09-19T06:05:13.727965+0000","last_became_active":"2024-09-19T06:04:03.323166+0000","last_became_peered":"2024-09-19T06:04:03.323166+0000","last_unstale":"2024-09-19T06:05:13.727965+0000","last_undegraded":"2024-09-19T06:05:13.727965+0000","last_fullsized":"2024-09-19T06:05:13.727965+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:53.787307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"87'1","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726853+0000","last_change":"2024-09-19T06:04:12.467620+0000","last_active":"2024-09-19T06:05:13.726853+0000","last_peered":"2024-09-19T06:05:13.726853+0000","last_clean":"2024-09-19T06:05:13.726853+0000","last_became_active":"2024-09-19T06:04:12.467231+0000","last_became_peered":"2024-09-19T06:04:12.467231+0000","last_unstale":"2024-09-19T06:05:13.726853+0000","last_undegraded":"2024-09-19T06:05:13.726853+0000","last_fullsized":"2024-09-19T06:05:13.726853+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:12:07.731338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"89'9","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T06:06:13.689881+0000","last_change":"2024-09-19T06:04:05.426415+0000","last_active":"2024-09-19T06:06:13.689881+0000","last_peered":"2024-09-19T06:06:13.689881+0000","last_clean":"2024-09-19T06:06:13.689881+0000","last_became_active":"2024-09-19T06:04:05.426061+0000","last_became_peered":"2024-09-19T06:04:05.426061+0000","last_unstale":"2024-09-19T06:06:13.689881+0000","last_undegraded":"2024-09-19T06:06:13.689881+0000","last_fullsized":"2024-09-19T06:06:13.689881+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:44.810600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.729834+0000","last_change":"2024-09-19T06:04:03.319185+0000","last_active":"2024-09-19T06:05:13.729834+0000","last_peered":"2024-09-19T06:05:13.729834+0000","last_clean":"2024-09-19T06:05:13.729834+0000","last_became_active":"2024-09-19T06:04:03.318788+0000","last_became_peered":"2024-09-19T06:04:03.318788+0000","last_unstale":"2024-09-19T06:05:13.729834+0000","last_undegraded":"2024-09-19T06:05:13.729834+0000","last_fullsized":"2024-09-19T06:05:13.729834+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:41:14.668303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.476753+0000","last_change":"2024-09-19T06:05:14.476214+0000","last_active":"2024-09-19T06:05:14.476753+0000","last_peered":"2024-09-19T06:05:14.476753+0000","last_clean":"2024-09-19T06:05:14.476753+0000","last_became_active":"2024-09-19T06:05:14.475721+0000","last_became_peered":"2024-09-19T06:05:14.475721+0000","last_unstale":"2024-09-19T06:05:14.476753+0000","last_undegraded":"2024-09-19T06:05:14.476753+0000","last_fullsized":"2024-09-19T06:05:14.476753+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:15:37.925870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,2,5],"acting":[8,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727210+0000","last_change":"2024-09-19T06:04:05.428027+0000","last_active":"2024-09-19T06:05:13.727210+0000","last_peered":"2024-09-19T06:05:13.727210+0000","last_clean":"2024-09-19T06:05:13.727210+0000","last_became_active":"2024-09-19T06:04:05.427698+0000","last_became_peered":"2024-09-19T06:04:05.427698+0000","last_unstale":"2024-09-19T06:05:13.727210+0000","last_undegraded":"2024-09-19T06:05:13.727210+0000","last_fullsized":"2024-09-19T06:05:13.727210+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:06:34.627086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:15.014198+0000","last_change":"2024-09-19T06:04:03.380435+0000","last_active":"2024-09-19T06:05:15.014198+0000","last_peered":"2024-09-19T06:05:15.014198+0000","last_clean":"2024-09-19T06:05:15.014198+0000","last_became_active":"2024-09-19T06:04:03.380102+0000","last_became_peered":"2024-09-19T06:04:03.380102+0000","last_unstale":"2024-09-19T06:05:15.014198+0000","last_undegraded":"2024-09-19T06:05:15.014198+0000","last_fullsized":"2024-09-19T06:05:15.014198+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:43.886466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.730251+0000","last_change":"2024-09-19T06:05:13.730251+0000","last_active":"2024-09-19T06:05:13.730251+0000","last_peered":"2024-09-19T06:05:13.730251+0000","last_clean":"2024-09-19T06:05:13.730251+0000","last_became_active":"2024-09-19T06:05:13.729757+0000","last_became_peered":"2024-09-19T06:05:13.729757+0000","last_unstale":"2024-09-19T06:05:13.730251+0000","last_undegraded":"2024-09-19T06:05:13.730251+0000","last_fullsized":"2024-09-19T06:05:13.730251+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:57:09.816160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,10,9],"acting":[4,8,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.160089+0000","last_change":"2024-09-19T06:05:14.160089+0000","last_active":"2024-09-19T06:05:14.160089+0000","last_peered":"2024-09-19T06:05:14.160089+0000","last_clean":"2024-09-19T06:05:14.160089+0000","last_became_active":"2024-09-19T06:05:14.159695+0000","last_became_peered":"2024-09-19T06:05:14.159695+0000","last_unstale":"2024-09-19T06:05:14.160089+0000","last_undegraded":"2024-09-19T06:05:14.160089+0000","last_fullsized":"2024-09-19T06:05:14.160089+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:12:52.838620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"81'2","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726647+0000","last_change":"2024-09-19T06:04:03.376510+0000","last_active":"2024-09-19T06:05:13.726647+0000","last_peered":"2024-09-19T06:05:13.726647+0000","last_clean":"2024-09-19T06:05:13.726647+0000","last_became_active":"2024-09-19T06:04:03.376241+0000","last_became_peered":"2024-09-19T06:04:03.376241+0000","last_unstale":"2024-09-19T06:05:13.726647+0000","last_undegraded":"2024-09-19T06:05:13.726647+0000","last_fullsized":"2024-09-19T06:05:13.726647+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:19:29.209233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727510+0000","last_change":"2024-09-19T06:04:12.462237+0000","last_active":"2024-09-19T06:05:13.727510+0000","last_peered":"2024-09-19T06:05:13.727510+0000","last_clean":"2024-09-19T06:05:13.727510+0000","last_became_active":"2024-09-19T06:04:12.461771+0000","last_became_peered":"2024-09-19T06:04:12.461771+0000","last_unstale":"2024-09-19T06:05:13.727510+0000","last_undegraded":"2024-09-19T06:05:13.727510+0000","last_fullsized":"2024-09-19T06:05:13.727510+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:46:42.780847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.730324+0000","last_change":"2024-09-19T06:04:05.420472+0000","last_active":"2024-09-19T06:05:13.730324+0000","last_peered":"2024-09-19T06:05:13.730324+0000","last_clean":"2024-09-19T06:05:13.730324+0000","last_became_active":"2024-09-19T06:04:05.420147+0000","last_became_peered":"2024-09-19T06:04:05.420147+0000","last_unstale":"2024-09-19T06:05:13.730324+0000","last_undegraded":"2024-09-19T06:05:13.730324+0000","last_fullsized":"2024-09-19T06:05:13.730324+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:38.616378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"89'9","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T06:06:13.690414+0000","last_change":"2024-09-19T06:04:03.316655+0000","last_active":"2024-09-19T06:06:13.690414+0000","last_peered":"2024-09-19T06:06:13.690414+0000","last_clean":"2024-09-19T06:06:13.690414+0000","last_became_active":"2024-09-19T06:04:03.316296+0000","last_became_peered":"2024-09-19T06:04:03.316296+0000","last_unstale":"2024-09-19T06:06:13.690414+0000","last_undegraded":"2024-09-19T06:06:13.690414+0000","last_fullsized":"2024-09-19T06:06:13.690414+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:02:06.320482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.729377+0000","last_change":"2024-09-19T06:04:12.635106+0000","last_active":"2024-09-19T06:05:13.729377+0000","last_peered":"2024-09-19T06:05:13.729377+0000","last_clean":"2024-09-19T06:05:13.729377+0000","last_became_active":"2024-09-19T06:04:12.634671+0000","last_became_peered":"2024-09-19T06:04:12.634671+0000","last_unstale":"2024-09-19T06:05:13.729377+0000","last_undegraded":"2024-09-19T06:05:13.729377+0000","last_fullsized":"2024-09-19T06:05:13.729377+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:54:22.428102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.158806+0000","last_change":"2024-09-19T06:04:05.427483+0000","last_active":"2024-09-19T06:05:14.158806+0000","last_peered":"2024-09-19T06:05:14.158806+0000","last_clean":"2024-09-19T06:05:14.158806+0000","last_became_active":"2024-09-19T06:04:05.427092+0000","last_became_peered":"2024-09-19T06:04:05.427092+0000","last_unstale":"2024-09-19T06:05:14.158806+0000","last_undegraded":"2024-09-19T06:05:14.158806+0000","last_fullsized":"2024-09-19T06:05:14.158806+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:50:21.576757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727515+0000","last_change":"2024-09-19T06:04:03.377962+0000","last_active":"2024-09-19T06:05:13.727515+0000","last_peered":"2024-09-19T06:05:13.727515+0000","last_clean":"2024-09-19T06:05:13.727515+0000","last_became_active":"2024-09-19T06:04:03.377686+0000","last_became_peered":"2024-09-19T06:04:03.377686+0000","last_unstale":"2024-09-19T06:05:13.727515+0000","last_undegraded":"2024-09-19T06:05:13.727515+0000","last_fullsized":"2024-09-19T06:05:13.727515+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:00.635765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T06:06:13.689968+0000","last_change":"2024-09-19T06:04:12.467349+0000","last_active":"2024-09-19T06:06:13.689968+0000","last_peered":"2024-09-19T06:06:13.689968+0000","last_clean":"2024-09-19T06:06:13.689968+0000","last_became_active":"2024-09-19T06:04:12.466117+0000","last_became_peered":"2024-09-19T06:04:12.466117+0000","last_unstale":"2024-09-19T06:06:13.689968+0000","last_undegraded":"2024-09-19T06:06:13.689968+0000","last_fullsized":"2024-09-19T06:06:13.689968+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:28:03.040586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"89'4","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:06:12.648854+0000","last_change":"2024-09-19T06:04:05.429656+0000","last_active":"2024-09-19T06:06:12.648854+0000","last_peered":"2024-09-19T06:06:12.648854+0000","last_clean":"2024-09-19T06:06:12.648854+0000","last_became_active":"2024-09-19T06:04:05.429023+0000","last_became_peered":"2024-09-19T06:04:05.429023+0000","last_unstale":"2024-09-19T06:06:12.648854+0000","last_undegraded":"2024-09-19T06:06:12.648854+0000","last_fullsized":"2024-09-19T06:06:12.648854+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:25:57.627940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T06:06:13.690107+0000","last_change":"2024-09-19T06:04:03.378415+0000","last_active":"2024-09-19T06:06:13.690107+0000","last_peered":"2024-09-19T06:06:13.690107+0000","last_clean":"2024-09-19T06:06:13.690107+0000","last_became_active":"2024-09-19T06:04:03.378096+0000","last_became_peered":"2024-09-19T06:04:03.378096+0000","last_unstale":"2024-09-19T06:06:13.690107+0000","last_undegraded":"2024-09-19T06:06:13.690107+0000","last_fullsized":"2024-09-19T06:06:13.690107+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:14:33.988869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726970+0000","last_change":"2024-09-19T06:04:12.635410+0000","last_active":"2024-09-19T06:05:13.726970+0000","last_peered":"2024-09-19T06:05:13.726970+0000","last_clean":"2024-09-19T06:05:13.726970+0000","last_became_active":"2024-09-19T06:04:12.634852+0000","last_became_peered":"2024-09-19T06:04:12.634852+0000","last_unstale":"2024-09-19T06:05:13.726970+0000","last_undegraded":"2024-09-19T06:05:13.726970+0000","last_fullsized":"2024-09-19T06:05:13.726970+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:28:46.014324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"89'7","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:06:12.648293+0000","last_change":"2024-09-19T06:04:05.421348+0000","last_active":"2024-09-19T06:06:12.648293+0000","last_peered":"2024-09-19T06:06:12.648293+0000","last_clean":"2024-09-19T06:06:12.648293+0000","last_became_active":"2024-09-19T06:04:05.420999+0000","last_became_peered":"2024-09-19T06:04:05.420999+0000","last_unstale":"2024-09-19T06:06:12.648293+0000","last_undegraded":"2024-09-19T06:06:12.648293+0000","last_fullsized":"2024-09-19T06:06:12.648293+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:52:26.257580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724594+0000","last_change":"2024-09-19T06:04:03.321233+0000","last_active":"2024-09-19T06:05:13.724594+0000","last_peered":"2024-09-19T06:05:13.724594+0000","last_clean":"2024-09-19T06:05:13.724594+0000","last_became_active":"2024-09-19T06:04:03.320755+0000","last_became_peered":"2024-09-19T06:04:03.320755+0000","last_unstale":"2024-09-19T06:05:13.724594+0000","last_undegraded":"2024-09-19T06:05:13.724594+0000","last_fullsized":"2024-09-19T06:05:13.724594+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:46.661751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.158645+0000","last_change":"2024-09-19T06:04:12.463185+0000","last_active":"2024-09-19T06:05:14.158645+0000","last_peered":"2024-09-19T06:05:14.158645+0000","last_clean":"2024-09-19T06:05:14.158645+0000","last_became_active":"2024-09-19T06:04:12.462824+0000","last_became_peered":"2024-09-19T06:04:12.462824+0000","last_unstale":"2024-09-19T06:05:14.158645+0000","last_undegraded":"2024-09-19T06:05:14.158645+0000","last_fullsized":"2024-09-19T06:05:14.158645+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:54:05.634907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.474286+0000","last_change":"2024-09-19T06:04:05.427259+0000","last_active":"2024-09-19T06:05:14.474286+0000","last_peered":"2024-09-19T06:05:14.474286+0000","last_clean":"2024-09-19T06:05:14.474286+0000","last_became_active":"2024-09-19T06:04:05.426955+0000","last_became_peered":"2024-09-19T06:04:05.426955+0000","last_unstale":"2024-09-19T06:05:14.474286+0000","last_undegraded":"2024-09-19T06:05:14.474286+0000","last_fullsized":"2024-09-19T06:05:14.474286+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:34:22.085384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.158553+0000","last_change":"2024-09-19T06:04:03.378174+0000","last_active":"2024-09-19T06:05:14.158553+0000","last_peered":"2024-09-19T06:05:14.158553+0000","last_clean":"2024-09-19T06:05:14.158553+0000","last_became_active":"2024-09-19T06:04:03.377803+0000","last_became_peered":"2024-09-19T06:04:03.377803+0000","last_unstale":"2024-09-19T06:05:14.158553+0000","last_undegraded":"2024-09-19T06:05:14.158553+0000","last_fullsized":"2024-09-19T06:05:14.158553+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:24:26.087284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.158946+0000","last_change":"2024-09-19T06:04:12.635365+0000","last_active":"2024-09-19T06:05:14.158946+0000","last_peered":"2024-09-19T06:05:14.158946+0000","last_clean":"2024-09-19T06:05:14.158946+0000","last_became_active":"2024-09-19T06:04:12.634691+0000","last_became_peered":"2024-09-19T06:04:12.634691+0000","last_unstale":"2024-09-19T06:05:14.158946+0000","last_undegraded":"2024-09-19T06:05:14.158946+0000","last_fullsized":"2024-09-19T06:05:14.158946+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:20:58.523992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.158431+0000","last_change":"2024-09-19T06:04:05.425638+0000","last_active":"2024-09-19T06:05:14.158431+0000","last_peered":"2024-09-19T06:05:14.158431+0000","last_clean":"2024-09-19T06:05:14.158431+0000","last_became_active":"2024-09-19T06:04:05.425356+0000","last_became_peered":"2024-09-19T06:04:05.425356+0000","last_unstale":"2024-09-19T06:05:14.158431+0000","last_undegraded":"2024-09-19T06:05:14.158431+0000","last_fullsized":"2024-09-19T06:05:14.158431+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:51:11.857888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.725170+0000","last_change":"2024-09-19T06:04:03.322432+0000","last_active":"2024-09-19T06:05:13.725170+0000","last_peered":"2024-09-19T06:05:13.725170+0000","last_clean":"2024-09-19T06:05:13.725170+0000","last_became_active":"2024-09-19T06:04:03.322071+0000","last_became_peered":"2024-09-19T06:04:03.322071+0000","last_unstale":"2024-09-19T06:05:13.725170+0000","last_undegraded":"2024-09-19T06:05:13.725170+0000","last_fullsized":"2024-09-19T06:05:13.725170+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:16:23.935470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.474787+0000","last_change":"2024-09-19T06:04:12.635970+0000","last_active":"2024-09-19T06:05:14.474787+0000","last_peered":"2024-09-19T06:05:14.474787+0000","last_clean":"2024-09-19T06:05:14.474787+0000","last_became_active":"2024-09-19T06:04:12.635283+0000","last_became_peered":"2024-09-19T06:04:12.635283+0000","last_unstale":"2024-09-19T06:05:14.474787+0000","last_undegraded":"2024-09-19T06:05:14.474787+0000","last_fullsized":"2024-09-19T06:05:14.474787+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:55:05.460652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.729630+0000","last_change":"2024-09-19T06:04:05.424335+0000","last_active":"2024-09-19T06:05:13.729630+0000","last_peered":"2024-09-19T06:05:13.729630+0000","last_clean":"2024-09-19T06:05:13.729630+0000","last_became_active":"2024-09-19T06:04:05.423868+0000","last_became_peered":"2024-09-19T06:04:05.423868+0000","last_unstale":"2024-09-19T06:05:13.729630+0000","last_undegraded":"2024-09-19T06:05:13.729630+0000","last_fullsized":"2024-09-19T06:05:13.729630+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:17:15.556240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727369+0000","last_change":"2024-09-19T06:04:03.315749+0000","last_active":"2024-09-19T06:05:13.727369+0000","last_peered":"2024-09-19T06:05:13.727369+0000","last_clean":"2024-09-19T06:05:13.727369+0000","last_became_active":"2024-09-19T06:04:03.315404+0000","last_became_peered":"2024-09-19T06:04:03.315404+0000","last_unstale":"2024-09-19T06:05:13.727369+0000","last_undegraded":"2024-09-19T06:05:13.727369+0000","last_fullsized":"2024-09-19T06:05:13.727369+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:43:35.485993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":345,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724597+0000","last_change":"2024-09-19T06:02:49.934106+0000","last_active":"2024-09-19T06:05:13.724597+0000","last_peered":"2024-09-19T06:05:13.724597+0000","last_clean":"2024-09-19T06:05:13.724597+0000","last_became_active":"2024-09-19T06:02:49.933684+0000","last_became_peered":"2024-09-19T06:02:49.933684+0000","last_unstale":"2024-09-19T06:05:13.724597+0000","last_undegraded":"2024-09-19T06:05:13.724597+0000","last_fullsized":"2024-09-19T06:05:13.724597+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:59:27.582796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:59:27.582796+0000","last_clean_scrub_stamp":"2024-09-19T05:59:27.582796+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:35:06.837740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"87'1","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724414+0000","last_change":"2024-09-19T06:04:12.468160+0000","last_active":"2024-09-19T06:05:13.724414+0000","last_peered":"2024-09-19T06:05:13.724414+0000","last_clean":"2024-09-19T06:05:13.724414+0000","last_became_active":"2024-09-19T06:04:12.467642+0000","last_became_peered":"2024-09-19T06:04:12.467642+0000","last_unstale":"2024-09-19T06:05:13.724414+0000","last_undegraded":"2024-09-19T06:05:13.724414+0000","last_fullsized":"2024-09-19T06:05:13.724414+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:40.053143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724738+0000","last_change":"2024-09-19T06:04:05.435815+0000","last_active":"2024-09-19T06:05:13.724738+0000","last_peered":"2024-09-19T06:05:13.724738+0000","last_clean":"2024-09-19T06:05:13.724738+0000","last_became_active":"2024-09-19T06:04:05.435498+0000","last_became_peered":"2024-09-19T06:04:05.435498+0000","last_unstale":"2024-09-19T06:05:13.724738+0000","last_undegraded":"2024-09-19T06:05:13.724738+0000","last_fullsized":"2024-09-19T06:05:13.724738+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:33:30.330877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.731805+0000","last_change":"2024-09-19T06:05:13.730770+0000","last_active":"2024-09-19T06:05:13.731805+0000","last_peered":"2024-09-19T06:05:13.731805+0000","last_clean":"2024-09-19T06:05:13.731805+0000","last_became_active":"2024-09-19T06:05:13.730360+0000","last_became_peered":"2024-09-19T06:05:13.730360+0000","last_unstale":"2024-09-19T06:05:13.731805+0000","last_undegraded":"2024-09-19T06:05:13.731805+0000","last_fullsized":"2024-09-19T06:05:13.731805+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:06:34.488351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:15.014149+0000","last_change":"2024-09-19T06:04:12.466249+0000","last_active":"2024-09-19T06:05:15.014149+0000","last_peered":"2024-09-19T06:05:15.014149+0000","last_clean":"2024-09-19T06:05:15.014149+0000","last_became_active":"2024-09-19T06:04:12.465709+0000","last_became_peered":"2024-09-19T06:04:12.465709+0000","last_unstale":"2024-09-19T06:05:15.014149+0000","last_undegraded":"2024-09-19T06:05:15.014149+0000","last_fullsized":"2024-09-19T06:05:15.014149+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:02:11.454334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724466+0000","last_change":"2024-09-19T06:04:05.425733+0000","last_active":"2024-09-19T06:05:13.724466+0000","last_peered":"2024-09-19T06:05:13.724466+0000","last_clean":"2024-09-19T06:05:13.724466+0000","last_became_active":"2024-09-19T06:04:05.425399+0000","last_became_peered":"2024-09-19T06:04:05.425399+0000","last_unstale":"2024-09-19T06:05:13.724466+0000","last_undegraded":"2024-09-19T06:05:13.724466+0000","last_fullsized":"2024-09-19T06:05:13.724466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:35:33.287456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.475134+0000","last_change":"2024-09-19T06:04:03.319361+0000","last_active":"2024-09-19T06:05:14.475134+0000","last_peered":"2024-09-19T06:05:14.475134+0000","last_clean":"2024-09-19T06:05:14.475134+0000","last_became_active":"2024-09-19T06:04:03.319053+0000","last_became_peered":"2024-09-19T06:04:03.319053+0000","last_unstale":"2024-09-19T06:05:14.475134+0000","last_undegraded":"2024-09-19T06:05:14.475134+0000","last_fullsized":"2024-09-19T06:05:14.475134+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:25:23.739392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726834+0000","last_change":"2024-09-19T06:04:12.468270+0000","last_active":"2024-09-19T06:05:13.726834+0000","last_peered":"2024-09-19T06:05:13.726834+0000","last_clean":"2024-09-19T06:05:13.726834+0000","last_became_active":"2024-09-19T06:04:12.467872+0000","last_became_peered":"2024-09-19T06:04:12.467872+0000","last_unstale":"2024-09-19T06:05:13.726834+0000","last_undegraded":"2024-09-19T06:05:13.726834+0000","last_fullsized":"2024-09-19T06:05:13.726834+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:35.476189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724645+0000","last_change":"2024-09-19T06:04:05.431360+0000","last_active":"2024-09-19T06:05:13.724645+0000","last_peered":"2024-09-19T06:05:13.724645+0000","last_clean":"2024-09-19T06:05:13.724645+0000","last_became_active":"2024-09-19T06:04:05.431067+0000","last_became_peered":"2024-09-19T06:04:05.431067+0000","last_unstale":"2024-09-19T06:05:13.724645+0000","last_undegraded":"2024-09-19T06:05:13.724645+0000","last_fullsized":"2024-09-19T06:05:13.724645+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:16:25.317086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.159080+0000","last_change":"2024-09-19T06:04:03.316793+0000","last_active":"2024-09-19T06:05:14.159080+0000","last_peered":"2024-09-19T06:05:14.159080+0000","last_clean":"2024-09-19T06:05:14.159080+0000","last_became_active":"2024-09-19T06:04:03.316485+0000","last_became_peered":"2024-09-19T06:04:03.316485+0000","last_unstale":"2024-09-19T06:05:14.159080+0000","last_undegraded":"2024-09-19T06:05:14.159080+0000","last_fullsized":"2024-09-19T06:05:14.159080+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:19:26.427025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.473926+0000","last_change":"2024-09-19T06:04:12.466322+0000","last_active":"2024-09-19T06:05:14.473926+0000","last_peered":"2024-09-19T06:05:14.473926+0000","last_clean":"2024-09-19T06:05:14.473926+0000","last_became_active":"2024-09-19T06:04:12.465806+0000","last_became_peered":"2024-09-19T06:04:12.465806+0000","last_unstale":"2024-09-19T06:05:14.473926+0000","last_undegraded":"2024-09-19T06:05:14.473926+0000","last_fullsized":"2024-09-19T06:05:14.473926+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:33:28.893570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"89'5","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T06:06:13.690397+0000","last_change":"2024-09-19T06:04:05.424864+0000","last_active":"2024-09-19T06:06:13.690397+0000","last_peered":"2024-09-19T06:06:13.690397+0000","last_clean":"2024-09-19T06:06:13.690397+0000","last_became_active":"2024-09-19T06:04:05.424504+0000","last_became_peered":"2024-09-19T06:04:05.424504+0000","last_unstale":"2024-09-19T06:06:13.690397+0000","last_undegraded":"2024-09-19T06:06:13.690397+0000","last_fullsized":"2024-09-19T06:06:13.690397+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:30.471757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.728243+0000","last_change":"2024-09-19T06:04:03.321925+0000","last_active":"2024-09-19T06:05:13.728243+0000","last_peered":"2024-09-19T06:05:13.728243+0000","last_clean":"2024-09-19T06:05:13.728243+0000","last_became_active":"2024-09-19T06:04:03.321445+0000","last_became_peered":"2024-09-19T06:04:03.321445+0000","last_unstale":"2024-09-19T06:05:13.728243+0000","last_undegraded":"2024-09-19T06:05:13.728243+0000","last_fullsized":"2024-09-19T06:05:13.728243+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:15:55.621352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.474063+0000","last_change":"2024-09-19T06:04:12.471413+0000","last_active":"2024-09-19T06:05:14.474063+0000","last_peered":"2024-09-19T06:05:14.474063+0000","last_clean":"2024-09-19T06:05:14.474063+0000","last_became_active":"2024-09-19T06:04:12.471057+0000","last_became_peered":"2024-09-19T06:04:12.471057+0000","last_unstale":"2024-09-19T06:05:14.474063+0000","last_undegraded":"2024-09-19T06:05:14.474063+0000","last_fullsized":"2024-09-19T06:05:14.474063+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:08:47.259211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.474222+0000","last_change":"2024-09-19T06:04:05.429447+0000","last_active":"2024-09-19T06:05:14.474222+0000","last_peered":"2024-09-19T06:05:14.474222+0000","last_clean":"2024-09-19T06:05:14.474222+0000","last_became_active":"2024-09-19T06:04:05.428852+0000","last_became_peered":"2024-09-19T06:04:05.428852+0000","last_unstale":"2024-09-19T06:05:14.474222+0000","last_undegraded":"2024-09-19T06:05:14.474222+0000","last_fullsized":"2024-09-19T06:05:14.474222+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:01.466814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726844+0000","last_change":"2024-09-19T06:04:03.378586+0000","last_active":"2024-09-19T06:05:13.726844+0000","last_peered":"2024-09-19T06:05:13.726844+0000","last_clean":"2024-09-19T06:05:13.726844+0000","last_became_active":"2024-09-19T06:04:03.378292+0000","last_became_peered":"2024-09-19T06:04:03.378292+0000","last_unstale":"2024-09-19T06:05:13.726844+0000","last_undegraded":"2024-09-19T06:05:13.726844+0000","last_fullsized":"2024-09-19T06:05:13.726844+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:54.247070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.159022+0000","last_change":"2024-09-19T06:04:12.470914+0000","last_active":"2024-09-19T06:05:14.159022+0000","last_peered":"2024-09-19T06:05:14.159022+0000","last_clean":"2024-09-19T06:05:14.159022+0000","last_became_active":"2024-09-19T06:04:12.470563+0000","last_became_peered":"2024-09-19T06:04:12.470563+0000","last_unstale":"2024-09-19T06:05:14.159022+0000","last_undegraded":"2024-09-19T06:05:14.159022+0000","last_fullsized":"2024-09-19T06:05:14.159022+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:13.060646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724169+0000","last_change":"2024-09-19T06:04:05.424009+0000","last_active":"2024-09-19T06:05:13.724169+0000","last_peered":"2024-09-19T06:05:13.724169+0000","last_clean":"2024-09-19T06:05:13.724169+0000","last_became_active":"2024-09-19T06:04:05.423670+0000","last_became_peered":"2024-09-19T06:04:05.423670+0000","last_unstale":"2024-09-19T06:05:13.724169+0000","last_undegraded":"2024-09-19T06:05:13.724169+0000","last_fullsized":"2024-09-19T06:05:13.724169+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:30:15.165259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726323+0000","last_change":"2024-09-19T06:04:03.317089+0000","last_active":"2024-09-19T06:05:13.726323+0000","last_peered":"2024-09-19T06:05:13.726323+0000","last_clean":"2024-09-19T06:05:13.726323+0000","last_became_active":"2024-09-19T06:04:03.316575+0000","last_became_peered":"2024-09-19T06:04:03.316575+0000","last_unstale":"2024-09-19T06:05:13.726323+0000","last_undegraded":"2024-09-19T06:05:13.726323+0000","last_fullsized":"2024-09-19T06:05:13.726323+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:11:43.769660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.732957+0000","last_change":"2024-09-19T06:05:13.731879+0000","last_active":"2024-09-19T06:05:13.732957+0000","last_peered":"2024-09-19T06:05:13.732957+0000","last_clean":"2024-09-19T06:05:13.732957+0000","last_became_active":"2024-09-19T06:05:13.731373+0000","last_became_peered":"2024-09-19T06:05:13.731373+0000","last_unstale":"2024-09-19T06:05:13.732957+0000","last_undegraded":"2024-09-19T06:05:13.732957+0000","last_fullsized":"2024-09-19T06:05:13.732957+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:41:45.556733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724870+0000","last_change":"2024-09-19T06:04:05.430145+0000","last_active":"2024-09-19T06:05:13.724870+0000","last_peered":"2024-09-19T06:05:13.724870+0000","last_clean":"2024-09-19T06:05:13.724870+0000","last_became_active":"2024-09-19T06:04:05.429763+0000","last_became_peered":"2024-09-19T06:04:05.429763+0000","last_unstale":"2024-09-19T06:05:13.724870+0000","last_undegraded":"2024-09-19T06:05:13.724870+0000","last_fullsized":"2024-09-19T06:05:13.724870+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:44:38.783894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.474581+0000","last_change":"2024-09-19T06:04:03.317410+0000","last_active":"2024-09-19T06:05:14.474581+0000","last_peered":"2024-09-19T06:05:14.474581+0000","last_clean":"2024-09-19T06:05:14.474581+0000","last_became_active":"2024-09-19T06:04:03.317068+0000","last_became_peered":"2024-09-19T06:04:03.317068+0000","last_unstale":"2024-09-19T06:05:14.474581+0000","last_undegraded":"2024-09-19T06:05:14.474581+0000","last_fullsized":"2024-09-19T06:05:14.474581+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:23.209080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T06:06:13.690019+0000","last_change":"2024-09-19T06:04:12.469867+0000","last_active":"2024-09-19T06:06:13.690019+0000","last_peered":"2024-09-19T06:06:13.690019+0000","last_clean":"2024-09-19T06:06:13.690019+0000","last_became_active":"2024-09-19T06:04:12.469391+0000","last_became_peered":"2024-09-19T06:04:12.469391+0000","last_unstale":"2024-09-19T06:06:13.690019+0000","last_undegraded":"2024-09-19T06:06:13.690019+0000","last_fullsized":"2024-09-19T06:06:13.690019+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:43:29.493247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.158639+0000","last_change":"2024-09-19T06:04:05.423515+0000","last_active":"2024-09-19T06:05:14.158639+0000","last_peered":"2024-09-19T06:05:14.158639+0000","last_clean":"2024-09-19T06:05:14.158639+0000","last_became_active":"2024-09-19T06:04:05.422185+0000","last_became_peered":"2024-09-19T06:04:05.422185+0000","last_unstale":"2024-09-19T06:05:14.158639+0000","last_undegraded":"2024-09-19T06:05:14.158639+0000","last_fullsized":"2024-09-19T06:05:14.158639+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:09:22.951171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"81'2","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T06:06:13.689958+0000","last_change":"2024-09-19T06:05:13.736876+0000","last_active":"2024-09-19T06:06:13.689958+0000","last_peered":"2024-09-19T06:06:13.689958+0000","last_clean":"2024-09-19T06:06:13.689958+0000","last_became_active":"2024-09-19T06:05:13.731079+0000","last_became_peered":"2024-09-19T06:05:13.731079+0000","last_unstale":"2024-09-19T06:06:13.689958+0000","last_undegraded":"2024-09-19T06:06:13.689958+0000","last_fullsized":"2024-09-19T06:06:13.689958+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:23.458684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.474836+0000","last_change":"2024-09-19T06:04:12.468569+0000","last_active":"2024-09-19T06:05:14.474836+0000","last_peered":"2024-09-19T06:05:14.474836+0000","last_clean":"2024-09-19T06:05:14.474836+0000","last_became_active":"2024-09-19T06:04:12.467759+0000","last_became_peered":"2024-09-19T06:04:12.467759+0000","last_unstale":"2024-09-19T06:05:14.474836+0000","last_undegraded":"2024-09-19T06:05:14.474836+0000","last_fullsized":"2024-09-19T06:05:14.474836+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:20:49.817163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727216+0000","last_change":"2024-09-19T06:04:05.425703+0000","last_active":"2024-09-19T06:05:13.727216+0000","last_peered":"2024-09-19T06:05:13.727216+0000","last_clean":"2024-09-19T06:05:13.727216+0000","last_became_active":"2024-09-19T06:04:05.425360+0000","last_became_peered":"2024-09-19T06:04:05.425360+0000","last_unstale":"2024-09-19T06:05:13.727216+0000","last_undegraded":"2024-09-19T06:05:13.727216+0000","last_fullsized":"2024-09-19T06:05:13.727216+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:33:25.457191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"89'34","reported_seq":263,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:06:12.682978+0000","last_change":"2024-09-19T06:04:03.319087+0000","last_active":"2024-09-19T06:06:12.682978+0000","last_peered":"2024-09-19T06:06:12.682978+0000","last_clean":"2024-09-19T06:06:12.682978+0000","last_became_active":"2024-09-19T06:04:03.318721+0000","last_became_peered":"2024-09-19T06:04:03.318721+0000","last_unstale":"2024-09-19T06:06:12.682978+0000","last_undegraded":"2024-09-19T06:06:12.682978+0000","last_fullsized":"2024-09-19T06:06:12.682978+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:14:32.337455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68382,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":195,"num_read_kb":164,"num_write":34,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T06:06:13.690303+0000","last_change":"2024-09-19T06:04:12.472008+0000","last_active":"2024-09-19T06:06:13.690303+0000","last_peered":"2024-09-19T06:06:13.690303+0000","last_clean":"2024-09-19T06:06:13.690303+0000","last_became_active":"2024-09-19T06:04:12.471623+0000","last_became_peered":"2024-09-19T06:04:12.471623+0000","last_unstale":"2024-09-19T06:06:13.690303+0000","last_undegraded":"2024-09-19T06:06:13.690303+0000","last_fullsized":"2024-09-19T06:06:13.690303+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:13:11.424242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:15.014354+0000","last_change":"2024-09-19T06:04:05.434865+0000","last_active":"2024-09-19T06:05:15.014354+0000","last_peered":"2024-09-19T06:05:15.014354+0000","last_clean":"2024-09-19T06:05:15.014354+0000","last_became_active":"2024-09-19T06:04:05.434472+0000","last_became_peered":"2024-09-19T06:04:05.434472+0000","last_unstale":"2024-09-19T06:05:15.014354+0000","last_undegraded":"2024-09-19T06:05:15.014354+0000","last_fullsized":"2024-09-19T06:05:15.014354+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:35.490406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"81'3","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.475083+0000","last_change":"2024-09-19T06:04:03.380447+0000","last_active":"2024-09-19T06:05:14.475083+0000","last_peered":"2024-09-19T06:05:14.475083+0000","last_clean":"2024-09-19T06:05:14.475083+0000","last_became_active":"2024-09-19T06:04:03.380154+0000","last_became_peered":"2024-09-19T06:04:03.380154+0000","last_unstale":"2024-09-19T06:05:14.475083+0000","last_undegraded":"2024-09-19T06:05:14.475083+0000","last_fullsized":"2024-09-19T06:05:14.475083+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:48:11.570148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726945+0000","last_change":"2024-09-19T06:04:12.467995+0000","last_active":"2024-09-19T06:05:13.726945+0000","last_peered":"2024-09-19T06:05:13.726945+0000","last_clean":"2024-09-19T06:05:13.726945+0000","last_became_active":"2024-09-19T06:04:12.467539+0000","last_became_peered":"2024-09-19T06:04:12.467539+0000","last_unstale":"2024-09-19T06:05:13.726945+0000","last_undegraded":"2024-09-19T06:05:13.726945+0000","last_fullsized":"2024-09-19T06:05:13.726945+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:13:29.285909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726884+0000","last_change":"2024-09-19T06:04:05.429919+0000","last_active":"2024-09-19T06:05:13.726884+0000","last_peered":"2024-09-19T06:05:13.726884+0000","last_clean":"2024-09-19T06:05:13.726884+0000","last_became_active":"2024-09-19T06:04:05.429597+0000","last_became_peered":"2024-09-19T06:04:05.429597+0000","last_unstale":"2024-09-19T06:05:13.726884+0000","last_undegraded":"2024-09-19T06:05:13.726884+0000","last_fullsized":"2024-09-19T06:05:13.726884+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:08:38.816272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724643+0000","last_change":"2024-09-19T06:04:03.320501+0000","last_active":"2024-09-19T06:05:13.724643+0000","last_peered":"2024-09-19T06:05:13.724643+0000","last_clean":"2024-09-19T06:05:13.724643+0000","last_became_active":"2024-09-19T06:04:03.320093+0000","last_became_peered":"2024-09-19T06:04:03.320093+0000","last_unstale":"2024-09-19T06:05:13.724643+0000","last_undegraded":"2024-09-19T06:05:13.724643+0000","last_fullsized":"2024-09-19T06:05:13.724643+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:31:11.896935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T06:06:13.689610+0000","last_change":"2024-09-19T06:04:12.468455+0000","last_active":"2024-09-19T06:06:13.689610+0000","last_peered":"2024-09-19T06:06:13.689610+0000","last_clean":"2024-09-19T06:06:13.689610+0000","last_became_active":"2024-09-19T06:04:12.468007+0000","last_became_peered":"2024-09-19T06:04:12.468007+0000","last_unstale":"2024-09-19T06:06:13.689610+0000","last_undegraded":"2024-09-19T06:06:13.689610+0000","last_fullsized":"2024-09-19T06:06:13.689610+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:50:58.995825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:15.014577+0000","last_change":"2024-09-19T06:04:05.427599+0000","last_active":"2024-09-19T06:05:15.014577+0000","last_peered":"2024-09-19T06:05:15.014577+0000","last_clean":"2024-09-19T06:05:15.014577+0000","last_became_active":"2024-09-19T06:04:05.425338+0000","last_became_peered":"2024-09-19T06:04:05.425338+0000","last_unstale":"2024-09-19T06:05:15.014577+0000","last_undegraded":"2024-09-19T06:05:15.014577+0000","last_fullsized":"2024-09-19T06:05:15.014577+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:44.547625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.728363+0000","last_change":"2024-09-19T06:04:03.322165+0000","last_active":"2024-09-19T06:05:13.728363+0000","last_peered":"2024-09-19T06:05:13.728363+0000","last_clean":"2024-09-19T06:05:13.728363+0000","last_became_active":"2024-09-19T06:04:03.321822+0000","last_became_peered":"2024-09-19T06:04:03.321822+0000","last_unstale":"2024-09-19T06:05:13.728363+0000","last_undegraded":"2024-09-19T06:05:13.728363+0000","last_fullsized":"2024-09-19T06:05:13.728363+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:58:00.943453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.729258+0000","last_change":"2024-09-19T06:04:12.465823+0000","last_active":"2024-09-19T06:05:13.729258+0000","last_peered":"2024-09-19T06:05:13.729258+0000","last_clean":"2024-09-19T06:05:13.729258+0000","last_became_active":"2024-09-19T06:04:12.465375+0000","last_became_peered":"2024-09-19T06:04:12.465375+0000","last_unstale":"2024-09-19T06:05:13.729258+0000","last_undegraded":"2024-09-19T06:05:13.729258+0000","last_fullsized":"2024-09-19T06:05:13.729258+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:26:25.428328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726852+0000","last_change":"2024-09-19T06:04:12.470023+0000","last_active":"2024-09-19T06:05:13.726852+0000","last_peered":"2024-09-19T06:05:13.726852+0000","last_clean":"2024-09-19T06:05:13.726852+0000","last_became_active":"2024-09-19T06:04:12.469651+0000","last_became_peered":"2024-09-19T06:04:12.469651+0000","last_unstale":"2024-09-19T06:05:13.726852+0000","last_undegraded":"2024-09-19T06:05:13.726852+0000","last_fullsized":"2024-09-19T06:05:13.726852+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:50:35.374437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"89'11","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T06:06:13.689708+0000","last_change":"2024-09-19T06:04:05.417466+0000","last_active":"2024-09-19T06:06:13.689708+0000","last_peered":"2024-09-19T06:06:13.689708+0000","last_clean":"2024-09-19T06:06:13.689708+0000","last_became_active":"2024-09-19T06:04:05.417026+0000","last_became_peered":"2024-09-19T06:04:05.417026+0000","last_unstale":"2024-09-19T06:06:13.689708+0000","last_undegraded":"2024-09-19T06:06:13.689708+0000","last_fullsized":"2024-09-19T06:06:13.689708+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:44:08.251755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.474542+0000","last_change":"2024-09-19T06:04:03.317466+0000","last_active":"2024-09-19T06:05:14.474542+0000","last_peered":"2024-09-19T06:05:14.474542+0000","last_clean":"2024-09-19T06:05:14.474542+0000","last_became_active":"2024-09-19T06:04:03.317148+0000","last_became_peered":"2024-09-19T06:04:03.317148+0000","last_unstale":"2024-09-19T06:05:14.474542+0000","last_undegraded":"2024-09-19T06:05:14.474542+0000","last_fullsized":"2024-09-19T06:05:14.474542+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:45:50.789900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T06:06:13.690309+0000","last_change":"2024-09-19T06:04:12.469279+0000","last_active":"2024-09-19T06:06:13.690309+0000","last_peered":"2024-09-19T06:06:13.690309+0000","last_clean":"2024-09-19T06:06:13.690309+0000","last_became_active":"2024-09-19T06:04:12.467928+0000","last_became_peered":"2024-09-19T06:04:12.467928+0000","last_unstale":"2024-09-19T06:06:13.690309+0000","last_undegraded":"2024-09-19T06:06:13.690309+0000","last_fullsized":"2024-09-19T06:06:13.690309+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:52:25.839433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.729399+0000","last_change":"2024-09-19T06:04:05.420425+0000","last_active":"2024-09-19T06:05:13.729399+0000","last_peered":"2024-09-19T06:05:13.729399+0000","last_clean":"2024-09-19T06:05:13.729399+0000","last_became_active":"2024-09-19T06:04:05.420107+0000","last_became_peered":"2024-09-19T06:04:05.420107+0000","last_unstale":"2024-09-19T06:05:13.729399+0000","last_undegraded":"2024-09-19T06:05:13.729399+0000","last_fullsized":"2024-09-19T06:05:13.729399+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:49:24.566302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.158396+0000","last_change":"2024-09-19T06:04:03.315704+0000","last_active":"2024-09-19T06:05:14.158396+0000","last_peered":"2024-09-19T06:05:14.158396+0000","last_clean":"2024-09-19T06:05:14.158396+0000","last_became_active":"2024-09-19T06:04:03.315392+0000","last_became_peered":"2024-09-19T06:04:03.315392+0000","last_unstale":"2024-09-19T06:05:14.158396+0000","last_undegraded":"2024-09-19T06:05:14.158396+0000","last_fullsized":"2024-09-19T06:05:14.158396+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:52:14.417470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"81'1","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.728460+0000","last_change":"2024-09-19T06:04:03.323560+0000","last_active":"2024-09-19T06:05:13.728460+0000","last_peered":"2024-09-19T06:05:13.728460+0000","last_clean":"2024-09-19T06:05:13.728460+0000","last_became_active":"2024-09-19T06:04:03.323188+0000","last_became_peered":"2024-09-19T06:04:03.323188+0000","last_unstale":"2024-09-19T06:05:13.728460+0000","last_undegraded":"2024-09-19T06:05:13.728460+0000","last_fullsized":"2024-09-19T06:05:13.728460+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:02:50.426435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.474822+0000","last_change":"2024-09-19T06:04:05.430677+0000","last_active":"2024-09-19T06:05:14.474822+0000","last_peered":"2024-09-19T06:05:14.474822+0000","last_clean":"2024-09-19T06:05:14.474822+0000","last_became_active":"2024-09-19T06:04:05.430257+0000","last_became_peered":"2024-09-19T06:04:05.430257+0000","last_unstale":"2024-09-19T06:05:14.474822+0000","last_undegraded":"2024-09-19T06:05:14.474822+0000","last_fullsized":"2024-09-19T06:05:14.474822+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:38:42.138770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727118+0000","last_change":"2024-09-19T06:04:12.465252+0000","last_active":"2024-09-19T06:05:13.727118+0000","last_peered":"2024-09-19T06:05:13.727118+0000","last_clean":"2024-09-19T06:05:13.727118+0000","last_became_active":"2024-09-19T06:04:12.464649+0000","last_became_peered":"2024-09-19T06:04:12.464649+0000","last_unstale":"2024-09-19T06:05:13.727118+0000","last_undegraded":"2024-09-19T06:05:13.727118+0000","last_fullsized":"2024-09-19T06:05:13.727118+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:11:43.137148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"81'1","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.474959+0000","last_change":"2024-09-19T06:04:03.317584+0000","last_active":"2024-09-19T06:05:14.474959+0000","last_peered":"2024-09-19T06:05:14.474959+0000","last_clean":"2024-09-19T06:05:14.474959+0000","last_became_active":"2024-09-19T06:04:03.317250+0000","last_became_peered":"2024-09-19T06:04:03.317250+0000","last_unstale":"2024-09-19T06:05:14.474959+0000","last_undegraded":"2024-09-19T06:05:14.474959+0000","last_fullsized":"2024-09-19T06:05:14.474959+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:02.285467+0000","last_clean_scrub_stamp":"2024-09-19T06:04:02.285467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:22.353887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727268+0000","last_change":"2024-09-19T06:04:05.431102+0000","last_active":"2024-09-19T06:05:13.727268+0000","last_peered":"2024-09-19T06:05:13.727268+0000","last_clean":"2024-09-19T06:05:13.727268+0000","last_became_active":"2024-09-19T06:04:05.430792+0000","last_became_peered":"2024-09-19T06:04:05.430792+0000","last_unstale":"2024-09-19T06:05:13.727268+0000","last_undegraded":"2024-09-19T06:05:13.727268+0000","last_fullsized":"2024-09-19T06:05:13.727268+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:48:48.682273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727983+0000","last_change":"2024-09-19T06:04:12.467143+0000","last_active":"2024-09-19T06:05:13.727983+0000","last_peered":"2024-09-19T06:05:13.727983+0000","last_clean":"2024-09-19T06:05:13.727983+0000","last_became_active":"2024-09-19T06:04:12.466672+0000","last_became_peered":"2024-09-19T06:04:12.466672+0000","last_unstale":"2024-09-19T06:05:13.727983+0000","last_undegraded":"2024-09-19T06:05:13.727983+0000","last_fullsized":"2024-09-19T06:05:13.727983+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:11.443450+0000","last_clean_scrub_stamp":"2024-09-19T06:04:11.443450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:57:36.710316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"89'9","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T06:06:13.689862+0000","last_change":"2024-09-19T06:04:05.427387+0000","last_active":"2024-09-19T06:06:13.689862+0000","last_peered":"2024-09-19T06:06:13.689862+0000","last_clean":"2024-09-19T06:06:13.689862+0000","last_became_active":"2024-09-19T06:04:05.427082+0000","last_became_peered":"2024-09-19T06:04:05.427082+0000","last_unstale":"2024-09-19T06:06:13.689862+0000","last_undegraded":"2024-09-19T06:06:13.689862+0000","last_fullsized":"2024-09-19T06:06:13.689862+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:55.931289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.728442+0000","last_change":"2024-09-19T06:04:05.434396+0000","last_active":"2024-09-19T06:05:13.728442+0000","last_peered":"2024-09-19T06:05:13.728442+0000","last_clean":"2024-09-19T06:05:13.728442+0000","last_became_active":"2024-09-19T06:04:05.433907+0000","last_became_peered":"2024-09-19T06:04:05.433907+0000","last_unstale":"2024-09-19T06:05:13.728442+0000","last_undegraded":"2024-09-19T06:05:13.728442+0000","last_fullsized":"2024-09-19T06:05:13.728442+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:02:40.885820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727903+0000","last_change":"2024-09-19T06:04:05.435813+0000","last_active":"2024-09-19T06:05:13.727903+0000","last_peered":"2024-09-19T06:05:13.727903+0000","last_clean":"2024-09-19T06:05:13.727903+0000","last_became_active":"2024-09-19T06:04:05.435441+0000","last_became_peered":"2024-09-19T06:04:05.435441+0000","last_unstale":"2024-09-19T06:05:13.727903+0000","last_undegraded":"2024-09-19T06:05:13.727903+0000","last_fullsized":"2024-09-19T06:05:13.727903+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:11:20.071732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727073+0000","last_change":"2024-09-19T06:04:05.433045+0000","last_active":"2024-09-19T06:05:13.727073+0000","last_peered":"2024-09-19T06:05:13.727073+0000","last_clean":"2024-09-19T06:05:13.727073+0000","last_became_active":"2024-09-19T06:04:05.432674+0000","last_became_peered":"2024-09-19T06:04:05.432674+0000","last_unstale":"2024-09-19T06:05:13.727073+0000","last_undegraded":"2024-09-19T06:05:13.727073+0000","last_fullsized":"2024-09-19T06:05:13.727073+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:33:06.743886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.158713+0000","last_change":"2024-09-19T06:04:05.431702+0000","last_active":"2024-09-19T06:05:14.158713+0000","last_peered":"2024-09-19T06:05:14.158713+0000","last_clean":"2024-09-19T06:05:14.158713+0000","last_became_active":"2024-09-19T06:04:05.431394+0000","last_became_peered":"2024-09-19T06:04:05.431394+0000","last_unstale":"2024-09-19T06:05:14.158713+0000","last_undegraded":"2024-09-19T06:05:14.158713+0000","last_fullsized":"2024-09-19T06:05:14.158713+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:42:18.692549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"89'6","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T06:06:13.690400+0000","last_change":"2024-09-19T06:05:13.733030+0000","last_active":"2024-09-19T06:06:13.690400+0000","last_peered":"2024-09-19T06:06:13.690400+0000","last_clean":"2024-09-19T06:06:13.690400+0000","last_became_active":"2024-09-19T06:05:13.732680+0000","last_became_peered":"2024-09-19T06:05:13.732680+0000","last_unstale":"2024-09-19T06:06:13.690400+0000","last_undegraded":"2024-09-19T06:06:13.690400+0000","last_fullsized":"2024-09-19T06:06:13.690400+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:53:24.299931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727345+0000","last_change":"2024-09-19T06:04:05.430104+0000","last_active":"2024-09-19T06:05:13.727345+0000","last_peered":"2024-09-19T06:05:13.727345+0000","last_clean":"2024-09-19T06:05:13.727345+0000","last_became_active":"2024-09-19T06:04:05.429779+0000","last_became_peered":"2024-09-19T06:04:05.429779+0000","last_unstale":"2024-09-19T06:05:13.727345+0000","last_undegraded":"2024-09-19T06:05:13.727345+0000","last_fullsized":"2024-09-19T06:05:13.727345+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:52:46.191484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.730313+0000","last_change":"2024-09-19T06:04:05.427235+0000","last_active":"2024-09-19T06:05:13.730313+0000","last_peered":"2024-09-19T06:05:13.730313+0000","last_clean":"2024-09-19T06:05:13.730313+0000","last_became_active":"2024-09-19T06:04:05.426937+0000","last_became_peered":"2024-09-19T06:04:05.426937+0000","last_unstale":"2024-09-19T06:05:13.730313+0000","last_undegraded":"2024-09-19T06:05:13.730313+0000","last_fullsized":"2024-09-19T06:05:13.730313+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:55.949564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.474156+0000","last_change":"2024-09-19T06:04:05.422199+0000","last_active":"2024-09-19T06:05:14.474156+0000","last_peered":"2024-09-19T06:05:14.474156+0000","last_clean":"2024-09-19T06:05:14.474156+0000","last_became_active":"2024-09-19T06:04:05.421681+0000","last_became_peered":"2024-09-19T06:04:05.421681+0000","last_unstale":"2024-09-19T06:05:14.474156+0000","last_undegraded":"2024-09-19T06:05:14.474156+0000","last_fullsized":"2024-09-19T06:05:14.474156+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:27:54.774211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.729451+0000","last_change":"2024-09-19T06:04:05.426559+0000","last_active":"2024-09-19T06:05:13.729451+0000","last_peered":"2024-09-19T06:05:13.729451+0000","last_clean":"2024-09-19T06:05:13.729451+0000","last_became_active":"2024-09-19T06:04:05.423197+0000","last_became_peered":"2024-09-19T06:04:05.423197+0000","last_unstale":"2024-09-19T06:05:13.729451+0000","last_undegraded":"2024-09-19T06:05:13.729451+0000","last_fullsized":"2024-09-19T06:05:13.729451+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:43.964457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:15.014232+0000","last_change":"2024-09-19T06:04:05.435779+0000","last_active":"2024-09-19T06:05:15.014232+0000","last_peered":"2024-09-19T06:05:15.014232+0000","last_clean":"2024-09-19T06:05:15.014232+0000","last_became_active":"2024-09-19T06:04:05.435436+0000","last_became_peered":"2024-09-19T06:04:05.435436+0000","last_unstale":"2024-09-19T06:05:15.014232+0000","last_undegraded":"2024-09-19T06:05:15.014232+0000","last_fullsized":"2024-09-19T06:05:15.014232+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:13:03.341438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.158694+0000","last_change":"2024-09-19T06:04:05.431718+0000","last_active":"2024-09-19T06:05:14.158694+0000","last_peered":"2024-09-19T06:05:14.158694+0000","last_clean":"2024-09-19T06:05:14.158694+0000","last_became_active":"2024-09-19T06:04:05.431429+0000","last_became_peered":"2024-09-19T06:04:05.431429+0000","last_unstale":"2024-09-19T06:05:14.158694+0000","last_undegraded":"2024-09-19T06:05:14.158694+0000","last_fullsized":"2024-09-19T06:05:14.158694+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:11:42.818368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"89'8","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T06:06:13.690093+0000","last_change":"2024-09-19T06:04:05.429575+0000","last_active":"2024-09-19T06:06:13.690093+0000","last_peered":"2024-09-19T06:06:13.690093+0000","last_clean":"2024-09-19T06:06:13.690093+0000","last_became_active":"2024-09-19T06:04:05.429226+0000","last_became_peered":"2024-09-19T06:04:05.429226+0000","last_unstale":"2024-09-19T06:06:13.690093+0000","last_undegraded":"2024-09-19T06:06:13.690093+0000","last_fullsized":"2024-09-19T06:06:13.690093+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:29:19.680433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.728155+0000","last_change":"2024-09-19T06:04:05.431612+0000","last_active":"2024-09-19T06:05:13.728155+0000","last_peered":"2024-09-19T06:05:13.728155+0000","last_clean":"2024-09-19T06:05:13.728155+0000","last_became_active":"2024-09-19T06:04:05.431240+0000","last_became_peered":"2024-09-19T06:04:05.431240+0000","last_unstale":"2024-09-19T06:05:13.728155+0000","last_undegraded":"2024-09-19T06:05:13.728155+0000","last_fullsized":"2024-09-19T06:05:13.728155+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:46:14.138603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"89'10","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T06:06:13.690321+0000","last_change":"2024-09-19T06:04:05.428849+0000","last_active":"2024-09-19T06:06:13.690321+0000","last_peered":"2024-09-19T06:06:13.690321+0000","last_clean":"2024-09-19T06:06:13.690321+0000","last_became_active":"2024-09-19T06:04:05.428516+0000","last_became_peered":"2024-09-19T06:04:05.428516+0000","last_unstale":"2024-09-19T06:06:13.690321+0000","last_undegraded":"2024-09-19T06:06:13.690321+0000","last_fullsized":"2024-09-19T06:06:13.690321+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:58:00.323959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"89'8","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T06:06:13.690673+0000","last_change":"2024-09-19T06:04:05.436409+0000","last_active":"2024-09-19T06:06:13.690673+0000","last_peered":"2024-09-19T06:06:13.690673+0000","last_clean":"2024-09-19T06:06:13.690673+0000","last_became_active":"2024-09-19T06:04:05.436058+0000","last_became_peered":"2024-09-19T06:04:05.436058+0000","last_unstale":"2024-09-19T06:06:13.690673+0000","last_undegraded":"2024-09-19T06:06:13.690673+0000","last_fullsized":"2024-09-19T06:06:13.690673+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:20:45.227159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:15.014023+0000","last_change":"2024-09-19T06:04:05.434398+0000","last_active":"2024-09-19T06:05:15.014023+0000","last_peered":"2024-09-19T06:05:15.014023+0000","last_clean":"2024-09-19T06:05:15.014023+0000","last_became_active":"2024-09-19T06:04:05.433635+0000","last_became_peered":"2024-09-19T06:04:05.433635+0000","last_unstale":"2024-09-19T06:05:15.014023+0000","last_undegraded":"2024-09-19T06:05:15.014023+0000","last_fullsized":"2024-09-19T06:05:15.014023+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:10:42.104705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726446+0000","last_change":"2024-09-19T06:04:05.423447+0000","last_active":"2024-09-19T06:05:13.726446+0000","last_peered":"2024-09-19T06:05:13.726446+0000","last_clean":"2024-09-19T06:05:13.726446+0000","last_became_active":"2024-09-19T06:04:05.423081+0000","last_became_peered":"2024-09-19T06:04:05.423081+0000","last_unstale":"2024-09-19T06:05:13.726446+0000","last_undegraded":"2024-09-19T06:05:13.726446+0000","last_fullsized":"2024-09-19T06:05:13.726446+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:03:54.856251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726503+0000","last_change":"2024-09-19T06:04:05.426371+0000","last_active":"2024-09-19T06:05:13.726503+0000","last_peered":"2024-09-19T06:05:13.726503+0000","last_clean":"2024-09-19T06:05:13.726503+0000","last_became_active":"2024-09-19T06:04:05.425601+0000","last_became_peered":"2024-09-19T06:04:05.425601+0000","last_unstale":"2024-09-19T06:05:13.726503+0000","last_undegraded":"2024-09-19T06:05:13.726503+0000","last_fullsized":"2024-09-19T06:05:13.726503+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:55:05.677121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:14.158746+0000","last_change":"2024-09-19T06:04:05.426264+0000","last_active":"2024-09-19T06:05:14.158746+0000","last_peered":"2024-09-19T06:05:14.158746+0000","last_clean":"2024-09-19T06:05:14.158746+0000","last_became_active":"2024-09-19T06:04:05.425939+0000","last_became_peered":"2024-09-19T06:04:05.425939+0000","last_unstale":"2024-09-19T06:05:14.158746+0000","last_undegraded":"2024-09-19T06:05:14.158746+0000","last_fullsized":"2024-09-19T06:05:14.158746+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:18:43.250682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"89'7","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:06:12.651015+0000","last_change":"2024-09-19T06:04:05.432654+0000","last_active":"2024-09-19T06:06:12.651015+0000","last_peered":"2024-09-19T06:06:12.651015+0000","last_clean":"2024-09-19T06:06:12.651015+0000","last_became_active":"2024-09-19T06:04:05.431489+0000","last_became_peered":"2024-09-19T06:04:05.431489+0000","last_unstale":"2024-09-19T06:06:12.651015+0000","last_undegraded":"2024-09-19T06:06:12.651015+0000","last_fullsized":"2024-09-19T06:06:12.651015+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:15:41.251538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724637+0000","last_change":"2024-09-19T06:04:05.435221+0000","last_active":"2024-09-19T06:05:13.724637+0000","last_peered":"2024-09-19T06:05:13.724637+0000","last_clean":"2024-09-19T06:05:13.724637+0000","last_became_active":"2024-09-19T06:04:05.434909+0000","last_became_peered":"2024-09-19T06:04:05.434909+0000","last_unstale":"2024-09-19T06:05:13.724637+0000","last_undegraded":"2024-09-19T06:05:13.724637+0000","last_fullsized":"2024-09-19T06:05:13.724637+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:15:20.414499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"89'16","reported_seq":51,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:06:12.656382+0000","last_change":"2024-09-19T06:05:13.731152+0000","last_active":"2024-09-19T06:06:12.656382+0000","last_peered":"2024-09-19T06:06:12.656382+0000","last_clean":"2024-09-19T06:06:12.656382+0000","last_became_active":"2024-09-19T06:05:13.730810+0000","last_became_peered":"2024-09-19T06:05:13.730810+0000","last_unstale":"2024-09-19T06:06:12.656382+0000","last_undegraded":"2024-09-19T06:06:12.656382+0000","last_fullsized":"2024-09-19T06:06:12.656382+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:55:13.359784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:15.014646+0000","last_change":"2024-09-19T06:04:05.432940+0000","last_active":"2024-09-19T06:05:15.014646+0000","last_peered":"2024-09-19T06:05:15.014646+0000","last_clean":"2024-09-19T06:05:15.014646+0000","last_became_active":"2024-09-19T06:04:05.432579+0000","last_became_peered":"2024-09-19T06:04:05.432579+0000","last_unstale":"2024-09-19T06:05:15.014646+0000","last_undegraded":"2024-09-19T06:05:15.014646+0000","last_fullsized":"2024-09-19T06:05:15.014646+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:56.740048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.729272+0000","last_change":"2024-09-19T06:04:05.417967+0000","last_active":"2024-09-19T06:05:13.729272+0000","last_peered":"2024-09-19T06:05:13.729272+0000","last_clean":"2024-09-19T06:05:13.729272+0000","last_became_active":"2024-09-19T06:04:05.417658+0000","last_became_peered":"2024-09-19T06:04:05.417658+0000","last_unstale":"2024-09-19T06:05:13.729272+0000","last_undegraded":"2024-09-19T06:05:13.729272+0000","last_fullsized":"2024-09-19T06:05:13.729272+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:55.571313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.724281+0000","last_change":"2024-09-19T06:04:05.424627+0000","last_active":"2024-09-19T06:05:13.724281+0000","last_peered":"2024-09-19T06:05:13.724281+0000","last_clean":"2024-09-19T06:05:13.724281+0000","last_became_active":"2024-09-19T06:04:05.424301+0000","last_became_peered":"2024-09-19T06:04:05.424301+0000","last_unstale":"2024-09-19T06:05:13.724281+0000","last_undegraded":"2024-09-19T06:05:13.724281+0000","last_fullsized":"2024-09-19T06:05:13.724281+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:48:00.964989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"89'6","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:06:12.662195+0000","last_change":"2024-09-19T06:04:05.423635+0000","last_active":"2024-09-19T06:06:12.662195+0000","last_peered":"2024-09-19T06:06:12.662195+0000","last_clean":"2024-09-19T06:06:12.662195+0000","last_became_active":"2024-09-19T06:04:05.422625+0000","last_became_peered":"2024-09-19T06:04:05.422625+0000","last_unstale":"2024-09-19T06:06:12.662195+0000","last_undegraded":"2024-09-19T06:06:12.662195+0000","last_fullsized":"2024-09-19T06:06:12.662195+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:33:34.099443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726970+0000","last_change":"2024-09-19T06:04:05.428933+0000","last_active":"2024-09-19T06:05:13.726970+0000","last_peered":"2024-09-19T06:05:13.726970+0000","last_clean":"2024-09-19T06:05:13.726970+0000","last_became_active":"2024-09-19T06:04:05.428598+0000","last_became_peered":"2024-09-19T06:04:05.428598+0000","last_unstale":"2024-09-19T06:05:13.726970+0000","last_undegraded":"2024-09-19T06:05:13.726970+0000","last_fullsized":"2024-09-19T06:05:13.726970+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:27:15.111954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"89'8","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T06:06:13.689920+0000","last_change":"2024-09-19T06:05:13.730637+0000","last_active":"2024-09-19T06:06:13.689920+0000","last_peered":"2024-09-19T06:06:13.689920+0000","last_clean":"2024-09-19T06:06:13.689920+0000","last_became_active":"2024-09-19T06:05:13.730224+0000","last_became_peered":"2024-09-19T06:05:13.730224+0000","last_unstale":"2024-09-19T06:06:13.689920+0000","last_undegraded":"2024-09-19T06:06:13.689920+0000","last_fullsized":"2024-09-19T06:06:13.689920+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:14:08.175943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.726638+0000","last_change":"2024-09-19T06:04:05.430427+0000","last_active":"2024-09-19T06:05:13.726638+0000","last_peered":"2024-09-19T06:05:13.726638+0000","last_clean":"2024-09-19T06:05:13.726638+0000","last_became_active":"2024-09-19T06:04:05.430106+0000","last_became_peered":"2024-09-19T06:04:05.430106+0000","last_unstale":"2024-09-19T06:05:13.726638+0000","last_undegraded":"2024-09-19T06:05:13.726638+0000","last_fullsized":"2024-09-19T06:05:13.726638+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:03:00.764689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:05:13.727017+0000","last_change":"2024-09-19T06:04:05.427189+0000","last_active":"2024-09-19T06:05:13.727017+0000","last_peered":"2024-09-19T06:05:13.727017+0000","last_clean":"2024-09-19T06:05:13.727017+0000","last_became_active":"2024-09-19T06:04:05.426874+0000","last_became_peered":"2024-09-19T06:04:05.426874+0000","last_unstale":"2024-09-19T06:05:13.727017+0000","last_undegraded":"2024-09-19T06:05:13.727017+0000","last_fullsized":"2024-09-19T06:05:13.727017+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:37:10.910723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"89'8","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T06:06:13.690631+0000","last_change":"2024-09-19T06:04:05.435803+0000","last_active":"2024-09-19T06:06:13.690631+0000","last_peered":"2024-09-19T06:06:13.690631+0000","last_clean":"2024-09-19T06:06:13.690631+0000","last_became_active":"2024-09-19T06:04:05.435430+0000","last_became_peered":"2024-09-19T06:04:05.435430+0000","last_unstale":"2024-09-19T06:06:13.690631+0000","last_undegraded":"2024-09-19T06:06:13.690631+0000","last_fullsized":"2024-09-19T06:06:13.690631+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:04.392956+0000","last_clean_scrub_stamp":"2024-09-19T06:04:04.392956+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:41.828016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69180,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":201,"num_read_kb":170,"num_write":90,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":198106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547240,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1007616,"data_stored":497802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776173,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36988,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708164,"statfs":{"total":95995035648,"available":95957159936,"internally_reserved":0,"allocated":1683456,"data_stored":1152616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939698,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1028096,"data_stored":511796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168630,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1011712,"data_stored":498372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397563,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36920,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708232,"statfs":{"total":95995035648,"available":95957229568,"internally_reserved":0,"allocated":1605632,"data_stored":1092814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561089,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":999424,"data_stored":493672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790021,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28604,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716548,"statfs":{"total":95995035648,"available":95965745152,"internally_reserved":0,"allocated":1609728,"data_stored":1088318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953546,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1007616,"data_stored":497790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182479,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36336,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708816,"statfs":{"total":95995035648,"available":95957827584,"internally_reserved":0,"allocated":1007616,"data_stored":493776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411413,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28080,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717072,"statfs":{"total":95995035648,"available":95966281728,"internally_reserved":0,"allocated":1073152,"data_stored":557183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574938,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28072,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717080,"statfs":{"total":95995035648,"available":95966289920,"internally_reserved":0,"allocated":1073152,"data_stored":557491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738463,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1003520,"data_stored":493762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":63819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":63511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":68576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T06:06:16.783 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:06:16.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:06:16 smithi099 ceph-mon[35300]: from='client.15144 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:06:16.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:06:16 smithi117 ceph-mon[35050]: from='client.15144 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:06:17.047 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:06:17.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:06:16 smithi037 ceph-mon[31211]: from='client.15144 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:06:17.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:17.540+0000 7f3f95c5b640 1 -- 172.21.15.37:0/2566358772 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f901027a0 msgr2=0x7f3f901067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:17.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:17.540+0000 7f3f95c5b640 1 --2- 172.21.15.37:0/2566358772 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f901027a0 0x7f3f901067f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f3f84009900 tx=0x7f3f8402a410 comp rx=0 tx=0).stop 2024-09-19T06:06:17.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:17.540+0000 7f3f95c5b640 1 -- 172.21.15.37:0/2566358772 shutdown_connections 2024-09-19T06:06:17.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:17.540+0000 7f3f95c5b640 1 --2- 172.21.15.37:0/2566358772 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f90106f20 0x7f3f9010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:17.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:17.540+0000 7f3f95c5b640 1 --2- 172.21.15.37:0/2566358772 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f901027a0 0x7f3f901067f0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:17.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:17.540+0000 7f3f95c5b640 1 --2- 172.21.15.37:0/2566358772 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f90101df0 0x7f3f901021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:17.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:17.540+0000 7f3f95c5b640 1 -- 172.21.15.37:0/2566358772 >> 172.21.15.37:0/2566358772 conn(0x7f3f900fd8b0 msgr2=0x7f3f900ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:17.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:17.540+0000 7f3f95c5b640 1 -- 172.21.15.37:0/2566358772 shutdown_connections 2024-09-19T06:06:17.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:17.540+0000 7f3f95c5b640 1 -- 172.21.15.37:0/2566358772 wait complete. 2024-09-19T06:06:17.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:17.541+0000 7f3f95c5b640 1 Processor -- start 2024-09-19T06:06:17.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:17.541+0000 7f3f95c5b640 1 -- start start 2024-09-19T06:06:17.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:17.541+0000 7f3f95c5b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f90101df0 0x7f3f90198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:17.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:17.541+0000 7f3f95c5b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f901027a0 0x7f3f90198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:17.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:17.541+0000 7f3f95c5b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f90106f20 0x7f3f9019cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:17.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:17.541+0000 7f3f95c5b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3f90111fa0 con 0x7f3f90101df0 2024-09-19T06:06:17.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:17.541+0000 7f3f95c5b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f3f90111e20 con 0x7f3f901027a0 2024-09-19T06:06:17.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:17.541+0000 7f3f95c5b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3f90112120 con 0x7f3f90106f20 2024-09-19T06:06:17.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:17.542+0000 7f3f8f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f90101df0 0x7f3f90198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:17.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:17.542+0000 7f3f8f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f90101df0 0x7f3f90198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47088/0 (socket says 172.21.15.37:47088) 2024-09-19T06:06:17.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:17.542+0000 7f3f8f7fe640 1 -- 172.21.15.37:0/1113027580 learned_addr learned my addr 172.21.15.37:0/1113027580 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:06:17.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:17.542+0000 7f3f8effd640 1 --2- 172.21.15.37:0/1113027580 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f901027a0 0x7f3f90198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:17.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:17.542+0000 7f3f8f7fe640 1 -- 172.21.15.37:0/1113027580 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f90106f20 msgr2=0x7f3f9019cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:17.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:17.542+0000 7f3f8ffff640 1 --2- 172.21.15.37:0/1113027580 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f90106f20 0x7f3f9019cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:17.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:17.542+0000 7f3f8f7fe640 1 --2- 172.21.15.37:0/1113027580 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f90106f20 0x7f3f9019cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:17.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:17.542+0000 7f3f8f7fe640 1 -- 172.21.15.37:0/1113027580 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f901027a0 msgr2=0x7f3f90198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:17.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:17.542+0000 7f3f8f7fe640 1 --2- 172.21.15.37:0/1113027580 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f901027a0 0x7f3f90198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:17.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:17.542+0000 7f3f8f7fe640 1 -- 172.21.15.37:0/1113027580 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f9019d400 con 0x7f3f90101df0 2024-09-19T06:06:17.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:17.542+0000 7f3f8effd640 1 --2- 172.21.15.37:0/1113027580 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f901027a0 0x7f3f90198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:06:17.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:17.542+0000 7f3f8f7fe640 1 --2- 172.21.15.37:0/1113027580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f90101df0 0x7f3f90198450 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f3f8000c890 tx=0x7f3f8000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:17.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:17.542+0000 7f3f8cff9640 1 -- 172.21.15.37:0/1113027580 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f80004220 con 0x7f3f90101df0 2024-09-19T06:06:17.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:17.542+0000 7f3f95c5b640 1 -- 172.21.15.37:0/1113027580 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f9019d6f0 con 0x7f3f90101df0 2024-09-19T06:06:17.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:17.542+0000 7f3f8cff9640 1 -- 172.21.15.37:0/1113027580 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3f800043c0 con 0x7f3f90101df0 2024-09-19T06:06:17.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:17.542+0000 7f3f8cff9640 1 -- 172.21.15.37:0/1113027580 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f80004a00 con 0x7f3f90101df0 2024-09-19T06:06:17.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:17.542+0000 7f3f95c5b640 1 -- 172.21.15.37:0/1113027580 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f901a4fd0 con 0x7f3f90101df0 2024-09-19T06:06:17.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:17.544+0000 7f3f95c5b640 1 -- 172.21.15.37:0/1113027580 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f901021d0 con 0x7f3f90101df0 2024-09-19T06:06:17.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:17.545+0000 7f3f8cff9640 1 -- 172.21.15.37:0/1113027580 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f3f800079b0 con 0x7f3f90101df0 2024-09-19T06:06:17.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:17.545+0000 7f3f8cff9640 1 --2- 172.21.15.37:0/1113027580 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f3f780a3240 0x7f3f780a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:17.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:17.545+0000 7f3f8cff9640 1 -- 172.21.15.37:0/1113027580 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9121+0+0 (secure 0 0 0) 0x7f3f800cfa40 con 0x7f3f90101df0 2024-09-19T06:06:17.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:17.545+0000 7f3f8effd640 1 --2- 172.21.15.37:0/1113027580 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f3f780a3240 0x7f3f780a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:17.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:17.546+0000 7f3f8effd640 1 --2- 172.21.15.37:0/1113027580 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f3f780a3240 0x7f3f780a5700 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3f900fdcd0 tx=0x7f3f84005a20 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:17.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:17.550+0000 7f3f8cff9640 1 -- 172.21.15.37:0/1113027580 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3f80014030 con 0x7f3f90101df0 2024-09-19T06:06:17.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:17.766+0000 7f3f95c5b640 1 -- 172.21.15.37:0/1113027580 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3f9002d7c0 con 0x7f3f90101df0 2024-09-19T06:06:17.768 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:06:17 smithi037 ceph-mon[31211]: pgmap v353: 129 pgs: 129 active+clean; 644 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 1.1 KiB/s wr, 2 op/s 2024-09-19T06:06:17.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:17.766+0000 7f3f8cff9640 1 -- 172.21.15.37:0/1113027580 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11842 (secure 0 0 0) 0x7f3f8009c3e0 con 0x7f3f90101df0 2024-09-19T06:06:17.769 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T06:06:17.769 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"btime":"2024-09-19T06:04:42:531480+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14514,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2864247978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2864247978},{"type":"v1","addr":"172.21.15.37:6835","nonce":2864247978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14526,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/633000932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":633000932},{"type":"v1","addr":"172.21.15.37:6837","nonce":633000932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14574,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/3753800615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":3753800615},{"type":"v1","addr":"172.21.15.37:6839","nonce":3753800615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/2718998355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":2718998355},{"type":"v1","addr":"172.21.15.37:6841","nonce":2718998355}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6833/866590207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":866590207},{"type":"v1","addr":"172.21.15.99:6833","nonce":866590207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3898668400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3898668400},{"type":"v1","addr":"172.21.15.117:6833","nonce":3898668400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2650673320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2650673320},{"type":"v1","addr":"172.21.15.99:6835","nonce":2650673320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1097471349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1097471349},{"type":"v1","addr":"172.21.15.117:6835","nonce":1097471349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24457,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1001392672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1001392672},{"type":"v1","addr":"172.21.15.117:6837","nonce":1001392672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/23570935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":23570935},{"type":"v1","addr":"172.21.15.99:6837","nonce":23570935}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:04:06.253034+0000","modified":"2024-09-19T06:04:42.196783+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24485},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24478":{"gid":24478,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6839/1269518339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":1269518339},{"type":"v1","addr":"172.21.15.117:6839","nonce":1269518339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.99:6839/3404812329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":3404812329},{"type":"v1","addr":"172.21.15.99:6839","nonce":3404812329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24485,"qdb_cluster":[24485]},"id":1}]} 2024-09-19T06:06:17.769 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 20 2024-09-19T06:06:17.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:17.769+0000 7f3f95c5b640 1 -- 172.21.15.37:0/1113027580 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f3f780a3240 msgr2=0x7f3f780a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:17.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:17.769+0000 7f3f95c5b640 1 --2- 172.21.15.37:0/1113027580 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f3f780a3240 0x7f3f780a5700 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3f900fdcd0 tx=0x7f3f84005a20 comp rx=0 tx=0).stop 2024-09-19T06:06:17.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:17.769+0000 7f3f95c5b640 1 -- 172.21.15.37:0/1113027580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f90101df0 msgr2=0x7f3f90198450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:17.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:17.769+0000 7f3f95c5b640 1 --2- 172.21.15.37:0/1113027580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f90101df0 0x7f3f90198450 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f3f8000c890 tx=0x7f3f8000cd50 comp rx=0 tx=0).stop 2024-09-19T06:06:17.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:17.769+0000 7f3f95c5b640 1 -- 172.21.15.37:0/1113027580 shutdown_connections 2024-09-19T06:06:17.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:17.769+0000 7f3f95c5b640 1 --2- 172.21.15.37:0/1113027580 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f3f780a3240 0x7f3f780a5700 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:17.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:17.769+0000 7f3f95c5b640 1 --2- 172.21.15.37:0/1113027580 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f901027a0 0x7f3f90198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:17.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:17.769+0000 7f3f95c5b640 1 --2- 172.21.15.37:0/1113027580 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f90106f20 0x7f3f9019cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:17.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:17.769+0000 7f3f95c5b640 1 --2- 172.21.15.37:0/1113027580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f90101df0 0x7f3f90198450 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:17.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:17.769+0000 7f3f95c5b640 1 -- 172.21.15.37:0/1113027580 >> 172.21.15.37:0/1113027580 conn(0x7f3f900fd8b0 msgr2=0x7f3f900fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:17.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:17.769+0000 7f3f95c5b640 1 -- 172.21.15.37:0/1113027580 shutdown_connections 2024-09-19T06:06:17.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:17.769+0000 7f3f95c5b640 1 -- 172.21.15.37:0/1113027580 wait complete. 2024-09-19T06:06:17.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:06:17 smithi099 ceph-mon[35300]: pgmap v353: 129 pgs: 129 active+clean; 644 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 1.1 KiB/s wr, 2 op/s 2024-09-19T06:06:17.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:06:17 smithi117 ceph-mon[35050]: pgmap v353: 129 pgs: 129 active+clean; 644 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 1.1 KiB/s wr, 2 op/s 2024-09-19T06:06:18.554 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:06:18.819 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:06:18.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:06:18 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/1113027580' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:06:18.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:06:18 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/1113027580' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:06:19.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:06:18 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/1113027580' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:06:19.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:19.281+0000 7f5bab01b640 1 -- 172.21.15.37:0/2864880897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ba4100480 msgr2=0x7f5ba4100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:19.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:19.281+0000 7f5bab01b640 1 --2- 172.21.15.37:0/2864880897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ba4100480 0x7f5ba4100860 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f5b94009900 tx=0x7f5b9402a410 comp rx=0 tx=0).stop 2024-09-19T06:06:19.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:19.281+0000 7f5bab01b640 1 -- 172.21.15.37:0/2864880897 shutdown_connections 2024-09-19T06:06:19.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:19.281+0000 7f5bab01b640 1 --2- 172.21.15.37:0/2864880897 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ba4100e30 0x7f5ba4104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:19.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:19.281+0000 7f5bab01b640 1 --2- 172.21.15.37:0/2864880897 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ba41055b0 0x7f5ba410d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:19.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:19.281+0000 7f5bab01b640 1 --2- 172.21.15.37:0/2864880897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ba4100480 0x7f5ba4100860 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:19.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:19.281+0000 7f5bab01b640 1 -- 172.21.15.37:0/2864880897 >> 172.21.15.37:0/2864880897 conn(0x7f5ba4077210 msgr2=0x7f5ba40fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:19.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:19.281+0000 7f5bab01b640 1 -- 172.21.15.37:0/2864880897 shutdown_connections 2024-09-19T06:06:19.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:19.281+0000 7f5bab01b640 1 -- 172.21.15.37:0/2864880897 wait complete. 2024-09-19T06:06:19.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:19.282+0000 7f5bab01b640 1 Processor -- start 2024-09-19T06:06:19.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:19.282+0000 7f5bab01b640 1 -- start start 2024-09-19T06:06:19.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:19.282+0000 7f5bab01b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ba4100480 0x7f5ba41983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:19.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:19.282+0000 7f5bab01b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ba4100e30 0x7f5ba4198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:19.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:19.282+0000 7f5bab01b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ba41055b0 0x7f5ba419ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:19.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:19.282+0000 7f5bab01b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5ba4110600 con 0x7f5ba4100e30 2024-09-19T06:06:19.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:19.282+0000 7f5bab01b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f5ba4110480 con 0x7f5ba4100480 2024-09-19T06:06:19.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:19.282+0000 7f5bab01b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5ba4110780 con 0x7f5ba41055b0 2024-09-19T06:06:19.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:19.282+0000 7f5ba3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ba4100e30 0x7f5ba4198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:19.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:19.282+0000 7f5ba3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ba4100e30 0x7f5ba4198930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47114/0 (socket says 172.21.15.37:47114) 2024-09-19T06:06:19.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:19.282+0000 7f5ba3fff640 1 -- 172.21.15.37:0/1919852461 learned_addr learned my addr 172.21.15.37:0/1919852461 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:06:19.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:19.283+0000 7f5ba8db7640 1 --2- 172.21.15.37:0/1919852461 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ba4100480 0x7f5ba41983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:19.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:19.283+0000 7f5ba95b8640 1 --2- 172.21.15.37:0/1919852461 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ba41055b0 0x7f5ba419ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:19.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:19.283+0000 7f5ba3fff640 1 -- 172.21.15.37:0/1919852461 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ba41055b0 msgr2=0x7f5ba419ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:19.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:19.283+0000 7f5ba3fff640 1 --2- 172.21.15.37:0/1919852461 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ba41055b0 0x7f5ba419ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:19.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:19.283+0000 7f5ba3fff640 1 -- 172.21.15.37:0/1919852461 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ba4100480 msgr2=0x7f5ba41983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:19.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:19.283+0000 7f5ba3fff640 1 --2- 172.21.15.37:0/1919852461 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ba4100480 0x7f5ba41983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:19.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:19.283+0000 7f5ba3fff640 1 -- 172.21.15.37:0/1919852461 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ba419d3a0 con 0x7f5ba4100e30 2024-09-19T06:06:19.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:19.283+0000 7f5ba3fff640 1 --2- 172.21.15.37:0/1919852461 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ba4100e30 0x7f5ba4198930 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f5b9800c890 tx=0x7f5b9800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:19.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:19.283+0000 7f5ba1ffb640 1 -- 172.21.15.37:0/1919852461 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b98004220 con 0x7f5ba4100e30 2024-09-19T06:06:19.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:19.283+0000 7f5ba1ffb640 1 -- 172.21.15.37:0/1919852461 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b980043c0 con 0x7f5ba4100e30 2024-09-19T06:06:19.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:19.283+0000 7f5bab01b640 1 -- 172.21.15.37:0/1919852461 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ba419d690 con 0x7f5ba4100e30 2024-09-19T06:06:19.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:19.283+0000 7f5ba1ffb640 1 -- 172.21.15.37:0/1919852461 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b980049e0 con 0x7f5ba4100e30 2024-09-19T06:06:19.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:19.283+0000 7f5bab01b640 1 -- 172.21.15.37:0/1919852461 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ba41a4f70 con 0x7f5ba4100e30 2024-09-19T06:06:19.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:19.284+0000 7f5bab01b640 1 -- 172.21.15.37:0/1919852461 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ba4100860 con 0x7f5ba4100e30 2024-09-19T06:06:19.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:19.285+0000 7f5ba1ffb640 1 -- 172.21.15.37:0/1919852461 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f5b980079b0 con 0x7f5ba4100e30 2024-09-19T06:06:19.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:19.286+0000 7f5ba1ffb640 1 --2- 172.21.15.37:0/1919852461 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f5b8c0a3240 0x7f5b8c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:19.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:19.286+0000 7f5ba1ffb640 1 -- 172.21.15.37:0/1919852461 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9121+0+0 (secure 0 0 0) 0x7f5b980cfc40 con 0x7f5ba4100e30 2024-09-19T06:06:19.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:19.286+0000 7f5ba8db7640 1 --2- 172.21.15.37:0/1919852461 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f5b8c0a3240 0x7f5b8c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:19.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:19.287+0000 7f5ba8db7640 1 --2- 172.21.15.37:0/1919852461 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f5b8c0a3240 0x7f5b8c0a5700 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5b94000c00 tx=0x7f5b94005df0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:19.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:19.290+0000 7f5ba1ffb640 1 -- 172.21.15.37:0/1919852461 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5b98014030 con 0x7f5ba4100e30 2024-09-19T06:06:19.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:19.507+0000 7f5bab01b640 1 -- 172.21.15.37:0/1919852461 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5ba41a5260 con 0x7f5ba4100e30 2024-09-19T06:06:19.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:19.508+0000 7f5ba1ffb640 1 -- 172.21.15.37:0/1919852461 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11842 (secure 0 0 0) 0x7f5b9809bf90 con 0x7f5ba4100e30 2024-09-19T06:06:19.510 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T06:06:19.510 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"btime":"2024-09-19T06:04:42:531480+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14514,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2864247978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2864247978},{"type":"v1","addr":"172.21.15.37:6835","nonce":2864247978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14526,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/633000932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":633000932},{"type":"v1","addr":"172.21.15.37:6837","nonce":633000932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14574,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/3753800615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":3753800615},{"type":"v1","addr":"172.21.15.37:6839","nonce":3753800615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/2718998355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":2718998355},{"type":"v1","addr":"172.21.15.37:6841","nonce":2718998355}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6833/866590207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":866590207},{"type":"v1","addr":"172.21.15.99:6833","nonce":866590207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3898668400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3898668400},{"type":"v1","addr":"172.21.15.117:6833","nonce":3898668400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2650673320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2650673320},{"type":"v1","addr":"172.21.15.99:6835","nonce":2650673320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1097471349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1097471349},{"type":"v1","addr":"172.21.15.117:6835","nonce":1097471349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24457,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1001392672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1001392672},{"type":"v1","addr":"172.21.15.117:6837","nonce":1001392672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/23570935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":23570935},{"type":"v1","addr":"172.21.15.99:6837","nonce":23570935}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:04:06.253034+0000","modified":"2024-09-19T06:04:42.196783+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24485},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24478":{"gid":24478,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6839/1269518339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":1269518339},{"type":"v1","addr":"172.21.15.117:6839","nonce":1269518339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.99:6839/3404812329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":3404812329},{"type":"v1","addr":"172.21.15.99:6839","nonce":3404812329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24485,"qdb_cluster":[24485]},"id":1}]} 2024-09-19T06:06:19.510 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 20 2024-09-19T06:06:19.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:19.510+0000 7f5bab01b640 1 -- 172.21.15.37:0/1919852461 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f5b8c0a3240 msgr2=0x7f5b8c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:19.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:19.510+0000 7f5bab01b640 1 --2- 172.21.15.37:0/1919852461 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f5b8c0a3240 0x7f5b8c0a5700 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5b94000c00 tx=0x7f5b94005df0 comp rx=0 tx=0).stop 2024-09-19T06:06:19.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:19.510+0000 7f5bab01b640 1 -- 172.21.15.37:0/1919852461 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ba4100e30 msgr2=0x7f5ba4198930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:19.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:19.510+0000 7f5bab01b640 1 --2- 172.21.15.37:0/1919852461 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ba4100e30 0x7f5ba4198930 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f5b9800c890 tx=0x7f5b9800cd50 comp rx=0 tx=0).stop 2024-09-19T06:06:19.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:19.510+0000 7f5bab01b640 1 -- 172.21.15.37:0/1919852461 shutdown_connections 2024-09-19T06:06:19.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:19.510+0000 7f5bab01b640 1 --2- 172.21.15.37:0/1919852461 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f5b8c0a3240 0x7f5b8c0a5700 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:19.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:19.510+0000 7f5bab01b640 1 --2- 172.21.15.37:0/1919852461 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ba41055b0 0x7f5ba419ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:19.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:19.510+0000 7f5bab01b640 1 --2- 172.21.15.37:0/1919852461 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ba4100e30 0x7f5ba4198930 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:19.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:19.510+0000 7f5bab01b640 1 --2- 172.21.15.37:0/1919852461 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ba4100480 0x7f5ba41983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:19.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:19.510+0000 7f5bab01b640 1 -- 172.21.15.37:0/1919852461 >> 172.21.15.37:0/1919852461 conn(0x7f5ba4077210 msgr2=0x7f5ba4103460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:19.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:19.510+0000 7f5bab01b640 1 -- 172.21.15.37:0/1919852461 shutdown_connections 2024-09-19T06:06:19.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:19.510+0000 7f5bab01b640 1 -- 172.21.15.37:0/1919852461 wait complete. 2024-09-19T06:06:19.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:06:19 smithi037 ceph-mon[31211]: pgmap v354: 129 pgs: 129 active+clean; 644 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-09-19T06:06:19.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:06:19 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/1919852461' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:06:19.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:06:19 smithi099 ceph-mon[35300]: pgmap v354: 129 pgs: 129 active+clean; 644 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-09-19T06:06:19.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:06:19 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/1919852461' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:06:20.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:06:19 smithi117 ceph-mon[35050]: pgmap v354: 129 pgs: 129 active+clean; 644 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-09-19T06:06:20.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:06:19 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/1919852461' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:06:20.383 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T06:06:20.650 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:06:21.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:21.152+0000 7f529250d640 1 -- 172.21.15.37:0/3231399311 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f528c10c180 msgr2=0x7f528c10e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:21.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:21.152+0000 7f529250d640 1 --2- 172.21.15.37:0/3231399311 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f528c10c180 0x7f528c10e610 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f5284009ca0 tx=0x7f528402a950 comp rx=0 tx=0).stop 2024-09-19T06:06:21.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:21.152+0000 7f529250d640 1 -- 172.21.15.37:0/3231399311 shutdown_connections 2024-09-19T06:06:21.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:21.152+0000 7f529250d640 1 --2- 172.21.15.37:0/3231399311 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f528c10c180 0x7f528c10e610 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:21.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:21.152+0000 7f529250d640 1 --2- 172.21.15.37:0/3231399311 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f528c103700 0x7f528c10bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:21.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:21.152+0000 7f529250d640 1 --2- 172.21.15.37:0/3231399311 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f528c102de0 0x7f528c1031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:21.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:21.152+0000 7f529250d640 1 -- 172.21.15.37:0/3231399311 >> 172.21.15.37:0/3231399311 conn(0x7f528c0fc7a0 msgr2=0x7f528c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:21.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:21.152+0000 7f529250d640 1 -- 172.21.15.37:0/3231399311 shutdown_connections 2024-09-19T06:06:21.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:21.152+0000 7f529250d640 1 -- 172.21.15.37:0/3231399311 wait complete. 2024-09-19T06:06:21.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:21.153+0000 7f529250d640 1 Processor -- start 2024-09-19T06:06:21.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:21.153+0000 7f529250d640 1 -- start start 2024-09-19T06:06:21.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:21.153+0000 7f529250d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f528c102de0 0x7f528c19a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:21.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:21.153+0000 7f529250d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f528c103700 0x7f528c19ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:21.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:21.153+0000 7f529250d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f528c10c180 0x7f528c19eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:21.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:21.153+0000 7f529250d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f528c111f50 con 0x7f528c103700 2024-09-19T06:06:21.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:21.153+0000 7f529250d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f528c111dd0 con 0x7f528c102de0 2024-09-19T06:06:21.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:21.153+0000 7f529250d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f528c1120d0 con 0x7f528c10c180 2024-09-19T06:06:21.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:21.153+0000 7f528b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f528c103700 0x7f528c19ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:21.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:21.153+0000 7f528b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f528c103700 0x7f528c19ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47132/0 (socket says 172.21.15.37:47132) 2024-09-19T06:06:21.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:21.153+0000 7f528b7fe640 1 -- 172.21.15.37:0/2185607366 learned_addr learned my addr 172.21.15.37:0/2185607366 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:06:21.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:21.153+0000 7f528bfff640 1 --2- 172.21.15.37:0/2185607366 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f528c102de0 0x7f528c19a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:21.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:21.153+0000 7f5290aaa640 1 --2- 172.21.15.37:0/2185607366 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f528c10c180 0x7f528c19eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:21.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:21.154+0000 7f528b7fe640 1 -- 172.21.15.37:0/2185607366 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f528c10c180 msgr2=0x7f528c19eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:21.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:21.154+0000 7f528b7fe640 1 --2- 172.21.15.37:0/2185607366 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f528c10c180 0x7f528c19eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:21.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:21.154+0000 7f528b7fe640 1 -- 172.21.15.37:0/2185607366 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f528c102de0 msgr2=0x7f528c19a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:21.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:21.154+0000 7f528b7fe640 1 --2- 172.21.15.37:0/2185607366 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f528c102de0 0x7f528c19a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:21.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:21.154+0000 7f528b7fe640 1 -- 172.21.15.37:0/2185607366 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f528c19f5a0 con 0x7f528c103700 2024-09-19T06:06:21.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:21.154+0000 7f5290aaa640 1 --2- 172.21.15.37:0/2185607366 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f528c10c180 0x7f528c19eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:06:21.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:21.154+0000 7f528b7fe640 1 --2- 172.21.15.37:0/2185607366 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f528c103700 0x7f528c19ab30 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f528000d770 tx=0x7f528000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:21.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:21.154+0000 7f52897fa640 1 -- 172.21.15.37:0/2185607366 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5280017070 con 0x7f528c103700 2024-09-19T06:06:21.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:21.154+0000 7f529250d640 1 -- 172.21.15.37:0/2185607366 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f528c19f890 con 0x7f528c103700 2024-09-19T06:06:21.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:21.154+0000 7f52897fa640 1 -- 172.21.15.37:0/2185607366 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5280005500 con 0x7f528c103700 2024-09-19T06:06:21.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:21.154+0000 7f52897fa640 1 -- 172.21.15.37:0/2185607366 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5280004e00 con 0x7f528c103700 2024-09-19T06:06:21.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:21.154+0000 7f529250d640 1 -- 172.21.15.37:0/2185607366 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f528c1a7170 con 0x7f528c103700 2024-09-19T06:06:21.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:21.155+0000 7f529250d640 1 -- 172.21.15.37:0/2185607366 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f528c1031c0 con 0x7f528c103700 2024-09-19T06:06:21.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:21.156+0000 7f52897fa640 1 -- 172.21.15.37:0/2185607366 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f5280004fa0 con 0x7f528c103700 2024-09-19T06:06:21.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:21.157+0000 7f52897fa640 1 --2- 172.21.15.37:0/2185607366 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f52740a3240 0x7f52740a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:21.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:21.157+0000 7f528bfff640 1 --2- 172.21.15.37:0/2185607366 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f52740a3240 0x7f52740a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:21.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:21.157+0000 7f52897fa640 1 -- 172.21.15.37:0/2185607366 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9121+0+0 (secure 0 0 0) 0x7f52800cfa90 con 0x7f528c103700 2024-09-19T06:06:21.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:21.158+0000 7f528bfff640 1 --2- 172.21.15.37:0/2185607366 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f52740a3240 0x7f52740a5700 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f527c00bbe0 tx=0x7f527c00b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:21.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:21.160+0000 7f52897fa640 1 -- 172.21.15.37:0/2185607366 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f528009c430 con 0x7f528c103700 2024-09-19T06:06:21.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:21.337+0000 7f529250d640 1 -- 172.21.15.37:0/2185607366 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f528c1a7410 con 0x7f528c103700 2024-09-19T06:06:21.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:21.339+0000 7f52897fa640 1 -- 172.21.15.37:0/2185607366 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+24772 (secure 0 0 0) 0x7f528009bd30 con 0x7f528c103700 2024-09-19T06:06:21.341 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T06:06:21.342 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":91,"fsid":"b8c8bdae-764b-11ef-bceb-c7b262605968","created":"2024-09-19T05:56:22.523060+0000","modified":"2024-09-19T06:06:14.642042+0000","last_up_change":"2024-09-19T06:03:12.771014+0000","last_in_change":"2024-09-19T06:02:49.926626+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:59:27.062607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:04:01.918234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:04:04.392543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T06:04:10.877951+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"455bc11d-2b6e-4a0c-90d9-8ab4ef4f9e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1783875173},{"type":"v1","addr":"172.21.15.37:6803","nonce":1783875173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1783875173},{"type":"v1","addr":"172.21.15.37:6805","nonce":1783875173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1783875173},{"type":"v1","addr":"172.21.15.37:6809","nonce":1783875173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1783875173},{"type":"v1","addr":"172.21.15.37:6807","nonce":1783875173}]},"public_addr":"172.21.15.37:6803/1783875173","cluster_addr":"172.21.15.37:6805/1783875173","heartbeat_back_addr":"172.21.15.37:6809/1783875173","heartbeat_front_addr":"172.21.15.37:6807/1783875173","state":["exists","up"]},{"osd":1,"uuid":"3505c162-c342-479d-8ea2-15b7a9d625cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":3414373360},{"type":"v1","addr":"172.21.15.99:6801","nonce":3414373360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":3414373360},{"type":"v1","addr":"172.21.15.99:6803","nonce":3414373360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":3414373360},{"type":"v1","addr":"172.21.15.99:6807","nonce":3414373360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":3414373360},{"type":"v1","addr":"172.21.15.99:6805","nonce":3414373360}]},"public_addr":"172.21.15.99:6801/3414373360","cluster_addr":"172.21.15.99:6803/3414373360","heartbeat_back_addr":"172.21.15.99:6807/3414373360","heartbeat_front_addr":"172.21.15.99:6805/3414373360","state":["exists","up"]},{"osd":2,"uuid":"736ec67f-b5e7-43f0-9303-0c88878ead6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3794943081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3794943081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3794943081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3794943081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3794943081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3794943081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3794943081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3794943081}]},"public_addr":"172.21.15.117:6801/3794943081","cluster_addr":"172.21.15.117:6803/3794943081","heartbeat_back_addr":"172.21.15.117:6807/3794943081","heartbeat_front_addr":"172.21.15.117:6805/3794943081","state":["exists","up"]},{"osd":3,"uuid":"3f784ef7-0cc1-4c86-a03a-b8f13396c835","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2121011955},{"type":"v1","addr":"172.21.15.37:6811","nonce":2121011955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2121011955},{"type":"v1","addr":"172.21.15.37:6813","nonce":2121011955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2121011955},{"type":"v1","addr":"172.21.15.37:6817","nonce":2121011955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2121011955},{"type":"v1","addr":"172.21.15.37:6815","nonce":2121011955}]},"public_addr":"172.21.15.37:6811/2121011955","cluster_addr":"172.21.15.37:6813/2121011955","heartbeat_back_addr":"172.21.15.37:6817/2121011955","heartbeat_front_addr":"172.21.15.37:6815/2121011955","state":["exists","up"]},{"osd":4,"uuid":"d7c16e7f-f599-419b-b4a2-fd6c1cafa0d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":1881025735},{"type":"v1","addr":"172.21.15.99:6809","nonce":1881025735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1881025735},{"type":"v1","addr":"172.21.15.99:6811","nonce":1881025735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1881025735},{"type":"v1","addr":"172.21.15.99:6815","nonce":1881025735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":1881025735},{"type":"v1","addr":"172.21.15.99:6813","nonce":1881025735}]},"public_addr":"172.21.15.99:6809/1881025735","cluster_addr":"172.21.15.99:6811/1881025735","heartbeat_back_addr":"172.21.15.99:6815/1881025735","heartbeat_front_addr":"172.21.15.99:6813/1881025735","state":["exists","up"]},{"osd":5,"uuid":"2f499ab4-3d09-4f96-a709-b4229865c690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1141976511},{"type":"v1","addr":"172.21.15.117:6809","nonce":1141976511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1141976511},{"type":"v1","addr":"172.21.15.117:6811","nonce":1141976511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1141976511},{"type":"v1","addr":"172.21.15.117:6815","nonce":1141976511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1141976511},{"type":"v1","addr":"172.21.15.117:6813","nonce":1141976511}]},"public_addr":"172.21.15.117:6809/1141976511","cluster_addr":"172.21.15.117:6811/1141976511","heartbeat_back_addr":"172.21.15.117:6815/1141976511","heartbeat_front_addr":"172.21.15.117:6813/1141976511","state":["exists","up"]},{"osd":6,"uuid":"10f7fd72-1ae8-4efd-a448-75f4b5054be3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":770433145},{"type":"v1","addr":"172.21.15.37:6819","nonce":770433145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":770433145},{"type":"v1","addr":"172.21.15.37:6821","nonce":770433145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":770433145},{"type":"v1","addr":"172.21.15.37:6825","nonce":770433145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":770433145},{"type":"v1","addr":"172.21.15.37:6823","nonce":770433145}]},"public_addr":"172.21.15.37:6819/770433145","cluster_addr":"172.21.15.37:6821/770433145","heartbeat_back_addr":"172.21.15.37:6825/770433145","heartbeat_front_addr":"172.21.15.37:6823/770433145","state":["exists","up"]},{"osd":7,"uuid":"7199a267-c486-417c-b530-3ff03fc9eb1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1694360992},{"type":"v1","addr":"172.21.15.99:6817","nonce":1694360992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1694360992},{"type":"v1","addr":"172.21.15.99:6819","nonce":1694360992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":1694360992},{"type":"v1","addr":"172.21.15.99:6823","nonce":1694360992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":1694360992},{"type":"v1","addr":"172.21.15.99:6821","nonce":1694360992}]},"public_addr":"172.21.15.99:6817/1694360992","cluster_addr":"172.21.15.99:6819/1694360992","heartbeat_back_addr":"172.21.15.99:6823/1694360992","heartbeat_front_addr":"172.21.15.99:6821/1694360992","state":["exists","up"]},{"osd":8,"uuid":"8d5bb83c-62eb-4ded-8a16-e8d57ab102c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2005866772},{"type":"v1","addr":"172.21.15.117:6817","nonce":2005866772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2005866772},{"type":"v1","addr":"172.21.15.117:6819","nonce":2005866772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2005866772},{"type":"v1","addr":"172.21.15.117:6823","nonce":2005866772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2005866772},{"type":"v1","addr":"172.21.15.117:6821","nonce":2005866772}]},"public_addr":"172.21.15.117:6817/2005866772","cluster_addr":"172.21.15.117:6819/2005866772","heartbeat_back_addr":"172.21.15.117:6823/2005866772","heartbeat_front_addr":"172.21.15.117:6821/2005866772","state":["exists","up"]},{"osd":9,"uuid":"04b6203d-a10c-4a55-8e59-b30012dee02b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1398779376},{"type":"v1","addr":"172.21.15.37:6827","nonce":1398779376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1398779376},{"type":"v1","addr":"172.21.15.37:6829","nonce":1398779376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1398779376},{"type":"v1","addr":"172.21.15.37:6833","nonce":1398779376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1398779376},{"type":"v1","addr":"172.21.15.37:6831","nonce":1398779376}]},"public_addr":"172.21.15.37:6827/1398779376","cluster_addr":"172.21.15.37:6829/1398779376","heartbeat_back_addr":"172.21.15.37:6833/1398779376","heartbeat_front_addr":"172.21.15.37:6831/1398779376","state":["exists","up"]},{"osd":10,"uuid":"bbf8ff4b-29cd-4d56-a30e-ff2de3555f78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2200957302},{"type":"v1","addr":"172.21.15.99:6825","nonce":2200957302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2200957302},{"type":"v1","addr":"172.21.15.99:6827","nonce":2200957302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2200957302},{"type":"v1","addr":"172.21.15.99:6831","nonce":2200957302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2200957302},{"type":"v1","addr":"172.21.15.99:6829","nonce":2200957302}]},"public_addr":"172.21.15.99:6825/2200957302","cluster_addr":"172.21.15.99:6827/2200957302","heartbeat_back_addr":"172.21.15.99:6831/2200957302","heartbeat_front_addr":"172.21.15.99:6829/2200957302","state":["exists","up"]},{"osd":11,"uuid":"041d54f4-a274-47b5-a467-0ce86efd363b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":1354423136},{"type":"v1","addr":"172.21.15.117:6825","nonce":1354423136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":1354423136},{"type":"v1","addr":"172.21.15.117:6827","nonce":1354423136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":1354423136},{"type":"v1","addr":"172.21.15.117:6831","nonce":1354423136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":1354423136},{"type":"v1","addr":"172.21.15.117:6829","nonce":1354423136}]},"public_addr":"172.21.15.117:6825/1354423136","cluster_addr":"172.21.15.117:6827/1354423136","heartbeat_back_addr":"172.21.15.117:6831/1354423136","heartbeat_front_addr":"172.21.15.117:6829/1354423136","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:58:33.697099+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:58:59.641549+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:59:23.811178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:59:49.550214+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:00:15.034610+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:00:39.399651+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:01:05.106379+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:01:30.375956+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:01:54.881549+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:02:21.519316+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:02:46.125918+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:03:11.310862+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.f","mappings":[{"from":9,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6801/133577710":"2024-09-20T05:57:12.560771+0000","172.21.15.37:6800/133577710":"2024-09-20T05:57:12.560771+0000","172.21.15.37:0/2877363162":"2024-09-20T05:57:12.560771+0000","172.21.15.37:0/1053171617":"2024-09-20T05:57:12.560771+0000","172.21.15.37:6800/3277805697":"2024-09-20T05:56:49.335334+0000","172.21.15.37:0/1280697705":"2024-09-20T05:56:49.335334+0000","172.21.15.37:0/1106526058":"2024-09-20T05:57:12.560771+0000","172.21.15.37:0/1978184693":"2024-09-20T05:56:49.335334+0000","172.21.15.37:6801/3277805697":"2024-09-20T05:56:49.335334+0000","172.21.15.37:0/3650338877":"2024-09-20T05:56:49.335334+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:06:21.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:21.341+0000 7f529250d640 1 -- 172.21.15.37:0/2185607366 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f52740a3240 msgr2=0x7f52740a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:21.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:21.341+0000 7f529250d640 1 --2- 172.21.15.37:0/2185607366 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f52740a3240 0x7f52740a5700 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f527c00bbe0 tx=0x7f527c00b390 comp rx=0 tx=0).stop 2024-09-19T06:06:21.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:21.341+0000 7f529250d640 1 -- 172.21.15.37:0/2185607366 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f528c103700 msgr2=0x7f528c19ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:21.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:21.341+0000 7f529250d640 1 --2- 172.21.15.37:0/2185607366 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f528c103700 0x7f528c19ab30 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f528000d770 tx=0x7f528000dc30 comp rx=0 tx=0).stop 2024-09-19T06:06:21.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:21.341+0000 7f529250d640 1 -- 172.21.15.37:0/2185607366 shutdown_connections 2024-09-19T06:06:21.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:21.341+0000 7f529250d640 1 --2- 172.21.15.37:0/2185607366 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f52740a3240 0x7f52740a5700 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:21.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:21.341+0000 7f529250d640 1 --2- 172.21.15.37:0/2185607366 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f528c10c180 0x7f528c19eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:21.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:21.341+0000 7f529250d640 1 --2- 172.21.15.37:0/2185607366 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f528c103700 0x7f528c19ab30 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:21.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:21.341+0000 7f529250d640 1 --2- 172.21.15.37:0/2185607366 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f528c102de0 0x7f528c19a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:21.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:21.341+0000 7f529250d640 1 -- 172.21.15.37:0/2185607366 >> 172.21.15.37:0/2185607366 conn(0x7f528c0fc7a0 msgr2=0x7f528c100970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:21.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:21.341+0000 7f529250d640 1 -- 172.21.15.37:0/2185607366 shutdown_connections 2024-09-19T06:06:21.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:21.341+0000 7f529250d640 1 -- 172.21.15.37:0/2185607366 wait complete. 2024-09-19T06:06:21.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:06:21 smithi117 ceph-mon[35050]: pgmap v355: 129 pgs: 129 active+clean; 644 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-09-19T06:06:22.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:06:21 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/2185607366' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:06:22.010 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:06:21 smithi037 ceph-mon[31211]: pgmap v355: 129 pgs: 129 active+clean; 644 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-09-19T06:06:22.010 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:06:21 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/2185607366' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:06:22.040 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph daemon mon.a --format=json config get run_dir 2024-09-19T06:06:22.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:06:21 smithi099 ceph-mon[35300]: pgmap v355: 129 pgs: 129 active+clean; 644 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-09-19T06:06:22.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:06:21 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/2185607366' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:06:22.296 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:06:23.510 INFO:teuthology.orchestra.run.smithi037.stdout:{"run_dir":"/var/run/ceph"} 2024-09-19T06:06:23.511 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-09-19T06:06:23.511 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 1747 2024-09-19T06:06:23.511 DEBUG:tasks.quiescer:Yielding 2024-09-19T06:06:23.512 INFO:teuthology.run_tasks:Running task workunit... 2024-09-19T06:06:23.525 INFO:tasks.workunit:Pulling workunits from ref 6fad5dd73c93545e52f57f681e140a9c3529c11e 2024-09-19T06:06:23.526 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-19T06:06:23.526 INFO:tasks.workunit:timeout=6h 2024-09-19T06:06:23.526 INFO:tasks.workunit:cleanup=True 2024-09-19T06:06:23.526 DEBUG:teuthology.orchestra.run.smithi037:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-19T06:06:23.527 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:06:23.546 INFO:teuthology.orchestra.run.smithi037.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-19T06:06:23.546 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-19T06:06:23.546 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 78h/120d Inode: 1099511628283 Links: 2 2024-09-19T06:06:23.546 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T06:06:23.546 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-19T06:06:23.546 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2024-09-19 06:04:49.875733054 +0000 2024-09-19T06:06:23.546 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-09-19 06:04:49.875733054 +0000 2024-09-19T06:06:23.546 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-09-19 06:06:11.419592410 +0000 2024-09-19T06:06:23.547 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2024-09-19 06:04:49.875733054 +0000 2024-09-19T06:06:23.547 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-19T06:06:23.547 DEBUG:teuthology.orchestra.run.smithi037:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-19T06:06:23.618 DEBUG:teuthology.orchestra.run.smithi037:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6fad5dd73c93545e52f57f681e140a9c3529c11e 2024-09-19T06:06:23.674 INFO:tasks.workunit.client.0.smithi037.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-19T06:06:23.797 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:06:23.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:06:23 smithi117 ceph-mon[35050]: pgmap v356: 129 pgs: 129 active+clean; 644 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 566 B/s rd, 113 B/s wr, 1 op/s 2024-09-19T06:06:24.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:06:23 smithi037 ceph-mon[31211]: pgmap v356: 129 pgs: 129 active+clean; 644 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 566 B/s rd, 113 B/s wr, 1 op/s 2024-09-19T06:06:24.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:06:23 smithi099 ceph-mon[35300]: pgmap v356: 129 pgs: 129 active+clean; 644 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 566 B/s rd, 113 B/s wr, 1 op/s 2024-09-19T06:06:24.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:24.304+0000 7f4e19ad6640 1 -- 172.21.15.37:0/1670261456 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e14102ef0 msgr2=0x7f4e1410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:24.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:24.304+0000 7f4e19ad6640 1 --2- 172.21.15.37:0/1670261456 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e14102ef0 0x7f4e1410da40 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c009ca0 tx=0x7f4e0c02a950 comp rx=0 tx=0).stop 2024-09-19T06:06:24.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:24.304+0000 7f4e19ad6640 1 -- 172.21.15.37:0/1670261456 shutdown_connections 2024-09-19T06:06:24.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:24.304+0000 7f4e19ad6640 1 --2- 172.21.15.37:0/1670261456 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e14102ef0 0x7f4e1410da40 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:24.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:24.304+0000 7f4e19ad6640 1 --2- 172.21.15.37:0/1670261456 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e14102570 0x7f4e141029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:24.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:24.304+0000 7f4e19ad6640 1 --2- 172.21.15.37:0/1670261456 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e14100e20 0x7f4e14101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:24.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:24.304+0000 7f4e19ad6640 1 -- 172.21.15.37:0/1670261456 >> 172.21.15.37:0/1670261456 conn(0x7f4e140fc7d0 msgr2=0x7f4e140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:24.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:24.304+0000 7f4e19ad6640 1 -- 172.21.15.37:0/1670261456 shutdown_connections 2024-09-19T06:06:24.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:24.304+0000 7f4e19ad6640 1 -- 172.21.15.37:0/1670261456 wait complete. 2024-09-19T06:06:24.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:24.305+0000 7f4e19ad6640 1 Processor -- start 2024-09-19T06:06:24.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:24.305+0000 7f4e19ad6640 1 -- start start 2024-09-19T06:06:24.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:24.305+0000 7f4e19ad6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e14100e20 0x7f4e14199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:24.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:24.305+0000 7f4e19ad6640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e14102570 0x7f4e14199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:24.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:24.305+0000 7f4e19ad6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e14102ef0 0x7f4e141a4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:24.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:24.305+0000 7f4e19ad6640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4e14110fa0 con 0x7f4e14102ef0 2024-09-19T06:06:24.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:24.305+0000 7f4e19ad6640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f4e14110e20 con 0x7f4e14102570 2024-09-19T06:06:24.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:24.305+0000 7f4e19ad6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4e14111120 con 0x7f4e14100e20 2024-09-19T06:06:24.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:24.305+0000 7f4e13fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e14102ef0 0x7f4e141a4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:24.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:24.305+0000 7f4e13fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e14102ef0 0x7f4e141a4390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35736/0 (socket says 172.21.15.37:35736) 2024-09-19T06:06:24.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:24.305+0000 7f4e13fff640 1 -- 172.21.15.37:0/2322030214 learned_addr learned my addr 172.21.15.37:0/2322030214 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:06:24.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:24.305+0000 7f4e12ffd640 1 --2- 172.21.15.37:0/2322030214 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e14102570 0x7f4e14199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:24.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:24.305+0000 7f4e137fe640 1 --2- 172.21.15.37:0/2322030214 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e14100e20 0x7f4e14199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:24.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:24.306+0000 7f4e13fff640 1 -- 172.21.15.37:0/2322030214 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e14100e20 msgr2=0x7f4e14199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:24.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:24.306+0000 7f4e13fff640 1 --2- 172.21.15.37:0/2322030214 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e14100e20 0x7f4e14199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:24.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:24.306+0000 7f4e13fff640 1 -- 172.21.15.37:0/2322030214 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e14102570 msgr2=0x7f4e14199850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:24.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:24.306+0000 7f4e13fff640 1 --2- 172.21.15.37:0/2322030214 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e14102570 0x7f4e14199850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:24.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:24.306+0000 7f4e13fff640 1 -- 172.21.15.37:0/2322030214 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e141a48d0 con 0x7f4e14102ef0 2024-09-19T06:06:24.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:24.306+0000 7f4e12ffd640 1 --2- 172.21.15.37:0/2322030214 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e14102570 0x7f4e14199850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:06:24.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:24.306+0000 7f4e13fff640 1 --2- 172.21.15.37:0/2322030214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e14102ef0 0x7f4e141a4390 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c02ae70 tx=0x7f4e0c02f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:24.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:24.306+0000 7f4e10ff9640 1 -- 172.21.15.37:0/2322030214 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c034040 con 0x7f4e14102ef0 2024-09-19T06:06:24.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:24.306+0000 7f4e10ff9640 1 -- 172.21.15.37:0/2322030214 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4e0c030920 con 0x7f4e14102ef0 2024-09-19T06:06:24.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:24.306+0000 7f4e10ff9640 1 -- 172.21.15.37:0/2322030214 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c0047f0 con 0x7f4e14102ef0 2024-09-19T06:06:24.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:24.306+0000 7f4e19ad6640 1 -- 172.21.15.37:0/2322030214 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e14197100 con 0x7f4e14102ef0 2024-09-19T06:06:24.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:24.306+0000 7f4e19ad6640 1 -- 172.21.15.37:0/2322030214 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e14197580 con 0x7f4e14102ef0 2024-09-19T06:06:24.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:24.307+0000 7f4e19ad6640 1 -- 172.21.15.37:0/2322030214 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e14101200 con 0x7f4e14102ef0 2024-09-19T06:06:24.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:24.309+0000 7f4e10ff9640 1 -- 172.21.15.37:0/2322030214 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f4e0c037020 con 0x7f4e14102ef0 2024-09-19T06:06:24.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:24.309+0000 7f4e10ff9640 1 --2- 172.21.15.37:0/2322030214 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f4dfc0a3240 0x7f4dfc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:24.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:24.309+0000 7f4e10ff9640 1 -- 172.21.15.37:0/2322030214 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9121+0+0 (secure 0 0 0) 0x7f4e0c0f0b60 con 0x7f4e14102ef0 2024-09-19T06:06:24.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:24.310+0000 7f4e137fe640 1 --2- 172.21.15.37:0/2322030214 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f4dfc0a3240 0x7f4dfc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:24.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:24.310+0000 7f4e137fe640 1 --2- 172.21.15.37:0/2322030214 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f4dfc0a3240 0x7f4dfc0a5700 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4e040092a0 tx=0x7f4e0400f7a0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:24.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:24.315+0000 7f4e10ff9640 1 -- 172.21.15.37:0/2322030214 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4e0c0bd590 con 0x7f4e14102ef0 2024-09-19T06:06:24.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:24.528+0000 7f4e19ad6640 1 -- 172.21.15.37:0/2322030214 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4e141977e0 con 0x7f4e14102ef0 2024-09-19T06:06:24.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:24.528+0000 7f4e10ff9640 1 -- 172.21.15.37:0/2322030214 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11842 (secure 0 0 0) 0x7f4e0c0bce90 con 0x7f4e14102ef0 2024-09-19T06:06:24.531 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T06:06:24.531 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"btime":"2024-09-19T06:04:42:531480+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14514,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2864247978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2864247978},{"type":"v1","addr":"172.21.15.37:6835","nonce":2864247978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14526,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/633000932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":633000932},{"type":"v1","addr":"172.21.15.37:6837","nonce":633000932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14574,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/3753800615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":3753800615},{"type":"v1","addr":"172.21.15.37:6839","nonce":3753800615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/2718998355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":2718998355},{"type":"v1","addr":"172.21.15.37:6841","nonce":2718998355}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6833/866590207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":866590207},{"type":"v1","addr":"172.21.15.99:6833","nonce":866590207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3898668400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3898668400},{"type":"v1","addr":"172.21.15.117:6833","nonce":3898668400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2650673320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2650673320},{"type":"v1","addr":"172.21.15.99:6835","nonce":2650673320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1097471349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1097471349},{"type":"v1","addr":"172.21.15.117:6835","nonce":1097471349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24457,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1001392672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1001392672},{"type":"v1","addr":"172.21.15.117:6837","nonce":1001392672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/23570935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":23570935},{"type":"v1","addr":"172.21.15.99:6837","nonce":23570935}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:04:06.253034+0000","modified":"2024-09-19T06:04:42.196783+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24485},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24478":{"gid":24478,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6839/1269518339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":1269518339},{"type":"v1","addr":"172.21.15.117:6839","nonce":1269518339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.99:6839/3404812329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":3404812329},{"type":"v1","addr":"172.21.15.99:6839","nonce":3404812329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24485,"qdb_cluster":[24485]},"id":1}]} 2024-09-19T06:06:24.531 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 20 2024-09-19T06:06:24.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:24.531+0000 7f4e19ad6640 1 -- 172.21.15.37:0/2322030214 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f4dfc0a3240 msgr2=0x7f4dfc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:24.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:24.531+0000 7f4e19ad6640 1 --2- 172.21.15.37:0/2322030214 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f4dfc0a3240 0x7f4dfc0a5700 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4e040092a0 tx=0x7f4e0400f7a0 comp rx=0 tx=0).stop 2024-09-19T06:06:24.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:24.531+0000 7f4e19ad6640 1 -- 172.21.15.37:0/2322030214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e14102ef0 msgr2=0x7f4e141a4390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:24.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:24.531+0000 7f4e19ad6640 1 --2- 172.21.15.37:0/2322030214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e14102ef0 0x7f4e141a4390 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c02ae70 tx=0x7f4e0c02f5d0 comp rx=0 tx=0).stop 2024-09-19T06:06:24.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:24.531+0000 7f4e19ad6640 1 -- 172.21.15.37:0/2322030214 shutdown_connections 2024-09-19T06:06:24.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:24.531+0000 7f4e19ad6640 1 --2- 172.21.15.37:0/2322030214 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f4dfc0a3240 0x7f4dfc0a5700 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:24.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:24.531+0000 7f4e19ad6640 1 --2- 172.21.15.37:0/2322030214 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e14102570 0x7f4e14199850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:24.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:24.531+0000 7f4e19ad6640 1 --2- 172.21.15.37:0/2322030214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e14102ef0 0x7f4e141a4390 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:24.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:24.531+0000 7f4e19ad6640 1 --2- 172.21.15.37:0/2322030214 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e14100e20 0x7f4e14199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:24.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:24.531+0000 7f4e19ad6640 1 -- 172.21.15.37:0/2322030214 >> 172.21.15.37:0/2322030214 conn(0x7f4e140fc7d0 msgr2=0x7f4e14106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:24.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:24.531+0000 7f4e19ad6640 1 -- 172.21.15.37:0/2322030214 shutdown_connections 2024-09-19T06:06:24.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:24.531+0000 7f4e19ad6640 1 -- 172.21.15.37:0/2322030214 wait complete. 2024-09-19T06:06:24.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:06:24 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/2322030214' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:06:24.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:06:24 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/2322030214' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:06:25.090 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:06:24 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/2322030214' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:06:25.234 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 20, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T06:04:06.253034+0000', 'modified': '2024-09-19T06:04:42.196783+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24485}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24478': {'gid': 24478, 'name': 'i', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.117:6839/1269518339', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6838', 'nonce': 1269518339}, {'type': 'v1', 'addr': '172.21.15.117:6839', 'nonce': 1269518339}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24485': {'gid': 24485, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.99:6839/3404812329', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6838', 'nonce': 3404812329}, {'type': 'v1', 'addr': '172.21.15.99:6839', 'nonce': 3404812329}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24485, 'qdb_cluster': [24485]} 2024-09-19T06:06:25.234 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-19T06:06:25.234 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-19T06:06:25.535 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:06:25.774 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:06:25 smithi037 ceph-mon[31211]: pgmap v357: 129 pgs: 129 active+clean; 644 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1020 B/s rd, 1 op/s 2024-09-19T06:06:25.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.990+0000 7f59f28b3640 1 -- 172.21.15.37:0/97538028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59ec102570 msgr2=0x7f59ec1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:25.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.990+0000 7f59f28b3640 1 --2- 172.21.15.37:0/97538028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59ec102570 0x7f59ec1029b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f59d4009900 tx=0x7f59d402a480 comp rx=0 tx=0).stop 2024-09-19T06:06:25.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.990+0000 7f59f28b3640 1 -- 172.21.15.37:0/97538028 shutdown_connections 2024-09-19T06:06:25.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.990+0000 7f59f28b3640 1 --2- 172.21.15.37:0/97538028 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59ec102ef0 0x7f59ec10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:25.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.990+0000 7f59f28b3640 1 --2- 172.21.15.37:0/97538028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59ec102570 0x7f59ec1029b0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:25.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.990+0000 7f59f28b3640 1 --2- 172.21.15.37:0/97538028 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59ec100e20 0x7f59ec101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:25.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.990+0000 7f59f28b3640 1 -- 172.21.15.37:0/97538028 >> 172.21.15.37:0/97538028 conn(0x7f59ec0fc7d0 msgr2=0x7f59ec0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:25.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.990+0000 7f59f28b3640 1 -- 172.21.15.37:0/97538028 shutdown_connections 2024-09-19T06:06:25.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.990+0000 7f59f28b3640 1 -- 172.21.15.37:0/97538028 wait complete. 2024-09-19T06:06:25.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.991+0000 7f59f28b3640 1 Processor -- start 2024-09-19T06:06:25.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.991+0000 7f59f28b3640 1 -- start start 2024-09-19T06:06:25.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.991+0000 7f59f28b3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59ec100e20 0x7f59ec198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:25.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.991+0000 7f59f28b3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59ec102570 0x7f59ec198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:25.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.991+0000 7f59f28b3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59ec102ef0 0x7f59ec19cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:25.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.991+0000 7f59f28b3640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f59ec110f80 con 0x7f59ec102ef0 2024-09-19T06:06:25.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.991+0000 7f59f28b3640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f59ec110e00 con 0x7f59ec102570 2024-09-19T06:06:25.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.991+0000 7f59f28b3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f59ec111100 con 0x7f59ec100e20 2024-09-19T06:06:25.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.991+0000 7f59f0e50640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59ec102ef0 0x7f59ec19cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:25.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.991+0000 7f59f0e50640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59ec102ef0 0x7f59ec19cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35750/0 (socket says 172.21.15.37:35750) 2024-09-19T06:06:25.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.991+0000 7f59f0e50640 1 -- 172.21.15.37:0/3271879004 learned_addr learned my addr 172.21.15.37:0/3271879004 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:06:25.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.991+0000 7f59ebfff640 1 --2- 172.21.15.37:0/3271879004 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59ec100e20 0x7f59ec198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:25.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.991+0000 7f59e3fff640 1 --2- 172.21.15.37:0/3271879004 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59ec102570 0x7f59ec198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:25.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.991+0000 7f59f0e50640 1 -- 172.21.15.37:0/3271879004 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59ec100e20 msgr2=0x7f59ec198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:25.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.991+0000 7f59f0e50640 1 --2- 172.21.15.37:0/3271879004 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59ec100e20 0x7f59ec198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:25.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.991+0000 7f59f0e50640 1 -- 172.21.15.37:0/3271879004 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59ec102570 msgr2=0x7f59ec198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:25.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.991+0000 7f59f0e50640 1 --2- 172.21.15.37:0/3271879004 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59ec102570 0x7f59ec198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:25.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.991+0000 7f59f0e50640 1 -- 172.21.15.37:0/3271879004 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59ec19d3c0 con 0x7f59ec102ef0 2024-09-19T06:06:25.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.991+0000 7f59ebfff640 1 --2- 172.21.15.37:0/3271879004 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59ec100e20 0x7f59ec198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:06:25.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.992+0000 7f59f0e50640 1 --2- 172.21.15.37:0/3271879004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59ec102ef0 0x7f59ec19cce0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f59e400cce0 tx=0x7f59e400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:25.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.992+0000 7f59e9ffb640 1 -- 172.21.15.37:0/3271879004 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e400f450 con 0x7f59ec102ef0 2024-09-19T06:06:25.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.992+0000 7f59e9ffb640 1 -- 172.21.15.37:0/3271879004 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f59e400fad0 con 0x7f59ec102ef0 2024-09-19T06:06:25.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.992+0000 7f59e9ffb640 1 -- 172.21.15.37:0/3271879004 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e4018c10 con 0x7f59ec102ef0 2024-09-19T06:06:25.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.992+0000 7f59f28b3640 1 -- 172.21.15.37:0/3271879004 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59ec19d6b0 con 0x7f59ec102ef0 2024-09-19T06:06:25.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.992+0000 7f59f28b3640 1 -- 172.21.15.37:0/3271879004 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59ec1a4f90 con 0x7f59ec102ef0 2024-09-19T06:06:26.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.994+0000 7f59e9ffb640 1 -- 172.21.15.37:0/3271879004 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f59e400f5f0 con 0x7f59ec102ef0 2024-09-19T06:06:26.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.994+0000 7f59f4c8c740 1 Processor -- start 2024-09-19T06:06:26.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.995+0000 7f59f4c8c740 1 -- start start 2024-09-19T06:06:26.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.995+0000 7f59f4c8c740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cb1aaf28b0 0x55cb1aaf2c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:26.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.995+0000 7f59f4c8c740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cb1aaf31d0 0x55cb1ab01a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:26.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.995+0000 7f59f4c8c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb1ab01fc0 0x55cb1ab043b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:26.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.995+0000 7f59f4c8c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55cb1aa59090 con 0x55cb1ab01fc0 2024-09-19T06:06:26.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.995+0000 7f59f4c8c740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55cb1aa00a70 con 0x55cb1aaf28b0 2024-09-19T06:06:26.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.995+0000 7f59f4c8c740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55cb1aa55050 con 0x55cb1aaf31d0 2024-09-19T06:06:26.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.995+0000 7f59e3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb1ab01fc0 0x55cb1ab043b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:26.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.995+0000 7f59e3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb1ab01fc0 0x55cb1ab043b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35760/0 (socket says 172.21.15.37:35760) 2024-09-19T06:06:26.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.995+0000 7f59e3fff640 1 -- 172.21.15.37:0/897474115 learned_addr learned my addr 172.21.15.37:0/897474115 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:06:26.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.995+0000 7f59e9ffb640 1 --2- 172.21.15.37:0/3271879004 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f59d80a3240 0x7f59d80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:26.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.995+0000 7f59ebfff640 1 --2- 172.21.15.37:0/897474115 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cb1aaf31d0 0x55cb1ab01a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:26.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.995+0000 7f59e3fff640 1 --2- 172.21.15.37:0/897474115 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cb1aaf28b0 0x55cb1aaf2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:26.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.995+0000 7f59f0e50640 1 --2- 172.21.15.37:0/3271879004 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f59d80a3240 0x7f59d80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:26.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.996+0000 7f59e3fff640 1 -- 172.21.15.37:0/897474115 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cb1aaf31d0 msgr2=0x55cb1ab01a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:06:26.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.996+0000 7f59e3fff640 1 --2- 172.21.15.37:0/897474115 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cb1aaf31d0 0x55cb1ab01a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:26.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.996+0000 7f59e3fff640 1 -- 172.21.15.37:0/897474115 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cb1aaf28b0 msgr2=0x55cb1aaf2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:06:26.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.996+0000 7f59e3fff640 1 --2- 172.21.15.37:0/897474115 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cb1aaf28b0 0x55cb1aaf2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:26.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.996+0000 7f59e3fff640 1 -- 172.21.15.37:0/897474115 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb1aa0d130 con 0x55cb1ab01fc0 2024-09-19T06:06:26.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.996+0000 7f59e9ffb640 1 -- 172.21.15.37:0/3271879004 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9121+0+0 (secure 0 0 0) 0x7f59e40d0400 con 0x7f59ec102ef0 2024-09-19T06:06:26.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.996+0000 7f59e3fff640 1 --2- 172.21.15.37:0/897474115 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb1ab01fc0 0x55cb1ab043b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f59d40314e0 tx=0x7f59d4005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a605c7a8f2f2045 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:26.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.996+0000 7f59f0e50640 1 --2- 172.21.15.37:0/3271879004 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f59d80a3240 0x7f59d80a5700 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f59e4070ae0 tx=0x7f59e4065040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:26.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.996+0000 7f59e27fc640 1 -- 172.21.15.37:0/897474115 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d4035050 con 0x55cb1ab01fc0 2024-09-19T06:06:26.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.996+0000 7f59e27fc640 1 -- 172.21.15.37:0/897474115 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f59d4031540 con 0x55cb1ab01fc0 2024-09-19T06:06:26.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.996+0000 7f59e27fc640 1 -- 172.21.15.37:0/897474115 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d403c6b0 con 0x55cb1ab01fc0 2024-09-19T06:06:26.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.997+0000 7f59f4c8c740 1 -- 172.21.15.37:0/897474115 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb1ab01fc0 msgr2=0x55cb1ab043b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:26.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.997+0000 7f59f4c8c740 1 --2- 172.21.15.37:0/897474115 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb1ab01fc0 0x55cb1ab043b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f59d40314e0 tx=0x7f59d4005b50 comp rx=0 tx=0).stop 2024-09-19T06:06:26.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.997+0000 7f59f4c8c740 1 -- 172.21.15.37:0/897474115 shutdown_connections 2024-09-19T06:06:26.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.997+0000 7f59f4c8c740 1 --2- 172.21.15.37:0/897474115 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb1ab01fc0 0x55cb1ab043b0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:26.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.997+0000 7f59f4c8c740 1 --2- 172.21.15.37:0/897474115 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cb1aaf31d0 0x55cb1ab01a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:26.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.997+0000 7f59f4c8c740 1 --2- 172.21.15.37:0/897474115 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cb1aaf28b0 0x55cb1aaf2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:26.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.997+0000 7f59f4c8c740 1 -- 172.21.15.37:0/897474115 >> 172.21.15.37:0/897474115 conn(0x55cb1aaeef60 msgr2=0x55cb1aaef340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:26.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.997+0000 7f59f4c8c740 1 -- 172.21.15.37:0/897474115 shutdown_connections 2024-09-19T06:06:26.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.997+0000 7f59f4c8c740 1 -- 172.21.15.37:0/897474115 wait complete. 2024-09-19T06:06:26.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.997+0000 7f59f4c8c740 1 -- start start 2024-09-19T06:06:26.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.998+0000 7f59f4c8c740 1 Processor -- start 2024-09-19T06:06:26.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.998+0000 7f59f4c8c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb1aaf28b0 0x55cb1ab01860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:26.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.998+0000 7f59f4c8c740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cb1aaf31d0 0x55cb1aafebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:26.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.998+0000 7f59f4c8c740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cb1ab01fc0 0x55cb1aaff0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:26.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.998+0000 7f59f4c8c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55cb1ab04b90 con 0x55cb1aaf28b0 2024-09-19T06:06:26.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.998+0000 7f59f4c8c740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55cb1aa13f20 con 0x55cb1ab01fc0 2024-09-19T06:06:26.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.998+0000 7f59f4c8c740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55cb1ab04d10 con 0x55cb1aaf31d0 2024-09-19T06:06:26.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.998+0000 7f59f4c8c740 10 client.0 _ll_register_callbacks cb 0x55cb1a9dd030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:06:26.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.998+0000 7f59e3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb1aaf28b0 0x55cb1ab01860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:26.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.998+0000 7f59e3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb1aaf28b0 0x55cb1ab01860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35776/0 (socket says 172.21.15.37:35776) 2024-09-19T06:06:26.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.998+0000 7f59e3fff640 1 -- 172.21.15.37:0/942187272 learned_addr learned my addr 172.21.15.37:0/942187272 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:06:26.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.998+0000 7f59ebfff640 1 --2- 172.21.15.37:0/942187272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cb1aaf31d0 0x55cb1aafebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:26.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.998+0000 7f59e3fff640 1 --2- 172.21.15.37:0/942187272 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cb1ab01fc0 0x55cb1aaff0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:26.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.998+0000 7f59e3fff640 1 -- 172.21.15.37:0/942187272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cb1aaf31d0 msgr2=0x55cb1aafebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:06:26.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.998+0000 7f59e3fff640 1 --2- 172.21.15.37:0/942187272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cb1aaf31d0 0x55cb1aafebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:26.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.998+0000 7f59e3fff640 1 -- 172.21.15.37:0/942187272 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cb1ab01fc0 msgr2=0x55cb1aaff0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:06:26.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.998+0000 7f59e3fff640 1 --2- 172.21.15.37:0/942187272 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cb1ab01fc0 0x55cb1aaff0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:26.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.998+0000 7f59e3fff640 1 -- 172.21.15.37:0/942187272 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb1a7ca2b0 con 0x55cb1aaf28b0 2024-09-19T06:06:26.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.999+0000 7f59e3fff640 1 --2- 172.21.15.37:0/942187272 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb1aaf28b0 0x55cb1ab01860 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f59d402a4c0 tx=0x7f59d40058b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18437a398b0d1ba9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:26.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.999+0000 7f59cb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-19T06:06:26.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.999+0000 7f59cb7fe640 1 -- 172.21.15.37:0/942187272 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d4055060 con 0x55cb1aaf28b0 2024-09-19T06:06:26.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.999+0000 7f59cb7fe640 1 -- 172.21.15.37:0/942187272 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9121+0+0 (secure 0 0 0) 0x7f59d4003cd0 con 0x55cb1aaf28b0 2024-09-19T06:06:26.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.999+0000 7f59f4c8c740 1 -- 172.21.15.37:0/942187272 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f59d4031540 con 0x55cb1aaf28b0 2024-09-19T06:06:26.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.999+0000 7f59cb7fe640 1 -- 172.21.15.37:0/942187272 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f59d405c050 con 0x55cb1aaf28b0 2024-09-19T06:06:26.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.999+0000 7f59f4c8c740 10 client.15180 fetch_fsmap learned FSMap version 20 2024-09-19T06:06:26.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.999+0000 7f59f4c8c740 1 -- 172.21.15.37:0/942187272 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55cb1ab10520 con 0x55cb1aaf28b0 2024-09-19T06:06:26.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.999+0000 7f59cb7fe640 1 -- 172.21.15.37:0/942187272 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f59d4031540 con 0x55cb1aaf28b0 2024-09-19T06:06:26.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:25.999+0000 7f59cb7fe640 1 -- 172.21.15.37:0/942187272 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 20) ==== 8338+0+0 (secure 0 0 0) 0x7f59d404d440 con 0x55cb1aaf28b0 2024-09-19T06:06:26.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.000+0000 7f59f4c8c740 10 client.15180 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:06:26.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.000+0000 7f59f4c8c740 10 client.15180 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T06:06:26.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.000+0000 7f59f4c8c740 20 client.15180 populate_metadata read hostname 'smithi037' 2024-09-19T06:06:26.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.000+0000 7f59f4c8c740 1 --2- 172.21.15.37:0/942187272 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x55cb1ab11870 0x55cb1ab13a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:26.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.000+0000 7f59f4c8c740 4 client.15180 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:06:26.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.000+0000 7f59f4c8c740 1 -- 172.21.15.37:0/942187272 --> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cb1aa66600 con 0x55cb1ab11870 2024-09-19T06:06:26.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.000+0000 7f59ebfff640 1 --2- 172.21.15.37:0/942187272 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x55cb1ab11870 0x55cb1ab13a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:26.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.001+0000 7f59ebfff640 1 --2- 172.21.15.37:0/942187272 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x55cb1ab11870 0x55cb1ab13a30 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80febfb7a5c331f server_cookie=9a3167155a0a366c in_seq=0 out_seq=0 2024-09-19T06:06:26.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.001+0000 7f59cb7fe640 10 client.15180 ms_handle_connect on v2:172.21.15.99:6838/3404812329 2024-09-19T06:06:26.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.001+0000 7f59cb7fe640 1 -- 172.21.15.37:0/942187272 <== mds.0 v2:172.21.15.99:6838/3404812329 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cb1aa66600 con 0x55cb1ab11870 2024-09-19T06:06:26.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.001+0000 7f59cb7fe640 10 client.15180 handle_command_reply: tid=0 2024-09-19T06:06:26.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.001+0000 7f59f4c8c740 1 client.15180 shutdown 2024-09-19T06:06:26.010 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:06:25 smithi117 ceph-mon[35050]: pgmap v357: 129 pgs: 129 active+clean; 644 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1020 B/s rd, 1 op/s 2024-09-19T06:06:26.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.002+0000 7f59f4c8c740 1 -- 172.21.15.37:0/942187272 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb1aaf28b0 msgr2=0x55cb1ab01860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:26.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.002+0000 7f59f4c8c740 1 --2- 172.21.15.37:0/942187272 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb1aaf28b0 0x55cb1ab01860 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f59d402a4c0 tx=0x7f59d40058b0 comp rx=0 tx=0).stop 2024-09-19T06:06:26.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.002+0000 7f59f4c8c740 1 -- 172.21.15.37:0/942187272 shutdown_connections 2024-09-19T06:06:26.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.002+0000 7f59f4c8c740 1 --2- 172.21.15.37:0/942187272 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x55cb1ab11870 0x55cb1ab13a30 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:26.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.002+0000 7f59f4c8c740 1 --2- 172.21.15.37:0/942187272 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cb1ab01fc0 0x55cb1aaff0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:26.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.002+0000 7f59f4c8c740 1 --2- 172.21.15.37:0/942187272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cb1aaf31d0 0x55cb1aafebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:26.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.002+0000 7f59f4c8c740 1 --2- 172.21.15.37:0/942187272 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb1aaf28b0 0x55cb1ab01860 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:26.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.002+0000 7f59cb7fe640 0 client.15180 ms_handle_reset on v2:172.21.15.99:6838/3404812329 2024-09-19T06:06:26.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.002+0000 7f59f4c8c740 1 -- 172.21.15.37:0/942187272 >> 172.21.15.37:0/942187272 conn(0x55cb1aaeef60 msgr2=0x55cb1aaf4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:26.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.002+0000 7f59f4c8c740 1 -- 172.21.15.37:0/942187272 shutdown_connections 2024-09-19T06:06:26.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.002+0000 7f59f4c8c740 1 -- 172.21.15.37:0/942187272 wait complete. 2024-09-19T06:06:26.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.002+0000 7f59f4c8c740 20 client.15180 trim_cache size 0 max 16384 2024-09-19T06:06:26.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.019+0000 7f59f4c8c740 1 Processor -- start 2024-09-19T06:06:26.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.020+0000 7f59f4c8c740 1 -- start start 2024-09-19T06:06:26.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.020+0000 7f59f4c8c740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cb1aaf28b0 0x55cb1ab125c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:26.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.020+0000 7f59f4c8c740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cb1aaf31d0 0x55cb1aae9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:26.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.020+0000 7f59f4c8c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb1ab01fc0 0x55cb1ab1bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:26.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.020+0000 7f59f4c8c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55cb1ab11d70 con 0x55cb1ab01fc0 2024-09-19T06:06:26.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.020+0000 7f59f4c8c740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55cb1ab12440 con 0x55cb1aaf31d0 2024-09-19T06:06:26.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.020+0000 7f59f4c8c740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55cb1ab12b10 con 0x55cb1aaf28b0 2024-09-19T06:06:26.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.020+0000 7f59e3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb1ab01fc0 0x55cb1ab1bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:26.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.020+0000 7f59e3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb1ab01fc0 0x55cb1ab1bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35790/0 (socket says 172.21.15.37:35790) 2024-09-19T06:06:26.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.020+0000 7f59e3fff640 1 -- 172.21.15.37:0/3161126189 learned_addr learned my addr 172.21.15.37:0/3161126189 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:06:26.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.020+0000 7f59ebfff640 1 --2- 172.21.15.37:0/3161126189 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cb1aaf31d0 0x55cb1aae9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:26.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.020+0000 7f59e3fff640 1 --2- 172.21.15.37:0/3161126189 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cb1aaf28b0 0x55cb1ab125c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:26.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.020+0000 7f59e3fff640 1 -- 172.21.15.37:0/3161126189 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cb1aaf28b0 msgr2=0x55cb1ab125c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:06:26.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.020+0000 7f59e3fff640 1 --2- 172.21.15.37:0/3161126189 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cb1aaf28b0 0x55cb1ab125c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:26.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.020+0000 7f59e3fff640 1 -- 172.21.15.37:0/3161126189 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cb1aaf31d0 msgr2=0x55cb1aae9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:06:26.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.020+0000 7f59e3fff640 1 --2- 172.21.15.37:0/3161126189 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cb1aaf31d0 0x55cb1aae9d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:26.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.020+0000 7f59e3fff640 1 -- 172.21.15.37:0/3161126189 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb1aafd100 con 0x55cb1ab01fc0 2024-09-19T06:06:26.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.020+0000 7f59e3fff640 1 --2- 172.21.15.37:0/3161126189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb1ab01fc0 0x55cb1ab1bc90 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f59d402a9a0 tx=0x7f59d4005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e578f0a8381f4614 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:26.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.021+0000 7f59e1ffb640 1 -- 172.21.15.37:0/3161126189 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d4055070 con 0x55cb1ab01fc0 2024-09-19T06:06:26.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.021+0000 7f59e1ffb640 1 -- 172.21.15.37:0/3161126189 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f59d4041070 con 0x55cb1ab01fc0 2024-09-19T06:06:26.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.021+0000 7f59e1ffb640 1 -- 172.21.15.37:0/3161126189 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d4035070 con 0x55cb1ab01fc0 2024-09-19T06:06:26.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.021+0000 7f59f4c8c740 1 -- 172.21.15.37:0/3161126189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb1ab01fc0 msgr2=0x55cb1ab1bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:26.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.021+0000 7f59f4c8c740 1 --2- 172.21.15.37:0/3161126189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb1ab01fc0 0x55cb1ab1bc90 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f59d402a9a0 tx=0x7f59d4005fd0 comp rx=0 tx=0).stop 2024-09-19T06:06:26.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.021+0000 7f59f4c8c740 1 -- 172.21.15.37:0/3161126189 shutdown_connections 2024-09-19T06:06:26.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.021+0000 7f59f4c8c740 1 --2- 172.21.15.37:0/3161126189 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cb1aaf31d0 0x55cb1aae9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:26.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.021+0000 7f59f4c8c740 1 --2- 172.21.15.37:0/3161126189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb1ab01fc0 0x55cb1ab1bc90 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:26.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.021+0000 7f59f4c8c740 1 --2- 172.21.15.37:0/3161126189 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cb1aaf28b0 0x55cb1ab125c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:26.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.021+0000 7f59f4c8c740 1 -- 172.21.15.37:0/3161126189 >> 172.21.15.37:0/3161126189 conn(0x55cb1aaeef60 msgr2=0x55cb1aaef340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:26.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.021+0000 7f59f4c8c740 1 -- 172.21.15.37:0/3161126189 shutdown_connections 2024-09-19T06:06:26.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.021+0000 7f59f4c8c740 1 -- 172.21.15.37:0/3161126189 wait complete. 2024-09-19T06:06:26.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.022+0000 7f59f4c8c740 1 -- start start 2024-09-19T06:06:26.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.022+0000 7f59f4c8c740 1 Processor -- start 2024-09-19T06:06:26.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.022+0000 7f59f4c8c740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cb1aaf28b0 0x55cb1aaf9390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:26.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.022+0000 7f59f4c8c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb1aaf31d0 0x55cb1aaf56d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:26.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.022+0000 7f59f4c8c740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cb1ab01fc0 0x55cb1aaf5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:26.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.022+0000 7f59f4c8c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55cb1ab138b0 con 0x55cb1aaf31d0 2024-09-19T06:06:26.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.022+0000 7f59f4c8c740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55cb1ab131e0 con 0x55cb1ab01fc0 2024-09-19T06:06:26.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.022+0000 7f59f4c8c740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55cb1ab13f80 con 0x55cb1aaf28b0 2024-09-19T06:06:26.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.022+0000 7f59f4c8c740 10 client.0 _ll_register_callbacks cb 0x7f59d4004340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:06:26.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.022+0000 7f59ebfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb1aaf31d0 0x55cb1aaf56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:26.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.022+0000 7f59ebfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb1aaf31d0 0x55cb1aaf56d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35798/0 (socket says 172.21.15.37:35798) 2024-09-19T06:06:26.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.022+0000 7f59ebfff640 1 -- 172.21.15.37:0/2634627339 learned_addr learned my addr 172.21.15.37:0/2634627339 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:06:26.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.023+0000 7f59e3fff640 1 --2- 172.21.15.37:0/2634627339 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cb1aaf28b0 0x55cb1aaf9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:26.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.023+0000 7f59e3fff640 1 --2- 172.21.15.37:0/2634627339 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cb1ab01fc0 0x55cb1aaf5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:26.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.023+0000 7f59ebfff640 1 -- 172.21.15.37:0/2634627339 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cb1aaf28b0 msgr2=0x55cb1aaf9390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:06:26.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.023+0000 7f59ebfff640 1 --2- 172.21.15.37:0/2634627339 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cb1aaf28b0 0x55cb1aaf9390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:26.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.023+0000 7f59ebfff640 1 -- 172.21.15.37:0/2634627339 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cb1ab01fc0 msgr2=0x55cb1aaf5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:06:26.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.023+0000 7f59ebfff640 1 --2- 172.21.15.37:0/2634627339 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cb1ab01fc0 0x55cb1aaf5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:26.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.023+0000 7f59ebfff640 1 -- 172.21.15.37:0/2634627339 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb1aaf6460 con 0x55cb1aaf31d0 2024-09-19T06:06:26.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.023+0000 7f59ebfff640 1 --2- 172.21.15.37:0/2634627339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb1aaf31d0 0x55cb1aaf56d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f59dc00cca0 tx=0x7f59dc01b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=451424f546bddea server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:26.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.023+0000 7f59cb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-19T06:06:26.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.023+0000 7f59cb7fe640 1 -- 172.21.15.37:0/2634627339 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59dc004030 con 0x55cb1aaf31d0 2024-09-19T06:06:26.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.023+0000 7f59cb7fe640 1 -- 172.21.15.37:0/2634627339 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9121+0+0 (secure 0 0 0) 0x7f59dc0041d0 con 0x55cb1aaf31d0 2024-09-19T06:06:26.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.023+0000 7f59f4c8c740 1 -- 172.21.15.37:0/2634627339 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f59d4041070 con 0x55cb1aaf31d0 2024-09-19T06:06:26.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.023+0000 7f59cb7fe640 1 -- 172.21.15.37:0/2634627339 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f59dc02d050 con 0x55cb1aaf31d0 2024-09-19T06:06:26.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.023+0000 7f59f4c8c740 10 client.15186 fetch_fsmap learned FSMap version 20 2024-09-19T06:06:26.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.023+0000 7f59f4c8c740 1 -- 172.21.15.37:0/2634627339 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55cb1ab1c430 con 0x55cb1aaf31d0 2024-09-19T06:06:26.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.024+0000 7f59cb7fe640 1 -- 172.21.15.37:0/2634627339 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f59d4041070 con 0x55cb1aaf31d0 2024-09-19T06:06:26.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.024+0000 7f59cb7fe640 1 -- 172.21.15.37:0/2634627339 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 20) ==== 8338+0+0 (secure 0 0 0) 0x7f59dc0038f0 con 0x55cb1aaf31d0 2024-09-19T06:06:26.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.024+0000 7f59f4c8c740 10 client.15186 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:06:26.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.024+0000 7f59f4c8c740 10 client.15186 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T06:06:26.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.024+0000 7f59f4c8c740 20 client.15186 populate_metadata read hostname 'smithi037' 2024-09-19T06:06:26.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.024+0000 7f59f4c8c740 1 --2- 172.21.15.37:0/2634627339 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x55cb1ab859a0 0x55cb1ab846b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:26.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.024+0000 7f59f4c8c740 4 client.15186 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T06:06:26.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.024+0000 7f59f4c8c740 1 -- 172.21.15.37:0/2634627339 --> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] -- command(tid 0: {"prefix": "status"}) -- 0x55cb1aa60b10 con 0x55cb1ab859a0 2024-09-19T06:06:26.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.024+0000 7f59e3fff640 1 --2- 172.21.15.37:0/2634627339 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x55cb1ab859a0 0x55cb1ab846b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:26.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.025+0000 7f59cb7fe640 10 client.15186 ms_handle_connect on v2:172.21.15.99:6838/3404812329 2024-09-19T06:06:26.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.025+0000 7f59e3fff640 1 --2- 172.21.15.37:0/2634627339 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x55cb1ab859a0 0x55cb1ab846b0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c6891ecb8e8e17d server_cookie=ec868056b2912141 in_seq=0 out_seq=0 2024-09-19T06:06:26.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.025+0000 7f59cb7fe640 1 -- 172.21.15.37:0/2634627339 <== mds.0 v2:172.21.15.99:6838/3404812329 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55cb1aa60b10 con 0x55cb1ab859a0 2024-09-19T06:06:26.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.025+0000 7f59cb7fe640 10 client.15186 handle_command_reply: tid=0 2024-09-19T06:06:26.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.025+0000 7f59f4c8c740 1 client.15186 shutdown 2024-09-19T06:06:26.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.025+0000 7f59f4c8c740 1 -- 172.21.15.37:0/2634627339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb1aaf31d0 msgr2=0x55cb1aaf56d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:26.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.025+0000 7f59f4c8c740 1 --2- 172.21.15.37:0/2634627339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb1aaf31d0 0x55cb1aaf56d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f59dc00cca0 tx=0x7f59dc01b9d0 comp rx=0 tx=0).stop 2024-09-19T06:06:26.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.025+0000 7f59f4c8c740 1 -- 172.21.15.37:0/2634627339 shutdown_connections 2024-09-19T06:06:26.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.025+0000 7f59f4c8c740 1 --2- 172.21.15.37:0/2634627339 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x55cb1ab859a0 0x55cb1ab846b0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:26.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.025+0000 7f59f4c8c740 1 --2- 172.21.15.37:0/2634627339 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cb1ab01fc0 0x55cb1aaf5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:26.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.025+0000 7f59f4c8c740 1 --2- 172.21.15.37:0/2634627339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb1aaf31d0 0x55cb1aaf56d0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:26.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.025+0000 7f59f4c8c740 1 --2- 172.21.15.37:0/2634627339 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cb1aaf28b0 0x55cb1aaf9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:26.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.025+0000 7f59f4c8c740 1 -- 172.21.15.37:0/2634627339 >> 172.21.15.37:0/2634627339 conn(0x55cb1aaeef60 msgr2=0x55cb1aae9ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:26.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.025+0000 7f59cb7fe640 0 client.15186 ms_handle_reset on v2:172.21.15.99:6838/3404812329 2024-09-19T06:06:26.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.026+0000 7f59f4c8c740 1 -- 172.21.15.37:0/2634627339 shutdown_connections 2024-09-19T06:06:26.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.026+0000 7f59f4c8c740 1 -- 172.21.15.37:0/2634627339 wait complete. 2024-09-19T06:06:26.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.026+0000 7f59f4c8c740 20 client.15186 trim_cache size 0 max 16384 2024-09-19T06:06:26.034 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-19T06:06:26.034 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "b8c8bdae-764b-11ef-bceb-c7b262605968", 2024-09-19T06:06:26.034 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2024-09-19T06:06:26.034 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 24485, 2024-09-19T06:06:26.034 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-09-19T06:06:26.034 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-09-19T06:06:26.034 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-09-19T06:06:26.034 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 139.61507975000001, 2024-09-19T06:06:26.034 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 20, 2024-09-19T06:06:26.035 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 91, 2024-09-19T06:06:26.035 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 87, 2024-09-19T06:06:26.035 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 150.85253485000001 2024-09-19T06:06:26.035 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-19T06:06:26.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.026+0000 7f59f28b3640 1 -- 172.21.15.37:0/3271879004 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f59d80a3240 msgr2=0x7f59d80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:26.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.026+0000 7f59f28b3640 1 --2- 172.21.15.37:0/3271879004 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f59d80a3240 0x7f59d80a5700 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f59e4070ae0 tx=0x7f59e4065040 comp rx=0 tx=0).stop 2024-09-19T06:06:26.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.026+0000 7f59f28b3640 1 -- 172.21.15.37:0/3271879004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59ec102ef0 msgr2=0x7f59ec19cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:26.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.026+0000 7f59f28b3640 1 --2- 172.21.15.37:0/3271879004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59ec102ef0 0x7f59ec19cce0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f59e400cce0 tx=0x7f59e400a620 comp rx=0 tx=0).stop 2024-09-19T06:06:26.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.026+0000 7f59f28b3640 1 -- 172.21.15.37:0/3271879004 shutdown_connections 2024-09-19T06:06:26.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.026+0000 7f59f28b3640 1 --2- 172.21.15.37:0/3271879004 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f59d80a3240 0x7f59d80a5700 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:26.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.026+0000 7f59f28b3640 1 --2- 172.21.15.37:0/3271879004 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59ec102570 0x7f59ec198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:26.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.026+0000 7f59f28b3640 1 --2- 172.21.15.37:0/3271879004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59ec102ef0 0x7f59ec19cce0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:26.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.026+0000 7f59f28b3640 1 --2- 172.21.15.37:0/3271879004 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59ec100e20 0x7f59ec198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:26.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.026+0000 7f59f28b3640 1 -- 172.21.15.37:0/3271879004 >> 172.21.15.37:0/3271879004 conn(0x7f59ec0fc7d0 msgr2=0x7f59ec06a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:26.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.026+0000 7f59f28b3640 1 -- 172.21.15.37:0/3271879004 shutdown_connections 2024-09-19T06:06:26.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:26.026+0000 7f59f28b3640 1 -- 172.21.15.37:0/3271879004 wait complete. 2024-09-19T06:06:26.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:06:25 smithi099 ceph-mon[35300]: pgmap v357: 129 pgs: 129 active+clean; 644 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1020 B/s rd, 1 op/s 2024-09-19T06:06:26.747 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-09-19T06:06:28.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:06:27 smithi117 ceph-mon[35050]: pgmap v358: 129 pgs: 129 active+clean; 644 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:06:28.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:06:27 smithi037 ceph-mon[31211]: pgmap v358: 129 pgs: 129 active+clean; 644 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:06:28.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:06:27 smithi099 ceph-mon[35300]: pgmap v358: 129 pgs: 129 active+clean; 644 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:06:30.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:06:29 smithi117 ceph-mon[35050]: pgmap v359: 129 pgs: 129 active+clean; 650 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-19T06:06:30.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:06:29 smithi037 ceph-mon[31211]: pgmap v359: 129 pgs: 129 active+clean; 650 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-19T06:06:30.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:06:29 smithi099 ceph-mon[35300]: pgmap v359: 129 pgs: 129 active+clean; 650 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-19T06:06:32.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:06:31 smithi037 ceph-mon[31211]: pgmap v360: 129 pgs: 129 active+clean; 650 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 597 B/s wr, 1 op/s 2024-09-19T06:06:32.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:06:31 smithi099 ceph-mon[35300]: pgmap v360: 129 pgs: 129 active+clean; 650 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 597 B/s wr, 1 op/s 2024-09-19T06:06:32.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:06:31 smithi117 ceph-mon[35050]: pgmap v360: 129 pgs: 129 active+clean; 650 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 597 B/s wr, 1 op/s 2024-09-19T06:06:34.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:06:33 smithi037 ceph-mon[31211]: pgmap v361: 129 pgs: 129 active+clean; 650 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 597 B/s wr, 1 op/s 2024-09-19T06:06:34.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:06:33 smithi099 ceph-mon[35300]: pgmap v361: 129 pgs: 129 active+clean; 650 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 597 B/s wr, 1 op/s 2024-09-19T06:06:34.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:06:33 smithi117 ceph-mon[35050]: pgmap v361: 129 pgs: 129 active+clean; 650 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 597 B/s wr, 1 op/s 2024-09-19T06:06:36.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:06:35 smithi037 ceph-mon[31211]: pgmap v362: 129 pgs: 129 active+clean; 650 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-19T06:06:36.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:06:35 smithi099 ceph-mon[35300]: pgmap v362: 129 pgs: 129 active+clean; 650 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-19T06:06:36.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:06:35 smithi117 ceph-mon[35050]: pgmap v362: 129 pgs: 129 active+clean; 650 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-19T06:06:38.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:06:37 smithi037 ceph-mon[31211]: pgmap v363: 129 pgs: 129 active+clean; 650 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 597 B/s wr, 1 op/s 2024-09-19T06:06:38.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:06:37 smithi099 ceph-mon[35300]: pgmap v363: 129 pgs: 129 active+clean; 650 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 597 B/s wr, 1 op/s 2024-09-19T06:06:38.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:06:37 smithi117 ceph-mon[35050]: pgmap v363: 129 pgs: 129 active+clean; 650 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 597 B/s wr, 1 op/s 2024-09-19T06:06:40.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:06:39 smithi037 ceph-mon[31211]: pgmap v364: 129 pgs: 129 active+clean; 650 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-19T06:06:40.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:06:39 smithi099 ceph-mon[35300]: pgmap v364: 129 pgs: 129 active+clean; 650 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-19T06:06:40.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:06:39 smithi117 ceph-mon[35050]: pgmap v364: 129 pgs: 129 active+clean; 650 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-19T06:06:41.748 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 11.2 2024-09-19T06:06:41.748 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:06:42.014 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:06:42.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:06:41 smithi037 ceph-mon[31211]: pgmap v365: 129 pgs: 129 active+clean; 650 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-19T06:06:42.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:06:41 smithi099 ceph-mon[35300]: pgmap v365: 129 pgs: 129 active+clean; 650 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-19T06:06:42.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:06:41 smithi117 ceph-mon[35050]: pgmap v365: 129 pgs: 129 active+clean; 650 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-19T06:06:42.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:42.483+0000 7fc783c28640 1 -- 172.21.15.37:0/3624237516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc77c102ef0 msgr2=0x7fc77c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:42.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:42.483+0000 7fc783c28640 1 --2- 172.21.15.37:0/3624237516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc77c102ef0 0x7fc77c10da40 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fc774009ca0 tx=0x7fc77402a950 comp rx=0 tx=0).stop 2024-09-19T06:06:42.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:42.483+0000 7fc783c28640 1 -- 172.21.15.37:0/3624237516 shutdown_connections 2024-09-19T06:06:42.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:42.483+0000 7fc783c28640 1 --2- 172.21.15.37:0/3624237516 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc77c102570 0x7fc77c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:42.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:42.483+0000 7fc783c28640 1 --2- 172.21.15.37:0/3624237516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc77c102ef0 0x7fc77c10da40 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:42.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:42.483+0000 7fc783c28640 1 --2- 172.21.15.37:0/3624237516 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc77c100e20 0x7fc77c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:42.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:42.483+0000 7fc783c28640 1 -- 172.21.15.37:0/3624237516 >> 172.21.15.37:0/3624237516 conn(0x7fc77c0fc7d0 msgr2=0x7fc77c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:42.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:42.483+0000 7fc783c28640 1 -- 172.21.15.37:0/3624237516 shutdown_connections 2024-09-19T06:06:42.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:42.483+0000 7fc783c28640 1 -- 172.21.15.37:0/3624237516 wait complete. 2024-09-19T06:06:42.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:42.483+0000 7fc783c28640 1 Processor -- start 2024-09-19T06:06:42.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:42.483+0000 7fc783c28640 1 -- start start 2024-09-19T06:06:42.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:42.484+0000 7fc783c28640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc77c100e20 0x7fc77c198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:42.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:42.484+0000 7fc783c28640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc77c102570 0x7fc77c198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:42.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:42.484+0000 7fc783c28640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc77c102ef0 0x7fc77c19ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:42.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:42.484+0000 7fc783c28640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc77c110fc0 con 0x7fc77c102570 2024-09-19T06:06:42.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:42.484+0000 7fc783c28640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc77c110e40 con 0x7fc77c102ef0 2024-09-19T06:06:42.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:42.484+0000 7fc783c28640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc77c111140 con 0x7fc77c100e20 2024-09-19T06:06:42.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:42.484+0000 7fc7811c3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc77c102570 0x7fc77c198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:42.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:42.484+0000 7fc7811c3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc77c102570 0x7fc77c198ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50790/0 (socket says 172.21.15.37:50790) 2024-09-19T06:06:42.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:42.484+0000 7fc7811c3640 1 -- 172.21.15.37:0/928687183 learned_addr learned my addr 172.21.15.37:0/928687183 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:06:42.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:42.484+0000 7fc7819c4640 1 --2- 172.21.15.37:0/928687183 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc77c100e20 0x7fc77c198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:42.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:42.484+0000 7fc7811c3640 1 -- 172.21.15.37:0/928687183 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc77c100e20 msgr2=0x7fc77c198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:42.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:42.484+0000 7fc7811c3640 1 --2- 172.21.15.37:0/928687183 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc77c100e20 0x7fc77c198570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:42.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:42.484+0000 7fc7811c3640 1 -- 172.21.15.37:0/928687183 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc77c102ef0 msgr2=0x7fc77c19ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:42.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:42.484+0000 7fc7811c3640 1 --2- 172.21.15.37:0/928687183 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc77c102ef0 0x7fc77c19ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:42.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:42.484+0000 7fc7811c3640 1 -- 172.21.15.37:0/928687183 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc77c19d520 con 0x7fc77c102570 2024-09-19T06:06:42.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:42.484+0000 7fc7811c3640 1 --2- 172.21.15.37:0/928687183 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc77c102570 0x7fc77c198ab0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fc76c00b4a0 tx=0x7fc76c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:42.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:42.485+0000 7fc772ffd640 1 -- 172.21.15.37:0/928687183 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc76c014070 con 0x7fc77c102570 2024-09-19T06:06:42.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:42.485+0000 7fc772ffd640 1 -- 172.21.15.37:0/928687183 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc76c010af0 con 0x7fc77c102570 2024-09-19T06:06:42.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:42.485+0000 7fc772ffd640 1 -- 172.21.15.37:0/928687183 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc76c017d10 con 0x7fc77c102570 2024-09-19T06:06:42.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:42.485+0000 7fc783c28640 1 -- 172.21.15.37:0/928687183 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc77c19d810 con 0x7fc77c102570 2024-09-19T06:06:42.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:42.485+0000 7fc783c28640 1 -- 172.21.15.37:0/928687183 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc77c1a50f0 con 0x7fc77c102570 2024-09-19T06:06:42.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:42.486+0000 7fc783c28640 1 -- 172.21.15.37:0/928687183 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc77c101200 con 0x7fc77c102570 2024-09-19T06:06:42.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:42.487+0000 7fc772ffd640 1 -- 172.21.15.37:0/928687183 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fc76c017070 con 0x7fc77c102570 2024-09-19T06:06:42.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:42.488+0000 7fc772ffd640 1 --2- 172.21.15.37:0/928687183 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fc7680a32c0 0x7fc7680a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:42.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:42.488+0000 7fc772ffd640 1 -- 172.21.15.37:0/928687183 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9121+0+0 (secure 0 0 0) 0x7fc76c0cf400 con 0x7fc77c102570 2024-09-19T06:06:42.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:42.488+0000 7fc7819c4640 1 --2- 172.21.15.37:0/928687183 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fc7680a32c0 0x7fc7680a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:42.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:42.489+0000 7fc7819c4640 1 --2- 172.21.15.37:0/928687183 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fc7680a32c0 0x7fc7680a5780 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc778009bd0 tx=0x7fc778005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:42.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:42.491+0000 7fc772ffd640 1 -- 172.21.15.37:0/928687183 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc76c09bd40 con 0x7fc77c102570 2024-09-19T06:06:42.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:42.732+0000 7fc783c28640 1 -- 172.21.15.37:0/928687183 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc77c1998d0 con 0x7fc77c102570 2024-09-19T06:06:42.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:42.733+0000 7fc772ffd640 1 -- 172.21.15.37:0/928687183 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11842 (secure 0 0 0) 0x7fc77c1998d0 con 0x7fc77c102570 2024-09-19T06:06:42.734 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T06:06:42.734 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"btime":"2024-09-19T06:04:42:531480+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14514,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2864247978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2864247978},{"type":"v1","addr":"172.21.15.37:6835","nonce":2864247978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14526,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/633000932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":633000932},{"type":"v1","addr":"172.21.15.37:6837","nonce":633000932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14574,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/3753800615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":3753800615},{"type":"v1","addr":"172.21.15.37:6839","nonce":3753800615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/2718998355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":2718998355},{"type":"v1","addr":"172.21.15.37:6841","nonce":2718998355}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6833/866590207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":866590207},{"type":"v1","addr":"172.21.15.99:6833","nonce":866590207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3898668400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3898668400},{"type":"v1","addr":"172.21.15.117:6833","nonce":3898668400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2650673320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2650673320},{"type":"v1","addr":"172.21.15.99:6835","nonce":2650673320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1097471349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1097471349},{"type":"v1","addr":"172.21.15.117:6835","nonce":1097471349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24457,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1001392672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1001392672},{"type":"v1","addr":"172.21.15.117:6837","nonce":1001392672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/23570935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":23570935},{"type":"v1","addr":"172.21.15.99:6837","nonce":23570935}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:04:06.253034+0000","modified":"2024-09-19T06:04:42.196783+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24485},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24478":{"gid":24478,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6839/1269518339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":1269518339},{"type":"v1","addr":"172.21.15.117:6839","nonce":1269518339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.99:6839/3404812329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":3404812329},{"type":"v1","addr":"172.21.15.99:6839","nonce":3404812329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24485,"qdb_cluster":[24485]},"id":1}]} 2024-09-19T06:06:42.734 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 20 2024-09-19T06:06:42.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:42.736+0000 7fc783c28640 1 -- 172.21.15.37:0/928687183 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fc7680a32c0 msgr2=0x7fc7680a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:42.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:42.736+0000 7fc783c28640 1 --2- 172.21.15.37:0/928687183 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fc7680a32c0 0x7fc7680a5780 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc778009bd0 tx=0x7fc778005f90 comp rx=0 tx=0).stop 2024-09-19T06:06:42.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:42.736+0000 7fc783c28640 1 -- 172.21.15.37:0/928687183 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc77c102570 msgr2=0x7fc77c198ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:42.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:42.736+0000 7fc783c28640 1 --2- 172.21.15.37:0/928687183 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc77c102570 0x7fc77c198ab0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fc76c00b4a0 tx=0x7fc76c00b960 comp rx=0 tx=0).stop 2024-09-19T06:06:42.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:42.736+0000 7fc783c28640 1 -- 172.21.15.37:0/928687183 shutdown_connections 2024-09-19T06:06:42.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:42.736+0000 7fc783c28640 1 --2- 172.21.15.37:0/928687183 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fc7680a32c0 0x7fc7680a5780 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:42.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:42.736+0000 7fc783c28640 1 --2- 172.21.15.37:0/928687183 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc77c102ef0 0x7fc77c19ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:42.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:42.736+0000 7fc783c28640 1 --2- 172.21.15.37:0/928687183 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc77c102570 0x7fc77c198ab0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:42.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:42.736+0000 7fc783c28640 1 --2- 172.21.15.37:0/928687183 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc77c100e20 0x7fc77c198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:42.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:42.736+0000 7fc783c28640 1 -- 172.21.15.37:0/928687183 >> 172.21.15.37:0/928687183 conn(0x7fc77c0fc7d0 msgr2=0x7fc77c06a210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:42.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:42.736+0000 7fc783c28640 1 -- 172.21.15.37:0/928687183 shutdown_connections 2024-09-19T06:06:42.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:42.736+0000 7fc783c28640 1 -- 172.21.15.37:0/928687183 wait complete. 2024-09-19T06:06:43.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:06:42 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/928687183' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:06:43.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:06:42 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/928687183' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:06:43.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:06:42 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/928687183' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:06:43.441 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24485 quiesce db / --timeout 90 --expiration 131.2 --await-for 45.0' 2024-09-19T06:06:43.441 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24485 quiesce db / --timeout 90 --expiration 131.2 --await-for 45.0 2024-09-19T06:06:43.719 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:06:44.025 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:06:43 smithi037 ceph-mon[31211]: pgmap v366: 129 pgs: 129 active+clean; 650 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:06:44.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:06:43 smithi099 ceph-mon[35300]: pgmap v366: 129 pgs: 129 active+clean; 650 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:06:44.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:06:43 smithi117 ceph-mon[35050]: pgmap v366: 129 pgs: 129 active+clean; 650 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:06:44.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.244+0000 7f9a92cb5640 1 -- 172.21.15.37:0/2730472881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a8c102570 msgr2=0x7f9a8c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:44.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.244+0000 7f9a92cb5640 1 --2- 172.21.15.37:0/2730472881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a8c102570 0x7f9a8c1029b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9a78009900 tx=0x7f9a7802a480 comp rx=0 tx=0).stop 2024-09-19T06:06:44.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.244+0000 7f9a92cb5640 1 -- 172.21.15.37:0/2730472881 shutdown_connections 2024-09-19T06:06:44.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.244+0000 7f9a92cb5640 1 --2- 172.21.15.37:0/2730472881 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a8c102ef0 0x7f9a8c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:44.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.244+0000 7f9a92cb5640 1 --2- 172.21.15.37:0/2730472881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a8c102570 0x7f9a8c1029b0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:44.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.244+0000 7f9a92cb5640 1 --2- 172.21.15.37:0/2730472881 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a8c100e20 0x7f9a8c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:44.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.244+0000 7f9a92cb5640 1 -- 172.21.15.37:0/2730472881 >> 172.21.15.37:0/2730472881 conn(0x7f9a8c0fc7d0 msgr2=0x7f9a8c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:44.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.244+0000 7f9a92cb5640 1 -- 172.21.15.37:0/2730472881 shutdown_connections 2024-09-19T06:06:44.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.244+0000 7f9a92cb5640 1 -- 172.21.15.37:0/2730472881 wait complete. 2024-09-19T06:06:44.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.245+0000 7f9a92cb5640 1 Processor -- start 2024-09-19T06:06:44.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.245+0000 7f9a92cb5640 1 -- start start 2024-09-19T06:06:44.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.246+0000 7f9a92cb5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a8c100e20 0x7f9a8c0fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:44.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.246+0000 7f9a92cb5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a8c102570 0x7f9a8c0fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:44.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.246+0000 7f9a92cb5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a8c102ef0 0x7f9a8c0fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:44.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.246+0000 7f9a92cb5640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9a8c110f80 con 0x7f9a8c102570 2024-09-19T06:06:44.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.246+0000 7f9a92cb5640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f9a8c110e00 con 0x7f9a8c102ef0 2024-09-19T06:06:44.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.246+0000 7f9a92cb5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9a8c111100 con 0x7f9a8c100e20 2024-09-19T06:06:44.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.246+0000 7f9a8bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a8c102570 0x7f9a8c0fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:44.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.246+0000 7f9a8bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a8c102570 0x7f9a8c0fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53448/0 (socket says 172.21.15.37:53448) 2024-09-19T06:06:44.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.246+0000 7f9a8bfff640 1 -- 172.21.15.37:0/937918646 learned_addr learned my addr 172.21.15.37:0/937918646 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:06:44.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.246+0000 7f9a90a51640 1 --2- 172.21.15.37:0/937918646 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a8c100e20 0x7f9a8c0fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:44.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.246+0000 7f9a91252640 1 --2- 172.21.15.37:0/937918646 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a8c102ef0 0x7f9a8c0fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:44.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.246+0000 7f9a8bfff640 1 -- 172.21.15.37:0/937918646 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a8c100e20 msgr2=0x7f9a8c0fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:44.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.246+0000 7f9a8bfff640 1 --2- 172.21.15.37:0/937918646 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a8c100e20 0x7f9a8c0fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:44.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.246+0000 7f9a8bfff640 1 -- 172.21.15.37:0/937918646 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a8c102ef0 msgr2=0x7f9a8c0fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:44.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.246+0000 7f9a8bfff640 1 --2- 172.21.15.37:0/937918646 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a8c102ef0 0x7f9a8c0fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:44.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.246+0000 7f9a8bfff640 1 -- 172.21.15.37:0/937918646 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a8c1a69a0 con 0x7f9a8c102570 2024-09-19T06:06:44.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.246+0000 7f9a8bfff640 1 --2- 172.21.15.37:0/937918646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a8c102570 0x7f9a8c0fd1c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f9a78006010 tx=0x7f9a78003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:44.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.246+0000 7f9a89ffb640 1 -- 172.21.15.37:0/937918646 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a7803f070 con 0x7f9a8c102570 2024-09-19T06:06:44.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.247+0000 7f9a89ffb640 1 -- 172.21.15.37:0/937918646 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a78031c30 con 0x7f9a8c102570 2024-09-19T06:06:44.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.247+0000 7f9a92cb5640 1 -- 172.21.15.37:0/937918646 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a8c1a6c30 con 0x7f9a8c102570 2024-09-19T06:06:44.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.247+0000 7f9a89ffb640 1 -- 172.21.15.37:0/937918646 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a78035030 con 0x7f9a8c102570 2024-09-19T06:06:44.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.247+0000 7f9a92cb5640 1 -- 172.21.15.37:0/937918646 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a8c1a7110 con 0x7f9a8c102570 2024-09-19T06:06:44.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.249+0000 7f9a9508e740 1 Processor -- start 2024-09-19T06:06:44.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.249+0000 7f9a9508e740 1 -- start start 2024-09-19T06:06:44.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.250+0000 7f9a89ffb640 1 -- 172.21.15.37:0/937918646 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f9a78042070 con 0x7f9a8c102570 2024-09-19T06:06:44.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.250+0000 7f9a9508e740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555cdaf71760 0x555cdaf71b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:44.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.250+0000 7f9a9508e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555cdaf72080 0x555cdaf7c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:44.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.250+0000 7f9a9508e740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cdaf7c940 0x555cdaf7ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:44.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.250+0000 7f9a9508e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x555cdaed72a0 con 0x555cdaf72080 2024-09-19T06:06:44.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.250+0000 7f9a9508e740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x555cdae7eb10 con 0x555cdaf71760 2024-09-19T06:06:44.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.250+0000 7f9a9508e740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x555cdaed3260 con 0x555cdaf7c940 2024-09-19T06:06:44.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.250+0000 7f9a90a51640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555cdaf72080 0x555cdaf7c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:44.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.250+0000 7f9a90a51640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555cdaf72080 0x555cdaf7c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53462/0 (socket says 172.21.15.37:53462) 2024-09-19T06:06:44.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.250+0000 7f9a90a51640 1 -- 172.21.15.37:0/2301662799 learned_addr learned my addr 172.21.15.37:0/2301662799 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:06:44.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.250+0000 7f9a91252640 1 --2- 172.21.15.37:0/2301662799 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555cdaf71760 0x555cdaf71b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:44.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.250+0000 7f9a8bfff640 1 --2- 172.21.15.37:0/2301662799 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cdaf7c940 0x555cdaf7ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:44.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.250+0000 7f9a90a51640 1 -- 172.21.15.37:0/2301662799 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cdaf7c940 msgr2=0x555cdaf7ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:06:44.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.250+0000 7f9a90a51640 1 --2- 172.21.15.37:0/2301662799 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cdaf7c940 0x555cdaf7ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:44.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.250+0000 7f9a90a51640 1 -- 172.21.15.37:0/2301662799 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555cdaf71760 msgr2=0x555cdaf71b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:06:44.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.250+0000 7f9a90a51640 1 --2- 172.21.15.37:0/2301662799 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555cdaf71760 0x555cdaf71b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:44.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.250+0000 7f9a90a51640 1 -- 172.21.15.37:0/2301662799 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cdac48b90 con 0x555cdaf72080 2024-09-19T06:06:44.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.250+0000 7f9a8bfff640 1 --2- 172.21.15.37:0/2301662799 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cdaf7c940 0x555cdaf7ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:06:44.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.251+0000 7f9a89ffb640 1 --2- 172.21.15.37:0/937918646 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f9a7c0a3240 0x7f9a7c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:44.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.251+0000 7f9a91252640 1 --2- 172.21.15.37:0/937918646 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f9a7c0a3240 0x7f9a7c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:44.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.251+0000 7f9a90a51640 1 --2- 172.21.15.37:0/2301662799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555cdaf72080 0x555cdaf7c400 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f9a8000bd10 tx=0x7f9a800107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cda822a8fc59e34b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:44.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.251+0000 7f9a89ffb640 1 -- 172.21.15.37:0/937918646 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9121+0+0 (secure 0 0 0) 0x7f9a780f04f0 con 0x7f9a8c102570 2024-09-19T06:06:44.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.251+0000 7f9a76ffd640 1 -- 172.21.15.37:0/2301662799 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a80004030 con 0x555cdaf72080 2024-09-19T06:06:44.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.251+0000 7f9a76ffd640 1 -- 172.21.15.37:0/2301662799 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a800041d0 con 0x555cdaf72080 2024-09-19T06:06:44.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.251+0000 7f9a76ffd640 1 -- 172.21.15.37:0/2301662799 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a80011840 con 0x555cdaf72080 2024-09-19T06:06:44.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.252+0000 7f9a9508e740 1 -- 172.21.15.37:0/2301662799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555cdaf72080 msgr2=0x555cdaf7c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:44.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.252+0000 7f9a9508e740 1 --2- 172.21.15.37:0/2301662799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555cdaf72080 0x555cdaf7c400 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f9a8000bd10 tx=0x7f9a800107a0 comp rx=0 tx=0).stop 2024-09-19T06:06:44.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.252+0000 7f9a91252640 1 --2- 172.21.15.37:0/937918646 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f9a7c0a3240 0x7f9a7c0a5700 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9a84005fd0 tx=0x7f9a840096e0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:44.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.252+0000 7f9a9508e740 1 -- 172.21.15.37:0/2301662799 shutdown_connections 2024-09-19T06:06:44.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.252+0000 7f9a9508e740 1 --2- 172.21.15.37:0/2301662799 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cdaf7c940 0x555cdaf7ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:44.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.252+0000 7f9a9508e740 1 --2- 172.21.15.37:0/2301662799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555cdaf72080 0x555cdaf7c400 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:44.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.252+0000 7f9a9508e740 1 --2- 172.21.15.37:0/2301662799 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555cdaf71760 0x555cdaf71b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:44.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.252+0000 7f9a9508e740 1 -- 172.21.15.37:0/2301662799 >> 172.21.15.37:0/2301662799 conn(0x555cdaf6dcf0 msgr2=0x555cdaf6e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:44.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.252+0000 7f9a9508e740 1 -- 172.21.15.37:0/2301662799 shutdown_connections 2024-09-19T06:06:44.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.252+0000 7f9a9508e740 1 -- 172.21.15.37:0/2301662799 wait complete. 2024-09-19T06:06:44.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.253+0000 7f9a9508e740 1 -- start start 2024-09-19T06:06:44.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.253+0000 7f9a9508e740 1 Processor -- start 2024-09-19T06:06:44.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.253+0000 7f9a9508e740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cdaf71760 0x555cdaf797f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:44.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.253+0000 7f9a9508e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555cdaf72080 0x555cdaf79d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:44.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.253+0000 7f9a9508e740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555cdaf7c940 0x555cdaf7a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:44.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.253+0000 7f9a9508e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x555cdaf7f510 con 0x555cdaf72080 2024-09-19T06:06:44.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.253+0000 7f9a9508e740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x555cdae5f6e0 con 0x555cdaf7c940 2024-09-19T06:06:44.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.253+0000 7f9a9508e740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x555cdaf7f690 con 0x555cdaf71760 2024-09-19T06:06:44.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.253+0000 7f9a9508e740 10 client.0 _ll_register_callbacks cb 0x555cdae83a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:06:44.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.253+0000 7f9a8bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555cdaf72080 0x555cdaf79d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:44.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.254+0000 7f9a8bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555cdaf72080 0x555cdaf79d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53476/0 (socket says 172.21.15.37:53476) 2024-09-19T06:06:44.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.254+0000 7f9a8bfff640 1 -- 172.21.15.37:0/3293122692 learned_addr learned my addr 172.21.15.37:0/3293122692 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:06:44.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.254+0000 7f9a90a51640 1 --2- 172.21.15.37:0/3293122692 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cdaf71760 0x555cdaf797f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:44.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.254+0000 7f9a91252640 1 --2- 172.21.15.37:0/3293122692 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555cdaf7c940 0x555cdaf7a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:44.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.254+0000 7f9a8bfff640 1 -- 172.21.15.37:0/3293122692 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cdaf71760 msgr2=0x555cdaf797f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:06:44.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.254+0000 7f9a8bfff640 1 --2- 172.21.15.37:0/3293122692 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cdaf71760 0x555cdaf797f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:44.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.254+0000 7f9a8bfff640 1 -- 172.21.15.37:0/3293122692 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555cdaf7c940 msgr2=0x555cdaf7a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:06:44.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.254+0000 7f9a8bfff640 1 --2- 172.21.15.37:0/3293122692 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555cdaf7c940 0x555cdaf7a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:44.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.254+0000 7f9a8bfff640 1 -- 172.21.15.37:0/3293122692 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555cdaf88a00 con 0x555cdaf72080 2024-09-19T06:06:44.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.254+0000 7f9a91252640 1 --2- 172.21.15.37:0/3293122692 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555cdaf7c940 0x555cdaf7a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:06:44.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.254+0000 7f9a8bfff640 1 --2- 172.21.15.37:0/3293122692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555cdaf72080 0x555cdaf79d30 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f9a780bc720 tx=0x7f9a780bc620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e4d9ac8f8a5006e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:44.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.254+0000 7f9a6bfff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-19T06:06:44.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.254+0000 7f9a6bfff640 1 -- 172.21.15.37:0/3293122692 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a78049070 con 0x555cdaf72080 2024-09-19T06:06:44.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.254+0000 7f9a6bfff640 1 -- 172.21.15.37:0/3293122692 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9121+0+0 (secure 0 0 0) 0x7f9a780f0230 con 0x555cdaf72080 2024-09-19T06:06:44.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.254+0000 7f9a9508e740 1 -- 172.21.15.37:0/3293122692 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9a800041d0 con 0x555cdaf72080 2024-09-19T06:06:44.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.254+0000 7f9a6bfff640 1 -- 172.21.15.37:0/3293122692 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f9a780bce90 con 0x555cdaf72080 2024-09-19T06:06:44.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.254+0000 7f9a9508e740 10 client.15204 fetch_fsmap learned FSMap version 20 2024-09-19T06:06:44.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.254+0000 7f9a9508e740 1 -- 172.21.15.37:0/3293122692 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x555cdaf8b300 con 0x555cdaf72080 2024-09-19T06:06:44.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.255+0000 7f9a6bfff640 1 -- 172.21.15.37:0/3293122692 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a800041d0 con 0x555cdaf72080 2024-09-19T06:06:44.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.255+0000 7f9a6bfff640 1 -- 172.21.15.37:0/3293122692 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 20) ==== 8338+0+0 (secure 0 0 0) 0x7f9a780bc9f0 con 0x555cdaf72080 2024-09-19T06:06:44.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.255+0000 7f9a9508e740 10 client.15204 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:06:44.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.255+0000 7f9a9508e740 10 client.15204 resolve_mds: validated gid 24485 aka daemon mds.b 2024-09-19T06:06:44.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.255+0000 7f9a9508e740 20 client.15204 populate_metadata read hostname 'smithi037' 2024-09-19T06:06:44.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.255+0000 7f9a9508e740 1 --2- 172.21.15.37:0/3293122692 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x555cdaf8c7c0 0x555cdaf8ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:44.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.255+0000 7f9a9508e740 4 client.15204 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:06:44.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.255+0000 7f9a9508e740 1 -- 172.21.15.37:0/3293122692 --> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555cdaee49d0 con 0x555cdaf8c7c0 2024-09-19T06:06:44.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.255+0000 7f9a90a51640 1 --2- 172.21.15.37:0/3293122692 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x555cdaf8c7c0 0x555cdaf8ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:44.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.256+0000 7f9a90a51640 1 --2- 172.21.15.37:0/3293122692 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x555cdaf8c7c0 0x555cdaf8ebe0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ddff0ee4b05cf166 server_cookie=50bce5f100462414 in_seq=0 out_seq=0 2024-09-19T06:06:44.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.256+0000 7f9a6bfff640 10 client.15204 ms_handle_connect on v2:172.21.15.99:6838/3404812329 2024-09-19T06:06:44.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.256+0000 7f9a6bfff640 1 -- 172.21.15.37:0/3293122692 <== mds.0 v2:172.21.15.99:6838/3404812329 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555cdaee49d0 con 0x555cdaf8c7c0 2024-09-19T06:06:44.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.256+0000 7f9a6bfff640 10 client.15204 handle_command_reply: tid=0 2024-09-19T06:06:44.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.256+0000 7f9a9508e740 1 client.15204 shutdown 2024-09-19T06:06:44.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.257+0000 7f9a9508e740 1 -- 172.21.15.37:0/3293122692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555cdaf72080 msgr2=0x555cdaf79d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:44.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.257+0000 7f9a9508e740 1 --2- 172.21.15.37:0/3293122692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555cdaf72080 0x555cdaf79d30 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f9a780bc720 tx=0x7f9a780bc620 comp rx=0 tx=0).stop 2024-09-19T06:06:44.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.257+0000 7f9a9508e740 1 -- 172.21.15.37:0/3293122692 shutdown_connections 2024-09-19T06:06:44.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.257+0000 7f9a9508e740 1 --2- 172.21.15.37:0/3293122692 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x555cdaf8c7c0 0x555cdaf8ebe0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:44.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.257+0000 7f9a6bfff640 0 client.15204 ms_handle_reset on v2:172.21.15.99:6838/3404812329 2024-09-19T06:06:44.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.257+0000 7f9a9508e740 1 --2- 172.21.15.37:0/3293122692 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555cdaf7c940 0x555cdaf7a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:44.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.257+0000 7f9a9508e740 1 --2- 172.21.15.37:0/3293122692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555cdaf72080 0x555cdaf79d30 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:44.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.257+0000 7f9a9508e740 1 --2- 172.21.15.37:0/3293122692 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cdaf71760 0x555cdaf797f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:44.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.257+0000 7f9a9508e740 1 -- 172.21.15.37:0/3293122692 >> 172.21.15.37:0/3293122692 conn(0x555cdaf6dcf0 msgr2=0x555cdaf73a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:44.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.257+0000 7f9a9508e740 1 -- 172.21.15.37:0/3293122692 shutdown_connections 2024-09-19T06:06:44.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.257+0000 7f9a9508e740 1 -- 172.21.15.37:0/3293122692 wait complete. 2024-09-19T06:06:44.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.257+0000 7f9a9508e740 20 client.15204 trim_cache size 0 max 16384 2024-09-19T06:06:44.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.275+0000 7f9a9508e740 1 Processor -- start 2024-09-19T06:06:44.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.275+0000 7f9a9508e740 1 -- start start 2024-09-19T06:06:44.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.276+0000 7f9a9508e740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555cdaf71760 0x555cdaf944d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:44.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.276+0000 7f9a9508e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555cdaf72080 0x555cdaf94a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:44.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.276+0000 7f9a9508e740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cdaf7c940 0x555cdaf76a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:44.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.276+0000 7f9a9508e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9a8c1aedf0 con 0x555cdaf72080 2024-09-19T06:06:44.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.276+0000 7f9a9508e740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f9a8c1b1670 con 0x555cdaf71760 2024-09-19T06:06:44.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.276+0000 7f9a9508e740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9a8c1af460 con 0x555cdaf7c940 2024-09-19T06:06:44.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.276+0000 7f9a8bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555cdaf72080 0x555cdaf94a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:44.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.276+0000 7f9a8bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555cdaf72080 0x555cdaf94a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53484/0 (socket says 172.21.15.37:53484) 2024-09-19T06:06:44.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.276+0000 7f9a8bfff640 1 -- 172.21.15.37:0/2443751914 learned_addr learned my addr 172.21.15.37:0/2443751914 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:06:44.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.276+0000 7f9a90a51640 1 --2- 172.21.15.37:0/2443751914 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555cdaf71760 0x555cdaf944d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:44.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.276+0000 7f9a91252640 1 --2- 172.21.15.37:0/2443751914 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cdaf7c940 0x555cdaf76a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:44.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.276+0000 7f9a90a51640 1 -- 172.21.15.37:0/2443751914 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cdaf7c940 msgr2=0x555cdaf76a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:06:44.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.276+0000 7f9a90a51640 1 --2- 172.21.15.37:0/2443751914 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cdaf7c940 0x555cdaf76a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:44.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.276+0000 7f9a90a51640 1 -- 172.21.15.37:0/2443751914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555cdaf72080 msgr2=0x555cdaf94a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:06:44.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.276+0000 7f9a90a51640 1 --2- 172.21.15.37:0/2443751914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555cdaf72080 0x555cdaf94a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:44.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.276+0000 7f9a90a51640 1 -- 172.21.15.37:0/2443751914 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cdaf6db20 con 0x555cdaf71760 2024-09-19T06:06:44.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.277+0000 7f9a8bfff640 1 --2- 172.21.15.37:0/2443751914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555cdaf72080 0x555cdaf94a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:06:44.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.277+0000 7f9a90a51640 1 --2- 172.21.15.37:0/2443751914 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555cdaf71760 0x555cdaf944d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9a80010ca0 tx=0x7f9a8000b900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=849d9fd2fe5b7f91 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:44.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.277+0000 7f9a767fc640 1 -- 172.21.15.37:0/2443751914 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a800052c0 con 0x555cdaf71760 2024-09-19T06:06:44.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.277+0000 7f9a767fc640 1 -- 172.21.15.37:0/2443751914 <== mon.2 v2:172.21.15.99:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a80005460 con 0x555cdaf71760 2024-09-19T06:06:44.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.277+0000 7f9a767fc640 1 -- 172.21.15.37:0/2443751914 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a800118d0 con 0x555cdaf71760 2024-09-19T06:06:44.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.278+0000 7f9a9508e740 1 -- 172.21.15.37:0/2443751914 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555cdaf71760 msgr2=0x555cdaf944d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:44.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.278+0000 7f9a9508e740 1 --2- 172.21.15.37:0/2443751914 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555cdaf71760 0x555cdaf944d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9a80010ca0 tx=0x7f9a8000b900 comp rx=0 tx=0).stop 2024-09-19T06:06:44.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.278+0000 7f9a9508e740 1 -- 172.21.15.37:0/2443751914 shutdown_connections 2024-09-19T06:06:44.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.278+0000 7f9a9508e740 1 --2- 172.21.15.37:0/2443751914 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cdaf7c940 0x555cdaf76a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:44.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.278+0000 7f9a9508e740 1 --2- 172.21.15.37:0/2443751914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555cdaf72080 0x555cdaf94a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:44.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.278+0000 7f9a9508e740 1 --2- 172.21.15.37:0/2443751914 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555cdaf71760 0x555cdaf944d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:44.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.278+0000 7f9a9508e740 1 -- 172.21.15.37:0/2443751914 >> 172.21.15.37:0/2443751914 conn(0x555cdaf6dcf0 msgr2=0x555cdaf7b870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:44.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.278+0000 7f9a9508e740 1 -- 172.21.15.37:0/2443751914 shutdown_connections 2024-09-19T06:06:44.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.278+0000 7f9a9508e740 1 -- 172.21.15.37:0/2443751914 wait complete. 2024-09-19T06:06:44.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.278+0000 7f9a9508e740 1 -- start start 2024-09-19T06:06:44.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.279+0000 7f9a9508e740 1 Processor -- start 2024-09-19T06:06:44.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.279+0000 7f9a9508e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555cdaf71760 0x555cdaf80910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:44.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.279+0000 7f9a9508e740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cdaf72080 0x555cdaf80e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:44.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.279+0000 7f9a9508e740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555cdaf7c940 0x555cdaf81390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:44.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.279+0000 7f9a9508e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9a8c1afb30 con 0x555cdaf71760 2024-09-19T06:06:44.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.279+0000 7f9a9508e740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f9a8c1b0fa0 con 0x555cdaf7c940 2024-09-19T06:06:44.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.279+0000 7f9a9508e740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9a8c1b0200 con 0x555cdaf72080 2024-09-19T06:06:44.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.279+0000 7f9a9508e740 10 client.0 _ll_register_callbacks cb 0x7f9a780b8a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:06:44.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.279+0000 7f9a90a51640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555cdaf71760 0x555cdaf80910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:44.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.279+0000 7f9a8bfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cdaf72080 0x555cdaf80e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:44.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.279+0000 7f9a90a51640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555cdaf71760 0x555cdaf80910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53494/0 (socket says 172.21.15.37:53494) 2024-09-19T06:06:44.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.279+0000 7f9a90a51640 1 -- 172.21.15.37:0/2262292155 learned_addr learned my addr 172.21.15.37:0/2262292155 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:06:44.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.279+0000 7f9a91252640 1 --2- 172.21.15.37:0/2262292155 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555cdaf7c940 0x555cdaf81390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:44.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.280+0000 7f9a91252640 1 -- 172.21.15.37:0/2262292155 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cdaf72080 msgr2=0x555cdaf80e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:06:44.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.280+0000 7f9a91252640 1 --2- 172.21.15.37:0/2262292155 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cdaf72080 0x555cdaf80e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:44.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.280+0000 7f9a91252640 1 -- 172.21.15.37:0/2262292155 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555cdaf71760 msgr2=0x555cdaf80910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:06:44.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.280+0000 7f9a91252640 1 --2- 172.21.15.37:0/2262292155 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555cdaf71760 0x555cdaf80910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:44.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.280+0000 7f9a91252640 1 -- 172.21.15.37:0/2262292155 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555cdaffef00 con 0x555cdaf7c940 2024-09-19T06:06:44.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.280+0000 7f9a90a51640 1 --2- 172.21.15.37:0/2262292155 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555cdaf71760 0x555cdaf80910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:06:44.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.280+0000 7f9a91252640 1 --2- 172.21.15.37:0/2262292155 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555cdaf7c940 0x555cdaf81390 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9a84013fd0 tx=0x7f9a84004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8ac0324275804cb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:44.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.280+0000 7f9a6bfff640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-09-19T06:06:44.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.280+0000 7f9a6bfff640 1 -- 172.21.15.37:0/2262292155 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a8401f020 con 0x555cdaf7c940 2024-09-19T06:06:44.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.280+0000 7f9a9508e740 1 -- 172.21.15.37:0/2262292155 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9a80005460 con 0x555cdaf7c940 2024-09-19T06:06:44.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.280+0000 7f9a6bfff640 1 -- 172.21.15.37:0/2262292155 <== mon.2 v2:172.21.15.99:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9121+0+0 (secure 0 0 0) 0x7f9a8401f1c0 con 0x555cdaf7c940 2024-09-19T06:06:44.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.280+0000 7f9a6bfff640 1 -- 172.21.15.37:0/2262292155 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f9a84033050 con 0x555cdaf7c940 2024-09-19T06:06:44.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.281+0000 7f9a9508e740 10 client.24899 fetch_fsmap learned FSMap version 20 2024-09-19T06:06:44.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.281+0000 7f9a9508e740 1 -- 172.21.15.37:0/2262292155 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x555cdb000210 con 0x555cdaf7c940 2024-09-19T06:06:44.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.281+0000 7f9a6bfff640 1 -- 172.21.15.37:0/2262292155 <== mon.2 v2:172.21.15.99:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a80005460 con 0x555cdaf7c940 2024-09-19T06:06:44.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.281+0000 7f9a6bfff640 1 -- 172.21.15.37:0/2262292155 <== mon.2 v2:172.21.15.99:3300/0 5 ==== fsmap(e 20) ==== 8338+0+0 (secure 0 0 0) 0x7f9a8400f040 con 0x555cdaf7c940 2024-09-19T06:06:44.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.281+0000 7f9a9508e740 10 client.24899 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:06:44.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.281+0000 7f9a9508e740 10 client.24899 resolve_mds: validated gid 24485 aka daemon mds.b 2024-09-19T06:06:44.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.281+0000 7f9a9508e740 20 client.24899 populate_metadata read hostname 'smithi037' 2024-09-19T06:06:44.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.281+0000 7f9a9508e740 1 --2- 172.21.15.37:0/2262292155 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x555cdaf8c7c0 0x555cdb002a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:44.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.281+0000 7f9a9508e740 4 client.24899 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 131.2, "await_for": 45.0}] 2024-09-19T06:06:44.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.281+0000 7f9a9508e740 1 -- 172.21.15.37:0/2262292155 --> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 131.2, "await_for": 45.0}) -- 0x555cdaeded20 con 0x555cdaf8c7c0 2024-09-19T06:06:44.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.281+0000 7f9a90a51640 1 --2- 172.21.15.37:0/2262292155 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x555cdaf8c7c0 0x555cdb002a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:44.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.282+0000 7f9a6bfff640 10 client.24899 ms_handle_connect on v2:172.21.15.99:6838/3404812329 2024-09-19T06:06:44.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.282+0000 7f9a90a51640 1 --2- 172.21.15.37:0/2262292155 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x555cdaf8c7c0 0x555cdb002a30 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7521d94e2e284e4 server_cookie=1854b68861e4f791 in_seq=0 out_seq=0 2024-09-19T06:06:44.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.289+0000 7f9a6bfff640 1 -- 172.21.15.37:0/2262292155 <== mds.0 v2:172.21.15.99:6838/3404812329 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x555cdaeded20 con 0x555cdaf8c7c0 2024-09-19T06:06:44.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.289+0000 7f9a6bfff640 10 client.24899 handle_command_reply: tid=0 2024-09-19T06:06:44.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.289+0000 7f9a9508e740 1 client.24899 shutdown 2024-09-19T06:06:44.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.290+0000 7f9a9508e740 1 -- 172.21.15.37:0/2262292155 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555cdaf7c940 msgr2=0x555cdaf81390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:44.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.290+0000 7f9a9508e740 1 --2- 172.21.15.37:0/2262292155 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555cdaf7c940 0x555cdaf81390 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9a84013fd0 tx=0x7f9a84004a40 comp rx=0 tx=0).stop 2024-09-19T06:06:44.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.290+0000 7f9a9508e740 1 -- 172.21.15.37:0/2262292155 shutdown_connections 2024-09-19T06:06:44.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.290+0000 7f9a9508e740 1 --2- 172.21.15.37:0/2262292155 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x555cdaf8c7c0 0x555cdb002a30 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:44.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.290+0000 7f9a6bfff640 0 client.24899 ms_handle_reset on v2:172.21.15.99:6838/3404812329 2024-09-19T06:06:44.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.290+0000 7f9a9508e740 1 --2- 172.21.15.37:0/2262292155 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555cdaf7c940 0x555cdaf81390 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:44.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.290+0000 7f9a9508e740 1 --2- 172.21.15.37:0/2262292155 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555cdaf72080 0x555cdaf80e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:44.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.290+0000 7f9a9508e740 1 --2- 172.21.15.37:0/2262292155 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555cdaf71760 0x555cdaf80910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:44.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.290+0000 7f9a9508e740 1 -- 172.21.15.37:0/2262292155 >> 172.21.15.37:0/2262292155 conn(0x555cdaf6dcf0 msgr2=0x555cdaf73180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:44.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.290+0000 7f9a9508e740 1 -- 172.21.15.37:0/2262292155 shutdown_connections 2024-09-19T06:06:44.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.290+0000 7f9a9508e740 1 -- 172.21.15.37:0/2262292155 wait complete. 2024-09-19T06:06:44.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.290+0000 7f9a9508e740 20 client.24899 trim_cache size 0 max 16384 2024-09-19T06:06:44.292 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-19T06:06:44.293 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 20, 2024-09-19T06:06:44.293 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 24485, 2024-09-19T06:06:44.293 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 2, 2024-09-19T06:06:44.293 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": { 2024-09-19T06:06:44.293 INFO:teuthology.orchestra.run.smithi037.stdout: "34f9caab": { 2024-09-19T06:06:44.293 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 2, 2024-09-19T06:06:44.293 INFO:teuthology.orchestra.run.smithi037.stdout: "age_ref": 0.0, 2024-09-19T06:06:44.293 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-09-19T06:06:44.293 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "QUIESCED", 2024-09-19T06:06:44.293 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-09-19T06:06:44.293 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:06:44.293 INFO:teuthology.orchestra.run.smithi037.stdout: "timeout": 90.0, 2024-09-19T06:06:44.293 INFO:teuthology.orchestra.run.smithi037.stdout: "expiration": 131.2, 2024-09-19T06:06:44.294 INFO:teuthology.orchestra.run.smithi037.stdout: "members": { 2024-09-19T06:06:44.294 INFO:teuthology.orchestra.run.smithi037.stdout: "file:/": { 2024-09-19T06:06:44.294 INFO:teuthology.orchestra.run.smithi037.stdout: "excluded": false, 2024-09-19T06:06:44.294 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-09-19T06:06:44.294 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "QUIESCED", 2024-09-19T06:06:44.294 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-09-19T06:06:44.294 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:06:44.294 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:06:44.294 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:06:44.294 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:06:44.294 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:06:44.294 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-19T06:06:44.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.291+0000 7f9a92cb5640 1 -- 172.21.15.37:0/937918646 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f9a7c0a3240 msgr2=0x7f9a7c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:44.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.291+0000 7f9a92cb5640 1 --2- 172.21.15.37:0/937918646 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f9a7c0a3240 0x7f9a7c0a5700 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9a84005fd0 tx=0x7f9a840096e0 comp rx=0 tx=0).stop 2024-09-19T06:06:44.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.291+0000 7f9a92cb5640 1 -- 172.21.15.37:0/937918646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a8c102570 msgr2=0x7f9a8c0fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:44.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.291+0000 7f9a92cb5640 1 --2- 172.21.15.37:0/937918646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a8c102570 0x7f9a8c0fd1c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f9a78006010 tx=0x7f9a78003c10 comp rx=0 tx=0).stop 2024-09-19T06:06:44.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.291+0000 7f9a92cb5640 1 -- 172.21.15.37:0/937918646 shutdown_connections 2024-09-19T06:06:44.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.291+0000 7f9a92cb5640 1 --2- 172.21.15.37:0/937918646 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f9a7c0a3240 0x7f9a7c0a5700 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:44.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.291+0000 7f9a92cb5640 1 --2- 172.21.15.37:0/937918646 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a8c102ef0 0x7f9a8c0fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:44.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.291+0000 7f9a92cb5640 1 --2- 172.21.15.37:0/937918646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a8c102570 0x7f9a8c0fd1c0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:44.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.291+0000 7f9a92cb5640 1 --2- 172.21.15.37:0/937918646 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a8c100e20 0x7f9a8c0fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:44.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.291+0000 7f9a92cb5640 1 -- 172.21.15.37:0/937918646 >> 172.21.15.37:0/937918646 conn(0x7f9a8c0fc7d0 msgr2=0x7f9a8c06a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:44.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.291+0000 7f9a92cb5640 1 -- 172.21.15.37:0/937918646 shutdown_connections 2024-09-19T06:06:44.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:44.291+0000 7f9a92cb5640 1 -- 172.21.15.37:0/937918646 wait complete. 2024-09-19T06:06:44.959 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '34f9caab', quiesce took 3.2 seconds. Will release after: 7.999999999999999 2024-09-19T06:06:46.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:06:45 smithi037 ceph-mon[31211]: pgmap v367: 129 pgs: 129 active+clean; 650 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:06:46.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:06:45 smithi099 ceph-mon[35300]: pgmap v367: 129 pgs: 129 active+clean; 650 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:06:46.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:06:45 smithi117 ceph-mon[35050]: pgmap v367: 129 pgs: 129 active+clean; 650 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:06:48.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:06:47 smithi037 ceph-mon[31211]: pgmap v368: 129 pgs: 129 active+clean; 650 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:06:48.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:06:47 smithi099 ceph-mon[35300]: pgmap v368: 129 pgs: 129 active+clean; 650 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:06:48.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:06:47 smithi117 ceph-mon[35050]: pgmap v368: 129 pgs: 129 active+clean; 650 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:06:50.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:06:49 smithi037 ceph-mon[31211]: pgmap v369: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-19T06:06:50.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:06:49 smithi099 ceph-mon[35300]: pgmap v369: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-19T06:06:50.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:06:49 smithi117 ceph-mon[35050]: pgmap v369: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-19T06:06:52.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:06:51 smithi037 ceph-mon[31211]: pgmap v370: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 597 B/s wr, 1 op/s 2024-09-19T06:06:52.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:06:51 smithi099 ceph-mon[35300]: pgmap v370: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 597 B/s wr, 1 op/s 2024-09-19T06:06:52.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:06:51 smithi117 ceph-mon[35050]: pgmap v370: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 597 B/s wr, 1 op/s 2024-09-19T06:06:52.959 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:06:53.249 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:06:54.051 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:06:53 smithi117 ceph-mon[35050]: pgmap v371: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 597 B/s wr, 1 op/s 2024-09-19T06:06:54.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:06:53 smithi037 ceph-mon[31211]: pgmap v371: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 597 B/s wr, 1 op/s 2024-09-19T06:06:54.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:06:53 smithi099 ceph-mon[35300]: pgmap v371: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 597 B/s wr, 1 op/s 2024-09-19T06:06:54.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:54.612+0000 7fdd3c09a640 1 -- 172.21.15.37:0/2123927372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd341082a0 msgr2=0x7fdd3410ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:54.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:54.612+0000 7fdd3c09a640 1 --2- 172.21.15.37:0/2123927372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd341082a0 0x7fdd3410ec40 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c009cd0 tx=0x7fdd2c02a8e0 comp rx=0 tx=0).stop 2024-09-19T06:06:54.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:54.613+0000 7fdd3c09a640 1 -- 172.21.15.37:0/2123927372 shutdown_connections 2024-09-19T06:06:54.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:54.613+0000 7fdd3c09a640 1 --2- 172.21.15.37:0/2123927372 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdd341036e0 0x7fdd34107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:54.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:54.613+0000 7fdd3c09a640 1 --2- 172.21.15.37:0/2123927372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd341082a0 0x7fdd3410ec40 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:54.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:54.613+0000 7fdd3c09a640 1 --2- 172.21.15.37:0/2123927372 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd34102d30 0x7fdd34103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:54.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:54.613+0000 7fdd3c09a640 1 -- 172.21.15.37:0/2123927372 >> 172.21.15.37:0/2123927372 conn(0x7fdd340fc7d0 msgr2=0x7fdd340febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:54.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:54.613+0000 7fdd3c09a640 1 -- 172.21.15.37:0/2123927372 shutdown_connections 2024-09-19T06:06:54.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:54.613+0000 7fdd3c09a640 1 -- 172.21.15.37:0/2123927372 wait complete. 2024-09-19T06:06:54.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:54.614+0000 7fdd3c09a640 1 Processor -- start 2024-09-19T06:06:54.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:54.614+0000 7fdd3c09a640 1 -- start start 2024-09-19T06:06:54.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:54.614+0000 7fdd3c09a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdd34102d30 0x7fdd34100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:54.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:54.614+0000 7fdd3c09a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd341036e0 0x7fdd34100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:54.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:54.614+0000 7fdd3c09a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd341082a0 0x7fdd34101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:54.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:54.614+0000 7fdd3c09a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdd341120f0 con 0x7fdd341036e0 2024-09-19T06:06:54.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:54.614+0000 7fdd3c09a640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fdd34111f70 con 0x7fdd34102d30 2024-09-19T06:06:54.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:54.614+0000 7fdd3c09a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fdd34112270 con 0x7fdd341082a0 2024-09-19T06:06:54.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:54.614+0000 7fdd39e36640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdd34102d30 0x7fdd34100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:54.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:54.614+0000 7fdd39e36640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdd34102d30 0x7fdd34100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.37:55130/0 (socket says 172.21.15.37:55130) 2024-09-19T06:06:54.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:54.615+0000 7fdd39e36640 1 -- 172.21.15.37:0/1466424187 learned_addr learned my addr 172.21.15.37:0/1466424187 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:06:54.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:54.615+0000 7fdd39635640 1 --2- 172.21.15.37:0/1466424187 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd341036e0 0x7fdd34100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:54.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:54.615+0000 7fdd3a637640 1 --2- 172.21.15.37:0/1466424187 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd341082a0 0x7fdd34101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:54.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:54.615+0000 7fdd39e36640 1 -- 172.21.15.37:0/1466424187 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd341082a0 msgr2=0x7fdd34101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:54.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:54.615+0000 7fdd39e36640 1 --2- 172.21.15.37:0/1466424187 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd341082a0 0x7fdd34101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:54.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:54.615+0000 7fdd39e36640 1 -- 172.21.15.37:0/1466424187 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd341036e0 msgr2=0x7fdd34100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:54.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:54.615+0000 7fdd39e36640 1 --2- 172.21.15.37:0/1466424187 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd341036e0 0x7fdd34100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:54.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:54.615+0000 7fdd39e36640 1 -- 172.21.15.37:0/1466424187 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd341a6a50 con 0x7fdd34102d30 2024-09-19T06:06:54.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:54.615+0000 7fdd3a637640 1 --2- 172.21.15.37:0/1466424187 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd341082a0 0x7fdd34101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:06:54.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:54.615+0000 7fdd39e36640 1 --2- 172.21.15.37:0/1466424187 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdd34102d30 0x7fdd34100990 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdd3000d770 tx=0x7fdd3000dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:54.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:54.615+0000 7fdd2affd640 1 -- 172.21.15.37:0/1466424187 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd30017070 con 0x7fdd34102d30 2024-09-19T06:06:54.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:54.615+0000 7fdd2affd640 1 -- 172.21.15.37:0/1466424187 <== mon.2 v2:172.21.15.99:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd30005500 con 0x7fdd34102d30 2024-09-19T06:06:54.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:54.615+0000 7fdd2affd640 1 -- 172.21.15.37:0/1466424187 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd30004e00 con 0x7fdd34102d30 2024-09-19T06:06:54.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:54.615+0000 7fdd3c09a640 1 -- 172.21.15.37:0/1466424187 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd341a6d40 con 0x7fdd34102d30 2024-09-19T06:06:54.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:54.616+0000 7fdd3c09a640 1 -- 172.21.15.37:0/1466424187 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd341a71d0 con 0x7fdd34102d30 2024-09-19T06:06:54.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:54.617+0000 7fdd3c09a640 1 -- 172.21.15.37:0/1466424187 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd34103110 con 0x7fdd34102d30 2024-09-19T06:06:54.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:54.619+0000 7fdd2affd640 1 -- 172.21.15.37:0/1466424187 <== mon.2 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fdd30004fa0 con 0x7fdd34102d30 2024-09-19T06:06:54.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:54.620+0000 7fdd2affd640 1 --2- 172.21.15.37:0/1466424187 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fdd200a32c0 0x7fdd200a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:54.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:54.620+0000 7fdd39635640 1 --2- 172.21.15.37:0/1466424187 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fdd200a32c0 0x7fdd200a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:54.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:54.620+0000 7fdd2affd640 1 -- 172.21.15.37:0/1466424187 <== mon.2 v2:172.21.15.99:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9121+0+0 (secure 0 0 0) 0x7fdd300cfaa0 con 0x7fdd34102d30 2024-09-19T06:06:54.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:54.620+0000 7fdd39635640 1 --2- 172.21.15.37:0/1466424187 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fdd200a32c0 0x7fdd200a5780 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fdd34102420 tx=0x7fdd2400b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:54.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:54.623+0000 7fdd2affd640 1 -- 172.21.15.37:0/1466424187 <== mon.2 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdd3009c460 con 0x7fdd34102d30 2024-09-19T06:06:54.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:54.934+0000 7fdd3c09a640 1 -- 172.21.15.37:0/1466424187 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdd34101ec0 con 0x7fdd34102d30 2024-09-19T06:06:54.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:54.935+0000 7fdd2affd640 1 -- 172.21.15.37:0/1466424187 <== mon.2 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11842 (secure 0 0 0) 0x7fdd3009bd60 con 0x7fdd34102d30 2024-09-19T06:06:54.937 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T06:06:54.937 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"btime":"2024-09-19T06:04:42:531480+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14514,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2864247978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2864247978},{"type":"v1","addr":"172.21.15.37:6835","nonce":2864247978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14526,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/633000932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":633000932},{"type":"v1","addr":"172.21.15.37:6837","nonce":633000932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14574,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/3753800615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":3753800615},{"type":"v1","addr":"172.21.15.37:6839","nonce":3753800615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/2718998355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":2718998355},{"type":"v1","addr":"172.21.15.37:6841","nonce":2718998355}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6833/866590207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":866590207},{"type":"v1","addr":"172.21.15.99:6833","nonce":866590207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3898668400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3898668400},{"type":"v1","addr":"172.21.15.117:6833","nonce":3898668400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2650673320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2650673320},{"type":"v1","addr":"172.21.15.99:6835","nonce":2650673320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1097471349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1097471349},{"type":"v1","addr":"172.21.15.117:6835","nonce":1097471349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24457,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1001392672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1001392672},{"type":"v1","addr":"172.21.15.117:6837","nonce":1001392672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/23570935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":23570935},{"type":"v1","addr":"172.21.15.99:6837","nonce":23570935}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:04:06.253034+0000","modified":"2024-09-19T06:04:42.196783+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24485},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24478":{"gid":24478,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6839/1269518339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":1269518339},{"type":"v1","addr":"172.21.15.117:6839","nonce":1269518339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.99:6839/3404812329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":3404812329},{"type":"v1","addr":"172.21.15.99:6839","nonce":3404812329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24485,"qdb_cluster":[24485]},"id":1}]} 2024-09-19T06:06:54.938 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 20 2024-09-19T06:06:54.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:54.938+0000 7fdd3c09a640 1 -- 172.21.15.37:0/1466424187 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fdd200a32c0 msgr2=0x7fdd200a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:54.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:54.938+0000 7fdd3c09a640 1 --2- 172.21.15.37:0/1466424187 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fdd200a32c0 0x7fdd200a5780 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fdd34102420 tx=0x7fdd2400b390 comp rx=0 tx=0).stop 2024-09-19T06:06:54.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:54.938+0000 7fdd3c09a640 1 -- 172.21.15.37:0/1466424187 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdd34102d30 msgr2=0x7fdd34100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:54.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:54.938+0000 7fdd3c09a640 1 --2- 172.21.15.37:0/1466424187 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdd34102d30 0x7fdd34100990 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdd3000d770 tx=0x7fdd3000dc30 comp rx=0 tx=0).stop 2024-09-19T06:06:54.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:54.938+0000 7fdd3c09a640 1 -- 172.21.15.37:0/1466424187 shutdown_connections 2024-09-19T06:06:54.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:54.939+0000 7fdd3c09a640 1 --2- 172.21.15.37:0/1466424187 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fdd200a32c0 0x7fdd200a5780 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:54.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:54.939+0000 7fdd3c09a640 1 --2- 172.21.15.37:0/1466424187 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd341082a0 0x7fdd34101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:54.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:54.939+0000 7fdd3c09a640 1 --2- 172.21.15.37:0/1466424187 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd341036e0 0x7fdd34100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:54.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:54.939+0000 7fdd3c09a640 1 --2- 172.21.15.37:0/1466424187 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdd34102d30 0x7fdd34100990 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:54.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:54.939+0000 7fdd3c09a640 1 -- 172.21.15.37:0/1466424187 >> 172.21.15.37:0/1466424187 conn(0x7fdd340fc7d0 msgr2=0x7fdd34106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:54.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:54.939+0000 7fdd3c09a640 1 -- 172.21.15.37:0/1466424187 shutdown_connections 2024-09-19T06:06:54.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:54.939+0000 7fdd3c09a640 1 -- 172.21.15.37:0/1466424187 wait complete. 2024-09-19T06:06:55.752 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24485 quiesce db --set-id 34f9caab --release --await' 2024-09-19T06:06:55.753 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24485 quiesce db --set-id 34f9caab --release --await 2024-09-19T06:06:56.054 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:06:56.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:06:55 smithi037 ceph-mon[31211]: pgmap v372: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-19T06:06:56.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:06:55 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/1466424187' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:06:56.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:06:55 smithi099 ceph-mon[35300]: pgmap v372: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-19T06:06:56.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:06:55 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/1466424187' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:06:56.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:06:55 smithi117 ceph-mon[35050]: pgmap v372: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-19T06:06:56.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:06:55 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/1466424187' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:06:56.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.559+0000 7fa78851d640 1 -- 172.21.15.37:0/1542182268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa780102570 msgr2=0x7fa7801029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:56.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.559+0000 7fa78851d640 1 --2- 172.21.15.37:0/1542182268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa780102570 0x7fa7801029b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa770009900 tx=0x7fa77002a480 comp rx=0 tx=0).stop 2024-09-19T06:06:56.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.560+0000 7fa78851d640 1 -- 172.21.15.37:0/1542182268 shutdown_connections 2024-09-19T06:06:56.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.560+0000 7fa78851d640 1 --2- 172.21.15.37:0/1542182268 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa780102ef0 0x7fa78010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:56.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.560+0000 7fa78851d640 1 --2- 172.21.15.37:0/1542182268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa780102570 0x7fa7801029b0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:56.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.560+0000 7fa78851d640 1 --2- 172.21.15.37:0/1542182268 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa780100e20 0x7fa780101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:56.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.560+0000 7fa78851d640 1 -- 172.21.15.37:0/1542182268 >> 172.21.15.37:0/1542182268 conn(0x7fa7800fc7d0 msgr2=0x7fa7800febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:56.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.560+0000 7fa78851d640 1 -- 172.21.15.37:0/1542182268 shutdown_connections 2024-09-19T06:06:56.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.560+0000 7fa78851d640 1 -- 172.21.15.37:0/1542182268 wait complete. 2024-09-19T06:06:56.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.561+0000 7fa78851d640 1 Processor -- start 2024-09-19T06:06:56.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.561+0000 7fa78851d640 1 -- start start 2024-09-19T06:06:56.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.561+0000 7fa78851d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa780100e20 0x7fa780197110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:56.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.561+0000 7fa78851d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa780102570 0x7fa780197650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:56.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.561+0000 7fa78851d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa780102ef0 0x7fa780197b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:56.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.561+0000 7fa786aba640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa780102ef0 0x7fa780197b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:56.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.561+0000 7fa7862b9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa780100e20 0x7fa780197110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:56.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.561+0000 7fa786aba640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa780102ef0 0x7fa780197b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37910/0 (socket says 172.21.15.37:37910) 2024-09-19T06:06:56.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.561+0000 7fa786aba640 1 -- 172.21.15.37:0/395026480 learned_addr learned my addr 172.21.15.37:0/395026480 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:06:56.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.561+0000 7fa7862b9640 1 --2- 172.21.15.37:0/395026480 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa780100e20 0x7fa780197110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.37:57274/0 (socket says 172.21.15.37:57274) 2024-09-19T06:06:56.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.561+0000 7fa78851d640 1 -- 172.21.15.37:0/395026480 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa780110f50 con 0x7fa780102ef0 2024-09-19T06:06:56.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.561+0000 7fa78851d640 1 -- 172.21.15.37:0/395026480 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fa780110dd0 con 0x7fa780102570 2024-09-19T06:06:56.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.561+0000 7fa78851d640 1 -- 172.21.15.37:0/395026480 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa7801110d0 con 0x7fa780100e20 2024-09-19T06:06:56.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.561+0000 7fa785ab8640 1 --2- 172.21.15.37:0/395026480 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa780102570 0x7fa780197650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:56.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.562+0000 7fa786aba640 1 -- 172.21.15.37:0/395026480 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa780100e20 msgr2=0x7fa780197110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:56.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.562+0000 7fa786aba640 1 --2- 172.21.15.37:0/395026480 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa780100e20 0x7fa780197110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:56.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.562+0000 7fa786aba640 1 -- 172.21.15.37:0/395026480 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa780102570 msgr2=0x7fa780197650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:56.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.562+0000 7fa786aba640 1 --2- 172.21.15.37:0/395026480 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa780102570 0x7fa780197650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:56.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.562+0000 7fa786aba640 1 -- 172.21.15.37:0/395026480 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7801a6980 con 0x7fa780102ef0 2024-09-19T06:06:56.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.562+0000 7fa786aba640 1 --2- 172.21.15.37:0/395026480 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa780102ef0 0x7fa780197b90 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa77800eb10 tx=0x7fa77800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:56.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.562+0000 7fa7777fe640 1 -- 172.21.15.37:0/395026480 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa778004b20 con 0x7fa780102ef0 2024-09-19T06:06:56.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.562+0000 7fa7777fe640 1 -- 172.21.15.37:0/395026480 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa778004cc0 con 0x7fa780102ef0 2024-09-19T06:06:56.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.562+0000 7fa78851d640 1 -- 172.21.15.37:0/395026480 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7801a6c70 con 0x7fa780102ef0 2024-09-19T06:06:56.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.562+0000 7fa78851d640 1 -- 172.21.15.37:0/395026480 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7801a7180 con 0x7fa780102ef0 2024-09-19T06:06:56.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.562+0000 7fa7777fe640 1 -- 172.21.15.37:0/395026480 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa778010760 con 0x7fa780102ef0 2024-09-19T06:06:56.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.565+0000 7fa7777fe640 1 -- 172.21.15.37:0/395026480 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fa778005020 con 0x7fa780102ef0 2024-09-19T06:06:56.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.566+0000 7fa78a8f6740 1 Processor -- start 2024-09-19T06:06:56.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.566+0000 7fa78a8f6740 1 -- start start 2024-09-19T06:06:56.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.566+0000 7fa78a8f6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612c5327060 0x5612c5327440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:56.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.566+0000 7fa78a8f6740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5612c5327980 0x5612c5331d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:56.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.566+0000 7fa7777fe640 1 --2- 172.21.15.37:0/395026480 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fa76c0a32c0 0x7fa76c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:56.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.566+0000 7fa78a8f6740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612c5332240 0x5612c5334630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:56.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.566+0000 7fa78a8f6740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5612c528c620 con 0x5612c5327060 2024-09-19T06:06:56.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.566+0000 7fa78a8f6740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5612c5233e50 con 0x5612c5332240 2024-09-19T06:06:56.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.566+0000 7fa78a8f6740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5612c52885e0 con 0x5612c5327980 2024-09-19T06:06:56.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.566+0000 7fa786aba640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612c5332240 0x5612c5334630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:56.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.566+0000 7fa7862b9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5612c5327980 0x5612c5331d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:56.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.566+0000 7fa785ab8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612c5327060 0x5612c5327440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:56.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.567+0000 7fa7862b9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5612c5327980 0x5612c5331d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.37:57290/0 (socket says 172.21.15.37:57290) 2024-09-19T06:06:56.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.567+0000 7fa7862b9640 1 -- 172.21.15.37:0/881113182 learned_addr learned my addr 172.21.15.37:0/881113182 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:06:56.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.567+0000 7fa785ab8640 1 --2- 172.21.15.37:0/395026480 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fa76c0a32c0 0x7fa76c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:56.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.567+0000 7fa7777fe640 1 -- 172.21.15.37:0/395026480 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9121+0+0 (secure 0 0 0) 0x7fa7780d01c0 con 0x7fa780102ef0 2024-09-19T06:06:56.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.567+0000 7fa786aba640 1 -- 172.21.15.37:0/881113182 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5612c5327980 msgr2=0x5612c5331d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:06:56.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.567+0000 7fa786aba640 1 --2- 172.21.15.37:0/881113182 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5612c5327980 0x5612c5331d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:56.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.567+0000 7fa786aba640 1 -- 172.21.15.37:0/881113182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612c5327060 msgr2=0x5612c5327440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:06:56.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.567+0000 7fa786aba640 1 --2- 172.21.15.37:0/881113182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612c5327060 0x5612c5327440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:56.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.567+0000 7fa786aba640 1 -- 172.21.15.37:0/881113182 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612c5224d40 con 0x5612c5332240 2024-09-19T06:06:56.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.567+0000 7fa7862b9640 1 --2- 172.21.15.37:0/881113182 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5612c5327980 0x5612c5331d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:06:56.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.567+0000 7fa786aba640 1 --2- 172.21.15.37:0/881113182 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612c5332240 0x5612c5334630 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa778096fd0 tx=0x7fa77806e230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73e682dff59c33e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:56.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.567+0000 7fa774ff9640 1 -- 172.21.15.37:0/881113182 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa77809bfa0 con 0x5612c5332240 2024-09-19T06:06:56.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.568+0000 7fa774ff9640 1 -- 172.21.15.37:0/881113182 <== mon.2 v2:172.21.15.99:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa77809cb60 con 0x5612c5332240 2024-09-19T06:06:56.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.568+0000 7fa774ff9640 1 -- 172.21.15.37:0/881113182 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa77809bdc0 con 0x5612c5332240 2024-09-19T06:06:56.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.568+0000 7fa78a8f6740 1 -- 172.21.15.37:0/881113182 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612c5332240 msgr2=0x5612c5334630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:56.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.568+0000 7fa78a8f6740 1 --2- 172.21.15.37:0/881113182 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612c5332240 0x5612c5334630 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa778096fd0 tx=0x7fa77806e230 comp rx=0 tx=0).stop 2024-09-19T06:06:56.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.568+0000 7fa785ab8640 1 --2- 172.21.15.37:0/395026480 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fa76c0a32c0 0x7fa76c0a5780 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa770009230 tx=0x7fa770005bb0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:56.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.568+0000 7fa78a8f6740 1 -- 172.21.15.37:0/881113182 shutdown_connections 2024-09-19T06:06:56.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.568+0000 7fa78a8f6740 1 --2- 172.21.15.37:0/881113182 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612c5332240 0x5612c5334630 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:56.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.568+0000 7fa78a8f6740 1 --2- 172.21.15.37:0/881113182 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5612c5327980 0x5612c5331d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:56.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.568+0000 7fa78a8f6740 1 --2- 172.21.15.37:0/881113182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612c5327060 0x5612c5327440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:56.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.568+0000 7fa78a8f6740 1 -- 172.21.15.37:0/881113182 >> 172.21.15.37:0/881113182 conn(0x5612c53235f0 msgr2=0x5612c53239d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:56.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.569+0000 7fa78a8f6740 1 -- 172.21.15.37:0/881113182 shutdown_connections 2024-09-19T06:06:56.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.569+0000 7fa78a8f6740 1 -- 172.21.15.37:0/881113182 wait complete. 2024-09-19T06:06:56.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.569+0000 7fa78a8f6740 1 -- start start 2024-09-19T06:06:56.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.569+0000 7fa78a8f6740 1 Processor -- start 2024-09-19T06:06:56.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.569+0000 7fa78a8f6740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612c5327980 0x5612c532f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:56.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.569+0000 7fa78a8f6740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5612c5332240 0x5612c532f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:56.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.569+0000 7fa78a8f6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612c532fcc0 0x5612c5346a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:56.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.570+0000 7fa78a8f6740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5612c5334e10 con 0x5612c532fcc0 2024-09-19T06:06:56.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.570+0000 7fa78a8f6740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5612c5214f10 con 0x5612c5327980 2024-09-19T06:06:56.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.570+0000 7fa78a8f6740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5612c5334f90 con 0x5612c5332240 2024-09-19T06:06:56.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.570+0000 7fa78a8f6740 10 client.0 _ll_register_callbacks cb 0x5612c5238db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:06:56.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.570+0000 7fa786aba640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612c532fcc0 0x5612c5346a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:56.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.570+0000 7fa786aba640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612c532fcc0 0x5612c5346a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37936/0 (socket says 172.21.15.37:37936) 2024-09-19T06:06:56.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.570+0000 7fa786aba640 1 -- 172.21.15.37:0/2141845096 learned_addr learned my addr 172.21.15.37:0/2141845096 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:06:56.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.570+0000 7fa7862b9640 1 --2- 172.21.15.37:0/2141845096 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612c5327980 0x5612c532f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:56.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.570+0000 7fa785ab8640 1 --2- 172.21.15.37:0/2141845096 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5612c5332240 0x5612c532f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:56.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.570+0000 7fa7862b9640 1 -- 172.21.15.37:0/2141845096 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5612c5332240 msgr2=0x5612c532f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:06:56.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.570+0000 7fa7862b9640 1 --2- 172.21.15.37:0/2141845096 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5612c5332240 0x5612c532f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:56.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.570+0000 7fa7862b9640 1 -- 172.21.15.37:0/2141845096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612c532fcc0 msgr2=0x5612c5346a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:06:56.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.570+0000 7fa7862b9640 1 --2- 172.21.15.37:0/2141845096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612c532fcc0 0x5612c5346a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:56.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.570+0000 7fa7862b9640 1 -- 172.21.15.37:0/2141845096 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612c4f9b580 con 0x5612c5327980 2024-09-19T06:06:56.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.570+0000 7fa786aba640 1 --2- 172.21.15.37:0/2141845096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612c532fcc0 0x5612c5346a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:06:56.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.570+0000 7fa785ab8640 1 --2- 172.21.15.37:0/2141845096 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5612c5332240 0x5612c532f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:06:56.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.570+0000 7fa7862b9640 1 --2- 172.21.15.37:0/2141845096 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612c5327980 0x5612c532f240 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa77c00bac0 tx=0x7fa77c00bf80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fba41f03395395c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:56.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.570+0000 7fa769ffb640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-09-19T06:06:56.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.571+0000 7fa769ffb640 1 -- 172.21.15.37:0/2141845096 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa77c003e20 con 0x5612c5327980 2024-09-19T06:06:56.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.571+0000 7fa78a8f6740 1 -- 172.21.15.37:0/2141845096 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa77809cb60 con 0x5612c5327980 2024-09-19T06:06:56.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.571+0000 7fa769ffb640 1 -- 172.21.15.37:0/2141845096 <== mon.2 v2:172.21.15.99:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9121+0+0 (secure 0 0 0) 0x7fa77c011440 con 0x5612c5327980 2024-09-19T06:06:56.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.571+0000 7fa769ffb640 1 -- 172.21.15.37:0/2141845096 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fa77c011640 con 0x5612c5327980 2024-09-19T06:06:56.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.571+0000 7fa78a8f6740 10 client.24917 fetch_fsmap learned FSMap version 20 2024-09-19T06:06:56.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.571+0000 7fa78a8f6740 1 -- 172.21.15.37:0/2141845096 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5612c5065960 con 0x5612c5327980 2024-09-19T06:06:56.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.571+0000 7fa769ffb640 1 -- 172.21.15.37:0/2141845096 <== mon.2 v2:172.21.15.99:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa77809cb60 con 0x5612c5327980 2024-09-19T06:06:56.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.571+0000 7fa769ffb640 1 -- 172.21.15.37:0/2141845096 <== mon.2 v2:172.21.15.99:3300/0 5 ==== fsmap(e 20) ==== 8338+0+0 (secure 0 0 0) 0x7fa77c01ba90 con 0x5612c5327980 2024-09-19T06:06:56.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.571+0000 7fa78a8f6740 10 client.24917 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:06:56.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.571+0000 7fa78a8f6740 10 client.24917 resolve_mds: validated gid 24485 aka daemon mds.b 2024-09-19T06:06:56.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.571+0000 7fa78a8f6740 20 client.24917 populate_metadata read hostname 'smithi037' 2024-09-19T06:06:56.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.571+0000 7fa78a8f6740 1 --2- 172.21.15.37:0/2141845096 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x5612c534aab0 0x5612c534cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:56.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.571+0000 7fa78a8f6740 4 client.24917 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:06:56.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.571+0000 7fa78a8f6740 1 -- 172.21.15.37:0/2141845096 --> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5612c5299b90 con 0x5612c534aab0 2024-09-19T06:06:56.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.572+0000 7fa785ab8640 1 --2- 172.21.15.37:0/2141845096 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x5612c534aab0 0x5612c534cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:56.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.572+0000 7fa785ab8640 1 --2- 172.21.15.37:0/2141845096 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x5612c534aab0 0x5612c534cf30 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c15ecc67685532 server_cookie=38c438fe51e37298 in_seq=0 out_seq=0 2024-09-19T06:06:56.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.572+0000 7fa769ffb640 10 client.24917 ms_handle_connect on v2:172.21.15.99:6838/3404812329 2024-09-19T06:06:56.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.573+0000 7fa769ffb640 1 -- 172.21.15.37:0/2141845096 <== mds.0 v2:172.21.15.99:6838/3404812329 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5612c5299b90 con 0x5612c534aab0 2024-09-19T06:06:56.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.573+0000 7fa769ffb640 10 client.24917 handle_command_reply: tid=0 2024-09-19T06:06:56.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.573+0000 7fa78a8f6740 1 client.24917 shutdown 2024-09-19T06:06:56.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.573+0000 7fa78a8f6740 1 -- 172.21.15.37:0/2141845096 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612c5327980 msgr2=0x5612c532f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:56.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.573+0000 7fa78a8f6740 1 --2- 172.21.15.37:0/2141845096 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612c5327980 0x5612c532f240 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa77c00bac0 tx=0x7fa77c00bf80 comp rx=0 tx=0).stop 2024-09-19T06:06:56.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.573+0000 7fa78a8f6740 1 -- 172.21.15.37:0/2141845096 shutdown_connections 2024-09-19T06:06:56.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.573+0000 7fa78a8f6740 1 --2- 172.21.15.37:0/2141845096 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x5612c534aab0 0x5612c534cf30 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:56.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.573+0000 7fa78a8f6740 1 --2- 172.21.15.37:0/2141845096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612c532fcc0 0x5612c5346a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:56.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.573+0000 7fa78a8f6740 1 --2- 172.21.15.37:0/2141845096 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5612c5332240 0x5612c532f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:56.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.573+0000 7fa769ffb640 0 client.24917 ms_handle_reset on v2:172.21.15.99:6838/3404812329 2024-09-19T06:06:56.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.574+0000 7fa78a8f6740 1 --2- 172.21.15.37:0/2141845096 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612c5327980 0x5612c532f240 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:56.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.574+0000 7fa78a8f6740 1 -- 172.21.15.37:0/2141845096 >> 172.21.15.37:0/2141845096 conn(0x5612c53235f0 msgr2=0x5612c5329320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:56.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.574+0000 7fa78a8f6740 1 -- 172.21.15.37:0/2141845096 shutdown_connections 2024-09-19T06:06:56.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.574+0000 7fa78a8f6740 1 -- 172.21.15.37:0/2141845096 wait complete. 2024-09-19T06:06:56.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.574+0000 7fa78a8f6740 20 client.24917 trim_cache size 0 max 16384 2024-09-19T06:06:56.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.608+0000 7fa78a8f6740 1 Processor -- start 2024-09-19T06:06:56.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.608+0000 7fa78a8f6740 1 -- start start 2024-09-19T06:06:56.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.608+0000 7fa78a8f6740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612c5327980 0x5612c5346900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:56.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.608+0000 7fa78a8f6740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5612c532fcc0 0x5612c5352850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:56.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.608+0000 7fa78a8f6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612c5332240 0x5612c5352d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:56.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.608+0000 7fa78a8f6740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa7801aaa20 con 0x5612c5332240 2024-09-19T06:06:56.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.608+0000 7fa78a8f6740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fa7801ad2a0 con 0x5612c5327980 2024-09-19T06:06:56.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.608+0000 7fa78a8f6740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa7801ab090 con 0x5612c532fcc0 2024-09-19T06:06:56.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.608+0000 7fa786aba640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612c5332240 0x5612c5352d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:56.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.608+0000 7fa786aba640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612c5332240 0x5612c5352d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37944/0 (socket says 172.21.15.37:37944) 2024-09-19T06:06:56.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.608+0000 7fa786aba640 1 -- 172.21.15.37:0/3077451454 learned_addr learned my addr 172.21.15.37:0/3077451454 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:06:56.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.608+0000 7fa785ab8640 1 --2- 172.21.15.37:0/3077451454 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5612c532fcc0 0x5612c5352850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:56.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.608+0000 7fa7862b9640 1 --2- 172.21.15.37:0/3077451454 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612c5327980 0x5612c5346900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:56.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.609+0000 7fa786aba640 1 -- 172.21.15.37:0/3077451454 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5612c532fcc0 msgr2=0x5612c5352850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:06:56.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.609+0000 7fa786aba640 1 --2- 172.21.15.37:0/3077451454 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5612c532fcc0 0x5612c5352850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:56.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.609+0000 7fa786aba640 1 -- 172.21.15.37:0/3077451454 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612c5327980 msgr2=0x5612c5346900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:06:56.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.609+0000 7fa786aba640 1 --2- 172.21.15.37:0/3077451454 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612c5327980 0x5612c5346900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:56.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.609+0000 7fa786aba640 1 -- 172.21.15.37:0/3077451454 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612c53277b0 con 0x5612c5332240 2024-09-19T06:06:56.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.609+0000 7fa786aba640 1 --2- 172.21.15.37:0/3077451454 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612c5332240 0x5612c5352d90 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa77809c160 tx=0x7fa77800efd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34fde65f3e482fc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:56.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.609+0000 7fa76bfff640 1 -- 172.21.15.37:0/3077451454 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa77809c460 con 0x5612c5332240 2024-09-19T06:06:56.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.609+0000 7fa76bfff640 1 -- 172.21.15.37:0/3077451454 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa7780a50d0 con 0x5612c5332240 2024-09-19T06:06:56.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.609+0000 7fa76bfff640 1 -- 172.21.15.37:0/3077451454 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7780a4c40 con 0x5612c5332240 2024-09-19T06:06:56.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.610+0000 7fa78a8f6740 1 -- 172.21.15.37:0/3077451454 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612c5332240 msgr2=0x5612c5352d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:56.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.610+0000 7fa78a8f6740 1 --2- 172.21.15.37:0/3077451454 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612c5332240 0x5612c5352d90 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa77809c160 tx=0x7fa77800efd0 comp rx=0 tx=0).stop 2024-09-19T06:06:56.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.610+0000 7fa78a8f6740 1 -- 172.21.15.37:0/3077451454 shutdown_connections 2024-09-19T06:06:56.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.610+0000 7fa78a8f6740 1 --2- 172.21.15.37:0/3077451454 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612c5332240 0x5612c5352d90 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:56.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.610+0000 7fa78a8f6740 1 --2- 172.21.15.37:0/3077451454 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5612c532fcc0 0x5612c5352850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:56.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.610+0000 7fa78a8f6740 1 --2- 172.21.15.37:0/3077451454 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612c5327980 0x5612c5346900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:56.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.610+0000 7fa78a8f6740 1 -- 172.21.15.37:0/3077451454 >> 172.21.15.37:0/3077451454 conn(0x5612c53235f0 msgr2=0x5612c532e330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:56.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.610+0000 7fa78a8f6740 1 -- 172.21.15.37:0/3077451454 shutdown_connections 2024-09-19T06:06:56.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.610+0000 7fa78a8f6740 1 -- 172.21.15.37:0/3077451454 wait complete. 2024-09-19T06:06:56.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.610+0000 7fa78a8f6740 1 -- start start 2024-09-19T06:06:56.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.611+0000 7fa78a8f6740 1 Processor -- start 2024-09-19T06:06:56.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.611+0000 7fa78a8f6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612c5327980 0x5612c533e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:56.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.611+0000 7fa78a8f6740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612c532fcc0 0x5612c533ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:56.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.611+0000 7fa78a8f6740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5612c5332240 0x5612c533f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:56.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.611+0000 7fa78a8f6740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa7801ab760 con 0x5612c5327980 2024-09-19T06:06:56.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.611+0000 7fa78a8f6740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fa7801acbd0 con 0x5612c532fcc0 2024-09-19T06:06:56.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.611+0000 7fa78a8f6740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa7801abe30 con 0x5612c5332240 2024-09-19T06:06:56.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.611+0000 7fa78a8f6740 10 client.0 _ll_register_callbacks cb 0x7fa77c0043e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:06:56.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.611+0000 7fa7862b9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612c5327980 0x5612c533e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:56.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.611+0000 7fa7862b9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612c5327980 0x5612c533e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37946/0 (socket says 172.21.15.37:37946) 2024-09-19T06:06:56.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.611+0000 7fa7862b9640 1 -- 172.21.15.37:0/193211237 learned_addr learned my addr 172.21.15.37:0/193211237 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:06:56.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.611+0000 7fa785ab8640 1 --2- 172.21.15.37:0/193211237 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612c532fcc0 0x5612c533ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:56.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.611+0000 7fa7862b9640 1 -- 172.21.15.37:0/193211237 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5612c5332240 msgr2=0x5612c533f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:06:56.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.611+0000 7fa786aba640 1 --2- 172.21.15.37:0/193211237 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5612c5332240 0x5612c533f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:56.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.611+0000 7fa7862b9640 1 --2- 172.21.15.37:0/193211237 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5612c5332240 0x5612c533f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:56.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.611+0000 7fa7862b9640 1 -- 172.21.15.37:0/193211237 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612c532fcc0 msgr2=0x5612c533ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:06:56.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.612+0000 7fa7862b9640 1 --2- 172.21.15.37:0/193211237 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612c532fcc0 0x5612c533ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:56.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.612+0000 7fa7862b9640 1 -- 172.21.15.37:0/193211237 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612c53b4820 con 0x5612c5327980 2024-09-19T06:06:56.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.612+0000 7fa7862b9640 1 --2- 172.21.15.37:0/193211237 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612c5327980 0x5612c533e720 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa77c01bf00 tx=0x7fa77c0042a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcd28147cd0405b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:56.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.612+0000 7fa769ffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-19T06:06:56.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.612+0000 7fa769ffb640 1 -- 172.21.15.37:0/193211237 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa77c02d070 con 0x5612c5327980 2024-09-19T06:06:56.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.612+0000 7fa769ffb640 1 -- 172.21.15.37:0/193211237 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9121+0+0 (secure 0 0 0) 0x7fa77c010940 con 0x5612c5327980 2024-09-19T06:06:56.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.612+0000 7fa78a8f6740 1 -- 172.21.15.37:0/193211237 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa7780a50d0 con 0x5612c5327980 2024-09-19T06:06:56.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.612+0000 7fa769ffb640 1 -- 172.21.15.37:0/193211237 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fa77c039050 con 0x5612c5327980 2024-09-19T06:06:56.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.612+0000 7fa78a8f6740 10 client.15234 fetch_fsmap learned FSMap version 20 2024-09-19T06:06:56.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.612+0000 7fa78a8f6740 1 -- 172.21.15.37:0/193211237 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5612c53b5aa0 con 0x5612c5327980 2024-09-19T06:06:56.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.613+0000 7fa769ffb640 1 -- 172.21.15.37:0/193211237 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa7780a50d0 con 0x5612c5327980 2024-09-19T06:06:56.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.613+0000 7fa769ffb640 1 -- 172.21.15.37:0/193211237 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 20) ==== 8338+0+0 (secure 0 0 0) 0x7fa77c0118e0 con 0x5612c5327980 2024-09-19T06:06:56.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.613+0000 7fa78a8f6740 10 client.15234 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:06:56.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.613+0000 7fa78a8f6740 10 client.15234 resolve_mds: validated gid 24485 aka daemon mds.b 2024-09-19T06:06:56.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.613+0000 7fa78a8f6740 20 client.15234 populate_metadata read hostname 'smithi037' 2024-09-19T06:06:56.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.613+0000 7fa78a8f6740 1 --2- 172.21.15.37:0/193211237 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x5612c534aab0 0x5612c53b81a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:56.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.613+0000 7fa78a8f6740 4 client.15234 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "34f9caab", "release": true, "await": true}] 2024-09-19T06:06:56.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.613+0000 7fa78a8f6740 1 -- 172.21.15.37:0/193211237 --> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] -- command(tid 0: {"prefix": "quiesce db", "set_id": "34f9caab", "release": true, "await": true}) -- 0x5612c52940a0 con 0x5612c534aab0 2024-09-19T06:06:56.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.613+0000 7fa785ab8640 1 --2- 172.21.15.37:0/193211237 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x5612c534aab0 0x5612c53b81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:56.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.614+0000 7fa785ab8640 1 --2- 172.21.15.37:0/193211237 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x5612c534aab0 0x5612c53b81a0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b028468d07c14da4 server_cookie=2e291a836073a729 in_seq=0 out_seq=0 2024-09-19T06:06:56.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.614+0000 7fa769ffb640 10 client.15234 ms_handle_connect on v2:172.21.15.99:6838/3404812329 2024-09-19T06:06:56.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.616+0000 7fa769ffb640 1 -- 172.21.15.37:0/193211237 <== mds.0 v2:172.21.15.99:6838/3404812329 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x5612c52940a0 con 0x5612c534aab0 2024-09-19T06:06:56.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.616+0000 7fa769ffb640 10 client.15234 handle_command_reply: tid=0 2024-09-19T06:06:56.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.616+0000 7fa78a8f6740 1 client.15234 shutdown 2024-09-19T06:06:56.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.616+0000 7fa78a8f6740 1 -- 172.21.15.37:0/193211237 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612c5327980 msgr2=0x5612c533e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:56.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.616+0000 7fa78a8f6740 1 --2- 172.21.15.37:0/193211237 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612c5327980 0x5612c533e720 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa77c01bf00 tx=0x7fa77c0042a0 comp rx=0 tx=0).stop 2024-09-19T06:06:56.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.616+0000 7fa78a8f6740 1 -- 172.21.15.37:0/193211237 shutdown_connections 2024-09-19T06:06:56.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.616+0000 7fa78a8f6740 1 --2- 172.21.15.37:0/193211237 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x5612c534aab0 0x5612c53b81a0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:56.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.616+0000 7fa769ffb640 0 client.15234 ms_handle_reset on v2:172.21.15.99:6838/3404812329 2024-09-19T06:06:56.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.616+0000 7fa78a8f6740 1 --2- 172.21.15.37:0/193211237 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5612c532fcc0 0x5612c533ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:56.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.616+0000 7fa78a8f6740 1 --2- 172.21.15.37:0/193211237 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5612c5332240 0x5612c533f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:56.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.616+0000 7fa78a8f6740 1 --2- 172.21.15.37:0/193211237 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612c5327980 0x5612c533e720 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:56.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.616+0000 7fa78a8f6740 1 -- 172.21.15.37:0/193211237 >> 172.21.15.37:0/193211237 conn(0x5612c53235f0 msgr2=0x5612c5321f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:56.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.616+0000 7fa78a8f6740 1 -- 172.21.15.37:0/193211237 shutdown_connections 2024-09-19T06:06:56.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.616+0000 7fa78a8f6740 1 -- 172.21.15.37:0/193211237 wait complete. 2024-09-19T06:06:56.620 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-19T06:06:56.620 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 20, 2024-09-19T06:06:56.620 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 24485, 2024-09-19T06:06:56.620 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 4, 2024-09-19T06:06:56.620 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": { 2024-09-19T06:06:56.620 INFO:teuthology.orchestra.run.smithi037.stdout: "34f9caab": { 2024-09-19T06:06:56.620 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 4, 2024-09-19T06:06:56.620 INFO:teuthology.orchestra.run.smithi037.stdout: "age_ref": 0.0, 2024-09-19T06:06:56.620 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-09-19T06:06:56.621 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RELEASED", 2024-09-19T06:06:56.621 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-09-19T06:06:56.621 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:06:56.621 INFO:teuthology.orchestra.run.smithi037.stdout: "timeout": 90.0, 2024-09-19T06:06:56.621 INFO:teuthology.orchestra.run.smithi037.stdout: "expiration": 131.2, 2024-09-19T06:06:56.621 INFO:teuthology.orchestra.run.smithi037.stdout: "members": { 2024-09-19T06:06:56.621 INFO:teuthology.orchestra.run.smithi037.stdout: "file:/": { 2024-09-19T06:06:56.621 INFO:teuthology.orchestra.run.smithi037.stdout: "excluded": false, 2024-09-19T06:06:56.621 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-09-19T06:06:56.621 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RELEASED", 2024-09-19T06:06:56.621 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-09-19T06:06:56.621 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:06:56.621 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:06:56.621 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:06:56.621 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:06:56.622 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:06:56.622 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-19T06:06:56.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.616+0000 7fa78a8f6740 20 client.15234 trim_cache size 0 max 16384 2024-09-19T06:06:56.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.617+0000 7fa78851d640 1 -- 172.21.15.37:0/395026480 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fa76c0a32c0 msgr2=0x7fa76c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:56.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.617+0000 7fa78851d640 1 --2- 172.21.15.37:0/395026480 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fa76c0a32c0 0x7fa76c0a5780 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa770009230 tx=0x7fa770005bb0 comp rx=0 tx=0).stop 2024-09-19T06:06:56.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.617+0000 7fa78851d640 1 -- 172.21.15.37:0/395026480 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa780102ef0 msgr2=0x7fa780197b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:56.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.617+0000 7fa78851d640 1 --2- 172.21.15.37:0/395026480 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa780102ef0 0x7fa780197b90 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa77800eb10 tx=0x7fa77800c2d0 comp rx=0 tx=0).stop 2024-09-19T06:06:56.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.617+0000 7fa78851d640 1 -- 172.21.15.37:0/395026480 shutdown_connections 2024-09-19T06:06:56.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.617+0000 7fa78851d640 1 --2- 172.21.15.37:0/395026480 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fa76c0a32c0 0x7fa76c0a5780 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:56.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.617+0000 7fa78851d640 1 --2- 172.21.15.37:0/395026480 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa780102570 0x7fa780197650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:56.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.617+0000 7fa78851d640 1 --2- 172.21.15.37:0/395026480 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa780102ef0 0x7fa780197b90 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:56.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.617+0000 7fa78851d640 1 --2- 172.21.15.37:0/395026480 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa780100e20 0x7fa780197110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:56.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.617+0000 7fa78851d640 1 -- 172.21.15.37:0/395026480 >> 172.21.15.37:0/395026480 conn(0x7fa7800fc7d0 msgr2=0x7fa7800febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:56.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.617+0000 7fa78851d640 1 -- 172.21.15.37:0/395026480 shutdown_connections 2024-09-19T06:06:56.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:06:56.617+0000 7fa78851d640 1 -- 172.21.15.37:0/395026480 wait complete. 2024-09-19T06:06:57.464 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '34f9caab', total seconds elapsed: 15.7 2024-09-19T06:06:58.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:06:57 smithi037 ceph-mon[31211]: pgmap v373: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 597 B/s wr, 1 op/s 2024-09-19T06:06:58.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:06:57 smithi099 ceph-mon[35300]: pgmap v373: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 597 B/s wr, 1 op/s 2024-09-19T06:06:58.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:06:57 smithi117 ceph-mon[35050]: pgmap v373: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 597 B/s wr, 1 op/s 2024-09-19T06:07:00.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:06:59 smithi037 ceph-mon[31211]: pgmap v374: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-19T06:07:00.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:06:59 smithi099 ceph-mon[35300]: pgmap v374: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-19T06:07:00.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:06:59 smithi117 ceph-mon[35050]: pgmap v374: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-19T06:07:02.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:07:01 smithi037 ceph-mon[31211]: pgmap v375: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-19T06:07:02.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:07:01 smithi099 ceph-mon[35300]: pgmap v375: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-19T06:07:02.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:07:01 smithi117 ceph-mon[35050]: pgmap v375: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-19T06:07:04.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:07:03 smithi037 ceph-mon[31211]: pgmap v376: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-19T06:07:04.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:07:03 smithi099 ceph-mon[35300]: pgmap v376: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-19T06:07:04.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:07:03 smithi117 ceph-mon[35050]: pgmap v376: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-19T06:07:06.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:07:05 smithi037 ceph-mon[31211]: pgmap v377: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-19T06:07:06.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:07:05 smithi099 ceph-mon[35300]: pgmap v377: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-19T06:07:06.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:07:05 smithi117 ceph-mon[35050]: pgmap v377: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-19T06:07:07.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:07:06 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:07:07.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:07:06 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:07:07.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:07:06 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:07:07.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:07:06 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:07:07.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:07:06 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:07:07.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:07:06 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:07:07.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:07:06 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:07:07.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:07:06 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:07:07.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:07:06 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:07:08.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:07:07 smithi037 ceph-mon[31211]: pgmap v378: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-19T06:07:08.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:07:07 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:08.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:07:07 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:07:08.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:07:07 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:07:08.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:07:07 smithi099 ceph-mon[35300]: pgmap v378: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-19T06:07:08.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:07:07 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:08.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:07:07 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:07:08.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:07:07 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:07:08.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:07:07 smithi117 ceph-mon[35050]: pgmap v378: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-19T06:07:08.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:07:07 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:08.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:07:07 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:07:08.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:07:07 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:07:10.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:07:09 smithi037 ceph-mon[31211]: pgmap v379: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-19T06:07:10.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:07:09 smithi099 ceph-mon[35300]: pgmap v379: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-19T06:07:10.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:07:09 smithi117 ceph-mon[35050]: pgmap v379: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-19T06:07:12.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:07:11 smithi037 ceph-mon[31211]: pgmap v380: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-19T06:07:12.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:07:11 smithi099 ceph-mon[35300]: pgmap v380: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-19T06:07:12.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:07:11 smithi117 ceph-mon[35050]: pgmap v380: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-19T06:07:14.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:07:13 smithi037 ceph-mon[31211]: pgmap v381: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:07:14.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:07:13 smithi099 ceph-mon[35300]: pgmap v381: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:07:14.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:07:13 smithi117 ceph-mon[35050]: pgmap v381: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:07:16.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:07:15 smithi037 ceph-mon[31211]: pgmap v382: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:07:16.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:07:15 smithi099 ceph-mon[35300]: pgmap v382: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:07:16.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:07:15 smithi117 ceph-mon[35050]: pgmap v382: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:07:17.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:07:17 smithi037 ceph-mon[31211]: pgmap v383: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:07:18.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:07:17 smithi099 ceph-mon[35300]: pgmap v383: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:07:18.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:07:17 smithi117 ceph-mon[35050]: pgmap v383: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:07:18.265 INFO:tasks.quiescer.fs.[cephfs]:Total duration (40.7) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-19T06:07:18.265 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.35 2024-09-19T06:07:18.266 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:07:18.563 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:07:19.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:19.128+0000 7f6a457ae640 1 -- 172.21.15.37:0/4187813590 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a40103780 msgr2=0x7f6a40107bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:19.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:19.128+0000 7f6a457ae640 1 --2- 172.21.15.37:0/4187813590 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a40103780 0x7f6a40107bc0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f6a34009930 tx=0x7f6a3402a420 comp rx=0 tx=0).stop 2024-09-19T06:07:19.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:19.128+0000 7f6a457ae640 1 -- 172.21.15.37:0/4187813590 shutdown_connections 2024-09-19T06:07:19.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:19.128+0000 7f6a457ae640 1 --2- 172.21.15.37:0/4187813590 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a40108300 0x7f6a4010ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:19.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:19.128+0000 7f6a457ae640 1 --2- 172.21.15.37:0/4187813590 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a40103780 0x7f6a40107bc0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:19.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:19.128+0000 7f6a457ae640 1 --2- 172.21.15.37:0/4187813590 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a40102dd0 0x7f6a401031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:19.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:19.128+0000 7f6a457ae640 1 -- 172.21.15.37:0/4187813590 >> 172.21.15.37:0/4187813590 conn(0x7f6a400fc7d0 msgr2=0x7f6a400febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:19.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:19.128+0000 7f6a457ae640 1 -- 172.21.15.37:0/4187813590 shutdown_connections 2024-09-19T06:07:19.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:19.128+0000 7f6a457ae640 1 -- 172.21.15.37:0/4187813590 wait complete. 2024-09-19T06:07:19.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:19.129+0000 7f6a457ae640 1 Processor -- start 2024-09-19T06:07:19.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:19.129+0000 7f6a457ae640 1 -- start start 2024-09-19T06:07:19.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:19.130+0000 7f6a457ae640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a40102dd0 0x7f6a401985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:19.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:19.130+0000 7f6a457ae640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a40103780 0x7f6a40198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:19.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:19.130+0000 7f6a457ae640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a40108300 0x7f6a4019cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:19.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:19.130+0000 7f6a457ae640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6a40112050 con 0x7f6a40108300 2024-09-19T06:07:19.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:19.130+0000 7f6a457ae640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f6a40111ed0 con 0x7f6a40102dd0 2024-09-19T06:07:19.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:19.130+0000 7f6a457ae640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6a401121d0 con 0x7f6a40103780 2024-09-19T06:07:19.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:19.130+0000 7f6a3f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a40108300 0x7f6a4019cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:19.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:19.130+0000 7f6a3f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a40108300 0x7f6a4019cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43664/0 (socket says 172.21.15.37:43664) 2024-09-19T06:07:19.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:19.130+0000 7f6a3f7fe640 1 -- 172.21.15.37:0/3501706059 learned_addr learned my addr 172.21.15.37:0/3501706059 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:07:19.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:19.130+0000 7f6a3effd640 1 --2- 172.21.15.37:0/3501706059 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a40102dd0 0x7f6a401985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:19.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:19.130+0000 7f6a3e7fc640 1 --2- 172.21.15.37:0/3501706059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a40103780 0x7f6a40198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:19.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:19.130+0000 7f6a3f7fe640 1 -- 172.21.15.37:0/3501706059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a40103780 msgr2=0x7f6a40198b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:19.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:19.130+0000 7f6a3f7fe640 1 --2- 172.21.15.37:0/3501706059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a40103780 0x7f6a40198b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:19.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:19.130+0000 7f6a3f7fe640 1 -- 172.21.15.37:0/3501706059 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a40102dd0 msgr2=0x7f6a401985d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:19.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:19.130+0000 7f6a3f7fe640 1 --2- 172.21.15.37:0/3501706059 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a40102dd0 0x7f6a401985d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:19.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:19.130+0000 7f6a3f7fe640 1 -- 172.21.15.37:0/3501706059 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a4019d580 con 0x7f6a40108300 2024-09-19T06:07:19.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:19.131+0000 7f6a3f7fe640 1 --2- 172.21.15.37:0/3501706059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a40108300 0x7f6a4019cea0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f6a3800eb10 tx=0x7f6a3800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:19.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:19.131+0000 7f6a27fff640 1 -- 172.21.15.37:0/3501706059 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a38004b20 con 0x7f6a40108300 2024-09-19T06:07:19.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:19.131+0000 7f6a457ae640 1 -- 172.21.15.37:0/3501706059 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a4019d870 con 0x7f6a40108300 2024-09-19T06:07:19.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:19.131+0000 7f6a457ae640 1 -- 172.21.15.37:0/3501706059 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a40100960 con 0x7f6a40108300 2024-09-19T06:07:19.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:19.131+0000 7f6a27fff640 1 -- 172.21.15.37:0/3501706059 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a38004cc0 con 0x7f6a40108300 2024-09-19T06:07:19.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:19.132+0000 7f6a27fff640 1 -- 172.21.15.37:0/3501706059 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a38010670 con 0x7f6a40108300 2024-09-19T06:07:19.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:19.133+0000 7f6a457ae640 1 -- 172.21.15.37:0/3501706059 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a2c005290 con 0x7f6a40108300 2024-09-19T06:07:19.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:19.134+0000 7f6a27fff640 1 -- 172.21.15.37:0/3501706059 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f6a38005020 con 0x7f6a40108300 2024-09-19T06:07:19.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:19.135+0000 7f6a27fff640 1 --2- 172.21.15.37:0/3501706059 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f6a280a32c0 0x7f6a280a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:19.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:19.135+0000 7f6a3effd640 1 --2- 172.21.15.37:0/3501706059 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f6a280a32c0 0x7f6a280a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:19.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:19.135+0000 7f6a27fff640 1 -- 172.21.15.37:0/3501706059 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9121+0+0 (secure 0 0 0) 0x7f6a380d0050 con 0x7f6a40108300 2024-09-19T06:07:19.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:19.136+0000 7f6a3effd640 1 --2- 172.21.15.37:0/3501706059 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f6a280a32c0 0x7f6a280a5780 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6a30009bd0 tx=0x7f6a30005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:19.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:19.140+0000 7f6a27fff640 1 -- 172.21.15.37:0/3501706059 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6a3809c9f0 con 0x7f6a40108300 2024-09-19T06:07:19.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:19.355+0000 7f6a457ae640 1 -- 172.21.15.37:0/3501706059 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6a2c005580 con 0x7f6a40108300 2024-09-19T06:07:19.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:19.355+0000 7f6a27fff640 1 -- 172.21.15.37:0/3501706059 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11842 (secure 0 0 0) 0x7f6a3809c2f0 con 0x7f6a40108300 2024-09-19T06:07:19.358 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T06:07:19.358 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"btime":"2024-09-19T06:04:42:531480+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14514,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2864247978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2864247978},{"type":"v1","addr":"172.21.15.37:6835","nonce":2864247978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14526,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/633000932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":633000932},{"type":"v1","addr":"172.21.15.37:6837","nonce":633000932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14574,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/3753800615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":3753800615},{"type":"v1","addr":"172.21.15.37:6839","nonce":3753800615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/2718998355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":2718998355},{"type":"v1","addr":"172.21.15.37:6841","nonce":2718998355}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6833/866590207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":866590207},{"type":"v1","addr":"172.21.15.99:6833","nonce":866590207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3898668400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3898668400},{"type":"v1","addr":"172.21.15.117:6833","nonce":3898668400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2650673320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2650673320},{"type":"v1","addr":"172.21.15.99:6835","nonce":2650673320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1097471349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1097471349},{"type":"v1","addr":"172.21.15.117:6835","nonce":1097471349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24457,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1001392672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1001392672},{"type":"v1","addr":"172.21.15.117:6837","nonce":1001392672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/23570935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":23570935},{"type":"v1","addr":"172.21.15.99:6837","nonce":23570935}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:04:06.253034+0000","modified":"2024-09-19T06:04:42.196783+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24485},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24478":{"gid":24478,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6839/1269518339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":1269518339},{"type":"v1","addr":"172.21.15.117:6839","nonce":1269518339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.99:6839/3404812329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":3404812329},{"type":"v1","addr":"172.21.15.99:6839","nonce":3404812329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24485,"qdb_cluster":[24485]},"id":1}]} 2024-09-19T06:07:19.358 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 20 2024-09-19T06:07:19.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:19.358+0000 7f6a457ae640 1 -- 172.21.15.37:0/3501706059 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f6a280a32c0 msgr2=0x7f6a280a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:19.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:19.358+0000 7f6a457ae640 1 --2- 172.21.15.37:0/3501706059 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f6a280a32c0 0x7f6a280a5780 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6a30009bd0 tx=0x7f6a30005f90 comp rx=0 tx=0).stop 2024-09-19T06:07:19.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:19.358+0000 7f6a457ae640 1 -- 172.21.15.37:0/3501706059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a40108300 msgr2=0x7f6a4019cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:19.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:19.358+0000 7f6a457ae640 1 --2- 172.21.15.37:0/3501706059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a40108300 0x7f6a4019cea0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f6a3800eb10 tx=0x7f6a3800c2d0 comp rx=0 tx=0).stop 2024-09-19T06:07:19.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:19.358+0000 7f6a457ae640 1 -- 172.21.15.37:0/3501706059 shutdown_connections 2024-09-19T06:07:19.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:19.358+0000 7f6a457ae640 1 --2- 172.21.15.37:0/3501706059 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f6a280a32c0 0x7f6a280a5780 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:19.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:19.358+0000 7f6a457ae640 1 --2- 172.21.15.37:0/3501706059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a40108300 0x7f6a4019cea0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:19.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:19.358+0000 7f6a457ae640 1 --2- 172.21.15.37:0/3501706059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a40103780 0x7f6a40198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:19.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:19.358+0000 7f6a457ae640 1 --2- 172.21.15.37:0/3501706059 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a40102dd0 0x7f6a401985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:19.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:19.358+0000 7f6a457ae640 1 -- 172.21.15.37:0/3501706059 >> 172.21.15.37:0/3501706059 conn(0x7f6a400fc7d0 msgr2=0x7f6a40105ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:19.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:19.358+0000 7f6a457ae640 1 -- 172.21.15.37:0/3501706059 shutdown_connections 2024-09-19T06:07:19.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:19.358+0000 7f6a457ae640 1 -- 172.21.15.37:0/3501706059 wait complete. 2024-09-19T06:07:20.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:07:19 smithi037 ceph-mon[31211]: pgmap v384: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:07:20.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:07:19 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/3501706059' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:07:20.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:07:19 smithi099 ceph-mon[35300]: pgmap v384: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:07:20.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:07:19 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/3501706059' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:07:20.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:07:19 smithi117 ceph-mon[35050]: pgmap v384: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:07:20.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:07:19 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/3501706059' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:07:20.419 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24485 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0' 2024-09-19T06:07:20.420 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24485 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0 2024-09-19T06:07:20.686 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:07:21.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.260+0000 7ffab36bf640 1 -- 172.21.15.37:0/512819947 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffaac100a70 msgr2=0x7ffaac100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:21.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.260+0000 7ffab36bf640 1 --2- 172.21.15.37:0/512819947 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffaac100a70 0x7ffaac100ed0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c009930 tx=0x7ffa9c02a420 comp rx=0 tx=0).stop 2024-09-19T06:07:21.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.260+0000 7ffab36bf640 1 -- 172.21.15.37:0/512819947 shutdown_connections 2024-09-19T06:07:21.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.260+0000 7ffab36bf640 1 --2- 172.21.15.37:0/512819947 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffaac101410 0x7ffaac10d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:21.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.260+0000 7ffab36bf640 1 --2- 172.21.15.37:0/512819947 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffaac100a70 0x7ffaac100ed0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:21.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.260+0000 7ffab36bf640 1 --2- 172.21.15.37:0/512819947 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffaac106a70 0x7ffaac106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:21.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.260+0000 7ffab36bf640 1 -- 172.21.15.37:0/512819947 >> 172.21.15.37:0/512819947 conn(0x7ffaac0fc7d0 msgr2=0x7ffaac0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:21.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.260+0000 7ffab36bf640 1 -- 172.21.15.37:0/512819947 shutdown_connections 2024-09-19T06:07:21.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.260+0000 7ffab36bf640 1 -- 172.21.15.37:0/512819947 wait complete. 2024-09-19T06:07:21.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.261+0000 7ffab36bf640 1 Processor -- start 2024-09-19T06:07:21.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.261+0000 7ffab36bf640 1 -- start start 2024-09-19T06:07:21.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.262+0000 7ffab36bf640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffaac100a70 0x7ffaac197360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:21.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.262+0000 7ffab36bf640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffaac101410 0x7ffaac1978a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:21.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.262+0000 7ffab36bf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffaac106a70 0x7ffaac19bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:21.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.262+0000 7ffab36bf640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ffaac110ec0 con 0x7ffaac106a70 2024-09-19T06:07:21.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.262+0000 7ffab36bf640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ffaac110d40 con 0x7ffaac101410 2024-09-19T06:07:21.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.262+0000 7ffab36bf640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ffaac111040 con 0x7ffaac100a70 2024-09-19T06:07:21.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.262+0000 7ffab1c5c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffaac106a70 0x7ffaac19bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:21.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.262+0000 7ffab1c5c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffaac106a70 0x7ffaac19bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43678/0 (socket says 172.21.15.37:43678) 2024-09-19T06:07:21.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.262+0000 7ffab1c5c640 1 -- 172.21.15.37:0/3704241020 learned_addr learned my addr 172.21.15.37:0/3704241020 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:07:21.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.262+0000 7ffab145b640 1 --2- 172.21.15.37:0/3704241020 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffaac100a70 0x7ffaac197360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:21.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.262+0000 7ffab0c5a640 1 --2- 172.21.15.37:0/3704241020 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffaac101410 0x7ffaac1978a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:21.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.262+0000 7ffab1c5c640 1 -- 172.21.15.37:0/3704241020 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffaac100a70 msgr2=0x7ffaac197360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:21.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.262+0000 7ffab1c5c640 1 --2- 172.21.15.37:0/3704241020 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffaac100a70 0x7ffaac197360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:21.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.262+0000 7ffab1c5c640 1 -- 172.21.15.37:0/3704241020 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffaac101410 msgr2=0x7ffaac1978a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:21.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.262+0000 7ffab1c5c640 1 --2- 172.21.15.37:0/3704241020 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffaac101410 0x7ffaac1978a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:21.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.262+0000 7ffab1c5c640 1 -- 172.21.15.37:0/3704241020 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaac19c310 con 0x7ffaac106a70 2024-09-19T06:07:21.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.262+0000 7ffab1c5c640 1 --2- 172.21.15.37:0/3704241020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffaac106a70 0x7ffaac19bc30 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ffaa400eaa0 tx=0x7ffaa400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:21.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.262+0000 7ffaa27fc640 1 -- 172.21.15.37:0/3704241020 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa400cdb0 con 0x7ffaac106a70 2024-09-19T06:07:21.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.263+0000 7ffaa27fc640 1 -- 172.21.15.37:0/3704241020 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffaa4005020 con 0x7ffaac106a70 2024-09-19T06:07:21.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.263+0000 7ffab36bf640 1 -- 172.21.15.37:0/3704241020 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffaac19c600 con 0x7ffaac106a70 2024-09-19T06:07:21.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.263+0000 7ffaa27fc640 1 -- 172.21.15.37:0/3704241020 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa40116b0 con 0x7ffaac106a70 2024-09-19T06:07:21.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.263+0000 7ffab36bf640 1 -- 172.21.15.37:0/3704241020 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffaac1a3ee0 con 0x7ffaac106a70 2024-09-19T06:07:21.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.265+0000 7ffaa27fc640 1 -- 172.21.15.37:0/3704241020 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ffaa4005560 con 0x7ffaac106a70 2024-09-19T06:07:21.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.265+0000 7ffab5a98740 1 Processor -- start 2024-09-19T06:07:21.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.266+0000 7ffab5a98740 1 -- start start 2024-09-19T06:07:21.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.266+0000 7ffab5a98740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5607a6bd1770 0x5607a6bd1b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:21.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.266+0000 7ffab5a98740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5607a6bd2090 0x5607a6bde700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:21.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.266+0000 7ffab5a98740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607a6bdec40 0x5607a6be1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:21.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.266+0000 7ffab5a98740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5607a6b36160 con 0x5607a6bdec40 2024-09-19T06:07:21.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.266+0000 7ffab5a98740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5607a6add720 con 0x5607a6bd2090 2024-09-19T06:07:21.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.266+0000 7ffab5a98740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5607a6b32120 con 0x5607a6bd1770 2024-09-19T06:07:21.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.266+0000 7ffaa27fc640 1 --2- 172.21.15.37:0/3704241020 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7ffa980a32c0 0x7ffa980a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:21.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.266+0000 7ffab0c5a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607a6bdec40 0x5607a6be1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:21.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.266+0000 7ffab0c5a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607a6bdec40 0x5607a6be1030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43688/0 (socket says 172.21.15.37:43688) 2024-09-19T06:07:21.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.266+0000 7ffab0c5a640 1 -- 172.21.15.37:0/4272103940 learned_addr learned my addr 172.21.15.37:0/4272103940 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:07:21.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.266+0000 7ffab1c5c640 1 --2- 172.21.15.37:0/3704241020 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7ffa980a32c0 0x7ffa980a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:21.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.266+0000 7ffab145b640 1 --2- 172.21.15.37:0/4272103940 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5607a6bd2090 0x5607a6bde700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:21.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.266+0000 7ffaa27fc640 1 -- 172.21.15.37:0/3704241020 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9121+0+0 (secure 0 0 0) 0x7ffaa40cfef0 con 0x7ffaac106a70 2024-09-19T06:07:21.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.266+0000 7ffab0c5a640 1 --2- 172.21.15.37:0/4272103940 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5607a6bd1770 0x5607a6bd1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:21.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.267+0000 7ffab145b640 1 -- 172.21.15.37:0/4272103940 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5607a6bd1770 msgr2=0x5607a6bd1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:21.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.267+0000 7ffab145b640 1 --2- 172.21.15.37:0/4272103940 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5607a6bd1770 0x5607a6bd1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:21.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.267+0000 7ffab145b640 1 -- 172.21.15.37:0/4272103940 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607a6bdec40 msgr2=0x5607a6be1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:21.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.267+0000 7ffab145b640 1 --2- 172.21.15.37:0/4272103940 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607a6bdec40 0x5607a6be1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:21.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.267+0000 7ffab145b640 1 -- 172.21.15.37:0/4272103940 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607a68a7ba0 con 0x5607a6bd2090 2024-09-19T06:07:21.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.267+0000 7ffab1c5c640 1 --2- 172.21.15.37:0/3704241020 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7ffa980a32c0 0x7ffa980a5780 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ffaa4000f80 tx=0x7ffaa406aed0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:21.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.267+0000 7ffab0c5a640 1 --2- 172.21.15.37:0/4272103940 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607a6bdec40 0x5607a6be1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:07:21.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.267+0000 7ffab145b640 1 --2- 172.21.15.37:0/4272103940 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5607a6bd2090 0x5607a6bde700 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ffaa800bb60 tx=0x7ffaa800f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e55db64d417d39e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:21.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.267+0000 7ffa977fe640 1 -- 172.21.15.37:0/4272103940 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa8015070 con 0x5607a6bd2090 2024-09-19T06:07:21.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.267+0000 7ffa977fe640 1 -- 172.21.15.37:0/4272103940 <== mon.2 v2:172.21.15.99:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffaa800be50 con 0x5607a6bd2090 2024-09-19T06:07:21.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.267+0000 7ffa977fe640 1 -- 172.21.15.37:0/4272103940 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa8011440 con 0x5607a6bd2090 2024-09-19T06:07:21.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.268+0000 7ffab5a98740 1 -- 172.21.15.37:0/4272103940 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5607a6bd2090 msgr2=0x5607a6bde700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:21.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.268+0000 7ffab5a98740 1 --2- 172.21.15.37:0/4272103940 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5607a6bd2090 0x5607a6bde700 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ffaa800bb60 tx=0x7ffaa800f730 comp rx=0 tx=0).stop 2024-09-19T06:07:21.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.268+0000 7ffab5a98740 1 -- 172.21.15.37:0/4272103940 shutdown_connections 2024-09-19T06:07:21.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.268+0000 7ffab5a98740 1 --2- 172.21.15.37:0/4272103940 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5607a6bd2090 0x5607a6bde700 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:21.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.268+0000 7ffab5a98740 1 --2- 172.21.15.37:0/4272103940 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607a6bdec40 0x5607a6be1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:21.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.268+0000 7ffab5a98740 1 --2- 172.21.15.37:0/4272103940 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5607a6bd1770 0x5607a6bd1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:21.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.268+0000 7ffab5a98740 1 -- 172.21.15.37:0/4272103940 >> 172.21.15.37:0/4272103940 conn(0x5607a6bcdde0 msgr2=0x5607a6bce1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:21.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.268+0000 7ffab5a98740 1 -- 172.21.15.37:0/4272103940 shutdown_connections 2024-09-19T06:07:21.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.268+0000 7ffab5a98740 1 -- 172.21.15.37:0/4272103940 wait complete. 2024-09-19T06:07:21.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.268+0000 7ffab5a98740 1 -- start start 2024-09-19T06:07:21.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.269+0000 7ffab5a98740 1 Processor -- start 2024-09-19T06:07:21.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.269+0000 7ffab5a98740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5607a6bd1770 0x5607a6bde280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:21.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.269+0000 7ffab5a98740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5607a6bd2090 0x5607a6bdc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:21.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.269+0000 7ffab5a98740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607a6bdec40 0x5607a6bdcad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:21.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.269+0000 7ffab5a98740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5607a6bd46d0 con 0x5607a6bdec40 2024-09-19T06:07:21.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.269+0000 7ffab5a98740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5607a6abe900 con 0x5607a6bd2090 2024-09-19T06:07:21.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.269+0000 7ffab5a98740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5607a6bd4850 con 0x5607a6bd1770 2024-09-19T06:07:21.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.269+0000 7ffab5a98740 10 client.0 _ll_register_callbacks cb 0x5607a6abc780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:07:21.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.269+0000 7ffab0c5a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607a6bdec40 0x5607a6bdcad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:21.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.269+0000 7ffab0c5a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607a6bdec40 0x5607a6bdcad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43690/0 (socket says 172.21.15.37:43690) 2024-09-19T06:07:21.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.269+0000 7ffab0c5a640 1 -- 172.21.15.37:0/4176180835 learned_addr learned my addr 172.21.15.37:0/4176180835 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:07:21.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.269+0000 7ffab0c5a640 1 --2- 172.21.15.37:0/4176180835 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5607a6bd1770 0x5607a6bde280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:21.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.269+0000 7ffab145b640 1 --2- 172.21.15.37:0/4176180835 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5607a6bd2090 0x5607a6bdc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:21.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.269+0000 7ffab0c5a640 1 -- 172.21.15.37:0/4176180835 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5607a6bd1770 msgr2=0x5607a6bde280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:21.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.270+0000 7ffab0c5a640 1 --2- 172.21.15.37:0/4176180835 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5607a6bd1770 0x5607a6bde280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:21.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.270+0000 7ffab0c5a640 1 -- 172.21.15.37:0/4176180835 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5607a6bd2090 msgr2=0x5607a6bdc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:21.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.270+0000 7ffab0c5a640 1 --2- 172.21.15.37:0/4176180835 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5607a6bd2090 0x5607a6bdc590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:21.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.270+0000 7ffab0c5a640 1 -- 172.21.15.37:0/4176180835 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607a6afec50 con 0x5607a6bdec40 2024-09-19T06:07:21.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.270+0000 7ffab145b640 1 --2- 172.21.15.37:0/4176180835 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5607a6bd2090 0x5607a6bdc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:07:21.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.270+0000 7ffab0c5a640 1 --2- 172.21.15.37:0/4176180835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607a6bdec40 0x5607a6bdcad0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c02a940 tx=0x7ffa9c044040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdf1946f86ccc6c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:21.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.270+0000 7ffa94ff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-19T06:07:21.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.270+0000 7ffa94ff9640 1 -- 172.21.15.37:0/4176180835 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c035040 con 0x5607a6bdec40 2024-09-19T06:07:21.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.270+0000 7ffab5a98740 1 -- 172.21.15.37:0/4176180835 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffaa800be50 con 0x5607a6bdec40 2024-09-19T06:07:21.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.270+0000 7ffa94ff9640 1 -- 172.21.15.37:0/4176180835 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9121+0+0 (secure 0 0 0) 0x7ffa9c0317c0 con 0x5607a6bdec40 2024-09-19T06:07:21.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.270+0000 7ffa94ff9640 1 -- 172.21.15.37:0/4176180835 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ffa9c0319c0 con 0x5607a6bdec40 2024-09-19T06:07:21.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.270+0000 7ffab5a98740 10 client.15252 fetch_fsmap learned FSMap version 20 2024-09-19T06:07:21.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.270+0000 7ffab5a98740 1 -- 172.21.15.37:0/4176180835 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5607a6beb350 con 0x5607a6bdec40 2024-09-19T06:07:21.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.270+0000 7ffa94ff9640 1 -- 172.21.15.37:0/4176180835 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffaa800be50 con 0x5607a6bdec40 2024-09-19T06:07:21.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.271+0000 7ffa94ff9640 1 -- 172.21.15.37:0/4176180835 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 20) ==== 8338+0+0 (secure 0 0 0) 0x7ffa9c03a040 con 0x5607a6bdec40 2024-09-19T06:07:21.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.271+0000 7ffab5a98740 10 client.15252 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:07:21.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.271+0000 7ffab5a98740 10 client.15252 resolve_mds: validated gid 24485 aka daemon mds.b 2024-09-19T06:07:21.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.271+0000 7ffab5a98740 20 client.15252 populate_metadata read hostname 'smithi037' 2024-09-19T06:07:21.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.271+0000 7ffab5a98740 1 --2- 172.21.15.37:0/4176180835 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x5607a6bec760 0x5607a6beeb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:21.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.271+0000 7ffab5a98740 4 client.15252 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:07:21.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.271+0000 7ffab5a98740 1 -- 172.21.15.37:0/4176180835 --> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5607a6b43890 con 0x5607a6bec760 2024-09-19T06:07:21.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.271+0000 7ffab145b640 1 --2- 172.21.15.37:0/4176180835 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x5607a6bec760 0x5607a6beeb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:21.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.272+0000 7ffab145b640 1 --2- 172.21.15.37:0/4176180835 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x5607a6bec760 0x5607a6beeb50 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=308bbd068a1fac79 server_cookie=b0c872c42cae3b2e in_seq=0 out_seq=0 2024-09-19T06:07:21.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.272+0000 7ffa94ff9640 10 client.15252 ms_handle_connect on v2:172.21.15.99:6838/3404812329 2024-09-19T06:07:21.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.272+0000 7ffa94ff9640 1 -- 172.21.15.37:0/4176180835 <== mds.0 v2:172.21.15.99:6838/3404812329 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5607a6b43890 con 0x5607a6bec760 2024-09-19T06:07:21.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.272+0000 7ffa94ff9640 10 client.15252 handle_command_reply: tid=0 2024-09-19T06:07:21.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.272+0000 7ffab5a98740 1 client.15252 shutdown 2024-09-19T06:07:21.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.272+0000 7ffab5a98740 1 -- 172.21.15.37:0/4176180835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607a6bdec40 msgr2=0x5607a6bdcad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:21.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.272+0000 7ffab5a98740 1 --2- 172.21.15.37:0/4176180835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607a6bdec40 0x5607a6bdcad0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c02a940 tx=0x7ffa9c044040 comp rx=0 tx=0).stop 2024-09-19T06:07:21.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.273+0000 7ffab5a98740 1 -- 172.21.15.37:0/4176180835 shutdown_connections 2024-09-19T06:07:21.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.273+0000 7ffab5a98740 1 --2- 172.21.15.37:0/4176180835 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x5607a6bec760 0x5607a6beeb50 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:21.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.273+0000 7ffa94ff9640 0 client.15252 ms_handle_reset on v2:172.21.15.99:6838/3404812329 2024-09-19T06:07:21.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.273+0000 7ffab5a98740 1 --2- 172.21.15.37:0/4176180835 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5607a6bd2090 0x5607a6bdc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:21.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.273+0000 7ffab5a98740 1 --2- 172.21.15.37:0/4176180835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607a6bdec40 0x5607a6bdcad0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:21.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.273+0000 7ffab5a98740 1 --2- 172.21.15.37:0/4176180835 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5607a6bd1770 0x5607a6bde280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:21.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.273+0000 7ffab5a98740 1 -- 172.21.15.37:0/4176180835 >> 172.21.15.37:0/4176180835 conn(0x5607a6bcdde0 msgr2=0x5607a6bd3a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:21.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.273+0000 7ffab5a98740 1 -- 172.21.15.37:0/4176180835 shutdown_connections 2024-09-19T06:07:21.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.273+0000 7ffab5a98740 1 -- 172.21.15.37:0/4176180835 wait complete. 2024-09-19T06:07:21.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.273+0000 7ffab5a98740 20 client.15252 trim_cache size 0 max 16384 2024-09-19T06:07:21.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.307+0000 7ffab5a98740 1 Processor -- start 2024-09-19T06:07:21.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.307+0000 7ffab5a98740 1 -- start start 2024-09-19T06:07:21.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.307+0000 7ffab5a98740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5607a6bd1770 0x5607a6bd7830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:21.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.307+0000 7ffab5a98740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5607a6bd2090 0x5607a6bf4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:21.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.307+0000 7ffab5a98740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607a6bdec40 0x5607a6bf4960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:21.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.307+0000 7ffab5a98740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ffaac1aaaa0 con 0x5607a6bdec40 2024-09-19T06:07:21.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.307+0000 7ffab5a98740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ffaac1ad320 con 0x5607a6bd1770 2024-09-19T06:07:21.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.307+0000 7ffab5a98740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ffaac1ab110 con 0x5607a6bd2090 2024-09-19T06:07:21.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.307+0000 7ffab0c5a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607a6bdec40 0x5607a6bf4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:21.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.307+0000 7ffab0c5a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607a6bdec40 0x5607a6bf4960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43702/0 (socket says 172.21.15.37:43702) 2024-09-19T06:07:21.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.307+0000 7ffab0c5a640 1 -- 172.21.15.37:0/2379587828 learned_addr learned my addr 172.21.15.37:0/2379587828 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:07:21.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.307+0000 7ffab0c5a640 1 --2- 172.21.15.37:0/2379587828 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5607a6bd1770 0x5607a6bd7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:21.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.307+0000 7ffab145b640 1 --2- 172.21.15.37:0/2379587828 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5607a6bd2090 0x5607a6bf4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:21.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.308+0000 7ffab0c5a640 1 -- 172.21.15.37:0/2379587828 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5607a6bd2090 msgr2=0x5607a6bf4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:21.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.308+0000 7ffab0c5a640 1 --2- 172.21.15.37:0/2379587828 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5607a6bd2090 0x5607a6bf4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:21.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.308+0000 7ffab0c5a640 1 -- 172.21.15.37:0/2379587828 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607a6bdec40 msgr2=0x5607a6bf4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:21.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.308+0000 7ffab0c5a640 1 --2- 172.21.15.37:0/2379587828 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607a6bdec40 0x5607a6bf4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:21.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.308+0000 7ffab0c5a640 1 -- 172.21.15.37:0/2379587828 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607a6bdcc30 con 0x5607a6bd1770 2024-09-19T06:07:21.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.308+0000 7ffab0c5a640 1 --2- 172.21.15.37:0/2379587828 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5607a6bd1770 0x5607a6bd7830 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c009930 tx=0x7ffa9c005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b58fa24afb9fddf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:21.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.308+0000 7ffa96ffd640 1 -- 172.21.15.37:0/2379587828 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c035040 con 0x5607a6bd1770 2024-09-19T06:07:21.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.308+0000 7ffa96ffd640 1 -- 172.21.15.37:0/2379587828 <== mon.2 v2:172.21.15.99:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa9c0317c0 con 0x5607a6bd1770 2024-09-19T06:07:21.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.308+0000 7ffa96ffd640 1 -- 172.21.15.37:0/2379587828 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c0035f0 con 0x5607a6bd1770 2024-09-19T06:07:21.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.309+0000 7ffab5a98740 1 -- 172.21.15.37:0/2379587828 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5607a6bd1770 msgr2=0x5607a6bd7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:21.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.309+0000 7ffab5a98740 1 --2- 172.21.15.37:0/2379587828 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5607a6bd1770 0x5607a6bd7830 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c009930 tx=0x7ffa9c005fd0 comp rx=0 tx=0).stop 2024-09-19T06:07:21.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.309+0000 7ffab5a98740 1 -- 172.21.15.37:0/2379587828 shutdown_connections 2024-09-19T06:07:21.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.309+0000 7ffab5a98740 1 --2- 172.21.15.37:0/2379587828 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607a6bdec40 0x5607a6bf4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:21.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.309+0000 7ffab5a98740 1 --2- 172.21.15.37:0/2379587828 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5607a6bd2090 0x5607a6bf4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:21.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.309+0000 7ffab5a98740 1 --2- 172.21.15.37:0/2379587828 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5607a6bd1770 0x5607a6bd7830 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:21.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.309+0000 7ffab5a98740 1 -- 172.21.15.37:0/2379587828 >> 172.21.15.37:0/2379587828 conn(0x5607a6bcdde0 msgr2=0x5607a6bccec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:21.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.309+0000 7ffab5a98740 1 -- 172.21.15.37:0/2379587828 shutdown_connections 2024-09-19T06:07:21.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.309+0000 7ffab5a98740 1 -- 172.21.15.37:0/2379587828 wait complete. 2024-09-19T06:07:21.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.310+0000 7ffab5a98740 1 -- start start 2024-09-19T06:07:21.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.310+0000 7ffab5a98740 1 Processor -- start 2024-09-19T06:07:21.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.310+0000 7ffab5a98740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5607a6bd1770 0x5607a6be1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:21.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.310+0000 7ffab5a98740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607a6bd2090 0x5607a6be2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:21.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.310+0000 7ffab5a98740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5607a6bdec40 0x5607a6be29d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:21.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.310+0000 7ffab5a98740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ffaac1ab7e0 con 0x5607a6bd2090 2024-09-19T06:07:21.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.310+0000 7ffab5a98740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ffaac1acc50 con 0x5607a6bd1770 2024-09-19T06:07:21.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.310+0000 7ffab5a98740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ffaac1abeb0 con 0x5607a6bdec40 2024-09-19T06:07:21.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.310+0000 7ffab5a98740 10 client.0 _ll_register_callbacks cb 0x7ffa9c009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:07:21.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.310+0000 7ffab145b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607a6bd2090 0x5607a6be2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:21.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.310+0000 7ffab0c5a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5607a6bd1770 0x5607a6be1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:21.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.310+0000 7ffab145b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607a6bd2090 0x5607a6be2490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43712/0 (socket says 172.21.15.37:43712) 2024-09-19T06:07:21.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.310+0000 7ffab145b640 1 -- 172.21.15.37:0/4152562026 learned_addr learned my addr 172.21.15.37:0/4152562026 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:07:21.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.310+0000 7ffab0c5a640 1 --2- 172.21.15.37:0/4152562026 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5607a6bdec40 0x5607a6be29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:21.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.311+0000 7ffab145b640 1 -- 172.21.15.37:0/4152562026 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5607a6bdec40 msgr2=0x5607a6be29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:21.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.311+0000 7ffab145b640 1 --2- 172.21.15.37:0/4152562026 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5607a6bdec40 0x5607a6be29d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:21.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.311+0000 7ffab145b640 1 -- 172.21.15.37:0/4152562026 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5607a6bd1770 msgr2=0x5607a6be1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:21.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.311+0000 7ffab145b640 1 --2- 172.21.15.37:0/4152562026 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5607a6bd1770 0x5607a6be1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:21.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.311+0000 7ffab145b640 1 -- 172.21.15.37:0/4152562026 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607a6bd7f10 con 0x5607a6bd2090 2024-09-19T06:07:21.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.311+0000 7ffab0c5a640 1 --2- 172.21.15.37:0/4152562026 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5607a6bd1770 0x5607a6be1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:07:21.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.311+0000 7ffab145b640 1 --2- 172.21.15.37:0/4152562026 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607a6bd2090 0x5607a6be2490 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7ffaa800bb60 tx=0x7ffaa80037d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=705f77a9d5d650a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:21.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.311+0000 7ffa94ff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-19T06:07:21.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.311+0000 7ffa94ff9640 1 -- 172.21.15.37:0/4152562026 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa802c060 con 0x5607a6bd2090 2024-09-19T06:07:21.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.311+0000 7ffa94ff9640 1 -- 172.21.15.37:0/4152562026 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9121+0+0 (secure 0 0 0) 0x7ffaa800b6d0 con 0x5607a6bd2090 2024-09-19T06:07:21.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.311+0000 7ffab5a98740 1 -- 172.21.15.37:0/4152562026 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa9c0317c0 con 0x5607a6bd2090 2024-09-19T06:07:21.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.312+0000 7ffa94ff9640 1 -- 172.21.15.37:0/4152562026 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ffaa8015040 con 0x5607a6bd2090 2024-09-19T06:07:21.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.312+0000 7ffab5a98740 10 client.15258 fetch_fsmap learned FSMap version 20 2024-09-19T06:07:21.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.312+0000 7ffab5a98740 1 -- 172.21.15.37:0/4152562026 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5607a6bde5f0 con 0x5607a6bd2090 2024-09-19T06:07:21.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.312+0000 7ffa94ff9640 1 -- 172.21.15.37:0/4152562026 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa9c0317c0 con 0x5607a6bd2090 2024-09-19T06:07:21.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.312+0000 7ffa94ff9640 1 -- 172.21.15.37:0/4152562026 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 20) ==== 8338+0+0 (secure 0 0 0) 0x7ffaa80114d0 con 0x5607a6bd2090 2024-09-19T06:07:21.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.312+0000 7ffab5a98740 10 client.15258 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:07:21.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.312+0000 7ffab5a98740 10 client.15258 resolve_mds: validated gid 24485 aka daemon mds.b 2024-09-19T06:07:21.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.312+0000 7ffab5a98740 20 client.15258 populate_metadata read hostname 'smithi037' 2024-09-19T06:07:21.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.312+0000 7ffab5a98740 1 --2- 172.21.15.37:0/4152562026 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x5607a6bec760 0x5607a6c59a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:21.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.312+0000 7ffab5a98740 4 client.15258 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}] 2024-09-19T06:07:21.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.312+0000 7ffab5a98740 1 -- 172.21.15.37:0/4152562026 --> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}) -- 0x5607a6b3dbe0 con 0x5607a6bec760 2024-09-19T06:07:21.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.312+0000 7ffab0c5a640 1 --2- 172.21.15.37:0/4152562026 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x5607a6bec760 0x5607a6c59a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:21.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.313+0000 7ffa94ff9640 10 client.15258 ms_handle_connect on v2:172.21.15.99:6838/3404812329 2024-09-19T06:07:21.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.313+0000 7ffab0c5a640 1 --2- 172.21.15.37:0/4152562026 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x5607a6bec760 0x5607a6c59a70 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad61a0589348621e server_cookie=9993aee777336e7e in_seq=0 out_seq=0 2024-09-19T06:07:21.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.317+0000 7ffa94ff9640 1 -- 172.21.15.37:0/4152562026 <== mds.0 v2:172.21.15.99:6838/3404812329 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x5607a6b3dbe0 con 0x5607a6bec760 2024-09-19T06:07:21.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.317+0000 7ffa94ff9640 10 client.15258 handle_command_reply: tid=0 2024-09-19T06:07:21.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.317+0000 7ffab5a98740 1 client.15258 shutdown 2024-09-19T06:07:21.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.317+0000 7ffab5a98740 1 -- 172.21.15.37:0/4152562026 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607a6bd2090 msgr2=0x5607a6be2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:21.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.317+0000 7ffab5a98740 1 --2- 172.21.15.37:0/4152562026 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607a6bd2090 0x5607a6be2490 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7ffaa800bb60 tx=0x7ffaa80037d0 comp rx=0 tx=0).stop 2024-09-19T06:07:21.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.317+0000 7ffab5a98740 1 -- 172.21.15.37:0/4152562026 shutdown_connections 2024-09-19T06:07:21.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.317+0000 7ffab5a98740 1 --2- 172.21.15.37:0/4152562026 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x5607a6bec760 0x5607a6c59a70 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:21.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.317+0000 7ffab5a98740 1 --2- 172.21.15.37:0/4152562026 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5607a6bdec40 0x5607a6be29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:21.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.317+0000 7ffab5a98740 1 --2- 172.21.15.37:0/4152562026 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607a6bd2090 0x5607a6be2490 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:21.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.317+0000 7ffab5a98740 1 --2- 172.21.15.37:0/4152562026 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5607a6bd1770 0x5607a6be1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:21.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.317+0000 7ffab5a98740 1 -- 172.21.15.37:0/4152562026 >> 172.21.15.37:0/4152562026 conn(0x5607a6bcdde0 msgr2=0x5607a6bd31c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:21.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.317+0000 7ffa94ff9640 0 client.15258 ms_handle_reset on v2:172.21.15.99:6838/3404812329 2024-09-19T06:07:21.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.317+0000 7ffab5a98740 1 -- 172.21.15.37:0/4152562026 shutdown_connections 2024-09-19T06:07:21.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.317+0000 7ffab5a98740 1 -- 172.21.15.37:0/4152562026 wait complete. 2024-09-19T06:07:21.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.317+0000 7ffab5a98740 20 client.15258 trim_cache size 0 max 16384 2024-09-19T06:07:21.321 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-19T06:07:21.321 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 20, 2024-09-19T06:07:21.321 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 24485, 2024-09-19T06:07:21.321 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 6, 2024-09-19T06:07:21.321 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": { 2024-09-19T06:07:21.321 INFO:teuthology.orchestra.run.smithi037.stdout: "66d90fa0": { 2024-09-19T06:07:21.321 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 6, 2024-09-19T06:07:21.321 INFO:teuthology.orchestra.run.smithi037.stdout: "age_ref": 0.0, 2024-09-19T06:07:21.321 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-09-19T06:07:21.321 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "QUIESCED", 2024-09-19T06:07:21.322 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-09-19T06:07:21.322 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:07:21.322 INFO:teuthology.orchestra.run.smithi037.stdout: "timeout": 90.0, 2024-09-19T06:07:21.322 INFO:teuthology.orchestra.run.smithi037.stdout: "expiration": 140.3, 2024-09-19T06:07:21.322 INFO:teuthology.orchestra.run.smithi037.stdout: "members": { 2024-09-19T06:07:21.322 INFO:teuthology.orchestra.run.smithi037.stdout: "file:/": { 2024-09-19T06:07:21.322 INFO:teuthology.orchestra.run.smithi037.stdout: "excluded": false, 2024-09-19T06:07:21.322 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-09-19T06:07:21.322 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "QUIESCED", 2024-09-19T06:07:21.322 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-09-19T06:07:21.322 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:07:21.322 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:07:21.322 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:07:21.322 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:07:21.322 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:07:21.322 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-19T06:07:21.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.318+0000 7ffab36bf640 1 -- 172.21.15.37:0/3704241020 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7ffa980a32c0 msgr2=0x7ffa980a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:21.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.318+0000 7ffab36bf640 1 --2- 172.21.15.37:0/3704241020 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7ffa980a32c0 0x7ffa980a5780 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ffaa4000f80 tx=0x7ffaa406aed0 comp rx=0 tx=0).stop 2024-09-19T06:07:21.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.318+0000 7ffab36bf640 1 -- 172.21.15.37:0/3704241020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffaac106a70 msgr2=0x7ffaac19bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:21.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.318+0000 7ffab36bf640 1 --2- 172.21.15.37:0/3704241020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffaac106a70 0x7ffaac19bc30 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ffaa400eaa0 tx=0x7ffaa400ef60 comp rx=0 tx=0).stop 2024-09-19T06:07:21.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.318+0000 7ffab36bf640 1 -- 172.21.15.37:0/3704241020 shutdown_connections 2024-09-19T06:07:21.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.318+0000 7ffab36bf640 1 --2- 172.21.15.37:0/3704241020 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7ffa980a32c0 0x7ffa980a5780 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:21.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.318+0000 7ffab36bf640 1 --2- 172.21.15.37:0/3704241020 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffaac101410 0x7ffaac1978a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:21.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.318+0000 7ffab36bf640 1 --2- 172.21.15.37:0/3704241020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffaac106a70 0x7ffaac19bc30 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:21.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.318+0000 7ffab36bf640 1 --2- 172.21.15.37:0/3704241020 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffaac100a70 0x7ffaac197360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:21.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.318+0000 7ffab36bf640 1 -- 172.21.15.37:0/3704241020 >> 172.21.15.37:0/3704241020 conn(0x7ffaac0fc7d0 msgr2=0x7ffaac0fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:21.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.318+0000 7ffab36bf640 1 -- 172.21.15.37:0/3704241020 shutdown_connections 2024-09-19T06:07:21.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:21.318+0000 7ffab36bf640 1 -- 172.21.15.37:0/3704241020 wait complete. 2024-09-19T06:07:21.945 INFO:tasks.workunit.client.0.smithi037.stderr:Updating files: 90% (11615/12896) Updating files: 91% (11736/12896) Updating files: 92% (11865/12896) Updating files: 93% (11994/12896) Updating files: 94% (12123/12896) Updating files: 95% (12252/12896) Updating files: 96% (12381/12896) Updating files: 97% (12510/12896) Updating files: 98% (12639/12896) Updating files: 99% (12768/12896) Updating files: 100% (12896/12896) Updating files: 100% (12896/12896), done. 2024-09-19T06:07:22.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:07:21 smithi037 ceph-mon[31211]: pgmap v385: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:07:22.180 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '66d90fa0', quiesce took 3.9 seconds. Will release after: 16.450000000000003 2024-09-19T06:07:22.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:07:21 smithi099 ceph-mon[35300]: pgmap v385: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:07:22.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:07:21 smithi117 ceph-mon[35050]: pgmap v385: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:07:22.901 INFO:tasks.workunit.client.0.smithi037.stderr:Note: switching to '6fad5dd73c93545e52f57f681e140a9c3529c11e'. 2024-09-19T06:07:22.901 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-19T06:07:22.901 INFO:tasks.workunit.client.0.smithi037.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-19T06:07:22.901 INFO:tasks.workunit.client.0.smithi037.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-19T06:07:22.901 INFO:tasks.workunit.client.0.smithi037.stderr:state without impacting any branches by switching back to a branch. 2024-09-19T06:07:22.901 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-19T06:07:22.901 INFO:tasks.workunit.client.0.smithi037.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-19T06:07:22.901 INFO:tasks.workunit.client.0.smithi037.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-19T06:07:22.901 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-19T06:07:22.902 INFO:tasks.workunit.client.0.smithi037.stderr: git switch -c 2024-09-19T06:07:22.902 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-19T06:07:22.902 INFO:tasks.workunit.client.0.smithi037.stderr:Or undo this operation with: 2024-09-19T06:07:22.902 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-19T06:07:22.902 INFO:tasks.workunit.client.0.smithi037.stderr: git switch - 2024-09-19T06:07:22.902 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-19T06:07:22.902 INFO:tasks.workunit.client.0.smithi037.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-19T06:07:22.902 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-09-19T06:07:22.902 INFO:tasks.workunit.client.0.smithi037.stderr:HEAD is now at 6fad5dd73c9 Merge pull request #59812 from neha-ojha/wip-rtd-squid 2024-09-19T06:07:22.906 DEBUG:teuthology.orchestra.run.smithi037:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-19T06:07:22.930 INFO:tasks.workunit.client.0.smithi037.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-19T06:07:22.933 INFO:tasks.workunit.client.0.smithi037.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T06:07:22.933 INFO:tasks.workunit.client.0.smithi037.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-19T06:07:23.620 INFO:tasks.workunit.client.0.smithi037.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-19T06:07:23.689 INFO:tasks.workunit.client.0.smithi037.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-19T06:07:23.730 INFO:tasks.workunit.client.0.smithi037.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T06:07:23.732 INFO:tasks.workunit.client.0.smithi037.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T06:07:23.732 INFO:tasks.workunit.client.0.smithi037.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-19T06:07:23.772 INFO:tasks.workunit.client.0.smithi037.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T06:07:23.776 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-19T06:07:23.776 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-19T06:07:23.834 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-09-19T06:07:23.835 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-19T06:07:23.835 DEBUG:teuthology.orchestra.run.smithi037:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6fad5dd73c93545e52f57f681e140a9c3529c11e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-09-19T06:07:24.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:07:23 smithi099 ceph-mon[35300]: pgmap v386: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:07:24.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:07:23 smithi117 ceph-mon[35050]: pgmap v386: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:07:24.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:07:23 smithi037 ceph-mon[31211]: pgmap v386: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:07:26.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:07:25 smithi099 ceph-mon[35300]: pgmap v387: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:07:26.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:07:25 smithi117 ceph-mon[35050]: pgmap v387: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:07:26.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:07:25 smithi037 ceph-mon[31211]: pgmap v387: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:07:28.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:07:27 smithi099 ceph-mon[35300]: pgmap v388: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:07:28.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:07:27 smithi117 ceph-mon[35050]: pgmap v388: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:07:28.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:07:27 smithi037 ceph-mon[31211]: pgmap v388: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:07:30.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:07:29 smithi099 ceph-mon[35300]: pgmap v389: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:07:30.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:07:29 smithi117 ceph-mon[35050]: pgmap v389: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:07:30.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:07:29 smithi037 ceph-mon[31211]: pgmap v389: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T06:07:32.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:07:31 smithi099 ceph-mon[35300]: pgmap v390: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-19T06:07:32.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:07:31 smithi117 ceph-mon[35050]: pgmap v390: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-19T06:07:32.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:07:31 smithi037 ceph-mon[31211]: pgmap v390: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-19T06:07:34.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:07:33 smithi099 ceph-mon[35300]: pgmap v391: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-19T06:07:34.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:07:33 smithi117 ceph-mon[35050]: pgmap v391: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-19T06:07:34.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:07:33 smithi037 ceph-mon[31211]: pgmap v391: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-19T06:07:36.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:07:35 smithi099 ceph-mon[35300]: pgmap v392: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-19T06:07:36.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:07:35 smithi117 ceph-mon[35050]: pgmap v392: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-19T06:07:36.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:07:35 smithi037 ceph-mon[31211]: pgmap v392: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-19T06:07:38.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:07:37 smithi099 ceph-mon[35300]: pgmap v393: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-19T06:07:38.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:07:37 smithi117 ceph-mon[35050]: pgmap v393: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-19T06:07:38.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:07:37 smithi037 ceph-mon[31211]: pgmap v393: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-19T06:07:38.631 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:07:38.904 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:07:39.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:39.391+0000 7f3d2036c640 1 -- 172.21.15.37:0/3686592929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d18101de0 msgr2=0x7f3d181021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:39.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:39.391+0000 7f3d2036c640 1 --2- 172.21.15.37:0/3686592929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d18101de0 0x7f3d181021c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f3d08009900 tx=0x7f3d0802a410 comp rx=0 tx=0).stop 2024-09-19T06:07:39.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:39.391+0000 7f3d2036c640 1 -- 172.21.15.37:0/3686592929 shutdown_connections 2024-09-19T06:07:39.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:39.391+0000 7f3d2036c640 1 --2- 172.21.15.37:0/3686592929 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d18102790 0x7f3d181067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:39.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:39.391+0000 7f3d2036c640 1 --2- 172.21.15.37:0/3686592929 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d18106f10 0x7f3d1810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:39.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:39.391+0000 7f3d2036c640 1 --2- 172.21.15.37:0/3686592929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d18101de0 0x7f3d181021c0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:39.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:39.391+0000 7f3d2036c640 1 -- 172.21.15.37:0/3686592929 >> 172.21.15.37:0/3686592929 conn(0x7f3d180fd8c0 msgr2=0x7f3d180ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:39.391+0000 7f3d2036c640 1 -- 172.21.15.37:0/3686592929 shutdown_connections 2024-09-19T06:07:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:39.391+0000 7f3d2036c640 1 -- 172.21.15.37:0/3686592929 wait complete. 2024-09-19T06:07:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:39.392+0000 7f3d2036c640 1 Processor -- start 2024-09-19T06:07:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:39.392+0000 7f3d2036c640 1 -- start start 2024-09-19T06:07:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:39.392+0000 7f3d2036c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d18101de0 0x7f3d18198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:39.392+0000 7f3d2036c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d18102790 0x7f3d18198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:39.392+0000 7f3d2036c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d18106f10 0x7f3d1819cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:39.392+0000 7f3d2036c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3d18111f70 con 0x7f3d18102790 2024-09-19T06:07:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:39.392+0000 7f3d2036c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f3d18111df0 con 0x7f3d18106f10 2024-09-19T06:07:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:39.392+0000 7f3d2036c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3d181120f0 con 0x7f3d18101de0 2024-09-19T06:07:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:39.393+0000 7f3d1d907640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d18102790 0x7f3d18198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:39.393+0000 7f3d1d907640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d18102790 0x7f3d18198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57460/0 (socket says 172.21.15.37:57460) 2024-09-19T06:07:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:39.393+0000 7f3d1d907640 1 -- 172.21.15.37:0/1304204853 learned_addr learned my addr 172.21.15.37:0/1304204853 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:07:39.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:39.393+0000 7f3d1e909640 1 --2- 172.21.15.37:0/1304204853 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d18106f10 0x7f3d1819cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:39.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:39.393+0000 7f3d1e108640 1 --2- 172.21.15.37:0/1304204853 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d18101de0 0x7f3d18198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:39.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:39.393+0000 7f3d1d907640 1 -- 172.21.15.37:0/1304204853 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d18101de0 msgr2=0x7f3d18198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:39.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:39.393+0000 7f3d1d907640 1 --2- 172.21.15.37:0/1304204853 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d18101de0 0x7f3d18198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:39.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:39.393+0000 7f3d1d907640 1 -- 172.21.15.37:0/1304204853 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d18106f10 msgr2=0x7f3d1819cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:39.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:39.393+0000 7f3d1d907640 1 --2- 172.21.15.37:0/1304204853 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d18106f10 0x7f3d1819cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:39.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:39.393+0000 7f3d1d907640 1 -- 172.21.15.37:0/1304204853 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d1819d3e0 con 0x7f3d18102790 2024-09-19T06:07:39.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:39.393+0000 7f3d1d907640 1 --2- 172.21.15.37:0/1304204853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d18102790 0x7f3d18198970 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c00d950 tx=0x7f3d0c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:39.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:39.393+0000 7f3d177fe640 1 -- 172.21.15.37:0/1304204853 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d0c017070 con 0x7f3d18102790 2024-09-19T06:07:39.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:39.393+0000 7f3d177fe640 1 -- 172.21.15.37:0/1304204853 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d0c009c30 con 0x7f3d18102790 2024-09-19T06:07:39.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:39.393+0000 7f3d2036c640 1 -- 172.21.15.37:0/1304204853 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d1819d6d0 con 0x7f3d18102790 2024-09-19T06:07:39.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:39.393+0000 7f3d177fe640 1 -- 172.21.15.37:0/1304204853 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d0c00f6b0 con 0x7f3d18102790 2024-09-19T06:07:39.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:39.393+0000 7f3d2036c640 1 -- 172.21.15.37:0/1304204853 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d181a4fb0 con 0x7f3d18102790 2024-09-19T06:07:39.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:39.394+0000 7f3d2036c640 1 -- 172.21.15.37:0/1304204853 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d181021c0 con 0x7f3d18102790 2024-09-19T06:07:39.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:39.395+0000 7f3d177fe640 1 -- 172.21.15.37:0/1304204853 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f3d0c0109d0 con 0x7f3d18102790 2024-09-19T06:07:39.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:39.396+0000 7f3d177fe640 1 --2- 172.21.15.37:0/1304204853 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f3d000a32c0 0x7f3d000a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:39.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:39.396+0000 7f3d177fe640 1 -- 172.21.15.37:0/1304204853 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9121+0+0 (secure 0 0 0) 0x7f3d0c0cf880 con 0x7f3d18102790 2024-09-19T06:07:39.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:39.396+0000 7f3d1e108640 1 --2- 172.21.15.37:0/1304204853 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f3d000a32c0 0x7f3d000a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:39.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:39.397+0000 7f3d1e108640 1 --2- 172.21.15.37:0/1304204853 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f3d000a32c0 0x7f3d000a5780 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3d08005ab0 tx=0x7f3d08005a20 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:39.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:39.400+0000 7f3d177fe640 1 -- 172.21.15.37:0/1304204853 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3d0c009de0 con 0x7f3d18102790 2024-09-19T06:07:39.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:39.616+0000 7f3d2036c640 1 -- 172.21.15.37:0/1304204853 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3d1810a150 con 0x7f3d18102790 2024-09-19T06:07:39.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:39.617+0000 7f3d177fe640 1 -- 172.21.15.37:0/1304204853 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11842 (secure 0 0 0) 0x7f3d0c09c220 con 0x7f3d18102790 2024-09-19T06:07:39.619 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T06:07:39.619 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"btime":"2024-09-19T06:04:42:531480+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14514,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2864247978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2864247978},{"type":"v1","addr":"172.21.15.37:6835","nonce":2864247978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14526,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/633000932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":633000932},{"type":"v1","addr":"172.21.15.37:6837","nonce":633000932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14574,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/3753800615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":3753800615},{"type":"v1","addr":"172.21.15.37:6839","nonce":3753800615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/2718998355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":2718998355},{"type":"v1","addr":"172.21.15.37:6841","nonce":2718998355}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6833/866590207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":866590207},{"type":"v1","addr":"172.21.15.99:6833","nonce":866590207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3898668400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3898668400},{"type":"v1","addr":"172.21.15.117:6833","nonce":3898668400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2650673320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2650673320},{"type":"v1","addr":"172.21.15.99:6835","nonce":2650673320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1097471349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1097471349},{"type":"v1","addr":"172.21.15.117:6835","nonce":1097471349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24457,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1001392672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1001392672},{"type":"v1","addr":"172.21.15.117:6837","nonce":1001392672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/23570935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":23570935},{"type":"v1","addr":"172.21.15.99:6837","nonce":23570935}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:04:06.253034+0000","modified":"2024-09-19T06:04:42.196783+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24485},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24478":{"gid":24478,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6839/1269518339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":1269518339},{"type":"v1","addr":"172.21.15.117:6839","nonce":1269518339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.99:6839/3404812329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":3404812329},{"type":"v1","addr":"172.21.15.99:6839","nonce":3404812329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24485,"qdb_cluster":[24485]},"id":1}]} 2024-09-19T06:07:39.620 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 20 2024-09-19T06:07:39.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:39.619+0000 7f3d2036c640 1 -- 172.21.15.37:0/1304204853 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f3d000a32c0 msgr2=0x7f3d000a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:39.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:39.619+0000 7f3d2036c640 1 --2- 172.21.15.37:0/1304204853 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f3d000a32c0 0x7f3d000a5780 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3d08005ab0 tx=0x7f3d08005a20 comp rx=0 tx=0).stop 2024-09-19T06:07:39.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:39.620+0000 7f3d2036c640 1 -- 172.21.15.37:0/1304204853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d18102790 msgr2=0x7f3d18198970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:39.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:39.620+0000 7f3d2036c640 1 --2- 172.21.15.37:0/1304204853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d18102790 0x7f3d18198970 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c00d950 tx=0x7f3d0c00de10 comp rx=0 tx=0).stop 2024-09-19T06:07:39.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:39.620+0000 7f3d2036c640 1 -- 172.21.15.37:0/1304204853 shutdown_connections 2024-09-19T06:07:39.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:39.620+0000 7f3d2036c640 1 --2- 172.21.15.37:0/1304204853 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f3d000a32c0 0x7f3d000a5780 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:39.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:39.620+0000 7f3d2036c640 1 --2- 172.21.15.37:0/1304204853 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d18106f10 0x7f3d1819cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:39.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:39.620+0000 7f3d2036c640 1 --2- 172.21.15.37:0/1304204853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d18102790 0x7f3d18198970 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:39.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:39.620+0000 7f3d2036c640 1 --2- 172.21.15.37:0/1304204853 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3d18101de0 0x7f3d18198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:39.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:39.620+0000 7f3d2036c640 1 -- 172.21.15.37:0/1304204853 >> 172.21.15.37:0/1304204853 conn(0x7f3d180fd8c0 msgr2=0x7f3d180febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:39.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:39.620+0000 7f3d2036c640 1 -- 172.21.15.37:0/1304204853 shutdown_connections 2024-09-19T06:07:39.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:39.620+0000 7f3d2036c640 1 -- 172.21.15.37:0/1304204853 wait complete. 2024-09-19T06:07:40.061 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:07:39 smithi037 ceph-mon[31211]: pgmap v394: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-19T06:07:40.061 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:07:39 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/1304204853' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:07:40.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:07:39 smithi099 ceph-mon[35300]: pgmap v394: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-19T06:07:40.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:07:39 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/1304204853' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:07:40.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:07:39 smithi117 ceph-mon[35050]: pgmap v394: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-19T06:07:40.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:07:39 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/1304204853' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:07:40.364 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24485 quiesce db --set-id 66d90fa0 --release --await' 2024-09-19T06:07:40.364 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24485 quiesce db --set-id 66d90fa0 --release --await 2024-09-19T06:07:40.626 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:07:41.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.071+0000 7fadd1630640 1 -- 172.21.15.37:0/2509005883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadcc10c180 msgr2=0x7fadcc10e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:41.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.071+0000 7fadd1630640 1 --2- 172.21.15.37:0/2509005883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadcc10c180 0x7fadcc10e600 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fadc4009ca0 tx=0x7fadc402a950 comp rx=0 tx=0).stop 2024-09-19T06:07:41.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.071+0000 7fadd1630640 1 -- 172.21.15.37:0/2509005883 shutdown_connections 2024-09-19T06:07:41.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.071+0000 7fadd1630640 1 --2- 172.21.15.37:0/2509005883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadcc10c180 0x7fadcc10e600 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:41.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.071+0000 7fadd1630640 1 --2- 172.21.15.37:0/2509005883 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fadcc1036c0 0x7fadcc10bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:41.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.071+0000 7fadd1630640 1 --2- 172.21.15.37:0/2509005883 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fadcc102da0 0x7fadcc103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:41.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.071+0000 7fadd1630640 1 -- 172.21.15.37:0/2509005883 >> 172.21.15.37:0/2509005883 conn(0x7fadcc0fc7a0 msgr2=0x7fadcc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:41.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.071+0000 7fadd1630640 1 -- 172.21.15.37:0/2509005883 shutdown_connections 2024-09-19T06:07:41.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.071+0000 7fadd1630640 1 -- 172.21.15.37:0/2509005883 wait complete. 2024-09-19T06:07:41.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.072+0000 7fadd1630640 1 Processor -- start 2024-09-19T06:07:41.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.072+0000 7fadd1630640 1 -- start start 2024-09-19T06:07:41.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.072+0000 7fadd1630640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fadcc102da0 0x7fadcc1983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:41.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.072+0000 7fadd1630640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fadcc1036c0 0x7fadcc198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:41.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.072+0000 7fadd1630640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadcc10c180 0x7fadcc19cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:41.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.072+0000 7fadd1630640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc111f70 con 0x7fadcc10c180 2024-09-19T06:07:41.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.072+0000 7fadd1630640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc111df0 con 0x7fadcc1036c0 2024-09-19T06:07:41.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.072+0000 7fadd1630640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc1120f0 con 0x7fadcc102da0 2024-09-19T06:07:41.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.072+0000 7fadcb7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadcc10c180 0x7fadcc19cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:41.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.072+0000 7fadcb7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadcc10c180 0x7fadcc19cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57476/0 (socket says 172.21.15.37:57476) 2024-09-19T06:07:41.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.072+0000 7fadcb7fe640 1 -- 172.21.15.37:0/1613906233 learned_addr learned my addr 172.21.15.37:0/1613906233 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:07:41.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.072+0000 7fadcaffd640 1 --2- 172.21.15.37:0/1613906233 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fadcc102da0 0x7fadcc1983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:41.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.073+0000 7fadcb7fe640 1 -- 172.21.15.37:0/1613906233 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fadcc102da0 msgr2=0x7fadcc1983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:41.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.073+0000 7fadcb7fe640 1 --2- 172.21.15.37:0/1613906233 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fadcc102da0 0x7fadcc1983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:41.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.073+0000 7fadcb7fe640 1 -- 172.21.15.37:0/1613906233 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fadcc1036c0 msgr2=0x7fadcc198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:41.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.073+0000 7fadcb7fe640 1 --2- 172.21.15.37:0/1613906233 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fadcc1036c0 0x7fadcc198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:41.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.073+0000 7fadcb7fe640 1 -- 172.21.15.37:0/1613906233 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadcc19d380 con 0x7fadcc10c180 2024-09-19T06:07:41.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.073+0000 7fadcb7fe640 1 --2- 172.21.15.37:0/1613906233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadcc10c180 0x7fadcc19cca0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fadc4009dc0 tx=0x7fadc4003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:41.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.073+0000 7fadb3fff640 1 -- 172.21.15.37:0/1613906233 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc4034040 con 0x7fadcc10c180 2024-09-19T06:07:41.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.073+0000 7fadd1630640 1 -- 172.21.15.37:0/1613906233 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadcc19d610 con 0x7fadcc10c180 2024-09-19T06:07:41.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.073+0000 7fadb3fff640 1 -- 172.21.15.37:0/1613906233 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fadc402f940 con 0x7fadcc10c180 2024-09-19T06:07:41.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.073+0000 7fadb3fff640 1 -- 172.21.15.37:0/1613906233 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc40046a0 con 0x7fadcc10c180 2024-09-19T06:07:41.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.074+0000 7fadd1630640 1 -- 172.21.15.37:0/1613906233 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadcc1a4f50 con 0x7fadcc10c180 2024-09-19T06:07:41.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.076+0000 7fadb3fff640 1 -- 172.21.15.37:0/1613906233 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fadc4037020 con 0x7fadcc10c180 2024-09-19T06:07:41.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.077+0000 7fadd3a09740 1 Processor -- start 2024-09-19T06:07:41.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.077+0000 7fadd3a09740 1 -- start start 2024-09-19T06:07:41.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.077+0000 7fadd3a09740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562e65c8e060 0x562e65c8e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:41.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.077+0000 7fadd3a09740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562e65c8e980 0x562e65c98d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:41.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.077+0000 7fadd3a09740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562e65c99240 0x562e65c9b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:41.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.077+0000 7fadd3a09740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562e65bf3620 con 0x562e65c99240 2024-09-19T06:07:41.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.077+0000 7fadd3a09740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x562e65b9ae50 con 0x562e65c8e060 2024-09-19T06:07:41.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.077+0000 7fadd3a09740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x562e65bef5e0 con 0x562e65c8e980 2024-09-19T06:07:41.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.077+0000 7fadca7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562e65c99240 0x562e65c9b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:41.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.078+0000 7fadca7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562e65c99240 0x562e65c9b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57484/0 (socket says 172.21.15.37:57484) 2024-09-19T06:07:41.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.078+0000 7fadca7fc640 1 -- 172.21.15.37:0/2405761943 learned_addr learned my addr 172.21.15.37:0/2405761943 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:07:41.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.078+0000 7fadca7fc640 1 --2- 172.21.15.37:0/2405761943 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562e65c8e060 0x562e65c8e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:41.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.078+0000 7fadb3fff640 1 --2- 172.21.15.37:0/1613906233 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fadb40a3240 0x7fadb40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:41.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.078+0000 7fadcaffd640 1 --2- 172.21.15.37:0/2405761943 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562e65c8e980 0x562e65c98d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:41.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.078+0000 7fadca7fc640 1 -- 172.21.15.37:0/2405761943 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562e65c8e980 msgr2=0x562e65c98d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:41.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.078+0000 7fadca7fc640 1 --2- 172.21.15.37:0/2405761943 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562e65c8e980 0x562e65c98d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:41.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.078+0000 7fadca7fc640 1 -- 172.21.15.37:0/2405761943 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562e65c8e060 msgr2=0x562e65c8e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:41.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.078+0000 7fadca7fc640 1 --2- 172.21.15.37:0/2405761943 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562e65c8e060 0x562e65c8e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:41.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.078+0000 7fadca7fc640 1 -- 172.21.15.37:0/2405761943 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e65b8bd40 con 0x562e65c99240 2024-09-19T06:07:41.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.078+0000 7fadb3fff640 1 -- 172.21.15.37:0/1613906233 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9121+0+0 (secure 0 0 0) 0x7fadc40f0b50 con 0x7fadcc10c180 2024-09-19T06:07:41.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.078+0000 7fadcb7fe640 1 --2- 172.21.15.37:0/1613906233 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fadb40a3240 0x7fadb40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:41.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.078+0000 7fadca7fc640 1 --2- 172.21.15.37:0/2405761943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562e65c99240 0x562e65c9b630 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fadc0009460 tx=0x7fadc00095f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1fdf032a554adfc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:41.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.078+0000 7fadb17fa640 1 -- 172.21.15.37:0/2405761943 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc0013070 con 0x562e65c99240 2024-09-19T06:07:41.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.078+0000 7fadb17fa640 1 -- 172.21.15.37:0/2405761943 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fadc0017070 con 0x562e65c99240 2024-09-19T06:07:41.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.078+0000 7fadcb7fe640 1 --2- 172.21.15.37:0/1613906233 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fadb40a3240 0x7fadb40a5700 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fadc40ee270 tx=0x7fadc4003f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:41.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.078+0000 7fadb17fa640 1 -- 172.21.15.37:0/2405761943 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc0005630 con 0x562e65c99240 2024-09-19T06:07:41.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.079+0000 7fadd3a09740 1 -- 172.21.15.37:0/2405761943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562e65c99240 msgr2=0x562e65c9b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:41.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.079+0000 7fadd3a09740 1 --2- 172.21.15.37:0/2405761943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562e65c99240 0x562e65c9b630 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fadc0009460 tx=0x7fadc00095f0 comp rx=0 tx=0).stop 2024-09-19T06:07:41.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.079+0000 7fadd3a09740 1 -- 172.21.15.37:0/2405761943 shutdown_connections 2024-09-19T06:07:41.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.079+0000 7fadd3a09740 1 --2- 172.21.15.37:0/2405761943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562e65c99240 0x562e65c9b630 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:41.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.079+0000 7fadd3a09740 1 --2- 172.21.15.37:0/2405761943 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562e65c8e980 0x562e65c98d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:41.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.079+0000 7fadd3a09740 1 --2- 172.21.15.37:0/2405761943 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562e65c8e060 0x562e65c8e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:41.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.079+0000 7fadd3a09740 1 -- 172.21.15.37:0/2405761943 >> 172.21.15.37:0/2405761943 conn(0x562e65c8a5f0 msgr2=0x562e65c8a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:41.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.079+0000 7fadd3a09740 1 -- 172.21.15.37:0/2405761943 shutdown_connections 2024-09-19T06:07:41.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.079+0000 7fadd3a09740 1 -- 172.21.15.37:0/2405761943 wait complete. 2024-09-19T06:07:41.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.080+0000 7fadd3a09740 1 -- start start 2024-09-19T06:07:41.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.080+0000 7fadd3a09740 1 Processor -- start 2024-09-19T06:07:41.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.080+0000 7fadd3a09740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562e65c8e060 0x562e65c96130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:41.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.080+0000 7fadd3a09740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562e65c8e980 0x562e65c96670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:41.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.080+0000 7fadd3a09740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562e65c99240 0x562e65c96bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:41.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.080+0000 7fadd3a09740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562e65c9be10 con 0x562e65c8e980 2024-09-19T06:07:41.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.080+0000 7fadd3a09740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x562e65b7bf10 con 0x562e65c99240 2024-09-19T06:07:41.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.080+0000 7fadd3a09740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x562e65c9bf90 con 0x562e65c8e060 2024-09-19T06:07:41.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.080+0000 7fadd3a09740 10 client.0 _ll_register_callbacks cb 0x562e65b9fdb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:07:41.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.080+0000 7fadcaffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562e65c8e980 0x562e65c96670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:41.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.080+0000 7fadcaffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562e65c8e980 0x562e65c96670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57486/0 (socket says 172.21.15.37:57486) 2024-09-19T06:07:41.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.080+0000 7fadcaffd640 1 -- 172.21.15.37:0/4257470380 learned_addr learned my addr 172.21.15.37:0/4257470380 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:07:41.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.080+0000 7fadca7fc640 1 --2- 172.21.15.37:0/4257470380 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562e65c8e060 0x562e65c96130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:41.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.080+0000 7fadca7fc640 1 --2- 172.21.15.37:0/4257470380 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562e65c99240 0x562e65c96bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:41.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.080+0000 7fadcaffd640 1 -- 172.21.15.37:0/4257470380 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562e65c8e060 msgr2=0x562e65c96130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:41.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.080+0000 7fadcaffd640 1 --2- 172.21.15.37:0/4257470380 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562e65c8e060 0x562e65c96130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:41.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.080+0000 7fadcaffd640 1 -- 172.21.15.37:0/4257470380 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562e65c99240 msgr2=0x562e65c96bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:41.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.080+0000 7fadcaffd640 1 --2- 172.21.15.37:0/4257470380 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562e65c99240 0x562e65c96bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:41.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.080+0000 7fadcaffd640 1 -- 172.21.15.37:0/4257470380 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e65902580 con 0x562e65c8e980 2024-09-19T06:07:41.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.081+0000 7fadcaffd640 1 --2- 172.21.15.37:0/4257470380 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562e65c8e980 0x562e65c96670 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fadbc012770 tx=0x7fadbc012c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de64161e804374ec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:41.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.081+0000 7fadaeff5640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-19T06:07:41.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.081+0000 7fadaeff5640 1 -- 172.21.15.37:0/4257470380 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadbc00f920 con 0x562e65c8e980 2024-09-19T06:07:41.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.081+0000 7fadaeff5640 1 -- 172.21.15.37:0/4257470380 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9121+0+0 (secure 0 0 0) 0x7fadbc00fac0 con 0x562e65c8e980 2024-09-19T06:07:41.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.081+0000 7fadd3a09740 1 -- 172.21.15.37:0/4257470380 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fadc0017070 con 0x562e65c8e980 2024-09-19T06:07:41.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.081+0000 7fadaeff5640 1 -- 172.21.15.37:0/4257470380 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fadbc00fcc0 con 0x562e65c8e980 2024-09-19T06:07:41.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.081+0000 7fadd3a09740 10 client.15276 fetch_fsmap learned FSMap version 20 2024-09-19T06:07:41.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.081+0000 7fadd3a09740 1 -- 172.21.15.37:0/4257470380 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x562e659cc960 con 0x562e65c8e980 2024-09-19T06:07:41.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.081+0000 7fadaeff5640 1 -- 172.21.15.37:0/4257470380 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fadc0017070 con 0x562e65c8e980 2024-09-19T06:07:41.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.081+0000 7fadaeff5640 1 -- 172.21.15.37:0/4257470380 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 20) ==== 8338+0+0 (secure 0 0 0) 0x7fadbc01c420 con 0x562e65c8e980 2024-09-19T06:07:41.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.082+0000 7fadd3a09740 10 client.15276 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:07:41.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.082+0000 7fadd3a09740 10 client.15276 resolve_mds: validated gid 24485 aka daemon mds.b 2024-09-19T06:07:41.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.082+0000 7fadd3a09740 20 client.15276 populate_metadata read hostname 'smithi037' 2024-09-19T06:07:41.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.082+0000 7fadd3a09740 1 --2- 172.21.15.37:0/4257470380 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x562e65ca8eb0 0x562e65cab2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:41.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.082+0000 7fadd3a09740 4 client.15276 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:07:41.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.082+0000 7fadd3a09740 1 -- 172.21.15.37:0/4257470380 --> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562e65c00b90 con 0x562e65ca8eb0 2024-09-19T06:07:41.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.082+0000 7fadca7fc640 1 --2- 172.21.15.37:0/4257470380 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x562e65ca8eb0 0x562e65cab2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:41.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.082+0000 7fadca7fc640 1 --2- 172.21.15.37:0/4257470380 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x562e65ca8eb0 0x562e65cab2d0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83fe31d0bafa6ab4 server_cookie=5bd4cea871482d3 in_seq=0 out_seq=0 2024-09-19T06:07:41.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.082+0000 7fadaeff5640 10 client.15276 ms_handle_connect on v2:172.21.15.99:6838/3404812329 2024-09-19T06:07:41.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.083+0000 7fadaeff5640 1 -- 172.21.15.37:0/4257470380 <== mds.0 v2:172.21.15.99:6838/3404812329 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562e65c00b90 con 0x562e65ca8eb0 2024-09-19T06:07:41.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.083+0000 7fadaeff5640 10 client.15276 handle_command_reply: tid=0 2024-09-19T06:07:41.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.083+0000 7fadd3a09740 1 client.15276 shutdown 2024-09-19T06:07:41.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.083+0000 7fadd3a09740 1 -- 172.21.15.37:0/4257470380 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562e65c8e980 msgr2=0x562e65c96670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:41.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.083+0000 7fadd3a09740 1 --2- 172.21.15.37:0/4257470380 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562e65c8e980 0x562e65c96670 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fadbc012770 tx=0x7fadbc012c30 comp rx=0 tx=0).stop 2024-09-19T06:07:41.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.083+0000 7fadd3a09740 1 -- 172.21.15.37:0/4257470380 shutdown_connections 2024-09-19T06:07:41.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.083+0000 7fadd3a09740 1 --2- 172.21.15.37:0/4257470380 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x562e65ca8eb0 0x562e65cab2d0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:41.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.083+0000 7fadd3a09740 1 --2- 172.21.15.37:0/4257470380 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562e65c99240 0x562e65c96bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:41.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.083+0000 7fadd3a09740 1 --2- 172.21.15.37:0/4257470380 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562e65c8e980 0x562e65c96670 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:41.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.083+0000 7fadd3a09740 1 --2- 172.21.15.37:0/4257470380 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562e65c8e060 0x562e65c96130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:41.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.083+0000 7fadd3a09740 1 -- 172.21.15.37:0/4257470380 >> 172.21.15.37:0/4257470380 conn(0x562e65c8a5f0 msgr2=0x562e65c902d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:41.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.083+0000 7fadaeff5640 0 client.15276 ms_handle_reset on v2:172.21.15.99:6838/3404812329 2024-09-19T06:07:41.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.083+0000 7fadd3a09740 1 -- 172.21.15.37:0/4257470380 shutdown_connections 2024-09-19T06:07:41.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.083+0000 7fadd3a09740 1 -- 172.21.15.37:0/4257470380 wait complete. 2024-09-19T06:07:41.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.083+0000 7fadd3a09740 20 client.15276 trim_cache size 0 max 16384 2024-09-19T06:07:41.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.100+0000 7fadd3a09740 1 Processor -- start 2024-09-19T06:07:41.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.100+0000 7fadd3a09740 1 -- start start 2024-09-19T06:07:41.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.100+0000 7fadd3a09740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562e65c8e060 0x562e65c89640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:41.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.100+0000 7fadd3a09740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562e65c8e980 0x562e65cb0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:41.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.100+0000 7fadd3a09740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562e65c99240 0x562e65cb10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:41.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.100+0000 7fadd3a09740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc1acc60 con 0x562e65c8e060 2024-09-19T06:07:41.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.100+0000 7fadd3a09740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc1af4e0 con 0x562e65c99240 2024-09-19T06:07:41.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.100+0000 7fadd3a09740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc1ad2d0 con 0x562e65c8e980 2024-09-19T06:07:41.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.100+0000 7fadca7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562e65c8e060 0x562e65c89640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:41.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.101+0000 7fadca7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562e65c8e060 0x562e65c89640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57496/0 (socket says 172.21.15.37:57496) 2024-09-19T06:07:41.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.101+0000 7fadca7fc640 1 -- 172.21.15.37:0/4088920552 learned_addr learned my addr 172.21.15.37:0/4088920552 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:07:41.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.101+0000 7fadca7fc640 1 --2- 172.21.15.37:0/4088920552 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562e65c99240 0x562e65cb10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:41.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.101+0000 7fadcaffd640 1 --2- 172.21.15.37:0/4088920552 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562e65c8e980 0x562e65cb0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:41.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.101+0000 7fadca7fc640 1 -- 172.21.15.37:0/4088920552 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562e65c8e980 msgr2=0x562e65cb0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:41.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.101+0000 7fadca7fc640 1 --2- 172.21.15.37:0/4088920552 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562e65c8e980 0x562e65cb0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:41.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.101+0000 7fadca7fc640 1 -- 172.21.15.37:0/4088920552 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562e65c99240 msgr2=0x562e65cb10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:41.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.101+0000 7fadca7fc640 1 --2- 172.21.15.37:0/4088920552 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562e65c99240 0x562e65cb10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:41.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.101+0000 7fadca7fc640 1 -- 172.21.15.37:0/4088920552 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e65c8a090 con 0x562e65c8e060 2024-09-19T06:07:41.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.101+0000 7fadcaffd640 1 --2- 172.21.15.37:0/4088920552 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562e65c8e980 0x562e65cb0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:07:41.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.101+0000 7fadca7fc640 1 --2- 172.21.15.37:0/4088920552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562e65c8e060 0x562e65c89640 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x562e65c8b970 tx=0x7fadc0020040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ce42207775e08bb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:41.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.101+0000 7fadb0ff9640 1 -- 172.21.15.37:0/4088920552 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc0029040 con 0x562e65c8e060 2024-09-19T06:07:41.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.101+0000 7fadb0ff9640 1 -- 172.21.15.37:0/4088920552 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fadc0017040 con 0x562e65c8e060 2024-09-19T06:07:41.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.101+0000 7fadb0ff9640 1 -- 172.21.15.37:0/4088920552 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc000e980 con 0x562e65c8e060 2024-09-19T06:07:41.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.102+0000 7fadd3a09740 1 -- 172.21.15.37:0/4088920552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562e65c8e060 msgr2=0x562e65c89640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:41.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.102+0000 7fadd3a09740 1 --2- 172.21.15.37:0/4088920552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562e65c8e060 0x562e65c89640 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x562e65c8b970 tx=0x7fadc0020040 comp rx=0 tx=0).stop 2024-09-19T06:07:41.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.102+0000 7fadd3a09740 1 -- 172.21.15.37:0/4088920552 shutdown_connections 2024-09-19T06:07:41.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.102+0000 7fadd3a09740 1 --2- 172.21.15.37:0/4088920552 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562e65c99240 0x562e65cb10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:41.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.102+0000 7fadd3a09740 1 --2- 172.21.15.37:0/4088920552 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562e65c8e980 0x562e65cb0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:41.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.102+0000 7fadd3a09740 1 --2- 172.21.15.37:0/4088920552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562e65c8e060 0x562e65c89640 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:41.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.102+0000 7fadd3a09740 1 -- 172.21.15.37:0/4088920552 >> 172.21.15.37:0/4088920552 conn(0x562e65c8a5f0 msgr2=0x562e65c88f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:41.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.102+0000 7fadd3a09740 1 -- 172.21.15.37:0/4088920552 shutdown_connections 2024-09-19T06:07:41.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.102+0000 7fadd3a09740 1 -- 172.21.15.37:0/4088920552 wait complete. 2024-09-19T06:07:41.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.102+0000 7fadd3a09740 1 -- start start 2024-09-19T06:07:41.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.102+0000 7fadd3a09740 1 Processor -- start 2024-09-19T06:07:41.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.103+0000 7fadd3a09740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562e65c8e060 0x562e65ca11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:41.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.103+0000 7fadd3a09740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562e65c8e980 0x562e65ca1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:41.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.103+0000 7fadd3a09740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562e65c99240 0x562e65c9e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:41.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.103+0000 7fadd3a09740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc1ad9a0 con 0x562e65c8e060 2024-09-19T06:07:41.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.103+0000 7fadd3a09740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc1aee10 con 0x562e65c8e980 2024-09-19T06:07:41.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.103+0000 7fadd3a09740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc1ae070 con 0x562e65c99240 2024-09-19T06:07:41.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.103+0000 7fadd3a09740 10 client.0 _ll_register_callbacks cb 0x7fadbc009f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:07:41.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.103+0000 7fadca7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562e65c8e060 0x562e65ca11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:41.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.103+0000 7fadca7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562e65c8e060 0x562e65ca11e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57506/0 (socket says 172.21.15.37:57506) 2024-09-19T06:07:41.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.103+0000 7fadca7fc640 1 -- 172.21.15.37:0/3891658209 learned_addr learned my addr 172.21.15.37:0/3891658209 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:07:41.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.103+0000 7fadca7fc640 1 --2- 172.21.15.37:0/3891658209 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562e65c99240 0x562e65c9e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:41.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.103+0000 7fadcaffd640 1 --2- 172.21.15.37:0/3891658209 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562e65c8e980 0x562e65ca1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:41.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.103+0000 7fadca7fc640 1 -- 172.21.15.37:0/3891658209 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562e65c99240 msgr2=0x562e65c9e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:41.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.103+0000 7fadca7fc640 1 --2- 172.21.15.37:0/3891658209 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562e65c99240 0x562e65c9e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:41.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.103+0000 7fadca7fc640 1 -- 172.21.15.37:0/3891658209 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562e65c8e980 msgr2=0x562e65ca1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:41.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.103+0000 7fadca7fc640 1 --2- 172.21.15.37:0/3891658209 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562e65c8e980 0x562e65ca1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:41.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.103+0000 7fadca7fc640 1 -- 172.21.15.37:0/3891658209 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e65c9e6f0 con 0x562e65c8e060 2024-09-19T06:07:41.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.103+0000 7fadcaffd640 1 --2- 172.21.15.37:0/3891658209 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562e65c8e980 0x562e65ca1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:07:41.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.103+0000 7fadca7fc640 1 --2- 172.21.15.37:0/3891658209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562e65c8e060 0x562e65ca11e0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fadc00135d0 tx=0x7fadc0005b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6536987631f9fe1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:41.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.103+0000 7fadaeff5640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-19T06:07:41.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.103+0000 7fadaeff5640 1 -- 172.21.15.37:0/3891658209 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc0036060 con 0x562e65c8e060 2024-09-19T06:07:41.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.104+0000 7fadd3a09740 1 -- 172.21.15.37:0/3891658209 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fadc0017040 con 0x562e65c8e060 2024-09-19T06:07:41.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.104+0000 7fadaeff5640 1 -- 172.21.15.37:0/3891658209 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9121+0+0 (secure 0 0 0) 0x7fadc00042a0 con 0x562e65c8e060 2024-09-19T06:07:41.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.104+0000 7fadaeff5640 1 -- 172.21.15.37:0/3891658209 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fadc00044a0 con 0x562e65c8e060 2024-09-19T06:07:41.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.104+0000 7fadd3a09740 10 client.15282 fetch_fsmap learned FSMap version 20 2024-09-19T06:07:41.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.104+0000 7fadd3a09740 1 -- 172.21.15.37:0/3891658209 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x562e65d18740 con 0x562e65c8e060 2024-09-19T06:07:41.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.104+0000 7fadaeff5640 1 -- 172.21.15.37:0/3891658209 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fadc0017040 con 0x562e65c8e060 2024-09-19T06:07:41.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.104+0000 7fadaeff5640 1 -- 172.21.15.37:0/3891658209 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 20) ==== 8338+0+0 (secure 0 0 0) 0x7fadc00039c0 con 0x562e65c8e060 2024-09-19T06:07:41.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.104+0000 7fadd3a09740 10 client.15282 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:07:41.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.104+0000 7fadd3a09740 10 client.15282 resolve_mds: validated gid 24485 aka daemon mds.b 2024-09-19T06:07:41.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.104+0000 7fadd3a09740 20 client.15282 populate_metadata read hostname 'smithi037' 2024-09-19T06:07:41.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.104+0000 7fadd3a09740 1 --2- 172.21.15.37:0/3891658209 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x562e65d18c50 0x562e65d1b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:41.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.104+0000 7fadd3a09740 4 client.15282 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "66d90fa0", "release": true, "await": true}] 2024-09-19T06:07:41.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.104+0000 7fadd3a09740 1 -- 172.21.15.37:0/3891658209 --> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] -- command(tid 0: {"prefix": "quiesce db", "set_id": "66d90fa0", "release": true, "await": true}) -- 0x562e65bfb0a0 con 0x562e65d18c50 2024-09-19T06:07:41.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.104+0000 7fadcaffd640 1 --2- 172.21.15.37:0/3891658209 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x562e65d18c50 0x562e65d1b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:41.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.105+0000 7fadcaffd640 1 --2- 172.21.15.37:0/3891658209 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x562e65d18c50 0x562e65d1b070 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d214e15d69830ab server_cookie=2d774d463107da2b in_seq=0 out_seq=0 2024-09-19T06:07:41.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.105+0000 7fadaeff5640 10 client.15282 ms_handle_connect on v2:172.21.15.99:6838/3404812329 2024-09-19T06:07:41.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.107+0000 7fadaeff5640 1 -- 172.21.15.37:0/3891658209 <== mds.0 v2:172.21.15.99:6838/3404812329 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x562e65bfb0a0 con 0x562e65d18c50 2024-09-19T06:07:41.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.107+0000 7fadaeff5640 10 client.15282 handle_command_reply: tid=0 2024-09-19T06:07:41.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.107+0000 7fadd3a09740 1 client.15282 shutdown 2024-09-19T06:07:41.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.107+0000 7fadd3a09740 1 -- 172.21.15.37:0/3891658209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562e65c8e060 msgr2=0x562e65ca11e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:41.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.107+0000 7fadd3a09740 1 --2- 172.21.15.37:0/3891658209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562e65c8e060 0x562e65ca11e0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fadc00135d0 tx=0x7fadc0005b90 comp rx=0 tx=0).stop 2024-09-19T06:07:41.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.108+0000 7fadd3a09740 1 -- 172.21.15.37:0/3891658209 shutdown_connections 2024-09-19T06:07:41.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.108+0000 7fadd3a09740 1 --2- 172.21.15.37:0/3891658209 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x562e65d18c50 0x562e65d1b070 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:41.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.108+0000 7fadd3a09740 1 --2- 172.21.15.37:0/3891658209 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562e65c8e980 0x562e65ca1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:41.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.108+0000 7fadd3a09740 1 --2- 172.21.15.37:0/3891658209 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562e65c99240 0x562e65c9e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:41.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.108+0000 7fadd3a09740 1 --2- 172.21.15.37:0/3891658209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562e65c8e060 0x562e65ca11e0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:41.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.108+0000 7fadd3a09740 1 -- 172.21.15.37:0/3891658209 >> 172.21.15.37:0/3891658209 conn(0x562e65c8a5f0 msgr2=0x562e65c902d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:41.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.108+0000 7fadaeff5640 0 client.15282 ms_handle_reset on v2:172.21.15.99:6838/3404812329 2024-09-19T06:07:41.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.108+0000 7fadd3a09740 1 -- 172.21.15.37:0/3891658209 shutdown_connections 2024-09-19T06:07:41.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.108+0000 7fadd3a09740 1 -- 172.21.15.37:0/3891658209 wait complete. 2024-09-19T06:07:41.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.108+0000 7fadd3a09740 20 client.15282 trim_cache size 0 max 16384 2024-09-19T06:07:41.115 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-19T06:07:41.115 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 20, 2024-09-19T06:07:41.115 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 24485, 2024-09-19T06:07:41.115 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 8, 2024-09-19T06:07:41.115 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": { 2024-09-19T06:07:41.115 INFO:teuthology.orchestra.run.smithi037.stdout: "66d90fa0": { 2024-09-19T06:07:41.115 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 8, 2024-09-19T06:07:41.115 INFO:teuthology.orchestra.run.smithi037.stdout: "age_ref": 0.0, 2024-09-19T06:07:41.115 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-09-19T06:07:41.115 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RELEASED", 2024-09-19T06:07:41.116 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-09-19T06:07:41.116 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:07:41.116 INFO:teuthology.orchestra.run.smithi037.stdout: "timeout": 90.0, 2024-09-19T06:07:41.116 INFO:teuthology.orchestra.run.smithi037.stdout: "expiration": 140.3, 2024-09-19T06:07:41.116 INFO:teuthology.orchestra.run.smithi037.stdout: "members": { 2024-09-19T06:07:41.116 INFO:teuthology.orchestra.run.smithi037.stdout: "file:/": { 2024-09-19T06:07:41.116 INFO:teuthology.orchestra.run.smithi037.stdout: "excluded": false, 2024-09-19T06:07:41.116 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-09-19T06:07:41.116 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RELEASED", 2024-09-19T06:07:41.116 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-09-19T06:07:41.116 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:07:41.116 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:07:41.116 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:07:41.116 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:07:41.116 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:07:41.117 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-19T06:07:41.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.108+0000 7fadd1630640 1 -- 172.21.15.37:0/1613906233 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fadb40a3240 msgr2=0x7fadb40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:41.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.108+0000 7fadd1630640 1 --2- 172.21.15.37:0/1613906233 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fadb40a3240 0x7fadb40a5700 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fadc40ee270 tx=0x7fadc4003f90 comp rx=0 tx=0).stop 2024-09-19T06:07:41.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.108+0000 7fadd1630640 1 -- 172.21.15.37:0/1613906233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadcc10c180 msgr2=0x7fadcc19cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:41.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.108+0000 7fadd1630640 1 --2- 172.21.15.37:0/1613906233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadcc10c180 0x7fadcc19cca0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fadc4009dc0 tx=0x7fadc4003c10 comp rx=0 tx=0).stop 2024-09-19T06:07:41.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.108+0000 7fadd1630640 1 -- 172.21.15.37:0/1613906233 shutdown_connections 2024-09-19T06:07:41.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.108+0000 7fadd1630640 1 --2- 172.21.15.37:0/1613906233 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fadb40a3240 0x7fadb40a5700 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:41.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.108+0000 7fadd1630640 1 --2- 172.21.15.37:0/1613906233 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fadcc1036c0 0x7fadcc198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:41.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.108+0000 7fadd1630640 1 --2- 172.21.15.37:0/1613906233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadcc10c180 0x7fadcc19cca0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:41.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.108+0000 7fadd1630640 1 --2- 172.21.15.37:0/1613906233 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fadcc102da0 0x7fadcc1983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:41.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.108+0000 7fadd1630640 1 -- 172.21.15.37:0/1613906233 >> 172.21.15.37:0/1613906233 conn(0x7fadcc0fc7a0 msgr2=0x7fadcc0fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:41.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.109+0000 7fadd1630640 1 -- 172.21.15.37:0/1613906233 shutdown_connections 2024-09-19T06:07:41.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:41.109+0000 7fadd1630640 1 -- 172.21.15.37:0/1613906233 wait complete. 2024-09-19T06:07:41.119 INFO:tasks.workunit.client.0.smithi037.stderr:+ mkdir -p fsstress 2024-09-19T06:07:41.119 INFO:tasks.workunit.client.0.smithi037.stderr:+ pushd fsstress 2024-09-19T06:07:41.119 INFO:tasks.workunit.client.0.smithi037.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-19T06:07:41.119 INFO:tasks.workunit.client.0.smithi037.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-19T06:07:41.757 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '66d90fa0', total seconds elapsed: 23.5 2024-09-19T06:07:41.758 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.35 2024-09-19T06:07:41.758 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:07:42.015 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:07:42.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:07:41 smithi037 ceph-mon[31211]: pgmap v395: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-19T06:07:42.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:07:41 smithi099 ceph-mon[35300]: pgmap v395: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-19T06:07:42.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:07:41 smithi117 ceph-mon[35050]: pgmap v395: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-19T06:07:42.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:42.506+0000 7f704eb68640 1 -- 172.21.15.37:0/2732090752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70481027c0 msgr2=0x7f7048106810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:42.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:42.506+0000 7f704eb68640 1 --2- 172.21.15.37:0/2732090752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70481027c0 0x7f7048106810 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f7038009ca0 tx=0x7f703802a8c0 comp rx=0 tx=0).stop 2024-09-19T06:07:42.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:42.506+0000 7f704eb68640 1 -- 172.21.15.37:0/2732090752 shutdown_connections 2024-09-19T06:07:42.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:42.506+0000 7f704eb68640 1 --2- 172.21.15.37:0/2732090752 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7048106f40 0x7f704810eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:42.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:42.506+0000 7f704eb68640 1 --2- 172.21.15.37:0/2732090752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70481027c0 0x7f7048106810 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:42.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:42.506+0000 7f704eb68640 1 --2- 172.21.15.37:0/2732090752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7048101e10 0x7f70481021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:42.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:42.506+0000 7f704eb68640 1 -- 172.21.15.37:0/2732090752 >> 172.21.15.37:0/2732090752 conn(0x7f70480fd8d0 msgr2=0x7f70480ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:42.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:42.506+0000 7f704eb68640 1 -- 172.21.15.37:0/2732090752 shutdown_connections 2024-09-19T06:07:42.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:42.506+0000 7f704eb68640 1 -- 172.21.15.37:0/2732090752 wait complete. 2024-09-19T06:07:42.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:42.506+0000 7f704eb68640 1 Processor -- start 2024-09-19T06:07:42.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:42.506+0000 7f704eb68640 1 -- start start 2024-09-19T06:07:42.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:42.507+0000 7f704eb68640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7048101e10 0x7f7048198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:42.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:42.507+0000 7f704eb68640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f70481027c0 0x7f7048198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:42.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:42.507+0000 7f704eb68640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7048106f40 0x7f704819cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:42.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:42.507+0000 7f704eb68640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7048111fa0 con 0x7f7048106f40 2024-09-19T06:07:42.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:42.507+0000 7f704eb68640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f7048111e20 con 0x7f70481027c0 2024-09-19T06:07:42.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:42.507+0000 7f704eb68640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7048112120 con 0x7f7048101e10 2024-09-19T06:07:42.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:42.507+0000 7f704d105640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7048106f40 0x7f704819cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:42.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:42.507+0000 7f704d105640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7048106f40 0x7f704819cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57528/0 (socket says 172.21.15.37:57528) 2024-09-19T06:07:42.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:42.507+0000 7f704d105640 1 -- 172.21.15.37:0/1426390117 learned_addr learned my addr 172.21.15.37:0/1426390117 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:07:42.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:42.507+0000 7f7047fff640 1 --2- 172.21.15.37:0/1426390117 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f70481027c0 0x7f7048198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:42.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:42.507+0000 7f704c904640 1 --2- 172.21.15.37:0/1426390117 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7048101e10 0x7f7048198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:42.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:42.507+0000 7f704d105640 1 -- 172.21.15.37:0/1426390117 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7048101e10 msgr2=0x7f7048198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:42.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:42.507+0000 7f704d105640 1 --2- 172.21.15.37:0/1426390117 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7048101e10 0x7f7048198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:42.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:42.507+0000 7f704d105640 1 -- 172.21.15.37:0/1426390117 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f70481027c0 msgr2=0x7f7048198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:42.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:42.507+0000 7f704d105640 1 --2- 172.21.15.37:0/1426390117 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f70481027c0 0x7f7048198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:42.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:42.507+0000 7f704d105640 1 -- 172.21.15.37:0/1426390117 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f704819d3e0 con 0x7f7048106f40 2024-09-19T06:07:42.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:42.507+0000 7f704d105640 1 --2- 172.21.15.37:0/1426390117 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7048106f40 0x7f704819cd00 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f704000d750 tx=0x7f704000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:42.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:42.507+0000 7f7045ffb640 1 -- 172.21.15.37:0/1426390117 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7040017070 con 0x7f7048106f40 2024-09-19T06:07:42.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:42.507+0000 7f704eb68640 1 -- 172.21.15.37:0/1426390117 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f704819d6d0 con 0x7f7048106f40 2024-09-19T06:07:42.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:42.507+0000 7f7045ffb640 1 -- 172.21.15.37:0/1426390117 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7040005500 con 0x7f7048106f40 2024-09-19T06:07:42.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:42.507+0000 7f7045ffb640 1 -- 172.21.15.37:0/1426390117 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7040004d90 con 0x7f7048106f40 2024-09-19T06:07:42.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:42.508+0000 7f704eb68640 1 -- 172.21.15.37:0/1426390117 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70481a4fb0 con 0x7f7048106f40 2024-09-19T06:07:42.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:42.509+0000 7f704eb68640 1 -- 172.21.15.37:0/1426390117 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70481021f0 con 0x7f7048106f40 2024-09-19T06:07:42.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:42.510+0000 7f7045ffb640 1 -- 172.21.15.37:0/1426390117 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f7040004f30 con 0x7f7048106f40 2024-09-19T06:07:42.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:42.510+0000 7f7045ffb640 1 --2- 172.21.15.37:0/1426390117 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f70340a3240 0x7f70340a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:42.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:42.511+0000 7f7045ffb640 1 -- 172.21.15.37:0/1426390117 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9121+0+0 (secure 0 0 0) 0x7f70400cf950 con 0x7f7048106f40 2024-09-19T06:07:42.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:42.511+0000 7f704c904640 1 --2- 172.21.15.37:0/1426390117 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f70340a3240 0x7f70340a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:42.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:42.511+0000 7f704c904640 1 --2- 172.21.15.37:0/1426390117 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f70340a3240 0x7f70340a5700 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7030005fd0 tx=0x7f703000b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:42.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:42.514+0000 7f7045ffb640 1 -- 172.21.15.37:0/1426390117 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f704009bca0 con 0x7f7048106f40 2024-09-19T06:07:42.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:42.725+0000 7f704eb68640 1 -- 172.21.15.37:0/1426390117 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f704810a180 con 0x7f7048106f40 2024-09-19T06:07:42.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:42.726+0000 7f7045ffb640 1 -- 172.21.15.37:0/1426390117 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11842 (secure 0 0 0) 0x7f704009ffa0 con 0x7f7048106f40 2024-09-19T06:07:42.729 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T06:07:42.729 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"btime":"2024-09-19T06:04:42:531480+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14514,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2864247978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2864247978},{"type":"v1","addr":"172.21.15.37:6835","nonce":2864247978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14526,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/633000932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":633000932},{"type":"v1","addr":"172.21.15.37:6837","nonce":633000932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14574,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/3753800615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":3753800615},{"type":"v1","addr":"172.21.15.37:6839","nonce":3753800615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/2718998355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":2718998355},{"type":"v1","addr":"172.21.15.37:6841","nonce":2718998355}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6833/866590207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":866590207},{"type":"v1","addr":"172.21.15.99:6833","nonce":866590207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3898668400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3898668400},{"type":"v1","addr":"172.21.15.117:6833","nonce":3898668400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2650673320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2650673320},{"type":"v1","addr":"172.21.15.99:6835","nonce":2650673320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1097471349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1097471349},{"type":"v1","addr":"172.21.15.117:6835","nonce":1097471349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24457,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1001392672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1001392672},{"type":"v1","addr":"172.21.15.117:6837","nonce":1001392672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/23570935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":23570935},{"type":"v1","addr":"172.21.15.99:6837","nonce":23570935}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:04:06.253034+0000","modified":"2024-09-19T06:04:42.196783+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24485},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24478":{"gid":24478,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6839/1269518339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":1269518339},{"type":"v1","addr":"172.21.15.117:6839","nonce":1269518339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.99:6839/3404812329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":3404812329},{"type":"v1","addr":"172.21.15.99:6839","nonce":3404812329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24485,"qdb_cluster":[24485]},"id":1}]} 2024-09-19T06:07:42.729 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 20 2024-09-19T06:07:42.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:42.728+0000 7f704eb68640 1 -- 172.21.15.37:0/1426390117 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f70340a3240 msgr2=0x7f70340a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:42.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:42.728+0000 7f704eb68640 1 --2- 172.21.15.37:0/1426390117 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f70340a3240 0x7f70340a5700 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7030005fd0 tx=0x7f703000b390 comp rx=0 tx=0).stop 2024-09-19T06:07:42.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:42.728+0000 7f704eb68640 1 -- 172.21.15.37:0/1426390117 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7048106f40 msgr2=0x7f704819cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:42.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:42.728+0000 7f704eb68640 1 --2- 172.21.15.37:0/1426390117 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7048106f40 0x7f704819cd00 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f704000d750 tx=0x7f704000dc10 comp rx=0 tx=0).stop 2024-09-19T06:07:42.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:42.728+0000 7f704eb68640 1 -- 172.21.15.37:0/1426390117 shutdown_connections 2024-09-19T06:07:42.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:42.728+0000 7f704eb68640 1 --2- 172.21.15.37:0/1426390117 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f70340a3240 0x7f70340a5700 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:42.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:42.728+0000 7f704eb68640 1 --2- 172.21.15.37:0/1426390117 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f70481027c0 0x7f7048198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:42.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:42.728+0000 7f704eb68640 1 --2- 172.21.15.37:0/1426390117 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7048106f40 0x7f704819cd00 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:42.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:42.729+0000 7f704eb68640 1 --2- 172.21.15.37:0/1426390117 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7048101e10 0x7f7048198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:42.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:42.729+0000 7f704eb68640 1 -- 172.21.15.37:0/1426390117 >> 172.21.15.37:0/1426390117 conn(0x7f70480fd8d0 msgr2=0x7f70480feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:42.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:42.729+0000 7f704eb68640 1 -- 172.21.15.37:0/1426390117 shutdown_connections 2024-09-19T06:07:42.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:42.729+0000 7f704eb68640 1 -- 172.21.15.37:0/1426390117 wait complete. 2024-09-19T06:07:43.047 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:07:42 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/1426390117' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:07:43.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:07:42 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/1426390117' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:07:43.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:07:42 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/1426390117' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:07:43.393 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24485 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0' 2024-09-19T06:07:43.393 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24485 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0 2024-09-19T06:07:43.651 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:07:44.064 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:07:43 smithi037 ceph-mon[31211]: pgmap v396: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:07:44.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.151+0000 7fd28e25a640 1 -- 172.21.15.37:0/3737189352 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd288106f20 msgr2=0x7fd28810eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:44.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.151+0000 7fd28e25a640 1 --2- 172.21.15.37:0/3737189352 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd288106f20 0x7fd28810eaa0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fd280009ca0 tx=0x7fd28002a8c0 comp rx=0 tx=0).stop 2024-09-19T06:07:44.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.151+0000 7fd28e25a640 1 -- 172.21.15.37:0/3737189352 shutdown_connections 2024-09-19T06:07:44.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.151+0000 7fd28e25a640 1 --2- 172.21.15.37:0/3737189352 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd2881027a0 0x7fd2881067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:44.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.151+0000 7fd28e25a640 1 --2- 172.21.15.37:0/3737189352 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd288106f20 0x7fd28810eaa0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:44.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.151+0000 7fd28e25a640 1 --2- 172.21.15.37:0/3737189352 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd288101df0 0x7fd2881021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:44.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.151+0000 7fd28e25a640 1 -- 172.21.15.37:0/3737189352 >> 172.21.15.37:0/3737189352 conn(0x7fd2880fd8b0 msgr2=0x7fd2880ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:44.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.151+0000 7fd28e25a640 1 -- 172.21.15.37:0/3737189352 shutdown_connections 2024-09-19T06:07:44.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.151+0000 7fd28e25a640 1 -- 172.21.15.37:0/3737189352 wait complete. 2024-09-19T06:07:44.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.152+0000 7fd28e25a640 1 Processor -- start 2024-09-19T06:07:44.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.152+0000 7fd28e25a640 1 -- start start 2024-09-19T06:07:44.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.152+0000 7fd28e25a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd288101df0 0x7fd2880744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:44.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.152+0000 7fd28e25a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2881027a0 0x7fd288074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:44.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.152+0000 7fd28e25a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd288106f20 0x7fd288074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:44.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.152+0000 7fd28e25a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd288111f80 con 0x7fd2881027a0 2024-09-19T06:07:44.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.152+0000 7fd28e25a640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fd288111e00 con 0x7fd288101df0 2024-09-19T06:07:44.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.152+0000 7fd28e25a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd288112100 con 0x7fd288106f20 2024-09-19T06:07:44.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.153+0000 7fd286ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2881027a0 0x7fd288074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:44.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.153+0000 7fd286ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2881027a0 0x7fd288074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47830/0 (socket says 172.21.15.37:47830) 2024-09-19T06:07:44.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.153+0000 7fd286ffd640 1 -- 172.21.15.37:0/3479236835 learned_addr learned my addr 172.21.15.37:0/3479236835 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:07:44.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.153+0000 7fd2877fe640 1 --2- 172.21.15.37:0/3479236835 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd288101df0 0x7fd2880744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:44.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.153+0000 7fd287fff640 1 --2- 172.21.15.37:0/3479236835 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd288106f20 0x7fd288074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:44.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.153+0000 7fd286ffd640 1 -- 172.21.15.37:0/3479236835 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd288106f20 msgr2=0x7fd288074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:44.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.153+0000 7fd286ffd640 1 --2- 172.21.15.37:0/3479236835 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd288106f20 0x7fd288074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:44.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.153+0000 7fd286ffd640 1 -- 172.21.15.37:0/3479236835 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd288101df0 msgr2=0x7fd2880744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:44.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.153+0000 7fd286ffd640 1 --2- 172.21.15.37:0/3479236835 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd288101df0 0x7fd2880744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:44.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.153+0000 7fd286ffd640 1 -- 172.21.15.37:0/3479236835 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2881a6800 con 0x7fd2881027a0 2024-09-19T06:07:44.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.153+0000 7fd287fff640 1 --2- 172.21.15.37:0/3479236835 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd288106f20 0x7fd288074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:07:44.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.153+0000 7fd286ffd640 1 --2- 172.21.15.37:0/3479236835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2881027a0 0x7fd288074a30 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fd27c00d950 tx=0x7fd27c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:44.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.153+0000 7fd284ff9640 1 -- 172.21.15.37:0/3479236835 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd27c017070 con 0x7fd2881027a0 2024-09-19T06:07:44.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.153+0000 7fd28e25a640 1 -- 172.21.15.37:0/3479236835 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2881a6af0 con 0x7fd2881027a0 2024-09-19T06:07:44.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.153+0000 7fd284ff9640 1 -- 172.21.15.37:0/3479236835 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd27c009c30 con 0x7fd2881027a0 2024-09-19T06:07:44.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.153+0000 7fd284ff9640 1 -- 172.21.15.37:0/3479236835 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd27c00f6b0 con 0x7fd2881027a0 2024-09-19T06:07:44.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.153+0000 7fd28e25a640 1 -- 172.21.15.37:0/3479236835 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2881a7030 con 0x7fd2881027a0 2024-09-19T06:07:44.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.156+0000 7fd290633740 1 Processor -- start 2024-09-19T06:07:44.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.156+0000 7fd290633740 1 -- start start 2024-09-19T06:07:44.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.156+0000 7fd284ff9640 1 -- 172.21.15.37:0/3479236835 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fd27c0109d0 con 0x7fd2881027a0 2024-09-19T06:07:44.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.156+0000 7fd290633740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c3492f8850 0x55c3492f8c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:44.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.156+0000 7fd290633740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c3492f9170 0x55c3493034f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:44.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.156+0000 7fd290633740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c349303a30 0x55c349305e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:44.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.156+0000 7fd290633740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c34925d160 con 0x55c3492f9170 2024-09-19T06:07:44.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.156+0000 7fd290633740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55c349204720 con 0x55c3492f8850 2024-09-19T06:07:44.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.156+0000 7fd290633740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55c349259120 con 0x55c349303a30 2024-09-19T06:07:44.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.157+0000 7fd287fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c3492f8850 0x55c3492f8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:44.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.157+0000 7fd287fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c3492f8850 0x55c3492f8c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.37:34996/0 (socket says 172.21.15.37:34996) 2024-09-19T06:07:44.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.157+0000 7fd287fff640 1 -- 172.21.15.37:0/1709517096 learned_addr learned my addr 172.21.15.37:0/1709517096 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:07:44.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.157+0000 7fd2877fe640 1 --2- 172.21.15.37:0/1709517096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c3492f9170 0x55c3493034f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:44.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.157+0000 7fd286ffd640 1 --2- 172.21.15.37:0/1709517096 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c349303a30 0x55c349305e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:44.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.157+0000 7fd287fff640 1 -- 172.21.15.37:0/1709517096 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c349303a30 msgr2=0x55c349305e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:44.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.157+0000 7fd287fff640 1 --2- 172.21.15.37:0/1709517096 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c349303a30 0x55c349305e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:44.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.157+0000 7fd287fff640 1 -- 172.21.15.37:0/1709517096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c3492f9170 msgr2=0x55c3493034f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:44.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.157+0000 7fd287fff640 1 --2- 172.21.15.37:0/1709517096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c3492f9170 0x55c3493034f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:44.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.157+0000 7fd287fff640 1 -- 172.21.15.37:0/1709517096 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c348fceba0 con 0x55c3492f8850 2024-09-19T06:07:44.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.157+0000 7fd2877fe640 1 --2- 172.21.15.37:0/1709517096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c3492f9170 0x55c3493034f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:07:44.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.157+0000 7fd286ffd640 1 --2- 172.21.15.37:0/1709517096 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c349303a30 0x55c349305e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:07:44.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.157+0000 7fd287fff640 1 --2- 172.21.15.37:0/1709517096 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c3492f8850 0x55c3492f8c30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd2800098b0 tx=0x7fd2800098e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3fc540485eea732b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:44.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.157+0000 7fd284ff9640 1 --2- 172.21.15.37:0/3479236835 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fd2700a3240 0x7fd2700a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:44.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.158+0000 7fd2877fe640 1 --2- 172.21.15.37:0/3479236835 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fd2700a3240 0x7fd2700a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:44.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.157+0000 7fd26dffb640 1 -- 172.21.15.37:0/1709517096 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd280003970 con 0x55c3492f8850 2024-09-19T06:07:44.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.158+0000 7fd284ff9640 1 -- 172.21.15.37:0/3479236835 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9121+0+0 (secure 0 0 0) 0x7fd27c0cf8e0 con 0x7fd2881027a0 2024-09-19T06:07:44.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.158+0000 7fd26dffb640 1 -- 172.21.15.37:0/1709517096 <== mon.2 v2:172.21.15.99:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd280036070 con 0x55c3492f8850 2024-09-19T06:07:44.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.158+0000 7fd26dffb640 1 -- 172.21.15.37:0/1709517096 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2800043c0 con 0x55c3492f8850 2024-09-19T06:07:44.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.158+0000 7fd290633740 1 -- 172.21.15.37:0/1709517096 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c3492f8850 msgr2=0x55c3492f8c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:44.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.158+0000 7fd2877fe640 1 --2- 172.21.15.37:0/3479236835 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fd2700a3240 0x7fd2700a5700 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x55c3492f5c40 tx=0x7fd27800c4b0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:44.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.158+0000 7fd290633740 1 --2- 172.21.15.37:0/1709517096 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c3492f8850 0x55c3492f8c30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd2800098b0 tx=0x7fd2800098e0 comp rx=0 tx=0).stop 2024-09-19T06:07:44.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.158+0000 7fd290633740 1 -- 172.21.15.37:0/1709517096 shutdown_connections 2024-09-19T06:07:44.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.158+0000 7fd290633740 1 --2- 172.21.15.37:0/1709517096 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c349303a30 0x55c349305e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:44.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.158+0000 7fd290633740 1 --2- 172.21.15.37:0/1709517096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c3492f9170 0x55c3493034f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:44.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.158+0000 7fd290633740 1 --2- 172.21.15.37:0/1709517096 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c3492f8850 0x55c3492f8c30 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:44.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.158+0000 7fd290633740 1 -- 172.21.15.37:0/1709517096 >> 172.21.15.37:0/1709517096 conn(0x55c3492f4de0 msgr2=0x55c3492f51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:44.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.158+0000 7fd290633740 1 -- 172.21.15.37:0/1709517096 shutdown_connections 2024-09-19T06:07:44.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.159+0000 7fd290633740 1 -- 172.21.15.37:0/1709517096 wait complete. 2024-09-19T06:07:44.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.159+0000 7fd290633740 1 -- start start 2024-09-19T06:07:44.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.159+0000 7fd290633740 1 Processor -- start 2024-09-19T06:07:44.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.159+0000 7fd290633740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c3492f8850 0x55c349300890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:44.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.159+0000 7fd290633740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c3492f9170 0x55c349300dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:44.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.159+0000 7fd290633740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c349303a30 0x55c349301310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:44.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.159+0000 7fd290633740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c349306600 con 0x55c3492f8850 2024-09-19T06:07:44.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.159+0000 7fd290633740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55c3491e5900 con 0x55c3492f9170 2024-09-19T06:07:44.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.159+0000 7fd290633740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55c349306780 con 0x55c349303a30 2024-09-19T06:07:44.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.159+0000 7fd2877fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c3492f8850 0x55c349300890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:44.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.159+0000 7fd290633740 10 client.0 _ll_register_callbacks cb 0x55c3491e3780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:07:44.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.160+0000 7fd2877fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c3492f8850 0x55c349300890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47856/0 (socket says 172.21.15.37:47856) 2024-09-19T06:07:44.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.160+0000 7fd2877fe640 1 -- 172.21.15.37:0/3360692357 learned_addr learned my addr 172.21.15.37:0/3360692357 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:07:44.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.160+0000 7fd286ffd640 1 --2- 172.21.15.37:0/3360692357 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c3492f9170 0x55c349300dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:44.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.160+0000 7fd287fff640 1 --2- 172.21.15.37:0/3360692357 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c349303a30 0x55c349301310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:44.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.160+0000 7fd2877fe640 1 -- 172.21.15.37:0/3360692357 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c349303a30 msgr2=0x55c349301310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:44.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.160+0000 7fd2877fe640 1 --2- 172.21.15.37:0/3360692357 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c349303a30 0x55c349301310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:44.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.160+0000 7fd2877fe640 1 -- 172.21.15.37:0/3360692357 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c3492f9170 msgr2=0x55c349300dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:44.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.160+0000 7fd2877fe640 1 --2- 172.21.15.37:0/3360692357 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c3492f9170 0x55c349300dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:44.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.160+0000 7fd2877fe640 1 -- 172.21.15.37:0/3360692357 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c349225c50 con 0x55c3492f8850 2024-09-19T06:07:44.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.160+0000 7fd286ffd640 1 --2- 172.21.15.37:0/3360692357 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c3492f9170 0x55c349300dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:07:44.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.160+0000 7fd2877fe640 1 --2- 172.21.15.37:0/3360692357 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c3492f8850 0x55c349300890 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fd27800ede0 tx=0x7fd2780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb49cfd048b1459b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:44.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.160+0000 7fd266ffd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-19T06:07:44.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.160+0000 7fd266ffd640 1 -- 172.21.15.37:0/3360692357 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd27801caa0 con 0x55c3492f8850 2024-09-19T06:07:44.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.160+0000 7fd266ffd640 1 -- 172.21.15.37:0/3360692357 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9121+0+0 (secure 0 0 0) 0x7fd27801cc40 con 0x55c3492f8850 2024-09-19T06:07:44.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.160+0000 7fd290633740 1 -- 172.21.15.37:0/3360692357 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd280036070 con 0x55c3492f8850 2024-09-19T06:07:44.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.160+0000 7fd266ffd640 1 -- 172.21.15.37:0/3360692357 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fd278031050 con 0x55c3492f8850 2024-09-19T06:07:44.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.160+0000 7fd290633740 10 client.15300 fetch_fsmap learned FSMap version 20 2024-09-19T06:07:44.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.160+0000 7fd290633740 1 -- 172.21.15.37:0/3360692357 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55c3493122c0 con 0x55c3492f8850 2024-09-19T06:07:44.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.161+0000 7fd266ffd640 1 -- 172.21.15.37:0/3360692357 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd280036070 con 0x55c3492f8850 2024-09-19T06:07:44.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.161+0000 7fd266ffd640 1 -- 172.21.15.37:0/3360692357 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 20) ==== 8338+0+0 (secure 0 0 0) 0x7fd27801d4a0 con 0x55c3492f8850 2024-09-19T06:07:44.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.161+0000 7fd290633740 10 client.15300 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:07:44.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.161+0000 7fd290633740 10 client.15300 resolve_mds: validated gid 24485 aka daemon mds.b 2024-09-19T06:07:44.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.161+0000 7fd290633740 20 client.15300 populate_metadata read hostname 'smithi037' 2024-09-19T06:07:44.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.161+0000 7fd290633740 1 --2- 172.21.15.37:0/3360692357 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x55c349313780 0x55c349315c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:44.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.161+0000 7fd290633740 4 client.15300 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:07:44.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.161+0000 7fd290633740 1 -- 172.21.15.37:0/3360692357 --> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c34926a890 con 0x55c349313780 2024-09-19T06:07:44.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.161+0000 7fd286ffd640 1 --2- 172.21.15.37:0/3360692357 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x55c349313780 0x55c349315c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:44.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.162+0000 7fd266ffd640 10 client.15300 ms_handle_connect on v2:172.21.15.99:6838/3404812329 2024-09-19T06:07:44.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.162+0000 7fd286ffd640 1 --2- 172.21.15.37:0/3360692357 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x55c349313780 0x55c349315c20 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=124514052136acd6 server_cookie=b227ed14eddf0b01 in_seq=0 out_seq=0 2024-09-19T06:07:44.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.162+0000 7fd266ffd640 1 -- 172.21.15.37:0/3360692357 <== mds.0 v2:172.21.15.99:6838/3404812329 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c34926a890 con 0x55c349313780 2024-09-19T06:07:44.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.162+0000 7fd266ffd640 10 client.15300 handle_command_reply: tid=0 2024-09-19T06:07:44.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.163+0000 7fd290633740 1 client.15300 shutdown 2024-09-19T06:07:44.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.163+0000 7fd290633740 1 -- 172.21.15.37:0/3360692357 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c3492f8850 msgr2=0x55c349300890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:44.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.163+0000 7fd290633740 1 --2- 172.21.15.37:0/3360692357 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c3492f8850 0x55c349300890 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fd27800ede0 tx=0x7fd2780046c0 comp rx=0 tx=0).stop 2024-09-19T06:07:44.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.163+0000 7fd290633740 1 -- 172.21.15.37:0/3360692357 shutdown_connections 2024-09-19T06:07:44.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.163+0000 7fd290633740 1 --2- 172.21.15.37:0/3360692357 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x55c349313780 0x55c349315c20 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:44.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.163+0000 7fd290633740 1 --2- 172.21.15.37:0/3360692357 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c3492f9170 0x55c349300dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:44.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.163+0000 7fd290633740 1 --2- 172.21.15.37:0/3360692357 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c349303a30 0x55c349301310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:44.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.163+0000 7fd290633740 1 --2- 172.21.15.37:0/3360692357 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c3492f8850 0x55c349300890 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:44.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.163+0000 7fd266ffd640 0 client.15300 ms_handle_reset on v2:172.21.15.99:6838/3404812329 2024-09-19T06:07:44.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.163+0000 7fd290633740 1 -- 172.21.15.37:0/3360692357 >> 172.21.15.37:0/3360692357 conn(0x55c3492f4de0 msgr2=0x55c3492fab10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:44.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.163+0000 7fd290633740 1 -- 172.21.15.37:0/3360692357 shutdown_connections 2024-09-19T06:07:44.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.163+0000 7fd290633740 1 -- 172.21.15.37:0/3360692357 wait complete. 2024-09-19T06:07:44.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.163+0000 7fd290633740 20 client.15300 trim_cache size 0 max 16384 2024-09-19T06:07:44.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.180+0000 7fd290633740 1 Processor -- start 2024-09-19T06:07:44.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.181+0000 7fd290633740 1 -- start start 2024-09-19T06:07:44.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.181+0000 7fd290633740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c3492f8850 0x55c3492fb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:44.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.181+0000 7fd290633740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c3492f9170 0x55c3492f3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:44.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.181+0000 7fd290633740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c349303a30 0x55c3492f42f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:44.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.181+0000 7fd290633740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd2881aedf0 con 0x55c3492f8850 2024-09-19T06:07:44.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.181+0000 7fd290633740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fd2881b1670 con 0x55c349303a30 2024-09-19T06:07:44.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.181+0000 7fd290633740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd2881af460 con 0x55c3492f9170 2024-09-19T06:07:44.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.181+0000 7fd2877fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c3492f8850 0x55c3492fb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:44.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.181+0000 7fd2877fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c3492f8850 0x55c3492fb2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47866/0 (socket says 172.21.15.37:47866) 2024-09-19T06:07:44.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.181+0000 7fd2877fe640 1 -- 172.21.15.37:0/353321316 learned_addr learned my addr 172.21.15.37:0/353321316 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:07:44.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.181+0000 7fd2877fe640 1 -- 172.21.15.37:0/353321316 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c3492f9170 msgr2=0x55c3492f3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:44.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.181+0000 7fd2877fe640 1 --2- 172.21.15.37:0/353321316 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c3492f9170 0x55c3492f3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:44.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.181+0000 7fd2877fe640 1 -- 172.21.15.37:0/353321316 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c349303a30 msgr2=0x55c3492f42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:44.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.181+0000 7fd2877fe640 1 --2- 172.21.15.37:0/353321316 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c349303a30 0x55c3492f42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:44.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.181+0000 7fd2877fe640 1 -- 172.21.15.37:0/353321316 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3492f03f0 con 0x55c3492f8850 2024-09-19T06:07:44.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.181+0000 7fd2877fe640 1 --2- 172.21.15.37:0/353321316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c3492f8850 0x55c3492fb2b0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fd27801d890 tx=0x7fd27800ea90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e40d362caea1a7c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:44.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.181+0000 7fd26d7fa640 1 -- 172.21.15.37:0/353321316 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd278011d20 con 0x55c3492f8850 2024-09-19T06:07:44.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.181+0000 7fd26d7fa640 1 -- 172.21.15.37:0/353321316 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd27801d410 con 0x55c3492f8850 2024-09-19T06:07:44.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.181+0000 7fd26d7fa640 1 -- 172.21.15.37:0/353321316 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd278004730 con 0x55c3492f8850 2024-09-19T06:07:44.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.182+0000 7fd290633740 1 -- 172.21.15.37:0/353321316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c3492f8850 msgr2=0x55c3492fb2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:44.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.182+0000 7fd290633740 1 --2- 172.21.15.37:0/353321316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c3492f8850 0x55c3492fb2b0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fd27801d890 tx=0x7fd27800ea90 comp rx=0 tx=0).stop 2024-09-19T06:07:44.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.182+0000 7fd290633740 1 -- 172.21.15.37:0/353321316 shutdown_connections 2024-09-19T06:07:44.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.182+0000 7fd290633740 1 --2- 172.21.15.37:0/353321316 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c349303a30 0x55c3492f42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:44.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.182+0000 7fd290633740 1 --2- 172.21.15.37:0/353321316 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c3492f9170 0x55c3492f3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:44.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.182+0000 7fd290633740 1 --2- 172.21.15.37:0/353321316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c3492f8850 0x55c3492fb2b0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:44.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.182+0000 7fd290633740 1 -- 172.21.15.37:0/353321316 >> 172.21.15.37:0/353321316 conn(0x55c3492f4de0 msgr2=0x55c3492f36a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:44.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.182+0000 7fd290633740 1 -- 172.21.15.37:0/353321316 shutdown_connections 2024-09-19T06:07:44.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.182+0000 7fd290633740 1 -- 172.21.15.37:0/353321316 wait complete. 2024-09-19T06:07:44.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.182+0000 7fd290633740 1 -- start start 2024-09-19T06:07:44.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.183+0000 7fd290633740 1 Processor -- start 2024-09-19T06:07:44.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.183+0000 7fd290633740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c3492f8850 0x55c34930bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:44.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.183+0000 7fd290633740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c3492f9170 0x55c34930c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:44.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.183+0000 7fd290633740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c349303a30 0x55c349306a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:44.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.183+0000 7fd290633740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd2881afb30 con 0x55c3492f9170 2024-09-19T06:07:44.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.183+0000 7fd290633740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fd2881b0fa0 con 0x55c3492f8850 2024-09-19T06:07:44.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.183+0000 7fd290633740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd2881b0200 con 0x55c349303a30 2024-09-19T06:07:44.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.183+0000 7fd290633740 10 client.0 _ll_register_callbacks cb 0x7fd27800cf90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:07:44.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.183+0000 7fd286ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c3492f9170 0x55c34930c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:44.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.183+0000 7fd286ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c3492f9170 0x55c34930c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47870/0 (socket says 172.21.15.37:47870) 2024-09-19T06:07:44.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.183+0000 7fd286ffd640 1 -- 172.21.15.37:0/506975019 learned_addr learned my addr 172.21.15.37:0/506975019 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:07:44.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.183+0000 7fd2877fe640 1 --2- 172.21.15.37:0/506975019 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c3492f8850 0x55c34930bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:44.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.183+0000 7fd287fff640 1 --2- 172.21.15.37:0/506975019 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c349303a30 0x55c349306a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:44.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.183+0000 7fd286ffd640 1 -- 172.21.15.37:0/506975019 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c349303a30 msgr2=0x55c349306a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:44.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.183+0000 7fd286ffd640 1 --2- 172.21.15.37:0/506975019 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c349303a30 0x55c349306a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:44.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.183+0000 7fd286ffd640 1 -- 172.21.15.37:0/506975019 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c3492f8850 msgr2=0x55c34930bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:07:44.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.183+0000 7fd286ffd640 1 --2- 172.21.15.37:0/506975019 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c3492f8850 0x55c34930bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:44.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.183+0000 7fd286ffd640 1 -- 172.21.15.37:0/506975019 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3492f5a70 con 0x55c3492f9170 2024-09-19T06:07:44.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.183+0000 7fd287fff640 1 --2- 172.21.15.37:0/506975019 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c349303a30 0x55c349306a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:07:44.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.184+0000 7fd286ffd640 1 --2- 172.21.15.37:0/506975019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c3492f9170 0x55c34930c1e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fd27c09b880 tx=0x7fd27c005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c90a96ac88318e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:44.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.184+0000 7fd266ffd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-19T06:07:44.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.184+0000 7fd266ffd640 1 -- 172.21.15.37:0/506975019 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd27c020040 con 0x55c3492f9170 2024-09-19T06:07:44.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.184+0000 7fd266ffd640 1 -- 172.21.15.37:0/506975019 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9121+0+0 (secure 0 0 0) 0x7fd27c099e80 con 0x55c3492f9170 2024-09-19T06:07:44.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.184+0000 7fd290633740 1 -- 172.21.15.37:0/506975019 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd27801d410 con 0x55c3492f9170 2024-09-19T06:07:44.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.184+0000 7fd266ffd640 1 -- 172.21.15.37:0/506975019 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fd27c09bb80 con 0x55c3492f9170 2024-09-19T06:07:44.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.184+0000 7fd290633740 10 client.15306 fetch_fsmap learned FSMap version 20 2024-09-19T06:07:44.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.184+0000 7fd290633740 1 -- 172.21.15.37:0/506975019 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55c3492f5e90 con 0x55c3492f9170 2024-09-19T06:07:44.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.184+0000 7fd266ffd640 1 -- 172.21.15.37:0/506975019 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd27801d410 con 0x55c3492f9170 2024-09-19T06:07:44.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.184+0000 7fd266ffd640 1 -- 172.21.15.37:0/506975019 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 20) ==== 8338+0+0 (secure 0 0 0) 0x7fd27c0860b0 con 0x55c3492f9170 2024-09-19T06:07:44.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.184+0000 7fd290633740 10 client.15306 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:07:44.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.184+0000 7fd290633740 10 client.15306 resolve_mds: validated gid 24485 aka daemon mds.b 2024-09-19T06:07:44.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.184+0000 7fd290633740 20 client.15306 populate_metadata read hostname 'smithi037' 2024-09-19T06:07:44.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.184+0000 7fd290633740 1 --2- 172.21.15.37:0/506975019 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x55c34937f430 0x55c349381850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:44.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.184+0000 7fd290633740 4 client.15306 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}] 2024-09-19T06:07:44.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.184+0000 7fd290633740 1 -- 172.21.15.37:0/506975019 --> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}) -- 0x55c349264be0 con 0x55c34937f430 2024-09-19T06:07:44.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.185+0000 7fd2877fe640 1 --2- 172.21.15.37:0/506975019 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x55c34937f430 0x55c349381850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:44.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.185+0000 7fd2877fe640 1 --2- 172.21.15.37:0/506975019 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x55c34937f430 0x55c349381850 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db4ef57c4c751cef server_cookie=baa15da80594d730 in_seq=0 out_seq=0 2024-09-19T06:07:44.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.185+0000 7fd266ffd640 10 client.15306 ms_handle_connect on v2:172.21.15.99:6838/3404812329 2024-09-19T06:07:44.199 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:07:43 smithi099 ceph-mon[35300]: pgmap v396: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:07:44.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.194+0000 7fd266ffd640 1 -- 172.21.15.37:0/506975019 <== mds.0 v2:172.21.15.99:6838/3404812329 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55c349264be0 con 0x55c34937f430 2024-09-19T06:07:44.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.194+0000 7fd266ffd640 10 client.15306 handle_command_reply: tid=0 2024-09-19T06:07:44.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.194+0000 7fd290633740 1 client.15306 shutdown 2024-09-19T06:07:44.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.194+0000 7fd290633740 1 -- 172.21.15.37:0/506975019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c3492f9170 msgr2=0x55c34930c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:44.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.194+0000 7fd290633740 1 --2- 172.21.15.37:0/506975019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c3492f9170 0x55c34930c1e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fd27c09b880 tx=0x7fd27c005f90 comp rx=0 tx=0).stop 2024-09-19T06:07:44.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.194+0000 7fd290633740 1 -- 172.21.15.37:0/506975019 shutdown_connections 2024-09-19T06:07:44.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.194+0000 7fd290633740 1 --2- 172.21.15.37:0/506975019 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x55c34937f430 0x55c349381850 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:44.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.194+0000 7fd290633740 1 --2- 172.21.15.37:0/506975019 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c349303a30 0x55c349306a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:44.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.194+0000 7fd290633740 1 --2- 172.21.15.37:0/506975019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c3492f9170 0x55c34930c1e0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:44.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.194+0000 7fd290633740 1 --2- 172.21.15.37:0/506975019 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c3492f8850 0x55c34930bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:44.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.194+0000 7fd266ffd640 0 client.15306 ms_handle_reset on v2:172.21.15.99:6838/3404812329 2024-09-19T06:07:44.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.194+0000 7fd290633740 1 -- 172.21.15.37:0/506975019 >> 172.21.15.37:0/506975019 conn(0x55c3492f4de0 msgr2=0x55c3492f3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:44.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.194+0000 7fd290633740 1 -- 172.21.15.37:0/506975019 shutdown_connections 2024-09-19T06:07:44.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.194+0000 7fd290633740 1 -- 172.21.15.37:0/506975019 wait complete. 2024-09-19T06:07:44.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.194+0000 7fd290633740 20 client.15306 trim_cache size 0 max 16384 2024-09-19T06:07:44.201 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-19T06:07:44.201 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 20, 2024-09-19T06:07:44.201 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 24485, 2024-09-19T06:07:44.201 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 10, 2024-09-19T06:07:44.201 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": { 2024-09-19T06:07:44.201 INFO:teuthology.orchestra.run.smithi037.stdout: "ad98437b": { 2024-09-19T06:07:44.201 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 10, 2024-09-19T06:07:44.201 INFO:teuthology.orchestra.run.smithi037.stdout: "age_ref": 0.0, 2024-09-19T06:07:44.201 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-09-19T06:07:44.202 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "QUIESCED", 2024-09-19T06:07:44.202 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-09-19T06:07:44.202 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:07:44.202 INFO:teuthology.orchestra.run.smithi037.stdout: "timeout": 90.0, 2024-09-19T06:07:44.202 INFO:teuthology.orchestra.run.smithi037.stdout: "expiration": 140.3, 2024-09-19T06:07:44.202 INFO:teuthology.orchestra.run.smithi037.stdout: "members": { 2024-09-19T06:07:44.202 INFO:teuthology.orchestra.run.smithi037.stdout: "file:/": { 2024-09-19T06:07:44.202 INFO:teuthology.orchestra.run.smithi037.stdout: "excluded": false, 2024-09-19T06:07:44.202 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-09-19T06:07:44.202 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "QUIESCED", 2024-09-19T06:07:44.202 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-09-19T06:07:44.202 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:07:44.202 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:07:44.202 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:07:44.203 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:07:44.203 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:07:44.203 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-19T06:07:44.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.195+0000 7fd28e25a640 1 -- 172.21.15.37:0/3479236835 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fd2700a3240 msgr2=0x7fd2700a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:44.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.195+0000 7fd28e25a640 1 --2- 172.21.15.37:0/3479236835 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fd2700a3240 0x7fd2700a5700 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x55c3492f5c40 tx=0x7fd27800c4b0 comp rx=0 tx=0).stop 2024-09-19T06:07:44.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.195+0000 7fd28e25a640 1 -- 172.21.15.37:0/3479236835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2881027a0 msgr2=0x7fd288074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:44.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.195+0000 7fd28e25a640 1 --2- 172.21.15.37:0/3479236835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2881027a0 0x7fd288074a30 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fd27c00d950 tx=0x7fd27c00de10 comp rx=0 tx=0).stop 2024-09-19T06:07:44.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.195+0000 7fd28e25a640 1 -- 172.21.15.37:0/3479236835 shutdown_connections 2024-09-19T06:07:44.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.195+0000 7fd28e25a640 1 --2- 172.21.15.37:0/3479236835 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fd2700a3240 0x7fd2700a5700 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:44.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.195+0000 7fd28e25a640 1 --2- 172.21.15.37:0/3479236835 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd288106f20 0x7fd288074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:44.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.195+0000 7fd28e25a640 1 --2- 172.21.15.37:0/3479236835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2881027a0 0x7fd288074a30 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:44.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.195+0000 7fd28e25a640 1 --2- 172.21.15.37:0/3479236835 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd288101df0 0x7fd2880744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:44.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.195+0000 7fd28e25a640 1 -- 172.21.15.37:0/3479236835 >> 172.21.15.37:0/3479236835 conn(0x7fd2880fd8b0 msgr2=0x7fd2880feb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:44.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.195+0000 7fd28e25a640 1 -- 172.21.15.37:0/3479236835 shutdown_connections 2024-09-19T06:07:44.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:07:44.195+0000 7fd28e25a640 1 -- 172.21.15.37:0/3479236835 wait complete. 2024-09-19T06:07:44.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:07:43 smithi117 ceph-mon[35050]: pgmap v396: 129 pgs: 129 active+clean; 655 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T06:07:44.996 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'ad98437b', quiesce took 3.2 seconds. Will release after: 17.150000000000002 2024-09-19T06:07:46.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:07:45 smithi099 ceph-mon[35300]: pgmap v397: 129 pgs: 129 active+clean; 673 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 1.8 KiB/s wr, 3 op/s 2024-09-19T06:07:46.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:07:45 smithi117 ceph-mon[35050]: pgmap v397: 129 pgs: 129 active+clean; 673 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 1.8 KiB/s wr, 3 op/s 2024-09-19T06:07:46.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:07:45 smithi037 ceph-mon[31211]: pgmap v397: 129 pgs: 129 active+clean; 673 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 1.8 KiB/s wr, 3 op/s 2024-09-19T06:07:48.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:07:47 smithi099 ceph-mon[35300]: pgmap v398: 129 pgs: 129 active+clean; 673 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 1.8 KiB/s wr, 2 op/s 2024-09-19T06:07:48.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:07:47 smithi117 ceph-mon[35050]: pgmap v398: 129 pgs: 129 active+clean; 673 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 1.8 KiB/s wr, 2 op/s 2024-09-19T06:07:48.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:07:47 smithi037 ceph-mon[31211]: pgmap v398: 129 pgs: 129 active+clean; 673 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 1.8 KiB/s wr, 2 op/s 2024-09-19T06:07:50.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:07:49 smithi099 ceph-mon[35300]: pgmap v399: 129 pgs: 129 active+clean; 4.7 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 344 KiB/s wr, 3 op/s 2024-09-19T06:07:50.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:07:49 smithi117 ceph-mon[35050]: pgmap v399: 129 pgs: 129 active+clean; 4.7 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 344 KiB/s wr, 3 op/s 2024-09-19T06:07:50.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:07:49 smithi037 ceph-mon[31211]: pgmap v399: 129 pgs: 129 active+clean; 4.7 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 344 KiB/s wr, 3 op/s 2024-09-19T06:07:52.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:07:51 smithi099 ceph-mon[35300]: pgmap v400: 129 pgs: 129 active+clean; 4.7 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 344 KiB/s wr, 2 op/s 2024-09-19T06:07:52.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:07:51 smithi117 ceph-mon[35050]: pgmap v400: 129 pgs: 129 active+clean; 4.7 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 344 KiB/s wr, 2 op/s 2024-09-19T06:07:52.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:07:51 smithi037 ceph-mon[31211]: pgmap v400: 129 pgs: 129 active+clean; 4.7 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 344 KiB/s wr, 2 op/s 2024-09-19T06:07:54.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:07:53 smithi099 ceph-mon[35300]: pgmap v401: 129 pgs: 129 active+clean; 6.1 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 471 KiB/s wr, 2 op/s 2024-09-19T06:07:54.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:07:53 smithi117 ceph-mon[35050]: pgmap v401: 129 pgs: 129 active+clean; 6.1 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 471 KiB/s wr, 2 op/s 2024-09-19T06:07:54.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:07:53 smithi037 ceph-mon[31211]: pgmap v401: 129 pgs: 129 active+clean; 6.1 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 471 KiB/s wr, 2 op/s 2024-09-19T06:07:56.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:07:55 smithi099 ceph-mon[35300]: pgmap v402: 129 pgs: 129 active+clean; 6.2 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 471 KiB/s wr, 3 op/s 2024-09-19T06:07:56.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:07:55 smithi117 ceph-mon[35050]: pgmap v402: 129 pgs: 129 active+clean; 6.2 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 471 KiB/s wr, 3 op/s 2024-09-19T06:07:56.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:07:55 smithi037 ceph-mon[31211]: pgmap v402: 129 pgs: 129 active+clean; 6.2 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 471 KiB/s wr, 3 op/s 2024-09-19T06:07:58.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:07:57 smithi099 ceph-mon[35300]: pgmap v403: 129 pgs: 129 active+clean; 6.2 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 470 KiB/s wr, 2 op/s 2024-09-19T06:07:58.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:07:57 smithi117 ceph-mon[35050]: pgmap v403: 129 pgs: 129 active+clean; 6.2 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 470 KiB/s wr, 2 op/s 2024-09-19T06:07:58.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:07:57 smithi037 ceph-mon[31211]: pgmap v403: 129 pgs: 129 active+clean; 6.2 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 470 KiB/s wr, 2 op/s 2024-09-19T06:08:00.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:07:59 smithi099 ceph-mon[35300]: pgmap v404: 129 pgs: 129 active+clean; 6.2 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 470 KiB/s wr, 3 op/s 2024-09-19T06:08:00.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:07:59 smithi117 ceph-mon[35050]: pgmap v404: 129 pgs: 129 active+clean; 6.2 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 470 KiB/s wr, 3 op/s 2024-09-19T06:08:00.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:07:59 smithi037 ceph-mon[31211]: pgmap v404: 129 pgs: 129 active+clean; 6.2 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 470 KiB/s wr, 3 op/s 2024-09-19T06:08:02.147 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:08:02.177 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:08:01 smithi037 ceph-mon[31211]: pgmap v405: 129 pgs: 129 active+clean; 6.2 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 127 KiB/s wr, 2 op/s 2024-09-19T06:08:02.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:08:01 smithi099 ceph-mon[35300]: pgmap v405: 129 pgs: 129 active+clean; 6.2 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 127 KiB/s wr, 2 op/s 2024-09-19T06:08:02.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:08:01 smithi117 ceph-mon[35050]: pgmap v405: 129 pgs: 129 active+clean; 6.2 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 127 KiB/s wr, 2 op/s 2024-09-19T06:08:02.424 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:08:03.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:03.117+0000 7f1727c5e640 1 -- 172.21.15.37:0/3010766062 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17201027a0 msgr2=0x7f17201067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:03.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:03.117+0000 7f1727c5e640 1 --2- 172.21.15.37:0/3010766062 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17201027a0 0x7f17201067f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f1710009900 tx=0x7f171002a410 comp rx=0 tx=0).stop 2024-09-19T06:08:03.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:03.117+0000 7f1727c5e640 1 -- 172.21.15.37:0/3010766062 shutdown_connections 2024-09-19T06:08:03.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:03.117+0000 7f1727c5e640 1 --2- 172.21.15.37:0/3010766062 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1720106f20 0x7f172010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:03.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:03.117+0000 7f1727c5e640 1 --2- 172.21.15.37:0/3010766062 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17201027a0 0x7f17201067f0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:03.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:03.117+0000 7f1727c5e640 1 --2- 172.21.15.37:0/3010766062 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1720101df0 0x7f17201021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:03.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:03.117+0000 7f1727c5e640 1 -- 172.21.15.37:0/3010766062 >> 172.21.15.37:0/3010766062 conn(0x7f17200fd8b0 msgr2=0x7f17200ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:03.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:03.117+0000 7f1727c5e640 1 -- 172.21.15.37:0/3010766062 shutdown_connections 2024-09-19T06:08:03.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:03.117+0000 7f1727c5e640 1 -- 172.21.15.37:0/3010766062 wait complete. 2024-09-19T06:08:03.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:03.118+0000 7f1727c5e640 1 Processor -- start 2024-09-19T06:08:03.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:03.118+0000 7f1727c5e640 1 -- start start 2024-09-19T06:08:03.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:03.118+0000 7f1727c5e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1720101df0 0x7f1720198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:03.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:03.118+0000 7f1727c5e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17201027a0 0x7f1720198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:03.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:03.118+0000 7f1727c5e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1720106f20 0x7f172019ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:03.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:03.118+0000 7f1727c5e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1720112020 con 0x7f1720101df0 2024-09-19T06:08:03.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:03.118+0000 7f1727c5e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f1720111ea0 con 0x7f1720106f20 2024-09-19T06:08:03.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:03.118+0000 7f1727c5e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f17201121a0 con 0x7f17201027a0 2024-09-19T06:08:03.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:03.118+0000 7f17259fa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1720101df0 0x7f1720198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:03.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:03.118+0000 7f17259fa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1720101df0 0x7f1720198570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50858/0 (socket says 172.21.15.37:50858) 2024-09-19T06:08:03.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:03.118+0000 7f17259fa640 1 -- 172.21.15.37:0/2714671714 learned_addr learned my addr 172.21.15.37:0/2714671714 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:08:03.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:03.118+0000 7f17251f9640 1 --2- 172.21.15.37:0/2714671714 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17201027a0 0x7f1720198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:03.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:03.118+0000 7f17261fb640 1 --2- 172.21.15.37:0/2714671714 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1720106f20 0x7f172019ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:03.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:03.118+0000 7f17259fa640 1 -- 172.21.15.37:0/2714671714 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17201027a0 msgr2=0x7f1720198ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:03.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:03.118+0000 7f17259fa640 1 --2- 172.21.15.37:0/2714671714 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17201027a0 0x7f1720198ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:03.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:03.118+0000 7f17259fa640 1 -- 172.21.15.37:0/2714671714 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1720106f20 msgr2=0x7f172019ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:03.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:03.118+0000 7f17259fa640 1 --2- 172.21.15.37:0/2714671714 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1720106f20 0x7f172019ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:03.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:03.118+0000 7f17259fa640 1 -- 172.21.15.37:0/2714671714 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f172019d520 con 0x7f1720101df0 2024-09-19T06:08:03.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:03.118+0000 7f17251f9640 1 --2- 172.21.15.37:0/2714671714 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17201027a0 0x7f1720198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:08:03.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:03.118+0000 7f17261fb640 1 --2- 172.21.15.37:0/2714671714 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1720106f20 0x7f172019ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:08:03.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:03.118+0000 7f17259fa640 1 --2- 172.21.15.37:0/2714671714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1720101df0 0x7f1720198570 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f171c00b4a0 tx=0x7f171c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:03.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:03.119+0000 7f1716ffd640 1 -- 172.21.15.37:0/2714671714 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f171c014070 con 0x7f1720101df0 2024-09-19T06:08:03.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:03.119+0000 7f1727c5e640 1 -- 172.21.15.37:0/2714671714 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f172019d810 con 0x7f1720101df0 2024-09-19T06:08:03.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:03.119+0000 7f1716ffd640 1 -- 172.21.15.37:0/2714671714 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f171c010af0 con 0x7f1720101df0 2024-09-19T06:08:03.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:03.119+0000 7f1716ffd640 1 -- 172.21.15.37:0/2714671714 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f171c017d10 con 0x7f1720101df0 2024-09-19T06:08:03.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:03.119+0000 7f1727c5e640 1 -- 172.21.15.37:0/2714671714 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17201a50f0 con 0x7f1720101df0 2024-09-19T06:08:03.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:03.120+0000 7f1727c5e640 1 -- 172.21.15.37:0/2714671714 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1720102250 con 0x7f1720101df0 2024-09-19T06:08:03.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:03.121+0000 7f1716ffd640 1 -- 172.21.15.37:0/2714671714 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f171c017070 con 0x7f1720101df0 2024-09-19T06:08:03.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:03.122+0000 7f1716ffd640 1 --2- 172.21.15.37:0/2714671714 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f170c0a3240 0x7f170c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:03.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:03.122+0000 7f17251f9640 1 --2- 172.21.15.37:0/2714671714 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f170c0a3240 0x7f170c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:03.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:03.122+0000 7f1716ffd640 1 -- 172.21.15.37:0/2714671714 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9121+0+0 (secure 0 0 0) 0x7f171c0cf4a0 con 0x7f1720101df0 2024-09-19T06:08:03.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:03.122+0000 7f17251f9640 1 --2- 172.21.15.37:0/2714671714 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f170c0a3240 0x7f170c0a5700 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f17200ffe80 tx=0x7f1710005a20 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:03.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:03.125+0000 7f1716ffd640 1 -- 172.21.15.37:0/2714671714 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f171c09be40 con 0x7f1720101df0 2024-09-19T06:08:03.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:03.342+0000 7f1727c5e640 1 -- 172.21.15.37:0/2714671714 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f17201998d0 con 0x7f1720101df0 2024-09-19T06:08:03.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:03.343+0000 7f1716ffd640 1 -- 172.21.15.37:0/2714671714 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11842 (secure 0 0 0) 0x7f171c09b740 con 0x7f1720101df0 2024-09-19T06:08:03.345 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T06:08:03.345 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"btime":"2024-09-19T06:04:42:531480+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14514,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2864247978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2864247978},{"type":"v1","addr":"172.21.15.37:6835","nonce":2864247978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14526,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/633000932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":633000932},{"type":"v1","addr":"172.21.15.37:6837","nonce":633000932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14574,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/3753800615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":3753800615},{"type":"v1","addr":"172.21.15.37:6839","nonce":3753800615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/2718998355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":2718998355},{"type":"v1","addr":"172.21.15.37:6841","nonce":2718998355}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6833/866590207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":866590207},{"type":"v1","addr":"172.21.15.99:6833","nonce":866590207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3898668400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3898668400},{"type":"v1","addr":"172.21.15.117:6833","nonce":3898668400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2650673320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2650673320},{"type":"v1","addr":"172.21.15.99:6835","nonce":2650673320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1097471349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1097471349},{"type":"v1","addr":"172.21.15.117:6835","nonce":1097471349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24457,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1001392672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1001392672},{"type":"v1","addr":"172.21.15.117:6837","nonce":1001392672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/23570935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":23570935},{"type":"v1","addr":"172.21.15.99:6837","nonce":23570935}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:04:06.253034+0000","modified":"2024-09-19T06:04:42.196783+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24485},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24478":{"gid":24478,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6839/1269518339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":1269518339},{"type":"v1","addr":"172.21.15.117:6839","nonce":1269518339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.99:6839/3404812329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":3404812329},{"type":"v1","addr":"172.21.15.99:6839","nonce":3404812329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24485,"qdb_cluster":[24485]},"id":1}]} 2024-09-19T06:08:03.346 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 20 2024-09-19T06:08:03.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:03.345+0000 7f1727c5e640 1 -- 172.21.15.37:0/2714671714 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f170c0a3240 msgr2=0x7f170c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:03.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:03.345+0000 7f1727c5e640 1 --2- 172.21.15.37:0/2714671714 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f170c0a3240 0x7f170c0a5700 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f17200ffe80 tx=0x7f1710005a20 comp rx=0 tx=0).stop 2024-09-19T06:08:03.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:03.345+0000 7f1727c5e640 1 -- 172.21.15.37:0/2714671714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1720101df0 msgr2=0x7f1720198570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:03.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:03.345+0000 7f1727c5e640 1 --2- 172.21.15.37:0/2714671714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1720101df0 0x7f1720198570 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f171c00b4a0 tx=0x7f171c00b960 comp rx=0 tx=0).stop 2024-09-19T06:08:03.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:03.345+0000 7f1727c5e640 1 -- 172.21.15.37:0/2714671714 shutdown_connections 2024-09-19T06:08:03.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:03.345+0000 7f1727c5e640 1 --2- 172.21.15.37:0/2714671714 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f170c0a3240 0x7f170c0a5700 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:03.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:03.345+0000 7f1727c5e640 1 --2- 172.21.15.37:0/2714671714 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1720106f20 0x7f172019ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:03.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:03.345+0000 7f1727c5e640 1 --2- 172.21.15.37:0/2714671714 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17201027a0 0x7f1720198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:03.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:03.345+0000 7f1727c5e640 1 --2- 172.21.15.37:0/2714671714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1720101df0 0x7f1720198570 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:03.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:03.345+0000 7f1727c5e640 1 -- 172.21.15.37:0/2714671714 >> 172.21.15.37:0/2714671714 conn(0x7f17200fd8b0 msgr2=0x7f17200fed50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:03.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:03.346+0000 7f1727c5e640 1 -- 172.21.15.37:0/2714671714 shutdown_connections 2024-09-19T06:08:03.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:03.346+0000 7f1727c5e640 1 -- 172.21.15.37:0/2714671714 wait complete. 2024-09-19T06:08:04.030 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24485 quiesce db --set-id ad98437b --release --await' 2024-09-19T06:08:04.030 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24485 quiesce db --set-id ad98437b --release --await 2024-09-19T06:08:04.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:08:03 smithi099 ceph-mon[35300]: pgmap v406: 129 pgs: 129 active+clean; 6.2 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 127 KiB/s wr, 2 op/s 2024-09-19T06:08:04.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:08:03 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/2714671714' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:08:04.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:08:03 smithi117 ceph-mon[35050]: pgmap v406: 129 pgs: 129 active+clean; 6.2 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 127 KiB/s wr, 2 op/s 2024-09-19T06:08:04.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:08:03 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/2714671714' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:08:04.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:08:03 smithi037 ceph-mon[31211]: pgmap v406: 129 pgs: 129 active+clean; 6.2 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 127 KiB/s wr, 2 op/s 2024-09-19T06:08:04.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:08:03 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/2714671714' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:08:04.332 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:08:04.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.851+0000 7fa3d6779640 1 -- 172.21.15.37:0/4121409549 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3d010c180 msgr2=0x7fa3d010e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:04.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.851+0000 7fa3d6779640 1 --2- 172.21.15.37:0/4121409549 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3d010c180 0x7fa3d010e600 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fa3c8009ca0 tx=0x7fa3c802a950 comp rx=0 tx=0).stop 2024-09-19T06:08:04.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.852+0000 7fa3d6779640 1 -- 172.21.15.37:0/4121409549 shutdown_connections 2024-09-19T06:08:04.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.852+0000 7fa3d6779640 1 --2- 172.21.15.37:0/4121409549 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3d01036c0 0x7fa3d010bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:04.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.852+0000 7fa3d6779640 1 --2- 172.21.15.37:0/4121409549 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3d010c180 0x7fa3d010e600 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:04.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.852+0000 7fa3d6779640 1 --2- 172.21.15.37:0/4121409549 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3d0102da0 0x7fa3d0103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:04.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.852+0000 7fa3d6779640 1 -- 172.21.15.37:0/4121409549 >> 172.21.15.37:0/4121409549 conn(0x7fa3d00fc7a0 msgr2=0x7fa3d00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:04.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.852+0000 7fa3d6779640 1 -- 172.21.15.37:0/4121409549 shutdown_connections 2024-09-19T06:08:04.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.852+0000 7fa3d6779640 1 -- 172.21.15.37:0/4121409549 wait complete. 2024-09-19T06:08:04.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.852+0000 7fa3d6779640 1 Processor -- start 2024-09-19T06:08:04.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.852+0000 7fa3d6779640 1 -- start start 2024-09-19T06:08:04.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.852+0000 7fa3d6779640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3d0102da0 0x7fa3d0198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:04.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.853+0000 7fa3d6779640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3d01036c0 0x7fa3d0198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:04.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.853+0000 7fa3d6779640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3d010c180 0x7fa3d019cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:04.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.853+0000 7fa3d6779640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d0111f60 con 0x7fa3d0102da0 2024-09-19T06:08:04.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.853+0000 7fa3d6779640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d0111de0 con 0x7fa3d01036c0 2024-09-19T06:08:04.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.853+0000 7fa3d6779640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d01120e0 con 0x7fa3d010c180 2024-09-19T06:08:04.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.853+0000 7fa3cffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3d0102da0 0x7fa3d0198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:04.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.853+0000 7fa3cffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3d0102da0 0x7fa3d0198320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52590/0 (socket says 172.21.15.37:52590) 2024-09-19T06:08:04.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.853+0000 7fa3cffff640 1 -- 172.21.15.37:0/1999066679 learned_addr learned my addr 172.21.15.37:0/1999066679 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:08:04.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.853+0000 7fa3c7fff640 1 --2- 172.21.15.37:0/1999066679 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3d01036c0 0x7fa3d0198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:04.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.853+0000 7fa3cffff640 1 -- 172.21.15.37:0/1999066679 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3d010c180 msgr2=0x7fa3d019cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:04.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.853+0000 7fa3d4d16640 1 --2- 172.21.15.37:0/1999066679 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3d010c180 0x7fa3d019cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:04.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.853+0000 7fa3cffff640 1 --2- 172.21.15.37:0/1999066679 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3d010c180 0x7fa3d019cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:04.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.853+0000 7fa3cffff640 1 -- 172.21.15.37:0/1999066679 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3d01036c0 msgr2=0x7fa3d0198860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:04.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.853+0000 7fa3cffff640 1 --2- 172.21.15.37:0/1999066679 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3d01036c0 0x7fa3d0198860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:04.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.853+0000 7fa3cffff640 1 -- 172.21.15.37:0/1999066679 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3d019d2d0 con 0x7fa3d0102da0 2024-09-19T06:08:04.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.853+0000 7fa3c7fff640 1 --2- 172.21.15.37:0/1999066679 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3d01036c0 0x7fa3d0198860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:08:04.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.853+0000 7fa3cffff640 1 --2- 172.21.15.37:0/1999066679 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3d0102da0 0x7fa3d0198320 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fa3c000d770 tx=0x7fa3c000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:04.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.853+0000 7fa3cdffb640 1 -- 172.21.15.37:0/1999066679 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c0017070 con 0x7fa3d0102da0 2024-09-19T06:08:04.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.853+0000 7fa3cdffb640 1 -- 172.21.15.37:0/1999066679 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3c0005500 con 0x7fa3d0102da0 2024-09-19T06:08:04.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.853+0000 7fa3cdffb640 1 -- 172.21.15.37:0/1999066679 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c0004e00 con 0x7fa3d0102da0 2024-09-19T06:08:04.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.853+0000 7fa3d6779640 1 -- 172.21.15.37:0/1999066679 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3d019d5c0 con 0x7fa3d0102da0 2024-09-19T06:08:04.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.853+0000 7fa3d6779640 1 -- 172.21.15.37:0/1999066679 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3d01a4ea0 con 0x7fa3d0102da0 2024-09-19T06:08:04.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.856+0000 7fa3cdffb640 1 -- 172.21.15.37:0/1999066679 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fa3c0004fa0 con 0x7fa3d0102da0 2024-09-19T06:08:04.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.856+0000 7fa3d8b52740 1 Processor -- start 2024-09-19T06:08:04.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.856+0000 7fa3d8b52740 1 -- start start 2024-09-19T06:08:04.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.856+0000 7fa3d8b52740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d46882bf40 0x55d46882c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:04.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.856+0000 7fa3d8b52740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d46882c860 0x55d46883b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:04.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.856+0000 7fa3d8b52740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d46883b650 0x55d46883da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:04.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.856+0000 7fa3d8b52740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d468791620 con 0x55d46882c860 2024-09-19T06:08:04.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.856+0000 7fa3d8b52740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55d468738e50 con 0x55d46883b650 2024-09-19T06:08:04.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.856+0000 7fa3d8b52740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55d46878d5e0 con 0x55d46882bf40 2024-09-19T06:08:04.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.856+0000 7fa3cdffb640 1 --2- 172.21.15.37:0/1999066679 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fa3bc0a32c0 0x7fa3bc0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:04.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.857+0000 7fa3cffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d46882c860 0x55d46883b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:04.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.857+0000 7fa3cffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d46882c860 0x55d46883b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52598/0 (socket says 172.21.15.37:52598) 2024-09-19T06:08:04.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.857+0000 7fa3cffff640 1 -- 172.21.15.37:0/3891897590 learned_addr learned my addr 172.21.15.37:0/3891897590 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:08:04.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.857+0000 7fa3d4d16640 1 --2- 172.21.15.37:0/3891897590 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d46882bf40 0x55d46882c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:04.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.857+0000 7fa3d4d16640 1 --2- 172.21.15.37:0/1999066679 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fa3bc0a32c0 0x7fa3bc0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:04.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.857+0000 7fa3c7fff640 1 --2- 172.21.15.37:0/3891897590 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d46883b650 0x55d46883da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:04.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.857+0000 7fa3cdffb640 1 -- 172.21.15.37:0/1999066679 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9121+0+0 (secure 0 0 0) 0x7fa3c00cf710 con 0x7fa3d0102da0 2024-09-19T06:08:04.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.857+0000 7fa3cffff640 1 -- 172.21.15.37:0/3891897590 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d46882bf40 msgr2=0x55d46882c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:04.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.857+0000 7fa3cffff640 1 --2- 172.21.15.37:0/3891897590 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d46882bf40 0x55d46882c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:04.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.857+0000 7fa3cffff640 1 -- 172.21.15.37:0/3891897590 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d46883b650 msgr2=0x55d46883da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:04.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.857+0000 7fa3cffff640 1 --2- 172.21.15.37:0/3891897590 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d46883b650 0x55d46883da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:04.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.857+0000 7fa3cffff640 1 -- 172.21.15.37:0/3891897590 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d468729d40 con 0x55d46882c860 2024-09-19T06:08:04.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.857+0000 7fa3c7fff640 1 --2- 172.21.15.37:0/3891897590 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d46883b650 0x55d46883da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:08:04.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.857+0000 7fa3cffff640 1 --2- 172.21.15.37:0/3891897590 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d46882c860 0x55d46883b110 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fa3c0021000 tx=0x7fa3c00048a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=986be9fcc7f08206 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:04.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.857+0000 7fa3d4d16640 1 --2- 172.21.15.37:0/1999066679 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fa3bc0a32c0 0x7fa3bc0a5780 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa3c8006010 tx=0x7fa3c802a950 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:04.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.857+0000 7fa3c67fc640 1 -- 172.21.15.37:0/3891897590 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c0020070 con 0x55d46882c860 2024-09-19T06:08:04.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.857+0000 7fa3c67fc640 1 -- 172.21.15.37:0/3891897590 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3c00046c0 con 0x55d46882c860 2024-09-19T06:08:04.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.857+0000 7fa3c67fc640 1 -- 172.21.15.37:0/3891897590 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c00c5e60 con 0x55d46882c860 2024-09-19T06:08:04.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.858+0000 7fa3d8b52740 1 -- 172.21.15.37:0/3891897590 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d46882c860 msgr2=0x55d46883b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:04.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.858+0000 7fa3d8b52740 1 --2- 172.21.15.37:0/3891897590 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d46882c860 0x55d46883b110 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fa3c0021000 tx=0x7fa3c00048a0 comp rx=0 tx=0).stop 2024-09-19T06:08:04.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.858+0000 7fa3d8b52740 1 -- 172.21.15.37:0/3891897590 shutdown_connections 2024-09-19T06:08:04.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.858+0000 7fa3d8b52740 1 --2- 172.21.15.37:0/3891897590 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d46883b650 0x55d46883da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:04.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.858+0000 7fa3d8b52740 1 --2- 172.21.15.37:0/3891897590 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d46882c860 0x55d46883b110 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:04.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.858+0000 7fa3d8b52740 1 --2- 172.21.15.37:0/3891897590 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d46882bf40 0x55d46882c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:04.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.858+0000 7fa3d8b52740 1 -- 172.21.15.37:0/3891897590 >> 172.21.15.37:0/3891897590 conn(0x55d4688285f0 msgr2=0x55d4688289d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:04.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.858+0000 7fa3d8b52740 1 -- 172.21.15.37:0/3891897590 shutdown_connections 2024-09-19T06:08:04.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.858+0000 7fa3d8b52740 1 -- 172.21.15.37:0/3891897590 wait complete. 2024-09-19T06:08:04.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.858+0000 7fa3d8b52740 1 -- start start 2024-09-19T06:08:04.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.859+0000 7fa3d8b52740 1 Processor -- start 2024-09-19T06:08:04.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.859+0000 7fa3d8b52740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d46882bf40 0x55d468838610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:04.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.859+0000 7fa3d8b52740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d46882c860 0x55d468838b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:04.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.859+0000 7fa3d8b52740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d46883b650 0x55d468839090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:04.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.859+0000 7fa3d8b52740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d46883e220 con 0x55d46882bf40 2024-09-19T06:08:04.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.859+0000 7fa3d8b52740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55d468719f10 con 0x55d46882c860 2024-09-19T06:08:04.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.859+0000 7fa3d8b52740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55d46883e3a0 con 0x55d46883b650 2024-09-19T06:08:04.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.859+0000 7fa3d8b52740 10 client.0 _ll_register_callbacks cb 0x55d46873ddb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:08:04.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.859+0000 7fa3cffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d46882bf40 0x55d468838610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:04.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.859+0000 7fa3cffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d46882bf40 0x55d468838610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52608/0 (socket says 172.21.15.37:52608) 2024-09-19T06:08:04.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.859+0000 7fa3cffff640 1 -- 172.21.15.37:0/2523738598 learned_addr learned my addr 172.21.15.37:0/2523738598 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:08:04.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.859+0000 7fa3d4d16640 1 --2- 172.21.15.37:0/2523738598 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d46883b650 0x55d468839090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:04.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.859+0000 7fa3c7fff640 1 --2- 172.21.15.37:0/2523738598 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d46882c860 0x55d468838b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:04.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.859+0000 7fa3cffff640 1 -- 172.21.15.37:0/2523738598 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d46883b650 msgr2=0x55d468839090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:04.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.859+0000 7fa3cffff640 1 --2- 172.21.15.37:0/2523738598 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d46883b650 0x55d468839090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:04.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.859+0000 7fa3cffff640 1 -- 172.21.15.37:0/2523738598 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d46882c860 msgr2=0x55d468838b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:04.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.859+0000 7fa3cffff640 1 --2- 172.21.15.37:0/2523738598 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d46882c860 0x55d468838b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:04.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.859+0000 7fa3cffff640 1 -- 172.21.15.37:0/2523738598 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4684a0580 con 0x55d46882bf40 2024-09-19T06:08:04.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.859+0000 7fa3c7fff640 1 --2- 172.21.15.37:0/2523738598 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d46882c860 0x55d468838b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:08:04.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.859+0000 7fa3d4d16640 1 --2- 172.21.15.37:0/2523738598 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d46883b650 0x55d468839090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:08:04.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.860+0000 7fa3cffff640 1 --2- 172.21.15.37:0/2523738598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d46882bf40 0x55d468838610 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fa3c000dfd0 tx=0x7fa3c0005bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24f602281237c0c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:04.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.860+0000 7fa3af7fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-19T06:08:04.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.860+0000 7fa3af7fe640 1 -- 172.21.15.37:0/2523738598 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c00b9060 con 0x55d46882bf40 2024-09-19T06:08:04.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.860+0000 7fa3af7fe640 1 -- 172.21.15.37:0/2523738598 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9121+0+0 (secure 0 0 0) 0x7fa3c00860c0 con 0x55d46882bf40 2024-09-19T06:08:04.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.860+0000 7fa3d8b52740 1 -- 172.21.15.37:0/2523738598 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d46879eb90 con 0x55d46882bf40 2024-09-19T06:08:04.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.860+0000 7fa3af7fe640 1 -- 172.21.15.37:0/2523738598 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fa3c0020040 con 0x55d46882bf40 2024-09-19T06:08:04.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.860+0000 7fa3d8b52740 10 client.15324 fetch_fsmap learned FSMap version 20 2024-09-19T06:08:04.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.860+0000 7fa3d8b52740 1 -- 172.21.15.37:0/2523738598 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55d46856a960 con 0x55d46882bf40 2024-09-19T06:08:04.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.860+0000 7fa3af7fe640 1 -- 172.21.15.37:0/2523738598 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55d46879eb90 con 0x55d46882bf40 2024-09-19T06:08:04.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.860+0000 7fa3af7fe640 1 -- 172.21.15.37:0/2523738598 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 20) ==== 8338+0+0 (secure 0 0 0) 0x7fa3c009cce0 con 0x55d46882bf40 2024-09-19T06:08:04.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.860+0000 7fa3d8b52740 10 client.15324 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:08:04.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.861+0000 7fa3d8b52740 10 client.15324 resolve_mds: validated gid 24485 aka daemon mds.b 2024-09-19T06:08:04.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.861+0000 7fa3d8b52740 20 client.15324 populate_metadata read hostname 'smithi037' 2024-09-19T06:08:04.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.861+0000 7fa3d8b52740 1 --2- 172.21.15.37:0/2523738598 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x55d46884b140 0x55d46884d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:04.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.861+0000 7fa3d8b52740 4 client.15324 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:08:04.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.861+0000 7fa3d8b52740 1 -- 172.21.15.37:0/2523738598 --> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d4687990a0 con 0x55d46884b140 2024-09-19T06:08:04.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.861+0000 7fa3c7fff640 1 --2- 172.21.15.37:0/2523738598 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x55d46884b140 0x55d46884d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:04.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.861+0000 7fa3c7fff640 1 --2- 172.21.15.37:0/2523738598 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x55d46884b140 0x55d46884d530 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=914e69dda0d9531e server_cookie=e0b0cbc06b61de1c in_seq=0 out_seq=0 2024-09-19T06:08:04.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.861+0000 7fa3af7fe640 10 client.15324 ms_handle_connect on v2:172.21.15.99:6838/3404812329 2024-09-19T06:08:04.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.862+0000 7fa3af7fe640 1 -- 172.21.15.37:0/2523738598 <== mds.0 v2:172.21.15.99:6838/3404812329 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d4687990a0 con 0x55d46884b140 2024-09-19T06:08:04.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.862+0000 7fa3af7fe640 10 client.15324 handle_command_reply: tid=0 2024-09-19T06:08:04.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.862+0000 7fa3d8b52740 1 client.15324 shutdown 2024-09-19T06:08:04.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.862+0000 7fa3d8b52740 1 -- 172.21.15.37:0/2523738598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d46882bf40 msgr2=0x55d468838610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:04.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.862+0000 7fa3d8b52740 1 --2- 172.21.15.37:0/2523738598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d46882bf40 0x55d468838610 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fa3c000dfd0 tx=0x7fa3c0005bb0 comp rx=0 tx=0).stop 2024-09-19T06:08:04.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.862+0000 7fa3d8b52740 1 -- 172.21.15.37:0/2523738598 shutdown_connections 2024-09-19T06:08:04.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.862+0000 7fa3d8b52740 1 --2- 172.21.15.37:0/2523738598 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x55d46884b140 0x55d46884d530 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:04.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.862+0000 7fa3d8b52740 1 --2- 172.21.15.37:0/2523738598 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d46882c860 0x55d468838b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:04.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.862+0000 7fa3d8b52740 1 --2- 172.21.15.37:0/2523738598 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d46883b650 0x55d468839090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:04.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.862+0000 7fa3af7fe640 0 client.15324 ms_handle_reset on v2:172.21.15.99:6838/3404812329 2024-09-19T06:08:04.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.862+0000 7fa3d8b52740 1 --2- 172.21.15.37:0/2523738598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d46882bf40 0x55d468838610 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:04.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.862+0000 7fa3d8b52740 1 -- 172.21.15.37:0/2523738598 >> 172.21.15.37:0/2523738598 conn(0x55d4688285f0 msgr2=0x55d46882e350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:04.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.862+0000 7fa3d8b52740 1 -- 172.21.15.37:0/2523738598 shutdown_connections 2024-09-19T06:08:04.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.862+0000 7fa3d8b52740 1 -- 172.21.15.37:0/2523738598 wait complete. 2024-09-19T06:08:04.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.863+0000 7fa3d8b52740 20 client.15324 trim_cache size 0 max 16384 2024-09-19T06:08:04.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.880+0000 7fa3d8b52740 1 Processor -- start 2024-09-19T06:08:04.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.880+0000 7fa3d8b52740 1 -- start start 2024-09-19T06:08:04.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.880+0000 7fa3d8b52740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d46882bf40 0x55d468827640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:04.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.880+0000 7fa3d8b52740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d46882c860 0x55d468850550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:04.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.880+0000 7fa3d8b52740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d46883b650 0x55d468850a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:04.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.880+0000 7fa3d8b52740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d01aaa00 con 0x55d46883b650 2024-09-19T06:08:04.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.880+0000 7fa3d8b52740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d01ad280 con 0x55d46882bf40 2024-09-19T06:08:04.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.880+0000 7fa3d8b52740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d01ab070 con 0x55d46882c860 2024-09-19T06:08:04.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.880+0000 7fa3d4d16640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d46883b650 0x55d468850a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:04.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.880+0000 7fa3c7fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d46882c860 0x55d468850550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:04.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.880+0000 7fa3d4d16640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d46883b650 0x55d468850a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52612/0 (socket says 172.21.15.37:52612) 2024-09-19T06:08:04.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.880+0000 7fa3d4d16640 1 -- 172.21.15.37:0/1979503650 learned_addr learned my addr 172.21.15.37:0/1979503650 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:08:04.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.880+0000 7fa3cffff640 1 --2- 172.21.15.37:0/1979503650 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d46882bf40 0x55d468827640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:04.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.880+0000 7fa3c7fff640 1 -- 172.21.15.37:0/1979503650 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d46882bf40 msgr2=0x55d468827640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:04.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.880+0000 7fa3c7fff640 1 --2- 172.21.15.37:0/1979503650 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d46882bf40 0x55d468827640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:04.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.880+0000 7fa3c7fff640 1 -- 172.21.15.37:0/1979503650 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d46883b650 msgr2=0x55d468850a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:04.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.880+0000 7fa3c7fff640 1 --2- 172.21.15.37:0/1979503650 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d46883b650 0x55d468850a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:04.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.880+0000 7fa3c7fff640 1 -- 172.21.15.37:0/1979503650 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d46882c650 con 0x55d46882c860 2024-09-19T06:08:04.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.881+0000 7fa3c7fff640 1 --2- 172.21.15.37:0/1979503650 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d46882c860 0x55d468850550 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x55d46883e3f0 tx=0x7fa3b800b780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1327471ea2e6fd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:04.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.881+0000 7fa3c5ffb640 1 -- 172.21.15.37:0/1979503650 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3b801a5f0 con 0x55d46882c860 2024-09-19T06:08:04.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.881+0000 7fa3c5ffb640 1 -- 172.21.15.37:0/1979503650 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3b801ac70 con 0x55d46882c860 2024-09-19T06:08:04.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.881+0000 7fa3c5ffb640 1 -- 172.21.15.37:0/1979503650 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3b800f3c0 con 0x55d46882c860 2024-09-19T06:08:04.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.882+0000 7fa3d8b52740 1 -- 172.21.15.37:0/1979503650 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d46882c860 msgr2=0x55d468850550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:04.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.882+0000 7fa3d8b52740 1 --2- 172.21.15.37:0/1979503650 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d46882c860 0x55d468850550 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x55d46883e3f0 tx=0x7fa3b800b780 comp rx=0 tx=0).stop 2024-09-19T06:08:04.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.882+0000 7fa3d8b52740 1 -- 172.21.15.37:0/1979503650 shutdown_connections 2024-09-19T06:08:04.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.882+0000 7fa3d8b52740 1 --2- 172.21.15.37:0/1979503650 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d46883b650 0x55d468850a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:04.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.882+0000 7fa3d8b52740 1 --2- 172.21.15.37:0/1979503650 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d46882c860 0x55d468850550 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:04.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.882+0000 7fa3d8b52740 1 --2- 172.21.15.37:0/1979503650 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d46882bf40 0x55d468827640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:04.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.882+0000 7fa3d8b52740 1 -- 172.21.15.37:0/1979503650 >> 172.21.15.37:0/1979503650 conn(0x55d4688285f0 msgr2=0x55d468826f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:04.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.882+0000 7fa3d8b52740 1 -- 172.21.15.37:0/1979503650 shutdown_connections 2024-09-19T06:08:04.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.882+0000 7fa3d8b52740 1 -- 172.21.15.37:0/1979503650 wait complete. 2024-09-19T06:08:04.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.882+0000 7fa3d8b52740 1 -- start start 2024-09-19T06:08:04.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.882+0000 7fa3d8b52740 1 Processor -- start 2024-09-19T06:08:04.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.883+0000 7fa3d8b52740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d46882bf40 0x55d46884e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:04.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.883+0000 7fa3d8b52740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d46882c860 0x55d46884eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:04.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.883+0000 7fa3d8b52740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d46883b650 0x55d46884f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:04.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.883+0000 7fa3d8b52740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d01ab740 con 0x55d46882c860 2024-09-19T06:08:04.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.883+0000 7fa3d8b52740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d01acbb0 con 0x55d46882bf40 2024-09-19T06:08:04.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.883+0000 7fa3d8b52740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d01abe10 con 0x55d46883b650 2024-09-19T06:08:04.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.883+0000 7fa3d8b52740 10 client.0 _ll_register_callbacks cb 0x7fa3c0097c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:08:04.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.883+0000 7fa3c7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d46882c860 0x55d46884eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:04.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.883+0000 7fa3c7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d46882c860 0x55d46884eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52620/0 (socket says 172.21.15.37:52620) 2024-09-19T06:08:04.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.883+0000 7fa3c7fff640 1 -- 172.21.15.37:0/1574714633 learned_addr learned my addr 172.21.15.37:0/1574714633 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:08:04.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.883+0000 7fa3cffff640 1 --2- 172.21.15.37:0/1574714633 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d46882bf40 0x55d46884e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:04.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.883+0000 7fa3d4d16640 1 --2- 172.21.15.37:0/1574714633 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d46883b650 0x55d46884f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:04.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.883+0000 7fa3c7fff640 1 -- 172.21.15.37:0/1574714633 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d46883b650 msgr2=0x55d46884f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:04.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.883+0000 7fa3c7fff640 1 --2- 172.21.15.37:0/1574714633 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d46883b650 0x55d46884f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:04.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.883+0000 7fa3c7fff640 1 -- 172.21.15.37:0/1574714633 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d46882bf40 msgr2=0x55d46884e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:08:04.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.883+0000 7fa3c7fff640 1 --2- 172.21.15.37:0/1574714633 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d46882bf40 0x55d46884e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:04.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.883+0000 7fa3c7fff640 1 -- 172.21.15.37:0/1574714633 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4688b4d20 con 0x55d46882c860 2024-09-19T06:08:04.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.883+0000 7fa3c7fff640 1 --2- 172.21.15.37:0/1574714633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d46882c860 0x55d46884eac0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fa3b8000c00 tx=0x7fa3b8005340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49b1852c247754e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:04.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.883+0000 7fa3af7fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-19T06:08:04.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.883+0000 7fa3af7fe640 1 -- 172.21.15.37:0/1574714633 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3b801a5f0 con 0x55d46882c860 2024-09-19T06:08:04.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.883+0000 7fa3af7fe640 1 -- 172.21.15.37:0/1574714633 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9121+0+0 (secure 0 0 0) 0x7fa3b801a790 con 0x55d46882c860 2024-09-19T06:08:04.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.883+0000 7fa3d8b52740 1 -- 172.21.15.37:0/1574714633 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa3b801ac70 con 0x55d46882c860 2024-09-19T06:08:04.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.884+0000 7fa3af7fe640 1 -- 172.21.15.37:0/1574714633 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fa3b8038050 con 0x55d46882c860 2024-09-19T06:08:04.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.884+0000 7fa3d8b52740 10 client.15330 fetch_fsmap learned FSMap version 20 2024-09-19T06:08:04.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.884+0000 7fa3d8b52740 1 -- 172.21.15.37:0/1574714633 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55d4688b6040 con 0x55d46882c860 2024-09-19T06:08:04.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.884+0000 7fa3af7fe640 1 -- 172.21.15.37:0/1574714633 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3b801ac70 con 0x55d46882c860 2024-09-19T06:08:04.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.884+0000 7fa3af7fe640 1 -- 172.21.15.37:0/1574714633 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 20) ==== 8338+0+0 (secure 0 0 0) 0x7fa3b802f7f0 con 0x55d46882c860 2024-09-19T06:08:04.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.884+0000 7fa3d8b52740 10 client.15330 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:08:04.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.884+0000 7fa3d8b52740 10 client.15330 resolve_mds: validated gid 24485 aka daemon mds.b 2024-09-19T06:08:04.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.884+0000 7fa3d8b52740 20 client.15330 populate_metadata read hostname 'smithi037' 2024-09-19T06:08:04.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.884+0000 7fa3d8b52740 1 --2- 172.21.15.37:0/1574714633 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x55d4688b6730 0x55d4688b8b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:04.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.884+0000 7fa3d8b52740 4 client.15330 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "ad98437b", "release": true, "await": true}] 2024-09-19T06:08:04.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.884+0000 7fa3d8b52740 1 -- 172.21.15.37:0/1574714633 --> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] -- command(tid 0: {"prefix": "quiesce db", "set_id": "ad98437b", "release": true, "await": true}) -- 0x55d4687155a0 con 0x55d4688b6730 2024-09-19T06:08:04.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.884+0000 7fa3cffff640 1 --2- 172.21.15.37:0/1574714633 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x55d4688b6730 0x55d4688b8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:04.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.885+0000 7fa3cffff640 1 --2- 172.21.15.37:0/1574714633 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x55d4688b6730 0x55d4688b8b50 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82ce99d808745228 server_cookie=a2baf167b3947287 in_seq=0 out_seq=0 2024-09-19T06:08:04.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.885+0000 7fa3af7fe640 10 client.15330 ms_handle_connect on v2:172.21.15.99:6838/3404812329 2024-09-19T06:08:04.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.886+0000 7fa3af7fe640 1 -- 172.21.15.37:0/1574714633 <== mds.0 v2:172.21.15.99:6838/3404812329 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55d4687155a0 con 0x55d4688b6730 2024-09-19T06:08:04.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.886+0000 7fa3af7fe640 10 client.15330 handle_command_reply: tid=0 2024-09-19T06:08:04.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.886+0000 7fa3d8b52740 1 client.15330 shutdown 2024-09-19T06:08:04.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.886+0000 7fa3d8b52740 1 -- 172.21.15.37:0/1574714633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d46882c860 msgr2=0x55d46884eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:04.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.886+0000 7fa3d8b52740 1 --2- 172.21.15.37:0/1574714633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d46882c860 0x55d46884eac0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fa3b8000c00 tx=0x7fa3b8005340 comp rx=0 tx=0).stop 2024-09-19T06:08:04.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.886+0000 7fa3d8b52740 1 -- 172.21.15.37:0/1574714633 shutdown_connections 2024-09-19T06:08:04.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.886+0000 7fa3d8b52740 1 --2- 172.21.15.37:0/1574714633 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x55d4688b6730 0x55d4688b8b50 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:04.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.886+0000 7fa3d8b52740 1 --2- 172.21.15.37:0/1574714633 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d46883b650 0x55d46884f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:04.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.886+0000 7fa3d8b52740 1 --2- 172.21.15.37:0/1574714633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d46882c860 0x55d46884eac0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:04.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.886+0000 7fa3d8b52740 1 --2- 172.21.15.37:0/1574714633 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d46882bf40 0x55d46884e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:04.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.886+0000 7fa3af7fe640 0 client.15330 ms_handle_reset on v2:172.21.15.99:6838/3404812329 2024-09-19T06:08:04.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.886+0000 7fa3d8b52740 1 -- 172.21.15.37:0/1574714633 >> 172.21.15.37:0/1574714633 conn(0x55d4688285f0 msgr2=0x55d468846e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:04.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.886+0000 7fa3d8b52740 1 -- 172.21.15.37:0/1574714633 shutdown_connections 2024-09-19T06:08:04.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.886+0000 7fa3d8b52740 1 -- 172.21.15.37:0/1574714633 wait complete. 2024-09-19T06:08:04.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.887+0000 7fa3d8b52740 20 client.15330 trim_cache size 0 max 16384 2024-09-19T06:08:04.894 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-19T06:08:04.894 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 20, 2024-09-19T06:08:04.894 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 24485, 2024-09-19T06:08:04.894 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 12, 2024-09-19T06:08:04.894 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": { 2024-09-19T06:08:04.894 INFO:teuthology.orchestra.run.smithi037.stdout: "ad98437b": { 2024-09-19T06:08:04.894 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 12, 2024-09-19T06:08:04.894 INFO:teuthology.orchestra.run.smithi037.stdout: "age_ref": 0.0, 2024-09-19T06:08:04.895 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-09-19T06:08:04.895 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RELEASED", 2024-09-19T06:08:04.895 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-09-19T06:08:04.895 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:08:04.895 INFO:teuthology.orchestra.run.smithi037.stdout: "timeout": 90.0, 2024-09-19T06:08:04.895 INFO:teuthology.orchestra.run.smithi037.stdout: "expiration": 140.3, 2024-09-19T06:08:04.895 INFO:teuthology.orchestra.run.smithi037.stdout: "members": { 2024-09-19T06:08:04.895 INFO:teuthology.orchestra.run.smithi037.stdout: "file:/": { 2024-09-19T06:08:04.895 INFO:teuthology.orchestra.run.smithi037.stdout: "excluded": false, 2024-09-19T06:08:04.895 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-09-19T06:08:04.895 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RELEASED", 2024-09-19T06:08:04.895 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-09-19T06:08:04.895 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:08:04.895 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:08:04.895 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:08:04.896 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:08:04.896 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:08:04.896 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-19T06:08:04.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.887+0000 7fa3d6779640 1 -- 172.21.15.37:0/1999066679 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fa3bc0a32c0 msgr2=0x7fa3bc0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:04.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.887+0000 7fa3d6779640 1 --2- 172.21.15.37:0/1999066679 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fa3bc0a32c0 0x7fa3bc0a5780 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa3c8006010 tx=0x7fa3c802a950 comp rx=0 tx=0).stop 2024-09-19T06:08:04.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.887+0000 7fa3d6779640 1 -- 172.21.15.37:0/1999066679 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3d0102da0 msgr2=0x7fa3d0198320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:04.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.887+0000 7fa3d6779640 1 --2- 172.21.15.37:0/1999066679 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3d0102da0 0x7fa3d0198320 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fa3c000d770 tx=0x7fa3c000dc30 comp rx=0 tx=0).stop 2024-09-19T06:08:04.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.887+0000 7fa3d6779640 1 -- 172.21.15.37:0/1999066679 shutdown_connections 2024-09-19T06:08:04.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.887+0000 7fa3d6779640 1 --2- 172.21.15.37:0/1999066679 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fa3bc0a32c0 0x7fa3bc0a5780 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:04.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.887+0000 7fa3d6779640 1 --2- 172.21.15.37:0/1999066679 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3d01036c0 0x7fa3d0198860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:04.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.887+0000 7fa3d6779640 1 --2- 172.21.15.37:0/1999066679 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3d010c180 0x7fa3d019cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:04.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.887+0000 7fa3d6779640 1 --2- 172.21.15.37:0/1999066679 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3d0102da0 0x7fa3d0198320 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:04.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.888+0000 7fa3d6779640 1 -- 172.21.15.37:0/1999066679 >> 172.21.15.37:0/1999066679 conn(0x7fa3d00fc7a0 msgr2=0x7fa3d00fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:04.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.888+0000 7fa3d6779640 1 -- 172.21.15.37:0/1999066679 shutdown_connections 2024-09-19T06:08:04.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:08:04.888+0000 7fa3d6779640 1 -- 172.21.15.37:0/1999066679 wait complete. 2024-09-19T06:08:05.571 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'ad98437b', total seconds elapsed: 23.8 2024-09-19T06:08:06.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:08:05 smithi099 ceph-mon[35300]: pgmap v407: 129 pgs: 129 active+clean; 6.2 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 1.3 KiB/s wr, 3 op/s 2024-09-19T06:08:06.244 INFO:tasks.workunit.client.0.smithi037.stderr:+ tar xzf ltp-full.tgz 2024-09-19T06:08:06.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:08:05 smithi117 ceph-mon[35050]: pgmap v407: 129 pgs: 129 active+clean; 6.2 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 1.3 KiB/s wr, 3 op/s 2024-09-19T06:08:06.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:08:05 smithi037 ceph-mon[31211]: pgmap v407: 129 pgs: 129 active+clean; 6.2 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 1.3 KiB/s wr, 3 op/s 2024-09-19T06:08:08.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:08:07 smithi099 ceph-mon[35300]: pgmap v408: 129 pgs: 129 active+clean; 6.2 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 426 B/s wr, 1 op/s 2024-09-19T06:08:08.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:08:07 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:08:08.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:08:07 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:08:08.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:08:07 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:08:08.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:08:07 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:08:08.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:08:07 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:08:08.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:08:07 smithi117 ceph-mon[35050]: pgmap v408: 129 pgs: 129 active+clean; 6.2 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 426 B/s wr, 1 op/s 2024-09-19T06:08:08.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:08:07 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:08:08.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:08:07 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:08:08.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:08:07 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:08:08.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:08:07 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:08:08.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:08:07 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:08:08.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:08:07 smithi037 ceph-mon[31211]: pgmap v408: 129 pgs: 129 active+clean; 6.2 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 426 B/s wr, 1 op/s 2024-09-19T06:08:08.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:08:07 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:08:08.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:08:07 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:08:08.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:08:07 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:08:08.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:08:07 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:08:08.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:08:07 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:08:09.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:08:08 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:08:09.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:08:08 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:08:09.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:08:08 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:08:09.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:08:08 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:08:09.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:08:08 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:08:09.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:08:08 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:08:09.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:08:08 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:08:09.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:08:08 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:08:09.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:08:08 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:08:10.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:08:10 smithi037 ceph-mon[31211]: pgmap v409: 129 pgs: 129 active+clean; 9.3 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 270 KiB/s wr, 3 op/s 2024-09-19T06:08:10.438 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:08:10 smithi099 ceph-mon[35300]: pgmap v409: 129 pgs: 129 active+clean; 9.3 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 270 KiB/s wr, 3 op/s 2024-09-19T06:08:10.499 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:08:10 smithi117 ceph-mon[35050]: pgmap v409: 129 pgs: 129 active+clean; 9.3 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 270 KiB/s wr, 3 op/s 2024-09-19T06:08:12.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:08:12 smithi037 ceph-mon[31211]: pgmap v410: 129 pgs: 129 active+clean; 9.3 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 282 KiB/s wr, 3 op/s 2024-09-19T06:08:12.438 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:08:12 smithi099 ceph-mon[35300]: pgmap v410: 129 pgs: 129 active+clean; 9.3 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 282 KiB/s wr, 3 op/s 2024-09-19T06:08:12.499 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:08:12 smithi117 ceph-mon[35050]: pgmap v410: 129 pgs: 129 active+clean; 9.3 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 282 KiB/s wr, 3 op/s 2024-09-19T06:08:14.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:08:14 smithi037 ceph-mon[31211]: pgmap v411: 129 pgs: 129 active+clean; 30 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 562 KiB/s rd, 2.1 MiB/s wr, 189 op/s 2024-09-19T06:08:14.438 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:08:14 smithi099 ceph-mon[35300]: pgmap v411: 129 pgs: 129 active+clean; 30 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 562 KiB/s rd, 2.1 MiB/s wr, 189 op/s 2024-09-19T06:08:14.499 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:08:14 smithi117 ceph-mon[35050]: pgmap v411: 129 pgs: 129 active+clean; 30 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 562 KiB/s rd, 2.1 MiB/s wr, 189 op/s 2024-09-19T06:08:16.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:08:16 smithi037 ceph-mon[31211]: pgmap v412: 129 pgs: 129 active+clean; 35 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 852 KiB/s rd, 2.5 MiB/s wr, 224 op/s 2024-09-19T06:08:16.438 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:08:16 smithi099 ceph-mon[35300]: pgmap v412: 129 pgs: 129 active+clean; 35 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 852 KiB/s rd, 2.5 MiB/s wr, 224 op/s 2024-09-19T06:08:16.499 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:08:16 smithi117 ceph-mon[35050]: pgmap v412: 129 pgs: 129 active+clean; 35 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 852 KiB/s rd, 2.5 MiB/s wr, 224 op/s 2024-09-19T06:08:18.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:08:18 smithi037 ceph-mon[31211]: pgmap v413: 129 pgs: 129 active+clean; 35 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 852 KiB/s rd, 2.6 MiB/s wr, 225 op/s 2024-09-19T06:08:18.438 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:08:18 smithi099 ceph-mon[35300]: pgmap v413: 129 pgs: 129 active+clean; 35 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 852 KiB/s rd, 2.6 MiB/s wr, 225 op/s 2024-09-19T06:08:18.499 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:08:18 smithi117 ceph-mon[35050]: pgmap v413: 129 pgs: 129 active+clean; 35 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 852 KiB/s rd, 2.6 MiB/s wr, 225 op/s 2024-09-19T06:08:20.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:08:20 smithi037 ceph-mon[31211]: pgmap v414: 129 pgs: 129 active+clean; 38 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.9 MiB/s wr, 236 op/s 2024-09-19T06:08:20.438 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:08:20 smithi099 ceph-mon[35300]: pgmap v414: 129 pgs: 129 active+clean; 38 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.9 MiB/s wr, 236 op/s 2024-09-19T06:08:20.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:08:20 smithi117 ceph-mon[35050]: pgmap v414: 129 pgs: 129 active+clean; 38 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.9 MiB/s wr, 236 op/s 2024-09-19T06:08:22.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:08:22 smithi037 ceph-mon[31211]: pgmap v415: 129 pgs: 129 active+clean; 40 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.8 MiB/s wr, 236 op/s 2024-09-19T06:08:22.438 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:08:22 smithi099 ceph-mon[35300]: pgmap v415: 129 pgs: 129 active+clean; 40 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.8 MiB/s wr, 236 op/s 2024-09-19T06:08:22.499 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:08:22 smithi117 ceph-mon[35050]: pgmap v415: 129 pgs: 129 active+clean; 40 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.8 MiB/s wr, 236 op/s 2024-09-19T06:08:24.322 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:08:24 smithi117 ceph-mon[35050]: pgmap v416: 129 pgs: 129 active+clean; 40 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.8 MiB/s wr, 237 op/s 2024-09-19T06:08:24.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:08:24 smithi037 ceph-mon[31211]: pgmap v416: 129 pgs: 129 active+clean; 40 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.8 MiB/s wr, 237 op/s 2024-09-19T06:08:24.438 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:08:24 smithi099 ceph-mon[35300]: pgmap v416: 129 pgs: 129 active+clean; 40 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.8 MiB/s wr, 237 op/s 2024-09-19T06:08:26.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:08:26 smithi037 ceph-mon[31211]: pgmap v417: 129 pgs: 129 active+clean; 40 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1022 KiB/s wr, 55 op/s 2024-09-19T06:08:26.438 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:08:26 smithi099 ceph-mon[35300]: pgmap v417: 129 pgs: 129 active+clean; 40 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1022 KiB/s wr, 55 op/s 2024-09-19T06:08:26.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:08:26 smithi117 ceph-mon[35050]: pgmap v417: 129 pgs: 129 active+clean; 40 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1022 KiB/s wr, 55 op/s 2024-09-19T06:08:27.862 INFO:tasks.workunit.client.0.smithi037.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-19T06:08:27.864 INFO:tasks.workunit.client.0.smithi037.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-19T06:08:27.864 INFO:tasks.workunit.client.0.smithi037.stderr:+ make 2024-09-19T06:08:28.087 INFO:tasks.workunit.client.0.smithi037.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-19T06:08:28.351 INFO:tasks.workunit.client.0.smithi037.stderr:++ readlink -f fsstress 2024-09-19T06:08:28.351 INFO:tasks.workunit.client.0.smithi037.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-19T06:08:28.351 INFO:tasks.workunit.client.0.smithi037.stderr:+ popd 2024-09-19T06:08:28.352 INFO:tasks.workunit.client.0.smithi037.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-19T06:08:28.352 INFO:tasks.workunit.client.0.smithi037.stderr:+ popd 2024-09-19T06:08:28.352 INFO:tasks.workunit.client.0.smithi037.stdout:~/cephtest/mnt.0/client.0/tmp 2024-09-19T06:08:28.352 INFO:tasks.workunit.client.0.smithi037.stderr:++ mktemp -d -p . 2024-09-19T06:08:28.353 INFO:tasks.workunit.client.0.smithi037.stderr:+ T=./tmp.eccD1u8hpS 2024-09-19T06:08:28.353 INFO:tasks.workunit.client.0.smithi037.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.eccD1u8hpS -l 1 -n 1000 -p 10 -v 2024-09-19T06:08:28.355 INFO:tasks.workunit.client.0.smithi037.stdout:seed = 1726928590 2024-09-19T06:08:28.357 INFO:tasks.workunit.client.0.smithi037.stdout:0/0: chown . 1 1 2024-09-19T06:08:28.358 INFO:tasks.workunit.client.0.smithi037.stdout:2/0: write - no filename 2024-09-19T06:08:28.359 INFO:tasks.workunit.client.0.smithi037.stdout:3/0: write - no filename 2024-09-19T06:08:28.359 INFO:tasks.workunit.client.0.smithi037.stdout:3/1: write - no filename 2024-09-19T06:08:28.359 INFO:tasks.workunit.client.0.smithi037.stdout:4/0: dwrite - no filename 2024-09-19T06:08:28.359 INFO:tasks.workunit.client.0.smithi037.stdout:4/1: write - no filename 2024-09-19T06:08:28.360 INFO:tasks.workunit.client.0.smithi037.stdout:3/2: mkdir d0 0 2024-09-19T06:08:28.360 INFO:tasks.workunit.client.0.smithi037.stdout:3/3: dwrite - no filename 2024-09-19T06:08:28.360 INFO:tasks.workunit.client.0.smithi037.stdout:3/4: rename d0 to d0/d1 22 2024-09-19T06:08:28.360 INFO:tasks.workunit.client.0.smithi037.stdout:3/5: link - no file 2024-09-19T06:08:28.360 INFO:tasks.workunit.client.0.smithi037.stdout:3/6: dread - no filename 2024-09-19T06:08:28.361 INFO:tasks.workunit.client.0.smithi037.stdout:4/2: mkdir d0 0 2024-09-19T06:08:28.362 INFO:tasks.workunit.client.0.smithi037.stdout:3/7: creat d0/f2 x:0 0 0 2024-09-19T06:08:28.362 INFO:tasks.workunit.client.0.smithi037.stdout:6/0: dwrite - no filename 2024-09-19T06:08:28.363 INFO:tasks.workunit.client.0.smithi037.stdout:5/0: mkdir d0 0 2024-09-19T06:08:28.363 INFO:tasks.workunit.client.0.smithi037.stdout:5/1: write - no filename 2024-09-19T06:08:28.363 INFO:tasks.workunit.client.0.smithi037.stdout:5/2: dwrite - no filename 2024-09-19T06:08:28.363 INFO:tasks.workunit.client.0.smithi037.stdout:4/3: symlink d0/l1 0 2024-09-19T06:08:28.364 INFO:tasks.workunit.client.0.smithi037.stdout:3/8: mknod d0/c3 0 2024-09-19T06:08:28.365 INFO:tasks.workunit.client.0.smithi037.stdout:7/0: link - no file 2024-09-19T06:08:28.365 INFO:tasks.workunit.client.0.smithi037.stdout:6/1: symlink l0 0 2024-09-19T06:08:28.365 INFO:tasks.workunit.client.0.smithi037.stdout:6/2: write - no filename 2024-09-19T06:08:28.365 INFO:tasks.workunit.client.0.smithi037.stdout:6/3: chown l0 610953 1 2024-09-19T06:08:28.365 INFO:tasks.workunit.client.0.smithi037.stdout:6/4: write - no filename 2024-09-19T06:08:28.365 INFO:tasks.workunit.client.0.smithi037.stdout:6/5: dread - no filename 2024-09-19T06:08:28.365 INFO:tasks.workunit.client.0.smithi037.stdout:6/6: dwrite - no filename 2024-09-19T06:08:28.365 INFO:tasks.workunit.client.0.smithi037.stdout:6/7: truncate - no filename 2024-09-19T06:08:28.366 INFO:tasks.workunit.client.0.smithi037.stdout:6/8: fdatasync - no filename 2024-09-19T06:08:28.366 INFO:tasks.workunit.client.0.smithi037.stdout:6/9: chown l0 2551 1 2024-09-19T06:08:28.366 INFO:tasks.workunit.client.0.smithi037.stdout:5/3: rmdir d0 0 2024-09-19T06:08:28.366 INFO:tasks.workunit.client.0.smithi037.stdout:5/4: dwrite - no filename 2024-09-19T06:08:28.366 INFO:tasks.workunit.client.0.smithi037.stdout:4/4: mkdir d0/d2 0 2024-09-19T06:08:28.367 INFO:tasks.workunit.client.0.smithi037.stdout:3/9: mknod d0/c4 0 2024-09-19T06:08:28.368 INFO:tasks.workunit.client.0.smithi037.stdout:7/1: creat f0 x:0 0 0 2024-09-19T06:08:28.369 INFO:tasks.workunit.client.0.smithi037.stdout:6/10: mkdir d1 0 2024-09-19T06:08:28.369 INFO:tasks.workunit.client.0.smithi037.stdout:6/11: readlink l0 0 2024-09-19T06:08:28.369 INFO:tasks.workunit.client.0.smithi037.stdout:6/12: write - no filename 2024-09-19T06:08:28.369 INFO:tasks.workunit.client.0.smithi037.stdout:6/13: write - no filename 2024-09-19T06:08:28.370 INFO:tasks.workunit.client.0.smithi037.stdout:5/5: symlink l1 0 2024-09-19T06:08:28.370 INFO:tasks.workunit.client.0.smithi037.stdout:5/6: dwrite - no filename 2024-09-19T06:08:28.370 INFO:tasks.workunit.client.0.smithi037.stdout:5/7: dwrite - no filename 2024-09-19T06:08:28.370 INFO:tasks.workunit.client.0.smithi037.stdout:4/5: mknod d0/c3 0 2024-09-19T06:08:28.371 INFO:tasks.workunit.client.0.smithi037.stdout:4/6: chown d0 2826525 1 2024-09-19T06:08:28.371 INFO:tasks.workunit.client.0.smithi037.stdout:4/7: chown d0/d2 1119 1 2024-09-19T06:08:28.371 INFO:tasks.workunit.client.0.smithi037.stdout:4/8: getdents d0/d2 0 2024-09-19T06:08:28.371 INFO:tasks.workunit.client.0.smithi037.stdout:8/0: symlink l0 0 2024-09-19T06:08:28.373 INFO:tasks.workunit.client.0.smithi037.stdout:6/14: rmdir d1 0 2024-09-19T06:08:28.373 INFO:tasks.workunit.client.0.smithi037.stdout:6/15: chown l0 40 1 2024-09-19T06:08:28.373 INFO:tasks.workunit.client.0.smithi037.stdout:6/16: chown l0 925 1 2024-09-19T06:08:28.373 INFO:tasks.workunit.client.0.smithi037.stdout:6/17: read - no filename 2024-09-19T06:08:28.373 INFO:tasks.workunit.client.0.smithi037.stdout:6/18: dread - no filename 2024-09-19T06:08:28.373 INFO:tasks.workunit.client.0.smithi037.stdout:6/19: dwrite - no filename 2024-09-19T06:08:28.374 INFO:tasks.workunit.client.0.smithi037.stdout:5/8: mkdir d2 0 2024-09-19T06:08:28.375 INFO:tasks.workunit.client.0.smithi037.stdout:4/9: creat d0/d2/f4 x:0 0 0 2024-09-19T06:08:28.375 INFO:tasks.workunit.client.0.smithi037.stdout:9/0: mknod c0 0 2024-09-19T06:08:28.375 INFO:tasks.workunit.client.0.smithi037.stdout:9/1: truncate - no filename 2024-09-19T06:08:28.375 INFO:tasks.workunit.client.0.smithi037.stdout:9/2: write - no filename 2024-09-19T06:08:28.376 INFO:tasks.workunit.client.0.smithi037.stdout:9/3: dwrite - no filename 2024-09-19T06:08:28.377 INFO:tasks.workunit.client.0.smithi037.stdout:8/1: mkdir d1 0 2024-09-19T06:08:28.377 INFO:tasks.workunit.client.0.smithi037.stdout:8/2: rename d1 to d1/d2 22 2024-09-19T06:08:28.377 INFO:tasks.workunit.client.0.smithi037.stdout:8/3: dwrite - no filename 2024-09-19T06:08:28.377 INFO:tasks.workunit.client.0.smithi037.stdout:8/4: dwrite - no filename 2024-09-19T06:08:28.378 INFO:tasks.workunit.client.0.smithi037.stdout:6/20: rename l0 to l2 0 2024-09-19T06:08:28.378 INFO:tasks.workunit.client.0.smithi037.stdout:6/21: fsync - no filename 2024-09-19T06:08:28.378 INFO:tasks.workunit.client.0.smithi037.stdout:6/22: dwrite - no filename 2024-09-19T06:08:28.379 INFO:tasks.workunit.client.0.smithi037.stdout:5/9: unlink l1 0 2024-09-19T06:08:28.379 INFO:tasks.workunit.client.0.smithi037.stdout:5/10: truncate - no filename 2024-09-19T06:08:28.379 INFO:tasks.workunit.client.0.smithi037.stdout:5/11: read - no filename 2024-09-19T06:08:28.379 INFO:tasks.workunit.client.0.smithi037.stdout:5/12: getdents d2 0 2024-09-19T06:08:28.379 INFO:tasks.workunit.client.0.smithi037.stdout:5/13: stat d2 0 2024-09-19T06:08:28.380 INFO:tasks.workunit.client.0.smithi037.stdout:5/14: link - no file 2024-09-19T06:08:28.380 INFO:tasks.workunit.client.0.smithi037.stdout:5/15: link - no file 2024-09-19T06:08:28.380 INFO:tasks.workunit.client.0.smithi037.stdout:5/16: chown d2 0 1 2024-09-19T06:08:28.380 INFO:tasks.workunit.client.0.smithi037.stdout:5/17: rename d2 to d2/d3 22 2024-09-19T06:08:28.380 INFO:tasks.workunit.client.0.smithi037.stdout:5/18: fdatasync - no filename 2024-09-19T06:08:28.381 INFO:tasks.workunit.client.0.smithi037.stdout:9/4: rename c0 to c1 0 2024-09-19T06:08:28.389 INFO:tasks.workunit.client.0.smithi037.stdout:8/5: mknod d1/c3 0 2024-09-19T06:08:28.389 INFO:tasks.workunit.client.0.smithi037.stdout:8/6: dwrite - no filename 2024-09-19T06:08:28.389 INFO:tasks.workunit.client.0.smithi037.stdout:8/7: read - no filename 2024-09-19T06:08:28.389 INFO:tasks.workunit.client.0.smithi037.stdout:8/8: dwrite - no filename 2024-09-19T06:08:28.389 INFO:tasks.workunit.client.0.smithi037.stdout:8/9: dread - no filename 2024-09-19T06:08:28.389 INFO:tasks.workunit.client.0.smithi037.stdout:8/10: truncate - no filename 2024-09-19T06:08:28.389 INFO:tasks.workunit.client.0.smithi037.stdout:8/11: dread - no filename 2024-09-19T06:08:28.393 INFO:tasks.workunit.client.0.smithi037.stdout:6/23: creat f3 x:0 0 0 2024-09-19T06:08:28.393 INFO:tasks.workunit.client.0.smithi037.stdout:5/19: mknod d2/c4 0 2024-09-19T06:08:28.393 INFO:tasks.workunit.client.0.smithi037.stdout:5/20: dread - no filename 2024-09-19T06:08:28.393 INFO:tasks.workunit.client.0.smithi037.stdout:5/21: fdatasync - no filename 2024-09-19T06:08:28.393 INFO:tasks.workunit.client.0.smithi037.stdout:5/22: stat d2 0 2024-09-19T06:08:28.393 INFO:tasks.workunit.client.0.smithi037.stdout:5/23: dread - no filename 2024-09-19T06:08:28.393 INFO:tasks.workunit.client.0.smithi037.stdout:5/24: chown d2/c4 85775 1 2024-09-19T06:08:28.393 INFO:tasks.workunit.client.0.smithi037.stdout:5/25: dread - no filename 2024-09-19T06:08:28.395 INFO:tasks.workunit.client.0.smithi037.stdout:8/12: symlink d1/l4 0 2024-09-19T06:08:28.395 INFO:tasks.workunit.client.0.smithi037.stdout:8/13: dwrite - no filename 2024-09-19T06:08:28.395 INFO:tasks.workunit.client.0.smithi037.stdout:8/14: write - no filename 2024-09-19T06:08:28.396 INFO:tasks.workunit.client.0.smithi037.stdout:6/24: stat l2 0 2024-09-19T06:08:28.399 INFO:tasks.workunit.client.0.smithi037.stdout:5/26: creat d2/f5 x:0 0 0 2024-09-19T06:08:28.403 INFO:tasks.workunit.client.0.smithi037.stdout:8/15: rename d1/c3 to d1/c5 0 2024-09-19T06:08:28.403 INFO:tasks.workunit.client.0.smithi037.stdout:8/16: chown d1/c5 2 1 2024-09-19T06:08:28.404 INFO:tasks.workunit.client.0.smithi037.stdout:6/25: rename f3 to f4 0 2024-09-19T06:08:28.405 INFO:tasks.workunit.client.0.smithi037.stdout:6/26: write f4 [483804,110015] 0 2024-09-19T06:08:28.405 INFO:tasks.workunit.client.0.smithi037.stdout:6/27: chown f4 11804000 1 2024-09-19T06:08:28.410 INFO:tasks.workunit.client.0.smithi037.stdout:5/27: mknod d2/c6 0 2024-09-19T06:08:28.411 INFO:tasks.workunit.client.0.smithi037.stdout:8/17: creat d1/f6 x:0 0 0 2024-09-19T06:08:28.415 INFO:tasks.workunit.client.0.smithi037.stdout:8/18: creat d1/f7 x:0 0 0 2024-09-19T06:08:28.415 INFO:tasks.workunit.client.0.smithi037.stdout:8/19: dread - d1/f6 zero size 2024-09-19T06:08:28.415 INFO:tasks.workunit.client.0.smithi037.stdout:8/20: chown d1/c5 277 1 2024-09-19T06:08:28.442 INFO:tasks.workunit.client.0.smithi037.stdout:7/2: fsync f0 0 2024-09-19T06:08:28.464 INFO:tasks.workunit.client.0.smithi037.stdout:7/3: creat f1 x:0 0 0 2024-09-19T06:08:28.464 INFO:tasks.workunit.client.0.smithi037.stdout:7/4: truncate f0 71567 0 2024-09-19T06:08:28.464 INFO:tasks.workunit.client.0.smithi037.stdout:7/5: stat f1 0 2024-09-19T06:08:28.464 INFO:tasks.workunit.client.0.smithi037.stdout:7/6: fdatasync f0 0 2024-09-19T06:08:28.502 INFO:tasks.workunit.client.0.smithi037.stdout:9/5: unlink c1 0 2024-09-19T06:08:28.568 INFO:tasks.workunit.client.0.smithi037.stdout:7/7: rename f1 to f2 0 2024-09-19T06:08:28.568 INFO:tasks.workunit.client.0.smithi037.stdout:7/8: dread - f2 zero size 2024-09-19T06:08:28.749 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:08:28 smithi117 ceph-mon[35050]: pgmap v418: 129 pgs: 129 active+clean; 44 MiB data, 502 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 927 KiB/s wr, 22 op/s 2024-09-19T06:08:28.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:08:28 smithi037 ceph-mon[31211]: pgmap v418: 129 pgs: 129 active+clean; 44 MiB data, 502 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 927 KiB/s wr, 22 op/s 2024-09-19T06:08:28.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:08:28 smithi099 ceph-mon[35300]: pgmap v418: 129 pgs: 129 active+clean; 44 MiB data, 502 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 927 KiB/s wr, 22 op/s 2024-09-19T06:08:28.947 INFO:tasks.workunit.client.0.smithi037.stdout:3/10: dwrite d0/f2 [0,4194304] 0 2024-09-19T06:08:29.155 INFO:tasks.workunit.client.0.smithi037.stdout:5/28: dwrite d2/f5 [0,4194304] 0 2024-09-19T06:08:29.162 INFO:tasks.workunit.client.0.smithi037.stdout:6/28: fsync f4 0 2024-09-19T06:08:29.163 INFO:tasks.workunit.client.0.smithi037.stdout:6/29: write f4 [674828,89127] 0 2024-09-19T06:08:29.373 INFO:tasks.workunit.client.0.smithi037.stdout:4/10: dwrite d0/d2/f4 [0,4194304] 0 2024-09-19T06:08:29.599 INFO:tasks.workunit.client.0.smithi037.stdout:8/21: dwrite d1/f6 [0,4194304] 0 2024-09-19T06:08:29.746 INFO:tasks.workunit.client.0.smithi037.stdout:7/9: dwrite f2 [0,4194304] 0 2024-09-19T06:08:29.784 INFO:tasks.workunit.client.0.smithi037.stdout:7/10: dwrite f2 [0,4194304] 0 2024-09-19T06:08:30.121 INFO:tasks.workunit.client.0.smithi037.stdout:4/11: write d0/d2/f4 [856584,75637] 0 2024-09-19T06:08:30.749 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:08:30 smithi117 ceph-mon[35050]: pgmap v419: 129 pgs: 129 active+clean; 44 MiB data, 502 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 918 KiB/s wr, 21 op/s 2024-09-19T06:08:30.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:08:30 smithi037 ceph-mon[31211]: pgmap v419: 129 pgs: 129 active+clean; 44 MiB data, 502 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 918 KiB/s wr, 21 op/s 2024-09-19T06:08:30.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:08:30 smithi099 ceph-mon[35300]: pgmap v419: 129 pgs: 129 active+clean; 44 MiB data, 502 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 918 KiB/s wr, 21 op/s 2024-09-19T06:08:32.749 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:08:32 smithi117 ceph-mon[35050]: pgmap v420: 129 pgs: 129 active+clean; 54 MiB data, 517 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 63 op/s 2024-09-19T06:08:32.769 INFO:tasks.workunit.client.0.smithi037.stdout:9/6: symlink l2 0 2024-09-19T06:08:32.769 INFO:tasks.workunit.client.0.smithi037.stdout:9/7: fdatasync - no filename 2024-09-19T06:08:32.769 INFO:tasks.workunit.client.0.smithi037.stdout:9/8: chown l2 451 1 2024-09-19T06:08:32.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:08:32 smithi037 ceph-mon[31211]: pgmap v420: 129 pgs: 129 active+clean; 54 MiB data, 517 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 63 op/s 2024-09-19T06:08:32.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:08:32 smithi099 ceph-mon[35300]: pgmap v420: 129 pgs: 129 active+clean; 54 MiB data, 517 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 63 op/s 2024-09-19T06:08:33.776 INFO:tasks.workunit.client.0.smithi037.stdout:3/11: rename d0/c4 to d0/c5 0 2024-09-19T06:08:33.776 INFO:tasks.workunit.client.0.smithi037.stdout:3/12: stat d0 0 2024-09-19T06:08:34.473 INFO:tasks.workunit.client.0.smithi037.stdout:6/30: creat f5 x:0 0 0 2024-09-19T06:08:34.750 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:08:34 smithi117 ceph-mon[35050]: pgmap v421: 129 pgs: 129 active+clean; 119 MiB data, 769 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 7.2 MiB/s wr, 634 op/s 2024-09-19T06:08:34.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:08:34 smithi037 ceph-mon[31211]: pgmap v421: 129 pgs: 129 active+clean; 119 MiB data, 769 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 7.2 MiB/s wr, 634 op/s 2024-09-19T06:08:34.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:08:34 smithi099 ceph-mon[35300]: pgmap v421: 129 pgs: 129 active+clean; 119 MiB data, 769 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 7.2 MiB/s wr, 634 op/s 2024-09-19T06:08:35.559 INFO:tasks.workunit.client.0.smithi037.stdout:5/29: write d2/f5 [4249986,23400] 0 2024-09-19T06:08:35.561 INFO:tasks.workunit.client.0.smithi037.stdout:5/30: fsync d2/f5 0 2024-09-19T06:08:35.662 INFO:tasks.workunit.client.0.smithi037.stdout:8/22: link d1/l4 d1/l8 0 2024-09-19T06:08:35.678 INFO:tasks.workunit.client.0.smithi037.stdout:8/23: dread d1/f6 [0,4194304] 0 2024-09-19T06:08:36.208 INFO:tasks.workunit.client.0.smithi037.stdout:7/11: unlink f0 0 2024-09-19T06:08:36.749 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:08:36 smithi117 ceph-mon[35050]: pgmap v422: 129 pgs: 129 active+clean; 128 MiB data, 823 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 8.1 MiB/s wr, 700 op/s 2024-09-19T06:08:36.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:08:36 smithi037 ceph-mon[31211]: pgmap v422: 129 pgs: 129 active+clean; 128 MiB data, 823 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 8.1 MiB/s wr, 700 op/s 2024-09-19T06:08:36.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:08:36 smithi099 ceph-mon[35300]: pgmap v422: 129 pgs: 129 active+clean; 128 MiB data, 823 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 8.1 MiB/s wr, 700 op/s 2024-09-19T06:08:37.183 INFO:tasks.workunit.client.0.smithi037.stdout:4/12: symlink d0/d2/l5 0 2024-09-19T06:08:37.186 INFO:tasks.workunit.client.0.smithi037.stdout:9/9: symlink l3 0 2024-09-19T06:08:37.186 INFO:tasks.workunit.client.0.smithi037.stdout:9/10: write - no filename 2024-09-19T06:08:37.187 INFO:tasks.workunit.client.0.smithi037.stdout:6/31: symlink l6 0 2024-09-19T06:08:37.189 INFO:tasks.workunit.client.0.smithi037.stdout:5/31: creat d2/f7 x:0 0 0 2024-09-19T06:08:37.191 INFO:tasks.workunit.client.0.smithi037.stdout:7/12: symlink l3 0 2024-09-19T06:08:37.192 INFO:tasks.workunit.client.0.smithi037.stdout:9/11: mkdir d4 0 2024-09-19T06:08:37.194 INFO:tasks.workunit.client.0.smithi037.stdout:7/13: creat f4 x:0 0 0 2024-09-19T06:08:37.196 INFO:tasks.workunit.client.0.smithi037.stdout:9/12: rmdir d4 0 2024-09-19T06:08:37.196 INFO:tasks.workunit.client.0.smithi037.stdout:9/13: dread - no filename 2024-09-19T06:08:37.196 INFO:tasks.workunit.client.0.smithi037.stdout:9/14: write - no filename 2024-09-19T06:08:37.196 INFO:tasks.workunit.client.0.smithi037.stdout:9/15: write - no filename 2024-09-19T06:08:37.196 INFO:tasks.workunit.client.0.smithi037.stdout:9/16: rmdir - no directory 2024-09-19T06:08:37.196 INFO:tasks.workunit.client.0.smithi037.stdout:9/17: dread - no filename 2024-09-19T06:08:37.196 INFO:tasks.workunit.client.0.smithi037.stdout:9/18: rmdir - no directory 2024-09-19T06:08:37.196 INFO:tasks.workunit.client.0.smithi037.stdout:9/19: chown l3 56874480 1 2024-09-19T06:08:37.197 INFO:tasks.workunit.client.0.smithi037.stdout:9/20: mknod c5 0 2024-09-19T06:08:37.197 INFO:tasks.workunit.client.0.smithi037.stdout:9/21: write - no filename 2024-09-19T06:08:37.214 INFO:tasks.workunit.client.0.smithi037.stdout:6/32: dwrite f5 [0,4194304] 0 2024-09-19T06:08:37.216 INFO:tasks.workunit.client.0.smithi037.stdout:6/33: link l6 l7 0 2024-09-19T06:08:37.217 INFO:tasks.workunit.client.0.smithi037.stdout:6/34: creat f8 x:0 0 0 2024-09-19T06:08:37.231 INFO:tasks.workunit.client.0.smithi037.stdout:6/35: write f5 [569140,10359] 0 2024-09-19T06:08:37.232 INFO:tasks.workunit.client.0.smithi037.stdout:6/36: readlink l7 0 2024-09-19T06:08:37.232 INFO:tasks.workunit.client.0.smithi037.stdout:6/37: rmdir - no directory 2024-09-19T06:08:37.253 INFO:tasks.workunit.client.0.smithi037.stdout:6/38: dwrite f8 [0,4194304] 0 2024-09-19T06:08:37.280 INFO:tasks.workunit.client.0.smithi037.stdout:6/39: dwrite f5 [0,4194304] 0 2024-09-19T06:08:37.306 INFO:tasks.workunit.client.0.smithi037.stdout:8/24: rename l0 to d1/l9 0 2024-09-19T06:08:37.307 INFO:tasks.workunit.client.0.smithi037.stdout:8/25: creat d1/fa x:0 0 0 2024-09-19T06:08:37.320 INFO:tasks.workunit.client.0.smithi037.stdout:8/26: write d1/f6 [3287910,52069] 0 2024-09-19T06:08:37.320 INFO:tasks.workunit.client.0.smithi037.stdout:8/27: read - d1/fa zero size 2024-09-19T06:08:37.343 INFO:tasks.workunit.client.0.smithi037.stdout:8/28: dwrite d1/fa [0,4194304] 0 2024-09-19T06:08:37.361 INFO:tasks.workunit.client.0.smithi037.stdout:8/29: dwrite d1/fa [0,4194304] 0 2024-09-19T06:08:37.363 INFO:tasks.workunit.client.0.smithi037.stdout:8/30: fdatasync d1/f6 0 2024-09-19T06:08:37.365 INFO:tasks.workunit.client.0.smithi037.stdout:8/31: mknod d1/cb 0 2024-09-19T06:08:37.365 INFO:tasks.workunit.client.0.smithi037.stdout:8/32: chown d1/cb 2505 1 2024-09-19T06:08:37.366 INFO:tasks.workunit.client.0.smithi037.stdout:8/33: rename d1/cb to d1/cc 0 2024-09-19T06:08:37.388 INFO:tasks.workunit.client.0.smithi037.stdout:8/34: dwrite d1/f6 [0,4194304] 0 2024-09-19T06:08:37.547 INFO:tasks.workunit.client.0.smithi037.stdout:0/1: sync 2024-09-19T06:08:37.547 INFO:tasks.workunit.client.0.smithi037.stdout:2/1: sync 2024-09-19T06:08:37.547 INFO:tasks.workunit.client.0.smithi037.stdout:2/2: rename - no filename 2024-09-19T06:08:37.547 INFO:tasks.workunit.client.0.smithi037.stdout:1/0: sync 2024-09-19T06:08:37.548 INFO:tasks.workunit.client.0.smithi037.stdout:0/2: dwrite - no filename 2024-09-19T06:08:37.548 INFO:tasks.workunit.client.0.smithi037.stdout:0/3: dread - no filename 2024-09-19T06:08:37.548 INFO:tasks.workunit.client.0.smithi037.stdout:0/4: write - no filename 2024-09-19T06:08:37.548 INFO:tasks.workunit.client.0.smithi037.stdout:1/1: dwrite - no filename 2024-09-19T06:08:37.549 INFO:tasks.workunit.client.0.smithi037.stdout:2/3: creat f0 x:0 0 0 2024-09-19T06:08:37.549 INFO:tasks.workunit.client.0.smithi037.stdout:2/4: chown f0 335 1 2024-09-19T06:08:37.549 INFO:tasks.workunit.client.0.smithi037.stdout:0/5: symlink l0 0 2024-09-19T06:08:37.550 INFO:tasks.workunit.client.0.smithi037.stdout:5/32: fsync d2/f7 0 2024-09-19T06:08:37.550 INFO:tasks.workunit.client.0.smithi037.stdout:5/33: stat d2/c4 0 2024-09-19T06:08:37.550 INFO:tasks.workunit.client.0.smithi037.stdout:5/34: rename d2 to d2/d8 22 2024-09-19T06:08:37.550 INFO:tasks.workunit.client.0.smithi037.stdout:0/6: creat f1 x:0 0 0 2024-09-19T06:08:37.550 INFO:tasks.workunit.client.0.smithi037.stdout:0/7: dread - f1 zero size 2024-09-19T06:08:37.551 INFO:tasks.workunit.client.0.smithi037.stdout:5/35: rename d2/c4 to d2/c9 0 2024-09-19T06:08:37.552 INFO:tasks.workunit.client.0.smithi037.stdout:5/36: creat d2/fa x:0 0 0 2024-09-19T06:08:37.553 INFO:tasks.workunit.client.0.smithi037.stdout:3/13: truncate d0/f2 1842220 0 2024-09-19T06:08:37.556 INFO:tasks.workunit.client.0.smithi037.stdout:9/22: getdents . 0 2024-09-19T06:08:37.557 INFO:tasks.workunit.client.0.smithi037.stdout:9/23: symlink l6 0 2024-09-19T06:08:37.558 INFO:tasks.workunit.client.0.smithi037.stdout:9/24: fdatasync - no filename 2024-09-19T06:08:37.558 INFO:tasks.workunit.client.0.smithi037.stdout:9/25: chown l3 1 1 2024-09-19T06:08:37.558 INFO:tasks.workunit.client.0.smithi037.stdout:9/26: dread - no filename 2024-09-19T06:08:37.558 INFO:tasks.workunit.client.0.smithi037.stdout:9/27: rmdir - no directory 2024-09-19T06:08:37.558 INFO:tasks.workunit.client.0.smithi037.stdout:9/28: dwrite - no filename 2024-09-19T06:08:37.558 INFO:tasks.workunit.client.0.smithi037.stdout:9/29: dwrite - no filename 2024-09-19T06:08:37.559 INFO:tasks.workunit.client.0.smithi037.stdout:9/30: mknod c7 0 2024-09-19T06:08:37.559 INFO:tasks.workunit.client.0.smithi037.stdout:9/31: write - no filename 2024-09-19T06:08:37.560 INFO:tasks.workunit.client.0.smithi037.stdout:9/32: dwrite - no filename 2024-09-19T06:08:37.560 INFO:tasks.workunit.client.0.smithi037.stdout:9/33: readlink l6 0 2024-09-19T06:08:37.561 INFO:tasks.workunit.client.0.smithi037.stdout:9/34: symlink l8 0 2024-09-19T06:08:37.565 INFO:tasks.workunit.client.0.smithi037.stdout:9/35: link l6 l9 0 2024-09-19T06:08:37.565 INFO:tasks.workunit.client.0.smithi037.stdout:9/36: dread - no filename 2024-09-19T06:08:37.565 INFO:tasks.workunit.client.0.smithi037.stdout:9/37: rmdir - no directory 2024-09-19T06:08:37.565 INFO:tasks.workunit.client.0.smithi037.stdout:9/38: chown l3 215710 1 2024-09-19T06:08:37.566 INFO:tasks.workunit.client.0.smithi037.stdout:4/13: mkdir d0/d6 0 2024-09-19T06:08:37.567 INFO:tasks.workunit.client.0.smithi037.stdout:4/14: creat d0/d2/f7 x:0 0 0 2024-09-19T06:08:37.569 INFO:tasks.workunit.client.0.smithi037.stdout:5/37: dread d2/f5 [0,4194304] 0 2024-09-19T06:08:37.569 INFO:tasks.workunit.client.0.smithi037.stdout:9/39: mkdir da 0 2024-09-19T06:08:37.569 INFO:tasks.workunit.client.0.smithi037.stdout:9/40: truncate - no filename 2024-09-19T06:08:37.569 INFO:tasks.workunit.client.0.smithi037.stdout:9/41: write - no filename 2024-09-19T06:08:37.569 INFO:tasks.workunit.client.0.smithi037.stdout:9/42: dread - no filename 2024-09-19T06:08:37.570 INFO:tasks.workunit.client.0.smithi037.stdout:5/38: creat d2/fb x:0 0 0 2024-09-19T06:08:37.570 INFO:tasks.workunit.client.0.smithi037.stdout:5/39: readlink - no filename 2024-09-19T06:08:37.570 INFO:tasks.workunit.client.0.smithi037.stdout:5/40: read - d2/fb zero size 2024-09-19T06:08:37.571 INFO:tasks.workunit.client.0.smithi037.stdout:5/41: symlink d2/lc 0 2024-09-19T06:08:37.572 INFO:tasks.workunit.client.0.smithi037.stdout:9/43: link l2 da/lb 0 2024-09-19T06:08:37.574 INFO:tasks.workunit.client.0.smithi037.stdout:0/8: dwrite f1 [0,4194304] 0 2024-09-19T06:08:37.574 INFO:tasks.workunit.client.0.smithi037.stdout:0/9: chown l0 25 1 2024-09-19T06:08:37.574 INFO:tasks.workunit.client.0.smithi037.stdout:5/42: link d2/fb d2/fd 0 2024-09-19T06:08:37.575 INFO:tasks.workunit.client.0.smithi037.stdout:5/43: dread - d2/fb zero size 2024-09-19T06:08:37.576 INFO:tasks.workunit.client.0.smithi037.stdout:9/44: creat da/fc x:0 0 0 2024-09-19T06:08:37.580 INFO:tasks.workunit.client.0.smithi037.stdout:0/10: rename f1 to f2 0 2024-09-19T06:08:37.581 INFO:tasks.workunit.client.0.smithi037.stdout:5/44: mknod d2/ce 0 2024-09-19T06:08:37.582 INFO:tasks.workunit.client.0.smithi037.stdout:9/45: mkdir da/dd 0 2024-09-19T06:08:37.582 INFO:tasks.workunit.client.0.smithi037.stdout:9/46: read - da/fc zero size 2024-09-19T06:08:37.584 INFO:tasks.workunit.client.0.smithi037.stdout:5/45: symlink d2/lf 0 2024-09-19T06:08:37.584 INFO:tasks.workunit.client.0.smithi037.stdout:5/46: fdatasync d2/fd 0 2024-09-19T06:08:37.585 INFO:tasks.workunit.client.0.smithi037.stdout:5/47: mkdir d2/d10 0 2024-09-19T06:08:37.586 INFO:tasks.workunit.client.0.smithi037.stdout:8/35: rename d1/cc to d1/cd 0 2024-09-19T06:08:37.587 INFO:tasks.workunit.client.0.smithi037.stdout:4/15: dwrite d0/d2/f7 [0,4194304] 0 2024-09-19T06:08:37.587 INFO:tasks.workunit.client.0.smithi037.stdout:5/48: unlink d2/lc 0 2024-09-19T06:08:37.588 INFO:tasks.workunit.client.0.smithi037.stdout:2/5: fsync f0 0 2024-09-19T06:08:37.590 INFO:tasks.workunit.client.0.smithi037.stdout:5/49: link d2/lf d2/l11 0 2024-09-19T06:08:37.592 INFO:tasks.workunit.client.0.smithi037.stdout:2/6: mkdir d1 0 2024-09-19T06:08:37.593 INFO:tasks.workunit.client.0.smithi037.stdout:2/7: symlink d1/l2 0 2024-09-19T06:08:37.594 INFO:tasks.workunit.client.0.smithi037.stdout:2/8: creat d1/f3 x:0 0 0 2024-09-19T06:08:37.594 INFO:tasks.workunit.client.0.smithi037.stdout:2/9: truncate f0 849406 0 2024-09-19T06:08:37.599 INFO:tasks.workunit.client.0.smithi037.stdout:0/11: rename f2 to f3 0 2024-09-19T06:08:37.606 INFO:tasks.workunit.client.0.smithi037.stdout:8/36: dread d1/fa [0,4194304] 0 2024-09-19T06:08:37.606 INFO:tasks.workunit.client.0.smithi037.stdout:8/37: fsync d1/fa 0 2024-09-19T06:08:37.606 INFO:tasks.workunit.client.0.smithi037.stdout:8/38: stat d1 0 2024-09-19T06:08:37.606 INFO:tasks.workunit.client.0.smithi037.stdout:8/39: dread - d1/f7 zero size 2024-09-19T06:08:37.609 INFO:tasks.workunit.client.0.smithi037.stdout:3/14: read d0/f2 [381086,92700] 0 2024-09-19T06:08:37.614 INFO:tasks.workunit.client.0.smithi037.stdout:5/50: dwrite d2/fb [0,4194304] 0 2024-09-19T06:08:37.614 INFO:tasks.workunit.client.0.smithi037.stdout:5/51: fsync d2/fb 0 2024-09-19T06:08:37.617 INFO:tasks.workunit.client.0.smithi037.stdout:5/52: mkdir d2/d12 0 2024-09-19T06:08:37.617 INFO:tasks.workunit.client.0.smithi037.stdout:5/53: chown d2/d10 7547 1 2024-09-19T06:08:37.618 INFO:tasks.workunit.client.0.smithi037.stdout:2/10: dwrite f0 [0,4194304] 0 2024-09-19T06:08:37.620 INFO:tasks.workunit.client.0.smithi037.stdout:5/54: write d2/fd [4798784,81975] 0 2024-09-19T06:08:37.620 INFO:tasks.workunit.client.0.smithi037.stdout:2/11: mknod d1/c4 0 2024-09-19T06:08:37.622 INFO:tasks.workunit.client.0.smithi037.stdout:2/12: rename d1/c4 to d1/c5 0 2024-09-19T06:08:37.622 INFO:tasks.workunit.client.0.smithi037.stdout:2/13: chown d1 64 1 2024-09-19T06:08:37.623 INFO:tasks.workunit.client.0.smithi037.stdout:2/14: mkdir d1/d6 0 2024-09-19T06:08:37.623 INFO:tasks.workunit.client.0.smithi037.stdout:8/40: dread d1/fa [0,4194304] 0 2024-09-19T06:08:37.624 INFO:tasks.workunit.client.0.smithi037.stdout:2/15: symlink d1/d6/l7 0 2024-09-19T06:08:37.625 INFO:tasks.workunit.client.0.smithi037.stdout:8/41: mknod d1/ce 0 2024-09-19T06:08:37.625 INFO:tasks.workunit.client.0.smithi037.stdout:2/16: rename d1/d6/l7 to d1/d6/l8 0 2024-09-19T06:08:37.625 INFO:tasks.workunit.client.0.smithi037.stdout:2/17: fsync f0 0 2024-09-19T06:08:37.626 INFO:tasks.workunit.client.0.smithi037.stdout:8/42: stat d1/cd 0 2024-09-19T06:08:37.626 INFO:tasks.workunit.client.0.smithi037.stdout:8/43: chown d1/fa 14 1 2024-09-19T06:08:37.626 INFO:tasks.workunit.client.0.smithi037.stdout:8/44: chown d1/fa 464676 1 2024-09-19T06:08:37.626 INFO:tasks.workunit.client.0.smithi037.stdout:8/45: dread - d1/f7 zero size 2024-09-19T06:08:37.627 INFO:tasks.workunit.client.0.smithi037.stdout:2/18: symlink d1/l9 0 2024-09-19T06:08:37.627 INFO:tasks.workunit.client.0.smithi037.stdout:2/19: readlink d1/d6/l8 0 2024-09-19T06:08:37.627 INFO:tasks.workunit.client.0.smithi037.stdout:2/20: truncate d1/f3 932476 0 2024-09-19T06:08:37.627 INFO:tasks.workunit.client.0.smithi037.stdout:2/21: fdatasync f0 0 2024-09-19T06:08:37.628 INFO:tasks.workunit.client.0.smithi037.stdout:8/46: rename d1/cd to d1/cf 0 2024-09-19T06:08:37.628 INFO:tasks.workunit.client.0.smithi037.stdout:2/22: mkdir d1/da 0 2024-09-19T06:08:37.629 INFO:tasks.workunit.client.0.smithi037.stdout:8/47: creat d1/f10 x:0 0 0 2024-09-19T06:08:37.630 INFO:tasks.workunit.client.0.smithi037.stdout:2/23: creat d1/da/fb x:0 0 0 2024-09-19T06:08:37.630 INFO:tasks.workunit.client.0.smithi037.stdout:2/24: chown d1/c5 522921613 1 2024-09-19T06:08:37.630 INFO:tasks.workunit.client.0.smithi037.stdout:2/25: chown d1/da 670321 1 2024-09-19T06:08:37.630 INFO:tasks.workunit.client.0.smithi037.stdout:8/48: mkdir d1/d11 0 2024-09-19T06:08:37.630 INFO:tasks.workunit.client.0.smithi037.stdout:8/49: dread - d1/f7 zero size 2024-09-19T06:08:37.632 INFO:tasks.workunit.client.0.smithi037.stdout:4/16: dwrite d0/d2/f7 [4194304,4194304] 0 2024-09-19T06:08:37.632 INFO:tasks.workunit.client.0.smithi037.stdout:3/15: dwrite d0/f2 [0,4194304] 0 2024-09-19T06:08:37.634 INFO:tasks.workunit.client.0.smithi037.stdout:5/55: write d2/f5 [1108803,11665] 0 2024-09-19T06:08:37.637 INFO:tasks.workunit.client.0.smithi037.stdout:0/12: read f3 [3822955,71129] 0 2024-09-19T06:08:37.637 INFO:tasks.workunit.client.0.smithi037.stdout:5/56: fdatasync d2/fb 0 2024-09-19T06:08:37.637 INFO:tasks.workunit.client.0.smithi037.stdout:8/50: rename d1/cf to d1/c12 0 2024-09-19T06:08:37.638 INFO:tasks.workunit.client.0.smithi037.stdout:0/13: rename f3 to f4 0 2024-09-19T06:08:37.640 INFO:tasks.workunit.client.0.smithi037.stdout:0/14: mkdir d5 0 2024-09-19T06:08:37.640 INFO:tasks.workunit.client.0.smithi037.stdout:0/15: fdatasync f4 0 2024-09-19T06:08:37.640 INFO:tasks.workunit.client.0.smithi037.stdout:2/26: fsync d1/da/fb 0 2024-09-19T06:08:37.641 INFO:tasks.workunit.client.0.smithi037.stdout:0/16: symlink d5/l6 0 2024-09-19T06:08:37.642 INFO:tasks.workunit.client.0.smithi037.stdout:0/17: write f4 [5003084,3785] 0 2024-09-19T06:08:37.642 INFO:tasks.workunit.client.0.smithi037.stdout:3/16: write d0/f2 [4629641,128516] 0 2024-09-19T06:08:37.645 INFO:tasks.workunit.client.0.smithi037.stdout:8/51: rename d1/c12 to d1/d11/c13 0 2024-09-19T06:08:37.645 INFO:tasks.workunit.client.0.smithi037.stdout:8/52: write d1/f10 [794353,24738] 0 2024-09-19T06:08:37.645 INFO:tasks.workunit.client.0.smithi037.stdout:8/53: readlink d1/l4 0 2024-09-19T06:08:37.647 INFO:tasks.workunit.client.0.smithi037.stdout:0/18: getdents d5 0 2024-09-19T06:08:37.650 INFO:tasks.workunit.client.0.smithi037.stdout:8/54: getdents d1/d11 0 2024-09-19T06:08:37.651 INFO:tasks.workunit.client.0.smithi037.stdout:8/55: creat d1/d11/f14 x:0 0 0 2024-09-19T06:08:37.653 INFO:tasks.workunit.client.0.smithi037.stdout:8/56: creat d1/f15 x:0 0 0 2024-09-19T06:08:37.655 INFO:tasks.workunit.client.0.smithi037.stdout:8/57: creat d1/d11/f16 x:0 0 0 2024-09-19T06:08:37.672 INFO:tasks.workunit.client.0.smithi037.stdout:2/27: dwrite d1/f3 [0,4194304] 0 2024-09-19T06:08:37.672 INFO:tasks.workunit.client.0.smithi037.stdout:2/28: dread - d1/da/fb zero size 2024-09-19T06:08:37.674 INFO:tasks.workunit.client.0.smithi037.stdout:5/57: dwrite d2/fa [0,4194304] 0 2024-09-19T06:08:37.674 INFO:tasks.workunit.client.0.smithi037.stdout:5/58: fdatasync d2/fa 0 2024-09-19T06:08:37.675 INFO:tasks.workunit.client.0.smithi037.stdout:5/59: chown d2/fd 14075 1 2024-09-19T06:08:37.675 INFO:tasks.workunit.client.0.smithi037.stdout:5/60: readlink d2/lf 0 2024-09-19T06:08:37.675 INFO:tasks.workunit.client.0.smithi037.stdout:2/29: mkdir d1/da/dc 0 2024-09-19T06:08:37.677 INFO:tasks.workunit.client.0.smithi037.stdout:5/61: symlink d2/l13 0 2024-09-19T06:08:37.679 INFO:tasks.workunit.client.0.smithi037.stdout:2/30: link f0 d1/fd 0 2024-09-19T06:08:37.680 INFO:tasks.workunit.client.0.smithi037.stdout:4/17: dwrite d0/d2/f7 [0,4194304] 0 2024-09-19T06:08:37.680 INFO:tasks.workunit.client.0.smithi037.stdout:5/62: symlink d2/d10/l14 0 2024-09-19T06:08:37.681 INFO:tasks.workunit.client.0.smithi037.stdout:2/31: creat d1/d6/fe x:0 0 0 2024-09-19T06:08:37.681 INFO:tasks.workunit.client.0.smithi037.stdout:2/32: stat d1/fd 0 2024-09-19T06:08:37.682 INFO:tasks.workunit.client.0.smithi037.stdout:4/18: symlink d0/l8 0 2024-09-19T06:08:37.683 INFO:tasks.workunit.client.0.smithi037.stdout:3/17: dwrite d0/f2 [4194304,4194304] 0 2024-09-19T06:08:37.685 INFO:tasks.workunit.client.0.smithi037.stdout:2/33: mknod d1/d6/cf 0 2024-09-19T06:08:37.685 INFO:tasks.workunit.client.0.smithi037.stdout:2/34: truncate d1/da/fb 817531 0 2024-09-19T06:08:37.687 INFO:tasks.workunit.client.0.smithi037.stdout:8/58: dwrite d1/f7 [0,4194304] 0 2024-09-19T06:08:37.688 INFO:tasks.workunit.client.0.smithi037.stdout:3/18: unlink d0/c3 0 2024-09-19T06:08:37.688 INFO:tasks.workunit.client.0.smithi037.stdout:3/19: fdatasync d0/f2 0 2024-09-19T06:08:37.688 INFO:tasks.workunit.client.0.smithi037.stdout:3/20: chown d0/c5 110202 1 2024-09-19T06:08:37.690 INFO:tasks.workunit.client.0.smithi037.stdout:0/19: dwrite f4 [0,4194304] 0 2024-09-19T06:08:37.691 INFO:tasks.workunit.client.0.smithi037.stdout:8/59: symlink d1/l17 0 2024-09-19T06:08:37.691 INFO:tasks.workunit.client.0.smithi037.stdout:8/60: stat d1/f15 0 2024-09-19T06:08:37.692 INFO:tasks.workunit.client.0.smithi037.stdout:0/20: link f4 d5/f7 0 2024-09-19T06:08:37.693 INFO:tasks.workunit.client.0.smithi037.stdout:5/63: getdents d2 0 2024-09-19T06:08:37.693 INFO:tasks.workunit.client.0.smithi037.stdout:8/61: rmdir d1/d11 39 2024-09-19T06:08:37.695 INFO:tasks.workunit.client.0.smithi037.stdout:8/62: creat d1/f18 x:0 0 0 2024-09-19T06:08:37.696 INFO:tasks.workunit.client.0.smithi037.stdout:8/63: unlink d1/l8 0 2024-09-19T06:08:37.709 INFO:tasks.workunit.client.0.smithi037.stdout:3/21: write d0/f2 [3489776,34475] 0 2024-09-19T06:08:37.710 INFO:tasks.workunit.client.0.smithi037.stdout:3/22: chown d0/c5 61637 1 2024-09-19T06:08:37.710 INFO:tasks.workunit.client.0.smithi037.stdout:3/23: chown d0/c5 41033299 1 2024-09-19T06:08:37.711 INFO:tasks.workunit.client.0.smithi037.stdout:2/35: dread d1/fd [0,4194304] 0 2024-09-19T06:08:37.712 INFO:tasks.workunit.client.0.smithi037.stdout:3/24: mknod d0/c6 0 2024-09-19T06:08:37.712 INFO:tasks.workunit.client.0.smithi037.stdout:2/36: creat d1/da/dc/f10 x:0 0 0 2024-09-19T06:08:37.715 INFO:tasks.workunit.client.0.smithi037.stdout:8/64: write d1/f7 [523896,120004] 0 2024-09-19T06:08:37.715 INFO:tasks.workunit.client.0.smithi037.stdout:8/65: chown d1/d11/f14 2 1 2024-09-19T06:08:37.717 INFO:tasks.workunit.client.0.smithi037.stdout:8/66: link d1/f7 d1/d11/f19 0 2024-09-19T06:08:37.718 INFO:tasks.workunit.client.0.smithi037.stdout:0/21: dwrite f4 [0,4194304] 0 2024-09-19T06:08:37.719 INFO:tasks.workunit.client.0.smithi037.stdout:0/22: fdatasync d5/f7 0 2024-09-19T06:08:37.719 INFO:tasks.workunit.client.0.smithi037.stdout:5/64: dwrite d2/fb [4194304,4194304] 0 2024-09-19T06:08:37.719 INFO:tasks.workunit.client.0.smithi037.stdout:5/65: readlink d2/lf 0 2024-09-19T06:08:37.721 INFO:tasks.workunit.client.0.smithi037.stdout:0/23: mkdir d5/d8 0 2024-09-19T06:08:37.721 INFO:tasks.workunit.client.0.smithi037.stdout:0/24: stat l0 0 2024-09-19T06:08:37.722 INFO:tasks.workunit.client.0.smithi037.stdout:5/66: rename d2/l13 to d2/l15 0 2024-09-19T06:08:37.723 INFO:tasks.workunit.client.0.smithi037.stdout:5/67: rmdir d2 39 2024-09-19T06:08:37.727 INFO:tasks.workunit.client.0.smithi037.stdout:5/68: unlink d2/c6 0 2024-09-19T06:08:37.727 INFO:tasks.workunit.client.0.smithi037.stdout:5/69: fsync d2/fd 0 2024-09-19T06:08:37.727 INFO:tasks.workunit.client.0.smithi037.stdout:5/70: write d2/f5 [440930,110088] 0 2024-09-19T06:08:37.727 INFO:tasks.workunit.client.0.smithi037.stdout:4/19: dwrite d0/d2/f4 [0,4194304] 0 2024-09-19T06:08:37.727 INFO:tasks.workunit.client.0.smithi037.stdout:8/67: getdents d1 0 2024-09-19T06:08:37.729 INFO:tasks.workunit.client.0.smithi037.stdout:4/20: creat d0/d2/f9 x:0 0 0 2024-09-19T06:08:37.729 INFO:tasks.workunit.client.0.smithi037.stdout:4/21: dread - d0/d2/f9 zero size 2024-09-19T06:08:37.729 INFO:tasks.workunit.client.0.smithi037.stdout:3/25: getdents d0 0 2024-09-19T06:08:37.732 INFO:tasks.workunit.client.0.smithi037.stdout:4/22: unlink d0/d2/f9 0 2024-09-19T06:08:37.733 INFO:tasks.workunit.client.0.smithi037.stdout:2/37: dread d1/f3 [0,4194304] 0 2024-09-19T06:08:37.734 INFO:tasks.workunit.client.0.smithi037.stdout:3/26: creat d0/f7 x:0 0 0 2024-09-19T06:08:37.738 INFO:tasks.workunit.client.0.smithi037.stdout:4/23: link d0/l1 d0/la 0 2024-09-19T06:08:37.738 INFO:tasks.workunit.client.0.smithi037.stdout:4/24: stat d0 0 2024-09-19T06:08:37.739 INFO:tasks.workunit.client.0.smithi037.stdout:2/38: mknod d1/d6/c11 0 2024-09-19T06:08:37.740 INFO:tasks.workunit.client.0.smithi037.stdout:8/68: truncate d1/f7 2955914 0 2024-09-19T06:08:37.741 INFO:tasks.workunit.client.0.smithi037.stdout:3/27: chown d0/f2 12133 1 2024-09-19T06:08:37.741 INFO:tasks.workunit.client.0.smithi037.stdout:3/28: write d0/f2 [3103230,125406] 0 2024-09-19T06:08:37.742 INFO:tasks.workunit.client.0.smithi037.stdout:0/25: dread f4 [0,4194304] 0 2024-09-19T06:08:37.742 INFO:tasks.workunit.client.0.smithi037.stdout:4/25: creat d0/d2/fb x:0 0 0 2024-09-19T06:08:37.742 INFO:tasks.workunit.client.0.smithi037.stdout:2/39: truncate d1/f3 4162101 0 2024-09-19T06:08:37.743 INFO:tasks.workunit.client.0.smithi037.stdout:3/29: rmdir d0 39 2024-09-19T06:08:37.745 INFO:tasks.workunit.client.0.smithi037.stdout:4/26: creat d0/d6/fc x:0 0 0 2024-09-19T06:08:37.757 INFO:tasks.workunit.client.0.smithi037.stdout:2/40: read f0 [945099,109890] 0 2024-09-19T06:08:37.757 INFO:tasks.workunit.client.0.smithi037.stdout:2/41: chown d1/fd 3 1 2024-09-19T06:08:37.765 INFO:tasks.workunit.client.0.smithi037.stdout:0/26: dread d5/f7 [0,4194304] 0 2024-09-19T06:08:37.766 INFO:tasks.workunit.client.0.smithi037.stdout:0/27: symlink d5/d8/l9 0 2024-09-19T06:08:37.769 INFO:tasks.workunit.client.0.smithi037.stdout:8/69: dwrite d1/f18 [0,4194304] 0 2024-09-19T06:08:37.771 INFO:tasks.workunit.client.0.smithi037.stdout:8/70: mknod d1/d11/c1a 0 2024-09-19T06:08:37.771 INFO:tasks.workunit.client.0.smithi037.stdout:8/71: fdatasync d1/f15 0 2024-09-19T06:08:37.774 INFO:tasks.workunit.client.0.smithi037.stdout:3/30: dwrite d0/f7 [0,4194304] 0 2024-09-19T06:08:37.776 INFO:tasks.workunit.client.0.smithi037.stdout:3/31: chown d0/c6 256792206 1 2024-09-19T06:08:37.778 INFO:tasks.workunit.client.0.smithi037.stdout:2/42: dread d1/fd [0,4194304] 0 2024-09-19T06:08:37.779 INFO:tasks.workunit.client.0.smithi037.stdout:4/27: dwrite d0/d2/f7 [8388608,4194304] 0 2024-09-19T06:08:37.785 INFO:tasks.workunit.client.0.smithi037.stdout:0/28: dread d5/f7 [0,4194304] 0 2024-09-19T06:08:37.794 INFO:tasks.workunit.client.0.smithi037.stdout:2/43: dread d1/fd [0,4194304] 0 2024-09-19T06:08:37.795 INFO:tasks.workunit.client.0.smithi037.stdout:2/44: rmdir d1/da 39 2024-09-19T06:08:37.795 INFO:tasks.workunit.client.0.smithi037.stdout:2/45: read d1/da/fb [805300,921] 0 2024-09-19T06:08:37.800 INFO:tasks.workunit.client.0.smithi037.stdout:8/72: dwrite d1/f6 [0,4194304] 0 2024-09-19T06:08:37.802 INFO:tasks.workunit.client.0.smithi037.stdout:8/73: symlink d1/d11/l1b 0 2024-09-19T06:08:37.802 INFO:tasks.workunit.client.0.smithi037.stdout:8/74: write d1/d11/f19 [2387609,50884] 0 2024-09-19T06:08:37.802 INFO:tasks.workunit.client.0.smithi037.stdout:8/75: readlink d1/l17 0 2024-09-19T06:08:37.804 INFO:tasks.workunit.client.0.smithi037.stdout:8/76: symlink d1/l1c 0 2024-09-19T06:08:37.804 INFO:tasks.workunit.client.0.smithi037.stdout:0/29: dread f4 [0,4194304] 0 2024-09-19T06:08:37.809 INFO:tasks.workunit.client.0.smithi037.stdout:4/28: dwrite d0/d2/f4 [0,4194304] 0 2024-09-19T06:08:37.809 INFO:tasks.workunit.client.0.smithi037.stdout:4/29: dread - d0/d6/fc zero size 2024-09-19T06:08:37.811 INFO:tasks.workunit.client.0.smithi037.stdout:4/30: mknod d0/cd 0 2024-09-19T06:08:37.811 INFO:tasks.workunit.client.0.smithi037.stdout:4/31: chown d0/d2/f4 1119373 1 2024-09-19T06:08:37.812 INFO:tasks.workunit.client.0.smithi037.stdout:3/32: dwrite d0/f2 [4194304,4194304] 0 2024-09-19T06:08:37.814 INFO:tasks.workunit.client.0.smithi037.stdout:3/33: creat d0/f8 x:0 0 0 2024-09-19T06:08:37.822 INFO:tasks.workunit.client.0.smithi037.stdout:2/46: dwrite d1/fd [0,4194304] 0 2024-09-19T06:08:37.824 INFO:tasks.workunit.client.0.smithi037.stdout:2/47: creat d1/d6/f12 x:0 0 0 2024-09-19T06:08:37.825 INFO:tasks.workunit.client.0.smithi037.stdout:2/48: rmdir d1/da/dc 39 2024-09-19T06:08:37.826 INFO:tasks.workunit.client.0.smithi037.stdout:0/30: dread f4 [0,4194304] 0 2024-09-19T06:08:37.828 INFO:tasks.workunit.client.0.smithi037.stdout:0/31: creat d5/fa x:0 0 0 2024-09-19T06:08:37.828 INFO:tasks.workunit.client.0.smithi037.stdout:8/77: dwrite d1/fa [0,4194304] 0 2024-09-19T06:08:37.829 INFO:tasks.workunit.client.0.smithi037.stdout:8/78: creat d1/f1d x:0 0 0 2024-09-19T06:08:37.831 INFO:tasks.workunit.client.0.smithi037.stdout:8/79: link d1/f15 d1/f1e 0 2024-09-19T06:08:37.832 INFO:tasks.workunit.client.0.smithi037.stdout:8/80: rename d1/fa to d1/f1f 0 2024-09-19T06:08:37.832 INFO:tasks.workunit.client.0.smithi037.stdout:8/81: chown d1/f10 45243179 1 2024-09-19T06:08:37.832 INFO:tasks.workunit.client.0.smithi037.stdout:4/32: dwrite d0/d2/f4 [0,4194304] 0 2024-09-19T06:08:37.835 INFO:tasks.workunit.client.0.smithi037.stdout:4/33: unlink d0/c3 0 2024-09-19T06:08:37.835 INFO:tasks.workunit.client.0.smithi037.stdout:4/34: write d0/d2/fb [858524,121530] 0 2024-09-19T06:08:37.836 INFO:tasks.workunit.client.0.smithi037.stdout:4/35: symlink d0/d2/le 0 2024-09-19T06:08:37.837 INFO:tasks.workunit.client.0.smithi037.stdout:4/36: link d0/la d0/d2/lf 0 2024-09-19T06:08:37.840 INFO:tasks.workunit.client.0.smithi037.stdout:4/37: symlink d0/d6/l10 0 2024-09-19T06:08:37.840 INFO:tasks.workunit.client.0.smithi037.stdout:2/49: write f0 [3940897,109315] 0 2024-09-19T06:08:37.841 INFO:tasks.workunit.client.0.smithi037.stdout:4/38: mknod d0/c11 0 2024-09-19T06:08:37.841 INFO:tasks.workunit.client.0.smithi037.stdout:4/39: chown d0 2425536 1 2024-09-19T06:08:37.842 INFO:tasks.workunit.client.0.smithi037.stdout:4/40: symlink d0/l12 0 2024-09-19T06:08:37.844 INFO:tasks.workunit.client.0.smithi037.stdout:4/41: unlink d0/d6/fc 0 2024-09-19T06:08:37.844 INFO:tasks.workunit.client.0.smithi037.stdout:4/42: stat d0/d2/le 0 2024-09-19T06:08:37.855 INFO:tasks.workunit.client.0.smithi037.stdout:8/82: dread d1/f1f [0,4194304] 0 2024-09-19T06:08:37.855 INFO:tasks.workunit.client.0.smithi037.stdout:8/83: truncate d1/f10 1215224 0 2024-09-19T06:08:37.856 INFO:tasks.workunit.client.0.smithi037.stdout:8/84: creat d1/d11/f20 x:0 0 0 2024-09-19T06:08:37.857 INFO:tasks.workunit.client.0.smithi037.stdout:0/32: dwrite f4 [4194304,4194304] 0 2024-09-19T06:08:37.857 INFO:tasks.workunit.client.0.smithi037.stdout:0/33: fsync f4 0 2024-09-19T06:08:37.876 INFO:tasks.workunit.client.0.smithi037.stdout:0/34: read f4 [7315515,96930] 0 2024-09-19T06:08:37.876 INFO:tasks.workunit.client.0.smithi037.stdout:2/50: dwrite f0 [0,4194304] 0 2024-09-19T06:08:37.876 INFO:tasks.workunit.client.0.smithi037.stdout:8/85: dread d1/f6 [0,4194304] 0 2024-09-19T06:08:37.876 INFO:tasks.workunit.client.0.smithi037.stdout:0/35: creat d5/d8/fb x:0 0 0 2024-09-19T06:08:37.883 INFO:tasks.workunit.client.0.smithi037.stdout:8/86: dread d1/f7 [0,4194304] 0 2024-09-19T06:08:37.884 INFO:tasks.workunit.client.0.smithi037.stdout:8/87: mknod d1/d11/c21 0 2024-09-19T06:08:37.884 INFO:tasks.workunit.client.0.smithi037.stdout:8/88: chown d1/d11/c13 37965 1 2024-09-19T06:08:37.885 INFO:tasks.workunit.client.0.smithi037.stdout:8/89: dread - d1/f1d zero size 2024-09-19T06:08:37.888 INFO:tasks.workunit.client.0.smithi037.stdout:2/51: write f0 [3049393,11851] 0 2024-09-19T06:08:37.890 INFO:tasks.workunit.client.0.smithi037.stdout:2/52: truncate d1/f3 658652 0 2024-09-19T06:08:37.897 INFO:tasks.workunit.client.0.smithi037.stdout:8/90: dread d1/f1f [0,4194304] 0 2024-09-19T06:08:37.907 INFO:tasks.workunit.client.0.smithi037.stdout:8/91: dread d1/f6 [0,4194304] 0 2024-09-19T06:08:37.907 INFO:tasks.workunit.client.0.smithi037.stdout:8/92: chown d1/d11/c13 191069163 1 2024-09-19T06:08:37.909 INFO:tasks.workunit.client.0.smithi037.stdout:8/93: rename d1/f1d to d1/d11/f22 0 2024-09-19T06:08:37.910 INFO:tasks.workunit.client.0.smithi037.stdout:8/94: creat d1/d11/f23 x:0 0 0 2024-09-19T06:08:37.910 INFO:tasks.workunit.client.0.smithi037.stdout:8/95: dread - d1/f15 zero size 2024-09-19T06:08:37.911 INFO:tasks.workunit.client.0.smithi037.stdout:8/96: creat d1/f24 x:0 0 0 2024-09-19T06:08:37.911 INFO:tasks.workunit.client.0.smithi037.stdout:8/97: chown d1/f1f 37372 1 2024-09-19T06:08:37.932 INFO:tasks.workunit.client.0.smithi037.stdout:8/98: dwrite d1/d11/f20 [0,4194304] 0 2024-09-19T06:08:37.936 INFO:tasks.workunit.client.0.smithi037.stdout:8/99: dread d1/f10 [0,4194304] 0 2024-09-19T06:08:37.936 INFO:tasks.workunit.client.0.smithi037.stdout:8/100: write d1/d11/f19 [1432501,48856] 0 2024-09-19T06:08:37.937 INFO:tasks.workunit.client.0.smithi037.stdout:8/101: rename d1/ce to d1/d11/c25 0 2024-09-19T06:08:37.954 INFO:tasks.workunit.client.0.smithi037.stdout:8/102: dwrite d1/d11/f22 [0,4194304] 0 2024-09-19T06:08:37.956 INFO:tasks.workunit.client.0.smithi037.stdout:8/103: creat d1/d11/f26 x:0 0 0 2024-09-19T06:08:37.957 INFO:tasks.workunit.client.0.smithi037.stdout:8/104: chown d1/d11/f16 1297291 1 2024-09-19T06:08:37.957 INFO:tasks.workunit.client.0.smithi037.stdout:8/105: creat d1/d11/f27 x:0 0 0 2024-09-19T06:08:37.958 INFO:tasks.workunit.client.0.smithi037.stdout:8/106: rename d1/c5 to d1/c28 0 2024-09-19T06:08:37.975 INFO:tasks.workunit.client.0.smithi037.stdout:8/107: dwrite d1/f18 [4194304,4194304] 0 2024-09-19T06:08:37.975 INFO:tasks.workunit.client.0.smithi037.stdout:8/108: chown d1/f7 223368494 1 2024-09-19T06:08:37.975 INFO:tasks.workunit.client.0.smithi037.stdout:8/109: fdatasync d1/d11/f20 0 2024-09-19T06:08:37.976 INFO:tasks.workunit.client.0.smithi037.stdout:8/110: creat d1/d11/f29 x:0 0 0 2024-09-19T06:08:38.749 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:08:38 smithi117 ceph-mon[35050]: pgmap v423: 129 pgs: 129 active+clean; 140 MiB data, 850 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 9.0 MiB/s wr, 701 op/s 2024-09-19T06:08:38.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:08:38 smithi037 ceph-mon[31211]: pgmap v423: 129 pgs: 129 active+clean; 140 MiB data, 850 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 9.0 MiB/s wr, 701 op/s 2024-09-19T06:08:38.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:08:38 smithi099 ceph-mon[35300]: pgmap v423: 129 pgs: 129 active+clean; 140 MiB data, 850 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 9.0 MiB/s wr, 701 op/s 2024-09-19T06:08:39.653 INFO:tasks.workunit.client.0.smithi037.stdout:4/43: sync 2024-09-19T06:08:39.653 INFO:tasks.workunit.client.0.smithi037.stdout:0/36: sync 2024-09-19T06:08:39.653 INFO:tasks.workunit.client.0.smithi037.stdout:2/53: sync 2024-09-19T06:08:39.654 INFO:tasks.workunit.client.0.smithi037.stdout:9/47: sync 2024-09-19T06:08:39.654 INFO:tasks.workunit.client.0.smithi037.stdout:3/34: sync 2024-09-19T06:08:39.654 INFO:tasks.workunit.client.0.smithi037.stdout:1/2: sync 2024-09-19T06:08:39.654 INFO:tasks.workunit.client.0.smithi037.stdout:1/3: write - no filename 2024-09-19T06:08:39.654 INFO:tasks.workunit.client.0.smithi037.stdout:1/4: read - no filename 2024-09-19T06:08:39.654 INFO:tasks.workunit.client.0.smithi037.stdout:1/5: unlink - no file 2024-09-19T06:08:39.654 INFO:tasks.workunit.client.0.smithi037.stdout:1/6: dwrite - no filename 2024-09-19T06:08:39.654 INFO:tasks.workunit.client.0.smithi037.stdout:5/71: sync 2024-09-19T06:08:39.654 INFO:tasks.workunit.client.0.smithi037.stdout:6/40: sync 2024-09-19T06:08:39.654 INFO:tasks.workunit.client.0.smithi037.stdout:8/111: sync 2024-09-19T06:08:39.654 INFO:tasks.workunit.client.0.smithi037.stdout:7/14: sync 2024-09-19T06:08:39.655 INFO:tasks.workunit.client.0.smithi037.stdout:4/44: symlink d0/d2/l13 0 2024-09-19T06:08:39.655 INFO:tasks.workunit.client.0.smithi037.stdout:2/54: mknod d1/d6/c13 0 2024-09-19T06:08:39.656 INFO:tasks.workunit.client.0.smithi037.stdout:9/48: creat da/fe x:0 0 0 2024-09-19T06:08:39.657 INFO:tasks.workunit.client.0.smithi037.stdout:5/72: creat d2/d12/f16 x:0 0 0 2024-09-19T06:08:39.657 INFO:tasks.workunit.client.0.smithi037.stdout:5/73: fsync d2/fd 0 2024-09-19T06:08:39.657 INFO:tasks.workunit.client.0.smithi037.stdout:5/74: fsync d2/fd 0 2024-09-19T06:08:39.658 INFO:tasks.workunit.client.0.smithi037.stdout:6/41: mkdir d9 0 2024-09-19T06:08:39.658 INFO:tasks.workunit.client.0.smithi037.stdout:6/42: fdatasync f4 0 2024-09-19T06:08:39.659 INFO:tasks.workunit.client.0.smithi037.stdout:1/7: creat f0 x:0 0 0 2024-09-19T06:08:39.659 INFO:tasks.workunit.client.0.smithi037.stdout:8/112: creat d1/f2a x:0 0 0 2024-09-19T06:08:39.660 INFO:tasks.workunit.client.0.smithi037.stdout:4/45: link d0/l12 d0/l14 0 2024-09-19T06:08:39.661 INFO:tasks.workunit.client.0.smithi037.stdout:2/55: creat d1/da/f14 x:0 0 0 2024-09-19T06:08:39.662 INFO:tasks.workunit.client.0.smithi037.stdout:3/35: rename d0/f8 to d0/f9 0 2024-09-19T06:08:39.663 INFO:tasks.workunit.client.0.smithi037.stdout:9/49: mknod da/dd/cf 0 2024-09-19T06:08:39.663 INFO:tasks.workunit.client.0.smithi037.stdout:9/50: dread - da/fe zero size 2024-09-19T06:08:39.663 INFO:tasks.workunit.client.0.smithi037.stdout:5/75: creat d2/d12/f17 x:0 0 0 2024-09-19T06:08:39.665 INFO:tasks.workunit.client.0.smithi037.stdout:1/8: creat f1 x:0 0 0 2024-09-19T06:08:39.665 INFO:tasks.workunit.client.0.smithi037.stdout:1/9: fdatasync f0 0 2024-09-19T06:08:39.666 INFO:tasks.workunit.client.0.smithi037.stdout:5/76: mknod d2/c18 0 2024-09-19T06:08:39.667 INFO:tasks.workunit.client.0.smithi037.stdout:3/36: symlink d0/la 0 2024-09-19T06:08:39.668 INFO:tasks.workunit.client.0.smithi037.stdout:5/77: rename d2/f5 to d2/d10/f19 0 2024-09-19T06:08:39.676 INFO:tasks.workunit.client.0.smithi037.stdout:9/51: getdents da 0 2024-09-19T06:08:39.677 INFO:tasks.workunit.client.0.smithi037.stdout:9/52: rmdir da 39 2024-09-19T06:08:39.678 INFO:tasks.workunit.client.0.smithi037.stdout:7/15: dwrite f2 [4194304,4194304] 0 2024-09-19T06:08:39.678 INFO:tasks.workunit.client.0.smithi037.stdout:7/16: readlink l3 0 2024-09-19T06:08:39.678 INFO:tasks.workunit.client.0.smithi037.stdout:9/53: mknod da/c10 0 2024-09-19T06:08:39.679 INFO:tasks.workunit.client.0.smithi037.stdout:4/46: write d0/d2/f7 [2959895,112076] 0 2024-09-19T06:08:39.680 INFO:tasks.workunit.client.0.smithi037.stdout:9/54: creat da/dd/f11 x:0 0 0 2024-09-19T06:08:39.681 INFO:tasks.workunit.client.0.smithi037.stdout:9/55: write da/fc [781021,108374] 0 2024-09-19T06:08:39.681 INFO:tasks.workunit.client.0.smithi037.stdout:6/43: dread f8 [0,4194304] 0 2024-09-19T06:08:39.682 INFO:tasks.workunit.client.0.smithi037.stdout:4/47: creat d0/d6/f15 x:0 0 0 2024-09-19T06:08:39.685 INFO:tasks.workunit.client.0.smithi037.stdout:9/56: creat da/dd/f12 x:0 0 0 2024-09-19T06:08:39.685 INFO:tasks.workunit.client.0.smithi037.stdout:9/57: dread - da/fe zero size 2024-09-19T06:08:39.688 INFO:tasks.workunit.client.0.smithi037.stdout:4/48: rename d0/d6/f15 to d0/f16 0 2024-09-19T06:08:39.688 INFO:tasks.workunit.client.0.smithi037.stdout:4/49: dread - d0/f16 zero size 2024-09-19T06:08:39.689 INFO:tasks.workunit.client.0.smithi037.stdout:9/58: creat da/f13 x:0 0 0 2024-09-19T06:08:39.690 INFO:tasks.workunit.client.0.smithi037.stdout:8/113: dread d1/f6 [0,4194304] 0 2024-09-19T06:08:39.690 INFO:tasks.workunit.client.0.smithi037.stdout:2/56: dwrite d1/da/f14 [0,4194304] 0 2024-09-19T06:08:39.691 INFO:tasks.workunit.client.0.smithi037.stdout:2/57: dread - d1/d6/f12 zero size 2024-09-19T06:08:39.691 INFO:tasks.workunit.client.0.smithi037.stdout:9/59: mknod da/dd/c14 0 2024-09-19T06:08:39.693 INFO:tasks.workunit.client.0.smithi037.stdout:8/114: symlink d1/d11/l2b 0 2024-09-19T06:08:39.693 INFO:tasks.workunit.client.0.smithi037.stdout:1/10: dwrite f0 [0,4194304] 0 2024-09-19T06:08:39.695 INFO:tasks.workunit.client.0.smithi037.stdout:3/37: getdents d0 0 2024-09-19T06:08:39.696 INFO:tasks.workunit.client.0.smithi037.stdout:2/58: creat d1/da/dc/f15 x:0 0 0 2024-09-19T06:08:39.696 INFO:tasks.workunit.client.0.smithi037.stdout:2/59: dread - d1/d6/fe zero size 2024-09-19T06:08:39.698 INFO:tasks.workunit.client.0.smithi037.stdout:9/60: mkdir da/d15 0 2024-09-19T06:08:39.699 INFO:tasks.workunit.client.0.smithi037.stdout:8/115: creat d1/d11/f2c x:0 0 0 2024-09-19T06:08:39.700 INFO:tasks.workunit.client.0.smithi037.stdout:5/78: dwrite d2/d12/f16 [0,4194304] 0 2024-09-19T06:08:39.702 INFO:tasks.workunit.client.0.smithi037.stdout:1/11: getdents . 0 2024-09-19T06:08:39.703 INFO:tasks.workunit.client.0.smithi037.stdout:2/60: mkdir d1/d16 0 2024-09-19T06:08:39.704 INFO:tasks.workunit.client.0.smithi037.stdout:9/61: stat l9 0 2024-09-19T06:08:39.704 INFO:tasks.workunit.client.0.smithi037.stdout:9/62: chown da/dd/f11 388 1 2024-09-19T06:08:39.704 INFO:tasks.workunit.client.0.smithi037.stdout:9/63: read - da/fe zero size 2024-09-19T06:08:39.704 INFO:tasks.workunit.client.0.smithi037.stdout:9/64: dread - da/f13 zero size 2024-09-19T06:08:39.706 INFO:tasks.workunit.client.0.smithi037.stdout:8/116: link d1/d11/f14 d1/f2d 0 2024-09-19T06:08:39.706 INFO:tasks.workunit.client.0.smithi037.stdout:8/117: chown d1/d11/f27 133 1 2024-09-19T06:08:39.706 INFO:tasks.workunit.client.0.smithi037.stdout:8/118: truncate d1/d11/f29 782002 0 2024-09-19T06:08:39.709 INFO:tasks.workunit.client.0.smithi037.stdout:5/79: mkdir d2/d12/d1a 0 2024-09-19T06:08:39.710 INFO:tasks.workunit.client.0.smithi037.stdout:1/12: mkdir d2 0 2024-09-19T06:08:39.711 INFO:tasks.workunit.client.0.smithi037.stdout:2/61: rename d1/l2 to d1/da/dc/l17 0 2024-09-19T06:08:39.711 INFO:tasks.workunit.client.0.smithi037.stdout:2/62: readlink d1/l9 0 2024-09-19T06:08:39.712 INFO:tasks.workunit.client.0.smithi037.stdout:9/65: rmdir da/dd 39 2024-09-19T06:08:39.713 INFO:tasks.workunit.client.0.smithi037.stdout:8/119: creat d1/d11/f2e x:0 0 0 2024-09-19T06:08:39.713 INFO:tasks.workunit.client.0.smithi037.stdout:8/120: stat d1/f15 0 2024-09-19T06:08:39.714 INFO:tasks.workunit.client.0.smithi037.stdout:1/13: creat d2/f3 x:0 0 0 2024-09-19T06:08:39.715 INFO:tasks.workunit.client.0.smithi037.stdout:2/63: creat d1/da/dc/f18 x:0 0 0 2024-09-19T06:08:39.716 INFO:tasks.workunit.client.0.smithi037.stdout:8/121: creat d1/d11/f2f x:0 0 0 2024-09-19T06:08:39.718 INFO:tasks.workunit.client.0.smithi037.stdout:1/14: rename f0 to d2/f4 0 2024-09-19T06:08:39.719 INFO:tasks.workunit.client.0.smithi037.stdout:1/15: mknod d2/c5 0 2024-09-19T06:08:39.721 INFO:tasks.workunit.client.0.smithi037.stdout:3/38: dread d0/f2 [4194304,4194304] 0 2024-09-19T06:08:39.725 INFO:tasks.workunit.client.0.smithi037.stdout:6/44: dwrite f4 [0,4194304] 0 2024-09-19T06:08:39.726 INFO:tasks.workunit.client.0.smithi037.stdout:4/50: dwrite d0/d2/f7 [8388608,4194304] 0 2024-09-19T06:08:39.730 INFO:tasks.workunit.client.0.smithi037.stdout:8/122: dread d1/f7 [0,4194304] 0 2024-09-19T06:08:39.730 INFO:tasks.workunit.client.0.smithi037.stdout:4/51: mknod d0/c17 0 2024-09-19T06:08:39.733 INFO:tasks.workunit.client.0.smithi037.stdout:2/64: dread d1/da/f14 [0,4194304] 0 2024-09-19T06:08:39.735 INFO:tasks.workunit.client.0.smithi037.stdout:8/123: mknod d1/c30 0 2024-09-19T06:08:39.735 INFO:tasks.workunit.client.0.smithi037.stdout:8/124: write d1/d11/f14 [304436,70680] 0 2024-09-19T06:08:39.735 INFO:tasks.workunit.client.0.smithi037.stdout:2/65: dread d1/da/fb [0,4194304] 0 2024-09-19T06:08:39.737 INFO:tasks.workunit.client.0.smithi037.stdout:2/66: creat d1/da/f19 x:0 0 0 2024-09-19T06:08:39.737 INFO:tasks.workunit.client.0.smithi037.stdout:2/67: fsync d1/f3 0 2024-09-19T06:08:39.737 INFO:tasks.workunit.client.0.smithi037.stdout:5/80: write d2/fa [845584,48112] 0 2024-09-19T06:08:39.738 INFO:tasks.workunit.client.0.smithi037.stdout:2/68: symlink d1/d16/l1a 0 2024-09-19T06:08:39.739 INFO:tasks.workunit.client.0.smithi037.stdout:6/45: dread f8 [0,4194304] 0 2024-09-19T06:08:39.740 INFO:tasks.workunit.client.0.smithi037.stdout:5/81: rename d2/ce to d2/d12/d1a/c1b 0 2024-09-19T06:08:39.740 INFO:tasks.workunit.client.0.smithi037.stdout:5/82: chown d2/lf 58 1 2024-09-19T06:08:39.742 INFO:tasks.workunit.client.0.smithi037.stdout:2/69: creat d1/da/f1b x:0 0 0 2024-09-19T06:08:39.743 INFO:tasks.workunit.client.0.smithi037.stdout:5/83: getdents d2/d12 0 2024-09-19T06:08:39.749 INFO:tasks.workunit.client.0.smithi037.stdout:4/52: dread d0/d2/f7 [8388608,4194304] 0 2024-09-19T06:08:39.751 INFO:tasks.workunit.client.0.smithi037.stdout:8/125: write d1/d11/f22 [1112090,93762] 0 2024-09-19T06:08:39.751 INFO:tasks.workunit.client.0.smithi037.stdout:8/126: write d1/d11/f23 [725185,69678] 0 2024-09-19T06:08:39.751 INFO:tasks.workunit.client.0.smithi037.stdout:8/127: write d1/f2a [939189,45275] 0 2024-09-19T06:08:39.752 INFO:tasks.workunit.client.0.smithi037.stdout:8/128: rename d1 to d1/d31 22 2024-09-19T06:08:39.753 INFO:tasks.workunit.client.0.smithi037.stdout:8/129: creat d1/f32 x:0 0 0 2024-09-19T06:08:39.754 INFO:tasks.workunit.client.0.smithi037.stdout:1/16: write d2/f4 [3391701,55107] 0 2024-09-19T06:08:39.754 INFO:tasks.workunit.client.0.smithi037.stdout:8/130: stat d1/l4 0 2024-09-19T06:08:39.754 INFO:tasks.workunit.client.0.smithi037.stdout:8/131: write d1/f24 [824010,63260] 0 2024-09-19T06:08:39.754 INFO:tasks.workunit.client.0.smithi037.stdout:8/132: readlink d1/l4 0 2024-09-19T06:08:39.754 INFO:tasks.workunit.client.0.smithi037.stdout:8/133: truncate d1/d11/f29 1183325 0 2024-09-19T06:08:39.754 INFO:tasks.workunit.client.0.smithi037.stdout:8/134: chown d1/f24 64100 1 2024-09-19T06:08:39.754 INFO:tasks.workunit.client.0.smithi037.stdout:8/135: readlink d1/d11/l2b 0 2024-09-19T06:08:39.755 INFO:tasks.workunit.client.0.smithi037.stdout:2/70: dread f0 [0,4194304] 0 2024-09-19T06:08:39.756 INFO:tasks.workunit.client.0.smithi037.stdout:1/17: creat d2/f6 x:0 0 0 2024-09-19T06:08:39.756 INFO:tasks.workunit.client.0.smithi037.stdout:1/18: symlink d2/l7 0 2024-09-19T06:08:39.757 INFO:tasks.workunit.client.0.smithi037.stdout:5/84: unlink d2/d12/d1a/c1b 0 2024-09-19T06:08:39.758 INFO:tasks.workunit.client.0.smithi037.stdout:1/19: creat d2/f8 x:0 0 0 2024-09-19T06:08:39.758 INFO:tasks.workunit.client.0.smithi037.stdout:8/136: fdatasync d1/d11/f22 0 2024-09-19T06:08:39.758 INFO:tasks.workunit.client.0.smithi037.stdout:8/137: chown d1/d11/f29 54 1 2024-09-19T06:08:39.758 INFO:tasks.workunit.client.0.smithi037.stdout:8/138: dread - d1/f1e zero size 2024-09-19T06:08:39.758 INFO:tasks.workunit.client.0.smithi037.stdout:2/71: write d1/f3 [297140,15015] 0 2024-09-19T06:08:39.759 INFO:tasks.workunit.client.0.smithi037.stdout:2/72: chown d1/d16 30871088 1 2024-09-19T06:08:39.759 INFO:tasks.workunit.client.0.smithi037.stdout:5/85: link d2/d12/f17 d2/d12/f1c 0 2024-09-19T06:08:39.761 INFO:tasks.workunit.client.0.smithi037.stdout:8/139: mknod d1/c33 0 2024-09-19T06:08:39.761 INFO:tasks.workunit.client.0.smithi037.stdout:2/73: creat d1/d16/f1c x:0 0 0 2024-09-19T06:08:39.762 INFO:tasks.workunit.client.0.smithi037.stdout:5/86: symlink d2/d12/d1a/l1d 0 2024-09-19T06:08:39.763 INFO:tasks.workunit.client.0.smithi037.stdout:2/74: symlink d1/d16/l1d 0 2024-09-19T06:08:39.766 INFO:tasks.workunit.client.0.smithi037.stdout:2/75: creat d1/f1e x:0 0 0 2024-09-19T06:08:39.778 INFO:tasks.workunit.client.0.smithi037.stdout:4/53: dwrite d0/d2/f7 [0,4194304] 0 2024-09-19T06:08:39.781 INFO:tasks.workunit.client.0.smithi037.stdout:6/46: dread f4 [0,4194304] 0 2024-09-19T06:08:39.781 INFO:tasks.workunit.client.0.smithi037.stdout:4/54: getdents d0 0 2024-09-19T06:08:39.781 INFO:tasks.workunit.client.0.smithi037.stdout:9/66: dwrite da/fc [0,4194304] 0 2024-09-19T06:08:39.781 INFO:tasks.workunit.client.0.smithi037.stdout:9/67: write da/fe [118170,108169] 0 2024-09-19T06:08:39.781 INFO:tasks.workunit.client.0.smithi037.stdout:9/68: write da/dd/f11 [53752,129090] 0 2024-09-19T06:08:39.781 INFO:tasks.workunit.client.0.smithi037.stdout:9/69: chown l2 50320800 1 2024-09-19T06:08:39.784 INFO:tasks.workunit.client.0.smithi037.stdout:4/55: symlink d0/d6/l18 0 2024-09-19T06:08:39.784 INFO:tasks.workunit.client.0.smithi037.stdout:4/56: write d0/f16 [409825,129328] 0 2024-09-19T06:08:39.785 INFO:tasks.workunit.client.0.smithi037.stdout:8/140: dwrite d1/d11/f29 [0,4194304] 0 2024-09-19T06:08:39.793 INFO:tasks.workunit.client.0.smithi037.stdout:9/70: dread da/dd/f11 [0,4194304] 0 2024-09-19T06:08:39.793 INFO:tasks.workunit.client.0.smithi037.stdout:4/57: creat d0/d2/f19 x:0 0 0 2024-09-19T06:08:39.797 INFO:tasks.workunit.client.0.smithi037.stdout:6/47: dread f8 [0,4194304] 0 2024-09-19T06:08:39.797 INFO:tasks.workunit.client.0.smithi037.stdout:2/76: dwrite d1/d6/fe [0,4194304] 0 2024-09-19T06:08:39.797 INFO:tasks.workunit.client.0.smithi037.stdout:2/77: chown d1/d16/l1d 14855776 1 2024-09-19T06:08:39.797 INFO:tasks.workunit.client.0.smithi037.stdout:2/78: write d1/d6/f12 [554675,46863] 0 2024-09-19T06:08:39.797 INFO:tasks.workunit.client.0.smithi037.stdout:2/79: readlink d1/d16/l1d 0 2024-09-19T06:08:39.798 INFO:tasks.workunit.client.0.smithi037.stdout:9/71: unlink da/dd/f11 0 2024-09-19T06:08:39.798 INFO:tasks.workunit.client.0.smithi037.stdout:9/72: dread - da/f13 zero size 2024-09-19T06:08:39.799 INFO:tasks.workunit.client.0.smithi037.stdout:4/58: creat d0/d2/f1a x:0 0 0 2024-09-19T06:08:39.799 INFO:tasks.workunit.client.0.smithi037.stdout:4/59: readlink d0/d2/l13 0 2024-09-19T06:08:39.799 INFO:tasks.workunit.client.0.smithi037.stdout:5/87: dwrite d2/d10/f19 [0,4194304] 0 2024-09-19T06:08:39.802 INFO:tasks.workunit.client.0.smithi037.stdout:6/48: rename l7 to d9/la 0 2024-09-19T06:08:39.803 INFO:tasks.workunit.client.0.smithi037.stdout:9/73: rmdir da/d15 0 2024-09-19T06:08:39.804 INFO:tasks.workunit.client.0.smithi037.stdout:4/60: mkdir d0/d6/d1b 0 2024-09-19T06:08:39.805 INFO:tasks.workunit.client.0.smithi037.stdout:9/74: write da/fc [5033017,42403] 0 2024-09-19T06:08:39.805 INFO:tasks.workunit.client.0.smithi037.stdout:9/75: chown l3 1 1 2024-09-19T06:08:39.805 INFO:tasks.workunit.client.0.smithi037.stdout:9/76: stat l2 0 2024-09-19T06:08:39.806 INFO:tasks.workunit.client.0.smithi037.stdout:9/77: rename da/c10 to da/dd/c16 0 2024-09-19T06:08:39.812 INFO:tasks.workunit.client.0.smithi037.stdout:0/37: sync 2024-09-19T06:08:39.812 INFO:tasks.workunit.client.0.smithi037.stdout:0/38: truncate d5/fa 550359 0 2024-09-19T06:08:39.812 INFO:tasks.workunit.client.0.smithi037.stdout:0/39: write d5/d8/fb [393921,25969] 0 2024-09-19T06:08:39.813 INFO:tasks.workunit.client.0.smithi037.stdout:0/40: write f4 [9014049,61815] 0 2024-09-19T06:08:39.813 INFO:tasks.workunit.client.0.smithi037.stdout:2/80: dread d1/fd [0,4194304] 0 2024-09-19T06:08:39.813 INFO:tasks.workunit.client.0.smithi037.stdout:2/81: creat d1/da/f1f x:0 0 0 2024-09-19T06:08:39.828 INFO:tasks.workunit.client.0.smithi037.stdout:9/78: dread da/fc [0,4194304] 0 2024-09-19T06:08:39.828 INFO:tasks.workunit.client.0.smithi037.stdout:9/79: fdatasync da/fc 0 2024-09-19T06:08:39.830 INFO:tasks.workunit.client.0.smithi037.stdout:6/49: dwrite f5 [0,4194304] 0 2024-09-19T06:08:39.837 INFO:tasks.workunit.client.0.smithi037.stdout:2/82: dwrite d1/d6/fe [0,4194304] 0 2024-09-19T06:08:39.837 INFO:tasks.workunit.client.0.smithi037.stdout:0/41: dread d5/d8/fb [0,4194304] 0 2024-09-19T06:08:39.837 INFO:tasks.workunit.client.0.smithi037.stdout:2/83: chown d1/da/f1f 4527033 1 2024-09-19T06:08:39.838 INFO:tasks.workunit.client.0.smithi037.stdout:0/42: mkdir d5/dc 0 2024-09-19T06:08:39.838 INFO:tasks.workunit.client.0.smithi037.stdout:0/43: chown d5 0 1 2024-09-19T06:08:39.838 INFO:tasks.workunit.client.0.smithi037.stdout:2/84: mknod d1/da/c20 0 2024-09-19T06:08:39.839 INFO:tasks.workunit.client.0.smithi037.stdout:0/44: dread d5/fa [0,4194304] 0 2024-09-19T06:08:39.840 INFO:tasks.workunit.client.0.smithi037.stdout:2/85: mkdir d1/da/dc/d21 0 2024-09-19T06:08:39.841 INFO:tasks.workunit.client.0.smithi037.stdout:0/45: creat d5/fd x:0 0 0 2024-09-19T06:08:39.841 INFO:tasks.workunit.client.0.smithi037.stdout:0/46: chown d5/d8/fb 647 1 2024-09-19T06:08:39.841 INFO:tasks.workunit.client.0.smithi037.stdout:0/47: chown d5/f7 104919180 1 2024-09-19T06:08:39.841 INFO:tasks.workunit.client.0.smithi037.stdout:0/48: stat d5/f7 0 2024-09-19T06:08:39.842 INFO:tasks.workunit.client.0.smithi037.stdout:2/86: getdents d1/d16 0 2024-09-19T06:08:39.842 INFO:tasks.workunit.client.0.smithi037.stdout:2/87: chown d1/f1e 1 1 2024-09-19T06:08:39.845 INFO:tasks.workunit.client.0.smithi037.stdout:2/88: rename d1/d6/l8 to d1/da/dc/d21/l22 0 2024-09-19T06:08:39.859 INFO:tasks.workunit.client.0.smithi037.stdout:9/80: dwrite da/fe [0,4194304] 0 2024-09-19T06:08:39.859 INFO:tasks.workunit.client.0.smithi037.stdout:9/81: chown da/lb 0 1 2024-09-19T06:08:39.859 INFO:tasks.workunit.client.0.smithi037.stdout:6/50: dwrite f5 [0,4194304] 0 2024-09-19T06:08:39.869 INFO:tasks.workunit.client.0.smithi037.stdout:2/89: dwrite d1/d16/f1c [0,4194304] 0 2024-09-19T06:08:39.869 INFO:tasks.workunit.client.0.smithi037.stdout:0/49: dwrite d5/fd [0,4194304] 0 2024-09-19T06:08:39.872 INFO:tasks.workunit.client.0.smithi037.stdout:2/90: mknod d1/d16/c23 0 2024-09-19T06:08:39.872 INFO:tasks.workunit.client.0.smithi037.stdout:2/91: chown d1/da/fb 42155 1 2024-09-19T06:08:39.872 INFO:tasks.workunit.client.0.smithi037.stdout:2/92: write d1/da/dc/f15 [406729,14720] 0 2024-09-19T06:08:39.875 INFO:tasks.workunit.client.0.smithi037.stdout:9/82: write da/fe [2352229,62808] 0 2024-09-19T06:08:39.875 INFO:tasks.workunit.client.0.smithi037.stdout:9/83: truncate da/dd/f12 734888 0 2024-09-19T06:08:39.875 INFO:tasks.workunit.client.0.smithi037.stdout:9/84: readlink l2 0 2024-09-19T06:08:39.876 INFO:tasks.workunit.client.0.smithi037.stdout:9/85: read da/dd/f12 [731909,70747] 0 2024-09-19T06:08:39.883 INFO:tasks.workunit.client.0.smithi037.stdout:0/50: creat d5/dc/fe x:0 0 0 2024-09-19T06:08:39.884 INFO:tasks.workunit.client.0.smithi037.stdout:6/51: dwrite f5 [0,4194304] 0 2024-09-19T06:08:39.884 INFO:tasks.workunit.client.0.smithi037.stdout:9/86: link c7 da/dd/c17 0 2024-09-19T06:08:39.885 INFO:tasks.workunit.client.0.smithi037.stdout:6/52: unlink f8 0 2024-09-19T06:08:39.885 INFO:tasks.workunit.client.0.smithi037.stdout:6/53: chown f4 67618 1 2024-09-19T06:08:39.886 INFO:tasks.workunit.client.0.smithi037.stdout:9/87: unlink l3 0 2024-09-19T06:08:39.887 INFO:tasks.workunit.client.0.smithi037.stdout:9/88: dread - da/f13 zero size 2024-09-19T06:08:39.887 INFO:tasks.workunit.client.0.smithi037.stdout:7/17: sync 2024-09-19T06:08:39.888 INFO:tasks.workunit.client.0.smithi037.stdout:7/18: mknod c5 0 2024-09-19T06:08:39.895 INFO:tasks.workunit.client.0.smithi037.stdout:0/51: write f4 [3699015,60417] 0 2024-09-19T06:08:39.896 INFO:tasks.workunit.client.0.smithi037.stdout:0/52: creat d5/ff x:0 0 0 2024-09-19T06:08:39.896 INFO:tasks.workunit.client.0.smithi037.stdout:0/53: rename d5 to d5/dc/d10 22 2024-09-19T06:08:39.896 INFO:tasks.workunit.client.0.smithi037.stdout:2/93: dwrite d1/d6/fe [0,4194304] 0 2024-09-19T06:08:39.896 INFO:tasks.workunit.client.0.smithi037.stdout:2/94: truncate d1/d6/f12 1269933 0 2024-09-19T06:08:39.898 INFO:tasks.workunit.client.0.smithi037.stdout:2/95: creat d1/d6/f24 x:0 0 0 2024-09-19T06:08:39.898 INFO:tasks.workunit.client.0.smithi037.stdout:2/96: write f0 [4701596,17770] 0 2024-09-19T06:08:39.898 INFO:tasks.workunit.client.0.smithi037.stdout:2/97: symlink d1/da/dc/d21/l25 0 2024-09-19T06:08:39.901 INFO:tasks.workunit.client.0.smithi037.stdout:0/54: rename d5/dc to d5/d8/d11 0 2024-09-19T06:08:39.903 INFO:tasks.workunit.client.0.smithi037.stdout:2/98: rename d1/da/dc/f10 to d1/d16/f26 0 2024-09-19T06:08:39.905 INFO:tasks.workunit.client.0.smithi037.stdout:2/99: rmdir d1/da/dc/d21 39 2024-09-19T06:08:39.907 INFO:tasks.workunit.client.0.smithi037.stdout:2/100: symlink d1/da/l27 0 2024-09-19T06:08:39.907 INFO:tasks.workunit.client.0.smithi037.stdout:2/101: write d1/da/fb [1669001,80598] 0 2024-09-19T06:08:39.919 INFO:tasks.workunit.client.0.smithi037.stdout:7/19: dread f2 [0,4194304] 0 2024-09-19T06:08:39.919 INFO:tasks.workunit.client.0.smithi037.stdout:7/20: dread - f4 zero size 2024-09-19T06:08:39.919 INFO:tasks.workunit.client.0.smithi037.stdout:7/21: rmdir - no directory 2024-09-19T06:08:39.920 INFO:tasks.workunit.client.0.smithi037.stdout:7/22: mkdir d6 0 2024-09-19T06:08:39.921 INFO:tasks.workunit.client.0.smithi037.stdout:7/23: mknod d6/c7 0 2024-09-19T06:08:39.921 INFO:tasks.workunit.client.0.smithi037.stdout:7/24: chown f4 63 1 2024-09-19T06:08:39.921 INFO:tasks.workunit.client.0.smithi037.stdout:7/25: chown c5 988664321 1 2024-09-19T06:08:39.921 INFO:tasks.workunit.client.0.smithi037.stdout:7/26: link d6/c7 d6/c8 0 2024-09-19T06:08:39.922 INFO:tasks.workunit.client.0.smithi037.stdout:0/55: dread f4 [0,4194304] 0 2024-09-19T06:08:39.922 INFO:tasks.workunit.client.0.smithi037.stdout:0/56: readlink l0 0 2024-09-19T06:08:39.922 INFO:tasks.workunit.client.0.smithi037.stdout:6/54: dwrite f5 [0,4194304] 0 2024-09-19T06:08:39.922 INFO:tasks.workunit.client.0.smithi037.stdout:9/89: dwrite da/dd/f12 [0,4194304] 0 2024-09-19T06:08:39.923 INFO:tasks.workunit.client.0.smithi037.stdout:0/57: mknod d5/c12 0 2024-09-19T06:08:39.925 INFO:tasks.workunit.client.0.smithi037.stdout:9/90: link l2 da/dd/l18 0 2024-09-19T06:08:39.926 INFO:tasks.workunit.client.0.smithi037.stdout:9/91: creat da/f19 x:0 0 0 2024-09-19T06:08:39.927 INFO:tasks.workunit.client.0.smithi037.stdout:9/92: creat da/f1a x:0 0 0 2024-09-19T06:08:39.928 INFO:tasks.workunit.client.0.smithi037.stdout:9/93: truncate da/f19 38298 0 2024-09-19T06:08:39.934 INFO:tasks.workunit.client.0.smithi037.stdout:9/94: getdents da/dd 0 2024-09-19T06:08:39.935 INFO:tasks.workunit.client.0.smithi037.stdout:0/58: read d5/d8/fb [259040,8206] 0 2024-09-19T06:08:39.935 INFO:tasks.workunit.client.0.smithi037.stdout:9/95: dread da/f19 [0,4194304] 0 2024-09-19T06:08:39.936 INFO:tasks.workunit.client.0.smithi037.stdout:0/59: write d5/fa [47666,56097] 0 2024-09-19T06:08:39.936 INFO:tasks.workunit.client.0.smithi037.stdout:0/60: read - d5/ff zero size 2024-09-19T06:08:39.936 INFO:tasks.workunit.client.0.smithi037.stdout:6/55: write f4 [3435491,4597] 0 2024-09-19T06:08:39.937 INFO:tasks.workunit.client.0.smithi037.stdout:0/61: mknod d5/c13 0 2024-09-19T06:08:39.937 INFO:tasks.workunit.client.0.smithi037.stdout:0/62: readlink l0 0 2024-09-19T06:08:39.939 INFO:tasks.workunit.client.0.smithi037.stdout:0/63: rename d5/c12 to d5/c14 0 2024-09-19T06:08:39.939 INFO:tasks.workunit.client.0.smithi037.stdout:2/102: dwrite d1/da/f14 [0,4194304] 0 2024-09-19T06:08:39.939 INFO:tasks.workunit.client.0.smithi037.stdout:0/64: chown d5/c13 19 1 2024-09-19T06:08:39.939 INFO:tasks.workunit.client.0.smithi037.stdout:2/103: fdatasync d1/d6/fe 0 2024-09-19T06:08:39.940 INFO:tasks.workunit.client.0.smithi037.stdout:0/65: mkdir d5/d8/d11/d15 0 2024-09-19T06:08:39.941 INFO:tasks.workunit.client.0.smithi037.stdout:0/66: creat d5/d8/d11/f16 x:0 0 0 2024-09-19T06:08:39.942 INFO:tasks.workunit.client.0.smithi037.stdout:0/67: mkdir d5/d17 0 2024-09-19T06:08:39.942 INFO:tasks.workunit.client.0.smithi037.stdout:0/68: write f4 [6330088,63458] 0 2024-09-19T06:08:39.943 INFO:tasks.workunit.client.0.smithi037.stdout:0/69: fsync d5/d8/d11/fe 0 2024-09-19T06:08:39.943 INFO:tasks.workunit.client.0.smithi037.stdout:0/70: readlink d5/d8/l9 0 2024-09-19T06:08:39.943 INFO:tasks.workunit.client.0.smithi037.stdout:0/71: write d5/d8/d11/fe [207834,51567] 0 2024-09-19T06:08:39.947 INFO:tasks.workunit.client.0.smithi037.stdout:7/27: dwrite f4 [0,4194304] 0 2024-09-19T06:08:39.947 INFO:tasks.workunit.client.0.smithi037.stdout:0/72: fsync d5/d8/d11/fe 0 2024-09-19T06:08:39.947 INFO:tasks.workunit.client.0.smithi037.stdout:0/73: chown f4 255386 1 2024-09-19T06:08:39.953 INFO:tasks.workunit.client.0.smithi037.stdout:0/74: mkdir d5/d18 0 2024-09-19T06:08:39.954 INFO:tasks.workunit.client.0.smithi037.stdout:6/56: dread f4 [0,4194304] 0 2024-09-19T06:08:39.954 INFO:tasks.workunit.client.0.smithi037.stdout:0/75: symlink d5/l19 0 2024-09-19T06:08:39.960 INFO:tasks.workunit.client.0.smithi037.stdout:6/57: truncate f5 1325430 0 2024-09-19T06:08:39.960 INFO:tasks.workunit.client.0.smithi037.stdout:6/58: chown l6 71 1 2024-09-19T06:08:39.961 INFO:tasks.workunit.client.0.smithi037.stdout:6/59: rmdir d9 39 2024-09-19T06:08:39.962 INFO:tasks.workunit.client.0.smithi037.stdout:9/96: dwrite da/f19 [0,4194304] 0 2024-09-19T06:08:39.965 INFO:tasks.workunit.client.0.smithi037.stdout:2/104: dread d1/d16/f1c [0,4194304] 0 2024-09-19T06:08:39.966 INFO:tasks.workunit.client.0.smithi037.stdout:3/39: sync 2024-09-19T06:08:39.966 INFO:tasks.workunit.client.0.smithi037.stdout:1/20: sync 2024-09-19T06:08:39.967 INFO:tasks.workunit.client.0.smithi037.stdout:4/61: sync 2024-09-19T06:08:39.967 INFO:tasks.workunit.client.0.smithi037.stdout:5/88: sync 2024-09-19T06:08:39.967 INFO:tasks.workunit.client.0.smithi037.stdout:8/141: sync 2024-09-19T06:08:39.969 INFO:tasks.workunit.client.0.smithi037.stdout:2/105: mknod d1/c28 0 2024-09-19T06:08:39.969 INFO:tasks.workunit.client.0.smithi037.stdout:1/21: creat d2/f9 x:0 0 0 2024-09-19T06:08:39.970 INFO:tasks.workunit.client.0.smithi037.stdout:4/62: unlink d0/cd 0 2024-09-19T06:08:39.971 INFO:tasks.workunit.client.0.smithi037.stdout:4/63: chown d0/l1 1978 1 2024-09-19T06:08:39.971 INFO:tasks.workunit.client.0.smithi037.stdout:4/64: readlink d0/l14 0 2024-09-19T06:08:39.971 INFO:tasks.workunit.client.0.smithi037.stdout:2/106: creat d1/f29 x:0 0 0 2024-09-19T06:08:39.971 INFO:tasks.workunit.client.0.smithi037.stdout:1/22: creat d2/fa x:0 0 0 2024-09-19T06:08:39.972 INFO:tasks.workunit.client.0.smithi037.stdout:5/89: creat d2/d10/f1e x:0 0 0 2024-09-19T06:08:39.972 INFO:tasks.workunit.client.0.smithi037.stdout:2/107: creat d1/da/f2a x:0 0 0 2024-09-19T06:08:39.972 INFO:tasks.workunit.client.0.smithi037.stdout:2/108: write d1/da/f19 [831270,111008] 0 2024-09-19T06:08:39.974 INFO:tasks.workunit.client.0.smithi037.stdout:1/23: creat d2/fb x:0 0 0 2024-09-19T06:08:39.974 INFO:tasks.workunit.client.0.smithi037.stdout:2/109: unlink d1/d16/f26 0 2024-09-19T06:08:39.975 INFO:tasks.workunit.client.0.smithi037.stdout:1/24: creat d2/fc x:0 0 0 2024-09-19T06:08:39.975 INFO:tasks.workunit.client.0.smithi037.stdout:2/110: rmdir d1/d6 39 2024-09-19T06:08:39.977 INFO:tasks.workunit.client.0.smithi037.stdout:1/25: rename d2/fc to d2/fd 0 2024-09-19T06:08:39.981 INFO:tasks.workunit.client.0.smithi037.stdout:7/28: dwrite f4 [0,4194304] 0 2024-09-19T06:08:39.985 INFO:tasks.workunit.client.0.smithi037.stdout:0/76: dwrite d5/d8/d11/fe [0,4194304] 0 2024-09-19T06:08:39.985 INFO:tasks.workunit.client.0.smithi037.stdout:0/77: stat d5/fd 0 2024-09-19T06:08:39.985 INFO:tasks.workunit.client.0.smithi037.stdout:0/78: write d5/fa [907352,93379] 0 2024-09-19T06:08:39.988 INFO:tasks.workunit.client.0.smithi037.stdout:0/79: mknod d5/c1a 0 2024-09-19T06:08:39.988 INFO:tasks.workunit.client.0.smithi037.stdout:3/40: write d0/f7 [544573,3926] 0 2024-09-19T06:08:40.003 INFO:tasks.workunit.client.0.smithi037.stdout:0/80: fdatasync f4 0 2024-09-19T06:08:40.003 INFO:tasks.workunit.client.0.smithi037.stdout:0/81: truncate f4 9213522 0 2024-09-19T06:08:40.005 INFO:tasks.workunit.client.0.smithi037.stdout:6/60: dwrite f5 [0,4194304] 0 2024-09-19T06:08:40.005 INFO:tasks.workunit.client.0.smithi037.stdout:6/61: fdatasync f5 0 2024-09-19T06:08:40.006 INFO:tasks.workunit.client.0.smithi037.stdout:6/62: chown d9 13 1 2024-09-19T06:08:40.006 INFO:tasks.workunit.client.0.smithi037.stdout:5/90: dread d2/d10/f19 [0,4194304] 0 2024-09-19T06:08:40.007 INFO:tasks.workunit.client.0.smithi037.stdout:9/97: dwrite da/f13 [0,4194304] 0 2024-09-19T06:08:40.008 INFO:tasks.workunit.client.0.smithi037.stdout:2/111: dread d1/d16/f1c [0,4194304] 0 2024-09-19T06:08:40.008 INFO:tasks.workunit.client.0.smithi037.stdout:2/112: chown d1/d6/c13 56948 1 2024-09-19T06:08:40.008 INFO:tasks.workunit.client.0.smithi037.stdout:2/113: readlink d1/d16/l1d 0 2024-09-19T06:08:40.010 INFO:tasks.workunit.client.0.smithi037.stdout:4/65: dwrite d0/d2/f4 [0,4194304] 0 2024-09-19T06:08:40.010 INFO:tasks.workunit.client.0.smithi037.stdout:4/66: write d0/d2/f1a [413833,109140] 0 2024-09-19T06:08:40.010 INFO:tasks.workunit.client.0.smithi037.stdout:5/91: rmdir d2/d12/d1a 39 2024-09-19T06:08:40.014 INFO:tasks.workunit.client.0.smithi037.stdout:2/114: rename d1/da/dc/d21/l25 to d1/d6/l2b 0 2024-09-19T06:08:40.014 INFO:tasks.workunit.client.0.smithi037.stdout:2/115: read - d1/da/dc/f18 zero size 2024-09-19T06:08:40.014 INFO:tasks.workunit.client.0.smithi037.stdout:8/142: dwrite d1/f2d [0,4194304] 0 2024-09-19T06:08:40.014 INFO:tasks.workunit.client.0.smithi037.stdout:1/26: dwrite d2/f6 [0,4194304] 0 2024-09-19T06:08:40.014 INFO:tasks.workunit.client.0.smithi037.stdout:5/92: creat d2/d10/f1f x:0 0 0 2024-09-19T06:08:40.021 INFO:tasks.workunit.client.0.smithi037.stdout:8/143: rename d1/f1f to d1/d11/f34 0 2024-09-19T06:08:40.021 INFO:tasks.workunit.client.0.smithi037.stdout:8/144: fsync d1/f10 0 2024-09-19T06:08:40.021 INFO:tasks.workunit.client.0.smithi037.stdout:1/27: getdents d2 0 2024-09-19T06:08:40.021 INFO:tasks.workunit.client.0.smithi037.stdout:8/145: readlink d1/l17 0 2024-09-19T06:08:40.021 INFO:tasks.workunit.client.0.smithi037.stdout:8/146: chown d1/d11/c25 1373902 1 2024-09-19T06:08:40.022 INFO:tasks.workunit.client.0.smithi037.stdout:7/29: dwrite f2 [0,4194304] 0 2024-09-19T06:08:40.022 INFO:tasks.workunit.client.0.smithi037.stdout:1/28: link d2/fd d2/fe 0 2024-09-19T06:08:40.025 INFO:tasks.workunit.client.0.smithi037.stdout:8/147: mkdir d1/d35 0 2024-09-19T06:08:40.029 INFO:tasks.workunit.client.0.smithi037.stdout:1/29: write d2/f6 [4882590,99055] 0 2024-09-19T06:08:40.031 INFO:tasks.workunit.client.0.smithi037.stdout:1/30: mknod d2/cf 0 2024-09-19T06:08:40.031 INFO:tasks.workunit.client.0.smithi037.stdout:1/31: chown d2/fb 0 1 2024-09-19T06:08:40.032 INFO:tasks.workunit.client.0.smithi037.stdout:3/41: dwrite d0/f7 [0,4194304] 0 2024-09-19T06:08:40.042 INFO:tasks.workunit.client.0.smithi037.stdout:1/32: creat d2/f10 x:0 0 0 2024-09-19T06:08:40.044 INFO:tasks.workunit.client.0.smithi037.stdout:1/33: creat d2/f11 x:0 0 0 2024-09-19T06:08:40.045 INFO:tasks.workunit.client.0.smithi037.stdout:7/30: write f2 [1713388,18348] 0 2024-09-19T06:08:40.045 INFO:tasks.workunit.client.0.smithi037.stdout:1/34: chown f1 2466 1 2024-09-19T06:08:40.045 INFO:tasks.workunit.client.0.smithi037.stdout:1/35: write d2/f10 [330679,96933] 0 2024-09-19T06:08:40.046 INFO:tasks.workunit.client.0.smithi037.stdout:7/31: creat d6/f9 x:0 0 0 2024-09-19T06:08:40.046 INFO:tasks.workunit.client.0.smithi037.stdout:7/32: stat d6 0 2024-09-19T06:08:40.046 INFO:tasks.workunit.client.0.smithi037.stdout:7/33: write f2 [576433,36932] 0 2024-09-19T06:08:40.047 INFO:tasks.workunit.client.0.smithi037.stdout:1/36: mkdir d2/d12 0 2024-09-19T06:08:40.050 INFO:tasks.workunit.client.0.smithi037.stdout:1/37: unlink d2/fd 0 2024-09-19T06:08:40.050 INFO:tasks.workunit.client.0.smithi037.stdout:1/38: truncate d2/f10 1205250 0 2024-09-19T06:08:40.056 INFO:tasks.workunit.client.0.smithi037.stdout:0/82: dwrite f4 [4194304,4194304] 0 2024-09-19T06:08:40.056 INFO:tasks.workunit.client.0.smithi037.stdout:4/67: write d0/d2/f7 [10962128,78924] 0 2024-09-19T06:08:40.057 INFO:tasks.workunit.client.0.smithi037.stdout:0/83: symlink d5/d8/l1b 0 2024-09-19T06:08:40.058 INFO:tasks.workunit.client.0.smithi037.stdout:5/93: write d2/fb [573895,123818] 0 2024-09-19T06:08:40.058 INFO:tasks.workunit.client.0.smithi037.stdout:5/94: chown d2/d10/f1e 12410 1 2024-09-19T06:08:40.058 INFO:tasks.workunit.client.0.smithi037.stdout:2/116: dwrite d1/f29 [0,4194304] 0 2024-09-19T06:08:40.058 INFO:tasks.workunit.client.0.smithi037.stdout:6/63: dwrite f5 [0,4194304] 0 2024-09-19T06:08:40.058 INFO:tasks.workunit.client.0.smithi037.stdout:2/117: dread - d1/da/f1f zero size 2024-09-19T06:08:40.060 INFO:tasks.workunit.client.0.smithi037.stdout:4/68: rename d0/d2/lf to d0/d2/l1c 0 2024-09-19T06:08:40.060 INFO:tasks.workunit.client.0.smithi037.stdout:9/98: write da/dd/f12 [3048823,109413] 0 2024-09-19T06:08:40.061 INFO:tasks.workunit.client.0.smithi037.stdout:3/42: dwrite d0/f2 [8388608,4194304] 0 2024-09-19T06:08:40.062 INFO:tasks.workunit.client.0.smithi037.stdout:5/95: getdents d2 0 2024-09-19T06:08:40.062 INFO:tasks.workunit.client.0.smithi037.stdout:5/96: write d2/d10/f1f [702964,19427] 0 2024-09-19T06:08:40.062 INFO:tasks.workunit.client.0.smithi037.stdout:5/97: getdents d2 0 2024-09-19T06:08:40.062 INFO:tasks.workunit.client.0.smithi037.stdout:5/98: stat d2/fa 0 2024-09-19T06:08:40.063 INFO:tasks.workunit.client.0.smithi037.stdout:6/64: symlink d9/lb 0 2024-09-19T06:08:40.063 INFO:tasks.workunit.client.0.smithi037.stdout:6/65: write f4 [1012473,40186] 0 2024-09-19T06:08:40.063 INFO:tasks.workunit.client.0.smithi037.stdout:6/66: readlink l2 0 2024-09-19T06:08:40.063 INFO:tasks.workunit.client.0.smithi037.stdout:6/67: readlink l2 0 2024-09-19T06:08:40.063 INFO:tasks.workunit.client.0.smithi037.stdout:6/68: stat d9 0 2024-09-19T06:08:40.063 INFO:tasks.workunit.client.0.smithi037.stdout:6/69: stat f5 0 2024-09-19T06:08:40.066 INFO:tasks.workunit.client.0.smithi037.stdout:2/118: creat d1/da/f2c x:0 0 0 2024-09-19T06:08:40.067 INFO:tasks.workunit.client.0.smithi037.stdout:4/69: creat d0/d2/f1d x:0 0 0 2024-09-19T06:08:40.068 INFO:tasks.workunit.client.0.smithi037.stdout:8/148: dwrite d1/f6 [0,4194304] 0 2024-09-19T06:08:40.069 INFO:tasks.workunit.client.0.smithi037.stdout:5/99: symlink d2/d12/d1a/l20 0 2024-09-19T06:08:40.069 INFO:tasks.workunit.client.0.smithi037.stdout:5/100: dread - d2/d10/f1e zero size 2024-09-19T06:08:40.069 INFO:tasks.workunit.client.0.smithi037.stdout:5/101: dread - d2/d10/f1e zero size 2024-09-19T06:08:40.071 INFO:tasks.workunit.client.0.smithi037.stdout:2/119: mkdir d1/d6/d2d 0 2024-09-19T06:08:40.071 INFO:tasks.workunit.client.0.smithi037.stdout:0/84: dread d5/fa [0,4194304] 0 2024-09-19T06:08:40.071 INFO:tasks.workunit.client.0.smithi037.stdout:0/85: getdents d5/d17 0 2024-09-19T06:08:40.072 INFO:tasks.workunit.client.0.smithi037.stdout:4/70: dread d0/f16 [0,4194304] 0 2024-09-19T06:08:40.074 INFO:tasks.workunit.client.0.smithi037.stdout:8/149: mkdir d1/d35/d36 0 2024-09-19T06:08:40.075 INFO:tasks.workunit.client.0.smithi037.stdout:5/102: creat d2/d10/f21 x:0 0 0 2024-09-19T06:08:40.078 INFO:tasks.workunit.client.0.smithi037.stdout:0/86: creat d5/d8/d11/d15/f1c x:0 0 0 2024-09-19T06:08:40.080 INFO:tasks.workunit.client.0.smithi037.stdout:7/34: dwrite d6/f9 [0,4194304] 0 2024-09-19T06:08:40.087 INFO:tasks.workunit.client.0.smithi037.stdout:4/71: getdents d0 0 2024-09-19T06:08:40.087 INFO:tasks.workunit.client.0.smithi037.stdout:3/43: truncate d0/f2 6932918 0 2024-09-19T06:08:40.087 INFO:tasks.workunit.client.0.smithi037.stdout:4/72: write d0/d2/f19 [855951,14624] 0 2024-09-19T06:08:40.089 INFO:tasks.workunit.client.0.smithi037.stdout:7/35: creat d6/fa x:0 0 0 2024-09-19T06:08:40.091 INFO:tasks.workunit.client.0.smithi037.stdout:3/44: creat d0/fb x:0 0 0 2024-09-19T06:08:40.092 INFO:tasks.workunit.client.0.smithi037.stdout:4/73: rename d0/d2/le to d0/d6/d1b/l1e 0 2024-09-19T06:08:40.093 INFO:tasks.workunit.client.0.smithi037.stdout:7/36: unlink c5 0 2024-09-19T06:08:40.093 INFO:tasks.workunit.client.0.smithi037.stdout:2/120: dread d1/da/fb [0,4194304] 0 2024-09-19T06:08:40.093 INFO:tasks.workunit.client.0.smithi037.stdout:1/39: dread d2/f6 [0,4194304] 0 2024-09-19T06:08:40.097 INFO:tasks.workunit.client.0.smithi037.stdout:1/40: creat d2/d12/f13 x:0 0 0 2024-09-19T06:08:40.097 INFO:tasks.workunit.client.0.smithi037.stdout:1/41: fdatasync d2/d12/f13 0 2024-09-19T06:08:40.098 INFO:tasks.workunit.client.0.smithi037.stdout:1/42: creat d2/f14 x:0 0 0 2024-09-19T06:08:40.099 INFO:tasks.workunit.client.0.smithi037.stdout:6/70: dwrite f5 [0,4194304] 0 2024-09-19T06:08:40.101 INFO:tasks.workunit.client.0.smithi037.stdout:9/99: dwrite da/fc [0,4194304] 0 2024-09-19T06:08:40.104 INFO:tasks.workunit.client.0.smithi037.stdout:1/43: write d2/f10 [67627,56475] 0 2024-09-19T06:08:40.104 INFO:tasks.workunit.client.0.smithi037.stdout:1/44: dread - f1 zero size 2024-09-19T06:08:40.108 INFO:tasks.workunit.client.0.smithi037.stdout:6/71: getdents d9 0 2024-09-19T06:08:40.108 INFO:tasks.workunit.client.0.smithi037.stdout:6/72: write f4 [3534497,77690] 0 2024-09-19T06:08:40.109 INFO:tasks.workunit.client.0.smithi037.stdout:0/87: dwrite d5/d8/d11/fe [0,4194304] 0 2024-09-19T06:08:40.110 INFO:tasks.workunit.client.0.smithi037.stdout:1/45: readlink d2/l7 0 2024-09-19T06:08:40.111 INFO:tasks.workunit.client.0.smithi037.stdout:6/73: creat d9/fc x:0 0 0 2024-09-19T06:08:40.111 INFO:tasks.workunit.client.0.smithi037.stdout:6/74: write f4 [1916961,102659] 0 2024-09-19T06:08:40.112 INFO:tasks.workunit.client.0.smithi037.stdout:1/46: mkdir d2/d12/d15 0 2024-09-19T06:08:40.114 INFO:tasks.workunit.client.0.smithi037.stdout:6/75: unlink d9/lb 0 2024-09-19T06:08:40.115 INFO:tasks.workunit.client.0.smithi037.stdout:6/76: mkdir d9/dd 0 2024-09-19T06:08:40.117 INFO:tasks.workunit.client.0.smithi037.stdout:3/45: truncate d0/f2 4698335 0 2024-09-19T06:08:40.117 INFO:tasks.workunit.client.0.smithi037.stdout:2/121: dwrite d1/da/f2a [0,4194304] 0 2024-09-19T06:08:40.118 INFO:tasks.workunit.client.0.smithi037.stdout:6/77: symlink d9/le 0 2024-09-19T06:08:40.118 INFO:tasks.workunit.client.0.smithi037.stdout:6/78: write d9/fc [969606,44131] 0 2024-09-19T06:08:40.118 INFO:tasks.workunit.client.0.smithi037.stdout:3/46: rmdir d0 39 2024-09-19T06:08:40.120 INFO:tasks.workunit.client.0.smithi037.stdout:4/74: dwrite d0/d2/f7 [0,4194304] 0 2024-09-19T06:08:40.122 INFO:tasks.workunit.client.0.smithi037.stdout:2/122: creat d1/d6/d2d/f2e x:0 0 0 2024-09-19T06:08:40.124 INFO:tasks.workunit.client.0.smithi037.stdout:3/47: rmdir d0 39 2024-09-19T06:08:40.125 INFO:tasks.workunit.client.0.smithi037.stdout:4/75: symlink d0/d6/d1b/l1f 0 2024-09-19T06:08:40.127 INFO:tasks.workunit.client.0.smithi037.stdout:2/123: creat d1/d6/f2f x:0 0 0 2024-09-19T06:08:40.127 INFO:tasks.workunit.client.0.smithi037.stdout:2/124: chown d1/da/f2a 3 1 2024-09-19T06:08:40.127 INFO:tasks.workunit.client.0.smithi037.stdout:2/125: fsync d1/da/dc/f18 0 2024-09-19T06:08:40.128 INFO:tasks.workunit.client.0.smithi037.stdout:0/88: dread f4 [4194304,4194304] 0 2024-09-19T06:08:40.128 INFO:tasks.workunit.client.0.smithi037.stdout:3/48: rmdir d0 39 2024-09-19T06:08:40.128 INFO:tasks.workunit.client.0.smithi037.stdout:3/49: fsync d0/fb 0 2024-09-19T06:08:40.129 INFO:tasks.workunit.client.0.smithi037.stdout:0/89: mknod d5/d17/c1d 0 2024-09-19T06:08:40.130 INFO:tasks.workunit.client.0.smithi037.stdout:3/50: creat d0/fc x:0 0 0 2024-09-19T06:08:40.131 INFO:tasks.workunit.client.0.smithi037.stdout:0/90: creat d5/d8/d11/d15/f1e x:0 0 0 2024-09-19T06:08:40.131 INFO:tasks.workunit.client.0.smithi037.stdout:9/100: dwrite da/fc [0,4194304] 0 2024-09-19T06:08:40.132 INFO:tasks.workunit.client.0.smithi037.stdout:3/51: mknod d0/cd 0 2024-09-19T06:08:40.132 INFO:tasks.workunit.client.0.smithi037.stdout:3/52: fdatasync d0/f2 0 2024-09-19T06:08:40.133 INFO:tasks.workunit.client.0.smithi037.stdout:0/91: rename d5/c14 to d5/d17/c1f 0 2024-09-19T06:08:40.135 INFO:tasks.workunit.client.0.smithi037.stdout:9/101: chown c5 1304551 1 2024-09-19T06:08:40.137 INFO:tasks.workunit.client.0.smithi037.stdout:3/53: creat d0/fe x:0 0 0 2024-09-19T06:08:40.138 INFO:tasks.workunit.client.0.smithi037.stdout:0/92: mkdir d5/d20 0 2024-09-19T06:08:40.138 INFO:tasks.workunit.client.0.smithi037.stdout:0/93: chown d5/d20 34269 1 2024-09-19T06:08:40.139 INFO:tasks.workunit.client.0.smithi037.stdout:6/79: truncate f4 2384173 0 2024-09-19T06:08:40.140 INFO:tasks.workunit.client.0.smithi037.stdout:2/126: write d1/d16/f1c [1712000,22401] 0 2024-09-19T06:08:40.140 INFO:tasks.workunit.client.0.smithi037.stdout:2/127: write d1/fd [2047957,89885] 0 2024-09-19T06:08:40.141 INFO:tasks.workunit.client.0.smithi037.stdout:9/102: mkdir da/dd/d1b 0 2024-09-19T06:08:40.143 INFO:tasks.workunit.client.0.smithi037.stdout:3/54: unlink d0/fb 0 2024-09-19T06:08:40.143 INFO:tasks.workunit.client.0.smithi037.stdout:2/128: mknod d1/da/c30 0 2024-09-19T06:08:40.145 INFO:tasks.workunit.client.0.smithi037.stdout:9/103: rename da/dd/c17 to da/c1c 0 2024-09-19T06:08:40.146 INFO:tasks.workunit.client.0.smithi037.stdout:4/76: dwrite d0/d2/f19 [0,4194304] 0 2024-09-19T06:08:40.153 INFO:tasks.workunit.client.0.smithi037.stdout:3/55: link d0/f9 d0/ff 0 2024-09-19T06:08:40.153 INFO:tasks.workunit.client.0.smithi037.stdout:3/56: chown d0/fc 257177 1 2024-09-19T06:08:40.153 INFO:tasks.workunit.client.0.smithi037.stdout:2/129: creat d1/d6/d2d/f31 x:0 0 0 2024-09-19T06:08:40.153 INFO:tasks.workunit.client.0.smithi037.stdout:2/130: chown d1/f3 4940018 1 2024-09-19T06:08:40.153 INFO:tasks.workunit.client.0.smithi037.stdout:4/77: mkdir d0/d6/d1b/d20 0 2024-09-19T06:08:40.153 INFO:tasks.workunit.client.0.smithi037.stdout:3/57: write d0/ff [179915,99033] 0 2024-09-19T06:08:40.153 INFO:tasks.workunit.client.0.smithi037.stdout:3/58: chown d0/c6 0 1 2024-09-19T06:08:40.154 INFO:tasks.workunit.client.0.smithi037.stdout:3/59: fsync d0/fc 0 2024-09-19T06:08:40.154 INFO:tasks.workunit.client.0.smithi037.stdout:2/131: creat d1/da/f32 x:0 0 0 2024-09-19T06:08:40.155 INFO:tasks.workunit.client.0.smithi037.stdout:4/78: mkdir d0/d6/d1b/d21 0 2024-09-19T06:08:40.156 INFO:tasks.workunit.client.0.smithi037.stdout:3/60: getdents d0 0 2024-09-19T06:08:40.157 INFO:tasks.workunit.client.0.smithi037.stdout:2/132: mkdir d1/d33 0 2024-09-19T06:08:40.157 INFO:tasks.workunit.client.0.smithi037.stdout:2/133: dread - d1/da/f2c zero size 2024-09-19T06:08:40.158 INFO:tasks.workunit.client.0.smithi037.stdout:6/80: write f5 [2949780,28899] 0 2024-09-19T06:08:40.158 INFO:tasks.workunit.client.0.smithi037.stdout:3/61: symlink d0/l10 0 2024-09-19T06:08:40.160 INFO:tasks.workunit.client.0.smithi037.stdout:2/134: rename d1/da/f1f to d1/d6/d2d/f34 0 2024-09-19T06:08:40.161 INFO:tasks.workunit.client.0.smithi037.stdout:3/62: chown d0/c6 114335792 1 2024-09-19T06:08:40.161 INFO:tasks.workunit.client.0.smithi037.stdout:2/135: rmdir d1 39 2024-09-19T06:08:40.164 INFO:tasks.workunit.client.0.smithi037.stdout:3/63: mknod d0/c11 0 2024-09-19T06:08:40.166 INFO:tasks.workunit.client.0.smithi037.stdout:3/64: creat d0/f12 x:0 0 0 2024-09-19T06:08:40.167 INFO:tasks.workunit.client.0.smithi037.stdout:3/65: dread - d0/f12 zero size 2024-09-19T06:08:40.173 INFO:tasks.workunit.client.0.smithi037.stdout:9/104: dwrite da/dd/f12 [0,4194304] 0 2024-09-19T06:08:40.173 INFO:tasks.workunit.client.0.smithi037.stdout:3/66: symlink d0/l13 0 2024-09-19T06:08:40.173 INFO:tasks.workunit.client.0.smithi037.stdout:3/67: truncate d0/f2 5310421 0 2024-09-19T06:08:40.175 INFO:tasks.workunit.client.0.smithi037.stdout:9/105: rename da/dd/l18 to da/dd/d1b/l1d 0 2024-09-19T06:08:40.175 INFO:tasks.workunit.client.0.smithi037.stdout:9/106: chown da/dd/d1b/l1d 540581095 1 2024-09-19T06:08:40.175 INFO:tasks.workunit.client.0.smithi037.stdout:3/68: creat d0/f14 x:0 0 0 2024-09-19T06:08:40.176 INFO:tasks.workunit.client.0.smithi037.stdout:9/107: symlink da/dd/l1e 0 2024-09-19T06:08:40.176 INFO:tasks.workunit.client.0.smithi037.stdout:3/69: truncate d0/f9 764593 0 2024-09-19T06:08:40.177 INFO:tasks.workunit.client.0.smithi037.stdout:9/108: creat da/dd/d1b/f1f x:0 0 0 2024-09-19T06:08:40.177 INFO:tasks.workunit.client.0.smithi037.stdout:9/109: chown da/c1c 6957263 1 2024-09-19T06:08:40.177 INFO:tasks.workunit.client.0.smithi037.stdout:3/70: fsync d0/fe 0 2024-09-19T06:08:40.178 INFO:tasks.workunit.client.0.smithi037.stdout:9/110: mkdir da/d20 0 2024-09-19T06:08:40.178 INFO:tasks.workunit.client.0.smithi037.stdout:9/111: dread - da/dd/d1b/f1f zero size 2024-09-19T06:08:40.178 INFO:tasks.workunit.client.0.smithi037.stdout:9/112: write da/fe [3106541,28877] 0 2024-09-19T06:08:40.179 INFO:tasks.workunit.client.0.smithi037.stdout:3/71: write d0/ff [619183,51260] 0 2024-09-19T06:08:40.179 INFO:tasks.workunit.client.0.smithi037.stdout:9/113: creat da/dd/d1b/f21 x:0 0 0 2024-09-19T06:08:40.179 INFO:tasks.workunit.client.0.smithi037.stdout:9/114: truncate da/dd/d1b/f21 48641 0 2024-09-19T06:08:40.180 INFO:tasks.workunit.client.0.smithi037.stdout:9/115: symlink da/d20/l22 0 2024-09-19T06:08:40.180 INFO:tasks.workunit.client.0.smithi037.stdout:9/116: mkdir da/dd/d1b/d23 0 2024-09-19T06:08:40.184 INFO:tasks.workunit.client.0.smithi037.stdout:9/117: rename da/f1a to da/dd/d1b/d23/f24 0 2024-09-19T06:08:40.184 INFO:tasks.workunit.client.0.smithi037.stdout:9/118: fdatasync da/fc 0 2024-09-19T06:08:40.184 INFO:tasks.workunit.client.0.smithi037.stdout:9/119: mkdir da/dd/d1b/d23/d25 0 2024-09-19T06:08:40.184 INFO:tasks.workunit.client.0.smithi037.stdout:9/120: creat da/dd/d1b/d23/f26 x:0 0 0 2024-09-19T06:08:40.185 INFO:tasks.workunit.client.0.smithi037.stdout:2/136: dwrite d1/d6/fe [4194304,4194304] 0 2024-09-19T06:08:40.185 INFO:tasks.workunit.client.0.smithi037.stdout:4/79: dwrite d0/d2/f7 [0,4194304] 0 2024-09-19T06:08:40.185 INFO:tasks.workunit.client.0.smithi037.stdout:4/80: write d0/d2/f1a [1294292,109450] 0 2024-09-19T06:08:40.185 INFO:tasks.workunit.client.0.smithi037.stdout:4/81: fsync d0/d2/f1d 0 2024-09-19T06:08:40.191 INFO:tasks.workunit.client.0.smithi037.stdout:3/72: dread d0/f7 [0,4194304] 0 2024-09-19T06:08:40.191 INFO:tasks.workunit.client.0.smithi037.stdout:3/73: fsync d0/f7 0 2024-09-19T06:08:40.191 INFO:tasks.workunit.client.0.smithi037.stdout:3/74: fsync d0/f7 0 2024-09-19T06:08:40.191 INFO:tasks.workunit.client.0.smithi037.stdout:3/75: write d0/f14 [1048492,76365] 0 2024-09-19T06:08:40.212 INFO:tasks.workunit.client.0.smithi037.stdout:9/121: creat da/f27 x:0 0 0 2024-09-19T06:08:40.215 INFO:tasks.workunit.client.0.smithi037.stdout:2/137: mknod d1/d6/c35 0 2024-09-19T06:08:40.215 INFO:tasks.workunit.client.0.smithi037.stdout:2/138: dread - d1/da/f32 zero size 2024-09-19T06:08:40.217 INFO:tasks.workunit.client.0.smithi037.stdout:4/82: rename d0/d2/l1c to d0/d6/d1b/d21/l22 0 2024-09-19T06:08:40.230 INFO:tasks.workunit.client.0.smithi037.stdout:9/122: rmdir da/dd/d1b/d23/d25 0 2024-09-19T06:08:40.235 INFO:tasks.workunit.client.0.smithi037.stdout:2/139: unlink d1/da/c30 0 2024-09-19T06:08:40.235 INFO:tasks.workunit.client.0.smithi037.stdout:2/140: write d1/da/fb [90940,121225] 0 2024-09-19T06:08:40.237 INFO:tasks.workunit.client.0.smithi037.stdout:3/76: mkdir d0/d15 0 2024-09-19T06:08:40.239 INFO:tasks.workunit.client.0.smithi037.stdout:9/123: rename l8 to da/dd/d1b/d23/l28 0 2024-09-19T06:08:40.239 INFO:tasks.workunit.client.0.smithi037.stdout:9/124: write da/dd/d1b/f1f [516378,115394] 0 2024-09-19T06:08:40.239 INFO:tasks.workunit.client.0.smithi037.stdout:4/83: dwrite d0/d2/f1a [0,4194304] 0 2024-09-19T06:08:40.240 INFO:tasks.workunit.client.0.smithi037.stdout:2/141: getdents d1 0 2024-09-19T06:08:40.241 INFO:tasks.workunit.client.0.smithi037.stdout:4/84: rmdir d0/d6/d1b/d21 39 2024-09-19T06:08:40.243 INFO:tasks.workunit.client.0.smithi037.stdout:3/77: rename d0/d15 to d0/d16 0 2024-09-19T06:08:40.244 INFO:tasks.workunit.client.0.smithi037.stdout:4/85: dread d0/f16 [0,4194304] 0 2024-09-19T06:08:40.247 INFO:tasks.workunit.client.0.smithi037.stdout:4/86: creat d0/d6/f23 x:0 0 0 2024-09-19T06:08:40.254 INFO:tasks.workunit.client.0.smithi037.stdout:9/125: read da/f19 [2190933,91867] 0 2024-09-19T06:08:40.262 INFO:tasks.workunit.client.0.smithi037.stdout:3/78: truncate d0/f7 1622158 0 2024-09-19T06:08:40.263 INFO:tasks.workunit.client.0.smithi037.stdout:9/126: fdatasync da/dd/d1b/f1f 0 2024-09-19T06:08:40.263 INFO:tasks.workunit.client.0.smithi037.stdout:3/79: write d0/fc [216600,61611] 0 2024-09-19T06:08:40.263 INFO:tasks.workunit.client.0.smithi037.stdout:2/142: dwrite d1/da/f32 [0,4194304] 0 2024-09-19T06:08:40.271 INFO:tasks.workunit.client.0.smithi037.stdout:4/87: dwrite d0/d2/f1a [0,4194304] 0 2024-09-19T06:08:40.274 INFO:tasks.workunit.client.0.smithi037.stdout:4/88: unlink d0/c11 0 2024-09-19T06:08:40.275 INFO:tasks.workunit.client.0.smithi037.stdout:4/89: creat d0/f24 x:0 0 0 2024-09-19T06:08:40.281 INFO:tasks.workunit.client.0.smithi037.stdout:9/127: dread da/fc [0,4194304] 0 2024-09-19T06:08:40.281 INFO:tasks.workunit.client.0.smithi037.stdout:3/80: fsync d0/f7 0 2024-09-19T06:08:40.281 INFO:tasks.workunit.client.0.smithi037.stdout:3/81: read - d0/fe zero size 2024-09-19T06:08:40.281 INFO:tasks.workunit.client.0.smithi037.stdout:2/143: dread d1/d6/f12 [0,4194304] 0 2024-09-19T06:08:40.282 INFO:tasks.workunit.client.0.smithi037.stdout:9/128: mknod da/dd/c29 0 2024-09-19T06:08:40.283 INFO:tasks.workunit.client.0.smithi037.stdout:3/82: creat d0/f17 x:0 0 0 2024-09-19T06:08:40.283 INFO:tasks.workunit.client.0.smithi037.stdout:3/83: chown d0/l10 137837027 1 2024-09-19T06:08:40.285 INFO:tasks.workunit.client.0.smithi037.stdout:2/144: symlink d1/d16/l36 0 2024-09-19T06:08:40.286 INFO:tasks.workunit.client.0.smithi037.stdout:3/84: truncate d0/f9 249638 0 2024-09-19T06:08:40.286 INFO:tasks.workunit.client.0.smithi037.stdout:3/85: fsync d0/f7 0 2024-09-19T06:08:40.286 INFO:tasks.workunit.client.0.smithi037.stdout:2/145: creat d1/d16/f37 x:0 0 0 2024-09-19T06:08:40.288 INFO:tasks.workunit.client.0.smithi037.stdout:3/86: creat d0/f18 x:0 0 0 2024-09-19T06:08:40.288 INFO:tasks.workunit.client.0.smithi037.stdout:3/87: fdatasync d0/f7 0 2024-09-19T06:08:40.289 INFO:tasks.workunit.client.0.smithi037.stdout:3/88: mkdir d0/d16/d19 0 2024-09-19T06:08:40.290 INFO:tasks.workunit.client.0.smithi037.stdout:3/89: rename d0/fe to d0/d16/d19/f1a 0 2024-09-19T06:08:40.308 INFO:tasks.workunit.client.0.smithi037.stdout:3/90: dwrite d0/f18 [0,4194304] 0 2024-09-19T06:08:40.309 INFO:tasks.workunit.client.0.smithi037.stdout:3/91: chown d0/la 2 1 2024-09-19T06:08:40.351 INFO:tasks.workunit.client.0.smithi037.stdout:2/146: dwrite d1/da/f19 [0,4194304] 0 2024-09-19T06:08:40.352 INFO:tasks.workunit.client.0.smithi037.stdout:2/147: readlink d1/d6/l2b 0 2024-09-19T06:08:40.356 INFO:tasks.workunit.client.0.smithi037.stdout:3/92: dwrite d0/f2 [0,4194304] 0 2024-09-19T06:08:40.363 INFO:tasks.workunit.client.0.smithi037.stdout:6/81: sync 2024-09-19T06:08:40.363 INFO:tasks.workunit.client.0.smithi037.stdout:0/94: sync 2024-09-19T06:08:40.363 INFO:tasks.workunit.client.0.smithi037.stdout:1/47: sync 2024-09-19T06:08:40.363 INFO:tasks.workunit.client.0.smithi037.stdout:8/150: sync 2024-09-19T06:08:40.363 INFO:tasks.workunit.client.0.smithi037.stdout:5/103: sync 2024-09-19T06:08:40.363 INFO:tasks.workunit.client.0.smithi037.stdout:7/37: sync 2024-09-19T06:08:40.364 INFO:tasks.workunit.client.0.smithi037.stdout:7/38: rmdir d6 39 2024-09-19T06:08:40.364 INFO:tasks.workunit.client.0.smithi037.stdout:2/148: read d1/d6/fe [1304933,90580] 0 2024-09-19T06:08:40.365 INFO:tasks.workunit.client.0.smithi037.stdout:5/104: mkdir d2/d12/d1a/d22 0 2024-09-19T06:08:40.365 INFO:tasks.workunit.client.0.smithi037.stdout:0/95: mkdir d5/d8/d11/d15/d21 0 2024-09-19T06:08:40.365 INFO:tasks.workunit.client.0.smithi037.stdout:0/96: chown d5/d8/d11/d15/f1c 10044931 1 2024-09-19T06:08:40.365 INFO:tasks.workunit.client.0.smithi037.stdout:0/97: truncate d5/d8/d11/f16 452736 0 2024-09-19T06:08:40.366 INFO:tasks.workunit.client.0.smithi037.stdout:7/39: truncate f4 1035255 0 2024-09-19T06:08:40.366 INFO:tasks.workunit.client.0.smithi037.stdout:1/48: rename f1 to d2/f16 0 2024-09-19T06:08:40.366 INFO:tasks.workunit.client.0.smithi037.stdout:1/49: dread - d2/f14 zero size 2024-09-19T06:08:40.367 INFO:tasks.workunit.client.0.smithi037.stdout:1/50: dread - d2/f14 zero size 2024-09-19T06:08:40.367 INFO:tasks.workunit.client.0.smithi037.stdout:2/149: creat d1/da/dc/d21/f38 x:0 0 0 2024-09-19T06:08:40.367 INFO:tasks.workunit.client.0.smithi037.stdout:2/150: fsync d1/da/f32 0 2024-09-19T06:08:40.368 INFO:tasks.workunit.client.0.smithi037.stdout:2/151: write d1/f1e [623616,61261] 0 2024-09-19T06:08:40.368 INFO:tasks.workunit.client.0.smithi037.stdout:5/105: rmdir d2/d10 39 2024-09-19T06:08:40.369 INFO:tasks.workunit.client.0.smithi037.stdout:0/98: mkdir d5/d8/d22 0 2024-09-19T06:08:40.369 INFO:tasks.workunit.client.0.smithi037.stdout:0/99: read d5/d8/fb [173267,13091] 0 2024-09-19T06:08:40.369 INFO:tasks.workunit.client.0.smithi037.stdout:7/40: mknod d6/cb 0 2024-09-19T06:08:40.370 INFO:tasks.workunit.client.0.smithi037.stdout:1/51: read - d2/f8 zero size 2024-09-19T06:08:40.371 INFO:tasks.workunit.client.0.smithi037.stdout:5/106: creat d2/f23 x:0 0 0 2024-09-19T06:08:40.372 INFO:tasks.workunit.client.0.smithi037.stdout:1/52: read - d2/f11 zero size 2024-09-19T06:08:40.373 INFO:tasks.workunit.client.0.smithi037.stdout:5/107: rmdir d2/d12 39 2024-09-19T06:08:40.373 INFO:tasks.workunit.client.0.smithi037.stdout:5/108: getdents d2/d12/d1a/d22 0 2024-09-19T06:08:40.374 INFO:tasks.workunit.client.0.smithi037.stdout:1/53: mkdir d2/d12/d17 0 2024-09-19T06:08:40.376 INFO:tasks.workunit.client.0.smithi037.stdout:5/109: mkdir d2/d12/d24 0 2024-09-19T06:08:40.379 INFO:tasks.workunit.client.0.smithi037.stdout:3/93: dwrite d0/f9 [0,4194304] 0 2024-09-19T06:08:40.381 INFO:tasks.workunit.client.0.smithi037.stdout:1/54: dread d2/f10 [0,4194304] 0 2024-09-19T06:08:40.381 INFO:tasks.workunit.client.0.smithi037.stdout:7/41: read f4 [776193,35561] 0 2024-09-19T06:08:40.382 INFO:tasks.workunit.client.0.smithi037.stdout:3/94: mknod d0/d16/c1b 0 2024-09-19T06:08:40.383 INFO:tasks.workunit.client.0.smithi037.stdout:3/95: chown d0/f17 330 1 2024-09-19T06:08:40.384 INFO:tasks.workunit.client.0.smithi037.stdout:2/152: write d1/d6/f12 [926467,11922] 0 2024-09-19T06:08:40.384 INFO:tasks.workunit.client.0.smithi037.stdout:2/153: chown d1/da/f19 20 1 2024-09-19T06:08:40.384 INFO:tasks.workunit.client.0.smithi037.stdout:2/154: stat d1/d16 0 2024-09-19T06:08:40.384 INFO:tasks.workunit.client.0.smithi037.stdout:2/155: stat d1/d6/c11 0 2024-09-19T06:08:40.385 INFO:tasks.workunit.client.0.smithi037.stdout:1/55: link d2/f10 d2/d12/d17/f18 0 2024-09-19T06:08:40.385 INFO:tasks.workunit.client.0.smithi037.stdout:8/151: dread d1/f6 [0,4194304] 0 2024-09-19T06:08:40.386 INFO:tasks.workunit.client.0.smithi037.stdout:1/56: truncate d2/f14 129371 0 2024-09-19T06:08:40.386 INFO:tasks.workunit.client.0.smithi037.stdout:8/152: chown d1/d11/c25 206 1 2024-09-19T06:08:40.386 INFO:tasks.workunit.client.0.smithi037.stdout:7/42: mkdir d6/dc 0 2024-09-19T06:08:40.386 INFO:tasks.workunit.client.0.smithi037.stdout:7/43: write f4 [1426944,13661] 0 2024-09-19T06:08:40.386 INFO:tasks.workunit.client.0.smithi037.stdout:7/44: chown d6/c8 129852186 1 2024-09-19T06:08:40.390 INFO:tasks.workunit.client.0.smithi037.stdout:3/96: creat d0/d16/d19/f1c x:0 0 0 2024-09-19T06:08:40.392 INFO:tasks.workunit.client.0.smithi037.stdout:3/97: mkdir d0/d16/d19/d1d 0 2024-09-19T06:08:40.392 INFO:tasks.workunit.client.0.smithi037.stdout:6/82: dwrite f4 [0,4194304] 0 2024-09-19T06:08:40.396 INFO:tasks.workunit.client.0.smithi037.stdout:3/98: symlink d0/l1e 0 2024-09-19T06:08:40.400 INFO:tasks.workunit.client.0.smithi037.stdout:0/100: dwrite d5/f7 [0,4194304] 0 2024-09-19T06:08:40.400 INFO:tasks.workunit.client.0.smithi037.stdout:0/101: read - d5/ff zero size 2024-09-19T06:08:40.401 INFO:tasks.workunit.client.0.smithi037.stdout:0/102: symlink d5/l23 0 2024-09-19T06:08:40.401 INFO:tasks.workunit.client.0.smithi037.stdout:0/103: dread - d5/d8/d11/d15/f1c zero size 2024-09-19T06:08:40.404 INFO:tasks.workunit.client.0.smithi037.stdout:5/110: dwrite d2/f23 [0,4194304] 0 2024-09-19T06:08:40.404 INFO:tasks.workunit.client.0.smithi037.stdout:5/111: write d2/d12/f1c [664122,92227] 0 2024-09-19T06:08:40.404 INFO:tasks.workunit.client.0.smithi037.stdout:5/112: write d2/d12/f16 [4715157,22562] 0 2024-09-19T06:08:40.406 INFO:tasks.workunit.client.0.smithi037.stdout:5/113: symlink d2/l25 0 2024-09-19T06:08:40.406 INFO:tasks.workunit.client.0.smithi037.stdout:5/114: chown d2/d12/d24 9361 1 2024-09-19T06:08:40.407 INFO:tasks.workunit.client.0.smithi037.stdout:5/115: dread - d2/d10/f21 zero size 2024-09-19T06:08:40.407 INFO:tasks.workunit.client.0.smithi037.stdout:7/45: dread d6/f9 [0,4194304] 0 2024-09-19T06:08:40.407 INFO:tasks.workunit.client.0.smithi037.stdout:7/46: write f2 [3110037,130417] 0 2024-09-19T06:08:40.407 INFO:tasks.workunit.client.0.smithi037.stdout:7/47: fsync d6/fa 0 2024-09-19T06:08:40.408 INFO:tasks.workunit.client.0.smithi037.stdout:5/116: creat d2/d12/f26 x:0 0 0 2024-09-19T06:08:40.409 INFO:tasks.workunit.client.0.smithi037.stdout:7/48: creat d6/dc/fd x:0 0 0 2024-09-19T06:08:40.411 INFO:tasks.workunit.client.0.smithi037.stdout:5/117: creat d2/d12/f27 x:0 0 0 2024-09-19T06:08:40.411 INFO:tasks.workunit.client.0.smithi037.stdout:5/118: chown d2/d12/d1a/d22 855 1 2024-09-19T06:08:40.413 INFO:tasks.workunit.client.0.smithi037.stdout:7/49: rename f2 to d6/dc/fe 0 2024-09-19T06:08:40.416 INFO:tasks.workunit.client.0.smithi037.stdout:0/104: write f4 [6348159,68734] 0 2024-09-19T06:08:40.416 INFO:tasks.workunit.client.0.smithi037.stdout:2/156: dwrite f0 [4194304,4194304] 0 2024-09-19T06:08:40.416 INFO:tasks.workunit.client.0.smithi037.stdout:7/50: mkdir d6/dc/df 0 2024-09-19T06:08:40.416 INFO:tasks.workunit.client.0.smithi037.stdout:7/51: fsync d6/fa 0 2024-09-19T06:08:40.417 INFO:tasks.workunit.client.0.smithi037.stdout:1/57: dread d2/f4 [0,4194304] 0 2024-09-19T06:08:40.420 INFO:tasks.workunit.client.0.smithi037.stdout:3/99: dwrite d0/f7 [0,4194304] 0 2024-09-19T06:08:40.422 INFO:tasks.workunit.client.0.smithi037.stdout:3/100: mkdir d0/d16/d19/d1f 0 2024-09-19T06:08:40.422 INFO:tasks.workunit.client.0.smithi037.stdout:3/101: dread - d0/f12 zero size 2024-09-19T06:08:40.428 INFO:tasks.workunit.client.0.smithi037.stdout:5/119: read d2/d12/f16 [3342484,127949] 0 2024-09-19T06:08:40.428 INFO:tasks.workunit.client.0.smithi037.stdout:5/120: write d2/f7 [40048,103709] 0 2024-09-19T06:08:40.430 INFO:tasks.workunit.client.0.smithi037.stdout:3/102: mkdir d0/d16/d20 0 2024-09-19T06:08:40.430 INFO:tasks.workunit.client.0.smithi037.stdout:3/103: stat d0/c11 0 2024-09-19T06:08:40.430 INFO:tasks.workunit.client.0.smithi037.stdout:7/52: dread f4 [0,4194304] 0 2024-09-19T06:08:40.433 INFO:tasks.workunit.client.0.smithi037.stdout:3/104: creat d0/f21 x:0 0 0 2024-09-19T06:08:40.439 INFO:tasks.workunit.client.0.smithi037.stdout:2/157: dwrite d1/d16/f1c [0,4194304] 0 2024-09-19T06:08:40.440 INFO:tasks.workunit.client.0.smithi037.stdout:0/105: dwrite d5/fd [4194304,4194304] 0 2024-09-19T06:08:40.440 INFO:tasks.workunit.client.0.smithi037.stdout:2/158: truncate d1/da/f2a 3693012 0 2024-09-19T06:08:40.440 INFO:tasks.workunit.client.0.smithi037.stdout:2/159: chown d1/d16 56788 1 2024-09-19T06:08:40.442 INFO:tasks.workunit.client.0.smithi037.stdout:5/121: dread d2/fa [0,4194304] 0 2024-09-19T06:08:40.442 INFO:tasks.workunit.client.0.smithi037.stdout:5/122: fsync d2/d10/f1e 0 2024-09-19T06:08:40.442 INFO:tasks.workunit.client.0.smithi037.stdout:5/123: chown d2/d10/l14 10758255 1 2024-09-19T06:08:40.442 INFO:tasks.workunit.client.0.smithi037.stdout:0/106: mknod d5/d8/d11/c24 0 2024-09-19T06:08:40.443 INFO:tasks.workunit.client.0.smithi037.stdout:2/160: symlink d1/da/l39 0 2024-09-19T06:08:40.443 INFO:tasks.workunit.client.0.smithi037.stdout:2/161: dread - d1/da/f1b zero size 2024-09-19T06:08:40.443 INFO:tasks.workunit.client.0.smithi037.stdout:5/124: dread d2/f7 [0,4194304] 0 2024-09-19T06:08:40.445 INFO:tasks.workunit.client.0.smithi037.stdout:0/107: mknod d5/d18/c25 0 2024-09-19T06:08:40.447 INFO:tasks.workunit.client.0.smithi037.stdout:2/162: unlink d1/da/fb 0 2024-09-19T06:08:40.449 INFO:tasks.workunit.client.0.smithi037.stdout:5/125: rename d2/d12/d1a to d2/d12/d28 0 2024-09-19T06:08:40.451 INFO:tasks.workunit.client.0.smithi037.stdout:2/163: rename d1/c28 to d1/da/c3a 0 2024-09-19T06:08:40.452 INFO:tasks.workunit.client.0.smithi037.stdout:5/126: creat d2/d12/d28/f29 x:0 0 0 2024-09-19T06:08:40.453 INFO:tasks.workunit.client.0.smithi037.stdout:2/164: creat d1/da/dc/f3b x:0 0 0 2024-09-19T06:08:40.453 INFO:tasks.workunit.client.0.smithi037.stdout:2/165: truncate d1/d6/f12 2200864 0 2024-09-19T06:08:40.453 INFO:tasks.workunit.client.0.smithi037.stdout:3/105: write d0/f18 [529214,19305] 0 2024-09-19T06:08:40.454 INFO:tasks.workunit.client.0.smithi037.stdout:5/127: mkdir d2/d12/d24/d2a 0 2024-09-19T06:08:40.454 INFO:tasks.workunit.client.0.smithi037.stdout:5/128: write d2/d12/f27 [993983,57186] 0 2024-09-19T06:08:40.454 INFO:tasks.workunit.client.0.smithi037.stdout:2/166: unlink d1/d16/c23 0 2024-09-19T06:08:40.455 INFO:tasks.workunit.client.0.smithi037.stdout:3/106: creat d0/d16/f22 x:0 0 0 2024-09-19T06:08:40.456 INFO:tasks.workunit.client.0.smithi037.stdout:3/107: dread - d0/f21 zero size 2024-09-19T06:08:40.456 INFO:tasks.workunit.client.0.smithi037.stdout:5/129: creat d2/f2b x:0 0 0 2024-09-19T06:08:40.458 INFO:tasks.workunit.client.0.smithi037.stdout:2/167: rename d1/da/f1b to d1/da/dc/d21/f3c 0 2024-09-19T06:08:40.459 INFO:tasks.workunit.client.0.smithi037.stdout:2/168: dread - d1/d6/f24 zero size 2024-09-19T06:08:40.459 INFO:tasks.workunit.client.0.smithi037.stdout:3/108: getdents d0/d16/d19 0 2024-09-19T06:08:40.459 INFO:tasks.workunit.client.0.smithi037.stdout:3/109: truncate d0/d16/f22 87578 0 2024-09-19T06:08:40.460 INFO:tasks.workunit.client.0.smithi037.stdout:5/130: rmdir d2/d12 39 2024-09-19T06:08:40.461 INFO:tasks.workunit.client.0.smithi037.stdout:5/131: fdatasync d2/d12/d28/f29 0 2024-09-19T06:08:40.463 INFO:tasks.workunit.client.0.smithi037.stdout:3/110: mkdir d0/d16/d19/d1f/d23 0 2024-09-19T06:08:40.463 INFO:tasks.workunit.client.0.smithi037.stdout:3/111: write d0/f9 [4454188,28494] 0 2024-09-19T06:08:40.463 INFO:tasks.workunit.client.0.smithi037.stdout:5/132: rmdir d2 39 2024-09-19T06:08:40.465 INFO:tasks.workunit.client.0.smithi037.stdout:3/112: symlink d0/d16/l24 0 2024-09-19T06:08:40.465 INFO:tasks.workunit.client.0.smithi037.stdout:3/113: chown d0/d16/d20 25290 1 2024-09-19T06:08:40.465 INFO:tasks.workunit.client.0.smithi037.stdout:5/133: truncate d2/d10/f19 438391 0 2024-09-19T06:08:40.465 INFO:tasks.workunit.client.0.smithi037.stdout:5/134: chown d2/f23 677880858 1 2024-09-19T06:08:40.466 INFO:tasks.workunit.client.0.smithi037.stdout:3/114: creat d0/f25 x:0 0 0 2024-09-19T06:08:40.466 INFO:tasks.workunit.client.0.smithi037.stdout:3/115: readlink d0/d16/l24 0 2024-09-19T06:08:40.466 INFO:tasks.workunit.client.0.smithi037.stdout:3/116: fdatasync d0/d16/f22 0 2024-09-19T06:08:40.467 INFO:tasks.workunit.client.0.smithi037.stdout:5/135: creat d2/d12/d28/d22/f2c x:0 0 0 2024-09-19T06:08:40.467 INFO:tasks.workunit.client.0.smithi037.stdout:5/136: write d2/d12/d28/f29 [997306,96307] 0 2024-09-19T06:08:40.467 INFO:tasks.workunit.client.0.smithi037.stdout:5/137: write d2/f2b [178897,55860] 0 2024-09-19T06:08:40.467 INFO:tasks.workunit.client.0.smithi037.stdout:3/117: chown d0/c5 1796315 1 2024-09-19T06:08:40.468 INFO:tasks.workunit.client.0.smithi037.stdout:5/138: unlink d2/l11 0 2024-09-19T06:08:40.468 INFO:tasks.workunit.client.0.smithi037.stdout:5/139: truncate d2/d12/f27 1721364 0 2024-09-19T06:08:40.469 INFO:tasks.workunit.client.0.smithi037.stdout:3/118: mkdir d0/d16/d19/d1f/d26 0 2024-09-19T06:08:40.469 INFO:tasks.workunit.client.0.smithi037.stdout:3/119: chown d0/f14 1008 1 2024-09-19T06:08:40.471 INFO:tasks.workunit.client.0.smithi037.stdout:3/120: rename d0/f21 to d0/d16/d19/d1d/f27 0 2024-09-19T06:08:40.479 INFO:tasks.workunit.client.0.smithi037.stdout:0/108: dwrite d5/d8/fb [0,4194304] 0 2024-09-19T06:08:40.482 INFO:tasks.workunit.client.0.smithi037.stdout:0/109: link d5/d8/l9 d5/d8/d11/l26 0 2024-09-19T06:08:40.483 INFO:tasks.workunit.client.0.smithi037.stdout:2/169: dwrite d1/f1e [0,4194304] 0 2024-09-19T06:08:40.486 INFO:tasks.workunit.client.0.smithi037.stdout:0/110: dread f4 [8388608,4194304] 0 2024-09-19T06:08:40.493 INFO:tasks.workunit.client.0.smithi037.stdout:9/129: sync 2024-09-19T06:08:40.493 INFO:tasks.workunit.client.0.smithi037.stdout:4/90: sync 2024-09-19T06:08:40.495 INFO:tasks.workunit.client.0.smithi037.stdout:4/91: rename d0/d6/d1b/l1f to d0/l25 0 2024-09-19T06:08:40.504 INFO:tasks.workunit.client.0.smithi037.stdout:0/111: dread d5/d8/fb [0,4194304] 0 2024-09-19T06:08:40.505 INFO:tasks.workunit.client.0.smithi037.stdout:9/130: dread da/dd/d1b/f21 [0,4194304] 0 2024-09-19T06:08:40.505 INFO:tasks.workunit.client.0.smithi037.stdout:9/131: rmdir da/d20 39 2024-09-19T06:08:40.505 INFO:tasks.workunit.client.0.smithi037.stdout:9/132: chown da/dd/d1b/d23/f24 41838 1 2024-09-19T06:08:40.505 INFO:tasks.workunit.client.0.smithi037.stdout:9/133: readlink da/dd/l1e 0 2024-09-19T06:08:40.506 INFO:tasks.workunit.client.0.smithi037.stdout:0/112: mknod d5/c27 0 2024-09-19T06:08:40.507 INFO:tasks.workunit.client.0.smithi037.stdout:0/113: link d5/d17/c1d d5/d17/c28 0 2024-09-19T06:08:40.513 INFO:tasks.workunit.client.0.smithi037.stdout:3/121: dwrite d0/ff [4194304,4194304] 0 2024-09-19T06:08:40.514 INFO:tasks.workunit.client.0.smithi037.stdout:3/122: truncate d0/fc 210776 0 2024-09-19T06:08:40.515 INFO:tasks.workunit.client.0.smithi037.stdout:2/170: dwrite d1/da/dc/f18 [0,4194304] 0 2024-09-19T06:08:40.516 INFO:tasks.workunit.client.0.smithi037.stdout:3/123: creat d0/d16/d19/f28 x:0 0 0 2024-09-19T06:08:40.517 INFO:tasks.workunit.client.0.smithi037.stdout:2/171: creat d1/d16/f3d x:0 0 0 2024-09-19T06:08:40.518 INFO:tasks.workunit.client.0.smithi037.stdout:3/124: truncate d0/f2 280402 0 2024-09-19T06:08:40.520 INFO:tasks.workunit.client.0.smithi037.stdout:2/172: creat d1/da/f3e x:0 0 0 2024-09-19T06:08:40.520 INFO:tasks.workunit.client.0.smithi037.stdout:2/173: readlink d1/da/l39 0 2024-09-19T06:08:40.521 INFO:tasks.workunit.client.0.smithi037.stdout:4/92: dwrite d0/d2/fb [0,4194304] 0 2024-09-19T06:08:40.521 INFO:tasks.workunit.client.0.smithi037.stdout:4/93: readlink d0/d2/l5 0 2024-09-19T06:08:40.524 INFO:tasks.workunit.client.0.smithi037.stdout:2/174: symlink d1/d6/l3f 0 2024-09-19T06:08:40.524 INFO:tasks.workunit.client.0.smithi037.stdout:2/175: chown d1/d16/f1c 5268991 1 2024-09-19T06:08:40.532 INFO:tasks.workunit.client.0.smithi037.stdout:9/134: dwrite da/fe [0,4194304] 0 2024-09-19T06:08:40.532 INFO:tasks.workunit.client.0.smithi037.stdout:9/135: chown da 0 1 2024-09-19T06:08:40.533 INFO:tasks.workunit.client.0.smithi037.stdout:9/136: rmdir da 39 2024-09-19T06:08:40.535 INFO:tasks.workunit.client.0.smithi037.stdout:4/94: truncate d0/d2/fb 2353242 0 2024-09-19T06:08:40.535 INFO:tasks.workunit.client.0.smithi037.stdout:0/114: dwrite f4 [0,4194304] 0 2024-09-19T06:08:40.536 INFO:tasks.workunit.client.0.smithi037.stdout:9/137: getdents da 0 2024-09-19T06:08:40.538 INFO:tasks.workunit.client.0.smithi037.stdout:9/138: creat da/d20/f2a x:0 0 0 2024-09-19T06:08:40.557 INFO:tasks.workunit.client.0.smithi037.stdout:4/95: dread d0/d2/f19 [0,4194304] 0 2024-09-19T06:08:40.557 INFO:tasks.workunit.client.0.smithi037.stdout:3/125: dwrite d0/d16/d19/f28 [0,4194304] 0 2024-09-19T06:08:40.559 INFO:tasks.workunit.client.0.smithi037.stdout:4/96: unlink d0/d6/d1b/l1e 0 2024-09-19T06:08:40.560 INFO:tasks.workunit.client.0.smithi037.stdout:3/126: creat d0/d16/d19/f29 x:0 0 0 2024-09-19T06:08:40.561 INFO:tasks.workunit.client.0.smithi037.stdout:4/97: creat d0/d6/f26 x:0 0 0 2024-09-19T06:08:40.562 INFO:tasks.workunit.client.0.smithi037.stdout:3/127: creat d0/d16/d19/d1f/d23/f2a x:0 0 0 2024-09-19T06:08:40.563 INFO:tasks.workunit.client.0.smithi037.stdout:4/98: rename d0/d2/f7 to d0/f27 0 2024-09-19T06:08:40.563 INFO:tasks.workunit.client.0.smithi037.stdout:4/99: fdatasync d0/d2/f1d 0 2024-09-19T06:08:40.563 INFO:tasks.workunit.client.0.smithi037.stdout:3/128: creat d0/d16/d20/f2b x:0 0 0 2024-09-19T06:08:40.563 INFO:tasks.workunit.client.0.smithi037.stdout:3/129: truncate d0/d16/d19/d1d/f27 511617 0 2024-09-19T06:08:40.564 INFO:tasks.workunit.client.0.smithi037.stdout:0/115: dwrite d5/d8/d11/d15/f1c [0,4194304] 0 2024-09-19T06:08:40.564 INFO:tasks.workunit.client.0.smithi037.stdout:9/139: dwrite da/fc [0,4194304] 0 2024-09-19T06:08:40.565 INFO:tasks.workunit.client.0.smithi037.stdout:4/100: unlink d0/l12 0 2024-09-19T06:08:40.565 INFO:tasks.workunit.client.0.smithi037.stdout:3/130: creat d0/d16/d19/f2c x:0 0 0 2024-09-19T06:08:40.567 INFO:tasks.workunit.client.0.smithi037.stdout:0/116: rename f4 to d5/d8/d11/d15/d21/f29 0 2024-09-19T06:08:40.567 INFO:tasks.workunit.client.0.smithi037.stdout:0/117: truncate d5/d8/d11/f16 851752 0 2024-09-19T06:08:40.568 INFO:tasks.workunit.client.0.smithi037.stdout:4/101: creat d0/d6/d1b/f28 x:0 0 0 2024-09-19T06:08:40.571 INFO:tasks.workunit.client.0.smithi037.stdout:0/118: rename d5/d8/d11/l26 to d5/l2a 0 2024-09-19T06:08:40.572 INFO:tasks.workunit.client.0.smithi037.stdout:4/102: creat d0/d6/d1b/f29 x:0 0 0 2024-09-19T06:08:40.577 INFO:tasks.workunit.client.0.smithi037.stdout:0/119: fsync d5/f7 0 2024-09-19T06:08:40.580 INFO:tasks.workunit.client.0.smithi037.stdout:4/103: write d0/d2/fb [1195144,122297] 0 2024-09-19T06:08:40.584 INFO:tasks.workunit.client.0.smithi037.stdout:3/131: dwrite d0/d16/d20/f2b [0,4194304] 0 2024-09-19T06:08:40.588 INFO:tasks.workunit.client.0.smithi037.stdout:4/104: readlink d0/l14 0 2024-09-19T06:08:40.589 INFO:tasks.workunit.client.0.smithi037.stdout:8/153: sync 2024-09-19T06:08:40.590 INFO:tasks.workunit.client.0.smithi037.stdout:4/105: symlink d0/d6/d1b/l2a 0 2024-09-19T06:08:40.590 INFO:tasks.workunit.client.0.smithi037.stdout:4/106: dread - d0/d6/f26 zero size 2024-09-19T06:08:40.591 INFO:tasks.workunit.client.0.smithi037.stdout:8/154: symlink d1/d11/l37 0 2024-09-19T06:08:40.591 INFO:tasks.workunit.client.0.smithi037.stdout:8/155: fdatasync d1/f10 0 2024-09-19T06:08:40.592 INFO:tasks.workunit.client.0.smithi037.stdout:0/120: read d5/d8/fb [2842992,108460] 0 2024-09-19T06:08:40.593 INFO:tasks.workunit.client.0.smithi037.stdout:8/156: mknod d1/d11/c38 0 2024-09-19T06:08:40.593 INFO:tasks.workunit.client.0.smithi037.stdout:8/157: write d1/d11/f16 [819224,75841] 0 2024-09-19T06:08:40.593 INFO:tasks.workunit.client.0.smithi037.stdout:0/121: dread d5/d8/d11/f16 [0,4194304] 0 2024-09-19T06:08:40.594 INFO:tasks.workunit.client.0.smithi037.stdout:0/122: mknod d5/d17/c2b 0 2024-09-19T06:08:40.595 INFO:tasks.workunit.client.0.smithi037.stdout:0/123: truncate d5/d8/d11/fe 4072320 0 2024-09-19T06:08:40.595 INFO:tasks.workunit.client.0.smithi037.stdout:0/124: fdatasync d5/d8/d11/d15/f1c 0 2024-09-19T06:08:40.595 INFO:tasks.workunit.client.0.smithi037.stdout:0/125: chown d5/l2a 251 1 2024-09-19T06:08:40.596 INFO:tasks.workunit.client.0.smithi037.stdout:0/126: mknod d5/d8/c2c 0 2024-09-19T06:08:40.598 INFO:tasks.workunit.client.0.smithi037.stdout:8/158: truncate d1/d11/f16 188788 0 2024-09-19T06:08:40.599 INFO:tasks.workunit.client.0.smithi037.stdout:3/132: dread d0/f7 [0,4194304] 0 2024-09-19T06:08:40.599 INFO:tasks.workunit.client.0.smithi037.stdout:3/133: fdatasync d0/d16/d19/d1f/d23/f2a 0 2024-09-19T06:08:40.600 INFO:tasks.workunit.client.0.smithi037.stdout:8/159: creat d1/d11/f39 x:0 0 0 2024-09-19T06:08:40.601 INFO:tasks.workunit.client.0.smithi037.stdout:3/134: creat d0/d16/d19/d1d/f2d x:0 0 0 2024-09-19T06:08:40.603 INFO:tasks.workunit.client.0.smithi037.stdout:8/160: symlink d1/l3a 0 2024-09-19T06:08:40.606 INFO:tasks.workunit.client.0.smithi037.stdout:4/107: dread d0/d2/f1a [0,4194304] 0 2024-09-19T06:08:40.612 INFO:tasks.workunit.client.0.smithi037.stdout:3/135: creat d0/d16/d19/f2e x:0 0 0 2024-09-19T06:08:40.613 INFO:tasks.workunit.client.0.smithi037.stdout:4/108: creat d0/d2/f2b x:0 0 0 2024-09-19T06:08:40.616 INFO:tasks.workunit.client.0.smithi037.stdout:0/127: dread d5/f7 [4194304,4194304] 0 2024-09-19T06:08:40.616 INFO:tasks.workunit.client.0.smithi037.stdout:4/109: rename d0/d2/f4 to d0/d2/f2c 0 2024-09-19T06:08:40.616 INFO:tasks.workunit.client.0.smithi037.stdout:4/110: truncate d0/d6/f23 462356 0 2024-09-19T06:08:40.616 INFO:tasks.workunit.client.0.smithi037.stdout:3/136: mknod d0/c2f 0 2024-09-19T06:08:40.616 INFO:tasks.workunit.client.0.smithi037.stdout:0/128: symlink d5/d8/l2d 0 2024-09-19T06:08:40.617 INFO:tasks.workunit.client.0.smithi037.stdout:4/111: symlink d0/d6/d1b/l2d 0 2024-09-19T06:08:40.617 INFO:tasks.workunit.client.0.smithi037.stdout:4/112: readlink d0/d6/l10 0 2024-09-19T06:08:40.618 INFO:tasks.workunit.client.0.smithi037.stdout:3/137: getdents d0/d16/d20 0 2024-09-19T06:08:40.627 INFO:tasks.workunit.client.0.smithi037.stdout:3/138: write d0/f7 [1470703,73687] 0 2024-09-19T06:08:40.627 INFO:tasks.workunit.client.0.smithi037.stdout:8/161: dwrite d1/d11/f2f [0,4194304] 0 2024-09-19T06:08:40.630 INFO:tasks.workunit.client.0.smithi037.stdout:8/162: creat d1/d35/d36/f3b x:0 0 0 2024-09-19T06:08:40.630 INFO:tasks.workunit.client.0.smithi037.stdout:8/163: write d1/f32 [174300,105349] 0 2024-09-19T06:08:40.630 INFO:tasks.workunit.client.0.smithi037.stdout:8/164: chown d1/d11/f19 1243 1 2024-09-19T06:08:40.632 INFO:tasks.workunit.client.0.smithi037.stdout:4/113: read d0/d2/f2c [1314969,80315] 0 2024-09-19T06:08:40.639 INFO:tasks.workunit.client.0.smithi037.stdout:0/129: read d5/d8/d11/fe [103092,64713] 0 2024-09-19T06:08:40.640 INFO:tasks.workunit.client.0.smithi037.stdout:0/130: write d5/f7 [4201842,64832] 0 2024-09-19T06:08:40.640 INFO:tasks.workunit.client.0.smithi037.stdout:0/131: chown d5/l6 1735426358 1 2024-09-19T06:08:40.647 INFO:tasks.workunit.client.0.smithi037.stdout:4/114: dread d0/d2/f2c [0,4194304] 0 2024-09-19T06:08:40.647 INFO:tasks.workunit.client.0.smithi037.stdout:4/115: write d0/d6/d1b/f29 [31010,10292] 0 2024-09-19T06:08:40.647 INFO:tasks.workunit.client.0.smithi037.stdout:0/132: symlink d5/d20/l2e 0 2024-09-19T06:08:40.648 INFO:tasks.workunit.client.0.smithi037.stdout:8/165: read d1/d11/f29 [2640190,62745] 0 2024-09-19T06:08:40.648 INFO:tasks.workunit.client.0.smithi037.stdout:4/116: fsync d0/f16 0 2024-09-19T06:08:40.649 INFO:tasks.workunit.client.0.smithi037.stdout:0/133: symlink d5/d8/d22/l2f 0 2024-09-19T06:08:40.649 INFO:tasks.workunit.client.0.smithi037.stdout:0/134: dread - d5/ff zero size 2024-09-19T06:08:40.649 INFO:tasks.workunit.client.0.smithi037.stdout:0/135: truncate d5/d8/d11/d15/f1e 69289 0 2024-09-19T06:08:40.649 INFO:tasks.workunit.client.0.smithi037.stdout:8/166: creat d1/d11/f3c x:0 0 0 2024-09-19T06:08:40.649 INFO:tasks.workunit.client.0.smithi037.stdout:8/167: dread - d1/d11/f2e zero size 2024-09-19T06:08:40.650 INFO:tasks.workunit.client.0.smithi037.stdout:4/117: mkdir d0/d2/d2e 0 2024-09-19T06:08:40.650 INFO:tasks.workunit.client.0.smithi037.stdout:8/168: getdents d1 0 2024-09-19T06:08:40.651 INFO:tasks.workunit.client.0.smithi037.stdout:8/169: chown d1/f24 0 1 2024-09-19T06:08:40.653 INFO:tasks.workunit.client.0.smithi037.stdout:4/118: creat d0/d6/d1b/d21/f2f x:0 0 0 2024-09-19T06:08:40.654 INFO:tasks.workunit.client.0.smithi037.stdout:4/119: mkdir d0/d6/d1b/d30 0 2024-09-19T06:08:40.654 INFO:tasks.workunit.client.0.smithi037.stdout:4/120: mknod d0/d6/d1b/d21/c31 0 2024-09-19T06:08:40.656 INFO:tasks.workunit.client.0.smithi037.stdout:4/121: creat d0/d6/d1b/d30/f32 x:0 0 0 2024-09-19T06:08:40.657 INFO:tasks.workunit.client.0.smithi037.stdout:4/122: rename d0/d6/l18 to d0/d6/l33 0 2024-09-19T06:08:40.659 INFO:tasks.workunit.client.0.smithi037.stdout:4/123: mknod d0/c34 0 2024-09-19T06:08:40.660 INFO:tasks.workunit.client.0.smithi037.stdout:4/124: rename d0/l14 to d0/d2/l35 0 2024-09-19T06:08:40.660 INFO:tasks.workunit.client.0.smithi037.stdout:4/125: write d0/f27 [12792242,55324] 0 2024-09-19T06:08:40.663 INFO:tasks.workunit.client.0.smithi037.stdout:0/136: write d5/fd [556461,40560] 0 2024-09-19T06:08:40.663 INFO:tasks.workunit.client.0.smithi037.stdout:8/170: dread d1/d11/f2f [0,4194304] 0 2024-09-19T06:08:40.664 INFO:tasks.workunit.client.0.smithi037.stdout:0/137: mknod d5/d8/d11/c30 0 2024-09-19T06:08:40.666 INFO:tasks.workunit.client.0.smithi037.stdout:4/126: rename d0/d6/d1b/d21 to d0/d2/d2e/d36 0 2024-09-19T06:08:40.668 INFO:tasks.workunit.client.0.smithi037.stdout:8/171: rename d1/d11 to d1/d35/d36/d3d 0 2024-09-19T06:08:40.668 INFO:tasks.workunit.client.0.smithi037.stdout:8/172: chown d1/f24 8 1 2024-09-19T06:08:40.677 INFO:tasks.workunit.client.0.smithi037.stdout:0/138: write d5/d8/d11/d15/d21/f29 [3598926,16505] 0 2024-09-19T06:08:40.679 INFO:tasks.workunit.client.0.smithi037.stdout:4/127: read d0/f27 [5276062,1754] 0 2024-09-19T06:08:40.679 INFO:tasks.workunit.client.0.smithi037.stdout:0/139: creat d5/d8/d11/d15/f31 x:0 0 0 2024-09-19T06:08:40.679 INFO:tasks.workunit.client.0.smithi037.stdout:0/140: chown d5/d18 5037 1 2024-09-19T06:08:40.679 INFO:tasks.workunit.client.0.smithi037.stdout:4/128: mkdir d0/d2/d37 0 2024-09-19T06:08:40.681 INFO:tasks.workunit.client.0.smithi037.stdout:0/141: mkdir d5/d8/d11/d32 0 2024-09-19T06:08:40.691 INFO:tasks.workunit.client.0.smithi037.stdout:8/173: dwrite d1/d35/d36/d3d/f16 [0,4194304] 0 2024-09-19T06:08:40.693 INFO:tasks.workunit.client.0.smithi037.stdout:8/174: symlink d1/d35/l3e 0 2024-09-19T06:08:40.702 INFO:tasks.workunit.client.0.smithi037.stdout:8/175: getdents d1/d35 0 2024-09-19T06:08:40.702 INFO:tasks.workunit.client.0.smithi037.stdout:4/129: dwrite d0/d6/f26 [0,4194304] 0 2024-09-19T06:08:40.705 INFO:tasks.workunit.client.0.smithi037.stdout:8/176: rename d1/d35/l3e to d1/l3f 0 2024-09-19T06:08:40.707 INFO:tasks.workunit.client.0.smithi037.stdout:0/142: dwrite d5/d8/fb [0,4194304] 0 2024-09-19T06:08:40.707 INFO:tasks.workunit.client.0.smithi037.stdout:8/177: creat d1/d35/d36/f40 x:0 0 0 2024-09-19T06:08:40.709 INFO:tasks.workunit.client.0.smithi037.stdout:0/143: fdatasync d5/fd 0 2024-09-19T06:08:40.710 INFO:tasks.workunit.client.0.smithi037.stdout:0/144: write d5/d8/d11/d15/d21/f29 [6257767,22302] 0 2024-09-19T06:08:40.714 INFO:tasks.workunit.client.0.smithi037.stdout:4/130: write d0/d2/f1a [1150308,18959] 0 2024-09-19T06:08:40.715 INFO:tasks.workunit.client.0.smithi037.stdout:6/83: sync 2024-09-19T06:08:40.717 INFO:tasks.workunit.client.0.smithi037.stdout:4/131: mknod d0/d6/d1b/d20/c38 0 2024-09-19T06:08:40.718 INFO:tasks.workunit.client.0.smithi037.stdout:6/84: creat d9/ff x:0 0 0 2024-09-19T06:08:40.719 INFO:tasks.workunit.client.0.smithi037.stdout:6/85: fdatasync d9/ff 0 2024-09-19T06:08:40.719 INFO:tasks.workunit.client.0.smithi037.stdout:6/86: dread - d9/ff zero size 2024-09-19T06:08:40.719 INFO:tasks.workunit.client.0.smithi037.stdout:7/53: sync 2024-09-19T06:08:40.719 INFO:tasks.workunit.client.0.smithi037.stdout:5/140: sync 2024-09-19T06:08:40.719 INFO:tasks.workunit.client.0.smithi037.stdout:9/140: sync 2024-09-19T06:08:40.719 INFO:tasks.workunit.client.0.smithi037.stdout:3/139: sync 2024-09-19T06:08:40.719 INFO:tasks.workunit.client.0.smithi037.stdout:2/176: sync 2024-09-19T06:08:40.719 INFO:tasks.workunit.client.0.smithi037.stdout:1/58: sync 2024-09-19T06:08:40.719 INFO:tasks.workunit.client.0.smithi037.stdout:9/141: chown da/dd/c14 24 1 2024-09-19T06:08:40.719 INFO:tasks.workunit.client.0.smithi037.stdout:2/177: dread - d1/d6/d2d/f31 zero size 2024-09-19T06:08:40.719 INFO:tasks.workunit.client.0.smithi037.stdout:9/142: fsync da/dd/d1b/f21 0 2024-09-19T06:08:40.719 INFO:tasks.workunit.client.0.smithi037.stdout:5/141: write d2/d10/f21 [949156,12643] 0 2024-09-19T06:08:40.719 INFO:tasks.workunit.client.0.smithi037.stdout:5/142: chown d2/d12 35015 1 2024-09-19T06:08:40.720 INFO:tasks.workunit.client.0.smithi037.stdout:1/59: write d2/f8 [513285,78903] 0 2024-09-19T06:08:40.720 INFO:tasks.workunit.client.0.smithi037.stdout:5/143: dread - d2/d12/d28/d22/f2c zero size 2024-09-19T06:08:40.720 INFO:tasks.workunit.client.0.smithi037.stdout:6/87: truncate f5 2253911 0 2024-09-19T06:08:40.721 INFO:tasks.workunit.client.0.smithi037.stdout:3/140: rename d0/f18 to d0/d16/f30 0 2024-09-19T06:08:40.721 INFO:tasks.workunit.client.0.smithi037.stdout:7/54: mkdir d6/d10 0 2024-09-19T06:08:40.721 INFO:tasks.workunit.client.0.smithi037.stdout:7/55: chown d6/f9 772193015 1 2024-09-19T06:08:40.721 INFO:tasks.workunit.client.0.smithi037.stdout:9/143: symlink da/l2b 0 2024-09-19T06:08:40.722 INFO:tasks.workunit.client.0.smithi037.stdout:1/60: mkdir d2/d12/d17/d19 0 2024-09-19T06:08:40.724 INFO:tasks.workunit.client.0.smithi037.stdout:1/61: symlink d2/d12/d17/d19/l1a 0 2024-09-19T06:08:40.724 INFO:tasks.workunit.client.0.smithi037.stdout:1/62: write d2/f11 [520119,19243] 0 2024-09-19T06:08:40.726 INFO:tasks.workunit.client.0.smithi037.stdout:1/63: symlink d2/d12/d17/l1b 0 2024-09-19T06:08:40.727 INFO:tasks.workunit.client.0.smithi037.stdout:1/64: stat d2/fe 0 2024-09-19T06:08:40.729 INFO:tasks.workunit.client.0.smithi037.stdout:4/132: dread d0/d2/f2c [0,4194304] 0 2024-09-19T06:08:40.731 INFO:tasks.workunit.client.0.smithi037.stdout:0/145: dread d5/f7 [0,4194304] 0 2024-09-19T06:08:40.731 INFO:tasks.workunit.client.0.smithi037.stdout:8/178: read d1/d35/d36/d3d/f34 [434436,940] 0 2024-09-19T06:08:40.732 INFO:tasks.workunit.client.0.smithi037.stdout:0/146: dread d5/d8/d11/d15/f1e [0,4194304] 0 2024-09-19T06:08:40.737 INFO:tasks.workunit.client.0.smithi037.stdout:4/133: rmdir d0/d2 39 2024-09-19T06:08:40.739 INFO:tasks.workunit.client.0.smithi037.stdout:8/179: symlink d1/l41 0 2024-09-19T06:08:40.741 INFO:tasks.workunit.client.0.smithi037.stdout:2/178: dread d1/da/f2a [0,4194304] 0 2024-09-19T06:08:40.744 INFO:tasks.workunit.client.0.smithi037.stdout:3/141: dread d0/f14 [0,4194304] 0 2024-09-19T06:08:40.744 INFO:tasks.workunit.client.0.smithi037.stdout:2/179: creat d1/d16/f40 x:0 0 0 2024-09-19T06:08:40.747 INFO:tasks.workunit.client.0.smithi037.stdout:2/180: mknod d1/da/dc/c41 0 2024-09-19T06:08:40.749 INFO:tasks.workunit.client.0.smithi037.stdout:3/142: link d0/l1e d0/l31 0 2024-09-19T06:08:40.749 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:08:40 smithi117 ceph-mon[35050]: pgmap v424: 129 pgs: 129 active+clean; 153 MiB data, 874 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 9.7 MiB/s wr, 706 op/s 2024-09-19T06:08:40.750 INFO:tasks.workunit.client.0.smithi037.stdout:2/181: mkdir d1/da/d42 0 2024-09-19T06:08:40.752 INFO:tasks.workunit.client.0.smithi037.stdout:2/182: creat d1/f43 x:0 0 0 2024-09-19T06:08:40.752 INFO:tasks.workunit.client.0.smithi037.stdout:7/56: dwrite d6/fa [0,4194304] 0 2024-09-19T06:08:40.753 INFO:tasks.workunit.client.0.smithi037.stdout:5/144: dwrite d2/d10/f19 [0,4194304] 0 2024-09-19T06:08:40.755 INFO:tasks.workunit.client.0.smithi037.stdout:1/65: dwrite d2/d12/f13 [0,4194304] 0 2024-09-19T06:08:40.757 INFO:tasks.workunit.client.0.smithi037.stdout:4/134: dread d0/f27 [4194304,4194304] 0 2024-09-19T06:08:40.758 INFO:tasks.workunit.client.0.smithi037.stdout:2/183: symlink d1/d16/l44 0 2024-09-19T06:08:40.758 INFO:tasks.workunit.client.0.smithi037.stdout:2/184: readlink d1/da/l39 0 2024-09-19T06:08:40.758 INFO:tasks.workunit.client.0.smithi037.stdout:2/185: chown f0 12289223 1 2024-09-19T06:08:40.759 INFO:tasks.workunit.client.0.smithi037.stdout:7/57: symlink d6/l11 0 2024-09-19T06:08:40.760 INFO:tasks.workunit.client.0.smithi037.stdout:7/58: write d6/dc/fd [194066,33372] 0 2024-09-19T06:08:40.761 INFO:tasks.workunit.client.0.smithi037.stdout:1/66: mknod d2/d12/d17/c1c 0 2024-09-19T06:08:40.761 INFO:tasks.workunit.client.0.smithi037.stdout:1/67: truncate d2/f16 619922 0 2024-09-19T06:08:40.762 INFO:tasks.workunit.client.0.smithi037.stdout:4/135: creat d0/d2/d37/f39 x:0 0 0 2024-09-19T06:08:40.762 INFO:tasks.workunit.client.0.smithi037.stdout:4/136: chown d0/d2/d2e/d36/f2f 115 1 2024-09-19T06:08:40.762 INFO:tasks.workunit.client.0.smithi037.stdout:4/137: fdatasync d0/f27 0 2024-09-19T06:08:40.762 INFO:tasks.workunit.client.0.smithi037.stdout:6/88: dwrite f5 [0,4194304] 0 2024-09-19T06:08:40.763 INFO:tasks.workunit.client.0.smithi037.stdout:2/186: link d1/d6/fe d1/da/dc/f45 0 2024-09-19T06:08:40.763 INFO:tasks.workunit.client.0.smithi037.stdout:1/68: write d2/f9 [34358,110886] 0 2024-09-19T06:08:40.764 INFO:tasks.workunit.client.0.smithi037.stdout:4/138: getdents d0/d6/d1b 0 2024-09-19T06:08:40.764 INFO:tasks.workunit.client.0.smithi037.stdout:8/180: write d1/d35/d36/d3d/f14 [3028051,128806] 0 2024-09-19T06:08:40.764 INFO:tasks.workunit.client.0.smithi037.stdout:8/181: fsync d1/d35/d36/d3d/f2f 0 2024-09-19T06:08:40.765 INFO:tasks.workunit.client.0.smithi037.stdout:6/89: symlink d9/dd/l10 0 2024-09-19T06:08:40.765 INFO:tasks.workunit.client.0.smithi037.stdout:6/90: write f5 [4640616,72410] 0 2024-09-19T06:08:40.765 INFO:tasks.workunit.client.0.smithi037.stdout:7/59: dread f4 [0,4194304] 0 2024-09-19T06:08:40.767 INFO:tasks.workunit.client.0.smithi037.stdout:2/187: rename d1/d6/c13 to d1/da/c46 0 2024-09-19T06:08:40.767 INFO:tasks.workunit.client.0.smithi037.stdout:2/188: chown d1/da/c46 22618877 1 2024-09-19T06:08:40.767 INFO:tasks.workunit.client.0.smithi037.stdout:1/69: mkdir d2/d12/d1d 0 2024-09-19T06:08:40.768 INFO:tasks.workunit.client.0.smithi037.stdout:4/139: getdents d0/d6/d1b/d30 0 2024-09-19T06:08:40.769 INFO:tasks.workunit.client.0.smithi037.stdout:8/182: mknod d1/c42 0 2024-09-19T06:08:40.770 INFO:tasks.workunit.client.0.smithi037.stdout:7/60: creat d6/f12 x:0 0 0 2024-09-19T06:08:40.771 INFO:tasks.workunit.client.0.smithi037.stdout:2/189: mkdir d1/d47 0 2024-09-19T06:08:40.772 INFO:tasks.workunit.client.0.smithi037.stdout:1/70: mkdir d2/d12/d1e 0 2024-09-19T06:08:40.773 INFO:tasks.workunit.client.0.smithi037.stdout:4/140: creat d0/d6/f3a x:0 0 0 2024-09-19T06:08:40.774 INFO:tasks.workunit.client.0.smithi037.stdout:8/183: creat d1/f43 x:0 0 0 2024-09-19T06:08:40.774 INFO:tasks.workunit.client.0.smithi037.stdout:8/184: write d1/f1e [355933,38547] 0 2024-09-19T06:08:40.774 INFO:tasks.workunit.client.0.smithi037.stdout:8/185: chown d1/l1c 14650031 1 2024-09-19T06:08:40.774 INFO:tasks.workunit.client.0.smithi037.stdout:3/143: dwrite d0/d16/f22 [0,4194304] 0 2024-09-19T06:08:40.776 INFO:tasks.workunit.client.0.smithi037.stdout:7/61: link f4 d6/dc/df/f13 0 2024-09-19T06:08:40.776 INFO:tasks.workunit.client.0.smithi037.stdout:7/62: chown d6/dc/fd 31 1 2024-09-19T06:08:40.776 INFO:tasks.workunit.client.0.smithi037.stdout:7/63: chown d6/f9 30 1 2024-09-19T06:08:40.776 INFO:tasks.workunit.client.0.smithi037.stdout:2/190: rename d1/da/f2c to d1/da/d42/f48 0 2024-09-19T06:08:40.787 INFO:tasks.workunit.client.0.smithi037.stdout:6/91: write f4 [1650155,49148] 0 2024-09-19T06:08:40.787 INFO:tasks.workunit.client.0.smithi037.stdout:6/92: chown f4 2 1 2024-09-19T06:08:40.788 INFO:tasks.workunit.client.0.smithi037.stdout:4/141: symlink d0/d2/l3b 0 2024-09-19T06:08:40.788 INFO:tasks.workunit.client.0.smithi037.stdout:8/186: truncate d1/f6 2491784 0 2024-09-19T06:08:40.788 INFO:tasks.workunit.client.0.smithi037.stdout:8/187: stat d1/d35/d36/d3d/c21 0 2024-09-19T06:08:40.788 INFO:tasks.workunit.client.0.smithi037.stdout:1/71: rename d2/f14 to d2/d12/d1d/f1f 0 2024-09-19T06:08:40.788 INFO:tasks.workunit.client.0.smithi037.stdout:8/188: dread - d1/d35/d36/d3d/f2c zero size 2024-09-19T06:08:40.788 INFO:tasks.workunit.client.0.smithi037.stdout:2/191: truncate d1/da/dc/f45 6997699 0 2024-09-19T06:08:40.788 INFO:tasks.workunit.client.0.smithi037.stdout:4/142: chown d0/l8 1247611 1 2024-09-19T06:08:40.789 INFO:tasks.workunit.client.0.smithi037.stdout:8/189: symlink d1/l44 0 2024-09-19T06:08:40.789 INFO:tasks.workunit.client.0.smithi037.stdout:2/192: symlink d1/d6/l49 0 2024-09-19T06:08:40.794 INFO:tasks.workunit.client.0.smithi037.stdout:6/93: rename f4 to d9/f11 0 2024-09-19T06:08:40.794 INFO:tasks.workunit.client.0.smithi037.stdout:6/94: truncate d9/ff 99993 0 2024-09-19T06:08:40.794 INFO:tasks.workunit.client.0.smithi037.stdout:6/95: chown d9/la 110928 1 2024-09-19T06:08:40.794 INFO:tasks.workunit.client.0.smithi037.stdout:2/193: mkdir d1/d16/d4a 0 2024-09-19T06:08:40.795 INFO:tasks.workunit.client.0.smithi037.stdout:2/194: truncate d1/da/f19 2582179 0 2024-09-19T06:08:40.795 INFO:tasks.workunit.client.0.smithi037.stdout:2/195: write d1/da/f3e [860675,115825] 0 2024-09-19T06:08:40.796 INFO:tasks.workunit.client.0.smithi037.stdout:8/190: rename d1/f7 to d1/d35/d36/d3d/f45 0 2024-09-19T06:08:40.797 INFO:tasks.workunit.client.0.smithi037.stdout:8/191: read d1/f1e [386841,52876] 0 2024-09-19T06:08:40.797 INFO:tasks.workunit.client.0.smithi037.stdout:2/196: mknod d1/d6/c4b 0 2024-09-19T06:08:40.797 INFO:tasks.workunit.client.0.smithi037.stdout:8/192: mknod d1/d35/d36/c46 0 2024-09-19T06:08:40.798 INFO:tasks.workunit.client.0.smithi037.stdout:8/193: chown d1/f43 47942239 1 2024-09-19T06:08:40.798 INFO:tasks.workunit.client.0.smithi037.stdout:8/194: chown d1/l44 0 1 2024-09-19T06:08:40.798 INFO:tasks.workunit.client.0.smithi037.stdout:2/197: mkdir d1/d33/d4c 0 2024-09-19T06:08:40.799 INFO:tasks.workunit.client.0.smithi037.stdout:2/198: readlink d1/da/l27 0 2024-09-19T06:08:40.800 INFO:tasks.workunit.client.0.smithi037.stdout:2/199: read - d1/da/dc/d21/f3c zero size 2024-09-19T06:08:40.800 INFO:tasks.workunit.client.0.smithi037.stdout:2/200: truncate d1/fd 7276052 0 2024-09-19T06:08:40.803 INFO:tasks.workunit.client.0.smithi037.stdout:7/64: dwrite d6/fa [4194304,4194304] 0 2024-09-19T06:08:40.803 INFO:tasks.workunit.client.0.smithi037.stdout:7/65: chown d6/c7 18234556 1 2024-09-19T06:08:40.805 INFO:tasks.workunit.client.0.smithi037.stdout:6/96: unlink d9/f11 0 2024-09-19T06:08:40.805 INFO:tasks.workunit.client.0.smithi037.stdout:6/97: stat l6 0 2024-09-19T06:08:40.806 INFO:tasks.workunit.client.0.smithi037.stdout:6/98: fdatasync d9/fc 0 2024-09-19T06:08:40.806 INFO:tasks.workunit.client.0.smithi037.stdout:7/66: creat d6/dc/f14 x:0 0 0 2024-09-19T06:08:40.807 INFO:tasks.workunit.client.0.smithi037.stdout:7/67: dread - d6/f12 zero size 2024-09-19T06:08:40.807 INFO:tasks.workunit.client.0.smithi037.stdout:3/144: dwrite d0/f17 [0,4194304] 0 2024-09-19T06:08:40.807 INFO:tasks.workunit.client.0.smithi037.stdout:7/68: mknod d6/d10/c15 0 2024-09-19T06:08:40.808 INFO:tasks.workunit.client.0.smithi037.stdout:7/69: write d6/dc/f14 [623623,38084] 0 2024-09-19T06:08:40.816 INFO:tasks.workunit.client.0.smithi037.stdout:6/99: dread d9/fc [0,4194304] 0 2024-09-19T06:08:40.818 INFO:tasks.workunit.client.0.smithi037.stdout:6/100: creat d9/dd/f12 x:0 0 0 2024-09-19T06:08:40.818 INFO:tasks.workunit.client.0.smithi037.stdout:6/101: fdatasync d9/dd/f12 0 2024-09-19T06:08:40.818 INFO:tasks.workunit.client.0.smithi037.stdout:6/102: chown l2 1 1 2024-09-19T06:08:40.820 INFO:tasks.workunit.client.0.smithi037.stdout:6/103: symlink d9/dd/l13 0 2024-09-19T06:08:40.820 INFO:tasks.workunit.client.0.smithi037.stdout:6/104: stat f5 0 2024-09-19T06:08:40.820 INFO:tasks.workunit.client.0.smithi037.stdout:6/105: stat d9/dd/l10 0 2024-09-19T06:08:40.821 INFO:tasks.workunit.client.0.smithi037.stdout:6/106: truncate d9/fc 156362 0 2024-09-19T06:08:40.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:08:40 smithi037 ceph-mon[31211]: pgmap v424: 129 pgs: 129 active+clean; 153 MiB data, 874 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 9.7 MiB/s wr, 706 op/s 2024-09-19T06:08:40.826 INFO:tasks.workunit.client.0.smithi037.stdout:8/195: dwrite d1/d35/d36/d3d/f45 [0,4194304] 0 2024-09-19T06:08:40.828 INFO:tasks.workunit.client.0.smithi037.stdout:8/196: rename d1/l3f to d1/d35/d36/l47 0 2024-09-19T06:08:40.828 INFO:tasks.workunit.client.0.smithi037.stdout:8/197: write d1/d35/d36/d3d/f22 [3122736,102336] 0 2024-09-19T06:08:40.830 INFO:tasks.workunit.client.0.smithi037.stdout:8/198: mknod d1/d35/d36/c48 0 2024-09-19T06:08:40.832 INFO:tasks.workunit.client.0.smithi037.stdout:8/199: rmdir d1 39 2024-09-19T06:08:40.833 INFO:tasks.workunit.client.0.smithi037.stdout:2/201: dread d1/fd [0,4194304] 0 2024-09-19T06:08:40.833 INFO:tasks.workunit.client.0.smithi037.stdout:4/143: dwrite d0/d2/f2b [0,4194304] 0 2024-09-19T06:08:40.835 INFO:tasks.workunit.client.0.smithi037.stdout:7/70: write d6/dc/fe [7789482,96138] 0 2024-09-19T06:08:40.836 INFO:tasks.workunit.client.0.smithi037.stdout:7/71: stat d6/d10 0 2024-09-19T06:08:40.837 INFO:tasks.workunit.client.0.smithi037.stdout:1/72: dwrite d2/fe [0,4194304] 0 2024-09-19T06:08:40.837 INFO:tasks.workunit.client.0.smithi037.stdout:8/200: symlink d1/d35/d36/l49 0 2024-09-19T06:08:40.837 INFO:tasks.workunit.client.0.smithi037.stdout:8/201: fdatasync d1/f43 0 2024-09-19T06:08:40.839 INFO:tasks.workunit.client.0.smithi037.stdout:2/202: truncate d1/da/dc/f15 119553 0 2024-09-19T06:08:40.840 INFO:tasks.workunit.client.0.smithi037.stdout:4/144: mknod d0/d2/d37/c3c 0 2024-09-19T06:08:40.841 INFO:tasks.workunit.client.0.smithi037.stdout:6/107: write f5 [3818623,36890] 0 2024-09-19T06:08:40.841 INFO:tasks.workunit.client.0.smithi037.stdout:6/108: chown l6 410051 1 2024-09-19T06:08:40.842 INFO:tasks.workunit.client.0.smithi037.stdout:1/73: write d2/f11 [417838,93914] 0 2024-09-19T06:08:40.842 INFO:tasks.workunit.client.0.smithi037.stdout:1/74: chown d2/d12/d1d 22 1 2024-09-19T06:08:40.842 INFO:tasks.workunit.client.0.smithi037.stdout:4/145: truncate d0/f24 775416 0 2024-09-19T06:08:40.843 INFO:tasks.workunit.client.0.smithi037.stdout:8/202: dread d1/f2a [0,4194304] 0 2024-09-19T06:08:40.844 INFO:tasks.workunit.client.0.smithi037.stdout:1/75: rename d2/d12/d17/d19/l1a to d2/d12/d1d/l20 0 2024-09-19T06:08:40.845 INFO:tasks.workunit.client.0.smithi037.stdout:8/203: mknod d1/c4a 0 2024-09-19T06:08:40.846 INFO:tasks.workunit.client.0.smithi037.stdout:1/76: write d2/fb [557213,12613] 0 2024-09-19T06:08:40.852 INFO:tasks.workunit.client.0.smithi037.stdout:2/203: dread d1/da/f2a [0,4194304] 0 2024-09-19T06:08:40.852 INFO:tasks.workunit.client.0.smithi037.stdout:2/204: readlink d1/da/dc/d21/l22 0 2024-09-19T06:08:40.855 INFO:tasks.workunit.client.0.smithi037.stdout:7/72: read d6/fa [2852661,5962] 0 2024-09-19T06:08:40.856 INFO:tasks.workunit.client.0.smithi037.stdout:1/77: creat d2/d12/f21 x:0 0 0 2024-09-19T06:08:40.858 INFO:tasks.workunit.client.0.smithi037.stdout:7/73: creat d6/dc/f16 x:0 0 0 2024-09-19T06:08:40.858 INFO:tasks.workunit.client.0.smithi037.stdout:7/74: write d6/dc/f14 [1578526,91263] 0 2024-09-19T06:08:40.859 INFO:tasks.workunit.client.0.smithi037.stdout:7/75: rename d6/cb to d6/c17 0 2024-09-19T06:08:40.860 INFO:tasks.workunit.client.0.smithi037.stdout:7/76: mknod d6/dc/c18 0 2024-09-19T06:08:40.860 INFO:tasks.workunit.client.0.smithi037.stdout:7/77: stat d6/dc/fe 0 2024-09-19T06:08:40.860 INFO:tasks.workunit.client.0.smithi037.stdout:7/78: fsync d6/f12 0 2024-09-19T06:08:40.860 INFO:tasks.workunit.client.0.smithi037.stdout:7/79: symlink d6/l19 0 2024-09-19T06:08:40.861 INFO:tasks.workunit.client.0.smithi037.stdout:7/80: link f4 d6/d10/f1a 0 2024-09-19T06:08:40.862 INFO:tasks.workunit.client.0.smithi037.stdout:7/81: creat d6/dc/f1b x:0 0 0 2024-09-19T06:08:40.867 INFO:tasks.workunit.client.0.smithi037.stdout:8/204: dwrite d1/f10 [0,4194304] 0 2024-09-19T06:08:40.870 INFO:tasks.workunit.client.0.smithi037.stdout:8/205: rename d1/d35/d36/f40 to d1/f4b 0 2024-09-19T06:08:40.871 INFO:tasks.workunit.client.0.smithi037.stdout:8/206: creat d1/f4c x:0 0 0 2024-09-19T06:08:40.872 INFO:tasks.workunit.client.0.smithi037.stdout:8/207: creat d1/d35/f4d x:0 0 0 2024-09-19T06:08:40.873 INFO:tasks.workunit.client.0.smithi037.stdout:8/208: link d1/d35/d36/d3d/c21 d1/d35/d36/c4e 0 2024-09-19T06:08:40.874 INFO:tasks.workunit.client.0.smithi037.stdout:8/209: stat d1/l4 0 2024-09-19T06:08:40.874 INFO:tasks.workunit.client.0.smithi037.stdout:8/210: write d1/d35/d36/d3d/f39 [138653,84622] 0 2024-09-19T06:08:40.875 INFO:tasks.workunit.client.0.smithi037.stdout:2/205: dwrite d1/da/d42/f48 [0,4194304] 0 2024-09-19T06:08:40.879 INFO:tasks.workunit.client.0.smithi037.stdout:2/206: creat d1/da/dc/d21/f4d x:0 0 0 2024-09-19T06:08:40.879 INFO:tasks.workunit.client.0.smithi037.stdout:2/207: stat d1/f29 0 2024-09-19T06:08:40.879 INFO:tasks.workunit.client.0.smithi037.stdout:8/211: dread d1/d35/d36/d3d/f23 [0,4194304] 0 2024-09-19T06:08:40.879 INFO:tasks.workunit.client.0.smithi037.stdout:2/208: mknod d1/da/d42/c4e 0 2024-09-19T06:08:40.880 INFO:tasks.workunit.client.0.smithi037.stdout:2/209: dread - d1/da/dc/d21/f38 zero size 2024-09-19T06:08:40.880 INFO:tasks.workunit.client.0.smithi037.stdout:2/210: fdatasync d1/fd 0 2024-09-19T06:08:40.881 INFO:tasks.workunit.client.0.smithi037.stdout:8/212: rename d1/d35/d36/l49 to d1/d35/d36/l4f 0 2024-09-19T06:08:40.881 INFO:tasks.workunit.client.0.smithi037.stdout:8/213: dread - d1/d35/d36/d3d/f26 zero size 2024-09-19T06:08:40.881 INFO:tasks.workunit.client.0.smithi037.stdout:2/211: link d1/d6/c4b d1/d6/c4f 0 2024-09-19T06:08:40.882 INFO:tasks.workunit.client.0.smithi037.stdout:2/212: fsync d1/fd 0 2024-09-19T06:08:40.883 INFO:tasks.workunit.client.0.smithi037.stdout:8/214: creat d1/d35/d36/f50 x:0 0 0 2024-09-19T06:08:40.883 INFO:tasks.workunit.client.0.smithi037.stdout:2/213: getdents d1 0 2024-09-19T06:08:40.884 INFO:tasks.workunit.client.0.smithi037.stdout:2/214: rmdir d1/d6/d2d 39 2024-09-19T06:08:40.884 INFO:tasks.workunit.client.0.smithi037.stdout:2/215: dread - d1/d6/d2d/f34 zero size 2024-09-19T06:08:40.886 INFO:tasks.workunit.client.0.smithi037.stdout:2/216: creat d1/da/d42/f50 x:0 0 0 2024-09-19T06:08:40.886 INFO:tasks.workunit.client.0.smithi037.stdout:2/217: write d1/da/d42/f50 [696553,121100] 0 2024-09-19T06:08:40.886 INFO:tasks.workunit.client.0.smithi037.stdout:2/218: readlink d1/d6/l2b 0 2024-09-19T06:08:40.886 INFO:tasks.workunit.client.0.smithi037.stdout:1/78: dwrite d2/fb [0,4194304] 0 2024-09-19T06:08:40.887 INFO:tasks.workunit.client.0.smithi037.stdout:2/219: rmdir d1/d47 0 2024-09-19T06:08:40.892 INFO:tasks.workunit.client.0.smithi037.stdout:1/79: symlink d2/d12/d1d/l22 0 2024-09-19T06:08:40.892 INFO:tasks.workunit.client.0.smithi037.stdout:1/80: chown d2/d12/d17 52376 1 2024-09-19T06:08:40.892 INFO:tasks.workunit.client.0.smithi037.stdout:1/81: write d2/f9 [303295,67951] 0 2024-09-19T06:08:40.892 INFO:tasks.workunit.client.0.smithi037.stdout:1/82: chown d2/f16 2564 1 2024-09-19T06:08:40.893 INFO:tasks.workunit.client.0.smithi037.stdout:8/215: write d1/d35/d36/d3d/f2f [2984900,33550] 0 2024-09-19T06:08:40.894 INFO:tasks.workunit.client.0.smithi037.stdout:2/220: truncate d1/da/d42/f48 2260326 0 2024-09-19T06:08:40.897 INFO:tasks.workunit.client.0.smithi037.stdout:1/83: link d2/f6 d2/d12/d1d/f23 0 2024-09-19T06:08:40.897 INFO:tasks.workunit.client.0.smithi037.stdout:2/221: mkdir d1/da/dc/d21/d51 0 2024-09-19T06:08:40.899 INFO:tasks.workunit.client.0.smithi037.stdout:1/84: creat d2/d12/d1d/f24 x:0 0 0 2024-09-19T06:08:40.899 INFO:tasks.workunit.client.0.smithi037.stdout:1/85: readlink d2/l7 0 2024-09-19T06:08:40.900 INFO:tasks.workunit.client.0.smithi037.stdout:2/222: rmdir d1/da 39 2024-09-19T06:08:40.902 INFO:tasks.workunit.client.0.smithi037.stdout:1/86: creat d2/d12/f25 x:0 0 0 2024-09-19T06:08:40.905 INFO:tasks.workunit.client.0.smithi037.stdout:1/87: rmdir d2/d12/d17/d19 0 2024-09-19T06:08:40.906 INFO:tasks.workunit.client.0.smithi037.stdout:9/144: sync 2024-09-19T06:08:40.906 INFO:tasks.workunit.client.0.smithi037.stdout:0/147: sync 2024-09-19T06:08:40.906 INFO:tasks.workunit.client.0.smithi037.stdout:9/145: chown da/f13 392 1 2024-09-19T06:08:40.906 INFO:tasks.workunit.client.0.smithi037.stdout:0/148: fsync d5/d8/fb 0 2024-09-19T06:08:40.906 INFO:tasks.workunit.client.0.smithi037.stdout:0/149: dread - d5/d8/d11/d15/f31 zero size 2024-09-19T06:08:40.906 INFO:tasks.workunit.client.0.smithi037.stdout:0/150: chown d5 165968146 1 2024-09-19T06:08:40.907 INFO:tasks.workunit.client.0.smithi037.stdout:9/146: link da/dd/c14 da/c2c 0 2024-09-19T06:08:40.909 INFO:tasks.workunit.client.0.smithi037.stdout:9/147: unlink da/dd/l1e 0 2024-09-19T06:08:40.909 INFO:tasks.workunit.client.0.smithi037.stdout:9/148: stat da/dd/c16 0 2024-09-19T06:08:40.918 INFO:tasks.workunit.client.0.smithi037.stdout:8/216: dwrite d1/d35/d36/d3d/f16 [0,4194304] 0 2024-09-19T06:08:40.923 INFO:tasks.workunit.client.0.smithi037.stdout:0/151: read d5/d8/d11/d15/f1c [4159099,63377] 0 2024-09-19T06:08:40.927 INFO:tasks.workunit.client.0.smithi037.stdout:0/152: truncate d5/d8/d11/d15/d21/f29 6261963 0 2024-09-19T06:08:40.928 INFO:tasks.workunit.client.0.smithi037.stdout:0/153: symlink d5/d8/d22/l33 0 2024-09-19T06:08:40.928 INFO:tasks.workunit.client.0.smithi037.stdout:0/154: write d5/d8/d11/fe [1841718,75233] 0 2024-09-19T06:08:40.929 INFO:tasks.workunit.client.0.smithi037.stdout:9/149: dread da/fe [0,4194304] 0 2024-09-19T06:08:40.929 INFO:tasks.workunit.client.0.smithi037.stdout:2/223: dwrite d1/da/f3e [0,4194304] 0 2024-09-19T06:08:40.929 INFO:tasks.workunit.client.0.smithi037.stdout:0/155: truncate d5/d8/fb 30891 0 2024-09-19T06:08:40.932 INFO:tasks.workunit.client.0.smithi037.stdout:9/150: mknod da/c2d 0 2024-09-19T06:08:40.933 INFO:tasks.workunit.client.0.smithi037.stdout:2/224: creat d1/da/dc/d21/d51/f52 x:0 0 0 2024-09-19T06:08:40.933 INFO:tasks.workunit.client.0.smithi037.stdout:2/225: write f0 [1830887,845] 0 2024-09-19T06:08:40.934 INFO:tasks.workunit.client.0.smithi037.stdout:0/156: mkdir d5/d20/d34 0 2024-09-19T06:08:40.936 INFO:tasks.workunit.client.0.smithi037.stdout:9/151: symlink da/dd/l2e 0 2024-09-19T06:08:40.936 INFO:tasks.workunit.client.0.smithi037.stdout:9/152: write da/d20/f2a [624592,90584] 0 2024-09-19T06:08:40.937 INFO:tasks.workunit.client.0.smithi037.stdout:9/153: dread da/dd/d1b/f21 [0,4194304] 0 2024-09-19T06:08:40.937 INFO:tasks.workunit.client.0.smithi037.stdout:2/226: link d1/d6/d2d/f34 d1/d33/d4c/f53 0 2024-09-19T06:08:40.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:08:40 smithi099 ceph-mon[35300]: pgmap v424: 129 pgs: 129 active+clean; 153 MiB data, 874 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 9.7 MiB/s wr, 706 op/s 2024-09-19T06:08:40.939 INFO:tasks.workunit.client.0.smithi037.stdout:0/157: link d5/d20/l2e d5/d20/d34/l35 0 2024-09-19T06:08:40.940 INFO:tasks.workunit.client.0.smithi037.stdout:0/158: symlink d5/d8/d11/d15/l36 0 2024-09-19T06:08:40.943 INFO:tasks.workunit.client.0.smithi037.stdout:8/217: dwrite d1/f1e [0,4194304] 0 2024-09-19T06:08:40.951 INFO:tasks.workunit.client.0.smithi037.stdout:9/154: dread da/f19 [0,4194304] 0 2024-09-19T06:08:40.951 INFO:tasks.workunit.client.0.smithi037.stdout:9/155: readlink l9 0 2024-09-19T06:08:40.951 INFO:tasks.workunit.client.0.smithi037.stdout:9/156: chown da/c2d 759206356 1 2024-09-19T06:08:40.951 INFO:tasks.workunit.client.0.smithi037.stdout:9/157: fsync da/dd/d1b/d23/f26 0 2024-09-19T06:08:40.951 INFO:tasks.workunit.client.0.smithi037.stdout:0/159: getdents d5/d8/d11/d15 0 2024-09-19T06:08:40.952 INFO:tasks.workunit.client.0.smithi037.stdout:0/160: truncate d5/fa 337072 0 2024-09-19T06:08:40.956 INFO:tasks.workunit.client.0.smithi037.stdout:2/227: dread d1/f29 [0,4194304] 0 2024-09-19T06:08:40.958 INFO:tasks.workunit.client.0.smithi037.stdout:2/228: rename d1/d6/l49 to d1/da/l54 0 2024-09-19T06:08:40.959 INFO:tasks.workunit.client.0.smithi037.stdout:2/229: mkdir d1/da/dc/d21/d55 0 2024-09-19T06:08:40.959 INFO:tasks.workunit.client.0.smithi037.stdout:2/230: chown d1/da/f32 36241266 1 2024-09-19T06:08:40.959 INFO:tasks.workunit.client.0.smithi037.stdout:2/231: chown d1/da/dc/d21/f4d 56923 1 2024-09-19T06:08:40.961 INFO:tasks.workunit.client.0.smithi037.stdout:2/232: creat d1/da/d42/f56 x:0 0 0 2024-09-19T06:08:40.963 INFO:tasks.workunit.client.0.smithi037.stdout:2/233: rename d1/f3 to d1/d33/d4c/f57 0 2024-09-19T06:08:40.963 INFO:tasks.workunit.client.0.smithi037.stdout:0/161: dread d5/d8/d11/d15/d21/f29 [0,4194304] 0 2024-09-19T06:08:40.963 INFO:tasks.workunit.client.0.smithi037.stdout:0/162: write d5/d8/d11/d15/f1e [883376,475] 0 2024-09-19T06:08:40.965 INFO:tasks.workunit.client.0.smithi037.stdout:0/163: rename d5/d8/fb to d5/d20/d34/f37 0 2024-09-19T06:08:40.966 INFO:tasks.workunit.client.0.smithi037.stdout:8/218: dwrite d1/d35/d36/f3b [0,4194304] 0 2024-09-19T06:08:40.967 INFO:tasks.workunit.client.0.smithi037.stdout:0/164: mknod d5/d8/d11/d32/c38 0 2024-09-19T06:08:40.969 INFO:tasks.workunit.client.0.smithi037.stdout:8/219: mknod d1/d35/d36/d3d/c51 0 2024-09-19T06:08:40.969 INFO:tasks.workunit.client.0.smithi037.stdout:9/158: dread da/fc [0,4194304] 0 2024-09-19T06:08:40.970 INFO:tasks.workunit.client.0.smithi037.stdout:8/220: creat d1/f52 x:0 0 0 2024-09-19T06:08:40.971 INFO:tasks.workunit.client.0.smithi037.stdout:9/159: mkdir da/dd/d1b/d2f 0 2024-09-19T06:08:40.976 INFO:tasks.workunit.client.0.smithi037.stdout:8/221: symlink d1/d35/d36/d3d/l53 0 2024-09-19T06:08:40.976 INFO:tasks.workunit.client.0.smithi037.stdout:8/222: write d1/d35/d36/d3d/f22 [3399992,114242] 0 2024-09-19T06:08:40.977 INFO:tasks.workunit.client.0.smithi037.stdout:9/160: mknod da/dd/d1b/d23/c30 0 2024-09-19T06:08:40.980 INFO:tasks.workunit.client.0.smithi037.stdout:8/223: creat d1/f54 x:0 0 0 2024-09-19T06:08:40.981 INFO:tasks.workunit.client.0.smithi037.stdout:0/165: truncate d5/d8/d11/fe 10247 0 2024-09-19T06:08:40.982 INFO:tasks.workunit.client.0.smithi037.stdout:0/166: creat d5/d8/d11/d32/f39 x:0 0 0 2024-09-19T06:08:40.982 INFO:tasks.workunit.client.0.smithi037.stdout:0/167: chown d5/d8/d11/c24 221066 1 2024-09-19T06:08:40.982 INFO:tasks.workunit.client.0.smithi037.stdout:0/168: chown d5/d20/d34 915 1 2024-09-19T06:08:40.983 INFO:tasks.workunit.client.0.smithi037.stdout:0/169: mknod d5/d8/c3a 0 2024-09-19T06:08:40.985 INFO:tasks.workunit.client.0.smithi037.stdout:2/234: dwrite d1/da/f32 [4194304,4194304] 0 2024-09-19T06:08:40.985 INFO:tasks.workunit.client.0.smithi037.stdout:2/235: chown d1/d16/f37 7167669 1 2024-09-19T06:08:40.994 INFO:tasks.workunit.client.0.smithi037.stdout:9/161: read da/f13 [1975835,118901] 0 2024-09-19T06:08:40.996 INFO:tasks.workunit.client.0.smithi037.stdout:9/162: mkdir da/dd/d31 0 2024-09-19T06:08:40.996 INFO:tasks.workunit.client.0.smithi037.stdout:9/163: dread - da/dd/d1b/d23/f26 zero size 2024-09-19T06:08:40.996 INFO:tasks.workunit.client.0.smithi037.stdout:9/164: getdents da/dd/d1b/d2f 0 2024-09-19T06:08:40.996 INFO:tasks.workunit.client.0.smithi037.stdout:9/165: stat da/dd/d1b/d23/l28 0 2024-09-19T06:08:40.996 INFO:tasks.workunit.client.0.smithi037.stdout:9/166: symlink da/l32 0 2024-09-19T06:08:40.997 INFO:tasks.workunit.client.0.smithi037.stdout:9/167: symlink da/dd/d1b/l33 0 2024-09-19T06:08:40.998 INFO:tasks.workunit.client.0.smithi037.stdout:9/168: link da/f13 da/d20/f34 0 2024-09-19T06:08:40.999 INFO:tasks.workunit.client.0.smithi037.stdout:9/169: rename da/c2d to da/dd/d31/c35 0 2024-09-19T06:08:41.001 INFO:tasks.workunit.client.0.smithi037.stdout:9/170: link da/dd/d1b/f1f da/dd/d1b/f36 0 2024-09-19T06:08:41.001 INFO:tasks.workunit.client.0.smithi037.stdout:9/171: write da/d20/f2a [1400385,73880] 0 2024-09-19T06:08:41.001 INFO:tasks.workunit.client.0.smithi037.stdout:9/172: truncate da/dd/f12 3485428 0 2024-09-19T06:08:41.004 INFO:tasks.workunit.client.0.smithi037.stdout:8/224: dwrite d1/f2a [0,4194304] 0 2024-09-19T06:08:41.007 INFO:tasks.workunit.client.0.smithi037.stdout:8/225: rename d1/d35/f4d to d1/f55 0 2024-09-19T06:08:41.010 INFO:tasks.workunit.client.0.smithi037.stdout:0/170: dwrite d5/d8/d11/d15/f1c [0,4194304] 0 2024-09-19T06:08:41.012 INFO:tasks.workunit.client.0.smithi037.stdout:2/236: dread d1/da/f32 [4194304,4194304] 0 2024-09-19T06:08:41.014 INFO:tasks.workunit.client.0.smithi037.stdout:0/171: symlink d5/d17/l3b 0 2024-09-19T06:08:41.014 INFO:tasks.workunit.client.0.smithi037.stdout:2/237: rmdir d1/da/dc/d21 39 2024-09-19T06:08:41.016 INFO:tasks.workunit.client.0.smithi037.stdout:2/238: rename d1/da/d42/c4e to d1/da/d42/c58 0 2024-09-19T06:08:41.016 INFO:tasks.workunit.client.0.smithi037.stdout:2/239: chown d1/fd 2 1 2024-09-19T06:08:41.018 INFO:tasks.workunit.client.0.smithi037.stdout:2/240: creat d1/da/dc/f59 x:0 0 0 2024-09-19T06:08:41.019 INFO:tasks.workunit.client.0.smithi037.stdout:2/241: fdatasync d1/da/dc/f15 0 2024-09-19T06:08:41.020 INFO:tasks.workunit.client.0.smithi037.stdout:2/242: rename d1/d6/l2b to d1/da/l5a 0 2024-09-19T06:08:41.020 INFO:tasks.workunit.client.0.smithi037.stdout:2/243: readlink d1/da/l27 0 2024-09-19T06:08:41.021 INFO:tasks.workunit.client.0.smithi037.stdout:2/244: chown f0 40722609 1 2024-09-19T06:08:41.021 INFO:tasks.workunit.client.0.smithi037.stdout:2/245: write d1/da/dc/d21/f3c [851817,101445] 0 2024-09-19T06:08:41.021 INFO:tasks.workunit.client.0.smithi037.stdout:5/145: sync 2024-09-19T06:08:41.021 INFO:tasks.workunit.client.0.smithi037.stdout:2/246: chown d1/da/dc/f18 17081 1 2024-09-19T06:08:41.021 INFO:tasks.workunit.client.0.smithi037.stdout:5/146: getdents d2/d12/d24/d2a 0 2024-09-19T06:08:41.022 INFO:tasks.workunit.client.0.smithi037.stdout:2/247: rename d1/d6/c35 to d1/d6/d2d/c5b 0 2024-09-19T06:08:41.022 INFO:tasks.workunit.client.0.smithi037.stdout:2/248: write d1/f29 [4699411,79839] 0 2024-09-19T06:08:41.022 INFO:tasks.workunit.client.0.smithi037.stdout:5/147: creat d2/d10/f2d x:0 0 0 2024-09-19T06:08:41.023 INFO:tasks.workunit.client.0.smithi037.stdout:5/148: mknod d2/d12/d28/c2e 0 2024-09-19T06:08:41.028 INFO:tasks.workunit.client.0.smithi037.stdout:9/173: dwrite da/dd/d1b/f21 [0,4194304] 0 2024-09-19T06:08:41.030 INFO:tasks.workunit.client.0.smithi037.stdout:5/149: dread d2/d10/f21 [0,4194304] 0 2024-09-19T06:08:41.032 INFO:tasks.workunit.client.0.smithi037.stdout:9/174: link c7 da/dd/d1b/d23/c37 0 2024-09-19T06:08:41.032 INFO:tasks.workunit.client.0.smithi037.stdout:5/150: rmdir d2/d12/d28/d22 39 2024-09-19T06:08:41.035 INFO:tasks.workunit.client.0.smithi037.stdout:9/175: mkdir da/dd/d1b/d2f/d38 0 2024-09-19T06:08:41.035 INFO:tasks.workunit.client.0.smithi037.stdout:0/172: dwrite d5/d8/d11/d15/f1c [0,4194304] 0 2024-09-19T06:08:41.037 INFO:tasks.workunit.client.0.smithi037.stdout:5/151: rename d2/d12/d28/d22/f2c to d2/f2f 0 2024-09-19T06:08:41.040 INFO:tasks.workunit.client.0.smithi037.stdout:5/152: unlink d2/l15 0 2024-09-19T06:08:41.040 INFO:tasks.workunit.client.0.smithi037.stdout:5/153: fsync d2/fd 0 2024-09-19T06:08:41.040 INFO:tasks.workunit.client.0.smithi037.stdout:3/145: sync 2024-09-19T06:08:41.040 INFO:tasks.workunit.client.0.smithi037.stdout:6/109: sync 2024-09-19T06:08:41.041 INFO:tasks.workunit.client.0.smithi037.stdout:1/88: sync 2024-09-19T06:08:41.041 INFO:tasks.workunit.client.0.smithi037.stdout:7/82: sync 2024-09-19T06:08:41.041 INFO:tasks.workunit.client.0.smithi037.stdout:3/146: read - d0/d16/d19/f29 zero size 2024-09-19T06:08:41.041 INFO:tasks.workunit.client.0.smithi037.stdout:4/146: sync 2024-09-19T06:08:41.042 INFO:tasks.workunit.client.0.smithi037.stdout:5/154: rename d2/d12/d28/l20 to d2/d12/d28/d22/l30 0 2024-09-19T06:08:41.042 INFO:tasks.workunit.client.0.smithi037.stdout:6/110: creat d9/dd/f14 x:0 0 0 2024-09-19T06:08:41.044 INFO:tasks.workunit.client.0.smithi037.stdout:3/147: mknod d0/d16/d19/c32 0 2024-09-19T06:08:41.044 INFO:tasks.workunit.client.0.smithi037.stdout:3/148: truncate d0/d16/d19/f2c 340442 0 2024-09-19T06:08:41.044 INFO:tasks.workunit.client.0.smithi037.stdout:3/149: fdatasync d0/d16/d19/f29 0 2024-09-19T06:08:41.044 INFO:tasks.workunit.client.0.smithi037.stdout:3/150: dread - d0/d16/d19/f29 zero size 2024-09-19T06:08:41.044 INFO:tasks.workunit.client.0.smithi037.stdout:3/151: fsync d0/d16/d19/f2c 0 2024-09-19T06:08:41.044 INFO:tasks.workunit.client.0.smithi037.stdout:3/152: write d0/d16/d19/f1c [458560,68614] 0 2024-09-19T06:08:41.044 INFO:tasks.workunit.client.0.smithi037.stdout:3/153: dread - d0/d16/d19/f2e zero size 2024-09-19T06:08:41.044 INFO:tasks.workunit.client.0.smithi037.stdout:3/154: stat d0/f14 0 2024-09-19T06:08:41.044 INFO:tasks.workunit.client.0.smithi037.stdout:4/147: mkdir d0/d6/d1b/d30/d3d 0 2024-09-19T06:08:41.045 INFO:tasks.workunit.client.0.smithi037.stdout:6/111: creat d9/dd/f15 x:0 0 0 2024-09-19T06:08:41.045 INFO:tasks.workunit.client.0.smithi037.stdout:3/155: mkdir d0/d16/d19/d33 0 2024-09-19T06:08:41.047 INFO:tasks.workunit.client.0.smithi037.stdout:6/112: mkdir d9/d16 0 2024-09-19T06:08:41.048 INFO:tasks.workunit.client.0.smithi037.stdout:6/113: chown d9/fc 0 1 2024-09-19T06:08:41.048 INFO:tasks.workunit.client.0.smithi037.stdout:6/114: dread - d9/dd/f12 zero size 2024-09-19T06:08:41.050 INFO:tasks.workunit.client.0.smithi037.stdout:9/176: write da/dd/f12 [2282014,3637] 0 2024-09-19T06:08:41.050 INFO:tasks.workunit.client.0.smithi037.stdout:9/177: fsync da/f19 0 2024-09-19T06:08:41.051 INFO:tasks.workunit.client.0.smithi037.stdout:9/178: fdatasync da/f27 0 2024-09-19T06:08:41.051 INFO:tasks.workunit.client.0.smithi037.stdout:9/179: write da/dd/f12 [27888,184] 0 2024-09-19T06:08:41.051 INFO:tasks.workunit.client.0.smithi037.stdout:2/249: dwrite d1/da/dc/f59 [0,4194304] 0 2024-09-19T06:08:41.053 INFO:tasks.workunit.client.0.smithi037.stdout:9/180: truncate da/d20/f2a 715904 0 2024-09-19T06:08:41.053 INFO:tasks.workunit.client.0.smithi037.stdout:9/181: chown da/dd/d1b/d23/f24 438 1 2024-09-19T06:08:41.062 INFO:tasks.workunit.client.0.smithi037.stdout:9/182: link da/dd/d1b/f1f da/dd/d1b/d2f/d38/f39 0 2024-09-19T06:08:41.065 INFO:tasks.workunit.client.0.smithi037.stdout:9/183: truncate da/fc 257504 0 2024-09-19T06:08:41.066 INFO:tasks.workunit.client.0.smithi037.stdout:0/173: dwrite d5/d8/d11/d15/d21/f29 [4194304,4194304] 0 2024-09-19T06:08:41.066 INFO:tasks.workunit.client.0.smithi037.stdout:6/115: dread f5 [0,4194304] 0 2024-09-19T06:08:41.067 INFO:tasks.workunit.client.0.smithi037.stdout:6/116: rename l2 to d9/l17 0 2024-09-19T06:08:41.068 INFO:tasks.workunit.client.0.smithi037.stdout:9/184: truncate da/f13 2873448 0 2024-09-19T06:08:41.070 INFO:tasks.workunit.client.0.smithi037.stdout:0/174: link d5/d17/c1f d5/d17/c3c 0 2024-09-19T06:08:41.070 INFO:tasks.workunit.client.0.smithi037.stdout:9/185: creat da/dd/d31/f3a x:0 0 0 2024-09-19T06:08:41.070 INFO:tasks.workunit.client.0.smithi037.stdout:9/186: write da/dd/d1b/d23/f24 [584783,97366] 0 2024-09-19T06:08:41.071 INFO:tasks.workunit.client.0.smithi037.stdout:0/175: mkdir d5/d17/d3d 0 2024-09-19T06:08:41.073 INFO:tasks.workunit.client.0.smithi037.stdout:9/187: creat da/f3b x:0 0 0 2024-09-19T06:08:41.074 INFO:tasks.workunit.client.0.smithi037.stdout:0/176: rename d5/d8/d11/fe to d5/d8/d11/f3e 0 2024-09-19T06:08:41.075 INFO:tasks.workunit.client.0.smithi037.stdout:9/188: mkdir da/dd/d1b/d2f/d3c 0 2024-09-19T06:08:41.075 INFO:tasks.workunit.client.0.smithi037.stdout:9/189: write da/dd/d1b/f1f [993074,19001] 0 2024-09-19T06:08:41.076 INFO:tasks.workunit.client.0.smithi037.stdout:0/177: creat d5/d8/f3f x:0 0 0 2024-09-19T06:08:41.078 INFO:tasks.workunit.client.0.smithi037.stdout:9/190: creat da/dd/d1b/f3d x:0 0 0 2024-09-19T06:08:41.079 INFO:tasks.workunit.client.0.smithi037.stdout:0/178: creat d5/d8/d22/f40 x:0 0 0 2024-09-19T06:08:41.080 INFO:tasks.workunit.client.0.smithi037.stdout:0/179: write d5/d8/d11/f3e [107163,116654] 0 2024-09-19T06:08:41.080 INFO:tasks.workunit.client.0.smithi037.stdout:0/180: write d5/d8/d22/f40 [192042,45337] 0 2024-09-19T06:08:41.080 INFO:tasks.workunit.client.0.smithi037.stdout:0/181: readlink d5/l2a 0 2024-09-19T06:08:41.080 INFO:tasks.workunit.client.0.smithi037.stdout:6/117: read d9/fc [20518,109338] 0 2024-09-19T06:08:41.081 INFO:tasks.workunit.client.0.smithi037.stdout:3/156: dwrite d0/d16/d19/f28 [0,4194304] 0 2024-09-19T06:08:41.081 INFO:tasks.workunit.client.0.smithi037.stdout:3/157: write d0/d16/d19/d1f/d23/f2a [857507,5814] 0 2024-09-19T06:08:41.081 INFO:tasks.workunit.client.0.smithi037.stdout:1/89: dwrite d2/d12/f25 [0,4194304] 0 2024-09-19T06:08:41.081 INFO:tasks.workunit.client.0.smithi037.stdout:1/90: stat d2/d12/d1e 0 2024-09-19T06:08:41.083 INFO:tasks.workunit.client.0.smithi037.stdout:7/83: dwrite d6/fa [4194304,4194304] 0 2024-09-19T06:08:41.086 INFO:tasks.workunit.client.0.smithi037.stdout:2/250: dwrite d1/da/dc/f18 [0,4194304] 0 2024-09-19T06:08:41.088 INFO:tasks.workunit.client.0.smithi037.stdout:0/182: creat d5/d8/d11/d15/f41 x:0 0 0 2024-09-19T06:08:41.089 INFO:tasks.workunit.client.0.smithi037.stdout:1/91: chown d2/cf 271932 1 2024-09-19T06:08:41.089 INFO:tasks.workunit.client.0.smithi037.stdout:1/92: write d2/f8 [1045257,124106] 0 2024-09-19T06:08:41.089 INFO:tasks.workunit.client.0.smithi037.stdout:3/158: mknod d0/d16/d19/c34 0 2024-09-19T06:08:41.089 INFO:tasks.workunit.client.0.smithi037.stdout:3/159: chown d0/f17 299186 1 2024-09-19T06:08:41.089 INFO:tasks.workunit.client.0.smithi037.stdout:5/155: dwrite d2/d12/f26 [0,4194304] 0 2024-09-19T06:08:41.091 INFO:tasks.workunit.client.0.smithi037.stdout:9/191: fsync da/dd/d31/f3a 0 2024-09-19T06:08:41.097 INFO:tasks.workunit.client.0.smithi037.stdout:0/183: mkdir d5/d42 0 2024-09-19T06:08:41.097 INFO:tasks.workunit.client.0.smithi037.stdout:0/184: chown d5/d17/c1f 1 1 2024-09-19T06:08:41.097 INFO:tasks.workunit.client.0.smithi037.stdout:0/185: write d5/d20/d34/f37 [716821,103382] 0 2024-09-19T06:08:41.098 INFO:tasks.workunit.client.0.smithi037.stdout:1/93: creat d2/f26 x:0 0 0 2024-09-19T06:08:41.098 INFO:tasks.workunit.client.0.smithi037.stdout:0/186: write d5/d20/d34/f37 [593157,69969] 0 2024-09-19T06:08:41.099 INFO:tasks.workunit.client.0.smithi037.stdout:3/160: link d0/c6 d0/d16/d19/d1f/d26/c35 0 2024-09-19T06:08:41.101 INFO:tasks.workunit.client.0.smithi037.stdout:7/84: dread d6/dc/f14 [0,4194304] 0 2024-09-19T06:08:41.101 INFO:tasks.workunit.client.0.smithi037.stdout:7/85: write d6/dc/fd [1227157,24867] 0 2024-09-19T06:08:41.102 INFO:tasks.workunit.client.0.smithi037.stdout:9/192: rename da/dd/d1b/d23/c30 to da/dd/d31/c3e 0 2024-09-19T06:08:41.104 INFO:tasks.workunit.client.0.smithi037.stdout:1/94: creat d2/d12/d15/f27 x:0 0 0 2024-09-19T06:08:41.104 INFO:tasks.workunit.client.0.smithi037.stdout:6/118: dwrite f5 [4194304,4194304] 0 2024-09-19T06:08:41.104 INFO:tasks.workunit.client.0.smithi037.stdout:1/95: read d2/f8 [574616,38042] 0 2024-09-19T06:08:41.105 INFO:tasks.workunit.client.0.smithi037.stdout:1/96: stat d2/fe 0 2024-09-19T06:08:41.105 INFO:tasks.workunit.client.0.smithi037.stdout:3/161: creat d0/d16/d19/d1f/d26/f36 x:0 0 0 2024-09-19T06:08:41.106 INFO:tasks.workunit.client.0.smithi037.stdout:7/86: mknod d6/c1c 0 2024-09-19T06:08:41.108 INFO:tasks.workunit.client.0.smithi037.stdout:0/187: rename d5/fd to d5/d8/d11/d32/f43 0 2024-09-19T06:08:41.109 INFO:tasks.workunit.client.0.smithi037.stdout:9/193: mkdir da/dd/d1b/d23/d3f 0 2024-09-19T06:08:41.110 INFO:tasks.workunit.client.0.smithi037.stdout:3/162: mkdir d0/d16/d19/d1f/d37 0 2024-09-19T06:08:41.110 INFO:tasks.workunit.client.0.smithi037.stdout:3/163: chown d0/l10 422907 1 2024-09-19T06:08:41.113 INFO:tasks.workunit.client.0.smithi037.stdout:0/188: rename d5/d17/d3d to d5/d8/d44 0 2024-09-19T06:08:41.113 INFO:tasks.workunit.client.0.smithi037.stdout:5/156: dwrite d2/fb [4194304,4194304] 0 2024-09-19T06:08:41.115 INFO:tasks.workunit.client.0.smithi037.stdout:9/194: creat da/d20/f40 x:0 0 0 2024-09-19T06:08:41.116 INFO:tasks.workunit.client.0.smithi037.stdout:5/157: rmdir d2/d12/d28 39 2024-09-19T06:08:41.118 INFO:tasks.workunit.client.0.smithi037.stdout:9/195: symlink da/d20/l41 0 2024-09-19T06:08:41.121 INFO:tasks.workunit.client.0.smithi037.stdout:5/158: dread d2/f2b [0,4194304] 0 2024-09-19T06:08:41.122 INFO:tasks.workunit.client.0.smithi037.stdout:5/159: fdatasync d2/d10/f21 0 2024-09-19T06:08:41.122 INFO:tasks.workunit.client.0.smithi037.stdout:5/160: chown d2/c9 179841 1 2024-09-19T06:08:41.123 INFO:tasks.workunit.client.0.smithi037.stdout:7/87: getdents d6 0 2024-09-19T06:08:41.123 INFO:tasks.workunit.client.0.smithi037.stdout:5/161: mknod d2/d12/c31 0 2024-09-19T06:08:41.126 INFO:tasks.workunit.client.0.smithi037.stdout:7/88: creat d6/f1d x:0 0 0 2024-09-19T06:08:41.130 INFO:tasks.workunit.client.0.smithi037.stdout:5/162: write d2/d12/d28/f29 [446314,104077] 0 2024-09-19T06:08:41.132 INFO:tasks.workunit.client.0.smithi037.stdout:6/119: dwrite d9/fc [0,4194304] 0 2024-09-19T06:08:41.136 INFO:tasks.workunit.client.0.smithi037.stdout:6/120: rename f5 to d9/f18 0 2024-09-19T06:08:41.136 INFO:tasks.workunit.client.0.smithi037.stdout:6/121: chown d9/f18 0 1 2024-09-19T06:08:41.136 INFO:tasks.workunit.client.0.smithi037.stdout:6/122: read - d9/dd/f15 zero size 2024-09-19T06:08:41.139 INFO:tasks.workunit.client.0.smithi037.stdout:3/164: dread d0/d16/f30 [0,4194304] 0 2024-09-19T06:08:41.140 INFO:tasks.workunit.client.0.smithi037.stdout:1/97: dwrite d2/f26 [0,4194304] 0 2024-09-19T06:08:41.140 INFO:tasks.workunit.client.0.smithi037.stdout:1/98: stat d2/f11 0 2024-09-19T06:08:41.144 INFO:tasks.workunit.client.0.smithi037.stdout:1/99: dread d2/d12/d17/f18 [0,4194304] 0 2024-09-19T06:08:41.145 INFO:tasks.workunit.client.0.smithi037.stdout:3/165: creat d0/d16/d19/d33/f38 x:0 0 0 2024-09-19T06:08:41.145 INFO:tasks.workunit.client.0.smithi037.stdout:1/100: read d2/f16 [461826,43785] 0 2024-09-19T06:08:41.149 INFO:tasks.workunit.client.0.smithi037.stdout:9/196: dwrite da/dd/d1b/d23/f26 [0,4194304] 0 2024-09-19T06:08:41.150 INFO:tasks.workunit.client.0.smithi037.stdout:3/166: dread d0/f14 [0,4194304] 0 2024-09-19T06:08:41.155 INFO:tasks.workunit.client.0.smithi037.stdout:7/89: dwrite d6/dc/f16 [0,4194304] 0 2024-09-19T06:08:41.155 INFO:tasks.workunit.client.0.smithi037.stdout:7/90: chown d6/dc 322707454 1 2024-09-19T06:08:41.156 INFO:tasks.workunit.client.0.smithi037.stdout:0/189: dwrite d5/fa [0,4194304] 0 2024-09-19T06:08:41.156 INFO:tasks.workunit.client.0.smithi037.stdout:0/190: write d5/d8/f3f [969726,30302] 0 2024-09-19T06:08:41.156 INFO:tasks.workunit.client.0.smithi037.stdout:0/191: truncate d5/d8/f3f 1995781 0 2024-09-19T06:08:41.158 INFO:tasks.workunit.client.0.smithi037.stdout:6/123: dread d9/fc [0,4194304] 0 2024-09-19T06:08:41.159 INFO:tasks.workunit.client.0.smithi037.stdout:0/192: creat d5/d8/d11/d15/f45 x:0 0 0 2024-09-19T06:08:41.159 INFO:tasks.workunit.client.0.smithi037.stdout:0/193: fdatasync d5/d8/d11/d15/f1e 0 2024-09-19T06:08:41.160 INFO:tasks.workunit.client.0.smithi037.stdout:0/194: creat d5/d8/d22/f46 x:0 0 0 2024-09-19T06:08:41.161 INFO:tasks.workunit.client.0.smithi037.stdout:7/91: write d6/dc/fd [971357,128551] 0 2024-09-19T06:08:41.161 INFO:tasks.workunit.client.0.smithi037.stdout:7/92: readlink d6/l19 0 2024-09-19T06:08:41.161 INFO:tasks.workunit.client.0.smithi037.stdout:7/93: chown d6/dc/f16 2322 1 2024-09-19T06:08:41.161 INFO:tasks.workunit.client.0.smithi037.stdout:0/195: link d5/d8/f3f d5/d8/d22/f47 0 2024-09-19T06:08:41.161 INFO:tasks.workunit.client.0.smithi037.stdout:0/196: chown d5/d20/d34/l35 6630601 1 2024-09-19T06:08:41.161 INFO:tasks.workunit.client.0.smithi037.stdout:0/197: readlink d5/l6 0 2024-09-19T06:08:41.162 INFO:tasks.workunit.client.0.smithi037.stdout:7/94: symlink d6/l1e 0 2024-09-19T06:08:41.162 INFO:tasks.workunit.client.0.smithi037.stdout:7/95: chown d6/dc/fd 6203945 1 2024-09-19T06:08:41.162 INFO:tasks.workunit.client.0.smithi037.stdout:7/96: write f4 [985804,46474] 0 2024-09-19T06:08:41.163 INFO:tasks.workunit.client.0.smithi037.stdout:0/198: unlink d5/d8/d22/l33 0 2024-09-19T06:08:41.163 INFO:tasks.workunit.client.0.smithi037.stdout:0/199: dread - d5/ff zero size 2024-09-19T06:08:41.163 INFO:tasks.workunit.client.0.smithi037.stdout:0/200: chown d5/d8/c2c 66 1 2024-09-19T06:08:41.163 INFO:tasks.workunit.client.0.smithi037.stdout:7/97: symlink d6/dc/df/l1f 0 2024-09-19T06:08:41.163 INFO:tasks.workunit.client.0.smithi037.stdout:7/98: readlink d6/l19 0 2024-09-19T06:08:41.164 INFO:tasks.workunit.client.0.smithi037.stdout:7/99: mkdir d6/d20 0 2024-09-19T06:08:41.164 INFO:tasks.workunit.client.0.smithi037.stdout:7/100: stat l3 0 2024-09-19T06:08:41.164 INFO:tasks.workunit.client.0.smithi037.stdout:7/101: read - d6/f12 zero size 2024-09-19T06:08:41.165 INFO:tasks.workunit.client.0.smithi037.stdout:7/102: truncate d6/f9 4909945 0 2024-09-19T06:08:41.175 INFO:tasks.workunit.client.0.smithi037.stdout:3/167: dwrite d0/f14 [0,4194304] 0 2024-09-19T06:08:41.178 INFO:tasks.workunit.client.0.smithi037.stdout:3/168: unlink d0/d16/d19/f1a 0 2024-09-19T06:08:41.179 INFO:tasks.workunit.client.0.smithi037.stdout:3/169: creat d0/d16/d19/d1d/f39 x:0 0 0 2024-09-19T06:08:41.179 INFO:tasks.workunit.client.0.smithi037.stdout:3/170: stat d0/d16/d19/d1f/d26 0 2024-09-19T06:08:41.181 INFO:tasks.workunit.client.0.smithi037.stdout:9/197: dwrite da/f3b [0,4194304] 0 2024-09-19T06:08:41.183 INFO:tasks.workunit.client.0.smithi037.stdout:6/124: dwrite d9/dd/f14 [0,4194304] 0 2024-09-19T06:08:41.183 INFO:tasks.workunit.client.0.smithi037.stdout:6/125: dread - d9/dd/f12 zero size 2024-09-19T06:08:41.186 INFO:tasks.workunit.client.0.smithi037.stdout:6/126: creat d9/f19 x:0 0 0 2024-09-19T06:08:41.188 INFO:tasks.workunit.client.0.smithi037.stdout:6/127: mknod d9/d16/c1a 0 2024-09-19T06:08:41.188 INFO:tasks.workunit.client.0.smithi037.stdout:6/128: fsync d9/fc 0 2024-09-19T06:08:41.194 INFO:tasks.workunit.client.0.smithi037.stdout:9/198: dread da/fe [0,4194304] 0 2024-09-19T06:08:41.194 INFO:tasks.workunit.client.0.smithi037.stdout:0/201: dwrite d5/d8/d11/d15/f31 [0,4194304] 0 2024-09-19T06:08:41.194 INFO:tasks.workunit.client.0.smithi037.stdout:0/202: chown d5/d8/c3a 1181033 1 2024-09-19T06:08:41.197 INFO:tasks.workunit.client.0.smithi037.stdout:9/199: mknod da/dd/c42 0 2024-09-19T06:08:41.197 INFO:tasks.workunit.client.0.smithi037.stdout:9/200: dread - da/dd/d1b/f3d zero size 2024-09-19T06:08:41.197 INFO:tasks.workunit.client.0.smithi037.stdout:9/201: fdatasync da/d20/f40 0 2024-09-19T06:08:41.198 INFO:tasks.workunit.client.0.smithi037.stdout:3/171: dread d0/ff [0,4194304] 0 2024-09-19T06:08:41.209 INFO:tasks.workunit.client.0.smithi037.stdout:0/203: dread d5/d8/d11/d32/f43 [4194304,4194304] 0 2024-09-19T06:08:41.209 INFO:tasks.workunit.client.0.smithi037.stdout:6/129: dwrite d9/dd/f12 [0,4194304] 0 2024-09-19T06:08:41.209 INFO:tasks.workunit.client.0.smithi037.stdout:6/130: write d9/ff [611539,45308] 0 2024-09-19T06:08:41.210 INFO:tasks.workunit.client.0.smithi037.stdout:6/131: write d9/f18 [1677473,118772] 0 2024-09-19T06:08:41.211 INFO:tasks.workunit.client.0.smithi037.stdout:3/172: dread d0/f14 [0,4194304] 0 2024-09-19T06:08:41.212 INFO:tasks.workunit.client.0.smithi037.stdout:6/132: rename d9/dd/f15 to d9/dd/f1b 0 2024-09-19T06:08:41.225 INFO:tasks.workunit.client.0.smithi037.stdout:0/204: read d5/d8/d11/d15/d21/f29 [4738311,15222] 0 2024-09-19T06:08:41.225 INFO:tasks.workunit.client.0.smithi037.stdout:9/202: dwrite da/fe [0,4194304] 0 2024-09-19T06:08:41.226 INFO:tasks.workunit.client.0.smithi037.stdout:3/173: write d0/ff [3959058,85067] 0 2024-09-19T06:08:41.226 INFO:tasks.workunit.client.0.smithi037.stdout:9/203: unlink da/f19 0 2024-09-19T06:08:41.226 INFO:tasks.workunit.client.0.smithi037.stdout:9/204: readlink da/l2b 0 2024-09-19T06:08:41.227 INFO:tasks.workunit.client.0.smithi037.stdout:3/174: getdents d0/d16/d19/d1f/d23 0 2024-09-19T06:08:41.227 INFO:tasks.workunit.client.0.smithi037.stdout:3/175: fsync d0/d16/d19/d1d/f27 0 2024-09-19T06:08:41.228 INFO:tasks.workunit.client.0.smithi037.stdout:9/205: getdents da/dd/d1b/d23 0 2024-09-19T06:08:41.229 INFO:tasks.workunit.client.0.smithi037.stdout:6/133: write d9/fc [3220691,105596] 0 2024-09-19T06:08:41.231 INFO:tasks.workunit.client.0.smithi037.stdout:0/205: write d5/d8/d22/f47 [644621,58060] 0 2024-09-19T06:08:41.231 INFO:tasks.workunit.client.0.smithi037.stdout:0/206: dread - d5/ff zero size 2024-09-19T06:08:41.231 INFO:tasks.workunit.client.0.smithi037.stdout:0/207: write d5/d8/d22/f46 [749943,3248] 0 2024-09-19T06:08:41.231 INFO:tasks.workunit.client.0.smithi037.stdout:0/208: stat d5/d8/l2d 0 2024-09-19T06:08:41.231 INFO:tasks.workunit.client.0.smithi037.stdout:6/134: mkdir d9/dd/d1c 0 2024-09-19T06:08:41.233 INFO:tasks.workunit.client.0.smithi037.stdout:0/209: mkdir d5/d8/d44/d48 0 2024-09-19T06:08:41.233 INFO:tasks.workunit.client.0.smithi037.stdout:6/135: symlink d9/d16/l1d 0 2024-09-19T06:08:41.233 INFO:tasks.workunit.client.0.smithi037.stdout:6/136: symlink d9/d16/l1e 0 2024-09-19T06:08:41.235 INFO:tasks.workunit.client.0.smithi037.stdout:6/137: symlink d9/dd/d1c/l1f 0 2024-09-19T06:08:41.235 INFO:tasks.workunit.client.0.smithi037.stdout:6/138: chown d9/la 37651843 1 2024-09-19T06:08:41.236 INFO:tasks.workunit.client.0.smithi037.stdout:4/148: sync 2024-09-19T06:08:41.236 INFO:tasks.workunit.client.0.smithi037.stdout:4/149: getdents d0/d6/d1b 0 2024-09-19T06:08:41.237 INFO:tasks.workunit.client.0.smithi037.stdout:8/226: sync 2024-09-19T06:08:41.237 INFO:tasks.workunit.client.0.smithi037.stdout:6/139: truncate d9/dd/f12 2255508 0 2024-09-19T06:08:41.238 INFO:tasks.workunit.client.0.smithi037.stdout:4/150: symlink d0/d2/d2e/l3e 0 2024-09-19T06:08:41.239 INFO:tasks.workunit.client.0.smithi037.stdout:4/151: truncate d0/d2/f1a 4953335 0 2024-09-19T06:08:41.239 INFO:tasks.workunit.client.0.smithi037.stdout:4/152: write d0/d2/d2e/d36/f2f [202565,102351] 0 2024-09-19T06:08:41.239 INFO:tasks.workunit.client.0.smithi037.stdout:8/227: creat d1/d35/f56 x:0 0 0 2024-09-19T06:08:41.241 INFO:tasks.workunit.client.0.smithi037.stdout:4/153: rename d0/d2/d37/f39 to d0/d6/d1b/f3f 0 2024-09-19T06:08:41.241 INFO:tasks.workunit.client.0.smithi037.stdout:4/154: fsync d0/d6/f23 0 2024-09-19T06:08:41.241 INFO:tasks.workunit.client.0.smithi037.stdout:4/155: readlink d0/d6/l10 0 2024-09-19T06:08:41.242 INFO:tasks.workunit.client.0.smithi037.stdout:8/228: getdents d1 0 2024-09-19T06:08:41.245 INFO:tasks.workunit.client.0.smithi037.stdout:3/176: dread d0/d16/d19/f28 [0,4194304] 0 2024-09-19T06:08:41.245 INFO:tasks.workunit.client.0.smithi037.stdout:4/156: unlink d0/d6/l33 0 2024-09-19T06:08:41.249 INFO:tasks.workunit.client.0.smithi037.stdout:8/229: rmdir d1/d35/d36/d3d 39 2024-09-19T06:08:41.250 INFO:tasks.workunit.client.0.smithi037.stdout:3/177: mkdir d0/d16/d19/d1f/d26/d3a 0 2024-09-19T06:08:41.251 INFO:tasks.workunit.client.0.smithi037.stdout:4/157: creat d0/d6/d1b/d20/f40 x:0 0 0 2024-09-19T06:08:41.252 INFO:tasks.workunit.client.0.smithi037.stdout:8/230: truncate d1/f2d 3928682 0 2024-09-19T06:08:41.254 INFO:tasks.workunit.client.0.smithi037.stdout:8/231: unlink d1/l44 0 2024-09-19T06:08:41.255 INFO:tasks.workunit.client.0.smithi037.stdout:8/232: mknod d1/d35/c57 0 2024-09-19T06:08:41.255 INFO:tasks.workunit.client.0.smithi037.stdout:8/233: getdents d1/d35/d36 0 2024-09-19T06:08:41.256 INFO:tasks.workunit.client.0.smithi037.stdout:8/234: mkdir d1/d35/d36/d3d/d58 0 2024-09-19T06:08:41.257 INFO:tasks.workunit.client.0.smithi037.stdout:0/210: dwrite d5/d8/d11/f16 [0,4194304] 0 2024-09-19T06:08:41.257 INFO:tasks.workunit.client.0.smithi037.stdout:0/211: chown d5/d8/d11/d32/f43 443442 1 2024-09-19T06:08:41.257 INFO:tasks.workunit.client.0.smithi037.stdout:8/235: mkdir d1/d35/d36/d3d/d58/d59 0 2024-09-19T06:08:41.257 INFO:tasks.workunit.client.0.smithi037.stdout:8/236: fsync d1/f2a 0 2024-09-19T06:08:41.258 INFO:tasks.workunit.client.0.smithi037.stdout:9/206: dwrite da/f3b [0,4194304] 0 2024-09-19T06:08:41.259 INFO:tasks.workunit.client.0.smithi037.stdout:0/212: creat d5/d8/d11/d15/d21/f49 x:0 0 0 2024-09-19T06:08:41.260 INFO:tasks.workunit.client.0.smithi037.stdout:0/213: chown d5/d8/d11/d15/f41 6419 1 2024-09-19T06:08:41.260 INFO:tasks.workunit.client.0.smithi037.stdout:0/214: truncate d5/d8/d11/d15/f45 723674 0 2024-09-19T06:08:41.260 INFO:tasks.workunit.client.0.smithi037.stdout:0/215: read - d5/ff zero size 2024-09-19T06:08:41.260 INFO:tasks.workunit.client.0.smithi037.stdout:8/237: rmdir d1/d35 39 2024-09-19T06:08:41.260 INFO:tasks.workunit.client.0.smithi037.stdout:8/238: fsync d1/f1e 0 2024-09-19T06:08:41.261 INFO:tasks.workunit.client.0.smithi037.stdout:9/207: rename da/dd/d1b/d2f/d3c to da/dd/d1b/d43 0 2024-09-19T06:08:41.261 INFO:tasks.workunit.client.0.smithi037.stdout:9/208: stat da/dd/d1b/d23/d3f 0 2024-09-19T06:08:41.263 INFO:tasks.workunit.client.0.smithi037.stdout:8/239: unlink d1/d35/d36/l4f 0 2024-09-19T06:08:41.263 INFO:tasks.workunit.client.0.smithi037.stdout:8/240: truncate d1/d35/d36/d3d/f2c 477645 0 2024-09-19T06:08:41.265 INFO:tasks.workunit.client.0.smithi037.stdout:9/209: creat da/dd/d1b/d2f/f44 x:0 0 0 2024-09-19T06:08:41.266 INFO:tasks.workunit.client.0.smithi037.stdout:8/241: mknod d1/d35/d36/d3d/c5a 0 2024-09-19T06:08:41.266 INFO:tasks.workunit.client.0.smithi037.stdout:8/242: symlink d1/d35/d36/d3d/d58/l5b 0 2024-09-19T06:08:41.269 INFO:tasks.workunit.client.0.smithi037.stdout:9/210: write da/d20/f2a [305330,129715] 0 2024-09-19T06:08:41.269 INFO:tasks.workunit.client.0.smithi037.stdout:4/158: dread d0/d6/f26 [0,4194304] 0 2024-09-19T06:08:41.270 INFO:tasks.workunit.client.0.smithi037.stdout:9/211: mkdir da/dd/d1b/d23/d3f/d45 0 2024-09-19T06:08:41.270 INFO:tasks.workunit.client.0.smithi037.stdout:9/212: write da/dd/d1b/f36 [1919851,93846] 0 2024-09-19T06:08:41.272 INFO:tasks.workunit.client.0.smithi037.stdout:9/213: creat da/dd/d1b/d43/f46 x:0 0 0 2024-09-19T06:08:41.273 INFO:tasks.workunit.client.0.smithi037.stdout:4/159: rename d0/d2/fb to d0/f41 0 2024-09-19T06:08:41.274 INFO:tasks.workunit.client.0.smithi037.stdout:4/160: fdatasync d0/d6/d1b/f28 0 2024-09-19T06:08:41.274 INFO:tasks.workunit.client.0.smithi037.stdout:4/161: truncate d0/d6/d1b/f29 183545 0 2024-09-19T06:08:41.274 INFO:tasks.workunit.client.0.smithi037.stdout:4/162: chown d0/c34 56 1 2024-09-19T06:08:41.274 INFO:tasks.workunit.client.0.smithi037.stdout:4/163: stat d0/f27 0 2024-09-19T06:08:41.275 INFO:tasks.workunit.client.0.smithi037.stdout:9/214: symlink da/dd/d1b/d2f/l47 0 2024-09-19T06:08:41.275 INFO:tasks.workunit.client.0.smithi037.stdout:4/164: symlink d0/d6/l42 0 2024-09-19T06:08:41.276 INFO:tasks.workunit.client.0.smithi037.stdout:4/165: dread - d0/d6/d1b/f3f zero size 2024-09-19T06:08:41.276 INFO:tasks.workunit.client.0.smithi037.stdout:6/140: truncate d9/dd/f12 1892180 0 2024-09-19T06:08:41.276 INFO:tasks.workunit.client.0.smithi037.stdout:4/166: getdents d0/d2/d2e 0 2024-09-19T06:08:41.277 INFO:tasks.workunit.client.0.smithi037.stdout:6/141: mkdir d9/dd/d20 0 2024-09-19T06:08:41.278 INFO:tasks.workunit.client.0.smithi037.stdout:6/142: mkdir d9/dd/d20/d21 0 2024-09-19T06:08:41.283 INFO:tasks.workunit.client.0.smithi037.stdout:0/216: dwrite d5/d8/d22/f46 [0,4194304] 0 2024-09-19T06:08:41.287 INFO:tasks.workunit.client.0.smithi037.stdout:9/215: dread da/d20/f34 [0,4194304] 0 2024-09-19T06:08:41.290 INFO:tasks.workunit.client.0.smithi037.stdout:9/216: rename da/dd/d1b/d23/f26 to da/dd/d1b/d23/d3f/d45/f48 0 2024-09-19T06:08:41.292 INFO:tasks.workunit.client.0.smithi037.stdout:8/243: read d1/f2a [3621886,8792] 0 2024-09-19T06:08:41.292 INFO:tasks.workunit.client.0.smithi037.stdout:0/217: dread d5/d8/d22/f47 [0,4194304] 0 2024-09-19T06:08:41.295 INFO:tasks.workunit.client.0.smithi037.stdout:0/218: rmdir d5/d20 39 2024-09-19T06:08:41.295 INFO:tasks.workunit.client.0.smithi037.stdout:0/219: chown d5/d8/f3f 1 1 2024-09-19T06:08:41.305 INFO:tasks.workunit.client.0.smithi037.stdout:6/143: dread d9/f18 [4194304,4194304] 0 2024-09-19T06:08:41.305 INFO:tasks.workunit.client.0.smithi037.stdout:4/167: dwrite d0/d2/d2e/d36/f2f [0,4194304] 0 2024-09-19T06:08:41.305 INFO:tasks.workunit.client.0.smithi037.stdout:6/144: chown d9/ff 5 1 2024-09-19T06:08:41.305 INFO:tasks.workunit.client.0.smithi037.stdout:4/168: readlink d0/d2/l35 0 2024-09-19T06:08:41.307 INFO:tasks.workunit.client.0.smithi037.stdout:6/145: creat d9/dd/f22 x:0 0 0 2024-09-19T06:08:41.308 INFO:tasks.workunit.client.0.smithi037.stdout:6/146: creat d9/dd/f23 x:0 0 0 2024-09-19T06:08:41.308 INFO:tasks.workunit.client.0.smithi037.stdout:6/147: chown d9/dd 16426783 1 2024-09-19T06:08:41.310 INFO:tasks.workunit.client.0.smithi037.stdout:0/220: dread d5/d8/d11/d15/f1c [0,4194304] 0 2024-09-19T06:08:41.310 INFO:tasks.workunit.client.0.smithi037.stdout:0/221: write d5/f7 [7577410,46379] 0 2024-09-19T06:08:41.310 INFO:tasks.workunit.client.0.smithi037.stdout:0/222: truncate d5/ff 373858 0 2024-09-19T06:08:41.311 INFO:tasks.workunit.client.0.smithi037.stdout:0/223: mknod d5/d8/d22/c4a 0 2024-09-19T06:08:41.312 INFO:tasks.workunit.client.0.smithi037.stdout:0/224: chown d5/d8/d11/f3e 573868685 1 2024-09-19T06:08:41.312 INFO:tasks.workunit.client.0.smithi037.stdout:0/225: write d5/d8/d11/d15/d21/f49 [1015614,88005] 0 2024-09-19T06:08:41.312 INFO:tasks.workunit.client.0.smithi037.stdout:0/226: dread - d5/d8/d11/d32/f39 zero size 2024-09-19T06:08:41.312 INFO:tasks.workunit.client.0.smithi037.stdout:0/227: stat d5/d8/d11/d15 0 2024-09-19T06:08:41.312 INFO:tasks.workunit.client.0.smithi037.stdout:8/244: write d1/d35/d36/d3d/f20 [1429912,34933] 0 2024-09-19T06:08:41.312 INFO:tasks.workunit.client.0.smithi037.stdout:8/245: dread - d1/d35/d36/d3d/f27 zero size 2024-09-19T06:08:41.313 INFO:tasks.workunit.client.0.smithi037.stdout:0/228: unlink d5/d8/d11/d32/c38 0 2024-09-19T06:08:41.313 INFO:tasks.workunit.client.0.smithi037.stdout:0/229: write d5/d8/d11/d15/f31 [5095883,64137] 0 2024-09-19T06:08:41.313 INFO:tasks.workunit.client.0.smithi037.stdout:8/246: creat d1/d35/d36/d3d/d58/d59/f5c x:0 0 0 2024-09-19T06:08:41.314 INFO:tasks.workunit.client.0.smithi037.stdout:8/247: mkdir d1/d35/d36/d3d/d58/d59/d5d 0 2024-09-19T06:08:41.320 INFO:tasks.workunit.client.0.smithi037.stdout:9/217: dwrite da/d20/f2a [0,4194304] 0 2024-09-19T06:08:41.321 INFO:tasks.workunit.client.0.smithi037.stdout:6/148: dread d9/dd/f14 [0,4194304] 0 2024-09-19T06:08:41.322 INFO:tasks.workunit.client.0.smithi037.stdout:6/149: rename d9/dd/f12 to d9/f24 0 2024-09-19T06:08:41.323 INFO:tasks.workunit.client.0.smithi037.stdout:6/150: fsync d9/f19 0 2024-09-19T06:08:41.323 INFO:tasks.workunit.client.0.smithi037.stdout:6/151: mknod d9/d16/c25 0 2024-09-19T06:08:41.324 INFO:tasks.workunit.client.0.smithi037.stdout:6/152: creat d9/d16/f26 x:0 0 0 2024-09-19T06:08:41.337 INFO:tasks.workunit.client.0.smithi037.stdout:8/248: write d1/d35/d36/d3d/f19 [3371586,78148] 0 2024-09-19T06:08:41.339 INFO:tasks.workunit.client.0.smithi037.stdout:0/230: dwrite d5/d20/d34/f37 [0,4194304] 0 2024-09-19T06:08:41.339 INFO:tasks.workunit.client.0.smithi037.stdout:8/249: mknod d1/d35/c5e 0 2024-09-19T06:08:41.339 INFO:tasks.workunit.client.0.smithi037.stdout:8/250: stat d1/c30 0 2024-09-19T06:08:41.339 INFO:tasks.workunit.client.0.smithi037.stdout:8/251: dread - d1/f54 zero size 2024-09-19T06:08:41.339 INFO:tasks.workunit.client.0.smithi037.stdout:9/218: write da/d20/f2a [4044889,57523] 0 2024-09-19T06:08:41.341 INFO:tasks.workunit.client.0.smithi037.stdout:0/231: creat d5/d8/d11/d15/d21/f4b x:0 0 0 2024-09-19T06:08:41.341 INFO:tasks.workunit.client.0.smithi037.stdout:0/232: rename d5/d8 to d5/d8/d11/d4c 22 2024-09-19T06:08:41.341 INFO:tasks.workunit.client.0.smithi037.stdout:9/219: mknod da/dd/d1b/d23/c49 0 2024-09-19T06:08:41.341 INFO:tasks.workunit.client.0.smithi037.stdout:0/233: rename d5/ff to d5/d8/d22/f4d 0 2024-09-19T06:08:41.342 INFO:tasks.workunit.client.0.smithi037.stdout:9/220: symlink da/dd/d1b/l4a 0 2024-09-19T06:08:41.342 INFO:tasks.workunit.client.0.smithi037.stdout:9/221: symlink da/dd/l4b 0 2024-09-19T06:08:41.343 INFO:tasks.workunit.client.0.smithi037.stdout:9/222: unlink da/f13 0 2024-09-19T06:08:41.345 INFO:tasks.workunit.client.0.smithi037.stdout:9/223: rename da/dd/d1b/d23/f24 to da/dd/d1b/f4c 0 2024-09-19T06:08:41.345 INFO:tasks.workunit.client.0.smithi037.stdout:9/224: truncate da/d20/f40 867650 0 2024-09-19T06:08:41.348 INFO:tasks.workunit.client.0.smithi037.stdout:6/153: dwrite d9/d16/f26 [0,4194304] 0 2024-09-19T06:08:41.353 INFO:tasks.workunit.client.0.smithi037.stdout:8/252: dread d1/d35/d36/d3d/f14 [0,4194304] 0 2024-09-19T06:08:41.353 INFO:tasks.workunit.client.0.smithi037.stdout:8/253: dread - d1/d35/f56 zero size 2024-09-19T06:08:41.356 INFO:tasks.workunit.client.0.smithi037.stdout:6/154: creat d9/dd/d20/f27 x:0 0 0 2024-09-19T06:08:41.364 INFO:tasks.workunit.client.0.smithi037.stdout:0/234: dwrite d5/d8/d11/d32/f39 [0,4194304] 0 2024-09-19T06:08:41.367 INFO:tasks.workunit.client.0.smithi037.stdout:0/235: dread d5/d8/d22/f40 [0,4194304] 0 2024-09-19T06:08:41.373 INFO:tasks.workunit.client.0.smithi037.stdout:0/236: dread d5/d8/d22/f47 [0,4194304] 0 2024-09-19T06:08:41.380 INFO:tasks.workunit.client.0.smithi037.stdout:6/155: dwrite d9/dd/f14 [0,4194304] 0 2024-09-19T06:08:41.381 INFO:tasks.workunit.client.0.smithi037.stdout:6/156: symlink d9/dd/l28 0 2024-09-19T06:08:41.382 INFO:tasks.workunit.client.0.smithi037.stdout:6/157: creat d9/f29 x:0 0 0 2024-09-19T06:08:41.382 INFO:tasks.workunit.client.0.smithi037.stdout:6/158: chown d9/d16/l1d 192262 1 2024-09-19T06:08:41.383 INFO:tasks.workunit.client.0.smithi037.stdout:8/254: dwrite d1/d35/d36/d3d/f26 [0,4194304] 0 2024-09-19T06:08:41.383 INFO:tasks.workunit.client.0.smithi037.stdout:6/159: rename d9/f29 to d9/d16/f2a 0 2024-09-19T06:08:41.385 INFO:tasks.workunit.client.0.smithi037.stdout:6/160: rmdir d9/dd/d20 39 2024-09-19T06:08:41.385 INFO:tasks.workunit.client.0.smithi037.stdout:6/161: fsync d9/f18 0 2024-09-19T06:08:41.394 INFO:tasks.workunit.client.0.smithi037.stdout:2/251: sync 2024-09-19T06:08:41.394 INFO:tasks.workunit.client.0.smithi037.stdout:7/103: sync 2024-09-19T06:08:41.394 INFO:tasks.workunit.client.0.smithi037.stdout:1/101: sync 2024-09-19T06:08:41.395 INFO:tasks.workunit.client.0.smithi037.stdout:5/163: sync 2024-09-19T06:08:41.395 INFO:tasks.workunit.client.0.smithi037.stdout:7/104: fdatasync d6/dc/df/f13 0 2024-09-19T06:08:41.395 INFO:tasks.workunit.client.0.smithi037.stdout:7/105: write d6/dc/fd [709836,63856] 0 2024-09-19T06:08:41.397 INFO:tasks.workunit.client.0.smithi037.stdout:2/252: rename d1/d6/c4f to d1/da/dc/d21/c5c 0 2024-09-19T06:08:41.397 INFO:tasks.workunit.client.0.smithi037.stdout:0/237: dread d5/d8/d11/d32/f39 [0,4194304] 0 2024-09-19T06:08:41.397 INFO:tasks.workunit.client.0.smithi037.stdout:0/238: readlink d5/d8/l1b 0 2024-09-19T06:08:41.397 INFO:tasks.workunit.client.0.smithi037.stdout:1/102: creat d2/f28 x:0 0 0 2024-09-19T06:08:41.398 INFO:tasks.workunit.client.0.smithi037.stdout:7/106: getdents d6/dc/df 0 2024-09-19T06:08:41.398 INFO:tasks.workunit.client.0.smithi037.stdout:7/107: readlink d6/dc/df/l1f 0 2024-09-19T06:08:41.399 INFO:tasks.workunit.client.0.smithi037.stdout:7/108: truncate d6/f1d 661784 0 2024-09-19T06:08:41.401 INFO:tasks.workunit.client.0.smithi037.stdout:2/253: rename d1/d6/cf to d1/d6/d2d/c5d 0 2024-09-19T06:08:41.402 INFO:tasks.workunit.client.0.smithi037.stdout:2/254: write d1/da/dc/f45 [7904186,120766] 0 2024-09-19T06:08:41.402 INFO:tasks.workunit.client.0.smithi037.stdout:1/103: write d2/fa [381567,34024] 0 2024-09-19T06:08:41.404 INFO:tasks.workunit.client.0.smithi037.stdout:2/255: mknod d1/da/dc/d21/d55/c5e 0 2024-09-19T06:08:41.404 INFO:tasks.workunit.client.0.smithi037.stdout:8/255: dread d1/d35/d36/d3d/f20 [0,4194304] 0 2024-09-19T06:08:41.404 INFO:tasks.workunit.client.0.smithi037.stdout:1/104: creat d2/d12/d1e/f29 x:0 0 0 2024-09-19T06:08:41.404 INFO:tasks.workunit.client.0.smithi037.stdout:1/105: chown d2/fe 17 1 2024-09-19T06:08:41.404 INFO:tasks.workunit.client.0.smithi037.stdout:2/256: write d1/da/dc/f59 [4688625,94791] 0 2024-09-19T06:08:41.405 INFO:tasks.workunit.client.0.smithi037.stdout:2/257: truncate d1/da/d42/f50 882853 0 2024-09-19T06:08:41.409 INFO:tasks.workunit.client.0.smithi037.stdout:8/256: unlink d1/f55 0 2024-09-19T06:08:41.409 INFO:tasks.workunit.client.0.smithi037.stdout:8/257: chown d1/d35/d36/d3d/d58/l5b 123097596 1 2024-09-19T06:08:41.409 INFO:tasks.workunit.client.0.smithi037.stdout:1/106: mkdir d2/d12/d1e/d2a 0 2024-09-19T06:08:41.409 INFO:tasks.workunit.client.0.smithi037.stdout:2/258: truncate d1/fd 6384276 0 2024-09-19T06:08:41.409 INFO:tasks.workunit.client.0.smithi037.stdout:2/259: truncate d1/d16/f3d 352004 0 2024-09-19T06:08:41.409 INFO:tasks.workunit.client.0.smithi037.stdout:2/260: readlink d1/d16/l44 0 2024-09-19T06:08:41.409 INFO:tasks.workunit.client.0.smithi037.stdout:2/261: chown d1/da/dc/d21/f3c 992981288 1 2024-09-19T06:08:41.409 INFO:tasks.workunit.client.0.smithi037.stdout:1/107: rename d2/d12/d1e/f29 to d2/d12/d17/f2b 0 2024-09-19T06:08:41.409 INFO:tasks.workunit.client.0.smithi037.stdout:5/164: dread d2/d12/f16 [0,4194304] 0 2024-09-19T06:08:41.410 INFO:tasks.workunit.client.0.smithi037.stdout:2/262: rename d1/da/dc/l17 to d1/da/dc/d21/l5f 0 2024-09-19T06:08:41.412 INFO:tasks.workunit.client.0.smithi037.stdout:5/165: truncate d2/d12/d28/f29 869823 0 2024-09-19T06:08:41.413 INFO:tasks.workunit.client.0.smithi037.stdout:6/162: dwrite d9/fc [0,4194304] 0 2024-09-19T06:08:41.415 INFO:tasks.workunit.client.0.smithi037.stdout:2/263: mknod d1/d6/d2d/c60 0 2024-09-19T06:08:41.418 INFO:tasks.workunit.client.0.smithi037.stdout:1/108: rename d2/c5 to d2/d12/d17/c2c 0 2024-09-19T06:08:41.418 INFO:tasks.workunit.client.0.smithi037.stdout:1/109: fdatasync d2/d12/d17/f2b 0 2024-09-19T06:08:41.418 INFO:tasks.workunit.client.0.smithi037.stdout:1/110: chown d2/f28 14356378 1 2024-09-19T06:08:41.418 INFO:tasks.workunit.client.0.smithi037.stdout:1/111: write d2/f16 [341188,19061] 0 2024-09-19T06:08:41.418 INFO:tasks.workunit.client.0.smithi037.stdout:1/112: read - d2/d12/d1d/f24 zero size 2024-09-19T06:08:41.418 INFO:tasks.workunit.client.0.smithi037.stdout:0/239: dread d5/d20/d34/f37 [0,4194304] 0 2024-09-19T06:08:41.418 INFO:tasks.workunit.client.0.smithi037.stdout:8/258: dread d1/d35/d36/d3d/f29 [0,4194304] 0 2024-09-19T06:08:41.421 INFO:tasks.workunit.client.0.smithi037.stdout:6/163: truncate d9/f18 2194008 0 2024-09-19T06:08:41.423 INFO:tasks.workunit.client.0.smithi037.stdout:2/264: creat d1/d16/f61 x:0 0 0 2024-09-19T06:08:41.424 INFO:tasks.workunit.client.0.smithi037.stdout:1/113: mkdir d2/d12/d1e/d2d 0 2024-09-19T06:08:41.426 INFO:tasks.workunit.client.0.smithi037.stdout:0/240: mkdir d5/d8/d11/d15/d21/d4e 0 2024-09-19T06:08:41.427 INFO:tasks.workunit.client.0.smithi037.stdout:6/164: rmdir d9/dd/d20/d21 0 2024-09-19T06:08:41.430 INFO:tasks.workunit.client.0.smithi037.stdout:2/265: mkdir d1/d16/d62 0 2024-09-19T06:08:41.430 INFO:tasks.workunit.client.0.smithi037.stdout:2/266: readlink d1/l9 0 2024-09-19T06:08:41.431 INFO:tasks.workunit.client.0.smithi037.stdout:2/267: write d1/f43 [622366,117530] 0 2024-09-19T06:08:41.436 INFO:tasks.workunit.client.0.smithi037.stdout:0/241: getdents d5/d20/d34 0 2024-09-19T06:08:41.441 INFO:tasks.workunit.client.0.smithi037.stdout:5/166: write d2/d10/f19 [4113656,4938] 0 2024-09-19T06:08:41.441 INFO:tasks.workunit.client.0.smithi037.stdout:7/109: dwrite d6/d10/f1a [0,4194304] 0 2024-09-19T06:08:41.441 INFO:tasks.workunit.client.0.smithi037.stdout:5/167: stat d2/c18 0 2024-09-19T06:08:41.444 INFO:tasks.workunit.client.0.smithi037.stdout:5/168: unlink d2/f2b 0 2024-09-19T06:08:41.444 INFO:tasks.workunit.client.0.smithi037.stdout:7/110: mkdir d6/d21 0 2024-09-19T06:08:41.446 INFO:tasks.workunit.client.0.smithi037.stdout:7/111: rename d6/d10 to d6/dc/d22 0 2024-09-19T06:08:41.448 INFO:tasks.workunit.client.0.smithi037.stdout:1/114: dwrite d2/d12/d1d/f24 [0,4194304] 0 2024-09-19T06:08:41.452 INFO:tasks.workunit.client.0.smithi037.stdout:2/268: dwrite d1/d6/f12 [0,4194304] 0 2024-09-19T06:08:41.457 INFO:tasks.workunit.client.0.smithi037.stdout:6/165: dread d9/f18 [0,4194304] 0 2024-09-19T06:08:41.457 INFO:tasks.workunit.client.0.smithi037.stdout:6/166: readlink d9/d16/l1d 0 2024-09-19T06:08:41.457 INFO:tasks.workunit.client.0.smithi037.stdout:6/167: fsync d9/d16/f2a 0 2024-09-19T06:08:41.459 INFO:tasks.workunit.client.0.smithi037.stdout:6/168: mkdir d9/dd/d2b 0 2024-09-19T06:08:41.459 INFO:tasks.workunit.client.0.smithi037.stdout:6/169: write d9/dd/f22 [720990,51066] 0 2024-09-19T06:08:41.459 INFO:tasks.workunit.client.0.smithi037.stdout:6/170: fsync d9/f19 0 2024-09-19T06:08:41.459 INFO:tasks.workunit.client.0.smithi037.stdout:6/171: truncate d9/dd/f23 264314 0 2024-09-19T06:08:41.459 INFO:tasks.workunit.client.0.smithi037.stdout:6/172: truncate d9/d16/f2a 32312 0 2024-09-19T06:08:41.459 INFO:tasks.workunit.client.0.smithi037.stdout:6/173: write d9/f19 [774216,80915] 0 2024-09-19T06:08:41.459 INFO:tasks.workunit.client.0.smithi037.stdout:2/269: dread d1/da/dc/d21/f3c [0,4194304] 0 2024-09-19T06:08:41.468 INFO:tasks.workunit.client.0.smithi037.stdout:7/112: dread d6/dc/fe [4194304,4194304] 0 2024-09-19T06:08:41.468 INFO:tasks.workunit.client.0.smithi037.stdout:0/242: dwrite d5/f7 [4194304,4194304] 0 2024-09-19T06:08:41.469 INFO:tasks.workunit.client.0.smithi037.stdout:7/113: rename d6/l19 to d6/d21/l23 0 2024-09-19T06:08:41.470 INFO:tasks.workunit.client.0.smithi037.stdout:0/243: mknod d5/d20/d34/c4f 0 2024-09-19T06:08:41.470 INFO:tasks.workunit.client.0.smithi037.stdout:0/244: fdatasync d5/d8/d22/f40 0 2024-09-19T06:08:41.470 INFO:tasks.workunit.client.0.smithi037.stdout:0/245: chown d5/c13 58 1 2024-09-19T06:08:41.471 INFO:tasks.workunit.client.0.smithi037.stdout:0/246: unlink d5/d8/d11/d15/f41 0 2024-09-19T06:08:41.472 INFO:tasks.workunit.client.0.smithi037.stdout:0/247: creat d5/d42/f50 x:0 0 0 2024-09-19T06:08:41.475 INFO:tasks.workunit.client.0.smithi037.stdout:6/174: dread d9/d16/f26 [0,4194304] 0 2024-09-19T06:08:41.480 INFO:tasks.workunit.client.0.smithi037.stdout:2/270: write d1/da/f14 [2903237,56363] 0 2024-09-19T06:08:41.480 INFO:tasks.workunit.client.0.smithi037.stdout:1/115: dwrite d2/f3 [0,4194304] 0 2024-09-19T06:08:41.480 INFO:tasks.workunit.client.0.smithi037.stdout:5/169: dread d2/d10/f19 [0,4194304] 0 2024-09-19T06:08:41.487 INFO:tasks.workunit.client.0.smithi037.stdout:5/170: truncate d2/d12/f17 521079 0 2024-09-19T06:08:41.490 INFO:tasks.workunit.client.0.smithi037.stdout:2/271: link d1/da/dc/f45 d1/da/f63 0 2024-09-19T06:08:41.490 INFO:tasks.workunit.client.0.smithi037.stdout:2/272: chown d1/d6/f12 31335358 1 2024-09-19T06:08:41.492 INFO:tasks.workunit.client.0.smithi037.stdout:1/116: mkdir d2/d12/d1e/d2a/d2e 0 2024-09-19T06:08:41.493 INFO:tasks.workunit.client.0.smithi037.stdout:5/171: creat d2/d12/f32 x:0 0 0 2024-09-19T06:08:41.495 INFO:tasks.workunit.client.0.smithi037.stdout:2/273: rmdir d1/d16 39 2024-09-19T06:08:41.496 INFO:tasks.workunit.client.0.smithi037.stdout:2/274: getdents d1/da/dc/d21/d55 0 2024-09-19T06:08:41.500 INFO:tasks.workunit.client.0.smithi037.stdout:3/178: sync 2024-09-19T06:08:41.502 INFO:tasks.workunit.client.0.smithi037.stdout:7/114: dwrite d6/dc/d22/f1a [0,4194304] 0 2024-09-19T06:08:41.514 INFO:tasks.workunit.client.0.smithi037.stdout:6/175: dwrite d9/dd/f23 [0,4194304] 0 2024-09-19T06:08:41.519 INFO:tasks.workunit.client.0.smithi037.stdout:1/117: dwrite d2/f10 [0,4194304] 0 2024-09-19T06:08:41.521 INFO:tasks.workunit.client.0.smithi037.stdout:7/115: dread f4 [0,4194304] 0 2024-09-19T06:08:41.522 INFO:tasks.workunit.client.0.smithi037.stdout:1/118: creat d2/d12/d1e/d2d/f2f x:0 0 0 2024-09-19T06:08:41.527 INFO:tasks.workunit.client.0.smithi037.stdout:0/248: dwrite d5/d8/d11/d32/f39 [0,4194304] 0 2024-09-19T06:08:41.528 INFO:tasks.workunit.client.0.smithi037.stdout:0/249: dread d5/d8/d22/f4d [0,4194304] 0 2024-09-19T06:08:41.529 INFO:tasks.workunit.client.0.smithi037.stdout:0/250: readlink d5/d20/d34/l35 0 2024-09-19T06:08:41.529 INFO:tasks.workunit.client.0.smithi037.stdout:6/176: dread d9/ff [0,4194304] 0 2024-09-19T06:08:41.530 INFO:tasks.workunit.client.0.smithi037.stdout:0/251: creat d5/d8/d44/f51 x:0 0 0 2024-09-19T06:08:41.531 INFO:tasks.workunit.client.0.smithi037.stdout:6/177: mknod d9/dd/d2b/c2c 0 2024-09-19T06:08:41.531 INFO:tasks.workunit.client.0.smithi037.stdout:6/178: chown d9/dd/l10 16110 1 2024-09-19T06:08:41.532 INFO:tasks.workunit.client.0.smithi037.stdout:6/179: getdents d9/dd/d20 0 2024-09-19T06:08:41.533 INFO:tasks.workunit.client.0.smithi037.stdout:6/180: mkdir d9/dd/d1c/d2d 0 2024-09-19T06:08:41.533 INFO:tasks.workunit.client.0.smithi037.stdout:3/179: dwrite d0/f25 [0,4194304] 0 2024-09-19T06:08:41.534 INFO:tasks.workunit.client.0.smithi037.stdout:5/172: dwrite d2/d12/f32 [0,4194304] 0 2024-09-19T06:08:41.537 INFO:tasks.workunit.client.0.smithi037.stdout:2/275: dwrite d1/da/dc/d21/f3c [0,4194304] 0 2024-09-19T06:08:41.538 INFO:tasks.workunit.client.0.smithi037.stdout:6/181: write d9/f19 [366322,62598] 0 2024-09-19T06:08:41.540 INFO:tasks.workunit.client.0.smithi037.stdout:5/173: symlink d2/d10/l33 0 2024-09-19T06:08:41.540 INFO:tasks.workunit.client.0.smithi037.stdout:5/174: write d2/d10/f1e [937958,111938] 0 2024-09-19T06:08:41.542 INFO:tasks.workunit.client.0.smithi037.stdout:1/119: write d2/d12/f25 [3895319,37514] 0 2024-09-19T06:08:41.544 INFO:tasks.workunit.client.0.smithi037.stdout:2/276: symlink d1/d33/d4c/l64 0 2024-09-19T06:08:41.545 INFO:tasks.workunit.client.0.smithi037.stdout:5/175: mknod d2/d12/c34 0 2024-09-19T06:08:41.547 INFO:tasks.workunit.client.0.smithi037.stdout:1/120: rename d2/d12/d1d/f24 to d2/d12/d1d/f30 0 2024-09-19T06:08:41.549 INFO:tasks.workunit.client.0.smithi037.stdout:2/277: mknod d1/da/dc/c65 0 2024-09-19T06:08:41.550 INFO:tasks.workunit.client.0.smithi037.stdout:5/176: mkdir d2/d12/d28/d22/d35 0 2024-09-19T06:08:41.551 INFO:tasks.workunit.client.0.smithi037.stdout:0/252: write d5/d8/d11/d15/d21/f29 [5123527,50331] 0 2024-09-19T06:08:41.552 INFO:tasks.workunit.client.0.smithi037.stdout:2/278: rmdir d1/da/dc/d21/d51 39 2024-09-19T06:08:41.552 INFO:tasks.workunit.client.0.smithi037.stdout:5/177: creat d2/d12/f36 x:0 0 0 2024-09-19T06:08:41.553 INFO:tasks.workunit.client.0.smithi037.stdout:3/180: truncate d0/f25 583472 0 2024-09-19T06:08:41.555 INFO:tasks.workunit.client.0.smithi037.stdout:5/178: link d2/c18 d2/d12/c37 0 2024-09-19T06:08:41.556 INFO:tasks.workunit.client.0.smithi037.stdout:7/116: dwrite d6/dc/fe [0,4194304] 0 2024-09-19T06:08:41.556 INFO:tasks.workunit.client.0.smithi037.stdout:5/179: chown d2/l25 7369927 1 2024-09-19T06:08:41.556 INFO:tasks.workunit.client.0.smithi037.stdout:7/117: write d6/fa [8435576,57554] 0 2024-09-19T06:08:41.556 INFO:tasks.workunit.client.0.smithi037.stdout:7/118: stat d6/fa 0 2024-09-19T06:08:41.557 INFO:tasks.workunit.client.0.smithi037.stdout:3/181: creat d0/d16/d19/f3b x:0 0 0 2024-09-19T06:08:41.557 INFO:tasks.workunit.client.0.smithi037.stdout:3/182: write d0/d16/d19/d1d/f39 [758381,94366] 0 2024-09-19T06:08:41.561 INFO:tasks.workunit.client.0.smithi037.stdout:7/119: rename d6/dc/d22/c15 to d6/d21/c24 0 2024-09-19T06:08:41.564 INFO:tasks.workunit.client.0.smithi037.stdout:3/183: creat d0/d16/d20/f3c x:0 0 0 2024-09-19T06:08:41.565 INFO:tasks.workunit.client.0.smithi037.stdout:7/120: creat d6/dc/f25 x:0 0 0 2024-09-19T06:08:41.566 INFO:tasks.workunit.client.0.smithi037.stdout:3/184: creat d0/d16/d19/d1d/f3d x:0 0 0 2024-09-19T06:08:41.566 INFO:tasks.workunit.client.0.smithi037.stdout:3/185: fsync d0/d16/d19/d1f/d23/f2a 0 2024-09-19T06:08:41.566 INFO:tasks.workunit.client.0.smithi037.stdout:3/186: dread - d0/d16/d19/d33/f38 zero size 2024-09-19T06:08:41.567 INFO:tasks.workunit.client.0.smithi037.stdout:3/187: creat d0/d16/d20/f3e x:0 0 0 2024-09-19T06:08:41.567 INFO:tasks.workunit.client.0.smithi037.stdout:3/188: chown d0/d16/d19/d1f/d23/f2a 119154 1 2024-09-19T06:08:41.567 INFO:tasks.workunit.client.0.smithi037.stdout:2/279: read d1/da/f32 [4442497,25658] 0 2024-09-19T06:08:41.569 INFO:tasks.workunit.client.0.smithi037.stdout:2/280: rename f0 to d1/da/dc/d21/d55/f66 0 2024-09-19T06:08:41.570 INFO:tasks.workunit.client.0.smithi037.stdout:3/189: symlink d0/l3f 0 2024-09-19T06:08:41.571 INFO:tasks.workunit.client.0.smithi037.stdout:2/281: creat d1/da/dc/d21/f67 x:0 0 0 2024-09-19T06:08:41.572 INFO:tasks.workunit.client.0.smithi037.stdout:6/182: dwrite d9/d16/f2a [0,4194304] 0 2024-09-19T06:08:41.572 INFO:tasks.workunit.client.0.smithi037.stdout:5/180: dread d2/d10/f1f [0,4194304] 0 2024-09-19T06:08:41.572 INFO:tasks.workunit.client.0.smithi037.stdout:6/183: stat d9/dd/l13 0 2024-09-19T06:08:41.573 INFO:tasks.workunit.client.0.smithi037.stdout:0/253: read d5/d8/d22/f46 [1024886,80493] 0 2024-09-19T06:08:41.573 INFO:tasks.workunit.client.0.smithi037.stdout:3/190: creat d0/d16/d19/d1f/d26/d3a/f40 x:0 0 0 2024-09-19T06:08:41.575 INFO:tasks.workunit.client.0.smithi037.stdout:1/121: dwrite d2/f10 [0,4194304] 0 2024-09-19T06:08:41.575 INFO:tasks.workunit.client.0.smithi037.stdout:1/122: dread - d2/d12/d15/f27 zero size 2024-09-19T06:08:41.577 INFO:tasks.workunit.client.0.smithi037.stdout:1/123: dread d2/d12/d1d/f1f [0,4194304] 0 2024-09-19T06:08:41.577 INFO:tasks.workunit.client.0.smithi037.stdout:0/254: fdatasync d5/d8/d11/d15/d21/f29 0 2024-09-19T06:08:41.578 INFO:tasks.workunit.client.0.smithi037.stdout:2/282: creat d1/d6/d2d/f68 x:0 0 0 2024-09-19T06:08:41.578 INFO:tasks.workunit.client.0.smithi037.stdout:2/283: write d1/da/dc/d21/f67 [943658,29899] 0 2024-09-19T06:08:41.580 INFO:tasks.workunit.client.0.smithi037.stdout:3/191: creat d0/d16/d20/f41 x:0 0 0 2024-09-19T06:08:41.581 INFO:tasks.workunit.client.0.smithi037.stdout:1/124: creat d2/d12/d1e/d2a/d2e/f31 x:0 0 0 2024-09-19T06:08:41.581 INFO:tasks.workunit.client.0.smithi037.stdout:0/255: truncate d5/d8/d11/d15/f1e 703060 0 2024-09-19T06:08:41.584 INFO:tasks.workunit.client.0.smithi037.stdout:7/121: dread d6/dc/f16 [0,4194304] 0 2024-09-19T06:08:41.585 INFO:tasks.workunit.client.0.smithi037.stdout:3/192: link d0/f25 d0/d16/d19/f42 0 2024-09-19T06:08:41.586 INFO:tasks.workunit.client.0.smithi037.stdout:0/256: symlink d5/d8/d11/d15/d21/l52 0 2024-09-19T06:08:41.587 INFO:tasks.workunit.client.0.smithi037.stdout:5/181: rmdir d2/d12/d24/d2a 0 2024-09-19T06:08:41.592 INFO:tasks.workunit.client.0.smithi037.stdout:7/122: rmdir d6/d21 39 2024-09-19T06:08:41.592 INFO:tasks.workunit.client.0.smithi037.stdout:7/123: write d6/f1d [780136,68502] 0 2024-09-19T06:08:41.592 INFO:tasks.workunit.client.0.smithi037.stdout:0/257: symlink d5/d8/d22/l53 0 2024-09-19T06:08:41.592 INFO:tasks.workunit.client.0.smithi037.stdout:5/182: link d2/d10/f1f d2/d12/d28/f38 0 2024-09-19T06:08:41.593 INFO:tasks.workunit.client.0.smithi037.stdout:7/124: link d6/c17 d6/dc/c26 0 2024-09-19T06:08:41.594 INFO:tasks.workunit.client.0.smithi037.stdout:0/258: symlink d5/d8/d11/d32/l54 0 2024-09-19T06:08:41.595 INFO:tasks.workunit.client.0.smithi037.stdout:0/259: creat d5/d8/d11/f55 x:0 0 0 2024-09-19T06:08:41.595 INFO:tasks.workunit.client.0.smithi037.stdout:0/260: truncate d5/d8/d11/d15/f45 1600295 0 2024-09-19T06:08:41.597 INFO:tasks.workunit.client.0.smithi037.stdout:0/261: rename d5/d20/d34/f37 to d5/d8/d44/f56 0 2024-09-19T06:08:41.597 INFO:tasks.workunit.client.0.smithi037.stdout:4/169: sync 2024-09-19T06:08:41.597 INFO:tasks.workunit.client.0.smithi037.stdout:9/225: sync 2024-09-19T06:08:41.597 INFO:tasks.workunit.client.0.smithi037.stdout:2/284: fsync d1/d6/d2d/f68 0 2024-09-19T06:08:41.598 INFO:tasks.workunit.client.0.smithi037.stdout:2/285: readlink d1/da/l39 0 2024-09-19T06:08:41.598 INFO:tasks.workunit.client.0.smithi037.stdout:9/226: mkdir da/d4d 0 2024-09-19T06:08:41.599 INFO:tasks.workunit.client.0.smithi037.stdout:2/286: getdents d1/d6 0 2024-09-19T06:08:41.601 INFO:tasks.workunit.client.0.smithi037.stdout:9/227: rename da/fe to da/dd/d1b/d2f/d38/f4e 0 2024-09-19T06:08:41.606 INFO:tasks.workunit.client.0.smithi037.stdout:8/259: sync 2024-09-19T06:08:41.610 INFO:tasks.workunit.client.0.smithi037.stdout:3/193: dwrite d0/d16/d19/d1f/d23/f2a [0,4194304] 0 2024-09-19T06:08:41.615 INFO:tasks.workunit.client.0.smithi037.stdout:5/183: dread d2/fa [0,4194304] 0 2024-09-19T06:08:41.615 INFO:tasks.workunit.client.0.smithi037.stdout:5/184: truncate d2/fa 4666408 0 2024-09-19T06:08:41.615 INFO:tasks.workunit.client.0.smithi037.stdout:8/260: link d1/d35/d36/d3d/c5a d1/d35/d36/d3d/d58/d59/c5f 0 2024-09-19T06:08:41.619 INFO:tasks.workunit.client.0.smithi037.stdout:3/194: stat d0/l1e 0 2024-09-19T06:08:41.622 INFO:tasks.workunit.client.0.smithi037.stdout:5/185: link d2/c18 d2/d12/d28/d22/c39 0 2024-09-19T06:08:41.623 INFO:tasks.workunit.client.0.smithi037.stdout:8/261: getdents d1/d35/d36/d3d 0 2024-09-19T06:08:41.627 INFO:tasks.workunit.client.0.smithi037.stdout:8/262: link d1/d35/d36/d3d/f2e d1/d35/d36/d3d/d58/d59/d5d/f60 0 2024-09-19T06:08:41.628 INFO:tasks.workunit.client.0.smithi037.stdout:3/195: rename d0/d16/d19/d1f to d0/d43 0 2024-09-19T06:08:41.628 INFO:tasks.workunit.client.0.smithi037.stdout:3/196: readlink d0/l3f 0 2024-09-19T06:08:41.628 INFO:tasks.workunit.client.0.smithi037.stdout:3/197: dread - d0/d16/d20/f41 zero size 2024-09-19T06:08:41.629 INFO:tasks.workunit.client.0.smithi037.stdout:8/263: mkdir d1/d61 0 2024-09-19T06:08:41.629 INFO:tasks.workunit.client.0.smithi037.stdout:8/264: fsync d1/d35/d36/d3d/f26 0 2024-09-19T06:08:41.629 INFO:tasks.workunit.client.0.smithi037.stdout:8/265: write d1/d35/f56 [283375,127240] 0 2024-09-19T06:08:41.629 INFO:tasks.workunit.client.0.smithi037.stdout:8/266: chown d1/f6 276112744 1 2024-09-19T06:08:41.629 INFO:tasks.workunit.client.0.smithi037.stdout:7/125: dwrite d6/dc/df/f13 [0,4194304] 0 2024-09-19T06:08:41.630 INFO:tasks.workunit.client.0.smithi037.stdout:3/198: symlink d0/l44 0 2024-09-19T06:08:41.631 INFO:tasks.workunit.client.0.smithi037.stdout:3/199: mkdir d0/d16/d20/d45 0 2024-09-19T06:08:41.631 INFO:tasks.workunit.client.0.smithi037.stdout:3/200: write d0/d16/d19/f2e [890729,115384] 0 2024-09-19T06:08:41.634 INFO:tasks.workunit.client.0.smithi037.stdout:9/228: dwrite da/dd/d1b/f3d [0,4194304] 0 2024-09-19T06:08:41.634 INFO:tasks.workunit.client.0.smithi037.stdout:4/170: dwrite d0/d2/f2b [0,4194304] 0 2024-09-19T06:08:41.636 INFO:tasks.workunit.client.0.smithi037.stdout:9/229: mkdir da/dd/d31/d4f 0 2024-09-19T06:08:41.637 INFO:tasks.workunit.client.0.smithi037.stdout:9/230: creat da/dd/f50 x:0 0 0 2024-09-19T06:08:41.637 INFO:tasks.workunit.client.0.smithi037.stdout:9/231: dread - da/dd/d1b/d2f/f44 zero size 2024-09-19T06:08:41.637 INFO:tasks.workunit.client.0.smithi037.stdout:9/232: truncate da/dd/d1b/f1f 2729484 0 2024-09-19T06:08:41.638 INFO:tasks.workunit.client.0.smithi037.stdout:9/233: truncate da/d20/f2a 4874426 0 2024-09-19T06:08:41.639 INFO:tasks.workunit.client.0.smithi037.stdout:9/234: getdents da/dd/d1b/d43 0 2024-09-19T06:08:41.640 INFO:tasks.workunit.client.0.smithi037.stdout:9/235: symlink da/dd/d1b/d23/l51 0 2024-09-19T06:08:41.640 INFO:tasks.workunit.client.0.smithi037.stdout:7/126: dread d6/dc/f16 [0,4194304] 0 2024-09-19T06:08:41.640 INFO:tasks.workunit.client.0.smithi037.stdout:2/287: dwrite d1/d16/f61 [0,4194304] 0 2024-09-19T06:08:41.642 INFO:tasks.workunit.client.0.smithi037.stdout:9/236: mknod da/dd/d1b/d23/c52 0 2024-09-19T06:08:41.642 INFO:tasks.workunit.client.0.smithi037.stdout:9/237: write da/d20/f2a [17801,95709] 0 2024-09-19T06:08:41.646 INFO:tasks.workunit.client.0.smithi037.stdout:9/238: creat da/d20/f53 x:0 0 0 2024-09-19T06:08:41.657 INFO:tasks.workunit.client.0.smithi037.stdout:5/186: dwrite d2/d10/f1e [0,4194304] 0 2024-09-19T06:08:41.657 INFO:tasks.workunit.client.0.smithi037.stdout:5/187: fdatasync d2/d10/f1f 0 2024-09-19T06:08:41.665 INFO:tasks.workunit.client.0.smithi037.stdout:5/188: truncate d2/d10/f1e 3658617 0 2024-09-19T06:08:41.665 INFO:tasks.workunit.client.0.smithi037.stdout:5/189: fsync d2/d12/f16 0 2024-09-19T06:08:41.666 INFO:tasks.workunit.client.0.smithi037.stdout:5/190: rename d2/fb to d2/d12/f3a 0 2024-09-19T06:08:41.668 INFO:tasks.workunit.client.0.smithi037.stdout:3/201: dwrite d0/d16/d19/d33/f38 [0,4194304] 0 2024-09-19T06:08:41.668 INFO:tasks.workunit.client.0.smithi037.stdout:3/202: write d0/d16/d20/f41 [43861,69541] 0 2024-09-19T06:08:41.669 INFO:tasks.workunit.client.0.smithi037.stdout:5/191: creat d2/d10/f3b x:0 0 0 2024-09-19T06:08:41.669 INFO:tasks.workunit.client.0.smithi037.stdout:5/192: stat d2 0 2024-09-19T06:08:41.672 INFO:tasks.workunit.client.0.smithi037.stdout:8/267: dwrite d1/d35/d36/d3d/f19 [0,4194304] 0 2024-09-19T06:08:41.672 INFO:tasks.workunit.client.0.smithi037.stdout:3/203: mknod d0/d16/d20/d45/c46 0 2024-09-19T06:08:41.672 INFO:tasks.workunit.client.0.smithi037.stdout:5/193: rmdir d2/d12/d28 39 2024-09-19T06:08:41.673 INFO:tasks.workunit.client.0.smithi037.stdout:4/171: dwrite d0/d6/d1b/f28 [0,4194304] 0 2024-09-19T06:08:41.673 INFO:tasks.workunit.client.0.smithi037.stdout:8/268: dread d1/d35/d36/d3d/f2c [0,4194304] 0 2024-09-19T06:08:41.677 INFO:tasks.workunit.client.0.smithi037.stdout:2/288: dwrite d1/d6/f2f [0,4194304] 0 2024-09-19T06:08:41.677 INFO:tasks.workunit.client.0.smithi037.stdout:2/289: write d1/da/dc/d21/d55/f66 [199447,28283] 0 2024-09-19T06:08:41.677 INFO:tasks.workunit.client.0.smithi037.stdout:3/204: write d0/d16/d19/f42 [499829,125377] 0 2024-09-19T06:08:41.679 INFO:tasks.workunit.client.0.smithi037.stdout:7/127: dwrite d6/fa [0,4194304] 0 2024-09-19T06:08:41.679 INFO:tasks.workunit.client.0.smithi037.stdout:8/269: rename d1/d35/d36/d3d/d58 to d1/d62 0 2024-09-19T06:08:41.681 INFO:tasks.workunit.client.0.smithi037.stdout:4/172: creat d0/d2/d2e/f43 x:0 0 0 2024-09-19T06:08:41.683 INFO:tasks.workunit.client.0.smithi037.stdout:2/290: truncate d1/da/d42/f48 811655 0 2024-09-19T06:08:41.684 INFO:tasks.workunit.client.0.smithi037.stdout:2/291: mknod d1/d33/c69 0 2024-09-19T06:08:41.685 INFO:tasks.workunit.client.0.smithi037.stdout:2/292: readlink d1/d16/l44 0 2024-09-19T06:08:41.685 INFO:tasks.workunit.client.0.smithi037.stdout:2/293: write d1/da/dc/d21/d55/f66 [7176774,97834] 0 2024-09-19T06:08:41.685 INFO:tasks.workunit.client.0.smithi037.stdout:2/294: dread - d1/d6/f24 zero size 2024-09-19T06:08:41.685 INFO:tasks.workunit.client.0.smithi037.stdout:2/295: mknod d1/c6a 0 2024-09-19T06:08:41.686 INFO:tasks.workunit.client.0.smithi037.stdout:2/296: symlink d1/d33/l6b 0 2024-09-19T06:08:41.687 INFO:tasks.workunit.client.0.smithi037.stdout:2/297: dread - d1/d6/d2d/f31 zero size 2024-09-19T06:08:41.687 INFO:tasks.workunit.client.0.smithi037.stdout:5/194: dread d2/fa [0,4194304] 0 2024-09-19T06:08:41.688 INFO:tasks.workunit.client.0.smithi037.stdout:9/239: dwrite da/dd/d1b/d2f/d38/f39 [0,4194304] 0 2024-09-19T06:08:41.689 INFO:tasks.workunit.client.0.smithi037.stdout:5/195: creat d2/d12/d28/d22/f3c x:0 0 0 2024-09-19T06:08:41.693 INFO:tasks.workunit.client.0.smithi037.stdout:9/240: creat da/dd/d1b/d43/f54 x:0 0 0 2024-09-19T06:08:41.693 INFO:tasks.workunit.client.0.smithi037.stdout:9/241: chown da/c1c 761826226 1 2024-09-19T06:08:41.695 INFO:tasks.workunit.client.0.smithi037.stdout:3/205: write d0/d16/d20/f2b [289294,57822] 0 2024-09-19T06:08:41.697 INFO:tasks.workunit.client.0.smithi037.stdout:5/196: symlink d2/d12/d28/d22/d35/l3d 0 2024-09-19T06:08:41.697 INFO:tasks.workunit.client.0.smithi037.stdout:4/173: dread d0/d2/d2e/d36/f2f [0,4194304] 0 2024-09-19T06:08:41.698 INFO:tasks.workunit.client.0.smithi037.stdout:9/242: creat da/dd/d1b/d2f/d38/f55 x:0 0 0 2024-09-19T06:08:41.703 INFO:tasks.workunit.client.0.smithi037.stdout:3/206: mknod d0/d43/d23/c47 0 2024-09-19T06:08:41.704 INFO:tasks.workunit.client.0.smithi037.stdout:2/298: dread d1/d16/f1c [0,4194304] 0 2024-09-19T06:08:41.704 INFO:tasks.workunit.client.0.smithi037.stdout:5/197: rmdir d2 39 2024-09-19T06:08:41.706 INFO:tasks.workunit.client.0.smithi037.stdout:9/243: mkdir da/dd/d1b/d56 0 2024-09-19T06:08:41.706 INFO:tasks.workunit.client.0.smithi037.stdout:9/244: write da/dd/d1b/d43/f46 [10053,48671] 0 2024-09-19T06:08:41.706 INFO:tasks.workunit.client.0.smithi037.stdout:3/207: mkdir d0/d16/d20/d48 0 2024-09-19T06:08:41.708 INFO:tasks.workunit.client.0.smithi037.stdout:7/128: dwrite d6/dc/fe [0,4194304] 0 2024-09-19T06:08:41.708 INFO:tasks.workunit.client.0.smithi037.stdout:7/129: chown d6/d21/c24 13089 1 2024-09-19T06:08:41.708 INFO:tasks.workunit.client.0.smithi037.stdout:7/130: truncate d6/dc/d22/f1a 4485767 0 2024-09-19T06:08:41.708 INFO:tasks.workunit.client.0.smithi037.stdout:3/208: dread d0/d16/d19/f2c [0,4194304] 0 2024-09-19T06:08:41.708 INFO:tasks.workunit.client.0.smithi037.stdout:3/209: chown d0/d43/d23/c47 0 1 2024-09-19T06:08:41.712 INFO:tasks.workunit.client.0.smithi037.stdout:5/198: link d2/d12/d28/f29 d2/d12/f3e 0 2024-09-19T06:08:41.712 INFO:tasks.workunit.client.0.smithi037.stdout:2/299: creat d1/d6/f6c x:0 0 0 2024-09-19T06:08:41.712 INFO:tasks.workunit.client.0.smithi037.stdout:5/199: fdatasync d2/d10/f1e 0 2024-09-19T06:08:41.712 INFO:tasks.workunit.client.0.smithi037.stdout:2/300: truncate d1/da/dc/d21/f38 415118 0 2024-09-19T06:08:41.712 INFO:tasks.workunit.client.0.smithi037.stdout:4/174: rename d0/d6/d1b/f29 to d0/f44 0 2024-09-19T06:08:41.712 INFO:tasks.workunit.client.0.smithi037.stdout:4/175: truncate d0/d6/d1b/f3f 385662 0 2024-09-19T06:08:41.712 INFO:tasks.workunit.client.0.smithi037.stdout:4/176: readlink d0/d2/l35 0 2024-09-19T06:08:41.713 INFO:tasks.workunit.client.0.smithi037.stdout:3/210: mknod d0/d16/d19/d33/c49 0 2024-09-19T06:08:41.714 INFO:tasks.workunit.client.0.smithi037.stdout:5/200: rmdir d2/d12/d28/d22/d35 39 2024-09-19T06:08:41.714 INFO:tasks.workunit.client.0.smithi037.stdout:2/301: creat d1/da/f6d x:0 0 0 2024-09-19T06:08:41.715 INFO:tasks.workunit.client.0.smithi037.stdout:3/211: creat d0/d43/d26/d3a/f4a x:0 0 0 2024-09-19T06:08:41.715 INFO:tasks.workunit.client.0.smithi037.stdout:5/201: getdents d2/d12/d28 0 2024-09-19T06:08:41.717 INFO:tasks.workunit.client.0.smithi037.stdout:2/302: unlink d1/d16/l36 0 2024-09-19T06:08:41.718 INFO:tasks.workunit.client.0.smithi037.stdout:2/303: mkdir d1/da/d6e 0 2024-09-19T06:08:41.719 INFO:tasks.workunit.client.0.smithi037.stdout:2/304: symlink d1/d33/l6f 0 2024-09-19T06:08:41.723 INFO:tasks.workunit.client.0.smithi037.stdout:2/305: getdents d1/d6 0 2024-09-19T06:08:41.728 INFO:tasks.workunit.client.0.smithi037.stdout:2/306: symlink d1/da/d42/l70 0 2024-09-19T06:08:41.728 INFO:tasks.workunit.client.0.smithi037.stdout:2/307: chown d1/d6/c11 1 1 2024-09-19T06:08:41.728 INFO:tasks.workunit.client.0.smithi037.stdout:2/308: write d1/da/dc/f3b [288471,122599] 0 2024-09-19T06:08:41.734 INFO:tasks.workunit.client.0.smithi037.stdout:7/131: dwrite d6/dc/f1b [0,4194304] 0 2024-09-19T06:08:41.734 INFO:tasks.workunit.client.0.smithi037.stdout:9/245: dwrite da/dd/f12 [0,4194304] 0 2024-09-19T06:08:41.737 INFO:tasks.workunit.client.0.smithi037.stdout:7/132: rename d6/d21/c24 to d6/d21/c27 0 2024-09-19T06:08:41.737 INFO:tasks.workunit.client.0.smithi037.stdout:3/212: write d0/d16/d19/f28 [1364228,47578] 0 2024-09-19T06:08:41.738 INFO:tasks.workunit.client.0.smithi037.stdout:7/133: unlink d6/fa 0 2024-09-19T06:08:41.741 INFO:tasks.workunit.client.0.smithi037.stdout:3/213: mknod d0/d16/d20/c4b 0 2024-09-19T06:08:41.741 INFO:tasks.workunit.client.0.smithi037.stdout:3/214: stat d0/l1e 0 2024-09-19T06:08:41.741 INFO:tasks.workunit.client.0.smithi037.stdout:3/215: chown d0/d16/d20/d45/c46 51 1 2024-09-19T06:08:41.741 INFO:tasks.workunit.client.0.smithi037.stdout:3/216: write d0/d16/d20/f3c [382449,127876] 0 2024-09-19T06:08:41.741 INFO:tasks.workunit.client.0.smithi037.stdout:7/134: rmdir d6 39 2024-09-19T06:08:41.748 INFO:tasks.workunit.client.0.smithi037.stdout:4/177: dwrite d0/d6/f23 [0,4194304] 0 2024-09-19T06:08:41.749 INFO:tasks.workunit.client.0.smithi037.stdout:4/178: dread - d0/d6/d1b/d20/f40 zero size 2024-09-19T06:08:41.749 INFO:tasks.workunit.client.0.smithi037.stdout:4/179: read d0/f44 [98266,103157] 0 2024-09-19T06:08:41.750 INFO:tasks.workunit.client.0.smithi037.stdout:5/202: dwrite d2/d12/f17 [0,4194304] 0 2024-09-19T06:08:41.752 INFO:tasks.workunit.client.0.smithi037.stdout:4/180: mkdir d0/d6/d45 0 2024-09-19T06:08:41.752 INFO:tasks.workunit.client.0.smithi037.stdout:9/246: dread da/dd/f12 [0,4194304] 0 2024-09-19T06:08:41.761 INFO:tasks.workunit.client.0.smithi037.stdout:7/135: dwrite d6/dc/fd [0,4194304] 0 2024-09-19T06:08:41.762 INFO:tasks.workunit.client.0.smithi037.stdout:5/203: link d2/d12/f17 d2/d12/d28/f3f 0 2024-09-19T06:08:41.764 INFO:tasks.workunit.client.0.smithi037.stdout:9/247: rename da/dd/d31/d4f to da/d57 0 2024-09-19T06:08:41.767 INFO:tasks.workunit.client.0.smithi037.stdout:5/204: unlink d2/d12/f3e 0 2024-09-19T06:08:41.767 INFO:tasks.workunit.client.0.smithi037.stdout:5/205: dread - d2/d12/f36 zero size 2024-09-19T06:08:41.769 INFO:tasks.workunit.client.0.smithi037.stdout:9/248: rename da/fc to da/dd/d1b/d56/f58 0 2024-09-19T06:08:41.770 INFO:tasks.workunit.client.0.smithi037.stdout:5/206: mknod d2/d12/d24/c40 0 2024-09-19T06:08:41.771 INFO:tasks.workunit.client.0.smithi037.stdout:9/249: link l2 da/l59 0 2024-09-19T06:08:41.772 INFO:tasks.workunit.client.0.smithi037.stdout:5/207: symlink d2/l41 0 2024-09-19T06:08:41.774 INFO:tasks.workunit.client.0.smithi037.stdout:9/250: creat da/f5a x:0 0 0 2024-09-19T06:08:41.774 INFO:tasks.workunit.client.0.smithi037.stdout:9/251: truncate da/dd/d1b/d43/f54 115459 0 2024-09-19T06:08:41.776 INFO:tasks.workunit.client.0.smithi037.stdout:5/208: dread d2/d10/f21 [0,4194304] 0 2024-09-19T06:08:41.776 INFO:tasks.workunit.client.0.smithi037.stdout:9/252: rename da/dd/d1b/d23/c49 to da/d4d/c5b 0 2024-09-19T06:08:41.776 INFO:tasks.workunit.client.0.smithi037.stdout:5/209: chown d2/d12/d28/d22/c39 4 1 2024-09-19T06:08:41.777 INFO:tasks.workunit.client.0.smithi037.stdout:4/181: dwrite d0/d6/d1b/f3f [0,4194304] 0 2024-09-19T06:08:41.777 INFO:tasks.workunit.client.0.smithi037.stdout:4/182: chown d0/d2/l3b 868229 1 2024-09-19T06:08:41.777 INFO:tasks.workunit.client.0.smithi037.stdout:4/183: stat d0/d2/l3b 0 2024-09-19T06:08:41.778 INFO:tasks.workunit.client.0.smithi037.stdout:9/253: write da/d20/f40 [359024,104382] 0 2024-09-19T06:08:41.778 INFO:tasks.workunit.client.0.smithi037.stdout:9/254: write da/dd/d1b/d43/f46 [1068432,44915] 0 2024-09-19T06:08:41.779 INFO:tasks.workunit.client.0.smithi037.stdout:9/255: dread - da/dd/f50 zero size 2024-09-19T06:08:41.780 INFO:tasks.workunit.client.0.smithi037.stdout:9/256: creat da/d57/f5c x:0 0 0 2024-09-19T06:08:41.781 INFO:tasks.workunit.client.0.smithi037.stdout:9/257: creat da/dd/d1b/d23/f5d x:0 0 0 2024-09-19T06:08:41.785 INFO:tasks.workunit.client.0.smithi037.stdout:7/136: dwrite d6/dc/df/f13 [0,4194304] 0 2024-09-19T06:08:41.787 INFO:tasks.workunit.client.0.smithi037.stdout:7/137: symlink d6/d21/l28 0 2024-09-19T06:08:41.787 INFO:tasks.workunit.client.0.smithi037.stdout:4/184: dread d0/d2/d2e/d36/f2f [0,4194304] 0 2024-09-19T06:08:41.787 INFO:tasks.workunit.client.0.smithi037.stdout:4/185: fdatasync d0/d2/d2e/f43 0 2024-09-19T06:08:41.787 INFO:tasks.workunit.client.0.smithi037.stdout:7/138: creat d6/d21/f29 x:0 0 0 2024-09-19T06:08:41.788 INFO:tasks.workunit.client.0.smithi037.stdout:7/139: dread - d6/d21/f29 zero size 2024-09-19T06:08:41.788 INFO:tasks.workunit.client.0.smithi037.stdout:4/186: chown d0/l1 138161 1 2024-09-19T06:08:41.788 INFO:tasks.workunit.client.0.smithi037.stdout:4/187: dread - d0/d2/f1d zero size 2024-09-19T06:08:41.790 INFO:tasks.workunit.client.0.smithi037.stdout:9/258: dread da/d20/f34 [0,4194304] 0 2024-09-19T06:08:41.790 INFO:tasks.workunit.client.0.smithi037.stdout:9/259: chown da/dd/cf 1524602150 1 2024-09-19T06:08:41.793 INFO:tasks.workunit.client.0.smithi037.stdout:4/188: mkdir d0/d2/d37/d46 0 2024-09-19T06:08:41.793 INFO:tasks.workunit.client.0.smithi037.stdout:9/260: symlink da/dd/d1b/d23/d3f/d45/l5e 0 2024-09-19T06:08:41.794 INFO:tasks.workunit.client.0.smithi037.stdout:9/261: creat da/dd/d1b/d43/f5f x:0 0 0 2024-09-19T06:08:41.795 INFO:tasks.workunit.client.0.smithi037.stdout:4/189: unlink d0/l25 0 2024-09-19T06:08:41.796 INFO:tasks.workunit.client.0.smithi037.stdout:9/262: mknod da/dd/d1b/d23/c60 0 2024-09-19T06:08:41.801 INFO:tasks.workunit.client.0.smithi037.stdout:9/263: dread da/dd/d1b/f4c [0,4194304] 0 2024-09-19T06:08:41.802 INFO:tasks.workunit.client.0.smithi037.stdout:9/264: symlink da/dd/d1b/d23/d3f/l61 0 2024-09-19T06:08:41.810 INFO:tasks.workunit.client.0.smithi037.stdout:7/140: dwrite d6/d21/f29 [0,4194304] 0 2024-09-19T06:08:41.810 INFO:tasks.workunit.client.0.smithi037.stdout:7/141: stat d6/l1e 0 2024-09-19T06:08:41.810 INFO:tasks.workunit.client.0.smithi037.stdout:9/265: truncate da/d20/f40 151427 0 2024-09-19T06:08:41.812 INFO:tasks.workunit.client.0.smithi037.stdout:7/142: rmdir d6/dc 39 2024-09-19T06:08:41.814 INFO:tasks.workunit.client.0.smithi037.stdout:9/266: rmdir da/dd/d1b/d23/d3f/d45 39 2024-09-19T06:08:41.816 INFO:tasks.workunit.client.0.smithi037.stdout:7/143: creat d6/dc/f2a x:0 0 0 2024-09-19T06:08:41.816 INFO:tasks.workunit.client.0.smithi037.stdout:7/144: fdatasync d6/f1d 0 2024-09-19T06:08:41.817 INFO:tasks.workunit.client.0.smithi037.stdout:9/267: mkdir da/dd/d1b/d62 0 2024-09-19T06:08:41.817 INFO:tasks.workunit.client.0.smithi037.stdout:9/268: write da/dd/f12 [4509814,62708] 0 2024-09-19T06:08:41.819 INFO:tasks.workunit.client.0.smithi037.stdout:7/145: unlink f4 0 2024-09-19T06:08:41.820 INFO:tasks.workunit.client.0.smithi037.stdout:9/269: mkdir da/dd/d63 0 2024-09-19T06:08:41.820 INFO:tasks.workunit.client.0.smithi037.stdout:1/125: sync 2024-09-19T06:08:41.821 INFO:tasks.workunit.client.0.smithi037.stdout:9/270: symlink da/dd/d1b/d56/l64 0 2024-09-19T06:08:41.822 INFO:tasks.workunit.client.0.smithi037.stdout:9/271: fsync da/dd/d1b/f3d 0 2024-09-19T06:08:41.822 INFO:tasks.workunit.client.0.smithi037.stdout:9/272: truncate da/dd/d1b/d23/d3f/d45/f48 4593507 0 2024-09-19T06:08:41.822 INFO:tasks.workunit.client.0.smithi037.stdout:1/126: getdents d2/d12/d1e/d2a 0 2024-09-19T06:08:41.823 INFO:tasks.workunit.client.0.smithi037.stdout:9/273: creat da/dd/d1b/d2f/f65 x:0 0 0 2024-09-19T06:08:41.825 INFO:tasks.workunit.client.0.smithi037.stdout:1/127: creat d2/d12/d15/f32 x:0 0 0 2024-09-19T06:08:41.825 INFO:tasks.workunit.client.0.smithi037.stdout:1/128: write d2/d12/d1e/d2d/f2f [383034,13216] 0 2024-09-19T06:08:41.826 INFO:tasks.workunit.client.0.smithi037.stdout:1/129: symlink d2/d12/d1e/d2a/l33 0 2024-09-19T06:08:41.833 INFO:tasks.workunit.client.0.smithi037.stdout:1/130: getdents d2/d12/d15 0 2024-09-19T06:08:41.834 INFO:tasks.workunit.client.0.smithi037.stdout:1/131: mkdir d2/d12/d15/d34 0 2024-09-19T06:08:41.844 INFO:tasks.workunit.client.0.smithi037.stdout:7/146: dwrite d6/d21/f29 [0,4194304] 0 2024-09-19T06:08:41.844 INFO:tasks.workunit.client.0.smithi037.stdout:7/147: readlink d6/l1e 0 2024-09-19T06:08:41.850 INFO:tasks.workunit.client.0.smithi037.stdout:9/274: dwrite da/dd/d1b/f36 [0,4194304] 0 2024-09-19T06:08:41.853 INFO:tasks.workunit.client.0.smithi037.stdout:9/275: creat da/dd/d1b/d43/f66 x:0 0 0 2024-09-19T06:08:41.854 INFO:tasks.workunit.client.0.smithi037.stdout:9/276: mknod da/d20/c67 0 2024-09-19T06:08:41.856 INFO:tasks.workunit.client.0.smithi037.stdout:9/277: creat da/d4d/f68 x:0 0 0 2024-09-19T06:08:41.856 INFO:tasks.workunit.client.0.smithi037.stdout:1/132: dwrite d2/d12/d1e/d2d/f2f [0,4194304] 0 2024-09-19T06:08:41.857 INFO:tasks.workunit.client.0.smithi037.stdout:9/278: creat da/dd/d1b/d23/f69 x:0 0 0 2024-09-19T06:08:41.859 INFO:tasks.workunit.client.0.smithi037.stdout:1/133: read d2/f9 [12578,13288] 0 2024-09-19T06:08:41.879 INFO:tasks.workunit.client.0.smithi037.stdout:9/279: dwrite da/dd/f12 [0,4194304] 0 2024-09-19T06:08:41.879 INFO:tasks.workunit.client.0.smithi037.stdout:9/280: chown da/dd/d1b/d23/d3f/d45/l5e 63 1 2024-09-19T06:08:41.881 INFO:tasks.workunit.client.0.smithi037.stdout:9/281: mkdir da/dd/d1b/d23/d6a 0 2024-09-19T06:08:41.881 INFO:tasks.workunit.client.0.smithi037.stdout:9/282: chown da/dd/cf 36744 1 2024-09-19T06:08:41.881 INFO:tasks.workunit.client.0.smithi037.stdout:9/283: truncate da/dd/d1b/d43/f66 546026 0 2024-09-19T06:08:41.881 INFO:tasks.workunit.client.0.smithi037.stdout:9/284: fsync da/f3b 0 2024-09-19T06:08:41.881 INFO:tasks.workunit.client.0.smithi037.stdout:9/285: dread - da/dd/d1b/d43/f5f zero size 2024-09-19T06:08:41.882 INFO:tasks.workunit.client.0.smithi037.stdout:9/286: mknod da/dd/d31/c6b 0 2024-09-19T06:08:41.882 INFO:tasks.workunit.client.0.smithi037.stdout:9/287: write da/f27 [185033,87534] 0 2024-09-19T06:08:41.894 INFO:tasks.workunit.client.0.smithi037.stdout:9/288: read da/dd/d1b/d2f/d38/f4e [3332330,26185] 0 2024-09-19T06:08:41.896 INFO:tasks.workunit.client.0.smithi037.stdout:9/289: rename da/dd/d1b/d23/c60 to da/dd/d1b/d62/c6c 0 2024-09-19T06:08:41.897 INFO:tasks.workunit.client.0.smithi037.stdout:9/290: mkdir da/dd/d1b/d2f/d6d 0 2024-09-19T06:08:41.900 INFO:tasks.workunit.client.0.smithi037.stdout:9/291: dread da/dd/d1b/d56/f58 [0,4194304] 0 2024-09-19T06:08:41.900 INFO:tasks.workunit.client.0.smithi037.stdout:9/292: chown da/d20/f34 103111 1 2024-09-19T06:08:41.912 INFO:tasks.workunit.client.0.smithi037.stdout:9/293: write da/dd/d1b/f21 [2457055,125669] 0 2024-09-19T06:08:41.912 INFO:tasks.workunit.client.0.smithi037.stdout:9/294: fdatasync da/dd/d1b/d23/f69 0 2024-09-19T06:08:41.913 INFO:tasks.workunit.client.0.smithi037.stdout:9/295: mknod da/dd/d1b/d56/c6e 0 2024-09-19T06:08:41.933 INFO:tasks.workunit.client.0.smithi037.stdout:9/296: dwrite da/dd/f50 [0,4194304] 0 2024-09-19T06:08:41.933 INFO:tasks.workunit.client.0.smithi037.stdout:9/297: chown da/dd/f12 558546 1 2024-09-19T06:08:41.934 INFO:tasks.workunit.client.0.smithi037.stdout:9/298: mkdir da/dd/d1b/d2f/d6f 0 2024-09-19T06:08:41.936 INFO:tasks.workunit.client.0.smithi037.stdout:9/299: rename da/d20/f53 to da/dd/d1b/d2f/f70 0 2024-09-19T06:08:41.936 INFO:tasks.workunit.client.0.smithi037.stdout:9/300: dread - da/d57/f5c zero size 2024-09-19T06:08:41.936 INFO:tasks.workunit.client.0.smithi037.stdout:9/301: stat da/d4d 0 2024-09-19T06:08:41.942 INFO:tasks.workunit.client.0.smithi037.stdout:9/302: getdents da/dd/d1b/d2f 0 2024-09-19T06:08:41.943 INFO:tasks.workunit.client.0.smithi037.stdout:9/303: symlink da/dd/d1b/d62/l71 0 2024-09-19T06:08:41.944 INFO:tasks.workunit.client.0.smithi037.stdout:9/304: symlink da/dd/d31/l72 0 2024-09-19T06:08:41.945 INFO:tasks.workunit.client.0.smithi037.stdout:9/305: creat da/dd/d1b/d23/f73 x:0 0 0 2024-09-19T06:08:41.946 INFO:tasks.workunit.client.0.smithi037.stdout:9/306: readlink da/dd/l4b 0 2024-09-19T06:08:41.946 INFO:tasks.workunit.client.0.smithi037.stdout:9/307: chown da/dd/d1b/d43/f66 667189131 1 2024-09-19T06:08:41.964 INFO:tasks.workunit.client.0.smithi037.stdout:0/262: sync 2024-09-19T06:08:41.964 INFO:tasks.workunit.client.0.smithi037.stdout:8/270: sync 2024-09-19T06:08:41.964 INFO:tasks.workunit.client.0.smithi037.stdout:6/184: sync 2024-09-19T06:08:41.964 INFO:tasks.workunit.client.0.smithi037.stdout:8/271: chown d1/f18 1 1 2024-09-19T06:08:41.964 INFO:tasks.workunit.client.0.smithi037.stdout:6/185: chown d9/f18 254388 1 2024-09-19T06:08:41.964 INFO:tasks.workunit.client.0.smithi037.stdout:6/186: read d9/f19 [227703,88949] 0 2024-09-19T06:08:41.965 INFO:tasks.workunit.client.0.smithi037.stdout:9/308: dwrite da/dd/d1b/d2f/f65 [0,4194304] 0 2024-09-19T06:08:41.972 INFO:tasks.workunit.client.0.smithi037.stdout:0/263: creat d5/d20/f57 x:0 0 0 2024-09-19T06:08:41.974 INFO:tasks.workunit.client.0.smithi037.stdout:9/309: link da/dd/d1b/l1d da/d4d/l74 0 2024-09-19T06:08:41.975 INFO:tasks.workunit.client.0.smithi037.stdout:0/264: creat d5/d17/f58 x:0 0 0 2024-09-19T06:08:41.976 INFO:tasks.workunit.client.0.smithi037.stdout:9/310: creat da/dd/d1b/d62/f75 x:0 0 0 2024-09-19T06:08:41.977 INFO:tasks.workunit.client.0.smithi037.stdout:9/311: symlink da/dd/d1b/d23/d3f/d45/l76 0 2024-09-19T06:08:41.979 INFO:tasks.workunit.client.0.smithi037.stdout:9/312: link da/dd/d31/c35 da/dd/d1b/d43/c77 0 2024-09-19T06:08:41.979 INFO:tasks.workunit.client.0.smithi037.stdout:9/313: chown da/dd/d1b/d2f/d6d 18 1 2024-09-19T06:08:41.980 INFO:tasks.workunit.client.0.smithi037.stdout:9/314: creat da/dd/d1b/d2f/d38/f78 x:0 0 0 2024-09-19T06:08:41.980 INFO:tasks.workunit.client.0.smithi037.stdout:9/315: chown da/dd/d1b/d43/f66 24 1 2024-09-19T06:08:41.980 INFO:tasks.workunit.client.0.smithi037.stdout:9/316: chown da/dd/d1b/d2f/f70 62 1 2024-09-19T06:08:41.987 INFO:tasks.workunit.client.0.smithi037.stdout:8/272: dwrite d1/d35/d36/d3d/f27 [0,4194304] 0 2024-09-19T06:08:41.987 INFO:tasks.workunit.client.0.smithi037.stdout:8/273: chown d1/f1e 64 1 2024-09-19T06:08:41.999 INFO:tasks.workunit.client.0.smithi037.stdout:9/317: dread da/dd/d1b/f1f [0,4194304] 0 2024-09-19T06:08:42.000 INFO:tasks.workunit.client.0.smithi037.stdout:9/318: rmdir da/dd/d1b/d62 39 2024-09-19T06:08:42.000 INFO:tasks.workunit.client.0.smithi037.stdout:9/319: chown da/dd/d1b/l1d 1 1 2024-09-19T06:08:42.001 INFO:tasks.workunit.client.0.smithi037.stdout:9/320: symlink da/dd/d1b/d23/d3f/l79 0 2024-09-19T06:08:42.007 INFO:tasks.workunit.client.0.smithi037.stdout:0/265: dwrite d5/d8/d11/d32/f39 [0,4194304] 0 2024-09-19T06:08:42.008 INFO:tasks.workunit.client.0.smithi037.stdout:0/266: symlink d5/d8/d11/d15/d21/l59 0 2024-09-19T06:08:42.012 INFO:tasks.workunit.client.0.smithi037.stdout:8/274: dwrite d1/d35/d36/d3d/f20 [0,4194304] 0 2024-09-19T06:08:42.012 INFO:tasks.workunit.client.0.smithi037.stdout:8/275: write d1/d35/d36/d3d/f34 [268256,38195] 0 2024-09-19T06:08:42.012 INFO:tasks.workunit.client.0.smithi037.stdout:8/276: readlink d1/d35/d36/l47 0 2024-09-19T06:08:42.013 INFO:tasks.workunit.client.0.smithi037.stdout:9/321: write da/dd/d1b/f36 [4191414,81811] 0 2024-09-19T06:08:42.013 INFO:tasks.workunit.client.0.smithi037.stdout:9/322: chown da/dd/d1b/d43/c77 197 1 2024-09-19T06:08:42.014 INFO:tasks.workunit.client.0.smithi037.stdout:8/277: link d1/c28 d1/d62/d59/d5d/c63 0 2024-09-19T06:08:42.014 INFO:tasks.workunit.client.0.smithi037.stdout:8/278: chown d1/f24 831736 1 2024-09-19T06:08:42.014 INFO:tasks.workunit.client.0.smithi037.stdout:8/279: write d1/f4b [782451,2177] 0 2024-09-19T06:08:42.015 INFO:tasks.workunit.client.0.smithi037.stdout:0/267: dread d5/d8/f3f [0,4194304] 0 2024-09-19T06:08:42.015 INFO:tasks.workunit.client.0.smithi037.stdout:0/268: chown d5/d8/d11/d15/d21/f49 1 1 2024-09-19T06:08:42.015 INFO:tasks.workunit.client.0.smithi037.stdout:0/269: fsync d5/d42/f50 0 2024-09-19T06:08:42.015 INFO:tasks.workunit.client.0.smithi037.stdout:0/270: truncate d5/d8/f3f 2204002 0 2024-09-19T06:08:42.015 INFO:tasks.workunit.client.0.smithi037.stdout:8/280: symlink d1/d61/l64 0 2024-09-19T06:08:42.016 INFO:tasks.workunit.client.0.smithi037.stdout:9/323: rename da/dd/c29 to da/d20/c7a 0 2024-09-19T06:08:42.016 INFO:tasks.workunit.client.0.smithi037.stdout:9/324: chown da/dd/d63 94 1 2024-09-19T06:08:42.032 INFO:tasks.workunit.client.0.smithi037.stdout:9/325: write da/f3b [1366035,128144] 0 2024-09-19T06:08:42.033 INFO:tasks.workunit.client.0.smithi037.stdout:9/326: getdents da/dd/d1b/d56 0 2024-09-19T06:08:42.034 INFO:tasks.workunit.client.0.smithi037.stdout:9/327: chown da/dd/d1b/d23/f69 31346 1 2024-09-19T06:08:42.034 INFO:tasks.workunit.client.0.smithi037.stdout:9/328: fsync da/f27 0 2024-09-19T06:08:42.034 INFO:tasks.workunit.client.0.smithi037.stdout:9/329: rename da/dd to da/dd/d1b/d2f/d38/d7b 22 2024-09-19T06:08:42.034 INFO:tasks.workunit.client.0.smithi037.stdout:9/330: read da/dd/d1b/d2f/d38/f4e [1263933,16704] 0 2024-09-19T06:08:42.034 INFO:tasks.workunit.client.0.smithi037.stdout:9/331: creat da/dd/d1b/d43/f7c x:0 0 0 2024-09-19T06:08:42.034 INFO:tasks.workunit.client.0.smithi037.stdout:9/332: chown da/dd/c42 16341 1 2024-09-19T06:08:42.035 INFO:tasks.workunit.client.0.smithi037.stdout:9/333: symlink da/l7d 0 2024-09-19T06:08:42.036 INFO:tasks.workunit.client.0.smithi037.stdout:9/334: truncate da/dd/d1b/f3d 3458727 0 2024-09-19T06:08:42.036 INFO:tasks.workunit.client.0.smithi037.stdout:9/335: chown da/c2c 43 1 2024-09-19T06:08:42.036 INFO:tasks.workunit.client.0.smithi037.stdout:0/271: dwrite d5/d8/d11/d15/f1c [4194304,4194304] 0 2024-09-19T06:08:42.038 INFO:tasks.workunit.client.0.smithi037.stdout:0/272: creat d5/d8/d44/d48/f5a x:0 0 0 2024-09-19T06:08:42.041 INFO:tasks.workunit.client.0.smithi037.stdout:0/273: read d5/d8/d11/d15/f1e [130823,35258] 0 2024-09-19T06:08:42.042 INFO:tasks.workunit.client.0.smithi037.stdout:0/274: write d5/d8/d44/d48/f5a [193971,62605] 0 2024-09-19T06:08:42.042 INFO:tasks.workunit.client.0.smithi037.stdout:0/275: fsync d5/f7 0 2024-09-19T06:08:42.050 INFO:tasks.workunit.client.0.smithi037.stdout:2/309: sync 2024-09-19T06:08:42.065 INFO:tasks.workunit.client.0.smithi037.stdout:2/310: truncate d1/fd 4918865 0 2024-09-19T06:08:42.066 INFO:tasks.workunit.client.0.smithi037.stdout:2/311: readlink d1/d6/l3f 0 2024-09-19T06:08:42.066 INFO:tasks.workunit.client.0.smithi037.stdout:2/312: symlink d1/d33/d4c/l71 0 2024-09-19T06:08:42.066 INFO:tasks.workunit.client.0.smithi037.stdout:2/313: mknod d1/da/dc/d21/d55/c72 0 2024-09-19T06:08:42.066 INFO:tasks.workunit.client.0.smithi037.stdout:2/314: creat d1/d16/d62/f73 x:0 0 0 2024-09-19T06:08:42.066 INFO:tasks.workunit.client.0.smithi037.stdout:9/336: dwrite da/dd/d1b/f21 [4194304,4194304] 0 2024-09-19T06:08:42.066 INFO:tasks.workunit.client.0.smithi037.stdout:9/337: dread - da/dd/d31/f3a zero size 2024-09-19T06:08:42.066 INFO:tasks.workunit.client.0.smithi037.stdout:9/338: fdatasync da/d57/f5c 0 2024-09-19T06:08:42.066 INFO:tasks.workunit.client.0.smithi037.stdout:9/339: readlink da/dd/d1b/d23/d3f/d45/l5e 0 2024-09-19T06:08:42.066 INFO:tasks.workunit.client.0.smithi037.stdout:2/315: rename d1/fd to d1/d16/f74 0 2024-09-19T06:08:42.066 INFO:tasks.workunit.client.0.smithi037.stdout:9/340: symlink da/dd/l7e 0 2024-09-19T06:08:42.066 INFO:tasks.workunit.client.0.smithi037.stdout:0/276: dwrite d5/fa [4194304,4194304] 0 2024-09-19T06:08:42.066 INFO:tasks.workunit.client.0.smithi037.stdout:2/316: creat d1/d16/d4a/f75 x:0 0 0 2024-09-19T06:08:42.066 INFO:tasks.workunit.client.0.smithi037.stdout:9/341: unlink da/dd/c16 0 2024-09-19T06:08:42.067 INFO:tasks.workunit.client.0.smithi037.stdout:2/317: dread d1/da/dc/f3b [0,4194304] 0 2024-09-19T06:08:42.067 INFO:tasks.workunit.client.0.smithi037.stdout:2/318: write d1/da/dc/f15 [564871,60736] 0 2024-09-19T06:08:42.068 INFO:tasks.workunit.client.0.smithi037.stdout:0/277: getdents d5/d8/d22 0 2024-09-19T06:08:42.068 INFO:tasks.workunit.client.0.smithi037.stdout:0/278: write d5/d8/d22/f46 [5184216,48941] 0 2024-09-19T06:08:42.068 INFO:tasks.workunit.client.0.smithi037.stdout:2/319: symlink d1/d6/l76 0 2024-09-19T06:08:42.069 INFO:tasks.workunit.client.0.smithi037.stdout:0/279: write d5/d8/f3f [2142622,46566] 0 2024-09-19T06:08:42.070 INFO:tasks.workunit.client.0.smithi037.stdout:2/320: rename d1/da/d42/c58 to d1/da/dc/d21/c77 0 2024-09-19T06:08:42.071 INFO:tasks.workunit.client.0.smithi037.stdout:0/280: truncate d5/d8/d11/d15/f1c 2729381 0 2024-09-19T06:08:42.072 INFO:tasks.workunit.client.0.smithi037.stdout:0/281: symlink d5/d8/d11/l5b 0 2024-09-19T06:08:42.074 INFO:tasks.workunit.client.0.smithi037.stdout:0/282: rename d5/d8/l2d to d5/d8/d44/l5c 0 2024-09-19T06:08:42.076 INFO:tasks.workunit.client.0.smithi037.stdout:0/283: symlink d5/d17/l5d 0 2024-09-19T06:08:42.076 INFO:tasks.workunit.client.0.smithi037.stdout:0/284: fdatasync d5/d42/f50 0 2024-09-19T06:08:42.076 INFO:tasks.workunit.client.0.smithi037.stdout:0/285: chown d5/d8/c2c 125227037 1 2024-09-19T06:08:42.077 INFO:tasks.workunit.client.0.smithi037.stdout:0/286: unlink d5/c27 0 2024-09-19T06:08:42.078 INFO:tasks.workunit.client.0.smithi037.stdout:9/342: write da/dd/d1b/d2f/f65 [1575562,74392] 0 2024-09-19T06:08:42.078 INFO:tasks.workunit.client.0.smithi037.stdout:0/287: stat d5/l2a 0 2024-09-19T06:08:42.078 INFO:tasks.workunit.client.0.smithi037.stdout:0/288: chown d5/d8/d11/d15/f45 1172122 1 2024-09-19T06:08:42.079 INFO:tasks.workunit.client.0.smithi037.stdout:9/343: rename da/dd/d1b/d23/f5d to da/dd/d1b/d23/d6a/f7f 0 2024-09-19T06:08:42.081 INFO:tasks.workunit.client.0.smithi037.stdout:0/289: creat d5/d8/d11/d32/f5e x:0 0 0 2024-09-19T06:08:42.085 INFO:tasks.workunit.client.0.smithi037.stdout:9/344: unlink da/dd/d1b/d62/c6c 0 2024-09-19T06:08:42.085 INFO:tasks.workunit.client.0.smithi037.stdout:9/345: dread - da/d57/f5c zero size 2024-09-19T06:08:42.086 INFO:tasks.workunit.client.0.smithi037.stdout:0/290: truncate d5/d8/d22/f4d 151965 0 2024-09-19T06:08:42.088 INFO:tasks.workunit.client.0.smithi037.stdout:9/346: mkdir da/dd/d63/d80 0 2024-09-19T06:08:42.088 INFO:tasks.workunit.client.0.smithi037.stdout:0/291: creat d5/d17/f5f x:0 0 0 2024-09-19T06:08:42.089 INFO:tasks.workunit.client.0.smithi037.stdout:0/292: chown d5/d8/d11/d15/f1e 5902 1 2024-09-19T06:08:42.089 INFO:tasks.workunit.client.0.smithi037.stdout:9/347: rename da/d4d/c5b to da/dd/d1b/d43/c81 0 2024-09-19T06:08:42.091 INFO:tasks.workunit.client.0.smithi037.stdout:2/321: dwrite d1/f29 [0,4194304] 0 2024-09-19T06:08:42.091 INFO:tasks.workunit.client.0.smithi037.stdout:2/322: chown d1/da/dc/d21/l22 8123679 1 2024-09-19T06:08:42.091 INFO:tasks.workunit.client.0.smithi037.stdout:2/323: fdatasync d1/d16/f40 0 2024-09-19T06:08:42.092 INFO:tasks.workunit.client.0.smithi037.stdout:2/324: symlink d1/da/d42/l78 0 2024-09-19T06:08:42.092 INFO:tasks.workunit.client.0.smithi037.stdout:2/325: readlink d1/da/dc/d21/l22 0 2024-09-19T06:08:42.093 INFO:tasks.workunit.client.0.smithi037.stdout:2/326: mknod d1/da/dc/c79 0 2024-09-19T06:08:42.094 INFO:tasks.workunit.client.0.smithi037.stdout:2/327: link d1/d16/f61 d1/d6/f7a 0 2024-09-19T06:08:42.096 INFO:tasks.workunit.client.0.smithi037.stdout:2/328: creat d1/d6/f7b x:0 0 0 2024-09-19T06:08:42.102 INFO:tasks.workunit.client.0.smithi037.stdout:0/293: dread d5/d8/d44/f56 [0,4194304] 0 2024-09-19T06:08:42.112 INFO:tasks.workunit.client.0.smithi037.stdout:2/329: dread d1/da/dc/f18 [0,4194304] 0 2024-09-19T06:08:42.112 INFO:tasks.workunit.client.0.smithi037.stdout:2/330: write d1/d6/d2d/f34 [264586,72930] 0 2024-09-19T06:08:42.113 INFO:tasks.workunit.client.0.smithi037.stdout:2/331: symlink d1/da/l7c 0 2024-09-19T06:08:42.115 INFO:tasks.workunit.client.0.smithi037.stdout:9/348: dwrite da/dd/f12 [0,4194304] 0 2024-09-19T06:08:42.120 INFO:tasks.workunit.client.0.smithi037.stdout:9/349: rmdir da/dd/d1b/d43 39 2024-09-19T06:08:42.120 INFO:tasks.workunit.client.0.smithi037.stdout:9/350: readlink da/dd/l4b 0 2024-09-19T06:08:42.123 INFO:tasks.workunit.client.0.smithi037.stdout:7/148: sync 2024-09-19T06:08:42.123 INFO:tasks.workunit.client.0.smithi037.stdout:5/210: sync 2024-09-19T06:08:42.123 INFO:tasks.workunit.client.0.smithi037.stdout:3/217: sync 2024-09-19T06:08:42.123 INFO:tasks.workunit.client.0.smithi037.stdout:1/134: sync 2024-09-19T06:08:42.123 INFO:tasks.workunit.client.0.smithi037.stdout:4/190: sync 2024-09-19T06:08:42.123 INFO:tasks.workunit.client.0.smithi037.stdout:7/149: fsync d6/dc/fd 0 2024-09-19T06:08:42.124 INFO:tasks.workunit.client.0.smithi037.stdout:3/218: unlink d0/f12 0 2024-09-19T06:08:42.124 INFO:tasks.workunit.client.0.smithi037.stdout:3/219: fsync d0/d16/d19/f29 0 2024-09-19T06:08:42.124 INFO:tasks.workunit.client.0.smithi037.stdout:3/220: read - d0/d43/d26/f36 zero size 2024-09-19T06:08:42.124 INFO:tasks.workunit.client.0.smithi037.stdout:3/221: chown d0/d16/d20/f41 15464 1 2024-09-19T06:08:42.125 INFO:tasks.workunit.client.0.smithi037.stdout:0/294: dwrite d5/d8/d11/d15/f45 [0,4194304] 0 2024-09-19T06:08:42.125 INFO:tasks.workunit.client.0.smithi037.stdout:0/295: truncate d5/d8/d11/f3e 491327 0 2024-09-19T06:08:42.126 INFO:tasks.workunit.client.0.smithi037.stdout:0/296: write d5/d8/d11/d15/f1e [803738,98581] 0 2024-09-19T06:08:42.126 INFO:tasks.workunit.client.0.smithi037.stdout:1/135: mknod d2/d12/d15/d34/c35 0 2024-09-19T06:08:42.126 INFO:tasks.workunit.client.0.smithi037.stdout:1/136: chown d2/fe 0 1 2024-09-19T06:08:42.126 INFO:tasks.workunit.client.0.smithi037.stdout:5/211: symlink d2/d12/d24/l42 0 2024-09-19T06:08:42.127 INFO:tasks.workunit.client.0.smithi037.stdout:4/191: getdents d0/d6 0 2024-09-19T06:08:42.127 INFO:tasks.workunit.client.0.smithi037.stdout:4/192: stat d0/d6/d1b/d20/f40 0 2024-09-19T06:08:42.127 INFO:tasks.workunit.client.0.smithi037.stdout:4/193: chown d0/f44 3834556 1 2024-09-19T06:08:42.127 INFO:tasks.workunit.client.0.smithi037.stdout:4/194: stat d0/d6/d1b/d30 0 2024-09-19T06:08:42.129 INFO:tasks.workunit.client.0.smithi037.stdout:3/222: rename d0/d16/d20/f3c to d0/d43/f4c 0 2024-09-19T06:08:42.129 INFO:tasks.workunit.client.0.smithi037.stdout:3/223: fdatasync d0/d43/d23/f2a 0 2024-09-19T06:08:42.130 INFO:tasks.workunit.client.0.smithi037.stdout:7/150: truncate d6/dc/df/f13 2626944 0 2024-09-19T06:08:42.133 INFO:tasks.workunit.client.0.smithi037.stdout:0/297: mknod d5/c60 0 2024-09-19T06:08:42.133 INFO:tasks.workunit.client.0.smithi037.stdout:0/298: chown d5/d17/f5f 1015160 1 2024-09-19T06:08:42.134 INFO:tasks.workunit.client.0.smithi037.stdout:1/137: creat d2/d12/d15/f36 x:0 0 0 2024-09-19T06:08:42.134 INFO:tasks.workunit.client.0.smithi037.stdout:1/138: chown d2/d12/d1e/d2a/l33 114038772 1 2024-09-19T06:08:42.135 INFO:tasks.workunit.client.0.smithi037.stdout:5/212: symlink d2/d12/d28/l43 0 2024-09-19T06:08:42.137 INFO:tasks.workunit.client.0.smithi037.stdout:4/195: creat d0/d2/d2e/d36/f47 x:0 0 0 2024-09-19T06:08:42.139 INFO:tasks.workunit.client.0.smithi037.stdout:7/151: link d6/dc/f1b d6/f2b 0 2024-09-19T06:08:42.140 INFO:tasks.workunit.client.0.smithi037.stdout:0/299: mkdir d5/d8/d44/d61 0 2024-09-19T06:08:42.140 INFO:tasks.workunit.client.0.smithi037.stdout:8/281: sync 2024-09-19T06:08:42.140 INFO:tasks.workunit.client.0.smithi037.stdout:6/187: sync 2024-09-19T06:08:42.141 INFO:tasks.workunit.client.0.smithi037.stdout:5/213: truncate d2/fa 311498 0 2024-09-19T06:08:42.142 INFO:tasks.workunit.client.0.smithi037.stdout:9/351: dwrite da/dd/d1b/d23/d3f/d45/f48 [4194304,4194304] 0 2024-09-19T06:08:42.142 INFO:tasks.workunit.client.0.smithi037.stdout:9/352: fdatasync da/dd/d1b/f4c 0 2024-09-19T06:08:42.142 INFO:tasks.workunit.client.0.smithi037.stdout:4/196: mkdir d0/d6/d1b/d20/d48 0 2024-09-19T06:08:42.143 INFO:tasks.workunit.client.0.smithi037.stdout:7/152: mkdir d6/d20/d2c 0 2024-09-19T06:08:42.145 INFO:tasks.workunit.client.0.smithi037.stdout:0/300: truncate d5/d8/f3f 1268145 0 2024-09-19T06:08:42.146 INFO:tasks.workunit.client.0.smithi037.stdout:6/188: creat d9/dd/d1c/f2e x:0 0 0 2024-09-19T06:08:42.146 INFO:tasks.workunit.client.0.smithi037.stdout:6/189: fdatasync d9/dd/d1c/f2e 0 2024-09-19T06:08:42.146 INFO:tasks.workunit.client.0.smithi037.stdout:6/190: chown d9/dd/d1c/d2d 2046 1 2024-09-19T06:08:42.146 INFO:tasks.workunit.client.0.smithi037.stdout:6/191: fdatasync d9/f24 0 2024-09-19T06:08:42.147 INFO:tasks.workunit.client.0.smithi037.stdout:9/353: rename da/dd/d1b/d23/d3f/d45 to da/dd/d1b/d23/d6a/d82 0 2024-09-19T06:08:42.148 INFO:tasks.workunit.client.0.smithi037.stdout:4/197: creat d0/d2/d37/f49 x:0 0 0 2024-09-19T06:08:42.149 INFO:tasks.workunit.client.0.smithi037.stdout:1/139: dread d2/fb [0,4194304] 0 2024-09-19T06:08:42.150 INFO:tasks.workunit.client.0.smithi037.stdout:0/301: creat d5/d42/f62 x:0 0 0 2024-09-19T06:08:42.150 INFO:tasks.workunit.client.0.smithi037.stdout:0/302: write d5/d8/d22/f4d [974173,126367] 0 2024-09-19T06:08:42.151 INFO:tasks.workunit.client.0.smithi037.stdout:3/224: dwrite d0/f2 [0,4194304] 0 2024-09-19T06:08:42.152 INFO:tasks.workunit.client.0.smithi037.stdout:6/192: mkdir d9/dd/d1c/d2d/d2f 0 2024-09-19T06:08:42.154 INFO:tasks.workunit.client.0.smithi037.stdout:4/198: rmdir d0/d6/d1b/d30/d3d 0 2024-09-19T06:08:42.156 INFO:tasks.workunit.client.0.smithi037.stdout:0/303: symlink d5/d8/d11/l63 0 2024-09-19T06:08:42.158 INFO:tasks.workunit.client.0.smithi037.stdout:3/225: rename d0/d16/d19/f2c to d0/d16/f4d 0 2024-09-19T06:08:42.158 INFO:tasks.workunit.client.0.smithi037.stdout:4/199: dread d0/f16 [0,4194304] 0 2024-09-19T06:08:42.159 INFO:tasks.workunit.client.0.smithi037.stdout:6/193: symlink d9/dd/d1c/l30 0 2024-09-19T06:08:42.161 INFO:tasks.workunit.client.0.smithi037.stdout:8/282: dread d1/d35/d36/d3d/f16 [0,4194304] 0 2024-09-19T06:08:42.162 INFO:tasks.workunit.client.0.smithi037.stdout:3/226: unlink d0/f14 0 2024-09-19T06:08:42.163 INFO:tasks.workunit.client.0.smithi037.stdout:4/200: mkdir d0/d6/d45/d4a 0 2024-09-19T06:08:42.164 INFO:tasks.workunit.client.0.smithi037.stdout:6/194: mknod d9/c31 0 2024-09-19T06:08:42.165 INFO:tasks.workunit.client.0.smithi037.stdout:3/227: symlink d0/d43/d26/d3a/l4e 0 2024-09-19T06:08:42.167 INFO:tasks.workunit.client.0.smithi037.stdout:4/201: rename d0/d2/l35 to d0/d6/d45/d4a/l4b 0 2024-09-19T06:08:42.168 INFO:tasks.workunit.client.0.smithi037.stdout:3/228: rename d0/d16 to d0/d16/d4f 22 2024-09-19T06:08:42.169 INFO:tasks.workunit.client.0.smithi037.stdout:3/229: mknod d0/d43/d23/c50 0 2024-09-19T06:08:42.170 INFO:tasks.workunit.client.0.smithi037.stdout:1/140: dread d2/f26 [0,4194304] 0 2024-09-19T06:08:42.172 INFO:tasks.workunit.client.0.smithi037.stdout:3/230: mkdir d0/d16/d20/d51 0 2024-09-19T06:08:42.175 INFO:tasks.workunit.client.0.smithi037.stdout:9/354: dwrite da/dd/d1b/d43/f66 [0,4194304] 0 2024-09-19T06:08:42.177 INFO:tasks.workunit.client.0.smithi037.stdout:8/283: dread d1/f10 [0,4194304] 0 2024-09-19T06:08:42.178 INFO:tasks.workunit.client.0.smithi037.stdout:1/141: mknod d2/d12/d1e/c37 0 2024-09-19T06:08:42.180 INFO:tasks.workunit.client.0.smithi037.stdout:3/231: symlink d0/d43/d37/l52 0 2024-09-19T06:08:42.181 INFO:tasks.workunit.client.0.smithi037.stdout:3/232: readlink d0/l31 0 2024-09-19T06:08:42.181 INFO:tasks.workunit.client.0.smithi037.stdout:3/233: chown d0/d16/d19/f1c 61608543 1 2024-09-19T06:08:42.183 INFO:tasks.workunit.client.0.smithi037.stdout:0/304: dwrite d5/d8/d22/f40 [0,4194304] 0 2024-09-19T06:08:42.183 INFO:tasks.workunit.client.0.smithi037.stdout:0/305: truncate d5/d8/d11/d15/f31 5859068 0 2024-09-19T06:08:42.184 INFO:tasks.workunit.client.0.smithi037.stdout:1/142: creat d2/f38 x:0 0 0 2024-09-19T06:08:42.184 INFO:tasks.workunit.client.0.smithi037.stdout:8/284: symlink d1/d62/d59/l65 0 2024-09-19T06:08:42.185 INFO:tasks.workunit.client.0.smithi037.stdout:1/143: truncate d2/d12/d1e/d2a/d2e/f31 910490 0 2024-09-19T06:08:42.187 INFO:tasks.workunit.client.0.smithi037.stdout:1/144: getdents d2/d12/d1e/d2a 0 2024-09-19T06:08:42.188 INFO:tasks.workunit.client.0.smithi037.stdout:8/285: mkdir d1/d35/d36/d3d/d66 0 2024-09-19T06:08:42.188 INFO:tasks.workunit.client.0.smithi037.stdout:8/286: stat d1/f18 0 2024-09-19T06:08:42.190 INFO:tasks.workunit.client.0.smithi037.stdout:1/145: dread d2/f11 [0,4194304] 0 2024-09-19T06:08:42.191 INFO:tasks.workunit.client.0.smithi037.stdout:1/146: fdatasync d2/f26 0 2024-09-19T06:08:42.191 INFO:tasks.workunit.client.0.smithi037.stdout:1/147: chown d2/d12/d1d/l22 25076691 1 2024-09-19T06:08:42.191 INFO:tasks.workunit.client.0.smithi037.stdout:1/148: chown d2/f16 1 1 2024-09-19T06:08:42.196 INFO:tasks.workunit.client.0.smithi037.stdout:0/306: dread d5/d8/d11/d15/d21/f29 [0,4194304] 0 2024-09-19T06:08:42.197 INFO:tasks.workunit.client.0.smithi037.stdout:0/307: mknod d5/d8/d11/d15/d21/d4e/c64 0 2024-09-19T06:08:42.199 INFO:tasks.workunit.client.0.smithi037.stdout:0/308: creat d5/d8/d44/d48/f65 x:0 0 0 2024-09-19T06:08:42.200 INFO:tasks.workunit.client.0.smithi037.stdout:0/309: unlink d5/d8/d22/f40 0 2024-09-19T06:08:42.200 INFO:tasks.workunit.client.0.smithi037.stdout:0/310: fsync d5/d42/f50 0 2024-09-19T06:08:42.201 INFO:tasks.workunit.client.0.smithi037.stdout:0/311: chown d5/d8 979 1 2024-09-19T06:08:42.201 INFO:tasks.workunit.client.0.smithi037.stdout:0/312: creat d5/d8/f66 x:0 0 0 2024-09-19T06:08:42.205 INFO:tasks.workunit.client.0.smithi037.stdout:3/234: dwrite d0/d16/d19/f2e [0,4194304] 0 2024-09-19T06:08:42.205 INFO:tasks.workunit.client.0.smithi037.stdout:8/287: write d1/f1e [1739502,118759] 0 2024-09-19T06:08:42.206 INFO:tasks.workunit.client.0.smithi037.stdout:9/355: dwrite da/dd/d1b/f1f [0,4194304] 0 2024-09-19T06:08:42.209 INFO:tasks.workunit.client.0.smithi037.stdout:8/288: creat d1/d35/d36/d3d/d66/f67 x:0 0 0 2024-09-19T06:08:42.209 INFO:tasks.workunit.client.0.smithi037.stdout:9/356: creat da/dd/d1b/d56/f83 x:0 0 0 2024-09-19T06:08:42.215 INFO:tasks.workunit.client.0.smithi037.stdout:1/149: dwrite d2/f3 [0,4194304] 0 2024-09-19T06:08:42.224 INFO:tasks.workunit.client.0.smithi037.stdout:1/150: getdents d2/d12/d1d 0 2024-09-19T06:08:42.227 INFO:tasks.workunit.client.0.smithi037.stdout:8/289: dread d1/d35/d36/f3b [0,4194304] 0 2024-09-19T06:08:42.227 INFO:tasks.workunit.client.0.smithi037.stdout:3/235: dwrite d0/d43/d26/f36 [0,4194304] 0 2024-09-19T06:08:42.228 INFO:tasks.workunit.client.0.smithi037.stdout:0/313: dread d5/d8/d11/d15/f31 [0,4194304] 0 2024-09-19T06:08:42.228 INFO:tasks.workunit.client.0.smithi037.stdout:0/314: fdatasync d5/d42/f62 0 2024-09-19T06:08:42.232 INFO:tasks.workunit.client.0.smithi037.stdout:8/290: mkdir d1/d61/d68 0 2024-09-19T06:08:42.232 INFO:tasks.workunit.client.0.smithi037.stdout:8/291: stat d1/f1e 0 2024-09-19T06:08:42.233 INFO:tasks.workunit.client.0.smithi037.stdout:3/236: creat d0/d16/d20/f53 x:0 0 0 2024-09-19T06:08:42.233 INFO:tasks.workunit.client.0.smithi037.stdout:0/315: mknod d5/d20/d34/c67 0 2024-09-19T06:08:42.233 INFO:tasks.workunit.client.0.smithi037.stdout:8/292: mkdir d1/d62/d59/d69 0 2024-09-19T06:08:42.234 INFO:tasks.workunit.client.0.smithi037.stdout:3/237: creat d0/d43/d26/d3a/f54 x:0 0 0 2024-09-19T06:08:42.234 INFO:tasks.workunit.client.0.smithi037.stdout:0/316: mkdir d5/d18/d68 0 2024-09-19T06:08:42.236 INFO:tasks.workunit.client.0.smithi037.stdout:3/238: unlink d0/d43/d23/c47 0 2024-09-19T06:08:42.236 INFO:tasks.workunit.client.0.smithi037.stdout:0/317: rmdir d5/d8/d44/d48 39 2024-09-19T06:08:42.237 INFO:tasks.workunit.client.0.smithi037.stdout:0/318: mknod d5/d42/c69 0 2024-09-19T06:08:42.239 INFO:tasks.workunit.client.0.smithi037.stdout:9/357: dwrite da/dd/d1b/d2f/f65 [4194304,4194304] 0 2024-09-19T06:08:42.241 INFO:tasks.workunit.client.0.smithi037.stdout:3/239: dread d0/d16/d19/f42 [0,4194304] 0 2024-09-19T06:08:42.241 INFO:tasks.workunit.client.0.smithi037.stdout:3/240: dread - d0/d43/d26/d3a/f40 zero size 2024-09-19T06:08:42.241 INFO:tasks.workunit.client.0.smithi037.stdout:9/358: chown da/d20/l41 3850 1 2024-09-19T06:08:42.241 INFO:tasks.workunit.client.0.smithi037.stdout:8/293: write d1/f6 [1743633,32865] 0 2024-09-19T06:08:42.242 INFO:tasks.workunit.client.0.smithi037.stdout:9/359: creat da/dd/d1b/d62/f84 x:0 0 0 2024-09-19T06:08:42.242 INFO:tasks.workunit.client.0.smithi037.stdout:9/360: readlink da/dd/d1b/d62/l71 0 2024-09-19T06:08:42.247 INFO:tasks.workunit.client.0.smithi037.stdout:2/332: sync 2024-09-19T06:08:42.250 INFO:tasks.workunit.client.0.smithi037.stdout:3/241: rename d0/d43/d26/d3a to d0/d16/d20/d45/d55 0 2024-09-19T06:08:42.252 INFO:tasks.workunit.client.0.smithi037.stdout:2/333: rename d1/d6/d2d to d1/da/dc/d21/d7d 0 2024-09-19T06:08:42.253 INFO:tasks.workunit.client.0.smithi037.stdout:2/334: write d1/da/dc/d21/d55/f66 [4987088,80067] 0 2024-09-19T06:08:42.253 INFO:tasks.workunit.client.0.smithi037.stdout:2/335: chown d1/d6/l3f 282 1 2024-09-19T06:08:42.256 INFO:tasks.workunit.client.0.smithi037.stdout:0/319: dread d5/d8/d44/f56 [0,4194304] 0 2024-09-19T06:08:42.256 INFO:tasks.workunit.client.0.smithi037.stdout:3/242: creat d0/d16/f56 x:0 0 0 2024-09-19T06:08:42.256 INFO:tasks.workunit.client.0.smithi037.stdout:2/336: link d1/d33/l6b d1/d6/l7e 0 2024-09-19T06:08:42.257 INFO:tasks.workunit.client.0.smithi037.stdout:9/361: dread da/d20/f2a [0,4194304] 0 2024-09-19T06:08:42.257 INFO:tasks.workunit.client.0.smithi037.stdout:9/362: rmdir da/dd/d1b/d23/d3f 39 2024-09-19T06:08:42.257 INFO:tasks.workunit.client.0.smithi037.stdout:9/363: write da/dd/d1b/d2f/f70 [546228,109958] 0 2024-09-19T06:08:42.266 INFO:tasks.workunit.client.0.smithi037.stdout:0/320: dread d5/d8/d11/d32/f43 [0,4194304] 0 2024-09-19T06:08:42.272 INFO:tasks.workunit.client.0.smithi037.stdout:3/243: dread d0/d16/d20/f2b [0,4194304] 0 2024-09-19T06:08:42.273 INFO:tasks.workunit.client.0.smithi037.stdout:3/244: mknod d0/d43/d37/c57 0 2024-09-19T06:08:42.275 INFO:tasks.workunit.client.0.smithi037.stdout:3/245: mknod d0/d16/d20/d45/c58 0 2024-09-19T06:08:42.277 INFO:tasks.workunit.client.0.smithi037.stdout:9/364: dread da/dd/f50 [0,4194304] 0 2024-09-19T06:08:42.277 INFO:tasks.workunit.client.0.smithi037.stdout:8/294: dwrite d1/d35/d36/d3d/f22 [4194304,4194304] 0 2024-09-19T06:08:42.278 INFO:tasks.workunit.client.0.smithi037.stdout:9/365: dread da/dd/d1b/d43/f54 [0,4194304] 0 2024-09-19T06:08:42.279 INFO:tasks.workunit.client.0.smithi037.stdout:8/295: rmdir d1/d62/d59/d5d 39 2024-09-19T06:08:42.280 INFO:tasks.workunit.client.0.smithi037.stdout:9/366: mkdir da/dd/d1b/d23/d6a/d85 0 2024-09-19T06:08:42.280 INFO:tasks.workunit.client.0.smithi037.stdout:9/367: chown da/dd/f50 11 1 2024-09-19T06:08:42.280 INFO:tasks.workunit.client.0.smithi037.stdout:8/296: mkdir d1/d6a 0 2024-09-19T06:08:42.280 INFO:tasks.workunit.client.0.smithi037.stdout:8/297: chown d1/d35/d36/d3d/f45 31 1 2024-09-19T06:08:42.282 INFO:tasks.workunit.client.0.smithi037.stdout:9/368: mknod da/d20/c86 0 2024-09-19T06:08:42.282 INFO:tasks.workunit.client.0.smithi037.stdout:9/369: write da/d20/f40 [494659,116229] 0 2024-09-19T06:08:42.286 INFO:tasks.workunit.client.0.smithi037.stdout:2/337: dwrite d1/d33/d4c/f53 [0,4194304] 0 2024-09-19T06:08:42.289 INFO:tasks.workunit.client.0.smithi037.stdout:2/338: mkdir d1/d16/d4a/d7f 0 2024-09-19T06:08:42.290 INFO:tasks.workunit.client.0.smithi037.stdout:2/339: rmdir d1/da/dc/d21/d7d 39 2024-09-19T06:08:42.292 INFO:tasks.workunit.client.0.smithi037.stdout:2/340: mkdir d1/da/dc/d21/d7d/d80 0 2024-09-19T06:08:42.292 INFO:tasks.workunit.client.0.smithi037.stdout:2/341: read - d1/d16/f40 zero size 2024-09-19T06:08:42.293 INFO:tasks.workunit.client.0.smithi037.stdout:2/342: creat d1/da/dc/d21/d7d/d80/f81 x:0 0 0 2024-09-19T06:08:42.293 INFO:tasks.workunit.client.0.smithi037.stdout:2/343: stat d1/da/dc/d21/d7d/f31 0 2024-09-19T06:08:42.294 INFO:tasks.workunit.client.0.smithi037.stdout:2/344: creat d1/da/dc/d21/d7d/f82 x:0 0 0 2024-09-19T06:08:42.295 INFO:tasks.workunit.client.0.smithi037.stdout:2/345: link d1/da/l5a d1/da/dc/d21/d55/l83 0 2024-09-19T06:08:42.296 INFO:tasks.workunit.client.0.smithi037.stdout:2/346: mknod d1/d16/d62/c84 0 2024-09-19T06:08:42.296 INFO:tasks.workunit.client.0.smithi037.stdout:8/298: dread d1/d35/d36/d3d/f19 [0,4194304] 0 2024-09-19T06:08:42.297 INFO:tasks.workunit.client.0.smithi037.stdout:2/347: truncate d1/da/dc/d21/f67 511029 0 2024-09-19T06:08:42.297 INFO:tasks.workunit.client.0.smithi037.stdout:2/348: getdents d1/d16/d4a/d7f 0 2024-09-19T06:08:42.297 INFO:tasks.workunit.client.0.smithi037.stdout:8/299: rmdir d1/d62/d59 39 2024-09-19T06:08:42.300 INFO:tasks.workunit.client.0.smithi037.stdout:3/246: dwrite d0/d43/f4c [0,4194304] 0 2024-09-19T06:08:42.300 INFO:tasks.workunit.client.0.smithi037.stdout:3/247: chown d0/f9 126002 1 2024-09-19T06:08:42.304 INFO:tasks.workunit.client.0.smithi037.stdout:9/370: dwrite da/d20/f34 [0,4194304] 0 2024-09-19T06:08:42.307 INFO:tasks.workunit.client.0.smithi037.stdout:3/248: creat d0/d16/d19/f59 x:0 0 0 2024-09-19T06:08:42.307 INFO:tasks.workunit.client.0.smithi037.stdout:3/249: truncate d0/d16/d19/f3b 319761 0 2024-09-19T06:08:42.309 INFO:tasks.workunit.client.0.smithi037.stdout:9/371: creat da/d4d/f87 x:0 0 0 2024-09-19T06:08:42.309 INFO:tasks.workunit.client.0.smithi037.stdout:9/372: write da/dd/d1b/d2f/d38/f55 [479678,15943] 0 2024-09-19T06:08:42.309 INFO:tasks.workunit.client.0.smithi037.stdout:3/250: creat d0/f5a x:0 0 0 2024-09-19T06:08:42.309 INFO:tasks.workunit.client.0.smithi037.stdout:3/251: readlink d0/l44 0 2024-09-19T06:08:42.310 INFO:tasks.workunit.client.0.smithi037.stdout:9/373: getdents da/dd/d1b/d62 0 2024-09-19T06:08:42.311 INFO:tasks.workunit.client.0.smithi037.stdout:9/374: creat da/dd/d1b/d43/f88 x:0 0 0 2024-09-19T06:08:42.311 INFO:tasks.workunit.client.0.smithi037.stdout:5/214: sync 2024-09-19T06:08:42.313 INFO:tasks.workunit.client.0.smithi037.stdout:9/375: unlink da/dd/f12 0 2024-09-19T06:08:42.313 INFO:tasks.workunit.client.0.smithi037.stdout:9/376: chown da/dd/d1b/d2f/d38/f39 61648 1 2024-09-19T06:08:42.314 INFO:tasks.workunit.client.0.smithi037.stdout:5/215: rename d2/l41 to d2/d12/d24/l44 0 2024-09-19T06:08:42.314 INFO:tasks.workunit.client.0.smithi037.stdout:5/216: write d2/d12/d28/d22/f3c [796090,12279] 0 2024-09-19T06:08:42.315 INFO:tasks.workunit.client.0.smithi037.stdout:5/217: creat d2/d12/d28/f45 x:0 0 0 2024-09-19T06:08:42.316 INFO:tasks.workunit.client.0.smithi037.stdout:9/377: rename da/d20/l22 to da/dd/d1b/d56/l89 0 2024-09-19T06:08:42.317 INFO:tasks.workunit.client.0.smithi037.stdout:5/218: getdents d2/d12/d28/d22 0 2024-09-19T06:08:42.318 INFO:tasks.workunit.client.0.smithi037.stdout:5/219: truncate d2/d12/f27 843994 0 2024-09-19T06:08:42.318 INFO:tasks.workunit.client.0.smithi037.stdout:8/300: dwrite d1/f15 [0,4194304] 0 2024-09-19T06:08:42.319 INFO:tasks.workunit.client.0.smithi037.stdout:8/301: rmdir d1/d35/d36/d3d 39 2024-09-19T06:08:42.319 INFO:tasks.workunit.client.0.smithi037.stdout:8/302: fdatasync d1/f2a 0 2024-09-19T06:08:42.321 INFO:tasks.workunit.client.0.smithi037.stdout:8/303: link d1/d35/f56 d1/d35/d36/f6b 0 2024-09-19T06:08:42.321 INFO:tasks.workunit.client.0.smithi037.stdout:8/304: stat d1/f24 0 2024-09-19T06:08:42.323 INFO:tasks.workunit.client.0.smithi037.stdout:8/305: creat d1/f6c x:0 0 0 2024-09-19T06:08:42.324 INFO:tasks.workunit.client.0.smithi037.stdout:9/378: dread da/dd/d1b/d43/f46 [0,4194304] 0 2024-09-19T06:08:42.326 INFO:tasks.workunit.client.0.smithi037.stdout:9/379: mknod da/d20/c8a 0 2024-09-19T06:08:42.326 INFO:tasks.workunit.client.0.smithi037.stdout:9/380: readlink da/dd/d31/l72 0 2024-09-19T06:08:42.334 INFO:tasks.workunit.client.0.smithi037.stdout:5/220: write d2/d10/f1e [521773,35267] 0 2024-09-19T06:08:42.335 INFO:tasks.workunit.client.0.smithi037.stdout:3/252: dwrite d0/d16/d20/d45/d55/f54 [0,4194304] 0 2024-09-19T06:08:42.337 INFO:tasks.workunit.client.0.smithi037.stdout:3/253: link d0/d16/d19/f28 d0/d43/f5b 0 2024-09-19T06:08:42.337 INFO:tasks.workunit.client.0.smithi037.stdout:3/254: chown d0/d16/d20/d45/c58 3014 1 2024-09-19T06:08:42.340 INFO:tasks.workunit.client.0.smithi037.stdout:3/255: rename d0/d16/d20/d45/d55/f54 to d0/d16/d20/f5c 0 2024-09-19T06:08:42.342 INFO:tasks.workunit.client.0.smithi037.stdout:9/381: write da/dd/d1b/f36 [179931,25756] 0 2024-09-19T06:08:42.387 INFO:tasks.workunit.client.0.smithi037.stdout:5/221: dwrite d2/d12/f36 [0,4194304] 0 2024-09-19T06:08:42.388 INFO:tasks.workunit.client.0.smithi037.stdout:8/306: dwrite d1/d35/d36/d3d/f3c [0,4194304] 0 2024-09-19T06:08:42.388 INFO:tasks.workunit.client.0.smithi037.stdout:8/307: chown d1/d62 749 1 2024-09-19T06:08:42.388 INFO:tasks.workunit.client.0.smithi037.stdout:8/308: stat d1/d35/d36/c46 0 2024-09-19T06:08:42.390 INFO:tasks.workunit.client.0.smithi037.stdout:3/256: dwrite d0/d43/f5b [4194304,4194304] 0 2024-09-19T06:08:42.393 INFO:tasks.workunit.client.0.smithi037.stdout:9/382: mkdir da/dd/d63/d80/d8b 0 2024-09-19T06:08:42.393 INFO:tasks.workunit.client.0.smithi037.stdout:9/383: stat c7 0 2024-09-19T06:08:42.393 INFO:tasks.workunit.client.0.smithi037.stdout:9/384: chown da/dd/d1b/d23 56 1 2024-09-19T06:08:42.393 INFO:tasks.workunit.client.0.smithi037.stdout:9/385: write da/dd/f50 [5063564,14226] 0 2024-09-19T06:08:42.393 INFO:tasks.workunit.client.0.smithi037.stdout:9/386: write da/dd/d31/f3a [668070,28232] 0 2024-09-19T06:08:42.393 INFO:tasks.workunit.client.0.smithi037.stdout:9/387: dread - da/f5a zero size 2024-09-19T06:08:42.394 INFO:tasks.workunit.client.0.smithi037.stdout:5/222: symlink d2/d12/d28/d22/l46 0 2024-09-19T06:08:42.397 INFO:tasks.workunit.client.0.smithi037.stdout:8/309: symlink d1/d61/l6d 0 2024-09-19T06:08:42.400 INFO:tasks.workunit.client.0.smithi037.stdout:3/257: dread d0/ff [0,4194304] 0 2024-09-19T06:08:42.400 INFO:tasks.workunit.client.0.smithi037.stdout:5/223: mknod d2/c47 0 2024-09-19T06:08:42.401 INFO:tasks.workunit.client.0.smithi037.stdout:8/310: link d1/d35/d36/d3d/d66/f67 d1/d62/d59/d69/f6e 0 2024-09-19T06:08:42.403 INFO:tasks.workunit.client.0.smithi037.stdout:2/349: sync 2024-09-19T06:08:42.403 INFO:tasks.workunit.client.0.smithi037.stdout:6/195: sync 2024-09-19T06:08:42.403 INFO:tasks.workunit.client.0.smithi037.stdout:6/196: dread - d9/dd/f1b zero size 2024-09-19T06:08:42.403 INFO:tasks.workunit.client.0.smithi037.stdout:4/202: sync 2024-09-19T06:08:42.403 INFO:tasks.workunit.client.0.smithi037.stdout:0/321: sync 2024-09-19T06:08:42.403 INFO:tasks.workunit.client.0.smithi037.stdout:1/151: sync 2024-09-19T06:08:42.403 INFO:tasks.workunit.client.0.smithi037.stdout:4/203: fdatasync d0/d2/d2e/f43 0 2024-09-19T06:08:42.403 INFO:tasks.workunit.client.0.smithi037.stdout:7/153: sync 2024-09-19T06:08:42.403 INFO:tasks.workunit.client.0.smithi037.stdout:7/154: chown d6/dc/d22 26 1 2024-09-19T06:08:42.403 INFO:tasks.workunit.client.0.smithi037.stdout:5/224: creat d2/d12/d28/f48 x:0 0 0 2024-09-19T06:08:42.403 INFO:tasks.workunit.client.0.smithi037.stdout:5/225: chown d2/f23 230764117 1 2024-09-19T06:08:42.403 INFO:tasks.workunit.client.0.smithi037.stdout:5/226: chown d2/d12/f27 6 1 2024-09-19T06:08:42.404 INFO:tasks.workunit.client.0.smithi037.stdout:8/311: unlink d1/f4b 0 2024-09-19T06:08:42.404 INFO:tasks.workunit.client.0.smithi037.stdout:8/312: stat d1/d35/d36/d3d/f39 0 2024-09-19T06:08:42.404 INFO:tasks.workunit.client.0.smithi037.stdout:6/197: creat d9/dd/f32 x:0 0 0 2024-09-19T06:08:42.405 INFO:tasks.workunit.client.0.smithi037.stdout:0/322: symlink d5/d8/d11/d32/l6a 0 2024-09-19T06:08:42.405 INFO:tasks.workunit.client.0.smithi037.stdout:1/152: symlink d2/d12/d1e/d2a/d2e/l39 0 2024-09-19T06:08:42.406 INFO:tasks.workunit.client.0.smithi037.stdout:4/204: getdents d0/d6/d1b/d30 0 2024-09-19T06:08:42.406 INFO:tasks.workunit.client.0.smithi037.stdout:4/205: truncate d0/d6/d1b/d20/f40 711284 0 2024-09-19T06:08:42.406 INFO:tasks.workunit.client.0.smithi037.stdout:7/155: mkdir d6/dc/d2d 0 2024-09-19T06:08:42.407 INFO:tasks.workunit.client.0.smithi037.stdout:8/313: getdents d1/d35/d36 0 2024-09-19T06:08:42.408 INFO:tasks.workunit.client.0.smithi037.stdout:0/323: mknod d5/d8/d44/d61/c6b 0 2024-09-19T06:08:42.408 INFO:tasks.workunit.client.0.smithi037.stdout:1/153: creat d2/f3a x:0 0 0 2024-09-19T06:08:42.409 INFO:tasks.workunit.client.0.smithi037.stdout:4/206: truncate d0/d6/f26 3238557 0 2024-09-19T06:08:42.410 INFO:tasks.workunit.client.0.smithi037.stdout:1/154: creat d2/d12/d15/d34/f3b x:0 0 0 2024-09-19T06:08:42.412 INFO:tasks.workunit.client.0.smithi037.stdout:1/155: creat d2/d12/d1e/d2d/f3c x:0 0 0 2024-09-19T06:08:42.412 INFO:tasks.workunit.client.0.smithi037.stdout:1/156: chown d2/d12/d1e/d2a/d2e 7 1 2024-09-19T06:08:42.414 INFO:tasks.workunit.client.0.smithi037.stdout:1/157: mknod d2/d12/d15/c3d 0 2024-09-19T06:08:42.414 INFO:tasks.workunit.client.0.smithi037.stdout:1/158: chown d2/f4 260606189 1 2024-09-19T06:08:42.414 INFO:tasks.workunit.client.0.smithi037.stdout:1/159: write d2/d12/d15/f36 [1037758,124244] 0 2024-09-19T06:08:42.417 INFO:tasks.workunit.client.0.smithi037.stdout:9/388: dwrite da/d20/f34 [0,4194304] 0 2024-09-19T06:08:42.418 INFO:tasks.workunit.client.0.smithi037.stdout:9/389: chown da/dd/d1b/d43/f54 8716 1 2024-09-19T06:08:42.418 INFO:tasks.workunit.client.0.smithi037.stdout:2/350: dread d1/da/f32 [0,4194304] 0 2024-09-19T06:08:42.419 INFO:tasks.workunit.client.0.smithi037.stdout:9/390: mknod da/dd/d1b/d23/d6a/d82/c8c 0 2024-09-19T06:08:42.421 INFO:tasks.workunit.client.0.smithi037.stdout:6/198: dread d9/f18 [0,4194304] 0 2024-09-19T06:08:42.421 INFO:tasks.workunit.client.0.smithi037.stdout:6/199: readlink d9/dd/l28 0 2024-09-19T06:08:42.422 INFO:tasks.workunit.client.0.smithi037.stdout:9/391: link da/dd/d31/c35 da/dd/d1b/d23/d3f/c8d 0 2024-09-19T06:08:42.425 INFO:tasks.workunit.client.0.smithi037.stdout:6/200: mkdir d9/dd/d1c/d2d/d33 0 2024-09-19T06:08:42.427 INFO:tasks.workunit.client.0.smithi037.stdout:9/392: creat da/d20/f8e x:0 0 0 2024-09-19T06:08:42.428 INFO:tasks.workunit.client.0.smithi037.stdout:1/160: getdents d2/d12/d15/d34 0 2024-09-19T06:08:42.428 INFO:tasks.workunit.client.0.smithi037.stdout:1/161: write d2/d12/f21 [18908,96519] 0 2024-09-19T06:08:42.429 INFO:tasks.workunit.client.0.smithi037.stdout:9/393: mkdir da/dd/d1b/d23/d6a/d8f 0 2024-09-19T06:08:42.429 INFO:tasks.workunit.client.0.smithi037.stdout:1/162: symlink d2/d12/d1d/l3e 0 2024-09-19T06:08:42.430 INFO:tasks.workunit.client.0.smithi037.stdout:4/207: dread d0/d2/f2b [0,4194304] 0 2024-09-19T06:08:42.431 INFO:tasks.workunit.client.0.smithi037.stdout:1/163: truncate d2/fb 1363820 0 2024-09-19T06:08:42.434 INFO:tasks.workunit.client.0.smithi037.stdout:0/324: dread d5/d8/d11/d15/d21/f29 [0,4194304] 0 2024-09-19T06:08:42.440 INFO:tasks.workunit.client.0.smithi037.stdout:8/314: write d1/d35/d36/d3d/f19 [2775249,5705] 0 2024-09-19T06:08:42.441 INFO:tasks.workunit.client.0.smithi037.stdout:3/258: dwrite d0/d43/d23/f2a [4194304,4194304] 0 2024-09-19T06:08:42.441 INFO:tasks.workunit.client.0.smithi037.stdout:8/315: write d1/d35/d36/d3d/f45 [951587,53136] 0 2024-09-19T06:08:42.441 INFO:tasks.workunit.client.0.smithi037.stdout:8/316: truncate d1/d35/d36/d3d/f29 5121863 0 2024-09-19T06:08:42.441 INFO:tasks.workunit.client.0.smithi037.stdout:8/317: chown d1/c4a 145198068 1 2024-09-19T06:08:42.443 INFO:tasks.workunit.client.0.smithi037.stdout:5/227: dwrite d2/d12/d28/f3f [4194304,4194304] 0 2024-09-19T06:08:42.447 INFO:tasks.workunit.client.0.smithi037.stdout:2/351: dwrite d1/da/d42/f50 [0,4194304] 0 2024-09-19T06:08:42.450 INFO:tasks.workunit.client.0.smithi037.stdout:8/318: symlink d1/d35/d36/l6f 0 2024-09-19T06:08:42.450 INFO:tasks.workunit.client.0.smithi037.stdout:5/228: rmdir d2/d12/d28 39 2024-09-19T06:08:42.451 INFO:tasks.workunit.client.0.smithi037.stdout:5/229: fsync d2/fd 0 2024-09-19T06:08:42.452 INFO:tasks.workunit.client.0.smithi037.stdout:2/352: mknod d1/da/c85 0 2024-09-19T06:08:42.453 INFO:tasks.workunit.client.0.smithi037.stdout:8/319: symlink d1/d62/l70 0 2024-09-19T06:08:42.454 INFO:tasks.workunit.client.0.smithi037.stdout:5/230: mknod d2/d12/d24/c49 0 2024-09-19T06:08:42.455 INFO:tasks.workunit.client.0.smithi037.stdout:5/231: mkdir d2/d12/d28/d22/d4a 0 2024-09-19T06:08:42.455 INFO:tasks.workunit.client.0.smithi037.stdout:5/232: read d2/d10/f19 [586667,96965] 0 2024-09-19T06:08:42.455 INFO:tasks.workunit.client.0.smithi037.stdout:5/233: rename d2/d12/d28/d22 to d2/d12/d28/d22/d4b 22 2024-09-19T06:08:42.455 INFO:tasks.workunit.client.0.smithi037.stdout:4/208: dread d0/d6/f23 [0,4194304] 0 2024-09-19T06:08:42.457 INFO:tasks.workunit.client.0.smithi037.stdout:5/234: truncate d2/d12/f27 814242 0 2024-09-19T06:08:42.457 INFO:tasks.workunit.client.0.smithi037.stdout:5/235: stat d2/f7 0 2024-09-19T06:08:42.457 INFO:tasks.workunit.client.0.smithi037.stdout:5/236: getdents d2/d12/d28/d22/d4a 0 2024-09-19T06:08:42.458 INFO:tasks.workunit.client.0.smithi037.stdout:5/237: rename d2/d12/d28/d22/d35/l3d to d2/d12/d28/d22/d35/l4c 0 2024-09-19T06:08:42.458 INFO:tasks.workunit.client.0.smithi037.stdout:8/320: write d1/f24 [536227,14885] 0 2024-09-19T06:08:42.459 INFO:tasks.workunit.client.0.smithi037.stdout:1/164: dread d2/f10 [0,4194304] 0 2024-09-19T06:08:42.459 INFO:tasks.workunit.client.0.smithi037.stdout:5/238: creat d2/d12/d28/d22/d4a/f4d x:0 0 0 2024-09-19T06:08:42.460 INFO:tasks.workunit.client.0.smithi037.stdout:8/321: mknod d1/c71 0 2024-09-19T06:08:42.460 INFO:tasks.workunit.client.0.smithi037.stdout:8/322: readlink d1/d35/d36/d3d/l53 0 2024-09-19T06:08:42.461 INFO:tasks.workunit.client.0.smithi037.stdout:1/165: mknod d2/d12/d17/c3f 0 2024-09-19T06:08:42.461 INFO:tasks.workunit.client.0.smithi037.stdout:1/166: fdatasync d2/f4 0 2024-09-19T06:08:42.462 INFO:tasks.workunit.client.0.smithi037.stdout:0/325: write d5/d8/d11/f16 [2608089,45916] 0 2024-09-19T06:08:42.462 INFO:tasks.workunit.client.0.smithi037.stdout:6/201: dwrite d9/dd/f14 [0,4194304] 0 2024-09-19T06:08:42.462 INFO:tasks.workunit.client.0.smithi037.stdout:6/202: fdatasync d9/dd/d20/f27 0 2024-09-19T06:08:42.462 INFO:tasks.workunit.client.0.smithi037.stdout:1/167: dread d2/d12/d1e/d2a/d2e/f31 [0,4194304] 0 2024-09-19T06:08:42.463 INFO:tasks.workunit.client.0.smithi037.stdout:8/323: link d1/d35/d36/c46 d1/d35/c72 0 2024-09-19T06:08:42.464 INFO:tasks.workunit.client.0.smithi037.stdout:6/203: creat d9/dd/d1c/d2d/f34 x:0 0 0 2024-09-19T06:08:42.465 INFO:tasks.workunit.client.0.smithi037.stdout:1/168: mknod d2/d12/d1e/c40 0 2024-09-19T06:08:42.466 INFO:tasks.workunit.client.0.smithi037.stdout:8/324: creat d1/d35/f73 x:0 0 0 2024-09-19T06:08:42.469 INFO:tasks.workunit.client.0.smithi037.stdout:8/325: rename d1/d62/d59/d69/f6e to d1/d62/d59/f74 0 2024-09-19T06:08:42.469 INFO:tasks.workunit.client.0.smithi037.stdout:8/326: dread - d1/d62/d59/d5d/f60 zero size 2024-09-19T06:08:42.469 INFO:tasks.workunit.client.0.smithi037.stdout:8/327: truncate d1/d62/d59/f5c 204037 0 2024-09-19T06:08:42.470 INFO:tasks.workunit.client.0.smithi037.stdout:4/209: dread d0/f41 [0,4194304] 0 2024-09-19T06:08:42.470 INFO:tasks.workunit.client.0.smithi037.stdout:4/210: write d0/f41 [2234592,82169] 0 2024-09-19T06:08:42.470 INFO:tasks.workunit.client.0.smithi037.stdout:4/211: chown d0/d6/d1b 6 1 2024-09-19T06:08:42.470 INFO:tasks.workunit.client.0.smithi037.stdout:1/169: dread d2/d12/f21 [0,4194304] 0 2024-09-19T06:08:42.473 INFO:tasks.workunit.client.0.smithi037.stdout:1/170: creat d2/d12/d1e/d2a/d2e/f41 x:0 0 0 2024-09-19T06:08:42.475 INFO:tasks.workunit.client.0.smithi037.stdout:4/212: rename d0/d2/l3b to d0/l4c 0 2024-09-19T06:08:42.477 INFO:tasks.workunit.client.0.smithi037.stdout:1/171: dread - d2/d12/d15/f32 zero size 2024-09-19T06:08:42.477 INFO:tasks.workunit.client.0.smithi037.stdout:1/172: fdatasync d2/f8 0 2024-09-19T06:08:42.479 INFO:tasks.workunit.client.0.smithi037.stdout:4/213: mkdir d0/d6/d1b/d20/d4d 0 2024-09-19T06:08:42.479 INFO:tasks.workunit.client.0.smithi037.stdout:4/214: truncate d0/d2/f1d 426370 0 2024-09-19T06:08:42.479 INFO:tasks.workunit.client.0.smithi037.stdout:4/215: fsync d0/d2/d2e/d36/f47 0 2024-09-19T06:08:42.479 INFO:tasks.workunit.client.0.smithi037.stdout:4/216: fsync d0/d6/d1b/d30/f32 0 2024-09-19T06:08:42.480 INFO:tasks.workunit.client.0.smithi037.stdout:1/173: getdents d2/d12/d17 0 2024-09-19T06:08:42.481 INFO:tasks.workunit.client.0.smithi037.stdout:1/174: rmdir d2/d12/d1e 39 2024-09-19T06:08:42.482 INFO:tasks.workunit.client.0.smithi037.stdout:5/239: dwrite d2/f2f [0,4194304] 0 2024-09-19T06:08:42.482 INFO:tasks.workunit.client.0.smithi037.stdout:1/175: creat d2/d12/d1e/f42 x:0 0 0 2024-09-19T06:08:42.483 INFO:tasks.workunit.client.0.smithi037.stdout:1/176: read d2/d12/f25 [3579883,65123] 0 2024-09-19T06:08:42.486 INFO:tasks.workunit.client.0.smithi037.stdout:8/328: rmdir d1/d62/d59/d69 0 2024-09-19T06:08:42.488 INFO:tasks.workunit.client.0.smithi037.stdout:8/329: creat d1/d62/d59/d5d/f75 x:0 0 0 2024-09-19T06:08:42.488 INFO:tasks.workunit.client.0.smithi037.stdout:4/217: getdents d0/d2 0 2024-09-19T06:08:42.499 INFO:tasks.workunit.client.0.smithi037.stdout:5/240: dread d2/d12/f32 [0,4194304] 0 2024-09-19T06:08:42.500 INFO:tasks.workunit.client.0.smithi037.stdout:5/241: fsync d2/d12/f1c 0 2024-09-19T06:08:42.501 INFO:tasks.workunit.client.0.smithi037.stdout:5/242: link d2/d12/d28/f48 d2/d10/f4e 0 2024-09-19T06:08:42.502 INFO:tasks.workunit.client.0.smithi037.stdout:5/243: creat d2/d12/f4f x:0 0 0 2024-09-19T06:08:42.504 INFO:tasks.workunit.client.0.smithi037.stdout:1/177: dwrite d2/d12/d1e/f42 [0,4194304] 0 2024-09-19T06:08:42.504 INFO:tasks.workunit.client.0.smithi037.stdout:8/330: dread d1/d35/d36/d3d/f39 [0,4194304] 0 2024-09-19T06:08:42.505 INFO:tasks.workunit.client.0.smithi037.stdout:5/244: rename d2/d10/f2d to d2/f50 0 2024-09-19T06:08:42.509 INFO:tasks.workunit.client.0.smithi037.stdout:1/178: symlink d2/d12/d17/l43 0 2024-09-19T06:08:42.516 INFO:tasks.workunit.client.0.smithi037.stdout:8/331: rename d1/d35/d36/d3d/d66/f67 to d1/d35/d36/f76 0 2024-09-19T06:08:42.517 INFO:tasks.workunit.client.0.smithi037.stdout:5/245: rename d2/d12/d28/d22/d4a/f4d to d2/d12/d24/f51 0 2024-09-19T06:08:42.518 INFO:tasks.workunit.client.0.smithi037.stdout:8/332: creat d1/d61/f77 x:0 0 0 2024-09-19T06:08:42.519 INFO:tasks.workunit.client.0.smithi037.stdout:8/333: creat d1/f78 x:0 0 0 2024-09-19T06:08:42.519 INFO:tasks.workunit.client.0.smithi037.stdout:8/334: fsync d1/d35/d36/f50 0 2024-09-19T06:08:42.520 INFO:tasks.workunit.client.0.smithi037.stdout:8/335: link d1/d35/d36/d3d/c25 d1/d6a/c79 0 2024-09-19T06:08:42.537 INFO:tasks.workunit.client.0.smithi037.stdout:1/179: dwrite d2/d12/d1e/d2d/f3c [0,4194304] 0 2024-09-19T06:08:42.539 INFO:tasks.workunit.client.0.smithi037.stdout:1/180: getdents d2/d12/d1e/d2a/d2e 0 2024-09-19T06:08:42.539 INFO:tasks.workunit.client.0.smithi037.stdout:1/181: fdatasync d2/d12/d1e/d2d/f2f 0 2024-09-19T06:08:42.540 INFO:tasks.workunit.client.0.smithi037.stdout:1/182: rename d2/fe to d2/d12/f44 0 2024-09-19T06:08:42.547 INFO:tasks.workunit.client.0.smithi037.stdout:5/246: dwrite d2/d12/f32 [0,4194304] 0 2024-09-19T06:08:42.548 INFO:tasks.workunit.client.0.smithi037.stdout:5/247: creat d2/f52 x:0 0 0 2024-09-19T06:08:42.548 INFO:tasks.workunit.client.0.smithi037.stdout:8/336: dwrite d1/d35/d36/d3d/f16 [0,4194304] 0 2024-09-19T06:08:42.549 INFO:tasks.workunit.client.0.smithi037.stdout:5/248: mkdir d2/d12/d28/d22/d53 0 2024-09-19T06:08:42.556 INFO:tasks.workunit.client.0.smithi037.stdout:7/156: sync 2024-09-19T06:08:42.557 INFO:tasks.workunit.client.0.smithi037.stdout:7/157: mknod d6/d20/d2c/c2e 0 2024-09-19T06:08:42.557 INFO:tasks.workunit.client.0.smithi037.stdout:7/158: chown d6/f1d 60 1 2024-09-19T06:08:42.557 INFO:tasks.workunit.client.0.smithi037.stdout:7/159: chown d6/f9 237 1 2024-09-19T06:08:42.558 INFO:tasks.workunit.client.0.smithi037.stdout:7/160: symlink d6/dc/d22/l2f 0 2024-09-19T06:08:42.568 INFO:tasks.workunit.client.0.smithi037.stdout:5/249: read d2/d12/f32 [207955,16162] 0 2024-09-19T06:08:42.568 INFO:tasks.workunit.client.0.smithi037.stdout:5/250: read - d2/f52 zero size 2024-09-19T06:08:42.569 INFO:tasks.workunit.client.0.smithi037.stdout:5/251: rmdir d2/d12/d28/d22 39 2024-09-19T06:08:42.570 INFO:tasks.workunit.client.0.smithi037.stdout:8/337: dwrite d1/d35/d36/d3d/f2e [0,4194304] 0 2024-09-19T06:08:42.571 INFO:tasks.workunit.client.0.smithi037.stdout:7/161: dread d6/dc/f16 [0,4194304] 0 2024-09-19T06:08:42.571 INFO:tasks.workunit.client.0.smithi037.stdout:7/162: readlink d6/dc/df/l1f 0 2024-09-19T06:08:42.572 INFO:tasks.workunit.client.0.smithi037.stdout:8/338: creat d1/d6a/f7a x:0 0 0 2024-09-19T06:08:42.572 INFO:tasks.workunit.client.0.smithi037.stdout:7/163: stat d6/d21/c27 0 2024-09-19T06:08:42.573 INFO:tasks.workunit.client.0.smithi037.stdout:7/164: write d6/dc/f25 [838875,75943] 0 2024-09-19T06:08:42.573 INFO:tasks.workunit.client.0.smithi037.stdout:8/339: truncate d1/d35/d36/d3d/f23 470627 0 2024-09-19T06:08:42.574 INFO:tasks.workunit.client.0.smithi037.stdout:7/165: mknod d6/dc/c30 0 2024-09-19T06:08:42.575 INFO:tasks.workunit.client.0.smithi037.stdout:8/340: truncate d1/d35/d36/d3d/f3c 3883517 0 2024-09-19T06:08:42.577 INFO:tasks.workunit.client.0.smithi037.stdout:8/341: mkdir d1/d61/d7b 0 2024-09-19T06:08:42.586 INFO:tasks.workunit.client.0.smithi037.stdout:7/166: write d6/dc/d22/f1a [1570948,41467] 0 2024-09-19T06:08:42.595 INFO:tasks.workunit.client.0.smithi037.stdout:5/252: dwrite d2/d10/f21 [0,4194304] 0 2024-09-19T06:08:42.600 INFO:tasks.workunit.client.0.smithi037.stdout:8/342: dwrite d1/d61/f77 [0,4194304] 0 2024-09-19T06:08:42.600 INFO:tasks.workunit.client.0.smithi037.stdout:8/343: stat d1/c42 0 2024-09-19T06:08:42.602 INFO:tasks.workunit.client.0.smithi037.stdout:8/344: creat d1/d62/d59/d5d/f7c x:0 0 0 2024-09-19T06:08:42.607 INFO:tasks.workunit.client.0.smithi037.stdout:5/253: dread d2/d12/f27 [0,4194304] 0 2024-09-19T06:08:42.608 INFO:tasks.workunit.client.0.smithi037.stdout:5/254: creat d2/d12/d28/d22/d4a/f54 x:0 0 0 2024-09-19T06:08:42.609 INFO:tasks.workunit.client.0.smithi037.stdout:5/255: symlink d2/d12/d28/d22/d35/l55 0 2024-09-19T06:08:42.610 INFO:tasks.workunit.client.0.smithi037.stdout:5/256: chown d2/d12/d28/d22/d4a/f54 1840068908 1 2024-09-19T06:08:42.615 INFO:tasks.workunit.client.0.smithi037.stdout:7/167: dwrite d6/dc/df/f13 [0,4194304] 0 2024-09-19T06:08:42.617 INFO:tasks.workunit.client.0.smithi037.stdout:7/168: unlink d6/d21/f29 0 2024-09-19T06:08:42.618 INFO:tasks.workunit.client.0.smithi037.stdout:7/169: write d6/dc/f25 [697450,85393] 0 2024-09-19T06:08:42.624 INFO:tasks.workunit.client.0.smithi037.stdout:8/345: dwrite d1/d62/d59/f74 [0,4194304] 0 2024-09-19T06:08:42.624 INFO:tasks.workunit.client.0.smithi037.stdout:8/346: readlink d1/l1c 0 2024-09-19T06:08:42.624 INFO:tasks.workunit.client.0.smithi037.stdout:8/347: write d1/f10 [4337480,71973] 0 2024-09-19T06:08:42.624 INFO:tasks.workunit.client.0.smithi037.stdout:8/348: write d1/d35/d36/d3d/f19 [2126141,77953] 0 2024-09-19T06:08:42.635 INFO:tasks.workunit.client.0.smithi037.stdout:5/257: read d2/d12/d28/f3f [3582340,33731] 0 2024-09-19T06:08:42.635 INFO:tasks.workunit.client.0.smithi037.stdout:5/258: write d2/fa [279960,112617] 0 2024-09-19T06:08:42.635 INFO:tasks.workunit.client.0.smithi037.stdout:7/170: dread d6/dc/fd [0,4194304] 0 2024-09-19T06:08:42.635 INFO:tasks.workunit.client.0.smithi037.stdout:5/259: creat d2/d12/d28/d22/d35/f56 x:0 0 0 2024-09-19T06:08:42.636 INFO:tasks.workunit.client.0.smithi037.stdout:5/260: truncate d2/d12/f26 3833054 0 2024-09-19T06:08:42.648 INFO:tasks.workunit.client.0.smithi037.stdout:8/349: dwrite d1/d35/f73 [0,4194304] 0 2024-09-19T06:08:42.651 INFO:tasks.workunit.client.0.smithi037.stdout:8/350: symlink d1/l7d 0 2024-09-19T06:08:42.651 INFO:tasks.workunit.client.0.smithi037.stdout:8/351: write d1/d35/d36/d3d/f29 [3973169,69924] 0 2024-09-19T06:08:42.651 INFO:tasks.workunit.client.0.smithi037.stdout:8/352: chown d1/d35 61 1 2024-09-19T06:08:42.651 INFO:tasks.workunit.client.0.smithi037.stdout:8/353: getdents d1/d61/d68 0 2024-09-19T06:08:42.652 INFO:tasks.workunit.client.0.smithi037.stdout:8/354: rmdir d1/d62/d59 39 2024-09-19T06:08:42.653 INFO:tasks.workunit.client.0.smithi037.stdout:7/171: dread d6/f2b [0,4194304] 0 2024-09-19T06:08:42.654 INFO:tasks.workunit.client.0.smithi037.stdout:7/172: creat d6/d20/d2c/f31 x:0 0 0 2024-09-19T06:08:42.667 INFO:tasks.workunit.client.0.smithi037.stdout:7/173: write d6/dc/df/f13 [2695389,80515] 0 2024-09-19T06:08:42.669 INFO:tasks.workunit.client.0.smithi037.stdout:7/174: rmdir d6/dc/d2d 0 2024-09-19T06:08:42.669 INFO:tasks.workunit.client.0.smithi037.stdout:7/175: write d6/dc/f25 [942136,113884] 0 2024-09-19T06:08:42.670 INFO:tasks.workunit.client.0.smithi037.stdout:7/176: truncate d6/dc/fd 1924783 0 2024-09-19T06:08:42.671 INFO:tasks.workunit.client.0.smithi037.stdout:7/177: mknod d6/dc/df/c32 0 2024-09-19T06:08:42.671 INFO:tasks.workunit.client.0.smithi037.stdout:8/355: dwrite d1/d35/d36/d3d/f45 [0,4194304] 0 2024-09-19T06:08:42.672 INFO:tasks.workunit.client.0.smithi037.stdout:8/356: stat d1/d35/d36/d3d/f16 0 2024-09-19T06:08:42.672 INFO:tasks.workunit.client.0.smithi037.stdout:8/357: write d1/d61/f77 [4668695,125816] 0 2024-09-19T06:08:42.673 INFO:tasks.workunit.client.0.smithi037.stdout:8/358: rmdir d1 39 2024-09-19T06:08:42.674 INFO:tasks.workunit.client.0.smithi037.stdout:8/359: mkdir d1/d61/d7e 0 2024-09-19T06:08:42.675 INFO:tasks.workunit.client.0.smithi037.stdout:8/360: truncate d1/f15 418616 0 2024-09-19T06:08:42.692 INFO:tasks.workunit.client.0.smithi037.stdout:7/178: read d6/dc/fd [934288,129342] 0 2024-09-19T06:08:42.692 INFO:tasks.workunit.client.0.smithi037.stdout:7/179: dread - d6/dc/f2a zero size 2024-09-19T06:08:42.692 INFO:tasks.workunit.client.0.smithi037.stdout:7/180: readlink l3 0 2024-09-19T06:08:42.692 INFO:tasks.workunit.client.0.smithi037.stdout:7/181: fsync d6/dc/f2a 0 2024-09-19T06:08:42.693 INFO:tasks.workunit.client.0.smithi037.stdout:7/182: rmdir d6/dc/df 39 2024-09-19T06:08:42.701 INFO:tasks.workunit.client.0.smithi037.stdout:8/361: dwrite d1/f43 [0,4194304] 0 2024-09-19T06:08:42.705 INFO:tasks.workunit.client.0.smithi037.stdout:8/362: rename d1/l4 to d1/d61/l7f 0 2024-09-19T06:08:42.705 INFO:tasks.workunit.client.0.smithi037.stdout:8/363: write d1/d35/d36/d3d/f29 [985315,23643] 0 2024-09-19T06:08:42.705 INFO:tasks.workunit.client.0.smithi037.stdout:8/364: write d1/f32 [1177526,76149] 0 2024-09-19T06:08:42.706 INFO:tasks.workunit.client.0.smithi037.stdout:3/259: sync 2024-09-19T06:08:42.706 INFO:tasks.workunit.client.0.smithi037.stdout:9/394: sync 2024-09-19T06:08:42.706 INFO:tasks.workunit.client.0.smithi037.stdout:7/183: write d6/dc/f1b [1930068,65196] 0 2024-09-19T06:08:42.707 INFO:tasks.workunit.client.0.smithi037.stdout:7/184: write d6/dc/d22/f1a [2741222,36516] 0 2024-09-19T06:08:42.711 INFO:tasks.workunit.client.0.smithi037.stdout:3/260: creat d0/d43/d26/f5d x:0 0 0 2024-09-19T06:08:42.712 INFO:tasks.workunit.client.0.smithi037.stdout:9/395: dread da/f27 [0,4194304] 0 2024-09-19T06:08:42.712 INFO:tasks.workunit.client.0.smithi037.stdout:7/185: rmdir d6/d20 39 2024-09-19T06:08:42.713 INFO:tasks.workunit.client.0.smithi037.stdout:3/261: mkdir d0/d16/d19/d1d/d5e 0 2024-09-19T06:08:42.720 INFO:tasks.workunit.client.0.smithi037.stdout:9/396: write da/dd/d1b/d2f/d38/f55 [470699,64253] 0 2024-09-19T06:08:42.727 INFO:tasks.workunit.client.0.smithi037.stdout:9/397: fsync da/dd/d1b/d2f/d38/f55 0 2024-09-19T06:08:42.727 INFO:tasks.workunit.client.0.smithi037.stdout:8/365: dwrite d1/f1e [0,4194304] 0 2024-09-19T06:08:42.728 INFO:tasks.workunit.client.0.smithi037.stdout:8/366: readlink d1/d35/d36/l47 0 2024-09-19T06:08:42.728 INFO:tasks.workunit.client.0.smithi037.stdout:3/262: dread d0/d43/d23/f2a [0,4194304] 0 2024-09-19T06:08:42.729 INFO:tasks.workunit.client.0.smithi037.stdout:9/398: rename da/d20/f34 to da/dd/d63/f90 0 2024-09-19T06:08:42.730 INFO:tasks.workunit.client.0.smithi037.stdout:9/399: creat da/dd/d1b/d2f/f91 x:0 0 0 2024-09-19T06:08:42.732 INFO:tasks.workunit.client.0.smithi037.stdout:3/263: mkdir d0/d5f 0 2024-09-19T06:08:42.732 INFO:tasks.workunit.client.0.smithi037.stdout:3/264: chown d0/d43/d37/l52 221137166 1 2024-09-19T06:08:42.732 INFO:tasks.workunit.client.0.smithi037.stdout:3/265: readlink d0/l13 0 2024-09-19T06:08:42.732 INFO:tasks.workunit.client.0.smithi037.stdout:3/266: stat d0/d16/d19/d1d 0 2024-09-19T06:08:42.738 INFO:tasks.workunit.client.0.smithi037.stdout:7/186: dwrite d6/d20/d2c/f31 [0,4194304] 0 2024-09-19T06:08:42.738 INFO:tasks.workunit.client.0.smithi037.stdout:7/187: write d6/dc/f14 [2325051,124241] 0 2024-09-19T06:08:42.748 INFO:tasks.workunit.client.0.smithi037.stdout:9/400: write da/dd/d1b/d23/d6a/d82/f48 [2597470,88554] 0 2024-09-19T06:08:42.750 INFO:tasks.workunit.client.0.smithi037.stdout:9/401: mkdir da/dd/d1b/d2f/d6d/d92 0 2024-09-19T06:08:42.755 INFO:tasks.workunit.client.0.smithi037.stdout:7/188: dread d6/dc/f1b [0,4194304] 0 2024-09-19T06:08:42.757 INFO:tasks.workunit.client.0.smithi037.stdout:7/189: mkdir d6/d20/d2c/d33 0 2024-09-19T06:08:42.758 INFO:tasks.workunit.client.0.smithi037.stdout:7/190: mkdir d6/d20/d34 0 2024-09-19T06:08:42.758 INFO:tasks.workunit.client.0.smithi037.stdout:8/367: dwrite d1/f32 [0,4194304] 0 2024-09-19T06:08:42.759 INFO:tasks.workunit.client.0.smithi037.stdout:3/267: dwrite d0/d16/d19/f59 [0,4194304] 0 2024-09-19T06:08:42.761 INFO:tasks.workunit.client.0.smithi037.stdout:8/368: rename d1/c33 to d1/d62/d59/c80 0 2024-09-19T06:08:42.771 INFO:tasks.workunit.client.0.smithi037.stdout:9/402: dwrite da/dd/d1b/d43/f7c [0,4194304] 0 2024-09-19T06:08:42.771 INFO:tasks.workunit.client.0.smithi037.stdout:9/403: dread - da/dd/d1b/d2f/f44 zero size 2024-09-19T06:08:42.771 INFO:tasks.workunit.client.0.smithi037.stdout:9/404: fsync da/dd/d1b/f4c 0 2024-09-19T06:08:42.774 INFO:tasks.workunit.client.0.smithi037.stdout:9/405: rename da/d20/l41 to da/dd/d63/l93 0 2024-09-19T06:08:42.775 INFO:tasks.workunit.client.0.smithi037.stdout:9/406: mknod da/dd/d31/c94 0 2024-09-19T06:08:42.775 INFO:tasks.workunit.client.0.smithi037.stdout:9/407: read - da/d4d/f87 zero size 2024-09-19T06:08:42.777 INFO:tasks.workunit.client.0.smithi037.stdout:9/408: creat da/dd/d1b/d62/f95 x:0 0 0 2024-09-19T06:08:42.777 INFO:tasks.workunit.client.0.smithi037.stdout:9/409: truncate da/f27 865883 0 2024-09-19T06:08:42.778 INFO:tasks.workunit.client.0.smithi037.stdout:8/369: write d1/d35/f73 [2746170,18053] 0 2024-09-19T06:08:42.778 INFO:tasks.workunit.client.0.smithi037.stdout:8/370: read - d1/f6c zero size 2024-09-19T06:08:42.788 INFO:tasks.workunit.client.0.smithi037.stdout:3/268: dwrite d0/d16/d20/d45/d55/f4a [0,4194304] 0 2024-09-19T06:08:42.796 INFO:tasks.workunit.client.0.smithi037.stdout:7/191: dwrite d6/dc/d22/f1a [0,4194304] 0 2024-09-19T06:08:42.801 INFO:tasks.workunit.client.0.smithi037.stdout:9/410: dwrite da/dd/f50 [0,4194304] 0 2024-09-19T06:08:42.801 INFO:tasks.workunit.client.0.smithi037.stdout:7/192: creat d6/d20/f35 x:0 0 0 2024-09-19T06:08:42.803 INFO:tasks.workunit.client.0.smithi037.stdout:9/411: rename da/dd/d1b/d23/l28 to da/dd/d1b/d2f/d6d/l96 0 2024-09-19T06:08:42.805 INFO:tasks.workunit.client.0.smithi037.stdout:7/193: creat d6/dc/d22/f36 x:0 0 0 2024-09-19T06:08:42.805 INFO:tasks.workunit.client.0.smithi037.stdout:8/371: dwrite d1/d35/d36/d3d/f2f [0,4194304] 0 2024-09-19T06:08:42.806 INFO:tasks.workunit.client.0.smithi037.stdout:9/412: creat da/dd/d1b/d23/d6a/d85/f97 x:0 0 0 2024-09-19T06:08:42.808 INFO:tasks.workunit.client.0.smithi037.stdout:7/194: mknod d6/c37 0 2024-09-19T06:08:42.810 INFO:tasks.workunit.client.0.smithi037.stdout:8/372: creat d1/d62/d59/d5d/f81 x:0 0 0 2024-09-19T06:08:42.811 INFO:tasks.workunit.client.0.smithi037.stdout:7/195: truncate d6/dc/fd 1359430 0 2024-09-19T06:08:42.813 INFO:tasks.workunit.client.0.smithi037.stdout:5/261: sync 2024-09-19T06:08:42.814 INFO:tasks.workunit.client.0.smithi037.stdout:1/183: sync 2024-09-19T06:08:42.814 INFO:tasks.workunit.client.0.smithi037.stdout:4/218: sync 2024-09-19T06:08:42.814 INFO:tasks.workunit.client.0.smithi037.stdout:2/353: sync 2024-09-19T06:08:42.814 INFO:tasks.workunit.client.0.smithi037.stdout:0/326: sync 2024-09-19T06:08:42.814 INFO:tasks.workunit.client.0.smithi037.stdout:6/204: sync 2024-09-19T06:08:42.814 INFO:tasks.workunit.client.0.smithi037.stdout:0/327: chown d5/c13 0 1 2024-09-19T06:08:42.816 INFO:tasks.workunit.client.0.smithi037.stdout:4/219: unlink d0/d2/d2e/d36/l22 0 2024-09-19T06:08:42.817 INFO:tasks.workunit.client.0.smithi037.stdout:5/262: mkdir d2/d12/d28/d57 0 2024-09-19T06:08:42.818 INFO:tasks.workunit.client.0.smithi037.stdout:2/354: dread d1/da/dc/f15 [0,4194304] 0 2024-09-19T06:08:42.819 INFO:tasks.workunit.client.0.smithi037.stdout:1/184: creat d2/d12/d1d/f45 x:0 0 0 2024-09-19T06:08:42.819 INFO:tasks.workunit.client.0.smithi037.stdout:1/185: stat d2/d12/d17/f18 0 2024-09-19T06:08:42.820 INFO:tasks.workunit.client.0.smithi037.stdout:6/205: rmdir d9 39 2024-09-19T06:08:42.821 INFO:tasks.workunit.client.0.smithi037.stdout:3/269: dwrite d0/d16/d20/d45/d55/f40 [0,4194304] 0 2024-09-19T06:08:42.822 INFO:tasks.workunit.client.0.smithi037.stdout:4/220: unlink d0/d2/d2e/d36/c31 0 2024-09-19T06:08:42.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:08:42 smithi037 ceph-mon[31211]: pgmap v425: 129 pgs: 129 active+clean; 161 MiB data, 901 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 10 MiB/s wr, 706 op/s 2024-09-19T06:08:42.824 INFO:tasks.workunit.client.0.smithi037.stdout:5/263: getdents d2/d12/d28/d22 0 2024-09-19T06:08:42.824 INFO:tasks.workunit.client.0.smithi037.stdout:5/264: chown d2/d12/f32 617854 1 2024-09-19T06:08:42.825 INFO:tasks.workunit.client.0.smithi037.stdout:2/355: creat d1/da/dc/d21/d55/f86 x:0 0 0 2024-09-19T06:08:42.825 INFO:tasks.workunit.client.0.smithi037.stdout:6/206: dread d9/dd/f22 [0,4194304] 0 2024-09-19T06:08:42.825 INFO:tasks.workunit.client.0.smithi037.stdout:6/207: write d9/dd/f23 [4745400,45284] 0 2024-09-19T06:08:42.827 INFO:tasks.workunit.client.0.smithi037.stdout:1/186: unlink d2/f11 0 2024-09-19T06:08:42.828 INFO:tasks.workunit.client.0.smithi037.stdout:5/265: dread d2/fa [0,4194304] 0 2024-09-19T06:08:42.829 INFO:tasks.workunit.client.0.smithi037.stdout:3/270: creat d0/d16/f60 x:0 0 0 2024-09-19T06:08:42.830 INFO:tasks.workunit.client.0.smithi037.stdout:6/208: write d9/dd/f22 [207990,14475] 0 2024-09-19T06:08:42.830 INFO:tasks.workunit.client.0.smithi037.stdout:6/209: dread - d9/dd/f32 zero size 2024-09-19T06:08:42.831 INFO:tasks.workunit.client.0.smithi037.stdout:6/210: readlink d9/d16/l1e 0 2024-09-19T06:08:42.831 INFO:tasks.workunit.client.0.smithi037.stdout:6/211: chown d9/dd/l10 802742795 1 2024-09-19T06:08:42.831 INFO:tasks.workunit.client.0.smithi037.stdout:1/187: write d2/f9 [279255,66981] 0 2024-09-19T06:08:42.831 INFO:tasks.workunit.client.0.smithi037.stdout:1/188: write d2/d12/d1d/f45 [304984,53291] 0 2024-09-19T06:08:42.831 INFO:tasks.workunit.client.0.smithi037.stdout:1/189: write d2/d12/f21 [898071,36810] 0 2024-09-19T06:08:42.831 INFO:tasks.workunit.client.0.smithi037.stdout:4/221: creat d0/d2/d2e/d36/f4e x:0 0 0 2024-09-19T06:08:42.831 INFO:tasks.workunit.client.0.smithi037.stdout:4/222: dread - d0/d2/d2e/d36/f47 zero size 2024-09-19T06:08:42.831 INFO:tasks.workunit.client.0.smithi037.stdout:4/223: truncate d0/d2/d2e/d36/f4e 32752 0 2024-09-19T06:08:42.832 INFO:tasks.workunit.client.0.smithi037.stdout:2/356: creat d1/d33/d4c/f87 x:0 0 0 2024-09-19T06:08:42.832 INFO:tasks.workunit.client.0.smithi037.stdout:5/266: mkdir d2/d12/d24/d58 0 2024-09-19T06:08:42.833 INFO:tasks.workunit.client.0.smithi037.stdout:3/271: mkdir d0/d16/d19/d1d/d5e/d61 0 2024-09-19T06:08:42.833 INFO:tasks.workunit.client.0.smithi037.stdout:3/272: write d0/fc [776602,56290] 0 2024-09-19T06:08:42.833 INFO:tasks.workunit.client.0.smithi037.stdout:3/273: read - d0/f5a zero size 2024-09-19T06:08:42.834 INFO:tasks.workunit.client.0.smithi037.stdout:6/212: creat d9/dd/d1c/d2d/d2f/f35 x:0 0 0 2024-09-19T06:08:42.834 INFO:tasks.workunit.client.0.smithi037.stdout:6/213: truncate d9/dd/f1b 107166 0 2024-09-19T06:08:42.836 INFO:tasks.workunit.client.0.smithi037.stdout:9/413: dwrite da/dd/d1b/d23/d6a/d85/f97 [0,4194304] 0 2024-09-19T06:08:42.837 INFO:tasks.workunit.client.0.smithi037.stdout:1/190: link d2/fb d2/d12/d15/d34/f46 0 2024-09-19T06:08:42.837 INFO:tasks.workunit.client.0.smithi037.stdout:1/191: truncate d2/d12/f21 1755816 0 2024-09-19T06:08:42.837 INFO:tasks.workunit.client.0.smithi037.stdout:1/192: chown d2/d12/d1d/l20 3029 1 2024-09-19T06:08:42.837 INFO:tasks.workunit.client.0.smithi037.stdout:1/193: stat d2/f6 0 2024-09-19T06:08:42.837 INFO:tasks.workunit.client.0.smithi037.stdout:5/267: rename d2/d12/d24/c40 to d2/d12/d28/c59 0 2024-09-19T06:08:42.841 INFO:tasks.workunit.client.0.smithi037.stdout:3/274: mkdir d0/d16/d20/d62 0 2024-09-19T06:08:42.841 INFO:tasks.workunit.client.0.smithi037.stdout:3/275: readlink d0/d43/d37/l52 0 2024-09-19T06:08:42.842 INFO:tasks.workunit.client.0.smithi037.stdout:6/214: getdents d9/dd 0 2024-09-19T06:08:42.843 INFO:tasks.workunit.client.0.smithi037.stdout:8/373: dwrite d1/d35/d36/d3d/f16 [0,4194304] 0 2024-09-19T06:08:42.843 INFO:tasks.workunit.client.0.smithi037.stdout:8/374: fsync d1/d35/d36/d3d/f26 0 2024-09-19T06:08:42.843 INFO:tasks.workunit.client.0.smithi037.stdout:7/196: dwrite d6/dc/f2a [0,4194304] 0 2024-09-19T06:08:42.848 INFO:tasks.workunit.client.0.smithi037.stdout:2/357: dread d1/da/f63 [4194304,4194304] 0 2024-09-19T06:08:42.848 INFO:tasks.workunit.client.0.smithi037.stdout:2/358: truncate d1/da/f3e 4393443 0 2024-09-19T06:08:42.849 INFO:tasks.workunit.client.0.smithi037.stdout:1/194: mkdir d2/d12/d1d/d47 0 2024-09-19T06:08:42.849 INFO:tasks.workunit.client.0.smithi037.stdout:3/276: creat d0/d16/d20/d45/d55/f63 x:0 0 0 2024-09-19T06:08:42.849 INFO:tasks.workunit.client.0.smithi037.stdout:8/375: mknod d1/d6a/c82 0 2024-09-19T06:08:42.854 INFO:tasks.workunit.client.0.smithi037.stdout:7/197: link d6/dc/d22/f36 d6/f38 0 2024-09-19T06:08:42.854 INFO:tasks.workunit.client.0.smithi037.stdout:7/198: fsync d6/dc/fe 0 2024-09-19T06:08:42.855 INFO:tasks.workunit.client.0.smithi037.stdout:2/359: getdents d1/da/d42 0 2024-09-19T06:08:42.855 INFO:tasks.workunit.client.0.smithi037.stdout:2/360: write d1/d16/d4a/f75 [971830,16586] 0 2024-09-19T06:08:42.855 INFO:tasks.workunit.client.0.smithi037.stdout:2/361: write d1/da/dc/d21/d7d/f68 [677520,85644] 0 2024-09-19T06:08:42.856 INFO:tasks.workunit.client.0.smithi037.stdout:3/277: rename d0/d16/c1b to d0/d43/d37/c64 0 2024-09-19T06:08:42.856 INFO:tasks.workunit.client.0.smithi037.stdout:3/278: stat d0/d43/f5b 0 2024-09-19T06:08:42.856 INFO:tasks.workunit.client.0.smithi037.stdout:3/279: readlink d0/l44 0 2024-09-19T06:08:42.856 INFO:tasks.workunit.client.0.smithi037.stdout:4/224: dwrite d0/d2/f1d [0,4194304] 0 2024-09-19T06:08:42.857 INFO:tasks.workunit.client.0.smithi037.stdout:8/376: dread d1/d35/f56 [0,4194304] 0 2024-09-19T06:08:42.858 INFO:tasks.workunit.client.0.smithi037.stdout:4/225: dread d0/d6/d1b/d20/f40 [0,4194304] 0 2024-09-19T06:08:42.865 INFO:tasks.workunit.client.0.smithi037.stdout:5/268: dwrite d2/f52 [0,4194304] 0 2024-09-19T06:08:42.865 INFO:tasks.workunit.client.0.smithi037.stdout:5/269: chown d2/d12/d28/d22/f3c 46 1 2024-09-19T06:08:42.866 INFO:tasks.workunit.client.0.smithi037.stdout:3/280: mkdir d0/d65 0 2024-09-19T06:08:42.866 INFO:tasks.workunit.client.0.smithi037.stdout:8/377: rename d1/l41 to d1/d61/d7e/l83 0 2024-09-19T06:08:42.870 INFO:tasks.workunit.client.0.smithi037.stdout:9/414: write da/dd/d1b/d43/f7c [917544,776] 0 2024-09-19T06:08:42.870 INFO:tasks.workunit.client.0.smithi037.stdout:9/415: chown da/dd/d1b/d62/f95 6 1 2024-09-19T06:08:42.874 INFO:tasks.workunit.client.0.smithi037.stdout:4/226: creat d0/d2/d2e/d36/f4f x:0 0 0 2024-09-19T06:08:42.874 INFO:tasks.workunit.client.0.smithi037.stdout:4/227: truncate d0/d2/d2e/d36/f47 914515 0 2024-09-19T06:08:42.876 INFO:tasks.workunit.client.0.smithi037.stdout:9/416: link da/d20/c86 da/dd/d63/d80/c98 0 2024-09-19T06:08:42.879 INFO:tasks.workunit.client.0.smithi037.stdout:6/215: dwrite d9/dd/d1c/d2d/f34 [0,4194304] 0 2024-09-19T06:08:42.880 INFO:tasks.workunit.client.0.smithi037.stdout:1/195: dread d2/d12/d1d/f30 [0,4194304] 0 2024-09-19T06:08:42.880 INFO:tasks.workunit.client.0.smithi037.stdout:1/196: chown d2/d12/d1e/d2d/f3c 1142753 1 2024-09-19T06:08:42.880 INFO:tasks.workunit.client.0.smithi037.stdout:1/197: chown d2/f28 7 1 2024-09-19T06:08:42.880 INFO:tasks.workunit.client.0.smithi037.stdout:1/198: dread - d2/d12/d15/d34/f3b zero size 2024-09-19T06:08:42.880 INFO:tasks.workunit.client.0.smithi037.stdout:1/199: fsync d2/fa 0 2024-09-19T06:08:42.882 INFO:tasks.workunit.client.0.smithi037.stdout:6/216: creat d9/dd/d1c/d2d/f36 x:0 0 0 2024-09-19T06:08:42.883 INFO:tasks.workunit.client.0.smithi037.stdout:2/362: write d1/da/f19 [2202687,29705] 0 2024-09-19T06:08:42.883 INFO:tasks.workunit.client.0.smithi037.stdout:2/363: readlink d1/da/dc/d21/d55/l83 0 2024-09-19T06:08:42.888 INFO:tasks.workunit.client.0.smithi037.stdout:6/217: rename d9/ff to d9/dd/d2b/f37 0 2024-09-19T06:08:42.889 INFO:tasks.workunit.client.0.smithi037.stdout:1/200: mkdir d2/d48 0 2024-09-19T06:08:42.890 INFO:tasks.workunit.client.0.smithi037.stdout:7/199: dwrite d6/f9 [0,4194304] 0 2024-09-19T06:08:42.895 INFO:tasks.workunit.client.0.smithi037.stdout:7/200: mknod d6/d20/d2c/d33/c39 0 2024-09-19T06:08:42.900 INFO:tasks.workunit.client.0.smithi037.stdout:7/201: creat d6/f3a x:0 0 0 2024-09-19T06:08:42.906 INFO:tasks.workunit.client.0.smithi037.stdout:5/270: dwrite d2/d10/f19 [0,4194304] 0 2024-09-19T06:08:42.906 INFO:tasks.workunit.client.0.smithi037.stdout:3/281: dwrite d0/d16/f30 [0,4194304] 0 2024-09-19T06:08:42.913 INFO:tasks.workunit.client.0.smithi037.stdout:4/228: dread d0/d2/f1d [0,4194304] 0 2024-09-19T06:08:42.915 INFO:tasks.workunit.client.0.smithi037.stdout:6/218: dwrite d9/dd/f14 [0,4194304] 0 2024-09-19T06:08:42.915 INFO:tasks.workunit.client.0.smithi037.stdout:1/201: dread d2/d12/f13 [0,4194304] 0 2024-09-19T06:08:42.917 INFO:tasks.workunit.client.0.smithi037.stdout:2/364: dwrite d1/da/dc/f18 [0,4194304] 0 2024-09-19T06:08:42.917 INFO:tasks.workunit.client.0.smithi037.stdout:2/365: truncate d1/da/dc/d21/d55/f86 694627 0 2024-09-19T06:08:42.918 INFO:tasks.workunit.client.0.smithi037.stdout:9/417: dwrite da/dd/d1b/d23/d6a/d82/f48 [4194304,4194304] 0 2024-09-19T06:08:42.918 INFO:tasks.workunit.client.0.smithi037.stdout:9/418: read - da/dd/d1b/d23/f73 zero size 2024-09-19T06:08:42.919 INFO:tasks.workunit.client.0.smithi037.stdout:1/202: dread d2/f9 [0,4194304] 0 2024-09-19T06:08:42.919 INFO:tasks.workunit.client.0.smithi037.stdout:1/203: stat d2/d12/d15/d34/f46 0 2024-09-19T06:08:42.925 INFO:tasks.workunit.client.0.smithi037.stdout:3/282: symlink d0/d16/d20/d62/l66 0 2024-09-19T06:08:42.925 INFO:tasks.workunit.client.0.smithi037.stdout:8/378: dwrite d1/d35/d36/f3b [0,4194304] 0 2024-09-19T06:08:42.925 INFO:tasks.workunit.client.0.smithi037.stdout:8/379: fsync d1/f4c 0 2024-09-19T06:08:42.926 INFO:tasks.workunit.client.0.smithi037.stdout:6/219: symlink d9/dd/d1c/l38 0 2024-09-19T06:08:42.926 INFO:tasks.workunit.client.0.smithi037.stdout:6/220: chown d9/dd/d1c/d2d 44268198 1 2024-09-19T06:08:42.927 INFO:tasks.workunit.client.0.smithi037.stdout:7/202: dwrite d6/dc/f25 [0,4194304] 0 2024-09-19T06:08:42.927 INFO:tasks.workunit.client.0.smithi037.stdout:9/419: creat da/dd/d1b/d23/d6a/d8f/f99 x:0 0 0 2024-09-19T06:08:42.928 INFO:tasks.workunit.client.0.smithi037.stdout:1/204: link d2/f3 d2/d12/d1d/f49 0 2024-09-19T06:08:42.928 INFO:tasks.workunit.client.0.smithi037.stdout:1/205: dread - d2/f28 zero size 2024-09-19T06:08:42.928 INFO:tasks.workunit.client.0.smithi037.stdout:1/206: chown d2/d12/d17/c3f 581145052 1 2024-09-19T06:08:42.928 INFO:tasks.workunit.client.0.smithi037.stdout:1/207: readlink d2/d12/d17/l43 0 2024-09-19T06:08:42.929 INFO:tasks.workunit.client.0.smithi037.stdout:3/283: creat d0/d16/d20/d45/d55/f67 x:0 0 0 2024-09-19T06:08:42.929 INFO:tasks.workunit.client.0.smithi037.stdout:8/380: symlink d1/d61/d7b/l84 0 2024-09-19T06:08:42.929 INFO:tasks.workunit.client.0.smithi037.stdout:8/381: chown d1/d61/l7f 15324 1 2024-09-19T06:08:42.933 INFO:tasks.workunit.client.0.smithi037.stdout:7/203: creat d6/dc/d22/f3b x:0 0 0 2024-09-19T06:08:42.933 INFO:tasks.workunit.client.0.smithi037.stdout:7/204: write d6/f1d [1572477,65667] 0 2024-09-19T06:08:42.933 INFO:tasks.workunit.client.0.smithi037.stdout:7/205: fsync d6/f12 0 2024-09-19T06:08:42.933 INFO:tasks.workunit.client.0.smithi037.stdout:1/208: symlink d2/d12/d1e/d2a/l4a 0 2024-09-19T06:08:42.933 INFO:tasks.workunit.client.0.smithi037.stdout:1/209: chown d2/l7 121540 1 2024-09-19T06:08:42.933 INFO:tasks.workunit.client.0.smithi037.stdout:1/210: readlink d2/d12/d1d/l3e 0 2024-09-19T06:08:42.935 INFO:tasks.workunit.client.0.smithi037.stdout:5/271: dwrite d2/d12/f1c [4194304,4194304] 0 2024-09-19T06:08:42.935 INFO:tasks.workunit.client.0.smithi037.stdout:1/211: unlink d2/d12/d1e/c37 0 2024-09-19T06:08:42.935 INFO:tasks.workunit.client.0.smithi037.stdout:1/212: read - d2/f3a zero size 2024-09-19T06:08:42.938 INFO:tasks.workunit.client.0.smithi037.stdout:5/272: symlink d2/d12/d28/d22/d35/l5a 0 2024-09-19T06:08:42.938 INFO:tasks.workunit.client.0.smithi037.stdout:3/284: mknod d0/d16/d20/d51/c68 0 2024-09-19T06:08:42.938 INFO:tasks.workunit.client.0.smithi037.stdout:3/285: readlink d0/l13 0 2024-09-19T06:08:42.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:08:42 smithi099 ceph-mon[35300]: pgmap v425: 129 pgs: 129 active+clean; 161 MiB data, 901 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 10 MiB/s wr, 706 op/s 2024-09-19T06:08:42.939 INFO:tasks.workunit.client.0.smithi037.stdout:1/213: mknod d2/d48/c4b 0 2024-09-19T06:08:42.940 INFO:tasks.workunit.client.0.smithi037.stdout:1/214: link d2/d12/d15/d34/f3b d2/d12/d1e/d2d/f4c 0 2024-09-19T06:08:42.941 INFO:tasks.workunit.client.0.smithi037.stdout:1/215: write d2/d12/d15/f27 [212227,65217] 0 2024-09-19T06:08:42.943 INFO:tasks.workunit.client.0.smithi037.stdout:1/216: rename d2/d12/d17/c3f to d2/d12/d15/c4d 0 2024-09-19T06:08:42.951 INFO:tasks.workunit.client.0.smithi037.stdout:4/229: dwrite d0/f44 [0,4194304] 0 2024-09-19T06:08:42.953 INFO:tasks.workunit.client.0.smithi037.stdout:1/217: dread d2/d12/f21 [0,4194304] 0 2024-09-19T06:08:42.953 INFO:tasks.workunit.client.0.smithi037.stdout:1/218: fsync d2/d12/d17/f18 0 2024-09-19T06:08:42.953 INFO:tasks.workunit.client.0.smithi037.stdout:4/230: symlink d0/d2/d37/d46/l50 0 2024-09-19T06:08:42.953 INFO:tasks.workunit.client.0.smithi037.stdout:4/231: readlink d0/l8 0 2024-09-19T06:08:42.953 INFO:tasks.workunit.client.0.smithi037.stdout:4/232: chown d0/d6 1 1 2024-09-19T06:08:42.954 INFO:tasks.workunit.client.0.smithi037.stdout:2/366: dwrite d1/da/dc/d21/d7d/f2e [0,4194304] 0 2024-09-19T06:08:42.954 INFO:tasks.workunit.client.0.smithi037.stdout:1/219: unlink d2/d12/d1e/d2d/f2f 0 2024-09-19T06:08:42.955 INFO:tasks.workunit.client.0.smithi037.stdout:6/221: dwrite d9/f24 [0,4194304] 0 2024-09-19T06:08:42.955 INFO:tasks.workunit.client.0.smithi037.stdout:4/233: creat d0/d6/d1b/d20/d4d/f51 x:0 0 0 2024-09-19T06:08:42.957 INFO:tasks.workunit.client.0.smithi037.stdout:6/222: mknod d9/dd/c39 0 2024-09-19T06:08:42.957 INFO:tasks.workunit.client.0.smithi037.stdout:4/234: truncate d0/d2/d2e/d36/f47 874356 0 2024-09-19T06:08:42.959 INFO:tasks.workunit.client.0.smithi037.stdout:6/223: rename d9/dd/c39 to d9/dd/c3a 0 2024-09-19T06:08:42.961 INFO:tasks.workunit.client.0.smithi037.stdout:4/235: rename d0/d2/d37/d46/l50 to d0/d6/d1b/d20/d48/l52 0 2024-09-19T06:08:42.962 INFO:tasks.workunit.client.0.smithi037.stdout:3/286: write d0/d16/d20/f5c [115266,2004] 0 2024-09-19T06:08:42.962 INFO:tasks.workunit.client.0.smithi037.stdout:7/206: dwrite d6/f12 [0,4194304] 0 2024-09-19T06:08:42.962 INFO:tasks.workunit.client.0.smithi037.stdout:7/207: fdatasync d6/dc/f2a 0 2024-09-19T06:08:42.962 INFO:tasks.workunit.client.0.smithi037.stdout:6/224: symlink d9/dd/l3b 0 2024-09-19T06:08:42.962 INFO:tasks.workunit.client.0.smithi037.stdout:6/225: dread - d9/dd/f32 zero size 2024-09-19T06:08:42.964 INFO:tasks.workunit.client.0.smithi037.stdout:3/287: creat d0/d43/d23/f69 x:0 0 0 2024-09-19T06:08:42.964 INFO:tasks.workunit.client.0.smithi037.stdout:3/288: write d0/f17 [4425773,69873] 0 2024-09-19T06:08:42.970 INFO:tasks.workunit.client.0.smithi037.stdout:5/273: dwrite d2/d12/d28/d22/d4a/f54 [0,4194304] 0 2024-09-19T06:08:42.971 INFO:tasks.workunit.client.0.smithi037.stdout:4/236: write d0/d2/d2e/d36/f2f [636457,41575] 0 2024-09-19T06:08:42.972 INFO:tasks.workunit.client.0.smithi037.stdout:4/237: readlink d0/l1 0 2024-09-19T06:08:42.972 INFO:tasks.workunit.client.0.smithi037.stdout:4/238: fdatasync d0/d6/d1b/d20/f40 0 2024-09-19T06:08:42.973 INFO:tasks.workunit.client.0.smithi037.stdout:7/208: rename d6/f9 to d6/d20/f3c 0 2024-09-19T06:08:42.973 INFO:tasks.workunit.client.0.smithi037.stdout:1/220: dread d2/f4 [0,4194304] 0 2024-09-19T06:08:42.973 INFO:tasks.workunit.client.0.smithi037.stdout:6/226: creat d9/d16/f3c x:0 0 0 2024-09-19T06:08:42.973 INFO:tasks.workunit.client.0.smithi037.stdout:6/227: truncate d9/dd/d2b/f37 1036118 0 2024-09-19T06:08:42.973 INFO:tasks.workunit.client.0.smithi037.stdout:7/209: stat d6/dc/fd 0 2024-09-19T06:08:42.974 INFO:tasks.workunit.client.0.smithi037.stdout:1/221: dread d2/d12/d1e/d2a/d2e/f31 [0,4194304] 0 2024-09-19T06:08:42.976 INFO:tasks.workunit.client.0.smithi037.stdout:5/274: creat d2/d12/d28/f5b x:0 0 0 2024-09-19T06:08:42.977 INFO:tasks.workunit.client.0.smithi037.stdout:5/275: write d2/d12/d28/f3f [3395919,61877] 0 2024-09-19T06:08:42.977 INFO:tasks.workunit.client.0.smithi037.stdout:5/276: chown d2/d12/f1c 32801671 1 2024-09-19T06:08:42.977 INFO:tasks.workunit.client.0.smithi037.stdout:2/367: dread d1/da/dc/d21/d55/f66 [0,4194304] 0 2024-09-19T06:08:42.977 INFO:tasks.workunit.client.0.smithi037.stdout:6/228: dread d9/dd/d2b/f37 [0,4194304] 0 2024-09-19T06:08:42.978 INFO:tasks.workunit.client.0.smithi037.stdout:6/229: getdents d9/dd/d20 0 2024-09-19T06:08:42.979 INFO:tasks.workunit.client.0.smithi037.stdout:4/239: creat d0/f53 x:0 0 0 2024-09-19T06:08:42.980 INFO:tasks.workunit.client.0.smithi037.stdout:3/289: symlink d0/l6a 0 2024-09-19T06:08:42.981 INFO:tasks.workunit.client.0.smithi037.stdout:3/290: chown d0/d16/d19/d33/c49 83509290 1 2024-09-19T06:08:42.983 INFO:tasks.workunit.client.0.smithi037.stdout:2/368: getdents d1/da/dc/d21/d7d/d80 0 2024-09-19T06:08:42.986 INFO:tasks.workunit.client.0.smithi037.stdout:4/240: mknod d0/d2/d2e/d36/c54 0 2024-09-19T06:08:42.987 INFO:tasks.workunit.client.0.smithi037.stdout:5/277: dread d2/d12/d28/f29 [0,4194304] 0 2024-09-19T06:08:42.987 INFO:tasks.workunit.client.0.smithi037.stdout:3/291: symlink d0/d43/d23/l6b 0 2024-09-19T06:08:42.988 INFO:tasks.workunit.client.0.smithi037.stdout:3/292: dread d0/d16/d19/f3b [0,4194304] 0 2024-09-19T06:08:42.990 INFO:tasks.workunit.client.0.smithi037.stdout:4/241: getdents d0/d6/d45 0 2024-09-19T06:08:42.990 INFO:tasks.workunit.client.0.smithi037.stdout:4/242: dread - d0/d6/d1b/d30/f32 zero size 2024-09-19T06:08:42.991 INFO:tasks.workunit.client.0.smithi037.stdout:5/278: mkdir d2/d5c 0 2024-09-19T06:08:42.993 INFO:tasks.workunit.client.0.smithi037.stdout:4/243: link d0/d2/d37/f49 d0/d6/d1b/f55 0 2024-09-19T06:08:42.993 INFO:tasks.workunit.client.0.smithi037.stdout:4/244: read - d0/d2/d37/f49 zero size 2024-09-19T06:08:42.993 INFO:tasks.workunit.client.0.smithi037.stdout:4/245: chown d0/l4c 171097 1 2024-09-19T06:08:42.994 INFO:tasks.workunit.client.0.smithi037.stdout:5/279: creat d2/d12/f5d x:0 0 0 2024-09-19T06:08:42.999 INFO:tasks.workunit.client.0.smithi037.stdout:2/369: rmdir d1/d16/d4a/d7f 0 2024-09-19T06:08:42.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:08:42 smithi117 ceph-mon[35050]: pgmap v425: 129 pgs: 129 active+clean; 161 MiB data, 901 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 10 MiB/s wr, 706 op/s 2024-09-19T06:08:43.003 INFO:tasks.workunit.client.0.smithi037.stdout:7/210: dwrite d6/d20/f35 [0,4194304] 0 2024-09-19T06:08:43.003 INFO:tasks.workunit.client.0.smithi037.stdout:7/211: read d6/f2b [2279324,73335] 0 2024-09-19T06:08:43.003 INFO:tasks.workunit.client.0.smithi037.stdout:7/212: chown d6/f38 574427236 1 2024-09-19T06:08:43.003 INFO:tasks.workunit.client.0.smithi037.stdout:7/213: readlink d6/l11 0 2024-09-19T06:08:43.003 INFO:tasks.workunit.client.0.smithi037.stdout:7/214: read d6/dc/f1b [1420316,114780] 0 2024-09-19T06:08:43.004 INFO:tasks.workunit.client.0.smithi037.stdout:6/230: dwrite d9/dd/f1b [0,4194304] 0 2024-09-19T06:08:43.004 INFO:tasks.workunit.client.0.smithi037.stdout:6/231: stat d9/f18 0 2024-09-19T06:08:43.007 INFO:tasks.workunit.client.0.smithi037.stdout:6/232: symlink d9/d16/l3d 0 2024-09-19T06:08:43.009 INFO:tasks.workunit.client.0.smithi037.stdout:6/233: creat d9/dd/d1c/f3e x:0 0 0 2024-09-19T06:08:43.009 INFO:tasks.workunit.client.0.smithi037.stdout:6/234: read - d9/dd/d20/f27 zero size 2024-09-19T06:08:43.010 INFO:tasks.workunit.client.0.smithi037.stdout:3/293: dwrite d0/d16/d19/f2e [0,4194304] 0 2024-09-19T06:08:43.010 INFO:tasks.workunit.client.0.smithi037.stdout:3/294: chown d0/d16/d19/d1d/d5e 15 1 2024-09-19T06:08:43.010 INFO:tasks.workunit.client.0.smithi037.stdout:3/295: fdatasync d0/d16/f22 0 2024-09-19T06:08:43.010 INFO:tasks.workunit.client.0.smithi037.stdout:3/296: truncate d0/d16/f56 885233 0 2024-09-19T06:08:43.010 INFO:tasks.workunit.client.0.smithi037.stdout:3/297: write d0/f9 [2469304,38050] 0 2024-09-19T06:08:43.013 INFO:tasks.workunit.client.0.smithi037.stdout:3/298: creat d0/d16/d19/d1d/d5e/f6c x:0 0 0 2024-09-19T06:08:43.015 INFO:tasks.workunit.client.0.smithi037.stdout:3/299: creat d0/d43/d23/f6d x:0 0 0 2024-09-19T06:08:43.018 INFO:tasks.workunit.client.0.smithi037.stdout:3/300: link d0/d43/d23/l6b d0/d16/l6e 0 2024-09-19T06:08:43.027 INFO:tasks.workunit.client.0.smithi037.stdout:2/370: write d1/da/f3e [306977,105327] 0 2024-09-19T06:08:43.028 INFO:tasks.workunit.client.0.smithi037.stdout:2/371: truncate d1/da/dc/d21/d7d/f2e 2746507 0 2024-09-19T06:08:43.031 INFO:tasks.workunit.client.0.smithi037.stdout:2/372: unlink d1/d33/l6b 0 2024-09-19T06:08:43.031 INFO:tasks.workunit.client.0.smithi037.stdout:3/301: write d0/d16/f22 [3205238,44734] 0 2024-09-19T06:08:43.031 INFO:tasks.workunit.client.0.smithi037.stdout:3/302: fsync d0/d43/d26/f36 0 2024-09-19T06:08:43.031 INFO:tasks.workunit.client.0.smithi037.stdout:3/303: truncate d0/d16/f60 802279 0 2024-09-19T06:08:43.032 INFO:tasks.workunit.client.0.smithi037.stdout:2/373: rename d1/da/dc/d21/d7d/f31 to d1/d33/d4c/f88 0 2024-09-19T06:08:43.040 INFO:tasks.workunit.client.0.smithi037.stdout:7/215: dwrite d6/dc/f1b [0,4194304] 0 2024-09-19T06:08:43.040 INFO:tasks.workunit.client.0.smithi037.stdout:7/216: stat d6 0 2024-09-19T06:08:43.040 INFO:tasks.workunit.client.0.smithi037.stdout:7/217: fsync d6/dc/f2a 0 2024-09-19T06:08:43.040 INFO:tasks.workunit.client.0.smithi037.stdout:5/280: dwrite d2/d12/f32 [0,4194304] 0 2024-09-19T06:08:43.042 INFO:tasks.workunit.client.0.smithi037.stdout:7/218: creat d6/f3d x:0 0 0 2024-09-19T06:08:43.043 INFO:tasks.workunit.client.0.smithi037.stdout:2/374: dread d1/da/f2a [0,4194304] 0 2024-09-19T06:08:43.043 INFO:tasks.workunit.client.0.smithi037.stdout:2/375: fdatasync d1/d33/d4c/f53 0 2024-09-19T06:08:43.047 INFO:tasks.workunit.client.0.smithi037.stdout:2/376: truncate d1/d16/f1c 3931197 0 2024-09-19T06:08:43.048 INFO:tasks.workunit.client.0.smithi037.stdout:2/377: symlink d1/da/dc/l89 0 2024-09-19T06:08:43.049 INFO:tasks.workunit.client.0.smithi037.stdout:4/246: dwrite d0/d2/f2b [4194304,4194304] 0 2024-09-19T06:08:43.049 INFO:tasks.workunit.client.0.smithi037.stdout:6/235: dread d9/dd/d1c/d2d/f34 [0,4194304] 0 2024-09-19T06:08:43.049 INFO:tasks.workunit.client.0.smithi037.stdout:4/247: truncate d0/d2/d37/f49 360229 0 2024-09-19T06:08:43.052 INFO:tasks.workunit.client.0.smithi037.stdout:2/378: write d1/d6/f7b [498346,18846] 0 2024-09-19T06:08:43.052 INFO:tasks.workunit.client.0.smithi037.stdout:3/304: write d0/d43/d26/f36 [533384,125870] 0 2024-09-19T06:08:43.052 INFO:tasks.workunit.client.0.smithi037.stdout:6/236: symlink d9/dd/d1c/d2d/d2f/l3f 0 2024-09-19T06:08:43.054 INFO:tasks.workunit.client.0.smithi037.stdout:2/379: rename d1/da/dc/l89 to d1/da/dc/d21/d51/l8a 0 2024-09-19T06:08:43.055 INFO:tasks.workunit.client.0.smithi037.stdout:3/305: mknod d0/d16/d20/d51/c6f 0 2024-09-19T06:08:43.057 INFO:tasks.workunit.client.0.smithi037.stdout:6/237: rename d9/d16/l1d to d9/dd/d20/l40 0 2024-09-19T06:08:43.058 INFO:tasks.workunit.client.0.smithi037.stdout:4/248: dread d0/d2/d2e/d36/f2f [0,4194304] 0 2024-09-19T06:08:43.058 INFO:tasks.workunit.client.0.smithi037.stdout:4/249: dread - d0/f53 zero size 2024-09-19T06:08:43.060 INFO:tasks.workunit.client.0.smithi037.stdout:6/238: creat d9/dd/d1c/f41 x:0 0 0 2024-09-19T06:08:43.060 INFO:tasks.workunit.client.0.smithi037.stdout:6/239: chown d9/dd/d1c/d2d 19652 1 2024-09-19T06:08:43.060 INFO:tasks.workunit.client.0.smithi037.stdout:6/240: dread - d9/dd/d1c/f2e zero size 2024-09-19T06:08:43.060 INFO:tasks.workunit.client.0.smithi037.stdout:2/380: mkdir d1/d6/d8b 0 2024-09-19T06:08:43.061 INFO:tasks.workunit.client.0.smithi037.stdout:4/250: mknod d0/d6/d1b/c56 0 2024-09-19T06:08:43.061 INFO:tasks.workunit.client.0.smithi037.stdout:4/251: getdents d0/d2 0 2024-09-19T06:08:43.061 INFO:tasks.workunit.client.0.smithi037.stdout:4/252: readlink d0/d6/l10 0 2024-09-19T06:08:43.063 INFO:tasks.workunit.client.0.smithi037.stdout:4/253: link d0/d2/d2e/d36/f4f d0/d2/f57 0 2024-09-19T06:08:43.063 INFO:tasks.workunit.client.0.smithi037.stdout:4/254: chown d0/d2/d2e/d36/f4f 1 1 2024-09-19T06:08:43.063 INFO:tasks.workunit.client.0.smithi037.stdout:4/255: dread - d0/d6/d1b/d20/d4d/f51 zero size 2024-09-19T06:08:43.063 INFO:tasks.workunit.client.0.smithi037.stdout:4/256: dread - d0/d6/d1b/d20/d4d/f51 zero size 2024-09-19T06:08:43.064 INFO:tasks.workunit.client.0.smithi037.stdout:4/257: mknod d0/d6/c58 0 2024-09-19T06:08:43.065 INFO:tasks.workunit.client.0.smithi037.stdout:4/258: mkdir d0/d6/d1b/d20/d48/d59 0 2024-09-19T06:08:43.066 INFO:tasks.workunit.client.0.smithi037.stdout:4/259: creat d0/d2/f5a x:0 0 0 2024-09-19T06:08:43.069 INFO:tasks.workunit.client.0.smithi037.stdout:4/260: unlink d0/l8 0 2024-09-19T06:08:43.070 INFO:tasks.workunit.client.0.smithi037.stdout:4/261: read d0/d6/d1b/d20/f40 [344067,11504] 0 2024-09-19T06:08:43.070 INFO:tasks.workunit.client.0.smithi037.stdout:4/262: write d0/d6/f3a [234868,12847] 0 2024-09-19T06:08:43.072 INFO:tasks.workunit.client.0.smithi037.stdout:2/381: truncate d1/da/f3e 212343 0 2024-09-19T06:08:43.072 INFO:tasks.workunit.client.0.smithi037.stdout:4/263: creat d0/d6/d45/f5b x:0 0 0 2024-09-19T06:08:43.073 INFO:tasks.workunit.client.0.smithi037.stdout:2/382: chown d1/d6/c11 21914599 1 2024-09-19T06:08:43.073 INFO:tasks.workunit.client.0.smithi037.stdout:2/383: truncate d1/da/dc/d21/f4d 226208 0 2024-09-19T06:08:43.075 INFO:tasks.workunit.client.0.smithi037.stdout:5/281: dwrite d2/d12/f4f [0,4194304] 0 2024-09-19T06:08:43.075 INFO:tasks.workunit.client.0.smithi037.stdout:7/219: dread d6/d20/f35 [0,4194304] 0 2024-09-19T06:08:43.075 INFO:tasks.workunit.client.0.smithi037.stdout:7/220: write d6/f3a [358317,6205] 0 2024-09-19T06:08:43.076 INFO:tasks.workunit.client.0.smithi037.stdout:2/384: rename d1/da/dc/d21/l22 to d1/l8c 0 2024-09-19T06:08:43.079 INFO:tasks.workunit.client.0.smithi037.stdout:5/282: creat d2/d12/d24/d58/f5e x:0 0 0 2024-09-19T06:08:43.080 INFO:tasks.workunit.client.0.smithi037.stdout:6/241: dread d9/dd/f1b [0,4194304] 0 2024-09-19T06:08:43.084 INFO:tasks.workunit.client.0.smithi037.stdout:6/242: mkdir d9/dd/d2b/d42 0 2024-09-19T06:08:43.084 INFO:tasks.workunit.client.0.smithi037.stdout:6/243: chown d9/la 12267114 1 2024-09-19T06:08:43.085 INFO:tasks.workunit.client.0.smithi037.stdout:3/306: dwrite d0/d16/d20/f3e [0,4194304] 0 2024-09-19T06:08:43.098 INFO:tasks.workunit.client.0.smithi037.stdout:3/307: mkdir d0/d5f/d70 0 2024-09-19T06:08:43.099 INFO:tasks.workunit.client.0.smithi037.stdout:3/308: creat d0/d16/f71 x:0 0 0 2024-09-19T06:08:43.101 INFO:tasks.workunit.client.0.smithi037.stdout:2/385: write d1/da/dc/f18 [3926743,117895] 0 2024-09-19T06:08:43.101 INFO:tasks.workunit.client.0.smithi037.stdout:4/264: dwrite d0/d2/f19 [0,4194304] 0 2024-09-19T06:08:43.101 INFO:tasks.workunit.client.0.smithi037.stdout:4/265: chown d0/d2/f19 578949793 1 2024-09-19T06:08:43.101 INFO:tasks.workunit.client.0.smithi037.stdout:4/266: chown d0/f53 27478317 1 2024-09-19T06:08:43.101 INFO:tasks.workunit.client.0.smithi037.stdout:4/267: write d0/d2/d2e/d36/f4f [1035803,59494] 0 2024-09-19T06:08:43.103 INFO:tasks.workunit.client.0.smithi037.stdout:2/386: creat d1/d16/d4a/f8d x:0 0 0 2024-09-19T06:08:43.105 INFO:tasks.workunit.client.0.smithi037.stdout:4/268: creat d0/d6/d45/d4a/f5c x:0 0 0 2024-09-19T06:08:43.105 INFO:tasks.workunit.client.0.smithi037.stdout:7/221: dwrite d6/f12 [0,4194304] 0 2024-09-19T06:08:43.106 INFO:tasks.workunit.client.0.smithi037.stdout:2/387: mkdir d1/da/dc/d21/d55/d8e 0 2024-09-19T06:08:43.106 INFO:tasks.workunit.client.0.smithi037.stdout:4/269: mkdir d0/d6/d1b/d5d 0 2024-09-19T06:08:43.108 INFO:tasks.workunit.client.0.smithi037.stdout:2/388: creat d1/d33/d4c/f8f x:0 0 0 2024-09-19T06:08:43.110 INFO:tasks.workunit.client.0.smithi037.stdout:2/389: unlink d1/da/dc/d21/l5f 0 2024-09-19T06:08:43.110 INFO:tasks.workunit.client.0.smithi037.stdout:6/244: write d9/fc [1085782,34851] 0 2024-09-19T06:08:43.112 INFO:tasks.workunit.client.0.smithi037.stdout:2/390: mknod d1/da/dc/c90 0 2024-09-19T06:08:43.112 INFO:tasks.workunit.client.0.smithi037.stdout:2/391: truncate d1/d16/d4a/f8d 1023428 0 2024-09-19T06:08:43.112 INFO:tasks.workunit.client.0.smithi037.stdout:2/392: write d1/da/f6d [922195,118417] 0 2024-09-19T06:08:43.112 INFO:tasks.workunit.client.0.smithi037.stdout:2/393: readlink d1/da/d42/l70 0 2024-09-19T06:08:43.112 INFO:tasks.workunit.client.0.smithi037.stdout:2/394: dread - d1/d33/d4c/f8f zero size 2024-09-19T06:08:43.113 INFO:tasks.workunit.client.0.smithi037.stdout:6/245: symlink d9/dd/d2b/d42/l43 0 2024-09-19T06:08:43.113 INFO:tasks.workunit.client.0.smithi037.stdout:6/246: rename d9/dd to d9/dd/d2b/d44 22 2024-09-19T06:08:43.113 INFO:tasks.workunit.client.0.smithi037.stdout:2/395: rmdir d1/d6 39 2024-09-19T06:08:43.114 INFO:tasks.workunit.client.0.smithi037.stdout:2/396: chown d1/da/dc/d21/d7d 1 1 2024-09-19T06:08:43.114 INFO:tasks.workunit.client.0.smithi037.stdout:4/270: getdents d0/d6/d1b 0 2024-09-19T06:08:43.115 INFO:tasks.workunit.client.0.smithi037.stdout:6/247: symlink d9/dd/d20/l45 0 2024-09-19T06:08:43.116 INFO:tasks.workunit.client.0.smithi037.stdout:7/222: read d6/dc/f16 [2155097,53305] 0 2024-09-19T06:08:43.117 INFO:tasks.workunit.client.0.smithi037.stdout:5/283: dwrite d2/d12/f27 [0,4194304] 0 2024-09-19T06:08:43.117 INFO:tasks.workunit.client.0.smithi037.stdout:5/284: stat d2/fd 0 2024-09-19T06:08:43.117 INFO:tasks.workunit.client.0.smithi037.stdout:6/248: mknod d9/dd/d1c/c46 0 2024-09-19T06:08:43.117 INFO:tasks.workunit.client.0.smithi037.stdout:2/397: unlink d1/d6/f7a 0 2024-09-19T06:08:43.119 INFO:tasks.workunit.client.0.smithi037.stdout:7/223: creat d6/f3e x:0 0 0 2024-09-19T06:08:43.119 INFO:tasks.workunit.client.0.smithi037.stdout:7/224: dread - d6/f3e zero size 2024-09-19T06:08:43.120 INFO:tasks.workunit.client.0.smithi037.stdout:5/285: mkdir d2/d5c/d5f 0 2024-09-19T06:08:43.120 INFO:tasks.workunit.client.0.smithi037.stdout:5/286: chown d2/d12/d28/f29 491773 1 2024-09-19T06:08:43.120 INFO:tasks.workunit.client.0.smithi037.stdout:0/328: sync 2024-09-19T06:08:43.120 INFO:tasks.workunit.client.0.smithi037.stdout:0/329: write d5/d20/f57 [85881,12558] 0 2024-09-19T06:08:43.121 INFO:tasks.workunit.client.0.smithi037.stdout:6/249: creat d9/dd/d1c/f47 x:0 0 0 2024-09-19T06:08:43.123 INFO:tasks.workunit.client.0.smithi037.stdout:2/398: creat d1/d16/f91 x:0 0 0 2024-09-19T06:08:43.123 INFO:tasks.workunit.client.0.smithi037.stdout:2/399: write d1/da/f3e [339964,120265] 0 2024-09-19T06:08:43.124 INFO:tasks.workunit.client.0.smithi037.stdout:7/225: symlink d6/d20/l3f 0 2024-09-19T06:08:43.124 INFO:tasks.workunit.client.0.smithi037.stdout:6/250: dread d9/dd/d2b/f37 [0,4194304] 0 2024-09-19T06:08:43.126 INFO:tasks.workunit.client.0.smithi037.stdout:5/287: creat d2/d5c/f60 x:0 0 0 2024-09-19T06:08:43.126 INFO:tasks.workunit.client.0.smithi037.stdout:5/288: readlink d2/d12/d28/d22/l30 0 2024-09-19T06:08:43.129 INFO:tasks.workunit.client.0.smithi037.stdout:6/251: dread d9/f19 [0,4194304] 0 2024-09-19T06:08:43.130 INFO:tasks.workunit.client.0.smithi037.stdout:0/330: creat d5/d8/f6c x:0 0 0 2024-09-19T06:08:43.132 INFO:tasks.workunit.client.0.smithi037.stdout:7/226: unlink d6/dc/c18 0 2024-09-19T06:08:43.132 INFO:tasks.workunit.client.0.smithi037.stdout:7/227: chown d6/d20/l3f 3832 1 2024-09-19T06:08:43.133 INFO:tasks.workunit.client.0.smithi037.stdout:5/289: symlink d2/d12/d28/d22/d53/l61 0 2024-09-19T06:08:43.133 INFO:tasks.workunit.client.0.smithi037.stdout:5/290: write d2/d12/d28/f48 [852072,45880] 0 2024-09-19T06:08:43.135 INFO:tasks.workunit.client.0.smithi037.stdout:6/252: rename d9/fc to d9/dd/d20/f48 0 2024-09-19T06:08:43.135 INFO:tasks.workunit.client.0.smithi037.stdout:6/253: readlink d9/dd/d1c/l38 0 2024-09-19T06:08:43.136 INFO:tasks.workunit.client.0.smithi037.stdout:4/271: dwrite d0/d2/d37/f49 [0,4194304] 0 2024-09-19T06:08:43.136 INFO:tasks.workunit.client.0.smithi037.stdout:0/331: mkdir d5/d18/d68/d6d 0 2024-09-19T06:08:43.137 INFO:tasks.workunit.client.0.smithi037.stdout:5/291: symlink d2/d10/l62 0 2024-09-19T06:08:43.138 INFO:tasks.workunit.client.0.smithi037.stdout:5/292: readlink d2/d12/d28/d22/l46 0 2024-09-19T06:08:43.138 INFO:tasks.workunit.client.0.smithi037.stdout:6/254: creat d9/dd/d2b/d42/f49 x:0 0 0 2024-09-19T06:08:43.144 INFO:tasks.workunit.client.0.smithi037.stdout:0/332: mkdir d5/d17/d6e 0 2024-09-19T06:08:43.144 INFO:tasks.workunit.client.0.smithi037.stdout:4/272: creat d0/d2/d37/f5e x:0 0 0 2024-09-19T06:08:43.146 INFO:tasks.workunit.client.0.smithi037.stdout:0/333: creat d5/d8/d44/f6f x:0 0 0 2024-09-19T06:08:43.146 INFO:tasks.workunit.client.0.smithi037.stdout:0/334: write d5/d8/d11/d15/d21/f4b [772731,56548] 0 2024-09-19T06:08:43.147 INFO:tasks.workunit.client.0.smithi037.stdout:4/273: creat d0/d6/d1b/f5f x:0 0 0 2024-09-19T06:08:43.147 INFO:tasks.workunit.client.0.smithi037.stdout:4/274: readlink d0/d6/d45/d4a/l4b 0 2024-09-19T06:08:43.148 INFO:tasks.workunit.client.0.smithi037.stdout:0/335: rmdir d5/d18/d68 39 2024-09-19T06:08:43.149 INFO:tasks.workunit.client.0.smithi037.stdout:4/275: symlink d0/d2/d2e/l60 0 2024-09-19T06:08:43.149 INFO:tasks.workunit.client.0.smithi037.stdout:7/228: write d6/dc/fe [704478,42500] 0 2024-09-19T06:08:43.163 INFO:tasks.workunit.client.0.smithi037.stdout:5/293: dwrite d2/d12/f3a [0,4194304] 0 2024-09-19T06:08:43.165 INFO:tasks.workunit.client.0.smithi037.stdout:4/276: dread d0/d2/d2e/d36/f4f [0,4194304] 0 2024-09-19T06:08:43.165 INFO:tasks.workunit.client.0.smithi037.stdout:4/277: chown d0/d6/d1b/d5d 611513 1 2024-09-19T06:08:43.165 INFO:tasks.workunit.client.0.smithi037.stdout:4/278: chown d0/d2/d37/d46 0 1 2024-09-19T06:08:43.165 INFO:tasks.workunit.client.0.smithi037.stdout:5/294: symlink d2/d12/d24/d58/l63 0 2024-09-19T06:08:43.167 INFO:tasks.workunit.client.0.smithi037.stdout:4/279: symlink d0/d2/d2e/l61 0 2024-09-19T06:08:43.167 INFO:tasks.workunit.client.0.smithi037.stdout:7/229: dread d6/dc/f25 [0,4194304] 0 2024-09-19T06:08:43.167 INFO:tasks.workunit.client.0.smithi037.stdout:7/230: fdatasync d6/dc/f16 0 2024-09-19T06:08:43.167 INFO:tasks.workunit.client.0.smithi037.stdout:4/280: chown d0/d6/d1b/l2a 507198 1 2024-09-19T06:08:43.168 INFO:tasks.workunit.client.0.smithi037.stdout:4/281: getdents d0/d6/d1b/d5d 0 2024-09-19T06:08:43.168 INFO:tasks.workunit.client.0.smithi037.stdout:7/231: creat d6/d20/d34/f40 x:0 0 0 2024-09-19T06:08:43.168 INFO:tasks.workunit.client.0.smithi037.stdout:7/232: readlink d6/l11 0 2024-09-19T06:08:43.169 INFO:tasks.workunit.client.0.smithi037.stdout:7/233: chown d6/dc/f25 3412 1 2024-09-19T06:08:43.171 INFO:tasks.workunit.client.0.smithi037.stdout:4/282: truncate d0/d6/d1b/f55 2772842 0 2024-09-19T06:08:43.172 INFO:tasks.workunit.client.0.smithi037.stdout:4/283: stat d0/d2/d37/d46 0 2024-09-19T06:08:43.172 INFO:tasks.workunit.client.0.smithi037.stdout:0/336: dwrite d5/d8/f3f [0,4194304] 0 2024-09-19T06:08:43.187 INFO:tasks.workunit.client.0.smithi037.stdout:5/295: dwrite d2/d12/d24/d58/f5e [0,4194304] 0 2024-09-19T06:08:43.193 INFO:tasks.workunit.client.0.smithi037.stdout:0/337: dwrite d5/d8/d22/f4d [0,4194304] 0 2024-09-19T06:08:43.195 INFO:tasks.workunit.client.0.smithi037.stdout:0/338: creat d5/d8/f70 x:0 0 0 2024-09-19T06:08:43.208 INFO:tasks.workunit.client.0.smithi037.stdout:5/296: dwrite d2/d12/d28/d22/d35/f56 [0,4194304] 0 2024-09-19T06:08:43.208 INFO:tasks.workunit.client.0.smithi037.stdout:5/297: truncate d2/d10/f21 5006710 0 2024-09-19T06:08:43.217 INFO:tasks.workunit.client.0.smithi037.stdout:0/339: dwrite d5/d8/d44/d48/f65 [0,4194304] 0 2024-09-19T06:08:43.229 INFO:tasks.workunit.client.0.smithi037.stdout:5/298: dwrite d2/d12/f16 [0,4194304] 0 2024-09-19T06:08:43.237 INFO:tasks.workunit.client.0.smithi037.stdout:0/340: dwrite d5/d8/d11/d15/f1e [0,4194304] 0 2024-09-19T06:08:43.248 INFO:tasks.workunit.client.0.smithi037.stdout:5/299: dwrite d2/d10/f1f [0,4194304] 0 2024-09-19T06:08:43.261 INFO:tasks.workunit.client.0.smithi037.stdout:5/300: write d2/d12/f3a [3375996,107373] 0 2024-09-19T06:08:43.261 INFO:tasks.workunit.client.0.smithi037.stdout:5/301: chown d2/d12/d28/d22/d35/l4c 164 1 2024-09-19T06:08:43.261 INFO:tasks.workunit.client.0.smithi037.stdout:0/341: dwrite d5/d8/f66 [0,4194304] 0 2024-09-19T06:08:43.261 INFO:tasks.workunit.client.0.smithi037.stdout:0/342: truncate d5/d8/d11/d32/f5e 656628 0 2024-09-19T06:08:43.262 INFO:tasks.workunit.client.0.smithi037.stdout:0/343: fsync d5/d8/d44/d48/f5a 0 2024-09-19T06:08:43.262 INFO:tasks.workunit.client.0.smithi037.stdout:0/344: write d5/d8/d11/d15/d21/f29 [7829597,37169] 0 2024-09-19T06:08:43.263 INFO:tasks.workunit.client.0.smithi037.stdout:5/302: read d2/d12/f16 [4317439,71392] 0 2024-09-19T06:08:43.263 INFO:tasks.workunit.client.0.smithi037.stdout:5/303: chown d2/d12/d28/d22/l30 235483928 1 2024-09-19T06:08:43.265 INFO:tasks.workunit.client.0.smithi037.stdout:5/304: dread d2/fa [0,4194304] 0 2024-09-19T06:08:43.266 INFO:tasks.workunit.client.0.smithi037.stdout:5/305: mknod d2/d12/d28/c64 0 2024-09-19T06:08:43.267 INFO:tasks.workunit.client.0.smithi037.stdout:1/222: sync 2024-09-19T06:08:43.267 INFO:tasks.workunit.client.0.smithi037.stdout:8/382: sync 2024-09-19T06:08:43.267 INFO:tasks.workunit.client.0.smithi037.stdout:9/420: sync 2024-09-19T06:08:43.267 INFO:tasks.workunit.client.0.smithi037.stdout:8/383: chown d1/d62/d59/d5d 57644 1 2024-09-19T06:08:43.267 INFO:tasks.workunit.client.0.smithi037.stdout:9/421: chown da/dd/d1b/d23/d3f/l61 49 1 2024-09-19T06:08:43.268 INFO:tasks.workunit.client.0.smithi037.stdout:5/306: rename d2/d12/d24/l42 to d2/d10/l65 0 2024-09-19T06:08:43.269 INFO:tasks.workunit.client.0.smithi037.stdout:9/422: link da/d4d/f87 da/f9a 0 2024-09-19T06:08:43.270 INFO:tasks.workunit.client.0.smithi037.stdout:9/423: write da/f3b [2976929,56901] 0 2024-09-19T06:08:43.271 INFO:tasks.workunit.client.0.smithi037.stdout:8/384: rename d1/d35/d36/d3d/f2e to d1/d62/d59/f85 0 2024-09-19T06:08:43.271 INFO:tasks.workunit.client.0.smithi037.stdout:8/385: write d1/d35/d36/d3d/f29 [5038304,128783] 0 2024-09-19T06:08:43.272 INFO:tasks.workunit.client.0.smithi037.stdout:5/307: write d2/d12/d28/f48 [453503,67404] 0 2024-09-19T06:08:43.273 INFO:tasks.workunit.client.0.smithi037.stdout:9/424: creat da/dd/d63/f9b x:0 0 0 2024-09-19T06:08:43.273 INFO:tasks.workunit.client.0.smithi037.stdout:9/425: truncate da/dd/d1b/d23/f69 556055 0 2024-09-19T06:08:43.274 INFO:tasks.workunit.client.0.smithi037.stdout:8/386: link d1/d35/d36/d3d/f22 d1/d61/d68/f86 0 2024-09-19T06:08:43.275 INFO:tasks.workunit.client.0.smithi037.stdout:5/308: rename d2/d12/d28/c2e to d2/d12/d28/d22/d35/c66 0 2024-09-19T06:08:43.276 INFO:tasks.workunit.client.0.smithi037.stdout:9/426: link da/dd/d1b/d2f/d38/f39 da/dd/d1b/d23/f9c 0 2024-09-19T06:08:43.276 INFO:tasks.workunit.client.0.smithi037.stdout:9/427: truncate da/dd/d1b/f36 4587336 0 2024-09-19T06:08:43.278 INFO:tasks.workunit.client.0.smithi037.stdout:8/387: truncate d1/d35/d36/d3d/f34 1434295 0 2024-09-19T06:08:43.280 INFO:tasks.workunit.client.0.smithi037.stdout:5/309: rename d2/d12/d28/d22/d35/l4c to d2/d12/d24/l67 0 2024-09-19T06:08:43.280 INFO:tasks.workunit.client.0.smithi037.stdout:0/345: dwrite d5/d8/d11/f55 [0,4194304] 0 2024-09-19T06:08:43.280 INFO:tasks.workunit.client.0.smithi037.stdout:0/346: fsync d5/d42/f62 0 2024-09-19T06:08:43.281 INFO:tasks.workunit.client.0.smithi037.stdout:9/428: creat da/d57/f9d x:0 0 0 2024-09-19T06:08:43.282 INFO:tasks.workunit.client.0.smithi037.stdout:8/388: truncate d1/d62/d59/f85 2321249 0 2024-09-19T06:08:43.284 INFO:tasks.workunit.client.0.smithi037.stdout:9/429: getdents da/dd/d1b/d23/d3f 0 2024-09-19T06:08:43.284 INFO:tasks.workunit.client.0.smithi037.stdout:9/430: write da/d4d/f87 [665696,65462] 0 2024-09-19T06:08:43.285 INFO:tasks.workunit.client.0.smithi037.stdout:8/389: mknod d1/d6a/c87 0 2024-09-19T06:08:43.286 INFO:tasks.workunit.client.0.smithi037.stdout:1/223: dwrite d2/d12/d15/d34/f46 [0,4194304] 0 2024-09-19T06:08:43.287 INFO:tasks.workunit.client.0.smithi037.stdout:1/224: chown d2/d12/d1d/f49 1 1 2024-09-19T06:08:43.289 INFO:tasks.workunit.client.0.smithi037.stdout:1/225: creat d2/d12/d1e/f4e x:0 0 0 2024-09-19T06:08:43.289 INFO:tasks.workunit.client.0.smithi037.stdout:1/226: read - d2/f3a zero size 2024-09-19T06:08:43.293 INFO:tasks.workunit.client.0.smithi037.stdout:5/310: read d2/d12/f26 [1318632,115944] 0 2024-09-19T06:08:43.293 INFO:tasks.workunit.client.0.smithi037.stdout:5/311: truncate d2/f7 345870 0 2024-09-19T06:08:43.299 INFO:tasks.workunit.client.0.smithi037.stdout:5/312: truncate d2/d12/d28/f48 189784 0 2024-09-19T06:08:43.301 INFO:tasks.workunit.client.0.smithi037.stdout:0/347: dread d5/d8/d11/f55 [0,4194304] 0 2024-09-19T06:08:43.303 INFO:tasks.workunit.client.0.smithi037.stdout:0/348: creat d5/d8/d44/f71 x:0 0 0 2024-09-19T06:08:43.304 INFO:tasks.workunit.client.0.smithi037.stdout:1/227: dread d2/d12/d15/d34/f46 [0,4194304] 0 2024-09-19T06:08:43.304 INFO:tasks.workunit.client.0.smithi037.stdout:0/349: creat d5/d8/d11/d15/d21/f72 x:0 0 0 2024-09-19T06:08:43.305 INFO:tasks.workunit.client.0.smithi037.stdout:1/228: creat d2/d12/d1d/f4f x:0 0 0 2024-09-19T06:08:43.306 INFO:tasks.workunit.client.0.smithi037.stdout:0/350: rmdir d5/d8/d44 39 2024-09-19T06:08:43.306 INFO:tasks.workunit.client.0.smithi037.stdout:0/351: fsync d5/d8/d44/d48/f5a 0 2024-09-19T06:08:43.306 INFO:tasks.workunit.client.0.smithi037.stdout:1/229: symlink d2/d12/l50 0 2024-09-19T06:08:43.306 INFO:tasks.workunit.client.0.smithi037.stdout:1/230: write d2/d12/d15/d34/f46 [4653387,116512] 0 2024-09-19T06:08:43.307 INFO:tasks.workunit.client.0.smithi037.stdout:0/352: truncate d5/d8/d11/d15/f31 4151252 0 2024-09-19T06:08:43.308 INFO:tasks.workunit.client.0.smithi037.stdout:0/353: rename d5/d8/d11/d15/d21/l52 to d5/d18/l73 0 2024-09-19T06:08:43.311 INFO:tasks.workunit.client.0.smithi037.stdout:1/231: dread d2/fa [0,4194304] 0 2024-09-19T06:08:43.312 INFO:tasks.workunit.client.0.smithi037.stdout:1/232: mknod d2/d12/d1e/d2d/c51 0 2024-09-19T06:08:43.313 INFO:tasks.workunit.client.0.smithi037.stdout:8/390: dwrite d1/f78 [0,4194304] 0 2024-09-19T06:08:43.313 INFO:tasks.workunit.client.0.smithi037.stdout:9/431: dwrite da/dd/d1b/d2f/f70 [0,4194304] 0 2024-09-19T06:08:43.316 INFO:tasks.workunit.client.0.smithi037.stdout:1/233: rmdir d2/d12/d1e/d2a 39 2024-09-19T06:08:43.317 INFO:tasks.workunit.client.0.smithi037.stdout:1/234: write d2/f4 [5073373,90679] 0 2024-09-19T06:08:43.317 INFO:tasks.workunit.client.0.smithi037.stdout:1/235: write d2/d12/d1d/f4f [701669,92675] 0 2024-09-19T06:08:43.323 INFO:tasks.workunit.client.0.smithi037.stdout:9/432: symlink da/dd/d1b/d23/d6a/l9e 0 2024-09-19T06:08:43.325 INFO:tasks.workunit.client.0.smithi037.stdout:9/433: creat da/dd/d1b/d2f/d6d/f9f x:0 0 0 2024-09-19T06:08:43.325 INFO:tasks.workunit.client.0.smithi037.stdout:9/434: stat da/dd/d1b/d23/d6a/d85/f97 0 2024-09-19T06:08:43.326 INFO:tasks.workunit.client.0.smithi037.stdout:9/435: write da/dd/d1b/f36 [4131465,19159] 0 2024-09-19T06:08:43.326 INFO:tasks.workunit.client.0.smithi037.stdout:9/436: chown da/d4d/f68 5089 1 2024-09-19T06:08:43.326 INFO:tasks.workunit.client.0.smithi037.stdout:9/437: dread - da/dd/d1b/d2f/d38/f78 zero size 2024-09-19T06:08:43.326 INFO:tasks.workunit.client.0.smithi037.stdout:9/438: chown da/dd/d1b/d23/d6a/d82/c8c 3336043 1 2024-09-19T06:08:43.326 INFO:tasks.workunit.client.0.smithi037.stdout:9/439: readlink da/dd/d1b/d2f/d6d/l96 0 2024-09-19T06:08:43.326 INFO:tasks.workunit.client.0.smithi037.stdout:9/440: read - da/dd/d63/f9b zero size 2024-09-19T06:08:43.327 INFO:tasks.workunit.client.0.smithi037.stdout:0/354: read d5/d8/d11/d32/f43 [4344262,17482] 0 2024-09-19T06:08:43.327 INFO:tasks.workunit.client.0.smithi037.stdout:0/355: stat d5/d8/d11/l63 0 2024-09-19T06:08:43.327 INFO:tasks.workunit.client.0.smithi037.stdout:0/356: write d5/d8/d44/d48/f5a [1252627,35050] 0 2024-09-19T06:08:43.328 INFO:tasks.workunit.client.0.smithi037.stdout:9/441: getdents da/dd 0 2024-09-19T06:08:43.329 INFO:tasks.workunit.client.0.smithi037.stdout:5/313: dwrite d2/d12/d28/d22/f3c [0,4194304] 0 2024-09-19T06:08:43.329 INFO:tasks.workunit.client.0.smithi037.stdout:5/314: chown d2 6 1 2024-09-19T06:08:43.330 INFO:tasks.workunit.client.0.smithi037.stdout:9/442: rmdir da/dd/d63/d80/d8b 0 2024-09-19T06:08:43.332 INFO:tasks.workunit.client.0.smithi037.stdout:8/391: dread d1/d35/d36/d3d/f3c [0,4194304] 0 2024-09-19T06:08:43.337 INFO:tasks.workunit.client.0.smithi037.stdout:1/236: read d2/d12/d17/f18 [1449282,111174] 0 2024-09-19T06:08:43.339 INFO:tasks.workunit.client.0.smithi037.stdout:5/315: link d2/d12/d24/d58/l63 d2/d12/d28/d22/d4a/l68 0 2024-09-19T06:08:43.340 INFO:tasks.workunit.client.0.smithi037.stdout:9/443: unlink da/d20/c86 0 2024-09-19T06:08:43.341 INFO:tasks.workunit.client.0.smithi037.stdout:8/392: symlink d1/d61/d7e/l88 0 2024-09-19T06:08:43.341 INFO:tasks.workunit.client.0.smithi037.stdout:1/237: creat d2/d12/d15/d34/f52 x:0 0 0 2024-09-19T06:08:43.342 INFO:tasks.workunit.client.0.smithi037.stdout:5/316: creat d2/d5c/d5f/f69 x:0 0 0 2024-09-19T06:08:43.344 INFO:tasks.workunit.client.0.smithi037.stdout:9/444: symlink da/dd/d1b/d23/d6a/d82/la0 0 2024-09-19T06:08:43.344 INFO:tasks.workunit.client.0.smithi037.stdout:9/445: read - da/dd/d1b/d23/d6a/f7f zero size 2024-09-19T06:08:43.344 INFO:tasks.workunit.client.0.smithi037.stdout:9/446: readlink da/l7d 0 2024-09-19T06:08:43.345 INFO:tasks.workunit.client.0.smithi037.stdout:8/393: rename d1/d35/d36/d3d/f27 to d1/d61/f89 0 2024-09-19T06:08:43.345 INFO:tasks.workunit.client.0.smithi037.stdout:1/238: truncate d2/f3 1619733 0 2024-09-19T06:08:43.345 INFO:tasks.workunit.client.0.smithi037.stdout:1/239: read d2/f10 [3506795,121828] 0 2024-09-19T06:08:43.346 INFO:tasks.workunit.client.0.smithi037.stdout:5/317: symlink d2/d12/d28/d22/d35/l6a 0 2024-09-19T06:08:43.347 INFO:tasks.workunit.client.0.smithi037.stdout:9/447: creat da/dd/d1b/d62/fa1 x:0 0 0 2024-09-19T06:08:43.347 INFO:tasks.workunit.client.0.smithi037.stdout:9/448: chown da/dd/d1b/d2f/l47 2361126 1 2024-09-19T06:08:43.348 INFO:tasks.workunit.client.0.smithi037.stdout:1/240: mknod d2/d48/c53 0 2024-09-19T06:08:43.349 INFO:tasks.workunit.client.0.smithi037.stdout:5/318: truncate d2/d12/f4f 2507356 0 2024-09-19T06:08:43.351 INFO:tasks.workunit.client.0.smithi037.stdout:9/449: creat da/dd/d1b/d2f/fa2 x:0 0 0 2024-09-19T06:08:43.351 INFO:tasks.workunit.client.0.smithi037.stdout:9/450: readlink da/dd/l2e 0 2024-09-19T06:08:43.351 INFO:tasks.workunit.client.0.smithi037.stdout:9/451: dread - da/dd/d1b/d2f/fa2 zero size 2024-09-19T06:08:43.352 INFO:tasks.workunit.client.0.smithi037.stdout:1/241: truncate d2/d12/f13 951038 0 2024-09-19T06:08:43.352 INFO:tasks.workunit.client.0.smithi037.stdout:3/309: sync 2024-09-19T06:08:43.354 INFO:tasks.workunit.client.0.smithi037.stdout:1/242: symlink d2/d12/d1e/d2d/l54 0 2024-09-19T06:08:43.361 INFO:tasks.workunit.client.0.smithi037.stdout:8/394: write d1/f43 [3713476,63167] 0 2024-09-19T06:08:43.363 INFO:tasks.workunit.client.0.smithi037.stdout:8/395: truncate d1/d35/d36/d3d/f19 943777 0 2024-09-19T06:08:43.365 INFO:tasks.workunit.client.0.smithi037.stdout:8/396: truncate d1/d61/d68/f86 8228607 0 2024-09-19T06:08:43.366 INFO:tasks.workunit.client.0.smithi037.stdout:1/243: dread d2/fb [0,4194304] 0 2024-09-19T06:08:43.367 INFO:tasks.workunit.client.0.smithi037.stdout:8/397: truncate d1/f10 2108862 0 2024-09-19T06:08:43.371 INFO:tasks.workunit.client.0.smithi037.stdout:1/244: creat d2/d12/d1e/d2d/f55 x:0 0 0 2024-09-19T06:08:43.372 INFO:tasks.workunit.client.0.smithi037.stdout:8/398: creat d1/d62/d59/d5d/f8a x:0 0 0 2024-09-19T06:08:43.374 INFO:tasks.workunit.client.0.smithi037.stdout:5/319: dwrite d2/d12/d24/f51 [0,4194304] 0 2024-09-19T06:08:43.379 INFO:tasks.workunit.client.0.smithi037.stdout:8/399: unlink d1/d35/d36/d3d/f29 0 2024-09-19T06:08:43.379 INFO:tasks.workunit.client.0.smithi037.stdout:9/452: dwrite da/f27 [0,4194304] 0 2024-09-19T06:08:43.379 INFO:tasks.workunit.client.0.smithi037.stdout:9/453: write da/dd/d1b/d23/d6a/f7f [754568,3604] 0 2024-09-19T06:08:43.379 INFO:tasks.workunit.client.0.smithi037.stdout:9/454: dread - da/dd/d1b/d62/f84 zero size 2024-09-19T06:08:43.383 INFO:tasks.workunit.client.0.smithi037.stdout:3/310: dwrite d0/d16/d20/d45/d55/f40 [0,4194304] 0 2024-09-19T06:08:43.383 INFO:tasks.workunit.client.0.smithi037.stdout:3/311: write d0/d43/d23/f69 [321858,111485] 0 2024-09-19T06:08:43.383 INFO:tasks.workunit.client.0.smithi037.stdout:5/320: symlink d2/d12/d28/d22/d53/l6b 0 2024-09-19T06:08:43.385 INFO:tasks.workunit.client.0.smithi037.stdout:8/400: mkdir d1/d61/d7e/d8b 0 2024-09-19T06:08:43.388 INFO:tasks.workunit.client.0.smithi037.stdout:9/455: creat da/dd/d1b/d43/fa3 x:0 0 0 2024-09-19T06:08:43.392 INFO:tasks.workunit.client.0.smithi037.stdout:3/312: creat d0/d43/d23/f72 x:0 0 0 2024-09-19T06:08:43.392 INFO:tasks.workunit.client.0.smithi037.stdout:3/313: chown d0/f17 335 1 2024-09-19T06:08:43.393 INFO:tasks.workunit.client.0.smithi037.stdout:9/456: mkdir da/dd/d1b/d23/d6a/d8f/da4 0 2024-09-19T06:08:43.393 INFO:tasks.workunit.client.0.smithi037.stdout:9/457: read da/dd/d1b/f36 [2500638,29367] 0 2024-09-19T06:08:43.393 INFO:tasks.workunit.client.0.smithi037.stdout:9/458: fdatasync da/dd/d1b/d62/f75 0 2024-09-19T06:08:43.394 INFO:tasks.workunit.client.0.smithi037.stdout:1/245: dwrite d2/fb [0,4194304] 0 2024-09-19T06:08:43.394 INFO:tasks.workunit.client.0.smithi037.stdout:1/246: chown d2/d48/c4b 6 1 2024-09-19T06:08:43.394 INFO:tasks.workunit.client.0.smithi037.stdout:1/247: fsync d2/d12/f25 0 2024-09-19T06:08:43.394 INFO:tasks.workunit.client.0.smithi037.stdout:3/314: creat d0/d43/d37/f73 x:0 0 0 2024-09-19T06:08:43.394 INFO:tasks.workunit.client.0.smithi037.stdout:3/315: dread - d0/d43/d23/f72 zero size 2024-09-19T06:08:43.395 INFO:tasks.workunit.client.0.smithi037.stdout:8/401: symlink d1/d35/l8c 0 2024-09-19T06:08:43.395 INFO:tasks.workunit.client.0.smithi037.stdout:8/402: stat d1/d35/d36/d3d/f2c 0 2024-09-19T06:08:43.396 INFO:tasks.workunit.client.0.smithi037.stdout:1/248: creat d2/d48/f56 x:0 0 0 2024-09-19T06:08:43.397 INFO:tasks.workunit.client.0.smithi037.stdout:3/316: creat d0/d16/d19/d1d/d5e/f74 x:0 0 0 2024-09-19T06:08:43.399 INFO:tasks.workunit.client.0.smithi037.stdout:8/403: creat d1/d35/d36/f8d x:0 0 0 2024-09-19T06:08:43.401 INFO:tasks.workunit.client.0.smithi037.stdout:8/404: creat d1/d62/d59/f8e x:0 0 0 2024-09-19T06:08:43.404 INFO:tasks.workunit.client.0.smithi037.stdout:8/405: mkdir d1/d8f 0 2024-09-19T06:08:43.412 INFO:tasks.workunit.client.0.smithi037.stdout:5/321: dwrite d2/d12/f3a [0,4194304] 0 2024-09-19T06:08:43.412 INFO:tasks.workunit.client.0.smithi037.stdout:5/322: stat d2/d12/f4f 0 2024-09-19T06:08:43.412 INFO:tasks.workunit.client.0.smithi037.stdout:5/323: chown d2/d12/d28/f5b 7403532 1 2024-09-19T06:08:43.413 INFO:tasks.workunit.client.0.smithi037.stdout:5/324: symlink d2/d5c/l6c 0 2024-09-19T06:08:43.413 INFO:tasks.workunit.client.0.smithi037.stdout:5/325: readlink d2/d12/d28/d22/d53/l6b 0 2024-09-19T06:08:43.414 INFO:tasks.workunit.client.0.smithi037.stdout:5/326: mknod d2/d12/d28/d22/c6d 0 2024-09-19T06:08:43.415 INFO:tasks.workunit.client.0.smithi037.stdout:5/327: mknod d2/d12/d28/d22/c6e 0 2024-09-19T06:08:43.415 INFO:tasks.workunit.client.0.smithi037.stdout:5/328: dread - d2/d12/d28/f45 zero size 2024-09-19T06:08:43.415 INFO:tasks.workunit.client.0.smithi037.stdout:5/329: rmdir d2/d12/d24/d58 39 2024-09-19T06:08:43.415 INFO:tasks.workunit.client.0.smithi037.stdout:5/330: write d2/d12/d28/f48 [519634,42664] 0 2024-09-19T06:08:43.416 INFO:tasks.workunit.client.0.smithi037.stdout:3/317: dread d0/d16/d20/f2b [0,4194304] 0 2024-09-19T06:08:43.417 INFO:tasks.workunit.client.0.smithi037.stdout:3/318: creat d0/d16/d19/f75 x:0 0 0 2024-09-19T06:08:43.418 INFO:tasks.workunit.client.0.smithi037.stdout:3/319: creat d0/d16/d20/d51/f76 x:0 0 0 2024-09-19T06:08:43.418 INFO:tasks.workunit.client.0.smithi037.stdout:3/320: write d0/f5a [150944,116433] 0 2024-09-19T06:08:43.423 INFO:tasks.workunit.client.0.smithi037.stdout:8/406: dwrite d1/d35/d36/f6b [0,4194304] 0 2024-09-19T06:08:43.427 INFO:tasks.workunit.client.0.smithi037.stdout:8/407: symlink d1/d35/d36/l90 0 2024-09-19T06:08:43.429 INFO:tasks.workunit.client.0.smithi037.stdout:5/331: write d2/d12/f27 [4054595,129737] 0 2024-09-19T06:08:43.439 INFO:tasks.workunit.client.0.smithi037.stdout:3/321: dwrite d0/d16/d19/f2e [0,4194304] 0 2024-09-19T06:08:43.441 INFO:tasks.workunit.client.0.smithi037.stdout:3/322: rename d0/d16/d20 to d0/d65/d77 0 2024-09-19T06:08:43.441 INFO:tasks.workunit.client.0.smithi037.stdout:3/323: fdatasync d0/f17 0 2024-09-19T06:08:43.442 INFO:tasks.workunit.client.0.smithi037.stdout:8/408: dread d1/d35/f56 [0,4194304] 0 2024-09-19T06:08:43.446 INFO:tasks.workunit.client.0.smithi037.stdout:5/332: dread d2/f23 [0,4194304] 0 2024-09-19T06:08:43.446 INFO:tasks.workunit.client.0.smithi037.stdout:5/333: chown d2/c47 0 1 2024-09-19T06:08:43.447 INFO:tasks.workunit.client.0.smithi037.stdout:5/334: symlink d2/d12/d28/d22/d35/l6f 0 2024-09-19T06:08:43.448 INFO:tasks.workunit.client.0.smithi037.stdout:5/335: creat d2/d12/d24/f70 x:0 0 0 2024-09-19T06:08:43.448 INFO:tasks.workunit.client.0.smithi037.stdout:5/336: write d2/d12/f27 [3784813,129520] 0 2024-09-19T06:08:43.449 INFO:tasks.workunit.client.0.smithi037.stdout:8/409: write d1/d35/d36/d3d/f45 [140595,130500] 0 2024-09-19T06:08:43.451 INFO:tasks.workunit.client.0.smithi037.stdout:8/410: rmdir d1/d35/d36/d3d 39 2024-09-19T06:08:43.451 INFO:tasks.workunit.client.0.smithi037.stdout:8/411: stat d1/d62/d59/d5d/f8a 0 2024-09-19T06:08:43.451 INFO:tasks.workunit.client.0.smithi037.stdout:8/412: write d1/f6c [275693,45377] 0 2024-09-19T06:08:43.462 INFO:tasks.workunit.client.0.smithi037.stdout:3/324: dwrite d0/d65/d77/f53 [0,4194304] 0 2024-09-19T06:08:43.472 INFO:tasks.workunit.client.0.smithi037.stdout:5/337: dwrite d2/d10/f21 [4194304,4194304] 0 2024-09-19T06:08:43.473 INFO:tasks.workunit.client.0.smithi037.stdout:5/338: unlink d2/f2f 0 2024-09-19T06:08:43.476 INFO:tasks.workunit.client.0.smithi037.stdout:2/400: sync 2024-09-19T06:08:43.476 INFO:tasks.workunit.client.0.smithi037.stdout:2/401: chown d1/d16/d4a/f8d 214 1 2024-09-19T06:08:43.478 INFO:tasks.workunit.client.0.smithi037.stdout:2/402: symlink d1/da/dc/d21/d55/l92 0 2024-09-19T06:08:43.479 INFO:tasks.workunit.client.0.smithi037.stdout:2/403: mknod d1/da/dc/d21/d51/c93 0 2024-09-19T06:08:43.480 INFO:tasks.workunit.client.0.smithi037.stdout:2/404: read d1/da/dc/d21/d55/f86 [237626,41089] 0 2024-09-19T06:08:43.480 INFO:tasks.workunit.client.0.smithi037.stdout:2/405: dread - d1/da/d42/f56 zero size 2024-09-19T06:08:43.483 INFO:tasks.workunit.client.0.smithi037.stdout:3/325: write d0/d65/d77/d45/d55/f40 [2074778,82626] 0 2024-09-19T06:08:43.483 INFO:tasks.workunit.client.0.smithi037.stdout:8/413: dwrite d1/d62/d59/f5c [0,4194304] 0 2024-09-19T06:08:43.486 INFO:tasks.workunit.client.0.smithi037.stdout:8/414: rename d1/d35/d36 to d1/d61/d7e/d8b/d91 0 2024-09-19T06:08:43.486 INFO:tasks.workunit.client.0.smithi037.stdout:3/326: creat d0/d5f/d70/f78 x:0 0 0 2024-09-19T06:08:43.488 INFO:tasks.workunit.client.0.smithi037.stdout:8/415: truncate d1/f6 1536876 0 2024-09-19T06:08:43.489 INFO:tasks.workunit.client.0.smithi037.stdout:3/327: symlink d0/d16/d19/d1d/d5e/d61/l79 0 2024-09-19T06:08:43.489 INFO:tasks.workunit.client.0.smithi037.stdout:3/328: write d0/d16/f60 [1385112,47799] 0 2024-09-19T06:08:43.490 INFO:tasks.workunit.client.0.smithi037.stdout:8/416: link d1/d61/l64 d1/d61/l92 0 2024-09-19T06:08:43.490 INFO:tasks.workunit.client.0.smithi037.stdout:8/417: fsync d1/d61/d7e/d8b/d91/d3d/f22 0 2024-09-19T06:08:43.491 INFO:tasks.workunit.client.0.smithi037.stdout:8/418: symlink d1/d61/l93 0 2024-09-19T06:08:43.502 INFO:tasks.workunit.client.0.smithi037.stdout:2/406: dwrite d1/da/dc/d21/d7d/f34 [4194304,4194304] 0 2024-09-19T06:08:43.502 INFO:tasks.workunit.client.0.smithi037.stdout:2/407: chown d1/d33/d4c/l71 145699864 1 2024-09-19T06:08:43.504 INFO:tasks.workunit.client.0.smithi037.stdout:2/408: symlink d1/d16/d62/l94 0 2024-09-19T06:08:43.504 INFO:tasks.workunit.client.0.smithi037.stdout:2/409: fsync d1/da/dc/d21/f3c 0 2024-09-19T06:08:43.504 INFO:tasks.workunit.client.0.smithi037.stdout:2/410: dread - d1/d33/d4c/f87 zero size 2024-09-19T06:08:43.517 INFO:tasks.workunit.client.0.smithi037.stdout:8/419: dread d1/d61/d7e/d8b/d91/f3b [0,4194304] 0 2024-09-19T06:08:43.517 INFO:tasks.workunit.client.0.smithi037.stdout:8/420: dread - d1/d61/d7e/d8b/d91/f50 zero size 2024-09-19T06:08:43.517 INFO:tasks.workunit.client.0.smithi037.stdout:8/421: mknod d1/d62/c94 0 2024-09-19T06:08:43.518 INFO:tasks.workunit.client.0.smithi037.stdout:8/422: write d1/d61/d7e/d8b/d91/d3d/f2f [5049404,43196] 0 2024-09-19T06:08:43.520 INFO:tasks.workunit.client.0.smithi037.stdout:8/423: creat d1/d35/f95 x:0 0 0 2024-09-19T06:08:43.521 INFO:tasks.workunit.client.0.smithi037.stdout:8/424: mkdir d1/d61/d7e/d8b/d91/d3d/d96 0 2024-09-19T06:08:43.521 INFO:tasks.workunit.client.0.smithi037.stdout:8/425: chown d1/d6a/c79 8343 1 2024-09-19T06:08:43.528 INFO:tasks.workunit.client.0.smithi037.stdout:2/411: dwrite d1/d6/f6c [0,4194304] 0 2024-09-19T06:08:43.531 INFO:tasks.workunit.client.0.smithi037.stdout:2/412: mkdir d1/da/d95 0 2024-09-19T06:08:43.531 INFO:tasks.workunit.client.0.smithi037.stdout:2/413: mkdir d1/d16/d96 0 2024-09-19T06:08:43.532 INFO:tasks.workunit.client.0.smithi037.stdout:2/414: write d1/da/d42/f56 [306144,75877] 0 2024-09-19T06:08:43.542 INFO:tasks.workunit.client.0.smithi037.stdout:8/426: dwrite d1/d61/d7e/d8b/d91/d3d/f39 [0,4194304] 0 2024-09-19T06:08:43.554 INFO:tasks.workunit.client.0.smithi037.stdout:7/234: sync 2024-09-19T06:08:43.554 INFO:tasks.workunit.client.0.smithi037.stdout:4/284: sync 2024-09-19T06:08:43.554 INFO:tasks.workunit.client.0.smithi037.stdout:6/255: sync 2024-09-19T06:08:43.554 INFO:tasks.workunit.client.0.smithi037.stdout:0/357: sync 2024-09-19T06:08:43.556 INFO:tasks.workunit.client.0.smithi037.stdout:4/285: unlink d0/d6/f3a 0 2024-09-19T06:08:43.557 INFO:tasks.workunit.client.0.smithi037.stdout:6/256: getdents d9/dd/d1c/d2d/d2f 0 2024-09-19T06:08:43.557 INFO:tasks.workunit.client.0.smithi037.stdout:6/257: chown d9/dd/d1c/d2d/f36 2 1 2024-09-19T06:08:43.557 INFO:tasks.workunit.client.0.smithi037.stdout:6/258: read - d9/d16/f3c zero size 2024-09-19T06:08:43.557 INFO:tasks.workunit.client.0.smithi037.stdout:6/259: chown d9/f18 0 1 2024-09-19T06:08:43.558 INFO:tasks.workunit.client.0.smithi037.stdout:2/415: dwrite d1/da/d42/f50 [0,4194304] 0 2024-09-19T06:08:43.558 INFO:tasks.workunit.client.0.smithi037.stdout:0/358: creat d5/d20/d34/f74 x:0 0 0 2024-09-19T06:08:43.558 INFO:tasks.workunit.client.0.smithi037.stdout:0/359: chown d5/d20/d34/c67 27272491 1 2024-09-19T06:08:43.558 INFO:tasks.workunit.client.0.smithi037.stdout:4/286: rmdir d0/d6/d1b/d20/d48 39 2024-09-19T06:08:43.559 INFO:tasks.workunit.client.0.smithi037.stdout:6/260: creat d9/d16/f4a x:0 0 0 2024-09-19T06:08:43.561 INFO:tasks.workunit.client.0.smithi037.stdout:2/416: link d1/da/f14 d1/da/d95/f97 0 2024-09-19T06:08:43.561 INFO:tasks.workunit.client.0.smithi037.stdout:2/417: fsync d1/d16/f40 0 2024-09-19T06:08:43.561 INFO:tasks.workunit.client.0.smithi037.stdout:2/418: chown d1/da/dc/d21/d7d/c60 47363761 1 2024-09-19T06:08:43.561 INFO:tasks.workunit.client.0.smithi037.stdout:6/261: truncate d9/dd/f23 2592926 0 2024-09-19T06:08:43.562 INFO:tasks.workunit.client.0.smithi037.stdout:2/419: unlink d1/l9 0 2024-09-19T06:08:43.563 INFO:tasks.workunit.client.0.smithi037.stdout:8/427: dwrite d1/d6a/f7a [0,4194304] 0 2024-09-19T06:08:43.563 INFO:tasks.workunit.client.0.smithi037.stdout:8/428: readlink d1/l7d 0 2024-09-19T06:08:43.563 INFO:tasks.workunit.client.0.smithi037.stdout:6/262: creat d9/d16/f4b x:0 0 0 2024-09-19T06:08:43.565 INFO:tasks.workunit.client.0.smithi037.stdout:2/420: mknod d1/d16/d96/c98 0 2024-09-19T06:08:43.570 INFO:tasks.workunit.client.0.smithi037.stdout:8/429: link d1/d62/d59/f8e d1/f97 0 2024-09-19T06:08:43.570 INFO:tasks.workunit.client.0.smithi037.stdout:8/430: truncate d1/d61/d7e/d8b/d91/d3d/f23 1342059 0 2024-09-19T06:08:43.570 INFO:tasks.workunit.client.0.smithi037.stdout:8/431: readlink d1/d61/d7e/d8b/d91/d3d/l1b 0 2024-09-19T06:08:43.570 INFO:tasks.workunit.client.0.smithi037.stdout:8/432: write d1/d62/d59/d5d/f7c [391338,58118] 0 2024-09-19T06:08:43.570 INFO:tasks.workunit.client.0.smithi037.stdout:6/263: rmdir d9/d16 39 2024-09-19T06:08:43.571 INFO:tasks.workunit.client.0.smithi037.stdout:4/287: dread d0/d2/d37/f49 [0,4194304] 0 2024-09-19T06:08:43.572 INFO:tasks.workunit.client.0.smithi037.stdout:2/421: rename d1/da/c46 to d1/d16/d96/c99 0 2024-09-19T06:08:43.574 INFO:tasks.workunit.client.0.smithi037.stdout:4/288: link d0/d6/d45/f5b d0/d6/d1b/d20/f62 0 2024-09-19T06:08:43.575 INFO:tasks.workunit.client.0.smithi037.stdout:2/422: stat d1/d6/f24 0 2024-09-19T06:08:43.578 INFO:tasks.workunit.client.0.smithi037.stdout:4/289: link d0/d6/d1b/f3f d0/d2/d2e/d36/f63 0 2024-09-19T06:08:43.578 INFO:tasks.workunit.client.0.smithi037.stdout:4/290: dread - d0/d2/d2e/f43 zero size 2024-09-19T06:08:43.579 INFO:tasks.workunit.client.0.smithi037.stdout:2/423: rmdir d1/da/dc/d21/d51 39 2024-09-19T06:08:43.581 INFO:tasks.workunit.client.0.smithi037.stdout:4/291: unlink d0/d6/d1b/d20/d48/l52 0 2024-09-19T06:08:43.581 INFO:tasks.workunit.client.0.smithi037.stdout:7/235: dwrite d6/dc/f14 [0,4194304] 0 2024-09-19T06:08:43.582 INFO:tasks.workunit.client.0.smithi037.stdout:2/424: mknod d1/d16/d96/c9a 0 2024-09-19T06:08:43.582 INFO:tasks.workunit.client.0.smithi037.stdout:2/425: chown d1/da/dc/d21/d55/c5e 195181452 1 2024-09-19T06:08:43.582 INFO:tasks.workunit.client.0.smithi037.stdout:4/292: dread d0/d6/d1b/d20/f40 [0,4194304] 0 2024-09-19T06:08:43.583 INFO:tasks.workunit.client.0.smithi037.stdout:0/360: dwrite d5/d8/d11/d32/f43 [4194304,4194304] 0 2024-09-19T06:08:43.584 INFO:tasks.workunit.client.0.smithi037.stdout:2/426: rename d1/d33/d4c/f8f to d1/d16/d96/f9b 0 2024-09-19T06:08:43.584 INFO:tasks.workunit.client.0.smithi037.stdout:0/361: rename d5 to d5/d20/d75 22 2024-09-19T06:08:43.586 INFO:tasks.workunit.client.0.smithi037.stdout:4/293: mkdir d0/d6/d1b/d20/d4d/d64 0 2024-09-19T06:08:43.593 INFO:tasks.workunit.client.0.smithi037.stdout:4/294: mkdir d0/d6/d1b/d20/d4d/d65 0 2024-09-19T06:08:43.594 INFO:tasks.workunit.client.0.smithi037.stdout:4/295: fdatasync d0/d2/f19 0 2024-09-19T06:08:43.595 INFO:tasks.workunit.client.0.smithi037.stdout:4/296: symlink d0/d6/d1b/d20/d4d/d65/l66 0 2024-09-19T06:08:43.598 INFO:tasks.workunit.client.0.smithi037.stdout:8/433: dread d1/d62/d59/f5c [0,4194304] 0 2024-09-19T06:08:43.598 INFO:tasks.workunit.client.0.smithi037.stdout:6/264: dwrite d9/dd/f32 [0,4194304] 0 2024-09-19T06:08:43.601 INFO:tasks.workunit.client.0.smithi037.stdout:6/265: creat d9/f4c x:0 0 0 2024-09-19T06:08:43.601 INFO:tasks.workunit.client.0.smithi037.stdout:6/266: fsync d9/dd/d20/f27 0 2024-09-19T06:08:43.602 INFO:tasks.workunit.client.0.smithi037.stdout:6/267: write d9/d16/f4b [1023779,68998] 0 2024-09-19T06:08:43.602 INFO:tasks.workunit.client.0.smithi037.stdout:6/268: rmdir d9/dd 39 2024-09-19T06:08:43.604 INFO:tasks.workunit.client.0.smithi037.stdout:6/269: symlink d9/dd/d20/l4d 0 2024-09-19T06:08:43.605 INFO:tasks.workunit.client.0.smithi037.stdout:6/270: getdents d9/dd/d1c/d2d 0 2024-09-19T06:08:43.605 INFO:tasks.workunit.client.0.smithi037.stdout:6/271: write d9/dd/d1c/d2d/d2f/f35 [587832,45374] 0 2024-09-19T06:08:43.606 INFO:tasks.workunit.client.0.smithi037.stdout:9/459: sync 2024-09-19T06:08:43.608 INFO:tasks.workunit.client.0.smithi037.stdout:6/272: rmdir d9/dd 39 2024-09-19T06:08:43.609 INFO:tasks.workunit.client.0.smithi037.stdout:4/297: dread d0/d2/f2c [0,4194304] 0 2024-09-19T06:08:43.612 INFO:tasks.workunit.client.0.smithi037.stdout:7/236: dwrite d6/dc/d22/f1a [0,4194304] 0 2024-09-19T06:08:43.612 INFO:tasks.workunit.client.0.smithi037.stdout:7/237: chown d6/c17 2089061 1 2024-09-19T06:08:43.613 INFO:tasks.workunit.client.0.smithi037.stdout:6/273: rename d9/dd/d1c/d2d to d9/dd/d1c/d4e 0 2024-09-19T06:08:43.615 INFO:tasks.workunit.client.0.smithi037.stdout:4/298: creat d0/d6/f67 x:0 0 0 2024-09-19T06:08:43.615 INFO:tasks.workunit.client.0.smithi037.stdout:4/299: fsync d0/f44 0 2024-09-19T06:08:43.615 INFO:tasks.workunit.client.0.smithi037.stdout:0/362: dwrite d5/d8/d11/d15/d21/f49 [0,4194304] 0 2024-09-19T06:08:43.615 INFO:tasks.workunit.client.0.smithi037.stdout:0/363: fsync d5/d8/d11/d15/d21/f49 0 2024-09-19T06:08:43.615 INFO:tasks.workunit.client.0.smithi037.stdout:0/364: readlink d5/l19 0 2024-09-19T06:08:43.616 INFO:tasks.workunit.client.0.smithi037.stdout:7/238: unlink d6/d20/f35 0 2024-09-19T06:08:43.616 INFO:tasks.workunit.client.0.smithi037.stdout:8/434: dread d1/f1e [0,4194304] 0 2024-09-19T06:08:43.617 INFO:tasks.workunit.client.0.smithi037.stdout:6/274: rename d9/dd/d2b/d42/l43 to d9/dd/l4f 0 2024-09-19T06:08:43.619 INFO:tasks.workunit.client.0.smithi037.stdout:4/300: creat d0/d6/d1b/f68 x:0 0 0 2024-09-19T06:08:43.620 INFO:tasks.workunit.client.0.smithi037.stdout:0/365: creat d5/d8/f76 x:0 0 0 2024-09-19T06:08:43.621 INFO:tasks.workunit.client.0.smithi037.stdout:7/239: creat d6/dc/df/f41 x:0 0 0 2024-09-19T06:08:43.621 INFO:tasks.workunit.client.0.smithi037.stdout:2/427: dwrite d1/d16/d4a/f75 [0,4194304] 0 2024-09-19T06:08:43.623 INFO:tasks.workunit.client.0.smithi037.stdout:8/435: rmdir d1/d61/d7e/d8b/d91/d3d/d96 0 2024-09-19T06:08:43.623 INFO:tasks.workunit.client.0.smithi037.stdout:8/436: write d1/d62/d59/d5d/f7c [870936,118927] 0 2024-09-19T06:08:43.624 INFO:tasks.workunit.client.0.smithi037.stdout:4/301: symlink d0/d6/d1b/d20/d48/d59/l69 0 2024-09-19T06:08:43.624 INFO:tasks.workunit.client.0.smithi037.stdout:4/302: fsync d0/f41 0 2024-09-19T06:08:43.624 INFO:tasks.workunit.client.0.smithi037.stdout:4/303: stat d0/d2/f2c 0 2024-09-19T06:08:43.625 INFO:tasks.workunit.client.0.smithi037.stdout:0/366: symlink d5/d18/l77 0 2024-09-19T06:08:43.633 INFO:tasks.workunit.client.0.smithi037.stdout:8/437: creat d1/d61/d7e/d8b/f98 x:0 0 0 2024-09-19T06:08:43.633 INFO:tasks.workunit.client.0.smithi037.stdout:8/438: write d1/f97 [56576,89859] 0 2024-09-19T06:08:43.634 INFO:tasks.workunit.client.0.smithi037.stdout:9/460: dwrite da/dd/d1b/d62/fa1 [0,4194304] 0 2024-09-19T06:08:43.634 INFO:tasks.workunit.client.0.smithi037.stdout:4/304: link d0/d6/d1b/d20/f62 d0/d2/d37/f6a 0 2024-09-19T06:08:43.635 INFO:tasks.workunit.client.0.smithi037.stdout:0/367: rename d5/d8/d11/d15/f1e to d5/d8/d11/f78 0 2024-09-19T06:08:43.637 INFO:tasks.workunit.client.0.smithi037.stdout:9/461: creat da/fa5 x:0 0 0 2024-09-19T06:08:43.638 INFO:tasks.workunit.client.0.smithi037.stdout:9/462: chown da/dd/d1b/d23/d6a/d82/l76 61358 1 2024-09-19T06:08:43.638 INFO:tasks.workunit.client.0.smithi037.stdout:0/368: mkdir d5/d8/d79 0 2024-09-19T06:08:43.640 INFO:tasks.workunit.client.0.smithi037.stdout:9/463: creat da/dd/d1b/d56/fa6 x:0 0 0 2024-09-19T06:08:43.640 INFO:tasks.workunit.client.0.smithi037.stdout:9/464: truncate da/dd/d1b/d2f/f70 4839150 0 2024-09-19T06:08:43.641 INFO:tasks.workunit.client.0.smithi037.stdout:0/369: symlink d5/d18/d68/l7a 0 2024-09-19T06:08:43.641 INFO:tasks.workunit.client.0.smithi037.stdout:0/370: stat d5/d18/l77 0 2024-09-19T06:08:43.642 INFO:tasks.workunit.client.0.smithi037.stdout:0/371: link d5/l2a d5/d8/d11/d15/d21/d4e/l7b 0 2024-09-19T06:08:43.643 INFO:tasks.workunit.client.0.smithi037.stdout:4/305: dread d0/f41 [0,4194304] 0 2024-09-19T06:08:43.643 INFO:tasks.workunit.client.0.smithi037.stdout:4/306: fdatasync d0/d6/d1b/d20/f62 0 2024-09-19T06:08:43.643 INFO:tasks.workunit.client.0.smithi037.stdout:4/307: chown d0/d6/d1b/l2a 15409 1 2024-09-19T06:08:43.643 INFO:tasks.workunit.client.0.smithi037.stdout:4/308: readlink d0/d2/d2e/l61 0 2024-09-19T06:08:43.643 INFO:tasks.workunit.client.0.smithi037.stdout:4/309: fsync d0/d2/d37/f49 0 2024-09-19T06:08:43.645 INFO:tasks.workunit.client.0.smithi037.stdout:4/310: unlink d0/d2/d2e/l60 0 2024-09-19T06:08:43.645 INFO:tasks.workunit.client.0.smithi037.stdout:4/311: getdents d0/d6/d1b/d5d 0 2024-09-19T06:08:43.645 INFO:tasks.workunit.client.0.smithi037.stdout:4/312: read - d0/d2/d2e/f43 zero size 2024-09-19T06:08:43.646 INFO:tasks.workunit.client.0.smithi037.stdout:4/313: unlink d0/d2/d2e/d36/f2f 0 2024-09-19T06:08:43.647 INFO:tasks.workunit.client.0.smithi037.stdout:4/314: truncate d0/d6/d1b/f3f 739388 0 2024-09-19T06:08:43.647 INFO:tasks.workunit.client.0.smithi037.stdout:4/315: fdatasync d0/d6/f67 0 2024-09-19T06:08:43.648 INFO:tasks.workunit.client.0.smithi037.stdout:4/316: fdatasync d0/d2/f2c 0 2024-09-19T06:08:43.648 INFO:tasks.workunit.client.0.smithi037.stdout:4/317: truncate d0/f16 1324268 0 2024-09-19T06:08:43.648 INFO:tasks.workunit.client.0.smithi037.stdout:4/318: dread - d0/d2/f5a zero size 2024-09-19T06:08:43.649 INFO:tasks.workunit.client.0.smithi037.stdout:4/319: symlink d0/d2/d2e/d36/l6b 0 2024-09-19T06:08:43.658 INFO:tasks.workunit.client.0.smithi037.stdout:9/465: write da/dd/d1b/d2f/f70 [2312414,8706] 0 2024-09-19T06:08:43.659 INFO:tasks.workunit.client.0.smithi037.stdout:7/240: dwrite d6/dc/f25 [0,4194304] 0 2024-09-19T06:08:43.659 INFO:tasks.workunit.client.0.smithi037.stdout:7/241: chown d6/dc/df/f13 25062334 1 2024-09-19T06:08:43.659 INFO:tasks.workunit.client.0.smithi037.stdout:7/242: read d6/dc/fd [734025,36808] 0 2024-09-19T06:08:43.660 INFO:tasks.workunit.client.0.smithi037.stdout:9/466: symlink da/dd/d31/la7 0 2024-09-19T06:08:43.660 INFO:tasks.workunit.client.0.smithi037.stdout:1/249: sync 2024-09-19T06:08:43.660 INFO:tasks.workunit.client.0.smithi037.stdout:9/467: dread - da/d4d/f68 zero size 2024-09-19T06:08:43.660 INFO:tasks.workunit.client.0.smithi037.stdout:3/329: sync 2024-09-19T06:08:43.660 INFO:tasks.workunit.client.0.smithi037.stdout:3/330: chown d0/l3f 10129696 1 2024-09-19T06:08:43.660 INFO:tasks.workunit.client.0.smithi037.stdout:3/331: chown d0/d43/d23 5290 1 2024-09-19T06:08:43.660 INFO:tasks.workunit.client.0.smithi037.stdout:3/332: stat d0/d65/d77/d45/d55/l4e 0 2024-09-19T06:08:43.660 INFO:tasks.workunit.client.0.smithi037.stdout:5/339: sync 2024-09-19T06:08:43.661 INFO:tasks.workunit.client.0.smithi037.stdout:6/275: dwrite d9/d16/f4b [0,4194304] 0 2024-09-19T06:08:43.669 INFO:tasks.workunit.client.0.smithi037.stdout:1/250: mknod d2/d12/d17/c57 0 2024-09-19T06:08:43.669 INFO:tasks.workunit.client.0.smithi037.stdout:1/251: fdatasync d2/d12/d1d/f30 0 2024-09-19T06:08:43.669 INFO:tasks.workunit.client.0.smithi037.stdout:0/372: dwrite d5/d8/d11/f16 [0,4194304] 0 2024-09-19T06:08:43.670 INFO:tasks.workunit.client.0.smithi037.stdout:8/439: dread d1/d61/d7e/d8b/d91/d3d/f22 [0,4194304] 0 2024-09-19T06:08:43.671 INFO:tasks.workunit.client.0.smithi037.stdout:3/333: rename d0/d65 to d0/d43/d23/d7a 0 2024-09-19T06:08:43.674 INFO:tasks.workunit.client.0.smithi037.stdout:5/340: rename d2/c18 to d2/d5c/c71 0 2024-09-19T06:08:43.676 INFO:tasks.workunit.client.0.smithi037.stdout:1/252: link d2/f3a d2/d12/d15/f58 0 2024-09-19T06:08:43.676 INFO:tasks.workunit.client.0.smithi037.stdout:1/253: readlink d2/l7 0 2024-09-19T06:08:43.676 INFO:tasks.workunit.client.0.smithi037.stdout:1/254: write d2/d12/d15/d34/f3b [174317,87391] 0 2024-09-19T06:08:43.676 INFO:tasks.workunit.client.0.smithi037.stdout:1/255: read - d2/d12/d15/f32 zero size 2024-09-19T06:08:43.677 INFO:tasks.workunit.client.0.smithi037.stdout:8/440: rename d1/d61/d7e/d8b/d91/d3d/f45 to d1/d61/d7b/f99 0 2024-09-19T06:08:43.677 INFO:tasks.workunit.client.0.smithi037.stdout:8/441: chown d1/d61/f77 25 1 2024-09-19T06:08:43.679 INFO:tasks.workunit.client.0.smithi037.stdout:5/341: unlink d2/d10/f3b 0 2024-09-19T06:08:43.682 INFO:tasks.workunit.client.0.smithi037.stdout:8/442: link d1/d62/l70 d1/d62/l9a 0 2024-09-19T06:08:43.683 INFO:tasks.workunit.client.0.smithi037.stdout:8/443: read - d1/f54 zero size 2024-09-19T06:08:43.685 INFO:tasks.workunit.client.0.smithi037.stdout:8/444: mkdir d1/d62/d9b 0 2024-09-19T06:08:43.685 INFO:tasks.workunit.client.0.smithi037.stdout:8/445: chown d1/d61/d7e/l83 2143644130 1 2024-09-19T06:08:43.691 INFO:tasks.workunit.client.0.smithi037.stdout:1/256: dread d2/fa [0,4194304] 0 2024-09-19T06:08:43.691 INFO:tasks.workunit.client.0.smithi037.stdout:8/446: truncate d1/f1e 823828 0 2024-09-19T06:08:43.695 INFO:tasks.workunit.client.0.smithi037.stdout:1/257: creat d2/d12/d1e/d2a/f59 x:0 0 0 2024-09-19T06:08:43.695 INFO:tasks.workunit.client.0.smithi037.stdout:6/276: write d9/dd/f14 [1033844,41656] 0 2024-09-19T06:08:43.695 INFO:tasks.workunit.client.0.smithi037.stdout:7/243: dwrite d6/dc/df/f13 [0,4194304] 0 2024-09-19T06:08:43.696 INFO:tasks.workunit.client.0.smithi037.stdout:9/468: dwrite da/dd/d1b/f3d [0,4194304] 0 2024-09-19T06:08:43.698 INFO:tasks.workunit.client.0.smithi037.stdout:8/447: dread d1/d62/d59/f8e [0,4194304] 0 2024-09-19T06:08:43.701 INFO:tasks.workunit.client.0.smithi037.stdout:1/258: creat d2/d12/d1e/d2d/f5a x:0 0 0 2024-09-19T06:08:43.703 INFO:tasks.workunit.client.0.smithi037.stdout:9/469: unlink da/dd/d1b/d2f/l47 0 2024-09-19T06:08:43.704 INFO:tasks.workunit.client.0.smithi037.stdout:8/448: symlink d1/d61/d7e/d8b/d91/l9c 0 2024-09-19T06:08:43.705 INFO:tasks.workunit.client.0.smithi037.stdout:1/259: mknod d2/d12/d1e/d2d/c5b 0 2024-09-19T06:08:43.705 INFO:tasks.workunit.client.0.smithi037.stdout:1/260: truncate d2/f9 908580 0 2024-09-19T06:08:43.705 INFO:tasks.workunit.client.0.smithi037.stdout:1/261: fdatasync d2/d12/d15/f27 0 2024-09-19T06:08:43.705 INFO:tasks.workunit.client.0.smithi037.stdout:0/373: dwrite d5/d8/d11/d15/f31 [0,4194304] 0 2024-09-19T06:08:43.706 INFO:tasks.workunit.client.0.smithi037.stdout:3/334: dwrite d0/ff [4194304,4194304] 0 2024-09-19T06:08:43.707 INFO:tasks.workunit.client.0.smithi037.stdout:9/470: rename da/dd/d1b/d2f/f44 to da/dd/d1b/d62/fa8 0 2024-09-19T06:08:43.707 INFO:tasks.workunit.client.0.smithi037.stdout:9/471: dread - da/dd/d1b/d56/f83 zero size 2024-09-19T06:08:43.707 INFO:tasks.workunit.client.0.smithi037.stdout:8/449: mknod d1/d8f/c9d 0 2024-09-19T06:08:43.708 INFO:tasks.workunit.client.0.smithi037.stdout:0/374: creat d5/d20/f7c x:0 0 0 2024-09-19T06:08:43.709 INFO:tasks.workunit.client.0.smithi037.stdout:3/335: rmdir d0/d43/d23 39 2024-09-19T06:08:43.709 INFO:tasks.workunit.client.0.smithi037.stdout:3/336: stat d0/d43/d26 0 2024-09-19T06:08:43.709 INFO:tasks.workunit.client.0.smithi037.stdout:5/342: dwrite d2/d12/d28/f45 [0,4194304] 0 2024-09-19T06:08:43.709 INFO:tasks.workunit.client.0.smithi037.stdout:5/343: dread - d2/d12/f5d zero size 2024-09-19T06:08:43.710 INFO:tasks.workunit.client.0.smithi037.stdout:1/262: mkdir d2/d12/d15/d5c 0 2024-09-19T06:08:43.711 INFO:tasks.workunit.client.0.smithi037.stdout:1/263: chown d2/d12/d1e/d2a/f59 147365800 1 2024-09-19T06:08:43.712 INFO:tasks.workunit.client.0.smithi037.stdout:9/472: dread da/dd/d1b/d2f/d38/f55 [0,4194304] 0 2024-09-19T06:08:43.712 INFO:tasks.workunit.client.0.smithi037.stdout:9/473: write da/dd/d1b/d23/f9c [5487692,63200] 0 2024-09-19T06:08:43.712 INFO:tasks.workunit.client.0.smithi037.stdout:9/474: readlink da/dd/d31/la7 0 2024-09-19T06:08:43.712 INFO:tasks.workunit.client.0.smithi037.stdout:9/475: dread - da/dd/d1b/d56/f83 zero size 2024-09-19T06:08:43.713 INFO:tasks.workunit.client.0.smithi037.stdout:0/375: symlink d5/d8/d22/l7d 0 2024-09-19T06:08:43.714 INFO:tasks.workunit.client.0.smithi037.stdout:5/344: mknod d2/d12/d24/c72 0 2024-09-19T06:08:43.715 INFO:tasks.workunit.client.0.smithi037.stdout:9/476: rename da/dd/l2e to da/dd/d1b/d23/d6a/d82/la9 0 2024-09-19T06:08:43.715 INFO:tasks.workunit.client.0.smithi037.stdout:9/477: readlink da/dd/d1b/d62/l71 0 2024-09-19T06:08:43.717 INFO:tasks.workunit.client.0.smithi037.stdout:9/478: mknod da/dd/d1b/d23/d6a/d8f/da4/caa 0 2024-09-19T06:08:43.720 INFO:tasks.workunit.client.0.smithi037.stdout:1/264: dread d2/f3 [0,4194304] 0 2024-09-19T06:08:43.722 INFO:tasks.workunit.client.0.smithi037.stdout:1/265: unlink d2/f16 0 2024-09-19T06:08:43.722 INFO:tasks.workunit.client.0.smithi037.stdout:1/266: fdatasync d2/d12/d15/d34/f52 0 2024-09-19T06:08:43.723 INFO:tasks.workunit.client.0.smithi037.stdout:1/267: creat d2/d12/d1e/f5d x:0 0 0 2024-09-19T06:08:43.724 INFO:tasks.workunit.client.0.smithi037.stdout:1/268: symlink d2/d12/d15/d34/l5e 0 2024-09-19T06:08:43.725 INFO:tasks.workunit.client.0.smithi037.stdout:3/337: write d0/d43/f4c [3986801,28093] 0 2024-09-19T06:08:43.726 INFO:tasks.workunit.client.0.smithi037.stdout:6/277: dread d9/d16/f4b [0,4194304] 0 2024-09-19T06:08:43.726 INFO:tasks.workunit.client.0.smithi037.stdout:1/269: unlink d2/d12/d15/d34/f3b 0 2024-09-19T06:08:43.726 INFO:tasks.workunit.client.0.smithi037.stdout:1/270: write d2/fa [686509,17410] 0 2024-09-19T06:08:43.726 INFO:tasks.workunit.client.0.smithi037.stdout:1/271: write d2/d12/d15/f58 [269297,82747] 0 2024-09-19T06:08:43.727 INFO:tasks.workunit.client.0.smithi037.stdout:6/278: creat d9/dd/d2b/f50 x:0 0 0 2024-09-19T06:08:43.727 INFO:tasks.workunit.client.0.smithi037.stdout:6/279: chown d9/dd/d1c/d4e 224778 1 2024-09-19T06:08:43.728 INFO:tasks.workunit.client.0.smithi037.stdout:1/272: symlink d2/d12/d1e/d2a/l5f 0 2024-09-19T06:08:43.729 INFO:tasks.workunit.client.0.smithi037.stdout:6/280: creat d9/dd/d1c/d4e/d2f/f51 x:0 0 0 2024-09-19T06:08:43.732 INFO:tasks.workunit.client.0.smithi037.stdout:0/376: dread d5/d8/d11/d32/f43 [4194304,4194304] 0 2024-09-19T06:08:43.733 INFO:tasks.workunit.client.0.smithi037.stdout:0/377: symlink d5/d17/l7e 0 2024-09-19T06:08:43.733 INFO:tasks.workunit.client.0.smithi037.stdout:0/378: dread - d5/d8/f6c zero size 2024-09-19T06:08:43.734 INFO:tasks.workunit.client.0.smithi037.stdout:8/450: dread d1/d61/d7e/d8b/d91/d3d/f26 [0,4194304] 0 2024-09-19T06:08:43.734 INFO:tasks.workunit.client.0.smithi037.stdout:8/451: fsync d1/d61/d7e/d8b/d91/f76 0 2024-09-19T06:08:43.734 INFO:tasks.workunit.client.0.smithi037.stdout:8/452: fdatasync d1/d61/d7e/d8b/d91/d3d/f2c 0 2024-09-19T06:08:43.734 INFO:tasks.workunit.client.0.smithi037.stdout:8/453: truncate d1/d6a/f7a 1363342 0 2024-09-19T06:08:43.734 INFO:tasks.workunit.client.0.smithi037.stdout:8/454: dread - d1/d62/d59/d5d/f81 zero size 2024-09-19T06:08:43.735 INFO:tasks.workunit.client.0.smithi037.stdout:8/455: truncate d1/d61/d7e/d8b/d91/d3d/f14 1020693 0 2024-09-19T06:08:43.736 INFO:tasks.workunit.client.0.smithi037.stdout:7/244: read d6/dc/f1b [4159059,8781] 0 2024-09-19T06:08:43.737 INFO:tasks.workunit.client.0.smithi037.stdout:8/456: creat d1/d62/d59/f9e x:0 0 0 2024-09-19T06:08:43.737 INFO:tasks.workunit.client.0.smithi037.stdout:8/457: stat d1/d61/d7e/d8b/d91/d3d/l53 0 2024-09-19T06:08:43.737 INFO:tasks.workunit.client.0.smithi037.stdout:8/458: chown d1/d61/d7e/d8b/d91/d3d/l53 16718464 1 2024-09-19T06:08:43.737 INFO:tasks.workunit.client.0.smithi037.stdout:8/459: chown d1/d62 5 1 2024-09-19T06:08:43.739 INFO:tasks.workunit.client.0.smithi037.stdout:7/245: symlink d6/d20/d2c/l42 0 2024-09-19T06:08:43.741 INFO:tasks.workunit.client.0.smithi037.stdout:7/246: rename d6/l11 to d6/l43 0 2024-09-19T06:08:43.743 INFO:tasks.workunit.client.0.smithi037.stdout:7/247: creat d6/d21/f44 x:0 0 0 2024-09-19T06:08:43.744 INFO:tasks.workunit.client.0.smithi037.stdout:1/273: dread d2/d12/d1e/d2d/f4c [0,4194304] 0 2024-09-19T06:08:43.744 INFO:tasks.workunit.client.0.smithi037.stdout:1/274: fsync d2/d12/d1d/f30 0 2024-09-19T06:08:43.744 INFO:tasks.workunit.client.0.smithi037.stdout:1/275: fsync d2/d12/d15/f27 0 2024-09-19T06:08:43.748 INFO:tasks.workunit.client.0.smithi037.stdout:5/345: dread d2/d12/f36 [0,4194304] 0 2024-09-19T06:08:43.748 INFO:tasks.workunit.client.0.smithi037.stdout:7/248: mknod d6/d20/c45 0 2024-09-19T06:08:43.749 INFO:tasks.workunit.client.0.smithi037.stdout:0/379: write d5/d8/d22/f4d [3922778,7721] 0 2024-09-19T06:08:43.750 INFO:tasks.workunit.client.0.smithi037.stdout:7/249: creat d6/d20/d34/f46 x:0 0 0 2024-09-19T06:08:43.752 INFO:tasks.workunit.client.0.smithi037.stdout:1/276: write d2/d12/f13 [555628,116735] 0 2024-09-19T06:08:43.752 INFO:tasks.workunit.client.0.smithi037.stdout:5/346: creat d2/d12/d28/d57/f73 x:0 0 0 2024-09-19T06:08:43.753 INFO:tasks.workunit.client.0.smithi037.stdout:8/460: dread d1/d61/d7e/d8b/d91/d3d/f34 [0,4194304] 0 2024-09-19T06:08:43.753 INFO:tasks.workunit.client.0.smithi037.stdout:8/461: chown d1/d35/c5e 51251970 1 2024-09-19T06:08:43.753 INFO:tasks.workunit.client.0.smithi037.stdout:8/462: dread - d1/f54 zero size 2024-09-19T06:08:43.757 INFO:tasks.workunit.client.0.smithi037.stdout:3/338: dwrite d0/d43/d23/d7a/d77/d45/d55/f67 [0,4194304] 0 2024-09-19T06:08:43.757 INFO:tasks.workunit.client.0.smithi037.stdout:3/339: stat d0/d43/d37/l52 0 2024-09-19T06:08:43.757 INFO:tasks.workunit.client.0.smithi037.stdout:3/340: chown d0/d16/d19/d33 906249 1 2024-09-19T06:08:43.759 INFO:tasks.workunit.client.0.smithi037.stdout:1/277: unlink d2/d12/d17/l1b 0 2024-09-19T06:08:43.759 INFO:tasks.workunit.client.0.smithi037.stdout:5/347: creat d2/d12/d28/f74 x:0 0 0 2024-09-19T06:08:43.760 INFO:tasks.workunit.client.0.smithi037.stdout:6/281: dwrite d9/dd/f32 [0,4194304] 0 2024-09-19T06:08:43.760 INFO:tasks.workunit.client.0.smithi037.stdout:6/282: readlink d9/d16/l1e 0 2024-09-19T06:08:43.761 INFO:tasks.workunit.client.0.smithi037.stdout:8/463: rmdir d1/d8f 39 2024-09-19T06:08:43.761 INFO:tasks.workunit.client.0.smithi037.stdout:8/464: chown d1/d61/d7e/d8b/f98 130 1 2024-09-19T06:08:43.766 INFO:tasks.workunit.client.0.smithi037.stdout:3/341: mknod d0/d43/d23/d7a/d77/d62/c7b 0 2024-09-19T06:08:43.767 INFO:tasks.workunit.client.0.smithi037.stdout:5/348: creat d2/d12/d28/d57/f75 x:0 0 0 2024-09-19T06:08:43.767 INFO:tasks.workunit.client.0.smithi037.stdout:7/250: dread d6/dc/f1b [0,4194304] 0 2024-09-19T06:08:43.769 INFO:tasks.workunit.client.0.smithi037.stdout:8/465: mkdir d1/d61/d7e/d8b/d9f 0 2024-09-19T06:08:43.769 INFO:tasks.workunit.client.0.smithi037.stdout:0/380: dread d5/d8/d22/f47 [0,4194304] 0 2024-09-19T06:08:43.769 INFO:tasks.workunit.client.0.smithi037.stdout:0/381: write d5/d8/d44/f51 [138282,24040] 0 2024-09-19T06:08:43.779 INFO:tasks.workunit.client.0.smithi037.stdout:6/283: write d9/f24 [15464,46576] 0 2024-09-19T06:08:43.783 INFO:tasks.workunit.client.0.smithi037.stdout:1/278: read d2/d12/d1d/f30 [4102324,69305] 0 2024-09-19T06:08:43.783 INFO:tasks.workunit.client.0.smithi037.stdout:3/342: mkdir d0/d16/d19/d1d/d7c 0 2024-09-19T06:08:43.784 INFO:tasks.workunit.client.0.smithi037.stdout:1/279: fsync d2/d12/d1e/d2a/d2e/f31 0 2024-09-19T06:08:43.784 INFO:tasks.workunit.client.0.smithi037.stdout:3/343: fdatasync d0/d16/d19/d1d/f39 0 2024-09-19T06:08:43.784 INFO:tasks.workunit.client.0.smithi037.stdout:1/280: chown d2/d12/d15/d5c 28634 1 2024-09-19T06:08:43.784 INFO:tasks.workunit.client.0.smithi037.stdout:8/466: getdents d1/d61/d68 0 2024-09-19T06:08:43.784 INFO:tasks.workunit.client.0.smithi037.stdout:1/281: rmdir d2/d12/d1e/d2a 39 2024-09-19T06:08:43.784 INFO:tasks.workunit.client.0.smithi037.stdout:1/282: chown d2/d12/d15/d34/f46 8 1 2024-09-19T06:08:43.785 INFO:tasks.workunit.client.0.smithi037.stdout:8/467: symlink d1/d61/la0 0 2024-09-19T06:08:43.786 INFO:tasks.workunit.client.0.smithi037.stdout:8/468: unlink d1/d61/d7e/d8b/d91/c46 0 2024-09-19T06:08:43.786 INFO:tasks.workunit.client.0.smithi037.stdout:8/469: write d1/f32 [4600246,41159] 0 2024-09-19T06:08:43.786 INFO:tasks.workunit.client.0.smithi037.stdout:8/470: fsync d1/d61/d7e/d8b/d91/d3d/f19 0 2024-09-19T06:08:43.786 INFO:tasks.workunit.client.0.smithi037.stdout:1/283: read d2/fa [553286,40885] 0 2024-09-19T06:08:43.787 INFO:tasks.workunit.client.0.smithi037.stdout:8/471: mkdir d1/d8f/da1 0 2024-09-19T06:08:43.787 INFO:tasks.workunit.client.0.smithi037.stdout:8/472: readlink d1/l1c 0 2024-09-19T06:08:43.788 INFO:tasks.workunit.client.0.smithi037.stdout:6/284: dread d9/dd/f23 [0,4194304] 0 2024-09-19T06:08:43.788 INFO:tasks.workunit.client.0.smithi037.stdout:1/284: link d2/f28 d2/d12/d1e/d2a/f60 0 2024-09-19T06:08:43.789 INFO:tasks.workunit.client.0.smithi037.stdout:8/473: mknod d1/d62/ca2 0 2024-09-19T06:08:43.789 INFO:tasks.workunit.client.0.smithi037.stdout:6/285: getdents d9/dd/d1c 0 2024-09-19T06:08:43.790 INFO:tasks.workunit.client.0.smithi037.stdout:1/285: getdents d2/d12/d1e 0 2024-09-19T06:08:43.790 INFO:tasks.workunit.client.0.smithi037.stdout:8/474: mkdir d1/d61/d68/da3 0 2024-09-19T06:08:43.791 INFO:tasks.workunit.client.0.smithi037.stdout:8/475: readlink d1/d61/l6d 0 2024-09-19T06:08:43.791 INFO:tasks.workunit.client.0.smithi037.stdout:1/286: unlink d2/d48/f56 0 2024-09-19T06:08:43.792 INFO:tasks.workunit.client.0.smithi037.stdout:8/476: symlink d1/d6a/la4 0 2024-09-19T06:08:43.792 INFO:tasks.workunit.client.0.smithi037.stdout:8/477: readlink d1/d61/d7e/d8b/d91/d3d/l37 0 2024-09-19T06:08:43.793 INFO:tasks.workunit.client.0.smithi037.stdout:8/478: stat d1/d35/l8c 0 2024-09-19T06:08:43.794 INFO:tasks.workunit.client.0.smithi037.stdout:1/287: rename d2/d12/d1e/d2a/l33 to d2/d12/d1e/d2a/d2e/l61 0 2024-09-19T06:08:43.797 INFO:tasks.workunit.client.0.smithi037.stdout:1/288: rename d2/d12/d1e/d2a/d2e/f41 to d2/d48/f62 0 2024-09-19T06:08:43.797 INFO:tasks.workunit.client.0.smithi037.stdout:5/349: dwrite d2/d12/d28/d57/f73 [0,4194304] 0 2024-09-19T06:08:43.798 INFO:tasks.workunit.client.0.smithi037.stdout:8/479: mknod d1/d35/ca5 0 2024-09-19T06:08:43.798 INFO:tasks.workunit.client.0.smithi037.stdout:8/480: fsync d1/d61/d7e/d8b/d91/f3b 0 2024-09-19T06:08:43.798 INFO:tasks.workunit.client.0.smithi037.stdout:1/289: rmdir d2/d12/d15/d34 39 2024-09-19T06:08:43.806 INFO:tasks.workunit.client.0.smithi037.stdout:5/350: link d2/d12/d28/c64 d2/d10/c76 0 2024-09-19T06:08:43.810 INFO:tasks.workunit.client.0.smithi037.stdout:3/344: dwrite d0/d16/d19/d1d/f27 [0,4194304] 0 2024-09-19T06:08:43.810 INFO:tasks.workunit.client.0.smithi037.stdout:3/345: read d0/d16/d19/d1d/f39 [810896,113592] 0 2024-09-19T06:08:43.810 INFO:tasks.workunit.client.0.smithi037.stdout:0/382: dwrite d5/d8/d44/f51 [0,4194304] 0 2024-09-19T06:08:43.812 INFO:tasks.workunit.client.0.smithi037.stdout:5/351: creat d2/d12/d28/d22/d35/f77 x:0 0 0 2024-09-19T06:08:43.814 INFO:tasks.workunit.client.0.smithi037.stdout:3/346: creat d0/f7d x:0 0 0 2024-09-19T06:08:43.814 INFO:tasks.workunit.client.0.smithi037.stdout:3/347: dread - d0/d43/d23/f72 zero size 2024-09-19T06:08:43.814 INFO:tasks.workunit.client.0.smithi037.stdout:3/348: read - d0/d16/f71 zero size 2024-09-19T06:08:43.815 INFO:tasks.workunit.client.0.smithi037.stdout:0/383: mknod d5/d42/c7f 0 2024-09-19T06:08:43.819 INFO:tasks.workunit.client.0.smithi037.stdout:3/349: read d0/d43/d23/f69 [218329,126933] 0 2024-09-19T06:08:43.824 INFO:tasks.workunit.client.0.smithi037.stdout:1/290: dwrite d2/d12/d1d/f4f [0,4194304] 0 2024-09-19T06:08:43.826 INFO:tasks.workunit.client.0.smithi037.stdout:8/481: dwrite d1/d61/d7e/d8b/f98 [0,4194304] 0 2024-09-19T06:08:43.826 INFO:tasks.workunit.client.0.smithi037.stdout:0/384: dread d5/d8/d11/d32/f43 [0,4194304] 0 2024-09-19T06:08:43.829 INFO:tasks.workunit.client.0.smithi037.stdout:0/385: mknod d5/d17/c80 0 2024-09-19T06:08:43.829 INFO:tasks.workunit.client.0.smithi037.stdout:0/386: chown d5/l19 21 1 2024-09-19T06:08:43.829 INFO:tasks.workunit.client.0.smithi037.stdout:1/291: write d2/f8 [899061,86127] 0 2024-09-19T06:08:43.830 INFO:tasks.workunit.client.0.smithi037.stdout:8/482: mknod d1/d62/d59/d5d/ca6 0 2024-09-19T06:08:43.830 INFO:tasks.workunit.client.0.smithi037.stdout:5/352: read d2/d10/f19 [3819317,100661] 0 2024-09-19T06:08:43.830 INFO:tasks.workunit.client.0.smithi037.stdout:6/286: dwrite d9/dd/d1c/f41 [0,4194304] 0 2024-09-19T06:08:43.830 INFO:tasks.workunit.client.0.smithi037.stdout:0/387: symlink d5/d8/d11/d15/l81 0 2024-09-19T06:08:43.831 INFO:tasks.workunit.client.0.smithi037.stdout:1/292: mkdir d2/d12/d1e/d63 0 2024-09-19T06:08:43.831 INFO:tasks.workunit.client.0.smithi037.stdout:1/293: write d2/fa [493017,19578] 0 2024-09-19T06:08:43.832 INFO:tasks.workunit.client.0.smithi037.stdout:5/353: rename d2/d12/d28/d22/d35/l55 to d2/d12/d24/l78 0 2024-09-19T06:08:43.835 INFO:tasks.workunit.client.0.smithi037.stdout:6/287: creat d9/dd/f52 x:0 0 0 2024-09-19T06:08:43.836 INFO:tasks.workunit.client.0.smithi037.stdout:0/388: rmdir d5/d8/d22 39 2024-09-19T06:08:43.836 INFO:tasks.workunit.client.0.smithi037.stdout:0/389: write d5/d8/d11/d15/d21/f29 [2121492,19403] 0 2024-09-19T06:08:43.836 INFO:tasks.workunit.client.0.smithi037.stdout:0/390: dread - d5/d8/d44/f71 zero size 2024-09-19T06:08:43.840 INFO:tasks.workunit.client.0.smithi037.stdout:6/288: rename d9/dd/f14 to d9/dd/d1c/d4e/d2f/f53 0 2024-09-19T06:08:43.840 INFO:tasks.workunit.client.0.smithi037.stdout:0/391: symlink d5/d8/d11/d15/d21/l82 0 2024-09-19T06:08:43.841 INFO:tasks.workunit.client.0.smithi037.stdout:6/289: symlink d9/dd/d20/l54 0 2024-09-19T06:08:43.841 INFO:tasks.workunit.client.0.smithi037.stdout:6/290: write d9/dd/d1c/d4e/d2f/f35 [853522,5530] 0 2024-09-19T06:08:43.841 INFO:tasks.workunit.client.0.smithi037.stdout:6/291: getdents d9/dd/d1c 0 2024-09-19T06:08:43.842 INFO:tasks.workunit.client.0.smithi037.stdout:0/392: truncate d5/d8/d44/d48/f5a 66829 0 2024-09-19T06:08:43.843 INFO:tasks.workunit.client.0.smithi037.stdout:8/483: dread d1/d61/d7e/d8b/d91/d3d/f26 [0,4194304] 0 2024-09-19T06:08:43.844 INFO:tasks.workunit.client.0.smithi037.stdout:6/292: mkdir d9/dd/d1c/d4e/d2f/d55 0 2024-09-19T06:08:43.845 INFO:tasks.workunit.client.0.smithi037.stdout:0/393: symlink d5/d8/d44/l83 0 2024-09-19T06:08:43.845 INFO:tasks.workunit.client.0.smithi037.stdout:6/293: write d9/dd/d2b/f37 [873205,32239] 0 2024-09-19T06:08:43.846 INFO:tasks.workunit.client.0.smithi037.stdout:3/350: dwrite d0/d43/f5b [0,4194304] 0 2024-09-19T06:08:43.848 INFO:tasks.workunit.client.0.smithi037.stdout:4/320: sync 2024-09-19T06:08:43.848 INFO:tasks.workunit.client.0.smithi037.stdout:2/428: sync 2024-09-19T06:08:43.848 INFO:tasks.workunit.client.0.smithi037.stdout:4/321: chown d0 270 1 2024-09-19T06:08:43.849 INFO:tasks.workunit.client.0.smithi037.stdout:6/294: mknod d9/dd/d1c/d4e/d33/c56 0 2024-09-19T06:08:43.849 INFO:tasks.workunit.client.0.smithi037.stdout:6/295: read - d9/dd/d20/f27 zero size 2024-09-19T06:08:43.850 INFO:tasks.workunit.client.0.smithi037.stdout:3/351: symlink d0/d16/d19/d1d/l7e 0 2024-09-19T06:08:43.851 INFO:tasks.workunit.client.0.smithi037.stdout:5/354: dread d2/d12/f3a [0,4194304] 0 2024-09-19T06:08:43.852 INFO:tasks.workunit.client.0.smithi037.stdout:4/322: creat d0/d6/d45/d4a/f6c x:0 0 0 2024-09-19T06:08:43.852 INFO:tasks.workunit.client.0.smithi037.stdout:6/296: creat d9/f57 x:0 0 0 2024-09-19T06:08:43.853 INFO:tasks.workunit.client.0.smithi037.stdout:3/352: creat d0/d43/f7f x:0 0 0 2024-09-19T06:08:43.854 INFO:tasks.workunit.client.0.smithi037.stdout:5/355: rename d2/d12/d28/d22/c6e to d2/d12/d28/d22/d35/c79 0 2024-09-19T06:08:43.855 INFO:tasks.workunit.client.0.smithi037.stdout:4/323: symlink d0/d6/d1b/d5d/l6d 0 2024-09-19T06:08:43.855 INFO:tasks.workunit.client.0.smithi037.stdout:1/294: dwrite d2/d12/d15/f27 [0,4194304] 0 2024-09-19T06:08:43.856 INFO:tasks.workunit.client.0.smithi037.stdout:1/295: truncate d2/f28 824839 0 2024-09-19T06:08:43.856 INFO:tasks.workunit.client.0.smithi037.stdout:6/297: creat d9/dd/d1c/f58 x:0 0 0 2024-09-19T06:08:43.856 INFO:tasks.workunit.client.0.smithi037.stdout:6/298: chown d9/dd/d20/f48 0 1 2024-09-19T06:08:43.857 INFO:tasks.workunit.client.0.smithi037.stdout:3/353: mknod d0/d43/d26/c80 0 2024-09-19T06:08:43.857 INFO:tasks.workunit.client.0.smithi037.stdout:3/354: chown d0/d43/d23/d7a/d77/f3e 35473 1 2024-09-19T06:08:43.857 INFO:tasks.workunit.client.0.smithi037.stdout:3/355: write d0/d43/d23/f69 [590827,98675] 0 2024-09-19T06:08:43.857 INFO:tasks.workunit.client.0.smithi037.stdout:3/356: fdatasync d0/d16/d19/f42 0 2024-09-19T06:08:43.858 INFO:tasks.workunit.client.0.smithi037.stdout:0/394: dread d5/d8/d11/d32/f43 [0,4194304] 0 2024-09-19T06:08:43.860 INFO:tasks.workunit.client.0.smithi037.stdout:4/324: mknod d0/d2/d37/d46/c6e 0 2024-09-19T06:08:43.861 INFO:tasks.workunit.client.0.smithi037.stdout:1/296: truncate d2/d12/d15/f58 219278 0 2024-09-19T06:08:43.863 INFO:tasks.workunit.client.0.smithi037.stdout:6/299: rename d9/d16/f3c to d9/dd/f59 0 2024-09-19T06:08:43.864 INFO:tasks.workunit.client.0.smithi037.stdout:6/300: write d9/f24 [2450016,81048] 0 2024-09-19T06:08:43.864 INFO:tasks.workunit.client.0.smithi037.stdout:6/301: chown d9/dd/d2b/f37 4707 1 2024-09-19T06:08:43.864 INFO:tasks.workunit.client.0.smithi037.stdout:6/302: chown d9/dd/d1c/l1f 4 1 2024-09-19T06:08:43.865 INFO:tasks.workunit.client.0.smithi037.stdout:1/297: unlink d2/l7 0 2024-09-19T06:08:43.865 INFO:tasks.workunit.client.0.smithi037.stdout:1/298: chown d2/d12/d1e/d2a/f59 837125751 1 2024-09-19T06:08:43.868 INFO:tasks.workunit.client.0.smithi037.stdout:6/303: mkdir d9/dd/d20/d5a 0 2024-09-19T06:08:43.868 INFO:tasks.workunit.client.0.smithi037.stdout:6/304: truncate d9/dd/d20/f27 238329 0 2024-09-19T06:08:43.872 INFO:tasks.workunit.client.0.smithi037.stdout:8/484: dwrite d1/f4c [0,4194304] 0 2024-09-19T06:08:43.876 INFO:tasks.workunit.client.0.smithi037.stdout:0/395: dread d5/d8/d11/d15/d21/f49 [0,4194304] 0 2024-09-19T06:08:43.876 INFO:tasks.workunit.client.0.smithi037.stdout:9/479: sync 2024-09-19T06:08:43.876 INFO:tasks.workunit.client.0.smithi037.stdout:9/480: dread - da/d4d/f68 zero size 2024-09-19T06:08:43.876 INFO:tasks.workunit.client.0.smithi037.stdout:2/429: write d1/d6/fe [6092950,124993] 0 2024-09-19T06:08:43.884 INFO:tasks.workunit.client.0.smithi037.stdout:5/356: dwrite d2/d10/f1f [0,4194304] 0 2024-09-19T06:08:43.885 INFO:tasks.workunit.client.0.smithi037.stdout:0/396: creat d5/d18/f84 x:0 0 0 2024-09-19T06:08:43.885 INFO:tasks.workunit.client.0.smithi037.stdout:9/481: creat da/dd/d1b/d23/d6a/d8f/fab x:0 0 0 2024-09-19T06:08:43.886 INFO:tasks.workunit.client.0.smithi037.stdout:6/305: dread d9/f24 [0,4194304] 0 2024-09-19T06:08:43.886 INFO:tasks.workunit.client.0.smithi037.stdout:2/430: creat d1/da/dc/d21/d51/f9c x:0 0 0 2024-09-19T06:08:43.887 INFO:tasks.workunit.client.0.smithi037.stdout:5/357: rename d2/d12/d28/d22/d35/f56 to d2/f7a 0 2024-09-19T06:08:43.889 INFO:tasks.workunit.client.0.smithi037.stdout:9/482: unlink l6 0 2024-09-19T06:08:43.890 INFO:tasks.workunit.client.0.smithi037.stdout:0/397: mkdir d5/d18/d68/d85 0 2024-09-19T06:08:43.891 INFO:tasks.workunit.client.0.smithi037.stdout:2/431: mkdir d1/d9d 0 2024-09-19T06:08:43.891 INFO:tasks.workunit.client.0.smithi037.stdout:2/432: write d1/da/dc/d21/d51/f52 [27661,71127] 0 2024-09-19T06:08:43.891 INFO:tasks.workunit.client.0.smithi037.stdout:2/433: write d1/d16/f74 [1891917,106545] 0 2024-09-19T06:08:43.892 INFO:tasks.workunit.client.0.smithi037.stdout:9/483: mkdir da/dd/d1b/d23/d6a/d8f/dac 0 2024-09-19T06:08:43.892 INFO:tasks.workunit.client.0.smithi037.stdout:9/484: write da/dd/d1b/d2f/d38/f78 [556376,34217] 0 2024-09-19T06:08:43.892 INFO:tasks.workunit.client.0.smithi037.stdout:0/398: creat d5/d18/f86 x:0 0 0 2024-09-19T06:08:43.893 INFO:tasks.workunit.client.0.smithi037.stdout:4/325: dwrite d0/f53 [0,4194304] 0 2024-09-19T06:08:43.894 INFO:tasks.workunit.client.0.smithi037.stdout:2/434: mkdir d1/d9e 0 2024-09-19T06:08:43.895 INFO:tasks.workunit.client.0.smithi037.stdout:0/399: creat d5/f87 x:0 0 0 2024-09-19T06:08:43.895 INFO:tasks.workunit.client.0.smithi037.stdout:0/400: stat d5/d18/d68/d6d 0 2024-09-19T06:08:43.897 INFO:tasks.workunit.client.0.smithi037.stdout:4/326: rename d0/d6/d1b/d20/d48/d59 to d0/d6/d45/d4a/d6f 0 2024-09-19T06:08:43.898 INFO:tasks.workunit.client.0.smithi037.stdout:0/401: mknod d5/d8/c88 0 2024-09-19T06:08:43.900 INFO:tasks.workunit.client.0.smithi037.stdout:0/402: mkdir d5/d8/d22/d89 0 2024-09-19T06:08:43.900 INFO:tasks.workunit.client.0.smithi037.stdout:0/403: chown d5/d8/d11/d15/d21/f4b 11997 1 2024-09-19T06:08:43.902 INFO:tasks.workunit.client.0.smithi037.stdout:0/404: creat d5/d8/d22/d89/f8a x:0 0 0 2024-09-19T06:08:43.903 INFO:tasks.workunit.client.0.smithi037.stdout:5/358: dread d2/f52 [0,4194304] 0 2024-09-19T06:08:43.903 INFO:tasks.workunit.client.0.smithi037.stdout:5/359: write d2/d12/d24/f70 [108843,71577] 0 2024-09-19T06:08:43.906 INFO:tasks.workunit.client.0.smithi037.stdout:0/405: truncate d5/f7 8292470 0 2024-09-19T06:08:43.906 INFO:tasks.workunit.client.0.smithi037.stdout:0/406: truncate d5/d8/d22/d89/f8a 23516 0 2024-09-19T06:08:43.915 INFO:tasks.workunit.client.0.smithi037.stdout:9/485: write da/dd/d1b/f4c [488567,8353] 0 2024-09-19T06:08:43.917 INFO:tasks.workunit.client.0.smithi037.stdout:9/486: dread - da/dd/d1b/d2f/fa2 zero size 2024-09-19T06:08:43.922 INFO:tasks.workunit.client.0.smithi037.stdout:6/306: dwrite d9/dd/d1c/f41 [0,4194304] 0 2024-09-19T06:08:43.923 INFO:tasks.workunit.client.0.smithi037.stdout:6/307: symlink d9/d16/l5b 0 2024-09-19T06:08:43.924 INFO:tasks.workunit.client.0.smithi037.stdout:3/357: dwrite d0/d43/d23/f69 [0,4194304] 0 2024-09-19T06:08:43.924 INFO:tasks.workunit.client.0.smithi037.stdout:8/485: write d1/d61/f89 [2446045,10499] 0 2024-09-19T06:08:43.925 INFO:tasks.workunit.client.0.smithi037.stdout:6/308: symlink d9/d16/l5c 0 2024-09-19T06:08:43.928 INFO:tasks.workunit.client.0.smithi037.stdout:2/435: dwrite d1/d16/f37 [0,4194304] 0 2024-09-19T06:08:43.930 INFO:tasks.workunit.client.0.smithi037.stdout:4/327: dwrite d0/f27 [4194304,4194304] 0 2024-09-19T06:08:43.930 INFO:tasks.workunit.client.0.smithi037.stdout:4/328: chown d0/d2/d37/f5e 226959 1 2024-09-19T06:08:43.931 INFO:tasks.workunit.client.0.smithi037.stdout:5/360: dwrite d2/d12/f16 [0,4194304] 0 2024-09-19T06:08:43.933 INFO:tasks.workunit.client.0.smithi037.stdout:3/358: creat d0/d16/f81 x:0 0 0 2024-09-19T06:08:43.933 INFO:tasks.workunit.client.0.smithi037.stdout:8/486: creat d1/d6a/fa7 x:0 0 0 2024-09-19T06:08:43.933 INFO:tasks.workunit.client.0.smithi037.stdout:6/309: rmdir d9/dd/d20 39 2024-09-19T06:08:43.933 INFO:tasks.workunit.client.0.smithi037.stdout:6/310: chown d9/dd/d2b/d42 5860763 1 2024-09-19T06:08:43.935 INFO:tasks.workunit.client.0.smithi037.stdout:2/436: symlink d1/d9e/l9f 0 2024-09-19T06:08:43.935 INFO:tasks.workunit.client.0.smithi037.stdout:2/437: dread - d1/da/dc/d21/d51/f9c zero size 2024-09-19T06:08:43.935 INFO:tasks.workunit.client.0.smithi037.stdout:2/438: readlink d1/d16/l44 0 2024-09-19T06:08:43.936 INFO:tasks.workunit.client.0.smithi037.stdout:5/361: rename d2/d12/f3a to d2/d5c/f7b 0 2024-09-19T06:08:43.937 INFO:tasks.workunit.client.0.smithi037.stdout:8/487: rmdir d1/d62/d59 39 2024-09-19T06:08:43.937 INFO:tasks.workunit.client.0.smithi037.stdout:8/488: fdatasync d1/d61/d7e/d8b/d91/f6b 0 2024-09-19T06:08:43.938 INFO:tasks.workunit.client.0.smithi037.stdout:6/311: rename d9/d16/l3d to d9/d16/l5d 0 2024-09-19T06:08:43.939 INFO:tasks.workunit.client.0.smithi037.stdout:0/407: dwrite d5/d8/d22/f47 [0,4194304] 0 2024-09-19T06:08:43.939 INFO:tasks.workunit.client.0.smithi037.stdout:2/439: mkdir d1/da/d6e/da0 0 2024-09-19T06:08:43.939 INFO:tasks.workunit.client.0.smithi037.stdout:8/489: symlink d1/d61/d7e/d8b/la8 0 2024-09-19T06:08:43.941 INFO:tasks.workunit.client.0.smithi037.stdout:2/440: rename d1/da/d42/f48 to d1/d33/fa1 0 2024-09-19T06:08:43.941 INFO:tasks.workunit.client.0.smithi037.stdout:2/441: write d1/d16/f1c [4531259,85387] 0 2024-09-19T06:08:43.942 INFO:tasks.workunit.client.0.smithi037.stdout:8/490: unlink d1/d61/d7e/d8b/d91/c4e 0 2024-09-19T06:08:43.942 INFO:tasks.workunit.client.0.smithi037.stdout:8/491: chown d1/d61/d68/da3 231 1 2024-09-19T06:08:43.944 INFO:tasks.workunit.client.0.smithi037.stdout:2/442: rename d1/da/dc/d21/d7d/f34 to d1/d16/d62/fa2 0 2024-09-19T06:08:43.944 INFO:tasks.workunit.client.0.smithi037.stdout:7/251: sync 2024-09-19T06:08:43.946 INFO:tasks.workunit.client.0.smithi037.stdout:7/252: creat d6/dc/f47 x:0 0 0 2024-09-19T06:08:43.947 INFO:tasks.workunit.client.0.smithi037.stdout:2/443: unlink d1/d6/l3f 0 2024-09-19T06:08:43.948 INFO:tasks.workunit.client.0.smithi037.stdout:7/253: truncate d6/dc/f16 2468254 0 2024-09-19T06:08:43.949 INFO:tasks.workunit.client.0.smithi037.stdout:9/487: dwrite da/dd/d1b/d43/fa3 [0,4194304] 0 2024-09-19T06:08:43.950 INFO:tasks.workunit.client.0.smithi037.stdout:3/359: dread d0/d43/f4c [0,4194304] 0 2024-09-19T06:08:43.952 INFO:tasks.workunit.client.0.smithi037.stdout:4/329: write d0/f27 [6013020,83938] 0 2024-09-19T06:08:43.956 INFO:tasks.workunit.client.0.smithi037.stdout:9/488: rename da/dd/d1b/l1d to da/d57/lad 0 2024-09-19T06:08:43.956 INFO:tasks.workunit.client.0.smithi037.stdout:2/444: mkdir d1/d6/da3 0 2024-09-19T06:08:43.956 INFO:tasks.workunit.client.0.smithi037.stdout:3/360: mkdir d0/d16/d19/d1d/d82 0 2024-09-19T06:08:43.956 INFO:tasks.workunit.client.0.smithi037.stdout:3/361: readlink d0/l6a 0 2024-09-19T06:08:43.957 INFO:tasks.workunit.client.0.smithi037.stdout:4/330: mkdir d0/d6/d1b/d30/d70 0 2024-09-19T06:08:43.958 INFO:tasks.workunit.client.0.smithi037.stdout:9/489: creat da/dd/d1b/d62/fae x:0 0 0 2024-09-19T06:08:43.963 INFO:tasks.workunit.client.0.smithi037.stdout:4/331: rename d0/c34 to d0/d6/c71 0 2024-09-19T06:08:43.964 INFO:tasks.workunit.client.0.smithi037.stdout:6/312: dread d9/dd/d1c/d4e/d2f/f53 [0,4194304] 0 2024-09-19T06:08:43.964 INFO:tasks.workunit.client.0.smithi037.stdout:0/408: dread d5/d8/d11/d32/f39 [0,4194304] 0 2024-09-19T06:08:43.972 INFO:tasks.workunit.client.0.smithi037.stdout:7/254: dread d6/dc/fe [0,4194304] 0 2024-09-19T06:08:43.972 INFO:tasks.workunit.client.0.smithi037.stdout:7/255: truncate d6/f38 964229 0 2024-09-19T06:08:43.973 INFO:tasks.workunit.client.0.smithi037.stdout:7/256: mkdir d6/d20/d2c/d48 0 2024-09-19T06:08:43.974 INFO:tasks.workunit.client.0.smithi037.stdout:7/257: mkdir d6/d20/d34/d49 0 2024-09-19T06:08:43.977 INFO:tasks.workunit.client.0.smithi037.stdout:0/409: write d5/d8/d11/f55 [3063294,130686] 0 2024-09-19T06:08:43.977 INFO:tasks.workunit.client.0.smithi037.stdout:0/410: chown d5/d8/d11/d32 3 1 2024-09-19T06:08:43.978 INFO:tasks.workunit.client.0.smithi037.stdout:8/492: dwrite d1/d61/f89 [0,4194304] 0 2024-09-19T06:08:43.978 INFO:tasks.workunit.client.0.smithi037.stdout:8/493: read d1/f2a [2284435,125381] 0 2024-09-19T06:08:43.981 INFO:tasks.workunit.client.0.smithi037.stdout:3/362: dread d0/d43/d23/f2a [0,4194304] 0 2024-09-19T06:08:43.981 INFO:tasks.workunit.client.0.smithi037.stdout:3/363: write d0/d43/d26/f36 [3681698,7007] 0 2024-09-19T06:08:43.981 INFO:tasks.workunit.client.0.smithi037.stdout:4/332: read d0/d6/d1b/f3f [622577,59431] 0 2024-09-19T06:08:43.982 INFO:tasks.workunit.client.0.smithi037.stdout:5/362: dwrite d2/d10/f21 [0,4194304] 0 2024-09-19T06:08:43.982 INFO:tasks.workunit.client.0.smithi037.stdout:5/363: readlink d2/d12/d28/l43 0 2024-09-19T06:08:43.982 INFO:tasks.workunit.client.0.smithi037.stdout:5/364: fdatasync d2/d12/d28/d22/d4a/f54 0 2024-09-19T06:08:43.982 INFO:tasks.workunit.client.0.smithi037.stdout:8/494: getdents d1/d62 0 2024-09-19T06:08:43.984 INFO:tasks.workunit.client.0.smithi037.stdout:3/364: rename d0/d16/f4d to d0/d16/d19/d1d/d5e/f83 0 2024-09-19T06:08:43.984 INFO:tasks.workunit.client.0.smithi037.stdout:3/365: chown d0/d16/f81 409567 1 2024-09-19T06:08:43.984 INFO:tasks.workunit.client.0.smithi037.stdout:3/366: fsync d0/d43/d23/d7a/d77/f5c 0 2024-09-19T06:08:43.984 INFO:tasks.workunit.client.0.smithi037.stdout:3/367: chown d0/f17 57335 1 2024-09-19T06:08:43.985 INFO:tasks.workunit.client.0.smithi037.stdout:6/313: dread d9/f18 [0,4194304] 0 2024-09-19T06:08:43.985 INFO:tasks.workunit.client.0.smithi037.stdout:6/314: chown d9/dd/d1c/f47 0 1 2024-09-19T06:08:43.985 INFO:tasks.workunit.client.0.smithi037.stdout:6/315: truncate d9/dd/d1c/f47 750428 0 2024-09-19T06:08:43.985 INFO:tasks.workunit.client.0.smithi037.stdout:6/316: stat d9/dd/f52 0 2024-09-19T06:08:43.986 INFO:tasks.workunit.client.0.smithi037.stdout:2/445: dwrite d1/d16/f3d [0,4194304] 0 2024-09-19T06:08:43.991 INFO:tasks.workunit.client.0.smithi037.stdout:5/365: truncate d2/d12/d28/d22/d4a/f54 158661 0 2024-09-19T06:08:43.991 INFO:tasks.workunit.client.0.smithi037.stdout:5/366: stat d2/d12/f32 0 2024-09-19T06:08:43.991 INFO:tasks.workunit.client.0.smithi037.stdout:5/367: fdatasync d2/d5c/f7b 0 2024-09-19T06:08:43.991 INFO:tasks.workunit.client.0.smithi037.stdout:5/368: write d2/fa [1207111,90343] 0 2024-09-19T06:08:43.992 INFO:tasks.workunit.client.0.smithi037.stdout:6/317: unlink d9/dd/d20/l54 0 2024-09-19T06:08:43.996 INFO:tasks.workunit.client.0.smithi037.stdout:2/446: creat d1/da/dc/d21/d55/fa4 x:0 0 0 2024-09-19T06:08:43.997 INFO:tasks.workunit.client.0.smithi037.stdout:2/447: truncate d1/d16/f37 2572985 0 2024-09-19T06:08:44.000 INFO:tasks.workunit.client.0.smithi037.stdout:1/299: sync 2024-09-19T06:08:44.000 INFO:tasks.workunit.client.0.smithi037.stdout:1/300: write d2/d12/d1d/f1f [262200,70642] 0 2024-09-19T06:08:44.001 INFO:tasks.workunit.client.0.smithi037.stdout:8/495: write d1/d61/d7e/d8b/d91/f3b [3399080,125531] 0 2024-09-19T06:08:44.002 INFO:tasks.workunit.client.0.smithi037.stdout:2/448: creat d1/da/fa5 x:0 0 0 2024-09-19T06:08:44.008 INFO:tasks.workunit.client.0.smithi037.stdout:0/411: dwrite d5/d8/d11/d15/d21/f4b [0,4194304] 0 2024-09-19T06:08:44.008 INFO:tasks.workunit.client.0.smithi037.stdout:0/412: fdatasync d5/d8/d11/f16 0 2024-09-19T06:08:44.009 INFO:tasks.workunit.client.0.smithi037.stdout:7/258: dwrite d6/dc/f14 [0,4194304] 0 2024-09-19T06:08:44.009 INFO:tasks.workunit.client.0.smithi037.stdout:7/259: chown d6/f38 61258 1 2024-09-19T06:08:44.010 INFO:tasks.workunit.client.0.smithi037.stdout:1/301: mknod d2/d12/d1d/c64 0 2024-09-19T06:08:44.010 INFO:tasks.workunit.client.0.smithi037.stdout:8/496: mkdir d1/d62/d59/da9 0 2024-09-19T06:08:44.011 INFO:tasks.workunit.client.0.smithi037.stdout:2/449: unlink d1/d33/d4c/f87 0 2024-09-19T06:08:44.013 INFO:tasks.workunit.client.0.smithi037.stdout:4/333: dread d0/f27 [0,4194304] 0 2024-09-19T06:08:44.013 INFO:tasks.workunit.client.0.smithi037.stdout:0/413: creat d5/d42/f8b x:0 0 0 2024-09-19T06:08:44.014 INFO:tasks.workunit.client.0.smithi037.stdout:0/414: write d5/d8/d11/f3e [966921,121462] 0 2024-09-19T06:08:44.014 INFO:tasks.workunit.client.0.smithi037.stdout:0/415: truncate d5/d42/f62 739198 0 2024-09-19T06:08:44.014 INFO:tasks.workunit.client.0.smithi037.stdout:0/416: dread - d5/f87 zero size 2024-09-19T06:08:44.015 INFO:tasks.workunit.client.0.smithi037.stdout:7/260: mknod d6/d21/c4a 0 2024-09-19T06:08:44.018 INFO:tasks.workunit.client.0.smithi037.stdout:8/497: mkdir d1/d62/daa 0 2024-09-19T06:08:44.020 INFO:tasks.workunit.client.0.smithi037.stdout:2/450: link d1/da/l39 d1/da/dc/d21/d51/la6 0 2024-09-19T06:08:44.020 INFO:tasks.workunit.client.0.smithi037.stdout:4/334: creat d0/d6/d1b/d20/f72 x:0 0 0 2024-09-19T06:08:44.021 INFO:tasks.workunit.client.0.smithi037.stdout:6/318: dwrite d9/dd/d1c/f2e [0,4194304] 0 2024-09-19T06:08:44.022 INFO:tasks.workunit.client.0.smithi037.stdout:8/498: dread d1/d62/d59/f8e [0,4194304] 0 2024-09-19T06:08:44.026 INFO:tasks.workunit.client.0.smithi037.stdout:3/368: dwrite d0/d43/d23/f69 [4194304,4194304] 0 2024-09-19T06:08:44.026 INFO:tasks.workunit.client.0.smithi037.stdout:3/369: write d0/d16/f22 [2922099,55989] 0 2024-09-19T06:08:44.026 INFO:tasks.workunit.client.0.smithi037.stdout:3/370: write d0/d16/d19/d1d/d5e/f83 [472319,42878] 0 2024-09-19T06:08:44.026 INFO:tasks.workunit.client.0.smithi037.stdout:3/371: chown d0/d43 180955 1 2024-09-19T06:08:44.028 INFO:tasks.workunit.client.0.smithi037.stdout:0/417: symlink d5/d8/d44/d48/l8c 0 2024-09-19T06:08:44.028 INFO:tasks.workunit.client.0.smithi037.stdout:1/302: rename d2/d12/d1e/d2d/f5a to d2/d12/d1e/d2a/f65 0 2024-09-19T06:08:44.028 INFO:tasks.workunit.client.0.smithi037.stdout:7/261: rmdir d6/dc/d22 39 2024-09-19T06:08:44.029 INFO:tasks.workunit.client.0.smithi037.stdout:6/319: link d9/dd/d1c/f41 d9/dd/f5e 0 2024-09-19T06:08:44.029 INFO:tasks.workunit.client.0.smithi037.stdout:8/499: creat d1/d61/d7e/d8b/d91/d3d/d66/fab x:0 0 0 2024-09-19T06:08:44.030 INFO:tasks.workunit.client.0.smithi037.stdout:5/369: dwrite d2/d12/f27 [0,4194304] 0 2024-09-19T06:08:44.032 INFO:tasks.workunit.client.0.smithi037.stdout:8/500: dread d1/d62/d59/f8e [0,4194304] 0 2024-09-19T06:08:44.034 INFO:tasks.workunit.client.0.smithi037.stdout:3/372: unlink d0/d43/d23/d7a/d77/d45/d55/f67 0 2024-09-19T06:08:44.043 INFO:tasks.workunit.client.0.smithi037.stdout:0/418: mkdir d5/d8/d11/d15/d8d 0 2024-09-19T06:08:44.043 INFO:tasks.workunit.client.0.smithi037.stdout:0/419: write d5/d8/d22/f47 [5025687,82833] 0 2024-09-19T06:08:44.045 INFO:tasks.workunit.client.0.smithi037.stdout:7/262: rmdir d6/dc/d22 39 2024-09-19T06:08:44.045 INFO:tasks.workunit.client.0.smithi037.stdout:6/320: rmdir d9/dd/d1c 39 2024-09-19T06:08:44.045 INFO:tasks.workunit.client.0.smithi037.stdout:5/370: mknod d2/d12/c7c 0 2024-09-19T06:08:44.045 INFO:tasks.workunit.client.0.smithi037.stdout:5/371: write d2/d5c/d5f/f69 [170560,74130] 0 2024-09-19T06:08:44.046 INFO:tasks.workunit.client.0.smithi037.stdout:8/501: dread d1/f18 [4194304,4194304] 0 2024-09-19T06:08:44.046 INFO:tasks.workunit.client.0.smithi037.stdout:3/373: link d0/f7 d0/d43/d23/d7a/d77/f84 0 2024-09-19T06:08:44.046 INFO:tasks.workunit.client.0.smithi037.stdout:3/374: write d0/d43/d26/f36 [5042880,34797] 0 2024-09-19T06:08:44.046 INFO:tasks.workunit.client.0.smithi037.stdout:3/375: chown d0/d43/d23/d7a/d77 150868360 1 2024-09-19T06:08:44.046 INFO:tasks.workunit.client.0.smithi037.stdout:3/376: write d0/d16/f81 [1026119,15380] 0 2024-09-19T06:08:44.046 INFO:tasks.workunit.client.0.smithi037.stdout:1/303: symlink d2/d12/d15/l66 0 2024-09-19T06:08:44.047 INFO:tasks.workunit.client.0.smithi037.stdout:6/321: rename d9/dd/d1c/l38 to d9/dd/d1c/d4e/d2f/d55/l5f 0 2024-09-19T06:08:44.048 INFO:tasks.workunit.client.0.smithi037.stdout:5/372: link d2/d12/f26 d2/d12/d28/d22/d53/f7d 0 2024-09-19T06:08:44.048 INFO:tasks.workunit.client.0.smithi037.stdout:8/502: getdents d1/d61/d7b 0 2024-09-19T06:08:44.049 INFO:tasks.workunit.client.0.smithi037.stdout:1/304: readlink d2/d12/d1e/d2d/l54 0 2024-09-19T06:08:44.050 INFO:tasks.workunit.client.0.smithi037.stdout:5/373: mkdir d2/d12/d7e 0 2024-09-19T06:08:44.050 INFO:tasks.workunit.client.0.smithi037.stdout:5/374: write d2/d12/d28/d57/f75 [185174,65899] 0 2024-09-19T06:08:44.050 INFO:tasks.workunit.client.0.smithi037.stdout:8/503: readlink d1/d35/l8c 0 2024-09-19T06:08:44.051 INFO:tasks.workunit.client.0.smithi037.stdout:4/335: dwrite d0/d6/d1b/f55 [0,4194304] 0 2024-09-19T06:08:44.052 INFO:tasks.workunit.client.0.smithi037.stdout:1/305: creat d2/d12/d1e/f67 x:0 0 0 2024-09-19T06:08:44.052 INFO:tasks.workunit.client.0.smithi037.stdout:2/451: dwrite d1/d16/d4a/f8d [0,4194304] 0 2024-09-19T06:08:44.052 INFO:tasks.workunit.client.0.smithi037.stdout:2/452: truncate d1/da/f19 2737855 0 2024-09-19T06:08:44.052 INFO:tasks.workunit.client.0.smithi037.stdout:4/336: dread d0/d2/d2e/d36/f4e [0,4194304] 0 2024-09-19T06:08:44.053 INFO:tasks.workunit.client.0.smithi037.stdout:8/504: rename d1/d61/d7e/d8b/d91/d3d/l53 to d1/d61/d7e/d8b/lac 0 2024-09-19T06:08:44.053 INFO:tasks.workunit.client.0.smithi037.stdout:8/505: fsync d1/f6c 0 2024-09-19T06:08:44.053 INFO:tasks.workunit.client.0.smithi037.stdout:5/375: read d2/d12/d28/d22/d4a/f54 [150652,75212] 0 2024-09-19T06:08:44.055 INFO:tasks.workunit.client.0.smithi037.stdout:2/453: mknod d1/d16/d62/ca7 0 2024-09-19T06:08:44.057 INFO:tasks.workunit.client.0.smithi037.stdout:4/337: rmdir d0/d6/d1b/d20 39 2024-09-19T06:08:44.057 INFO:tasks.workunit.client.0.smithi037.stdout:4/338: truncate d0/d6/d1b/d20/d4d/f51 454505 0 2024-09-19T06:08:44.057 INFO:tasks.workunit.client.0.smithi037.stdout:1/306: write d2/f3 [543949,74585] 0 2024-09-19T06:08:44.057 INFO:tasks.workunit.client.0.smithi037.stdout:1/307: fsync d2/d12/d1d/f4f 0 2024-09-19T06:08:44.057 INFO:tasks.workunit.client.0.smithi037.stdout:5/376: mkdir d2/d12/d24/d58/d7f 0 2024-09-19T06:08:44.062 INFO:tasks.workunit.client.0.smithi037.stdout:4/339: mknod d0/d2/d2e/d36/c73 0 2024-09-19T06:08:44.062 INFO:tasks.workunit.client.0.smithi037.stdout:4/340: write d0/d2/d2e/f43 [519529,50041] 0 2024-09-19T06:08:44.062 INFO:tasks.workunit.client.0.smithi037.stdout:6/322: getdents d9/dd/d1c 0 2024-09-19T06:08:44.062 INFO:tasks.workunit.client.0.smithi037.stdout:6/323: chown d9/dd/d1c/d4e/d2f/d55/l5f 13509681 1 2024-09-19T06:08:44.063 INFO:tasks.workunit.client.0.smithi037.stdout:5/377: creat d2/f80 x:0 0 0 2024-09-19T06:08:44.064 INFO:tasks.workunit.client.0.smithi037.stdout:4/341: chown d0/c17 999737 1 2024-09-19T06:08:44.065 INFO:tasks.workunit.client.0.smithi037.stdout:5/378: symlink d2/d12/d24/d58/l81 0 2024-09-19T06:08:44.068 INFO:tasks.workunit.client.0.smithi037.stdout:5/379: mkdir d2/d12/d28/d57/d82 0 2024-09-19T06:08:44.070 INFO:tasks.workunit.client.0.smithi037.stdout:5/380: rename d2/d12/d28/f5b to d2/d12/d28/d22/d53/f83 0 2024-09-19T06:08:44.070 INFO:tasks.workunit.client.0.smithi037.stdout:5/381: write d2/fa [2287054,23777] 0 2024-09-19T06:08:44.070 INFO:tasks.workunit.client.0.smithi037.stdout:5/382: fsync d2/d12/f5d 0 2024-09-19T06:08:44.073 INFO:tasks.workunit.client.0.smithi037.stdout:0/420: dwrite d5/d8/d44/f6f [0,4194304] 0 2024-09-19T06:08:44.078 INFO:tasks.workunit.client.0.smithi037.stdout:2/454: write d1/f43 [197737,47830] 0 2024-09-19T06:08:44.078 INFO:tasks.workunit.client.0.smithi037.stdout:2/455: chown d1/da/f3e 293726032 1 2024-09-19T06:08:44.078 INFO:tasks.workunit.client.0.smithi037.stdout:2/456: dread - d1/da/dc/d21/d51/f9c zero size 2024-09-19T06:08:44.079 INFO:tasks.workunit.client.0.smithi037.stdout:0/421: rename d5/d8/c3a to d5/d18/d68/d85/c8e 0 2024-09-19T06:08:44.079 INFO:tasks.workunit.client.0.smithi037.stdout:3/377: dwrite d0/d16/d19/f1c [0,4194304] 0 2024-09-19T06:08:44.079 INFO:tasks.workunit.client.0.smithi037.stdout:5/383: fsync d2/fa 0 2024-09-19T06:08:44.081 INFO:tasks.workunit.client.0.smithi037.stdout:7/263: dwrite d6/d20/d2c/f31 [0,4194304] 0 2024-09-19T06:08:44.087 INFO:tasks.workunit.client.0.smithi037.stdout:0/422: symlink d5/d42/l8f 0 2024-09-19T06:08:44.087 INFO:tasks.workunit.client.0.smithi037.stdout:0/423: readlink d5/d8/l1b 0 2024-09-19T06:08:44.088 INFO:tasks.workunit.client.0.smithi037.stdout:6/324: dread d9/dd/d1c/f41 [0,4194304] 0 2024-09-19T06:08:44.091 INFO:tasks.workunit.client.0.smithi037.stdout:6/325: link d9/c31 d9/dd/d1c/d4e/d2f/d55/c60 0 2024-09-19T06:08:44.091 INFO:tasks.workunit.client.0.smithi037.stdout:6/326: dread - d9/f57 zero size 2024-09-19T06:08:44.091 INFO:tasks.workunit.client.0.smithi037.stdout:6/327: dread - d9/dd/d1c/f58 zero size 2024-09-19T06:08:44.091 INFO:tasks.workunit.client.0.smithi037.stdout:6/328: chown d9/dd/d1c/d4e/d2f 976721688 1 2024-09-19T06:08:44.091 INFO:tasks.workunit.client.0.smithi037.stdout:6/329: readlink d9/d16/l5c 0 2024-09-19T06:08:44.092 INFO:tasks.workunit.client.0.smithi037.stdout:6/330: creat d9/dd/d2b/f61 x:0 0 0 2024-09-19T06:08:44.099 INFO:tasks.workunit.client.0.smithi037.stdout:8/506: dwrite d1/d61/d7e/d8b/d91/d3d/f16 [0,4194304] 0 2024-09-19T06:08:44.099 INFO:tasks.workunit.client.0.smithi037.stdout:4/342: dwrite d0/d6/d45/d4a/f6c [0,4194304] 0 2024-09-19T06:08:44.103 INFO:tasks.workunit.client.0.smithi037.stdout:1/308: dwrite d2/f4 [0,4194304] 0 2024-09-19T06:08:44.110 INFO:tasks.workunit.client.0.smithi037.stdout:0/424: dread d5/d8/d11/f16 [0,4194304] 0 2024-09-19T06:08:44.110 INFO:tasks.workunit.client.0.smithi037.stdout:2/457: dwrite d1/da/dc/d21/d7d/f2e [0,4194304] 0 2024-09-19T06:08:44.113 INFO:tasks.workunit.client.0.smithi037.stdout:3/378: dread d0/d16/f22 [0,4194304] 0 2024-09-19T06:08:44.116 INFO:tasks.workunit.client.0.smithi037.stdout:7/264: dread d6/d20/d2c/f31 [0,4194304] 0 2024-09-19T06:08:44.116 INFO:tasks.workunit.client.0.smithi037.stdout:7/265: read d6/f2b [2191205,7041] 0 2024-09-19T06:08:44.117 INFO:tasks.workunit.client.0.smithi037.stdout:8/507: creat d1/d61/d7e/d8b/d9f/fad x:0 0 0 2024-09-19T06:08:44.117 INFO:tasks.workunit.client.0.smithi037.stdout:8/508: chown d1/d8f/da1 0 1 2024-09-19T06:08:44.117 INFO:tasks.workunit.client.0.smithi037.stdout:5/384: dwrite d2/d12/f17 [0,4194304] 0 2024-09-19T06:08:44.117 INFO:tasks.workunit.client.0.smithi037.stdout:5/385: stat d2/d12/f17 0 2024-09-19T06:08:44.118 INFO:tasks.workunit.client.0.smithi037.stdout:1/309: creat d2/d12/d1d/d47/f68 x:0 0 0 2024-09-19T06:08:44.118 INFO:tasks.workunit.client.0.smithi037.stdout:1/310: chown d2/d12/d1d/l3e 6695 1 2024-09-19T06:08:44.119 INFO:tasks.workunit.client.0.smithi037.stdout:2/458: getdents d1/d33/d4c 0 2024-09-19T06:08:44.119 INFO:tasks.workunit.client.0.smithi037.stdout:6/331: dwrite d9/dd/d2b/f50 [0,4194304] 0 2024-09-19T06:08:44.119 INFO:tasks.workunit.client.0.smithi037.stdout:6/332: fsync d9/dd/f1b 0 2024-09-19T06:08:44.119 INFO:tasks.workunit.client.0.smithi037.stdout:2/459: write d1/d16/d96/f9b [386237,129089] 0 2024-09-19T06:08:44.120 INFO:tasks.workunit.client.0.smithi037.stdout:1/311: write d2/d12/d1e/d2a/f60 [171567,46208] 0 2024-09-19T06:08:44.121 INFO:tasks.workunit.client.0.smithi037.stdout:3/379: rename d0/d16/f60 to d0/d16/d19/d1d/d7c/f85 0 2024-09-19T06:08:44.121 INFO:tasks.workunit.client.0.smithi037.stdout:3/380: stat d0/ff 0 2024-09-19T06:08:44.127 INFO:tasks.workunit.client.0.smithi037.stdout:4/343: dwrite d0/d2/f1d [4194304,4194304] 0 2024-09-19T06:08:44.131 INFO:tasks.workunit.client.0.smithi037.stdout:5/386: symlink d2/d12/d28/d22/d53/l84 0 2024-09-19T06:08:44.132 INFO:tasks.workunit.client.0.smithi037.stdout:5/387: chown d2/d5c/f7b 3 1 2024-09-19T06:08:44.134 INFO:tasks.workunit.client.0.smithi037.stdout:0/425: write d5/d8/f3f [3461481,63260] 0 2024-09-19T06:08:44.134 INFO:tasks.workunit.client.0.smithi037.stdout:0/426: write d5/d20/f7c [644343,126358] 0 2024-09-19T06:08:44.135 INFO:tasks.workunit.client.0.smithi037.stdout:8/509: rename d1/d61/d7e/d8b/d91/d3d/f2f to d1/d62/d59/d5d/fae 0 2024-09-19T06:08:44.136 INFO:tasks.workunit.client.0.smithi037.stdout:1/312: mknod d2/d12/d15/d5c/c69 0 2024-09-19T06:08:44.136 INFO:tasks.workunit.client.0.smithi037.stdout:4/344: mknod d0/d6/c74 0 2024-09-19T06:08:44.137 INFO:tasks.workunit.client.0.smithi037.stdout:5/388: getdents d2/d12/d28/d22 0 2024-09-19T06:08:44.138 INFO:tasks.workunit.client.0.smithi037.stdout:7/266: dread d6/dc/f1b [0,4194304] 0 2024-09-19T06:08:44.138 INFO:tasks.workunit.client.0.smithi037.stdout:0/427: link d5/d8/d11/d15/d21/f49 d5/d8/d11/d15/f90 0 2024-09-19T06:08:44.138 INFO:tasks.workunit.client.0.smithi037.stdout:8/510: unlink d1/c28 0 2024-09-19T06:08:44.141 INFO:tasks.workunit.client.0.smithi037.stdout:4/345: truncate d0/f27 6816063 0 2024-09-19T06:08:44.145 INFO:tasks.workunit.client.0.smithi037.stdout:5/389: mknod d2/d5c/c85 0 2024-09-19T06:08:44.145 INFO:tasks.workunit.client.0.smithi037.stdout:5/390: write d2/d12/d28/d57/f75 [313962,35074] 0 2024-09-19T06:08:44.147 INFO:tasks.workunit.client.0.smithi037.stdout:8/511: mkdir d1/d62/d59/daf 0 2024-09-19T06:08:44.147 INFO:tasks.workunit.client.0.smithi037.stdout:4/346: truncate d0/d2/d2e/d36/f4e 25352 0 2024-09-19T06:08:44.150 INFO:tasks.workunit.client.0.smithi037.stdout:3/381: write d0/d43/d23/f69 [3773438,55157] 0 2024-09-19T06:08:44.151 INFO:tasks.workunit.client.0.smithi037.stdout:3/382: write d0/d43/d23/d7a/d77/f5c [1117601,11636] 0 2024-09-19T06:08:44.151 INFO:tasks.workunit.client.0.smithi037.stdout:3/383: chown d0/d43/d23/d7a/d77/f5c 10 1 2024-09-19T06:08:44.151 INFO:tasks.workunit.client.0.smithi037.stdout:3/384: write d0/d16/d19/f75 [393416,44966] 0 2024-09-19T06:08:44.151 INFO:tasks.workunit.client.0.smithi037.stdout:5/391: rename d2/d12/f17 to d2/d12/d28/d57/d82/f86 0 2024-09-19T06:08:44.152 INFO:tasks.workunit.client.0.smithi037.stdout:6/333: dwrite d9/f24 [0,4194304] 0 2024-09-19T06:08:44.152 INFO:tasks.workunit.client.0.smithi037.stdout:6/334: write d9/dd/d1c/f47 [850613,107268] 0 2024-09-19T06:08:44.152 INFO:tasks.workunit.client.0.smithi037.stdout:6/335: write d9/dd/d2b/f61 [556826,113220] 0 2024-09-19T06:08:44.153 INFO:tasks.workunit.client.0.smithi037.stdout:8/512: link d1/d62/d59/c80 d1/d62/d59/d5d/cb0 0 2024-09-19T06:08:44.155 INFO:tasks.workunit.client.0.smithi037.stdout:4/347: creat d0/d6/f75 x:0 0 0 2024-09-19T06:08:44.157 INFO:tasks.workunit.client.0.smithi037.stdout:5/392: mkdir d2/d12/d28/d22/d87 0 2024-09-19T06:08:44.158 INFO:tasks.workunit.client.0.smithi037.stdout:6/336: mkdir d9/dd/d1c/d4e/d62 0 2024-09-19T06:08:44.159 INFO:tasks.workunit.client.0.smithi037.stdout:2/460: dwrite d1/da/dc/d21/d7d/d80/f81 [0,4194304] 0 2024-09-19T06:08:44.159 INFO:tasks.workunit.client.0.smithi037.stdout:2/461: chown d1/da/dc 28597 1 2024-09-19T06:08:44.159 INFO:tasks.workunit.client.0.smithi037.stdout:2/462: chown d1/da/dc/d21/d7d/f2e 798972888 1 2024-09-19T06:08:44.160 INFO:tasks.workunit.client.0.smithi037.stdout:8/513: rename d1/f6 to d1/d61/d7e/d8b/d91/d3d/fb1 0 2024-09-19T06:08:44.160 INFO:tasks.workunit.client.0.smithi037.stdout:8/514: write d1/d6a/fa7 [312491,95510] 0 2024-09-19T06:08:44.161 INFO:tasks.workunit.client.0.smithi037.stdout:4/348: creat d0/d6/d1b/d20/d4d/d64/f76 x:0 0 0 2024-09-19T06:08:44.161 INFO:tasks.workunit.client.0.smithi037.stdout:7/267: write d6/dc/d22/f1a [857447,31457] 0 2024-09-19T06:08:44.162 INFO:tasks.workunit.client.0.smithi037.stdout:5/393: rmdir d2/d12/d28/d22/d53 39 2024-09-19T06:08:44.162 INFO:tasks.workunit.client.0.smithi037.stdout:9/490: sync 2024-09-19T06:08:44.162 INFO:tasks.workunit.client.0.smithi037.stdout:6/337: rmdir d9/d16 39 2024-09-19T06:08:44.165 INFO:tasks.workunit.client.0.smithi037.stdout:2/463: mkdir d1/d6/da3/da8 0 2024-09-19T06:08:44.165 INFO:tasks.workunit.client.0.smithi037.stdout:1/313: getdents d2/d12/d15/d5c 0 2024-09-19T06:08:44.167 INFO:tasks.workunit.client.0.smithi037.stdout:8/515: creat d1/d61/d7e/fb2 x:0 0 0 2024-09-19T06:08:44.169 INFO:tasks.workunit.client.0.smithi037.stdout:4/349: unlink d0/d6/d1b/c56 0 2024-09-19T06:08:44.172 INFO:tasks.workunit.client.0.smithi037.stdout:7/268: rename d6/d20/d2c/d48 to d6/d20/d4b 0 2024-09-19T06:08:44.173 INFO:tasks.workunit.client.0.smithi037.stdout:6/338: rmdir d9 39 2024-09-19T06:08:44.175 INFO:tasks.workunit.client.0.smithi037.stdout:1/314: getdents d2/d12/d1e 0 2024-09-19T06:08:44.176 INFO:tasks.workunit.client.0.smithi037.stdout:3/385: dwrite d0/f5a [0,4194304] 0 2024-09-19T06:08:44.178 INFO:tasks.workunit.client.0.smithi037.stdout:8/516: creat d1/d62/d59/daf/fb3 x:0 0 0 2024-09-19T06:08:44.178 INFO:tasks.workunit.client.0.smithi037.stdout:5/394: dread d2/d12/d28/f3f [4194304,4194304] 0 2024-09-19T06:08:44.179 INFO:tasks.workunit.client.0.smithi037.stdout:4/350: getdents d0/d6/d1b/d20/d4d 0 2024-09-19T06:08:44.180 INFO:tasks.workunit.client.0.smithi037.stdout:1/315: write d2/d12/d1d/f45 [15019,30161] 0 2024-09-19T06:08:44.181 INFO:tasks.workunit.client.0.smithi037.stdout:7/269: creat d6/dc/d22/f4c x:0 0 0 2024-09-19T06:08:44.183 INFO:tasks.workunit.client.0.smithi037.stdout:6/339: creat d9/dd/d1c/d4e/d2f/f63 x:0 0 0 2024-09-19T06:08:44.183 INFO:tasks.workunit.client.0.smithi037.stdout:6/340: readlink d9/dd/l10 0 2024-09-19T06:08:44.184 INFO:tasks.workunit.client.0.smithi037.stdout:6/341: chown d9/dd/d2b/d42/f49 524055 1 2024-09-19T06:08:44.188 INFO:tasks.workunit.client.0.smithi037.stdout:3/386: rmdir d0 39 2024-09-19T06:08:44.189 INFO:tasks.workunit.client.0.smithi037.stdout:9/491: dwrite da/dd/d63/f90 [0,4194304] 0 2024-09-19T06:08:44.190 INFO:tasks.workunit.client.0.smithi037.stdout:8/517: getdents d1/d62 0 2024-09-19T06:08:44.190 INFO:tasks.workunit.client.0.smithi037.stdout:1/316: creat d2/d12/d1e/d63/f6a x:0 0 0 2024-09-19T06:08:44.191 INFO:tasks.workunit.client.0.smithi037.stdout:7/270: truncate d6/dc/d22/f36 838713 0 2024-09-19T06:08:44.193 INFO:tasks.workunit.client.0.smithi037.stdout:6/342: symlink d9/dd/d20/d5a/l64 0 2024-09-19T06:08:44.193 INFO:tasks.workunit.client.0.smithi037.stdout:6/343: chown d9/dd/d2b/c2c 0 1 2024-09-19T06:08:44.193 INFO:tasks.workunit.client.0.smithi037.stdout:6/344: fdatasync d9/f19 0 2024-09-19T06:08:44.193 INFO:tasks.workunit.client.0.smithi037.stdout:6/345: chown d9/d16/f4a 227 1 2024-09-19T06:08:44.193 INFO:tasks.workunit.client.0.smithi037.stdout:3/387: mkdir d0/d16/d19/d1d/d82/d86 0 2024-09-19T06:08:44.194 INFO:tasks.workunit.client.0.smithi037.stdout:3/388: fsync d0/d16/d19/d1d/f39 0 2024-09-19T06:08:44.194 INFO:tasks.workunit.client.0.smithi037.stdout:9/492: creat da/dd/d1b/d2f/d6f/faf x:0 0 0 2024-09-19T06:08:44.196 INFO:tasks.workunit.client.0.smithi037.stdout:5/395: dread d2/d12/f27 [0,4194304] 0 2024-09-19T06:08:44.197 INFO:tasks.workunit.client.0.smithi037.stdout:9/493: mknod da/dd/cb0 0 2024-09-19T06:08:44.198 INFO:tasks.workunit.client.0.smithi037.stdout:2/464: dwrite d1/d16/d62/f73 [0,4194304] 0 2024-09-19T06:08:44.200 INFO:tasks.workunit.client.0.smithi037.stdout:8/518: rename d1/d61/d7e/d8b/d91/d3d/f19 to d1/d35/fb4 0 2024-09-19T06:08:44.202 INFO:tasks.workunit.client.0.smithi037.stdout:4/351: read d0/d6/d1b/f28 [3377803,24824] 0 2024-09-19T06:08:44.202 INFO:tasks.workunit.client.0.smithi037.stdout:4/352: chown d0/d6/d1b/d20/c38 47 1 2024-09-19T06:08:44.206 INFO:tasks.workunit.client.0.smithi037.stdout:6/346: dread d9/d16/f26 [0,4194304] 0 2024-09-19T06:08:44.206 INFO:tasks.workunit.client.0.smithi037.stdout:6/347: truncate d9/dd/f59 87762 0 2024-09-19T06:08:44.208 INFO:tasks.workunit.client.0.smithi037.stdout:7/271: read d6/dc/f25 [4091017,104802] 0 2024-09-19T06:08:44.209 INFO:tasks.workunit.client.0.smithi037.stdout:7/272: chown d6/dc/df/f41 53 1 2024-09-19T06:08:44.209 INFO:tasks.workunit.client.0.smithi037.stdout:7/273: read - d6/dc/f47 zero size 2024-09-19T06:08:44.210 INFO:tasks.workunit.client.0.smithi037.stdout:5/396: rename d2/d12/d28/d22/d35/l6f to d2/d5c/l88 0 2024-09-19T06:08:44.210 INFO:tasks.workunit.client.0.smithi037.stdout:8/519: getdents d1 0 2024-09-19T06:08:44.210 INFO:tasks.workunit.client.0.smithi037.stdout:8/520: write d1/d61/d7e/d8b/d91/f50 [974265,80552] 0 2024-09-19T06:08:44.210 INFO:tasks.workunit.client.0.smithi037.stdout:2/465: truncate d1/da/dc/f45 4662085 0 2024-09-19T06:08:44.210 INFO:tasks.workunit.client.0.smithi037.stdout:2/466: chown d1/da/f6d 13 1 2024-09-19T06:08:44.212 INFO:tasks.workunit.client.0.smithi037.stdout:6/348: unlink d9/dd/d1c/d4e/d2f/f35 0 2024-09-19T06:08:44.215 INFO:tasks.workunit.client.0.smithi037.stdout:9/494: rename da/d20/c67 to da/d4d/cb1 0 2024-09-19T06:08:44.215 INFO:tasks.workunit.client.0.smithi037.stdout:9/495: read - da/dd/d63/f9b zero size 2024-09-19T06:08:44.215 INFO:tasks.workunit.client.0.smithi037.stdout:9/496: fsync da/dd/d1b/d56/f58 0 2024-09-19T06:08:44.216 INFO:tasks.workunit.client.0.smithi037.stdout:5/397: unlink d2/d12/d28/f74 0 2024-09-19T06:08:44.223 INFO:tasks.workunit.client.0.smithi037.stdout:9/497: dread da/f9a [0,4194304] 0 2024-09-19T06:08:44.223 INFO:tasks.workunit.client.0.smithi037.stdout:9/498: fdatasync da/dd/d1b/f21 0 2024-09-19T06:08:44.224 INFO:tasks.workunit.client.0.smithi037.stdout:1/317: dwrite d2/f28 [0,4194304] 0 2024-09-19T06:08:44.224 INFO:tasks.workunit.client.0.smithi037.stdout:1/318: dread - d2/d12/d1e/f67 zero size 2024-09-19T06:08:44.224 INFO:tasks.workunit.client.0.smithi037.stdout:1/319: readlink d2/d12/d15/d34/l5e 0 2024-09-19T06:08:44.224 INFO:tasks.workunit.client.0.smithi037.stdout:1/320: write d2/d12/d1d/f45 [654467,36270] 0 2024-09-19T06:08:44.226 INFO:tasks.workunit.client.0.smithi037.stdout:6/349: mkdir d9/dd/d1c/d4e/d65 0 2024-09-19T06:08:44.231 INFO:tasks.workunit.client.0.smithi037.stdout:7/274: write d6/dc/f14 [586735,38361] 0 2024-09-19T06:08:44.231 INFO:tasks.workunit.client.0.smithi037.stdout:4/353: dwrite d0/d2/f2c [0,4194304] 0 2024-09-19T06:08:44.231 INFO:tasks.workunit.client.0.smithi037.stdout:9/499: rename da/f27 to da/dd/d1b/d2f/fb2 0 2024-09-19T06:08:44.235 INFO:tasks.workunit.client.0.smithi037.stdout:1/321: mkdir d2/d12/d1d/d6b 0 2024-09-19T06:08:44.235 INFO:tasks.workunit.client.0.smithi037.stdout:6/350: symlink d9/dd/d1c/d4e/d33/l66 0 2024-09-19T06:08:44.238 INFO:tasks.workunit.client.0.smithi037.stdout:2/467: dwrite d1/d6/f24 [0,4194304] 0 2024-09-19T06:08:44.242 INFO:tasks.workunit.client.0.smithi037.stdout:3/389: dwrite d0/d43/d23/f69 [0,4194304] 0 2024-09-19T06:08:44.244 INFO:tasks.workunit.client.0.smithi037.stdout:4/354: mkdir d0/d6/d1b/d20/d77 0 2024-09-19T06:08:44.246 INFO:tasks.workunit.client.0.smithi037.stdout:2/468: write d1/da/f6d [97681,74409] 0 2024-09-19T06:08:44.246 INFO:tasks.workunit.client.0.smithi037.stdout:5/398: write d2/d12/d28/d57/d82/f86 [4035974,11829] 0 2024-09-19T06:08:44.246 INFO:tasks.workunit.client.0.smithi037.stdout:5/399: chown d2/d12/d28/d22/l46 0 1 2024-09-19T06:08:44.246 INFO:tasks.workunit.client.0.smithi037.stdout:1/322: symlink d2/d12/d1e/d2a/d2e/l6c 0 2024-09-19T06:08:44.246 INFO:tasks.workunit.client.0.smithi037.stdout:6/351: unlink d9/dd/d20/l45 0 2024-09-19T06:08:44.246 INFO:tasks.workunit.client.0.smithi037.stdout:4/355: read d0/d2/d2e/d36/f47 [405505,57739] 0 2024-09-19T06:08:44.246 INFO:tasks.workunit.client.0.smithi037.stdout:4/356: fsync d0/f16 0 2024-09-19T06:08:44.248 INFO:tasks.workunit.client.0.smithi037.stdout:3/390: mkdir d0/d16/d19/d33/d87 0 2024-09-19T06:08:44.255 INFO:tasks.workunit.client.0.smithi037.stdout:7/275: write d6/f12 [2298822,12149] 0 2024-09-19T06:08:44.256 INFO:tasks.workunit.client.0.smithi037.stdout:8/521: dwrite d1/d62/d59/d5d/f8a [0,4194304] 0 2024-09-19T06:08:44.256 INFO:tasks.workunit.client.0.smithi037.stdout:2/469: symlink d1/da/d95/la9 0 2024-09-19T06:08:44.256 INFO:tasks.workunit.client.0.smithi037.stdout:7/276: write d6/f38 [1169118,79084] 0 2024-09-19T06:08:44.256 INFO:tasks.workunit.client.0.smithi037.stdout:2/470: write d1/da/f19 [1372741,29469] 0 2024-09-19T06:08:44.256 INFO:tasks.workunit.client.0.smithi037.stdout:5/400: creat d2/d12/d28/d22/d53/f89 x:0 0 0 2024-09-19T06:08:44.256 INFO:tasks.workunit.client.0.smithi037.stdout:1/323: unlink d2/d12/d15/f32 0 2024-09-19T06:08:44.256 INFO:tasks.workunit.client.0.smithi037.stdout:1/324: readlink d2/d12/d1e/d2a/d2e/l6c 0 2024-09-19T06:08:44.257 INFO:tasks.workunit.client.0.smithi037.stdout:3/391: creat d0/d16/f88 x:0 0 0 2024-09-19T06:08:44.260 INFO:tasks.workunit.client.0.smithi037.stdout:7/277: link d6/d21/c4a d6/d20/d34/d49/c4d 0 2024-09-19T06:08:44.260 INFO:tasks.workunit.client.0.smithi037.stdout:9/500: dwrite da/dd/d1b/d43/f54 [0,4194304] 0 2024-09-19T06:08:44.263 INFO:tasks.workunit.client.0.smithi037.stdout:5/401: unlink d2/d12/d28/d22/d4a/f54 0 2024-09-19T06:08:44.264 INFO:tasks.workunit.client.0.smithi037.stdout:3/392: symlink d0/d43/d23/d7a/d77/d45/l89 0 2024-09-19T06:08:44.271 INFO:tasks.workunit.client.0.smithi037.stdout:7/278: mknod d6/d20/d34/d49/c4e 0 2024-09-19T06:08:44.273 INFO:tasks.workunit.client.0.smithi037.stdout:5/402: truncate d2/d12/f4f 809240 0 2024-09-19T06:08:44.274 INFO:tasks.workunit.client.0.smithi037.stdout:6/352: dwrite d9/d16/f26 [4194304,4194304] 0 2024-09-19T06:08:44.274 INFO:tasks.workunit.client.0.smithi037.stdout:3/393: symlink d0/d43/d23/d7a/d77/d45/d55/l8a 0 2024-09-19T06:08:44.276 INFO:tasks.workunit.client.0.smithi037.stdout:7/279: write d6/f1d [69754,130543] 0 2024-09-19T06:08:44.277 INFO:tasks.workunit.client.0.smithi037.stdout:7/280: chown d6/d20/d34/d49 36 1 2024-09-19T06:08:44.277 INFO:tasks.workunit.client.0.smithi037.stdout:6/353: creat d9/dd/d1c/d4e/d65/f67 x:0 0 0 2024-09-19T06:08:44.280 INFO:tasks.workunit.client.0.smithi037.stdout:2/471: write d1/da/d42/f50 [2633424,5155] 0 2024-09-19T06:08:44.280 INFO:tasks.workunit.client.0.smithi037.stdout:2/472: write d1/d16/f37 [2830061,111498] 0 2024-09-19T06:08:44.280 INFO:tasks.workunit.client.0.smithi037.stdout:2/473: write d1/f43 [917801,119125] 0 2024-09-19T06:08:44.280 INFO:tasks.workunit.client.0.smithi037.stdout:7/281: mknod d6/d20/d2c/d33/c4f 0 2024-09-19T06:08:44.281 INFO:tasks.workunit.client.0.smithi037.stdout:6/354: symlink d9/dd/d1c/l68 0 2024-09-19T06:08:44.282 INFO:tasks.workunit.client.0.smithi037.stdout:3/394: link d0/cd d0/d43/d37/c8b 0 2024-09-19T06:08:44.283 INFO:tasks.workunit.client.0.smithi037.stdout:2/474: mknod d1/da/dc/d21/d7d/caa 0 2024-09-19T06:08:44.286 INFO:tasks.workunit.client.0.smithi037.stdout:6/355: symlink d9/dd/d20/l69 0 2024-09-19T06:08:44.287 INFO:tasks.workunit.client.0.smithi037.stdout:2/475: rename d1/da/d42 to d1/da/dc/d21/d7d/dab 0 2024-09-19T06:08:44.289 INFO:tasks.workunit.client.0.smithi037.stdout:6/356: rename d9/f57 to d9/dd/d20/d5a/f6a 0 2024-09-19T06:08:44.290 INFO:tasks.workunit.client.0.smithi037.stdout:2/476: unlink d1/da/dc/d21/d7d/f68 0 2024-09-19T06:08:44.299 INFO:tasks.workunit.client.0.smithi037.stdout:9/501: dwrite da/dd/d1b/d2f/f65 [4194304,4194304] 0 2024-09-19T06:08:44.299 INFO:tasks.workunit.client.0.smithi037.stdout:4/357: dwrite d0/f53 [0,4194304] 0 2024-09-19T06:08:44.299 INFO:tasks.workunit.client.0.smithi037.stdout:1/325: dread d2/d12/f25 [0,4194304] 0 2024-09-19T06:08:44.299 INFO:tasks.workunit.client.0.smithi037.stdout:1/326: write d2/fa [686384,95270] 0 2024-09-19T06:08:44.303 INFO:tasks.workunit.client.0.smithi037.stdout:4/358: creat d0/d6/d1b/f78 x:0 0 0 2024-09-19T06:08:44.304 INFO:tasks.workunit.client.0.smithi037.stdout:5/403: dwrite d2/f52 [0,4194304] 0 2024-09-19T06:08:44.312 INFO:tasks.workunit.client.0.smithi037.stdout:1/327: creat d2/d48/f6d x:0 0 0 2024-09-19T06:08:44.313 INFO:tasks.workunit.client.0.smithi037.stdout:4/359: creat d0/d2/d2e/d36/f79 x:0 0 0 2024-09-19T06:08:44.313 INFO:tasks.workunit.client.0.smithi037.stdout:4/360: stat d0/f41 0 2024-09-19T06:08:44.313 INFO:tasks.workunit.client.0.smithi037.stdout:3/395: dwrite d0/d16/d19/f29 [0,4194304] 0 2024-09-19T06:08:44.313 INFO:tasks.workunit.client.0.smithi037.stdout:3/396: chown d0/d5f/d70 26621 1 2024-09-19T06:08:44.313 INFO:tasks.workunit.client.0.smithi037.stdout:3/397: write d0/f7 [3198253,99850] 0 2024-09-19T06:08:44.314 INFO:tasks.workunit.client.0.smithi037.stdout:5/404: truncate d2/d12/f36 2317994 0 2024-09-19T06:08:44.314 INFO:tasks.workunit.client.0.smithi037.stdout:5/405: write d2/d12/f4f [1695680,23200] 0 2024-09-19T06:08:44.314 INFO:tasks.workunit.client.0.smithi037.stdout:7/282: dwrite d6/dc/fe [0,4194304] 0 2024-09-19T06:08:44.314 INFO:tasks.workunit.client.0.smithi037.stdout:7/283: truncate d6/dc/fd 1535377 0 2024-09-19T06:08:44.318 INFO:tasks.workunit.client.0.smithi037.stdout:1/328: mknod d2/d12/d1d/c6e 0 2024-09-19T06:08:44.318 INFO:tasks.workunit.client.0.smithi037.stdout:3/398: getdents d0/d43/d23/d7a/d77 0 2024-09-19T06:08:44.322 INFO:tasks.workunit.client.0.smithi037.stdout:1/329: mkdir d2/d12/d1e/d2d/d6f 0 2024-09-19T06:08:44.323 INFO:tasks.workunit.client.0.smithi037.stdout:9/502: dwrite da/dd/d1b/d2f/d6d/f9f [0,4194304] 0 2024-09-19T06:08:44.323 INFO:tasks.workunit.client.0.smithi037.stdout:9/503: chown da/d20/f2a 1 1 2024-09-19T06:08:44.323 INFO:tasks.workunit.client.0.smithi037.stdout:2/477: dwrite d1/da/d95/f97 [0,4194304] 0 2024-09-19T06:08:44.323 INFO:tasks.workunit.client.0.smithi037.stdout:2/478: dread - d1/d16/f91 zero size 2024-09-19T06:08:44.323 INFO:tasks.workunit.client.0.smithi037.stdout:1/330: creat d2/d12/d1e/d2d/d6f/f70 x:0 0 0 2024-09-19T06:08:44.324 INFO:tasks.workunit.client.0.smithi037.stdout:1/331: fdatasync d2/d12/d1e/f67 0 2024-09-19T06:08:44.324 INFO:tasks.workunit.client.0.smithi037.stdout:1/332: chown d2/d12/d1d/c6e 501 1 2024-09-19T06:08:44.327 INFO:tasks.workunit.client.0.smithi037.stdout:9/504: unlink da/dd/d1b/d62/l71 0 2024-09-19T06:08:44.328 INFO:tasks.workunit.client.0.smithi037.stdout:2/479: link d1/da/dc/d21/d7d/d80/f81 d1/da/d95/fac 0 2024-09-19T06:08:44.331 INFO:tasks.workunit.client.0.smithi037.stdout:9/505: dread da/dd/d1b/d2f/d38/f55 [0,4194304] 0 2024-09-19T06:08:44.339 INFO:tasks.workunit.client.0.smithi037.stdout:4/361: dwrite d0/d2/d2e/d36/f79 [0,4194304] 0 2024-09-19T06:08:44.345 INFO:tasks.workunit.client.0.smithi037.stdout:5/406: dwrite d2/f52 [4194304,4194304] 0 2024-09-19T06:08:44.350 INFO:tasks.workunit.client.0.smithi037.stdout:3/399: dwrite d0/d16/d19/f2e [0,4194304] 0 2024-09-19T06:08:44.350 INFO:tasks.workunit.client.0.smithi037.stdout:1/333: dwrite d2/d48/f62 [0,4194304] 0 2024-09-19T06:08:44.351 INFO:tasks.workunit.client.0.smithi037.stdout:1/334: write d2/f4 [5680237,49098] 0 2024-09-19T06:08:44.351 INFO:tasks.workunit.client.0.smithi037.stdout:1/335: rename d2 to d2/d12/d17/d71 22 2024-09-19T06:08:44.351 INFO:tasks.workunit.client.0.smithi037.stdout:1/336: fsync d2/d12/d15/f27 0 2024-09-19T06:08:44.351 INFO:tasks.workunit.client.0.smithi037.stdout:9/506: write da/dd/d1b/f3d [3958016,97476] 0 2024-09-19T06:08:44.351 INFO:tasks.workunit.client.0.smithi037.stdout:9/507: write da/dd/d1b/d2f/d38/f4e [4794213,89345] 0 2024-09-19T06:08:44.351 INFO:tasks.workunit.client.0.smithi037.stdout:9/508: fdatasync da/dd/d63/f9b 0 2024-09-19T06:08:44.351 INFO:tasks.workunit.client.0.smithi037.stdout:3/400: creat d0/d43/d37/f8c x:0 0 0 2024-09-19T06:08:44.351 INFO:tasks.workunit.client.0.smithi037.stdout:3/401: write d0/d16/d19/d1d/d5e/f83 [1345578,71515] 0 2024-09-19T06:08:44.352 INFO:tasks.workunit.client.0.smithi037.stdout:4/362: write d0/d6/f26 [1030253,25917] 0 2024-09-19T06:08:44.352 INFO:tasks.workunit.client.0.smithi037.stdout:4/363: fsync d0/d2/f19 0 2024-09-19T06:08:44.353 INFO:tasks.workunit.client.0.smithi037.stdout:1/337: creat d2/d12/d1d/d47/f72 x:0 0 0 2024-09-19T06:08:44.355 INFO:tasks.workunit.client.0.smithi037.stdout:4/364: truncate d0/d2/f2b 416399 0 2024-09-19T06:08:44.355 INFO:tasks.workunit.client.0.smithi037.stdout:4/365: read d0/d6/f26 [2905389,79523] 0 2024-09-19T06:08:44.356 INFO:tasks.workunit.client.0.smithi037.stdout:4/366: creat d0/f7a x:0 0 0 2024-09-19T06:08:44.358 INFO:tasks.workunit.client.0.smithi037.stdout:1/338: mkdir d2/d73 0 2024-09-19T06:08:44.358 INFO:tasks.workunit.client.0.smithi037.stdout:1/339: fdatasync d2/d12/d1d/d47/f72 0 2024-09-19T06:08:44.358 INFO:tasks.workunit.client.0.smithi037.stdout:1/340: chown d2/d12/d17/c2c 658820 1 2024-09-19T06:08:44.359 INFO:tasks.workunit.client.0.smithi037.stdout:1/341: creat d2/d12/d1e/d2d/f74 x:0 0 0 2024-09-19T06:08:44.361 INFO:tasks.workunit.client.0.smithi037.stdout:5/407: write d2/d12/f36 [672205,24278] 0 2024-09-19T06:08:44.361 INFO:tasks.workunit.client.0.smithi037.stdout:1/342: dread - d2/d12/d1e/d2d/f55 zero size 2024-09-19T06:08:44.361 INFO:tasks.workunit.client.0.smithi037.stdout:1/343: chown d2/d12/d1d/c6e 6 1 2024-09-19T06:08:44.364 INFO:tasks.workunit.client.0.smithi037.stdout:5/408: creat d2/d12/d28/d22/d53/f8a x:0 0 0 2024-09-19T06:08:44.364 INFO:tasks.workunit.client.0.smithi037.stdout:1/344: truncate d2/d12/f13 596507 0 2024-09-19T06:08:44.364 INFO:tasks.workunit.client.0.smithi037.stdout:5/409: fdatasync d2/f80 0 2024-09-19T06:08:44.364 INFO:tasks.workunit.client.0.smithi037.stdout:5/410: stat d2/d12/d28/d22/d53/l61 0 2024-09-19T06:08:44.366 INFO:tasks.workunit.client.0.smithi037.stdout:1/345: mkdir d2/d12/d1e/d75 0 2024-09-19T06:08:44.366 INFO:tasks.workunit.client.0.smithi037.stdout:1/346: stat d2/f10 0 2024-09-19T06:08:44.366 INFO:tasks.workunit.client.0.smithi037.stdout:1/347: write d2/d12/d1e/f67 [774088,75082] 0 2024-09-19T06:08:44.368 INFO:tasks.workunit.client.0.smithi037.stdout:5/411: creat d2/d12/d28/d22/f8b x:0 0 0 2024-09-19T06:08:44.368 INFO:tasks.workunit.client.0.smithi037.stdout:5/412: fdatasync d2/d12/f27 0 2024-09-19T06:08:44.368 INFO:tasks.workunit.client.0.smithi037.stdout:5/413: truncate d2/d12/d28/d22/d53/f83 555888 0 2024-09-19T06:08:44.368 INFO:tasks.workunit.client.0.smithi037.stdout:3/402: dread d0/d43/d23/f69 [0,4194304] 0 2024-09-19T06:08:44.369 INFO:tasks.workunit.client.0.smithi037.stdout:1/348: mkdir d2/d12/d1d/d76 0 2024-09-19T06:08:44.378 INFO:tasks.workunit.client.0.smithi037.stdout:5/414: symlink d2/d10/l8c 0 2024-09-19T06:08:44.378 INFO:tasks.workunit.client.0.smithi037.stdout:9/509: dwrite da/d4d/f68 [0,4194304] 0 2024-09-19T06:08:44.378 INFO:tasks.workunit.client.0.smithi037.stdout:9/510: truncate da/dd/d1b/d23/f73 85245 0 2024-09-19T06:08:44.380 INFO:tasks.workunit.client.0.smithi037.stdout:4/367: dwrite d0/d6/f23 [0,4194304] 0 2024-09-19T06:08:44.382 INFO:tasks.workunit.client.0.smithi037.stdout:5/415: symlink d2/d12/d24/d58/l8d 0 2024-09-19T06:08:44.382 INFO:tasks.workunit.client.0.smithi037.stdout:9/511: mkdir da/db3 0 2024-09-19T06:08:44.384 INFO:tasks.workunit.client.0.smithi037.stdout:4/368: creat d0/d6/d1b/d20/d4d/d65/f7b x:0 0 0 2024-09-19T06:08:44.386 INFO:tasks.workunit.client.0.smithi037.stdout:9/512: mkdir da/dd/d1b/d2f/d6d/db4 0 2024-09-19T06:08:44.388 INFO:tasks.workunit.client.0.smithi037.stdout:9/513: creat da/dd/d1b/d23/d6a/d8f/dac/fb5 x:0 0 0 2024-09-19T06:08:44.389 INFO:tasks.workunit.client.0.smithi037.stdout:9/514: creat da/db3/fb6 x:0 0 0 2024-09-19T06:08:44.389 INFO:tasks.workunit.client.0.smithi037.stdout:9/515: write da/dd/d1b/d62/fa1 [4470064,35995] 0 2024-09-19T06:08:44.392 INFO:tasks.workunit.client.0.smithi037.stdout:9/516: creat da/dd/d1b/d23/d6a/d8f/fb7 x:0 0 0 2024-09-19T06:08:44.393 INFO:tasks.workunit.client.0.smithi037.stdout:9/517: mknod da/dd/d1b/d23/d3f/cb8 0 2024-09-19T06:08:44.395 INFO:tasks.workunit.client.0.smithi037.stdout:3/403: dwrite d0/d16/d19/d1d/f2d [0,4194304] 0 2024-09-19T06:08:44.398 INFO:tasks.workunit.client.0.smithi037.stdout:3/404: creat d0/d43/d23/f8d x:0 0 0 2024-09-19T06:08:44.400 INFO:tasks.workunit.client.0.smithi037.stdout:3/405: symlink d0/d16/d19/l8e 0 2024-09-19T06:08:44.402 INFO:tasks.workunit.client.0.smithi037.stdout:3/406: rename d0/la to d0/d43/l8f 0 2024-09-19T06:08:44.411 INFO:tasks.workunit.client.0.smithi037.stdout:4/369: dwrite d0/d2/f19 [0,4194304] 0 2024-09-19T06:08:44.415 INFO:tasks.workunit.client.0.smithi037.stdout:3/407: dread d0/d43/d26/f36 [0,4194304] 0 2024-09-19T06:08:44.415 INFO:tasks.workunit.client.0.smithi037.stdout:3/408: chown d0/d16/d19/d33/f38 2865764 1 2024-09-19T06:08:44.417 INFO:tasks.workunit.client.0.smithi037.stdout:9/518: write da/dd/d1b/d62/fa1 [2203265,41897] 0 2024-09-19T06:08:44.417 INFO:tasks.workunit.client.0.smithi037.stdout:5/416: dwrite d2/d12/d28/f48 [0,4194304] 0 2024-09-19T06:08:44.417 INFO:tasks.workunit.client.0.smithi037.stdout:1/349: dwrite d2/d12/d1e/d2a/f65 [0,4194304] 0 2024-09-19T06:08:44.417 INFO:tasks.workunit.client.0.smithi037.stdout:5/417: truncate d2/d5c/f60 525074 0 2024-09-19T06:08:44.422 INFO:tasks.workunit.client.0.smithi037.stdout:9/519: rmdir da/dd/d1b/d2f/d38 39 2024-09-19T06:08:44.423 INFO:tasks.workunit.client.0.smithi037.stdout:1/350: creat d2/d12/d1e/d63/f77 x:0 0 0 2024-09-19T06:08:44.423 INFO:tasks.workunit.client.0.smithi037.stdout:1/351: chown d2/d12/d1d/f4f 638756 1 2024-09-19T06:08:44.424 INFO:tasks.workunit.client.0.smithi037.stdout:5/418: mkdir d2/d12/d24/d58/d8e 0 2024-09-19T06:08:44.427 INFO:tasks.workunit.client.0.smithi037.stdout:9/520: dread da/dd/d1b/f4c [0,4194304] 0 2024-09-19T06:08:44.433 INFO:tasks.workunit.client.0.smithi037.stdout:1/352: mknod d2/d12/d1d/c78 0 2024-09-19T06:08:44.434 INFO:tasks.workunit.client.0.smithi037.stdout:9/521: mknod da/dd/d1b/d23/d6a/d82/cb9 0 2024-09-19T06:08:44.434 INFO:tasks.workunit.client.0.smithi037.stdout:9/522: chown da/dd/d1b/d2f/d38/f39 75 1 2024-09-19T06:08:44.435 INFO:tasks.workunit.client.0.smithi037.stdout:1/353: getdents d2/d12 0 2024-09-19T06:08:44.436 INFO:tasks.workunit.client.0.smithi037.stdout:9/523: mknod da/dd/d31/cba 0 2024-09-19T06:08:44.437 INFO:tasks.workunit.client.0.smithi037.stdout:1/354: mknod d2/d12/d1e/d2a/c79 0 2024-09-19T06:08:44.438 INFO:tasks.workunit.client.0.smithi037.stdout:1/355: symlink d2/d12/d1e/d2a/l7a 0 2024-09-19T06:08:44.438 INFO:tasks.workunit.client.0.smithi037.stdout:1/356: chown d2/d12/d1e/d2d/d6f/f70 1935 1 2024-09-19T06:08:44.442 INFO:tasks.workunit.client.0.smithi037.stdout:4/370: dwrite d0/f53 [0,4194304] 0 2024-09-19T06:08:44.443 INFO:tasks.workunit.client.0.smithi037.stdout:1/357: read d2/d12/d1d/f1f [146031,37127] 0 2024-09-19T06:08:44.445 INFO:tasks.workunit.client.0.smithi037.stdout:1/358: truncate d2/d12/d1e/d2d/f4c 692228 0 2024-09-19T06:08:44.451 INFO:tasks.workunit.client.0.smithi037.stdout:5/419: dwrite d2/fa [0,4194304] 0 2024-09-19T06:08:44.457 INFO:tasks.workunit.client.0.smithi037.stdout:9/524: dread da/dd/d1b/d2f/fb2 [0,4194304] 0 2024-09-19T06:08:44.457 INFO:tasks.workunit.client.0.smithi037.stdout:1/359: dread d2/d12/d15/d34/f46 [0,4194304] 0 2024-09-19T06:08:44.457 INFO:tasks.workunit.client.0.smithi037.stdout:9/525: mkdir da/d4d/dbb 0 2024-09-19T06:08:44.458 INFO:tasks.workunit.client.0.smithi037.stdout:4/371: dread d0/d2/f19 [0,4194304] 0 2024-09-19T06:08:44.458 INFO:tasks.workunit.client.0.smithi037.stdout:4/372: chown d0/d6/d1b 3205 1 2024-09-19T06:08:44.465 INFO:tasks.workunit.client.0.smithi037.stdout:1/360: rename d2/d12/d1e/d2a/d2e/f31 to d2/d73/f7b 0 2024-09-19T06:08:44.465 INFO:tasks.workunit.client.0.smithi037.stdout:9/526: mknod da/dd/d1b/d23/d3f/cbc 0 2024-09-19T06:08:44.465 INFO:tasks.workunit.client.0.smithi037.stdout:1/361: readlink d2/d12/d1e/d2a/d2e/l39 0 2024-09-19T06:08:44.465 INFO:tasks.workunit.client.0.smithi037.stdout:9/527: write da/f9a [948134,70874] 0 2024-09-19T06:08:44.471 INFO:tasks.workunit.client.0.smithi037.stdout:9/528: symlink da/dd/d63/d80/lbd 0 2024-09-19T06:08:44.472 INFO:tasks.workunit.client.0.smithi037.stdout:9/529: truncate da/dd/d1b/d62/f75 521371 0 2024-09-19T06:08:44.473 INFO:tasks.workunit.client.0.smithi037.stdout:9/530: mkdir da/dd/d1b/d23/dbe 0 2024-09-19T06:08:44.476 INFO:tasks.workunit.client.0.smithi037.stdout:9/531: link da/f9a da/d20/fbf 0 2024-09-19T06:08:44.477 INFO:tasks.workunit.client.0.smithi037.stdout:9/532: unlink da/l59 0 2024-09-19T06:08:44.478 INFO:tasks.workunit.client.0.smithi037.stdout:4/373: dwrite d0/d6/d1b/d20/d4d/f51 [0,4194304] 0 2024-09-19T06:08:44.478 INFO:tasks.workunit.client.0.smithi037.stdout:9/533: rename da/dd/d1b/d23/d6a/d8f/fab to da/d4d/fc0 0 2024-09-19T06:08:44.481 INFO:tasks.workunit.client.0.smithi037.stdout:4/374: creat d0/f7c x:0 0 0 2024-09-19T06:08:44.484 INFO:tasks.workunit.client.0.smithi037.stdout:9/534: readlink l2 0 2024-09-19T06:08:44.500 INFO:tasks.workunit.client.0.smithi037.stdout:9/535: write da/dd/d1b/d43/fa3 [384624,100030] 0 2024-09-19T06:08:44.505 INFO:tasks.workunit.client.0.smithi037.stdout:4/375: dwrite d0/f41 [0,4194304] 0 2024-09-19T06:08:44.505 INFO:tasks.workunit.client.0.smithi037.stdout:4/376: write d0/d6/d1b/f3f [1370544,43072] 0 2024-09-19T06:08:44.506 INFO:tasks.workunit.client.0.smithi037.stdout:4/377: link d0/c17 d0/d6/d1b/d5d/c7d 0 2024-09-19T06:08:44.518 INFO:tasks.workunit.client.0.smithi037.stdout:4/378: dread d0/f53 [0,4194304] 0 2024-09-19T06:08:44.519 INFO:tasks.workunit.client.0.smithi037.stdout:4/379: creat d0/d2/d2e/f7e x:0 0 0 2024-09-19T06:08:44.520 INFO:tasks.workunit.client.0.smithi037.stdout:4/380: write d0/d6/d45/d4a/f5c [833770,100491] 0 2024-09-19T06:08:44.520 INFO:tasks.workunit.client.0.smithi037.stdout:4/381: symlink d0/d2/l7f 0 2024-09-19T06:08:44.520 INFO:tasks.workunit.client.0.smithi037.stdout:4/382: fsync d0/d6/d1b/f78 0 2024-09-19T06:08:44.520 INFO:tasks.workunit.client.0.smithi037.stdout:4/383: truncate d0/d2/f2b 820060 0 2024-09-19T06:08:44.521 INFO:tasks.workunit.client.0.smithi037.stdout:4/384: read - d0/d2/d37/f5e zero size 2024-09-19T06:08:44.521 INFO:tasks.workunit.client.0.smithi037.stdout:4/385: mkdir d0/d6/d1b/d30/d80 0 2024-09-19T06:08:44.525 INFO:tasks.workunit.client.0.smithi037.stdout:9/536: dwrite da/d20/f8e [0,4194304] 0 2024-09-19T06:08:44.527 INFO:tasks.workunit.client.0.smithi037.stdout:9/537: unlink da/dd/d31/c94 0 2024-09-19T06:08:44.528 INFO:tasks.workunit.client.0.smithi037.stdout:9/538: creat da/dd/d63/fc1 x:0 0 0 2024-09-19T06:08:44.528 INFO:tasks.workunit.client.0.smithi037.stdout:9/539: chown da/dd/d1b/f36 3 1 2024-09-19T06:08:44.541 INFO:tasks.workunit.client.0.smithi037.stdout:9/540: write da/dd/d1b/d23/d6a/d85/f97 [204410,90571] 0 2024-09-19T06:08:44.543 INFO:tasks.workunit.client.0.smithi037.stdout:9/541: rename da/dd/d1b/d2f/d6d/f9f to da/d20/fc2 0 2024-09-19T06:08:44.543 INFO:tasks.workunit.client.0.smithi037.stdout:9/542: chown da/dd/d1b/d43/c81 29640885 1 2024-09-19T06:08:44.545 INFO:tasks.workunit.client.0.smithi037.stdout:4/386: dwrite d0/f27 [0,4194304] 0 2024-09-19T06:08:44.547 INFO:tasks.workunit.client.0.smithi037.stdout:4/387: link d0/d2/d2e/l61 d0/d6/d1b/d5d/l81 0 2024-09-19T06:08:44.548 INFO:tasks.workunit.client.0.smithi037.stdout:4/388: mknod d0/d6/c82 0 2024-09-19T06:08:44.550 INFO:tasks.workunit.client.0.smithi037.stdout:4/389: link d0/d2/f19 d0/d6/d1b/d30/f83 0 2024-09-19T06:08:44.551 INFO:tasks.workunit.client.0.smithi037.stdout:4/390: creat d0/d6/d45/d4a/f84 x:0 0 0 2024-09-19T06:08:44.554 INFO:tasks.workunit.client.0.smithi037.stdout:4/391: rename d0/d2/l5 to d0/l85 0 2024-09-19T06:08:44.554 INFO:tasks.workunit.client.0.smithi037.stdout:4/392: fsync d0/d2/d2e/d36/f4e 0 2024-09-19T06:08:44.555 INFO:tasks.workunit.client.0.smithi037.stdout:4/393: mkdir d0/d6/d45/d4a/d86 0 2024-09-19T06:08:44.555 INFO:tasks.workunit.client.0.smithi037.stdout:4/394: stat d0/d6/d1b/l2a 0 2024-09-19T06:08:44.555 INFO:tasks.workunit.client.0.smithi037.stdout:4/395: chown d0/d2/d37/f5e 16 1 2024-09-19T06:08:44.556 INFO:tasks.workunit.client.0.smithi037.stdout:4/396: symlink d0/d6/l87 0 2024-09-19T06:08:44.557 INFO:tasks.workunit.client.0.smithi037.stdout:4/397: symlink d0/d6/d1b/d5d/l88 0 2024-09-19T06:08:44.559 INFO:tasks.workunit.client.0.smithi037.stdout:4/398: mknod d0/d6/d45/c89 0 2024-09-19T06:08:44.561 INFO:tasks.workunit.client.0.smithi037.stdout:4/399: dread d0/d2/f2b [0,4194304] 0 2024-09-19T06:08:44.563 INFO:tasks.workunit.client.0.smithi037.stdout:4/400: creat d0/d6/d45/d4a/d86/f8a x:0 0 0 2024-09-19T06:08:44.563 INFO:tasks.workunit.client.0.smithi037.stdout:4/401: fdatasync d0/f16 0 2024-09-19T06:08:44.565 INFO:tasks.workunit.client.0.smithi037.stdout:4/402: symlink d0/d6/d1b/d20/d77/l8b 0 2024-09-19T06:08:44.565 INFO:tasks.workunit.client.0.smithi037.stdout:4/403: write d0/d2/f5a [676294,102694] 0 2024-09-19T06:08:44.566 INFO:tasks.workunit.client.0.smithi037.stdout:4/404: rename d0/d6/d1b/d30/f83 to d0/d6/d45/d4a/f8c 0 2024-09-19T06:08:44.567 INFO:tasks.workunit.client.0.smithi037.stdout:4/405: mknod d0/d2/c8d 0 2024-09-19T06:08:44.568 INFO:tasks.workunit.client.0.smithi037.stdout:4/406: mkdir d0/d6/d45/d4a/d6f/d8e 0 2024-09-19T06:08:44.571 INFO:tasks.workunit.client.0.smithi037.stdout:4/407: mkdir d0/d8f 0 2024-09-19T06:08:44.571 INFO:tasks.workunit.client.0.smithi037.stdout:4/408: creat d0/d2/d37/f90 x:0 0 0 2024-09-19T06:08:44.572 INFO:tasks.workunit.client.0.smithi037.stdout:4/409: getdents d0/d2/d37/d46 0 2024-09-19T06:08:44.574 INFO:tasks.workunit.client.0.smithi037.stdout:4/410: rename d0/d6/d1b/d5d/l6d to d0/d6/d45/l91 0 2024-09-19T06:08:44.574 INFO:tasks.workunit.client.0.smithi037.stdout:4/411: chown d0/d6/d45/d4a/f6c 1341530 1 2024-09-19T06:08:44.575 INFO:tasks.workunit.client.0.smithi037.stdout:4/412: readlink d0/la 0 2024-09-19T06:08:44.579 INFO:tasks.workunit.client.0.smithi037.stdout:4/413: dread d0/d6/d45/d4a/f5c [0,4194304] 0 2024-09-19T06:08:44.587 INFO:tasks.workunit.client.0.smithi037.stdout:0/428: sync 2024-09-19T06:08:44.587 INFO:tasks.workunit.client.0.smithi037.stdout:0/429: creat d5/d20/d34/f91 x:0 0 0 2024-09-19T06:08:44.602 INFO:tasks.workunit.client.0.smithi037.stdout:0/430: dread d5/d8/d44/f51 [0,4194304] 0 2024-09-19T06:08:44.603 INFO:tasks.workunit.client.0.smithi037.stdout:4/414: dwrite d0/d2/d2e/d36/f79 [0,4194304] 0 2024-09-19T06:08:44.603 INFO:tasks.workunit.client.0.smithi037.stdout:4/415: mkdir d0/d2/d37/d92 0 2024-09-19T06:08:44.604 INFO:tasks.workunit.client.0.smithi037.stdout:4/416: creat d0/d6/d45/d4a/f93 x:0 0 0 2024-09-19T06:08:44.632 INFO:tasks.workunit.client.0.smithi037.stdout:0/431: dwrite d5/d8/d22/f47 [0,4194304] 0 2024-09-19T06:08:44.632 INFO:tasks.workunit.client.0.smithi037.stdout:4/417: dwrite d0/d2/f1a [0,4194304] 0 2024-09-19T06:08:44.648 INFO:tasks.workunit.client.0.smithi037.stdout:4/418: dread d0/d6/d45/d4a/f6c [0,4194304] 0 2024-09-19T06:08:44.648 INFO:tasks.workunit.client.0.smithi037.stdout:4/419: fsync d0/d2/d2e/f43 0 2024-09-19T06:08:44.661 INFO:tasks.workunit.client.0.smithi037.stdout:4/420: read d0/f41 [2612008,4949] 0 2024-09-19T06:08:44.723 INFO:tasks.workunit.client.0.smithi037.stdout:8/522: sync 2024-09-19T06:08:44.723 INFO:tasks.workunit.client.0.smithi037.stdout:8/523: stat d1/d62/ca2 0 2024-09-19T06:08:44.737 INFO:tasks.workunit.client.0.smithi037.stdout:8/524: write d1/d61/d7e/d8b/d91/f76 [1713604,10640] 0 2024-09-19T06:08:44.739 INFO:tasks.workunit.client.0.smithi037.stdout:8/525: mknod d1/d61/d7e/cb5 0 2024-09-19T06:08:44.739 INFO:tasks.workunit.client.0.smithi037.stdout:8/526: write d1/f97 [812041,115398] 0 2024-09-19T06:08:44.741 INFO:tasks.workunit.client.0.smithi037.stdout:8/527: read d1/d6a/fa7 [188817,126555] 0 2024-09-19T06:08:44.741 INFO:tasks.workunit.client.0.smithi037.stdout:8/528: write d1/f54 [230166,102283] 0 2024-09-19T06:08:44.744 INFO:tasks.workunit.client.0.smithi037.stdout:8/529: rename d1/d35/c5e to d1/d8f/da1/cb6 0 2024-09-19T06:08:44.745 INFO:tasks.workunit.client.0.smithi037.stdout:8/530: mknod d1/d61/d7e/d8b/d91/d3d/cb7 0 2024-09-19T06:08:44.748 INFO:tasks.workunit.client.0.smithi037.stdout:8/531: link d1/d35/ca5 d1/d62/d59/da9/cb8 0 2024-09-19T06:08:44.748 INFO:tasks.workunit.client.0.smithi037.stdout:8/532: readlink d1/l17 0 2024-09-19T06:08:44.749 INFO:tasks.workunit.client.0.smithi037.stdout:8/533: symlink d1/d61/lb9 0 2024-09-19T06:08:44.750 INFO:tasks.workunit.client.0.smithi037.stdout:8/534: creat d1/d61/d7e/d8b/d91/d3d/fba x:0 0 0 2024-09-19T06:08:44.751 INFO:tasks.workunit.client.0.smithi037.stdout:8/535: truncate d1/d61/d7e/d8b/d91/d3d/f20 677810 0 2024-09-19T06:08:44.753 INFO:tasks.workunit.client.0.smithi037.stdout:8/536: truncate d1/f2d 105213 0 2024-09-19T06:08:44.753 INFO:tasks.workunit.client.0.smithi037.stdout:8/537: chown d1 93486 1 2024-09-19T06:08:44.753 INFO:tasks.workunit.client.0.smithi037.stdout:8/538: write d1/d61/d7e/d8b/d91/d3d/f34 [2051037,128707] 0 2024-09-19T06:08:44.768 INFO:tasks.workunit.client.0.smithi037.stdout:8/539: dread d1/d62/d59/f74 [0,4194304] 0 2024-09-19T06:08:44.775 INFO:tasks.workunit.client.0.smithi037.stdout:6/357: sync 2024-09-19T06:08:44.777 INFO:tasks.workunit.client.0.smithi037.stdout:6/358: rename d9/dd/d1c/d4e/d2f/l3f to d9/dd/d1c/d4e/d33/l6b 0 2024-09-19T06:08:44.777 INFO:tasks.workunit.client.0.smithi037.stdout:6/359: write d9/dd/d1c/f3e [673663,23171] 0 2024-09-19T06:08:44.777 INFO:tasks.workunit.client.0.smithi037.stdout:6/360: chown d9/f19 5848 1 2024-09-19T06:08:44.777 INFO:tasks.workunit.client.0.smithi037.stdout:6/361: write d9/dd/d20/f27 [838757,2538] 0 2024-09-19T06:08:44.778 INFO:tasks.workunit.client.0.smithi037.stdout:6/362: mknod d9/dd/d20/c6c 0 2024-09-19T06:08:44.778 INFO:tasks.workunit.client.0.smithi037.stdout:6/363: readlink d9/dd/l3b 0 2024-09-19T06:08:44.778 INFO:tasks.workunit.client.0.smithi037.stdout:6/364: dread - d9/dd/d1c/d4e/d2f/f63 zero size 2024-09-19T06:08:44.778 INFO:tasks.workunit.client.0.smithi037.stdout:6/365: mkdir d9/dd/d20/d5a/d6d 0 2024-09-19T06:08:44.779 INFO:tasks.workunit.client.0.smithi037.stdout:6/366: mkdir d9/d6e 0 2024-09-19T06:08:44.780 INFO:tasks.workunit.client.0.smithi037.stdout:6/367: rename d9/d16/l5b to d9/d6e/l6f 0 2024-09-19T06:08:44.781 INFO:tasks.workunit.client.0.smithi037.stdout:6/368: creat d9/dd/d1c/d4e/d2f/f70 x:0 0 0 2024-09-19T06:08:44.782 INFO:tasks.workunit.client.0.smithi037.stdout:6/369: symlink d9/dd/d2b/d42/l71 0 2024-09-19T06:08:44.782 INFO:tasks.workunit.client.0.smithi037.stdout:6/370: chown d9/dd/d1c/f2e 16195 1 2024-09-19T06:08:44.782 INFO:tasks.workunit.client.0.smithi037.stdout:8/540: dread d1/f4c [0,4194304] 0 2024-09-19T06:08:44.783 INFO:tasks.workunit.client.0.smithi037.stdout:6/371: creat d9/dd/d20/d5a/d6d/f72 x:0 0 0 2024-09-19T06:08:44.800 INFO:tasks.workunit.client.0.smithi037.stdout:6/372: write d9/dd/d1c/f2e [3982813,108317] 0 2024-09-19T06:08:44.801 INFO:tasks.workunit.client.0.smithi037.stdout:8/541: dwrite d1/d62/d59/f9e [0,4194304] 0 2024-09-19T06:08:44.803 INFO:tasks.workunit.client.0.smithi037.stdout:8/542: creat d1/d61/d7e/d8b/d91/d3d/d66/fbb x:0 0 0 2024-09-19T06:08:44.813 INFO:tasks.workunit.client.0.smithi037.stdout:6/373: dread d9/dd/f23 [0,4194304] 0 2024-09-19T06:08:44.813 INFO:tasks.workunit.client.0.smithi037.stdout:6/374: read d9/dd/f22 [575528,3875] 0 2024-09-19T06:08:44.813 INFO:tasks.workunit.client.0.smithi037.stdout:6/375: dread - d9/dd/d20/d5a/d6d/f72 zero size 2024-09-19T06:08:44.813 INFO:tasks.workunit.client.0.smithi037.stdout:6/376: dread - d9/f4c zero size 2024-09-19T06:08:44.814 INFO:tasks.workunit.client.0.smithi037.stdout:6/377: rename d9/dd/d1c/d4e/d2f/d55 to d9/dd/d1c/d73 0 2024-09-19T06:08:44.815 INFO:tasks.workunit.client.0.smithi037.stdout:6/378: getdents d9/dd/d1c/d4e/d65 0 2024-09-19T06:08:44.816 INFO:tasks.workunit.client.0.smithi037.stdout:6/379: creat d9/dd/d1c/d4e/d62/f74 x:0 0 0 2024-09-19T06:08:44.822 INFO:tasks.workunit.client.0.smithi037.stdout:8/543: dwrite d1/f18 [4194304,4194304] 0 2024-09-19T06:08:44.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:08:44 smithi037 ceph-mon[31211]: pgmap v426: 129 pgs: 129 active+clean; 551 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 54 MiB/s rd, 68 MiB/s wr, 736 op/s 2024-09-19T06:08:44.843 INFO:tasks.workunit.client.0.smithi037.stdout:6/380: dwrite d9/dd/d1c/f3e [0,4194304] 0 2024-09-19T06:08:44.844 INFO:tasks.workunit.client.0.smithi037.stdout:6/381: symlink d9/l75 0 2024-09-19T06:08:44.846 INFO:tasks.workunit.client.0.smithi037.stdout:6/382: link d9/dd/d1c/f47 d9/dd/d20/f76 0 2024-09-19T06:08:44.850 INFO:tasks.workunit.client.0.smithi037.stdout:8/544: dwrite d1/d61/d7e/d8b/d91/d3d/f34 [0,4194304] 0 2024-09-19T06:08:44.850 INFO:tasks.workunit.client.0.smithi037.stdout:8/545: write d1/d62/d59/f5c [4699868,44488] 0 2024-09-19T06:08:44.853 INFO:tasks.workunit.client.0.smithi037.stdout:6/383: dread d9/dd/f23 [0,4194304] 0 2024-09-19T06:08:44.853 INFO:tasks.workunit.client.0.smithi037.stdout:6/384: rmdir d9/dd/d2b/d42 39 2024-09-19T06:08:44.859 INFO:tasks.workunit.client.0.smithi037.stdout:3/409: sync 2024-09-19T06:08:44.859 INFO:tasks.workunit.client.0.smithi037.stdout:5/420: sync 2024-09-19T06:08:44.859 INFO:tasks.workunit.client.0.smithi037.stdout:1/362: sync 2024-09-19T06:08:44.859 INFO:tasks.workunit.client.0.smithi037.stdout:9/543: sync 2024-09-19T06:08:44.859 INFO:tasks.workunit.client.0.smithi037.stdout:4/421: sync 2024-09-19T06:08:44.859 INFO:tasks.workunit.client.0.smithi037.stdout:7/284: sync 2024-09-19T06:08:44.859 INFO:tasks.workunit.client.0.smithi037.stdout:2/480: sync 2024-09-19T06:08:44.860 INFO:tasks.workunit.client.0.smithi037.stdout:0/432: sync 2024-09-19T06:08:44.860 INFO:tasks.workunit.client.0.smithi037.stdout:2/481: stat d1/da/dc/d21/d7d 0 2024-09-19T06:08:44.860 INFO:tasks.workunit.client.0.smithi037.stdout:1/363: rmdir d2/d73 39 2024-09-19T06:08:44.860 INFO:tasks.workunit.client.0.smithi037.stdout:1/364: chown d2/d12/d1d/c78 66401 1 2024-09-19T06:08:44.861 INFO:tasks.workunit.client.0.smithi037.stdout:8/546: dread d1/d62/d59/d5d/f60 [0,4194304] 0 2024-09-19T06:08:44.867 INFO:tasks.workunit.client.0.smithi037.stdout:4/422: symlink d0/d6/d1b/d30/d80/l94 0 2024-09-19T06:08:44.867 INFO:tasks.workunit.client.0.smithi037.stdout:9/544: symlink da/dd/d1b/d2f/d6f/lc3 0 2024-09-19T06:08:44.867 INFO:tasks.workunit.client.0.smithi037.stdout:5/421: creat d2/d12/d24/d58/f8f x:0 0 0 2024-09-19T06:08:44.867 INFO:tasks.workunit.client.0.smithi037.stdout:5/422: truncate d2/d10/f1f 4366434 0 2024-09-19T06:08:44.867 INFO:tasks.workunit.client.0.smithi037.stdout:2/482: link d1/da/dc/d21/d55/c5e d1/da/dc/d21/d7d/cad 0 2024-09-19T06:08:44.867 INFO:tasks.workunit.client.0.smithi037.stdout:5/423: truncate d2/d12/d24/f70 814402 0 2024-09-19T06:08:44.869 INFO:tasks.workunit.client.0.smithi037.stdout:8/547: truncate d1/d61/f77 3487001 0 2024-09-19T06:08:44.869 INFO:tasks.workunit.client.0.smithi037.stdout:4/423: creat d0/d6/d1b/d20/f95 x:0 0 0 2024-09-19T06:08:44.870 INFO:tasks.workunit.client.0.smithi037.stdout:2/483: rmdir d1/da/dc/d21/d55 39 2024-09-19T06:08:44.875 INFO:tasks.workunit.client.0.smithi037.stdout:8/548: fdatasync d1/d35/f56 0 2024-09-19T06:08:44.876 INFO:tasks.workunit.client.0.smithi037.stdout:9/545: mkdir da/dd/d63/d80/dc4 0 2024-09-19T06:08:44.877 INFO:tasks.workunit.client.0.smithi037.stdout:8/549: mkdir d1/d61/d7e/dbc 0 2024-09-19T06:08:44.878 INFO:tasks.workunit.client.0.smithi037.stdout:9/546: getdents da/dd/d1b/d23/d6a/d82 0 2024-09-19T06:08:44.878 INFO:tasks.workunit.client.0.smithi037.stdout:0/433: write d5/d8/d11/f78 [2938747,41141] 0 2024-09-19T06:08:44.878 INFO:tasks.workunit.client.0.smithi037.stdout:9/547: getdents da/dd/d1b/d2f/d38 0 2024-09-19T06:08:44.879 INFO:tasks.workunit.client.0.smithi037.stdout:0/434: mknod d5/d8/d44/d48/c92 0 2024-09-19T06:08:44.880 INFO:tasks.workunit.client.0.smithi037.stdout:1/365: dread d2/f4 [0,4194304] 0 2024-09-19T06:08:44.880 INFO:tasks.workunit.client.0.smithi037.stdout:9/548: symlink da/dd/d1b/d23/d6a/d8f/da4/lc5 0 2024-09-19T06:08:44.880 INFO:tasks.workunit.client.0.smithi037.stdout:9/549: write da/dd/d1b/d56/fa6 [199466,34322] 0 2024-09-19T06:08:44.880 INFO:tasks.workunit.client.0.smithi037.stdout:6/385: dwrite d9/dd/d2b/f37 [0,4194304] 0 2024-09-19T06:08:44.880 INFO:tasks.workunit.client.0.smithi037.stdout:6/386: write d9/dd/d1c/d4e/d2f/f53 [5111075,73718] 0 2024-09-19T06:08:44.880 INFO:tasks.workunit.client.0.smithi037.stdout:0/435: rmdir d5/d18/d68/d6d 0 2024-09-19T06:08:44.881 INFO:tasks.workunit.client.0.smithi037.stdout:1/366: creat d2/d12/d15/d34/f7c x:0 0 0 2024-09-19T06:08:44.883 INFO:tasks.workunit.client.0.smithi037.stdout:6/387: rename d9/dd/l3b to d9/d16/l77 0 2024-09-19T06:08:44.883 INFO:tasks.workunit.client.0.smithi037.stdout:1/367: creat d2/d12/d1e/d2d/f7d x:0 0 0 2024-09-19T06:08:44.885 INFO:tasks.workunit.client.0.smithi037.stdout:8/550: dread d1/f1e [0,4194304] 0 2024-09-19T06:08:44.885 INFO:tasks.workunit.client.0.smithi037.stdout:8/551: read d1/f2d [35237,86767] 0 2024-09-19T06:08:44.885 INFO:tasks.workunit.client.0.smithi037.stdout:8/552: chown d1/d61/d7e/d8b/d9f 16510480 1 2024-09-19T06:08:44.885 INFO:tasks.workunit.client.0.smithi037.stdout:1/368: truncate d2/fa 581660 0 2024-09-19T06:08:44.885 INFO:tasks.workunit.client.0.smithi037.stdout:1/369: fsync d2/d12/d1e/d2d/f4c 0 2024-09-19T06:08:44.885 INFO:tasks.workunit.client.0.smithi037.stdout:1/370: fsync d2/d12/d15/f36 0 2024-09-19T06:08:44.886 INFO:tasks.workunit.client.0.smithi037.stdout:8/553: mknod d1/d61/d7e/dbc/cbd 0 2024-09-19T06:08:44.888 INFO:tasks.workunit.client.0.smithi037.stdout:8/554: symlink d1/d61/d7e/d8b/d91/d3d/d66/lbe 0 2024-09-19T06:08:44.888 INFO:tasks.workunit.client.0.smithi037.stdout:9/550: read da/f9a [342472,88922] 0 2024-09-19T06:08:44.890 INFO:tasks.workunit.client.0.smithi037.stdout:8/555: rename d1/d61/la0 to d1/d61/d7e/d8b/lbf 0 2024-09-19T06:08:44.890 INFO:tasks.workunit.client.0.smithi037.stdout:8/556: fsync d1/f4c 0 2024-09-19T06:08:44.890 INFO:tasks.workunit.client.0.smithi037.stdout:8/557: readlink d1/d61/l6d 0 2024-09-19T06:08:44.890 INFO:tasks.workunit.client.0.smithi037.stdout:1/371: read d2/d12/d15/f58 [140768,85396] 0 2024-09-19T06:08:44.891 INFO:tasks.workunit.client.0.smithi037.stdout:8/558: mkdir d1/d61/d7e/dbc/dc0 0 2024-09-19T06:08:44.891 INFO:tasks.workunit.client.0.smithi037.stdout:1/372: creat d2/d12/d1e/d2a/d2e/f7e x:0 0 0 2024-09-19T06:08:44.893 INFO:tasks.workunit.client.0.smithi037.stdout:8/559: creat d1/d62/fc1 x:0 0 0 2024-09-19T06:08:44.893 INFO:tasks.workunit.client.0.smithi037.stdout:8/560: write d1/f2d [173713,39899] 0 2024-09-19T06:08:44.893 INFO:tasks.workunit.client.0.smithi037.stdout:8/561: dread - d1/d61/d7e/d8b/d91/f8d zero size 2024-09-19T06:08:44.894 INFO:tasks.workunit.client.0.smithi037.stdout:3/410: dwrite d0/d16/f81 [0,4194304] 0 2024-09-19T06:08:44.897 INFO:tasks.workunit.client.0.smithi037.stdout:7/285: dwrite d6/dc/f16 [0,4194304] 0 2024-09-19T06:08:44.897 INFO:tasks.workunit.client.0.smithi037.stdout:7/286: chown d6/dc/f16 479 1 2024-09-19T06:08:44.897 INFO:tasks.workunit.client.0.smithi037.stdout:7/287: getdents d6/d20/d4b 0 2024-09-19T06:08:44.897 INFO:tasks.workunit.client.0.smithi037.stdout:7/288: write d6/d20/d2c/f31 [4651877,42366] 0 2024-09-19T06:08:44.897 INFO:tasks.workunit.client.0.smithi037.stdout:7/289: fsync d6/f2b 0 2024-09-19T06:08:44.897 INFO:tasks.workunit.client.0.smithi037.stdout:6/388: write d9/dd/f1b [1257083,65773] 0 2024-09-19T06:08:44.897 INFO:tasks.workunit.client.0.smithi037.stdout:6/389: readlink d9/dd/d1c/l30 0 2024-09-19T06:08:44.898 INFO:tasks.workunit.client.0.smithi037.stdout:3/411: creat d0/d43/d23/d7a/d77/d62/f90 x:0 0 0 2024-09-19T06:08:44.900 INFO:tasks.workunit.client.0.smithi037.stdout:7/290: creat d6/d20/d34/f50 x:0 0 0 2024-09-19T06:08:44.901 INFO:tasks.workunit.client.0.smithi037.stdout:6/390: getdents d9/dd/d20/d5a 0 2024-09-19T06:08:44.901 INFO:tasks.workunit.client.0.smithi037.stdout:6/391: chown d9/dd/d1c/d73/c60 878655 1 2024-09-19T06:08:44.905 INFO:tasks.workunit.client.0.smithi037.stdout:2/484: dwrite d1/da/dc/d21/d51/f9c [0,4194304] 0 2024-09-19T06:08:44.906 INFO:tasks.workunit.client.0.smithi037.stdout:2/485: write d1/d33/fa1 [1729522,55622] 0 2024-09-19T06:08:44.906 INFO:tasks.workunit.client.0.smithi037.stdout:2/486: chown d1/da/dc/c79 6340 1 2024-09-19T06:08:44.906 INFO:tasks.workunit.client.0.smithi037.stdout:2/487: truncate d1/da/dc/d21/d51/f52 285703 0 2024-09-19T06:08:44.912 INFO:tasks.workunit.client.0.smithi037.stdout:3/412: creat d0/d16/d19/d1d/d7c/f91 x:0 0 0 2024-09-19T06:08:44.912 INFO:tasks.workunit.client.0.smithi037.stdout:3/413: write d0/d43/d23/d7a/d77/d62/f90 [929660,53594] 0 2024-09-19T06:08:44.913 INFO:tasks.workunit.client.0.smithi037.stdout:4/424: dwrite d0/d2/d37/f5e [0,4194304] 0 2024-09-19T06:08:44.917 INFO:tasks.workunit.client.0.smithi037.stdout:4/425: link d0/d2/f19 d0/d6/d1b/d20/d4d/d64/f96 0 2024-09-19T06:08:44.917 INFO:tasks.workunit.client.0.smithi037.stdout:5/424: dwrite d2/d12/f26 [0,4194304] 0 2024-09-19T06:08:44.917 INFO:tasks.workunit.client.0.smithi037.stdout:5/425: chown d2/d12/d28/d22/d35/l5a 224196643 1 2024-09-19T06:08:44.918 INFO:tasks.workunit.client.0.smithi037.stdout:9/551: dread da/dd/d1b/d2f/f70 [0,4194304] 0 2024-09-19T06:08:44.918 INFO:tasks.workunit.client.0.smithi037.stdout:8/562: dread d1/d61/d7e/d8b/d91/d3d/f14 [0,4194304] 0 2024-09-19T06:08:44.919 INFO:tasks.workunit.client.0.smithi037.stdout:1/373: dread d2/d48/f62 [0,4194304] 0 2024-09-19T06:08:44.919 INFO:tasks.workunit.client.0.smithi037.stdout:1/374: write d2/d12/d1e/d2d/f74 [894246,120091] 0 2024-09-19T06:08:44.920 INFO:tasks.workunit.client.0.smithi037.stdout:4/426: unlink d0/d2/d2e/l3e 0 2024-09-19T06:08:44.921 INFO:tasks.workunit.client.0.smithi037.stdout:4/427: truncate d0/d6/d1b/d20/f62 557203 0 2024-09-19T06:08:44.921 INFO:tasks.workunit.client.0.smithi037.stdout:4/428: truncate d0/f7c 568076 0 2024-09-19T06:08:44.921 INFO:tasks.workunit.client.0.smithi037.stdout:4/429: chown d0/d2/f1d 120800731 1 2024-09-19T06:08:44.921 INFO:tasks.workunit.client.0.smithi037.stdout:5/426: mknod d2/d12/c90 0 2024-09-19T06:08:44.921 INFO:tasks.workunit.client.0.smithi037.stdout:5/427: chown d2/d12/f27 4911 1 2024-09-19T06:08:44.922 INFO:tasks.workunit.client.0.smithi037.stdout:1/375: rename d2/d12/d1e/d63/f6a to d2/d12/d1e/d2a/d2e/f7f 0 2024-09-19T06:08:44.924 INFO:tasks.workunit.client.0.smithi037.stdout:5/428: link d2/d12/f4f d2/d12/d28/d57/f91 0 2024-09-19T06:08:44.925 INFO:tasks.workunit.client.0.smithi037.stdout:0/436: dwrite d5/d8/d44/f51 [0,4194304] 0 2024-09-19T06:08:44.926 INFO:tasks.workunit.client.0.smithi037.stdout:0/437: dread d5/d8/d22/d89/f8a [0,4194304] 0 2024-09-19T06:08:44.927 INFO:tasks.workunit.client.0.smithi037.stdout:1/376: rmdir d2/d12/d1d/d76 0 2024-09-19T06:08:44.927 INFO:tasks.workunit.client.0.smithi037.stdout:1/377: write d2/d12/d1d/d47/f68 [571601,21978] 0 2024-09-19T06:08:44.927 INFO:tasks.workunit.client.0.smithi037.stdout:1/378: read d2/d12/d1e/d2d/f74 [415917,127728] 0 2024-09-19T06:08:44.928 INFO:tasks.workunit.client.0.smithi037.stdout:1/379: write d2/d12/d1e/d2d/f55 [57094,20205] 0 2024-09-19T06:08:44.930 INFO:tasks.workunit.client.0.smithi037.stdout:5/429: mknod d2/d12/c92 0 2024-09-19T06:08:44.931 INFO:tasks.workunit.client.0.smithi037.stdout:2/488: dread d1/d33/d4c/f53 [0,4194304] 0 2024-09-19T06:08:44.932 INFO:tasks.workunit.client.0.smithi037.stdout:7/291: dwrite d6/d20/f3c [0,4194304] 0 2024-09-19T06:08:44.933 INFO:tasks.workunit.client.0.smithi037.stdout:0/438: symlink d5/d18/l93 0 2024-09-19T06:08:44.933 INFO:tasks.workunit.client.0.smithi037.stdout:0/439: fsync d5/d8/d11/d15/d21/f49 0 2024-09-19T06:08:44.934 INFO:tasks.workunit.client.0.smithi037.stdout:2/489: mknod d1/d9d/cae 0 2024-09-19T06:08:44.935 INFO:tasks.workunit.client.0.smithi037.stdout:7/292: write d6/f3a [59870,105850] 0 2024-09-19T06:08:44.935 INFO:tasks.workunit.client.0.smithi037.stdout:0/440: unlink d5/d8/d44/l83 0 2024-09-19T06:08:44.937 INFO:tasks.workunit.client.0.smithi037.stdout:2/490: creat d1/da/d6e/da0/faf x:0 0 0 2024-09-19T06:08:44.938 INFO:tasks.workunit.client.0.smithi037.stdout:0/441: symlink d5/d8/d11/d32/l94 0 2024-09-19T06:08:44.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:08:44 smithi099 ceph-mon[35300]: pgmap v426: 129 pgs: 129 active+clean; 551 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 54 MiB/s rd, 68 MiB/s wr, 736 op/s 2024-09-19T06:08:44.939 INFO:tasks.workunit.client.0.smithi037.stdout:2/491: getdents d1/d33 0 2024-09-19T06:08:44.940 INFO:tasks.workunit.client.0.smithi037.stdout:2/492: rmdir d1/da 39 2024-09-19T06:08:44.940 INFO:tasks.workunit.client.0.smithi037.stdout:4/430: dread d0/d6/d1b/d20/d4d/f51 [0,4194304] 0 2024-09-19T06:08:44.941 INFO:tasks.workunit.client.0.smithi037.stdout:2/493: getdents d1/da/dc 0 2024-09-19T06:08:44.942 INFO:tasks.workunit.client.0.smithi037.stdout:4/431: creat d0/d6/d45/d4a/d6f/d8e/f97 x:0 0 0 2024-09-19T06:08:44.947 INFO:tasks.workunit.client.0.smithi037.stdout:8/563: dwrite d1/d61/d7e/d8b/d91/d3d/f26 [4194304,4194304] 0 2024-09-19T06:08:44.948 INFO:tasks.workunit.client.0.smithi037.stdout:4/432: unlink d0/d6/d1b/d20/d77/l8b 0 2024-09-19T06:08:44.948 INFO:tasks.workunit.client.0.smithi037.stdout:4/433: chown d0/d6/d1b/d20/d4d/f51 78178384 1 2024-09-19T06:08:44.950 INFO:tasks.workunit.client.0.smithi037.stdout:4/434: creat d0/d2/d2e/f98 x:0 0 0 2024-09-19T06:08:44.952 INFO:tasks.workunit.client.0.smithi037.stdout:4/435: unlink d0/d6/l10 0 2024-09-19T06:08:44.954 INFO:tasks.workunit.client.0.smithi037.stdout:5/430: write d2/d12/d28/f45 [3168496,84803] 0 2024-09-19T06:08:44.958 INFO:tasks.workunit.client.0.smithi037.stdout:2/494: write d1/d33/d4c/f53 [5533,54162] 0 2024-09-19T06:08:44.958 INFO:tasks.workunit.client.0.smithi037.stdout:5/431: creat d2/d12/d28/d22/d53/f93 x:0 0 0 2024-09-19T06:08:44.958 INFO:tasks.workunit.client.0.smithi037.stdout:5/432: chown d2/d12/d28/l43 15964 1 2024-09-19T06:08:44.960 INFO:tasks.workunit.client.0.smithi037.stdout:2/495: truncate d1/da/f3e 211456 0 2024-09-19T06:08:44.961 INFO:tasks.workunit.client.0.smithi037.stdout:5/433: creat d2/d12/d24/d58/d8e/f94 x:0 0 0 2024-09-19T06:08:44.961 INFO:tasks.workunit.client.0.smithi037.stdout:5/434: readlink d2/d12/d28/d22/d53/l61 0 2024-09-19T06:08:44.962 INFO:tasks.workunit.client.0.smithi037.stdout:5/435: write d2/d12/d28/f38 [4839317,68357] 0 2024-09-19T06:08:44.963 INFO:tasks.workunit.client.0.smithi037.stdout:2/496: rename d1/da/dc/d21/d55/d8e to d1/d9d/db0 0 2024-09-19T06:08:44.964 INFO:tasks.workunit.client.0.smithi037.stdout:5/436: getdents d2/d5c/d5f 0 2024-09-19T06:08:44.964 INFO:tasks.workunit.client.0.smithi037.stdout:8/564: read d1/f78 [2732797,114730] 0 2024-09-19T06:08:44.967 INFO:tasks.workunit.client.0.smithi037.stdout:7/293: dwrite d6/d20/d34/f40 [0,4194304] 0 2024-09-19T06:08:44.967 INFO:tasks.workunit.client.0.smithi037.stdout:2/497: mkdir d1/d16/db1 0 2024-09-19T06:08:44.967 INFO:tasks.workunit.client.0.smithi037.stdout:0/442: dwrite d5/d8/d11/d32/f39 [0,4194304] 0 2024-09-19T06:08:44.969 INFO:tasks.workunit.client.0.smithi037.stdout:5/437: rename d2/d12/f1c to d2/d12/d24/f95 0 2024-09-19T06:08:44.969 INFO:tasks.workunit.client.0.smithi037.stdout:5/438: write d2/d12/d28/f29 [482863,25064] 0 2024-09-19T06:08:44.972 INFO:tasks.workunit.client.0.smithi037.stdout:7/294: rmdir d6/dc/d22 39 2024-09-19T06:08:44.974 INFO:tasks.workunit.client.0.smithi037.stdout:2/498: mkdir d1/d6/da3/da8/db2 0 2024-09-19T06:08:44.974 INFO:tasks.workunit.client.0.smithi037.stdout:2/499: chown d1/da/dc/d21/d55/l83 153 1 2024-09-19T06:08:44.975 INFO:tasks.workunit.client.0.smithi037.stdout:4/436: dread d0/d2/f19 [0,4194304] 0 2024-09-19T06:08:44.975 INFO:tasks.workunit.client.0.smithi037.stdout:0/443: rmdir d5/d8/d11 39 2024-09-19T06:08:44.977 INFO:tasks.workunit.client.0.smithi037.stdout:7/295: creat d6/dc/d22/f51 x:0 0 0 2024-09-19T06:08:44.977 INFO:tasks.workunit.client.0.smithi037.stdout:7/296: fdatasync d6/dc/f14 0 2024-09-19T06:08:44.981 INFO:tasks.workunit.client.0.smithi037.stdout:2/500: mknod d1/da/d6e/da0/cb3 0 2024-09-19T06:08:44.981 INFO:tasks.workunit.client.0.smithi037.stdout:4/437: creat d0/d6/d1b/d20/d4d/d64/f99 x:0 0 0 2024-09-19T06:08:44.982 INFO:tasks.workunit.client.0.smithi037.stdout:4/438: write d0/d2/f1d [9362457,1236] 0 2024-09-19T06:08:44.982 INFO:tasks.workunit.client.0.smithi037.stdout:0/444: creat d5/d8/d22/f95 x:0 0 0 2024-09-19T06:08:44.982 INFO:tasks.workunit.client.0.smithi037.stdout:2/501: fdatasync d1/d6/f12 0 2024-09-19T06:08:44.982 INFO:tasks.workunit.client.0.smithi037.stdout:2/502: write d1/da/dc/d21/d7d/dab/f56 [1154028,49899] 0 2024-09-19T06:08:44.984 INFO:tasks.workunit.client.0.smithi037.stdout:2/503: dread d1/da/dc/d21/f38 [0,4194304] 0 2024-09-19T06:08:44.984 INFO:tasks.workunit.client.0.smithi037.stdout:0/445: mkdir d5/d8/d22/d89/d96 0 2024-09-19T06:08:44.985 INFO:tasks.workunit.client.0.smithi037.stdout:2/504: rename d1/d33/d4c/l71 to d1/da/lb4 0 2024-09-19T06:08:44.986 INFO:tasks.workunit.client.0.smithi037.stdout:4/439: dread d0/d6/d45/d4a/f5c [0,4194304] 0 2024-09-19T06:08:44.987 INFO:tasks.workunit.client.0.smithi037.stdout:4/440: dread - d0/f7a zero size 2024-09-19T06:08:44.988 INFO:tasks.workunit.client.0.smithi037.stdout:8/565: dwrite d1/d62/d59/f85 [0,4194304] 0 2024-09-19T06:08:44.992 INFO:tasks.workunit.client.0.smithi037.stdout:8/566: rename d1/d62 to d1/d61/d7e/dbc/dc2 0 2024-09-19T06:08:44.992 INFO:tasks.workunit.client.0.smithi037.stdout:8/567: fsync d1/d61/d7e/d8b/d91/d3d/f22 0 2024-09-19T06:08:44.992 INFO:tasks.workunit.client.0.smithi037.stdout:8/568: chown d1/d61/d7e/dbc/dc2/d9b 44019 1 2024-09-19T06:08:44.996 INFO:tasks.workunit.client.0.smithi037.stdout:8/569: link d1/d61/f89 d1/d61/d7b/fc3 0 2024-09-19T06:08:44.999 INFO:tasks.workunit.client.0.smithi037.stdout:8/570: rename d1/d61/d7e/d8b/d91/d3d/c5a to d1/d61/d7e/dbc/dc2/d59/daf/cc4 0 2024-09-19T06:08:44.999 INFO:tasks.workunit.client.0.smithi037.stdout:8/571: truncate d1/d6a/fa7 594340 0 2024-09-19T06:08:44.999 INFO:tasks.workunit.client.0.smithi037.stdout:8/572: write d1/d61/d7e/dbc/dc2/d59/f8e [1902730,18721] 0 2024-09-19T06:08:45.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:08:44 smithi117 ceph-mon[35050]: pgmap v426: 129 pgs: 129 active+clean; 551 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 54 MiB/s rd, 68 MiB/s wr, 736 op/s 2024-09-19T06:08:45.000 INFO:tasks.workunit.client.0.smithi037.stdout:4/441: read d0/d6/d45/d4a/f8c [894977,50330] 0 2024-09-19T06:08:45.000 INFO:tasks.workunit.client.0.smithi037.stdout:8/573: rename d1/d61/d7b/l84 to d1/d61/d68/da3/lc5 0 2024-09-19T06:08:45.001 INFO:tasks.workunit.client.0.smithi037.stdout:4/442: mknod d0/d6/c9a 0 2024-09-19T06:08:45.002 INFO:tasks.workunit.client.0.smithi037.stdout:8/574: symlink d1/d61/d7e/dbc/lc6 0 2024-09-19T06:08:45.004 INFO:tasks.workunit.client.0.smithi037.stdout:7/297: dwrite d6/f3e [0,4194304] 0 2024-09-19T06:08:45.010 INFO:tasks.workunit.client.0.smithi037.stdout:7/298: dread d6/dc/fd [0,4194304] 0 2024-09-19T06:08:45.011 INFO:tasks.workunit.client.0.smithi037.stdout:2/505: dwrite d1/da/fa5 [0,4194304] 0 2024-09-19T06:08:45.011 INFO:tasks.workunit.client.0.smithi037.stdout:7/299: rename d6/dc/d22/f51 to d6/d21/f52 0 2024-09-19T06:08:45.012 INFO:tasks.workunit.client.0.smithi037.stdout:7/300: dread - d6/dc/d22/f4c zero size 2024-09-19T06:08:45.014 INFO:tasks.workunit.client.0.smithi037.stdout:2/506: mknod d1/d9d/cb5 0 2024-09-19T06:08:45.015 INFO:tasks.workunit.client.0.smithi037.stdout:7/301: rmdir d6/d20 39 2024-09-19T06:08:45.015 INFO:tasks.workunit.client.0.smithi037.stdout:7/302: write d6/dc/d22/f3b [890233,29067] 0 2024-09-19T06:08:45.015 INFO:tasks.workunit.client.0.smithi037.stdout:7/303: write d6/d20/d34/f40 [4462196,122669] 0 2024-09-19T06:08:45.016 INFO:tasks.workunit.client.0.smithi037.stdout:2/507: mknod d1/da/d95/cb6 0 2024-09-19T06:08:45.018 INFO:tasks.workunit.client.0.smithi037.stdout:7/304: mknod d6/d20/d4b/c53 0 2024-09-19T06:08:45.018 INFO:tasks.workunit.client.0.smithi037.stdout:7/305: write d6/dc/df/f41 [35366,3470] 0 2024-09-19T06:08:45.018 INFO:tasks.workunit.client.0.smithi037.stdout:7/306: write d6/dc/fd [931150,88514] 0 2024-09-19T06:08:45.018 INFO:tasks.workunit.client.0.smithi037.stdout:2/508: rmdir d1/d6/da3/da8 39 2024-09-19T06:08:45.019 INFO:tasks.workunit.client.0.smithi037.stdout:7/307: symlink d6/d21/l54 0 2024-09-19T06:08:45.019 INFO:tasks.workunit.client.0.smithi037.stdout:2/509: unlink d1/da/f14 0 2024-09-19T06:08:45.020 INFO:tasks.workunit.client.0.smithi037.stdout:7/308: mkdir d6/d20/d2c/d33/d55 0 2024-09-19T06:08:45.021 INFO:tasks.workunit.client.0.smithi037.stdout:7/309: mknod d6/dc/df/c56 0 2024-09-19T06:08:45.024 INFO:tasks.workunit.client.0.smithi037.stdout:7/310: creat d6/d20/d2c/d33/f57 x:0 0 0 2024-09-19T06:08:45.024 INFO:tasks.workunit.client.0.smithi037.stdout:7/311: write d6/dc/f47 [240774,71194] 0 2024-09-19T06:08:45.026 INFO:tasks.workunit.client.0.smithi037.stdout:7/312: creat d6/d20/d34/f58 x:0 0 0 2024-09-19T06:08:45.028 INFO:tasks.workunit.client.0.smithi037.stdout:7/313: mkdir d6/dc/d22/d59 0 2024-09-19T06:08:45.029 INFO:tasks.workunit.client.0.smithi037.stdout:4/443: dwrite d0/f16 [0,4194304] 0 2024-09-19T06:08:45.029 INFO:tasks.workunit.client.0.smithi037.stdout:7/314: symlink d6/d21/l5a 0 2024-09-19T06:08:45.031 INFO:tasks.workunit.client.0.smithi037.stdout:4/444: creat d0/d6/d1b/d20/d48/f9b x:0 0 0 2024-09-19T06:08:45.031 INFO:tasks.workunit.client.0.smithi037.stdout:4/445: write d0/d6/d1b/f3f [61379,107880] 0 2024-09-19T06:08:45.032 INFO:tasks.workunit.client.0.smithi037.stdout:7/315: rmdir d6/d20/d34 39 2024-09-19T06:08:45.032 INFO:tasks.workunit.client.0.smithi037.stdout:8/575: dwrite d1/d61/d68/f86 [0,4194304] 0 2024-09-19T06:08:45.033 INFO:tasks.workunit.client.0.smithi037.stdout:7/316: symlink d6/dc/l5b 0 2024-09-19T06:08:45.033 INFO:tasks.workunit.client.0.smithi037.stdout:8/576: truncate d1/d61/d7e/d8b/d91/d3d/f34 330106 0 2024-09-19T06:08:45.034 INFO:tasks.workunit.client.0.smithi037.stdout:8/577: write d1/d61/d7e/fb2 [248219,77295] 0 2024-09-19T06:08:45.036 INFO:tasks.workunit.client.0.smithi037.stdout:8/578: mkdir d1/dc7 0 2024-09-19T06:08:45.037 INFO:tasks.workunit.client.0.smithi037.stdout:8/579: chown d1/d35/c57 1478431 1 2024-09-19T06:08:45.045 INFO:tasks.workunit.client.0.smithi037.stdout:7/317: getdents d6/dc 0 2024-09-19T06:08:45.047 INFO:tasks.workunit.client.0.smithi037.stdout:4/446: dread d0/f44 [0,4194304] 0 2024-09-19T06:08:45.047 INFO:tasks.workunit.client.0.smithi037.stdout:4/447: dread - d0/d6/d1b/f78 zero size 2024-09-19T06:08:45.047 INFO:tasks.workunit.client.0.smithi037.stdout:4/448: chown d0/d2/d37/f49 1668929744 1 2024-09-19T06:08:45.047 INFO:tasks.workunit.client.0.smithi037.stdout:7/318: creat d6/dc/d22/f5c x:0 0 0 2024-09-19T06:08:45.051 INFO:tasks.workunit.client.0.smithi037.stdout:4/449: fsync d0/d2/d2e/d36/f63 0 2024-09-19T06:08:45.052 INFO:tasks.workunit.client.0.smithi037.stdout:8/580: write d1/d61/d7e/dbc/dc2/d59/f85 [1408020,29338] 0 2024-09-19T06:08:45.053 INFO:tasks.workunit.client.0.smithi037.stdout:4/450: rename d0/d2/d37/f6a to d0/d2/d37/d46/f9c 0 2024-09-19T06:08:45.055 INFO:tasks.workunit.client.0.smithi037.stdout:8/581: mkdir d1/dc8 0 2024-09-19T06:08:45.056 INFO:tasks.workunit.client.0.smithi037.stdout:8/582: creat d1/dc7/fc9 x:0 0 0 2024-09-19T06:08:45.058 INFO:tasks.workunit.client.0.smithi037.stdout:8/583: creat d1/d61/d7e/dbc/dc2/daa/fca x:0 0 0 2024-09-19T06:08:45.058 INFO:tasks.workunit.client.0.smithi037.stdout:8/584: read d1/d35/fb4 [872279,49968] 0 2024-09-19T06:08:45.059 INFO:tasks.workunit.client.0.smithi037.stdout:8/585: link d1/f52 d1/d61/d68/fcb 0 2024-09-19T06:08:45.073 INFO:tasks.workunit.client.0.smithi037.stdout:7/319: dwrite d6/d20/d2c/f31 [4194304,4194304] 0 2024-09-19T06:08:45.073 INFO:tasks.workunit.client.0.smithi037.stdout:8/586: dread d1/d61/d7b/fc3 [0,4194304] 0 2024-09-19T06:08:45.075 INFO:tasks.workunit.client.0.smithi037.stdout:7/320: creat d6/d20/d4b/f5d x:0 0 0 2024-09-19T06:08:45.076 INFO:tasks.workunit.client.0.smithi037.stdout:7/321: creat d6/d20/d34/d49/f5e x:0 0 0 2024-09-19T06:08:45.077 INFO:tasks.workunit.client.0.smithi037.stdout:8/587: read d1/d61/d7e/d8b/d91/f50 [813632,125739] 0 2024-09-19T06:08:45.077 INFO:tasks.workunit.client.0.smithi037.stdout:8/588: write d1/d61/d7e/d8b/d91/d3d/f16 [4875263,13946] 0 2024-09-19T06:08:45.077 INFO:tasks.workunit.client.0.smithi037.stdout:8/589: chown d1/d61/d7e/d8b/d91/d3d/f22 7430 1 2024-09-19T06:08:45.078 INFO:tasks.workunit.client.0.smithi037.stdout:4/451: dwrite d0/f53 [4194304,4194304] 0 2024-09-19T06:08:45.078 INFO:tasks.workunit.client.0.smithi037.stdout:4/452: write d0/d2/d2e/f98 [725598,54640] 0 2024-09-19T06:08:45.078 INFO:tasks.workunit.client.0.smithi037.stdout:4/453: readlink d0/d6/d1b/d30/d80/l94 0 2024-09-19T06:08:45.078 INFO:tasks.workunit.client.0.smithi037.stdout:7/322: creat d6/d21/f5f x:0 0 0 2024-09-19T06:08:45.078 INFO:tasks.workunit.client.0.smithi037.stdout:7/323: chown d6/f3e 793735577 1 2024-09-19T06:08:45.082 INFO:tasks.workunit.client.0.smithi037.stdout:7/324: rename d6/d20/d2c to d6/d20/d4b/d60 0 2024-09-19T06:08:45.084 INFO:tasks.workunit.client.0.smithi037.stdout:7/325: unlink d6/d20/d34/f46 0 2024-09-19T06:08:45.089 INFO:tasks.workunit.client.0.smithi037.stdout:8/590: read d1/d61/d7e/dbc/dc2/d59/f5c [289609,33766] 0 2024-09-19T06:08:45.089 INFO:tasks.workunit.client.0.smithi037.stdout:8/591: dread - d1/d61/d7e/dbc/dc2/daa/fca zero size 2024-09-19T06:08:45.091 INFO:tasks.workunit.client.0.smithi037.stdout:8/592: rename d1/l1c to d1/d61/d7b/lcc 0 2024-09-19T06:08:45.101 INFO:tasks.workunit.client.0.smithi037.stdout:4/454: dwrite d0/d6/d45/d4a/f6c [0,4194304] 0 2024-09-19T06:08:45.105 INFO:tasks.workunit.client.0.smithi037.stdout:7/326: dwrite d6/dc/f2a [0,4194304] 0 2024-09-19T06:08:45.106 INFO:tasks.workunit.client.0.smithi037.stdout:7/327: getdents d6/dc/df 0 2024-09-19T06:08:45.109 INFO:tasks.workunit.client.0.smithi037.stdout:7/328: mkdir d6/d20/d4b/d60/d33/d61 0 2024-09-19T06:08:45.111 INFO:tasks.workunit.client.0.smithi037.stdout:7/329: creat d6/d20/d4b/d60/f62 x:0 0 0 2024-09-19T06:08:45.114 INFO:tasks.workunit.client.0.smithi037.stdout:4/455: dread d0/d6/d45/d4a/f8c [0,4194304] 0 2024-09-19T06:08:45.121 INFO:tasks.workunit.client.0.smithi037.stdout:7/330: dread d6/f12 [0,4194304] 0 2024-09-19T06:08:45.122 INFO:tasks.workunit.client.0.smithi037.stdout:7/331: mknod d6/dc/df/c63 0 2024-09-19T06:08:45.124 INFO:tasks.workunit.client.0.smithi037.stdout:7/332: creat d6/d20/d4b/d60/d33/d61/f64 x:0 0 0 2024-09-19T06:08:45.127 INFO:tasks.workunit.client.0.smithi037.stdout:6/392: sync 2024-09-19T06:08:45.127 INFO:tasks.workunit.client.0.smithi037.stdout:8/593: dwrite d1/d61/d7e/fb2 [0,4194304] 0 2024-09-19T06:08:45.127 INFO:tasks.workunit.client.0.smithi037.stdout:8/594: stat d1/d61/d7e/dbc/dc2/l70 0 2024-09-19T06:08:45.130 INFO:tasks.workunit.client.0.smithi037.stdout:8/595: symlink d1/d61/d7e/d8b/d9f/lcd 0 2024-09-19T06:08:45.130 INFO:tasks.workunit.client.0.smithi037.stdout:8/596: chown d1/d61/d7e/dbc/dc2/c94 113428898 1 2024-09-19T06:08:45.138 INFO:tasks.workunit.client.0.smithi037.stdout:4/456: dwrite d0/d6/f67 [0,4194304] 0 2024-09-19T06:08:45.138 INFO:tasks.workunit.client.0.smithi037.stdout:4/457: write d0/f24 [1224633,63652] 0 2024-09-19T06:08:45.139 INFO:tasks.workunit.client.0.smithi037.stdout:4/458: mknod d0/d2/d37/d92/c9d 0 2024-09-19T06:08:45.140 INFO:tasks.workunit.client.0.smithi037.stdout:4/459: readlink d0/l1 0 2024-09-19T06:08:45.141 INFO:tasks.workunit.client.0.smithi037.stdout:4/460: creat d0/d6/d45/d4a/d86/f9e x:0 0 0 2024-09-19T06:08:45.141 INFO:tasks.workunit.client.0.smithi037.stdout:4/461: chown d0/c17 74025688 1 2024-09-19T06:08:45.144 INFO:tasks.workunit.client.0.smithi037.stdout:6/393: write d9/dd/d1c/d4e/f34 [1647847,88368] 0 2024-09-19T06:08:45.144 INFO:tasks.workunit.client.0.smithi037.stdout:6/394: chown d9/dd/d2b 1 1 2024-09-19T06:08:45.144 INFO:tasks.workunit.client.0.smithi037.stdout:7/333: dread d6/f3e [0,4194304] 0 2024-09-19T06:08:45.144 INFO:tasks.workunit.client.0.smithi037.stdout:6/395: rmdir d9/d6e 39 2024-09-19T06:08:45.145 INFO:tasks.workunit.client.0.smithi037.stdout:6/396: mkdir d9/d78 0 2024-09-19T06:08:45.145 INFO:tasks.workunit.client.0.smithi037.stdout:6/397: truncate d9/dd/d1c/d4e/d2f/f70 745769 0 2024-09-19T06:08:45.147 INFO:tasks.workunit.client.0.smithi037.stdout:6/398: rename d9/dd/d1c/d4e/d2f to d9/dd/d2b/d79 0 2024-09-19T06:08:45.148 INFO:tasks.workunit.client.0.smithi037.stdout:6/399: creat d9/dd/d2b/d79/f7a x:0 0 0 2024-09-19T06:08:45.148 INFO:tasks.workunit.client.0.smithi037.stdout:6/400: creat d9/dd/d1c/d4e/f7b x:0 0 0 2024-09-19T06:08:45.150 INFO:tasks.workunit.client.0.smithi037.stdout:6/401: dread d9/dd/d2b/d79/f70 [0,4194304] 0 2024-09-19T06:08:45.152 INFO:tasks.workunit.client.0.smithi037.stdout:6/402: link d9/dd/d20/f76 d9/dd/d2b/f7c 0 2024-09-19T06:08:45.152 INFO:tasks.workunit.client.0.smithi037.stdout:6/403: rmdir d9/dd/d20/d5a/d6d 39 2024-09-19T06:08:45.153 INFO:tasks.workunit.client.0.smithi037.stdout:8/597: dwrite d1/d61/d7e/dbc/dc2/d59/d5d/f60 [4194304,4194304] 0 2024-09-19T06:08:45.153 INFO:tasks.workunit.client.0.smithi037.stdout:8/598: chown d1/d61/d7e/dbc/dc2/d59/d5d 50042552 1 2024-09-19T06:08:45.153 INFO:tasks.workunit.client.0.smithi037.stdout:6/404: mknod d9/d6e/c7d 0 2024-09-19T06:08:45.154 INFO:tasks.workunit.client.0.smithi037.stdout:8/599: truncate d1/f43 1335396 0 2024-09-19T06:08:45.155 INFO:tasks.workunit.client.0.smithi037.stdout:6/405: symlink d9/d6e/l7e 0 2024-09-19T06:08:45.157 INFO:tasks.workunit.client.0.smithi037.stdout:6/406: link d9/f24 d9/dd/d20/d5a/d6d/f7f 0 2024-09-19T06:08:45.158 INFO:tasks.workunit.client.0.smithi037.stdout:6/407: write d9/dd/d20/f27 [1236505,101716] 0 2024-09-19T06:08:45.165 INFO:tasks.workunit.client.0.smithi037.stdout:4/462: dwrite d0/d2/d2e/f43 [0,4194304] 0 2024-09-19T06:08:45.166 INFO:tasks.workunit.client.0.smithi037.stdout:4/463: chown d0/d2/d37 1773830202 1 2024-09-19T06:08:45.168 INFO:tasks.workunit.client.0.smithi037.stdout:4/464: symlink d0/d2/d2e/l9f 0 2024-09-19T06:08:45.168 INFO:tasks.workunit.client.0.smithi037.stdout:4/465: fdatasync d0/d6/d45/d4a/d6f/d8e/f97 0 2024-09-19T06:08:45.169 INFO:tasks.workunit.client.0.smithi037.stdout:4/466: readlink d0/d2/d2e/l61 0 2024-09-19T06:08:45.169 INFO:tasks.workunit.client.0.smithi037.stdout:7/334: dwrite d6/d20/d4b/d60/d33/d61/f64 [0,4194304] 0 2024-09-19T06:08:45.170 INFO:tasks.workunit.client.0.smithi037.stdout:4/467: link d0/d2/l13 d0/d6/d1b/d20/la0 0 2024-09-19T06:08:45.171 INFO:tasks.workunit.client.0.smithi037.stdout:4/468: readlink d0/d6/d1b/d30/d80/l94 0 2024-09-19T06:08:45.179 INFO:tasks.workunit.client.0.smithi037.stdout:6/408: dwrite d9/f24 [4194304,4194304] 0 2024-09-19T06:08:45.179 INFO:tasks.workunit.client.0.smithi037.stdout:4/469: link d0/d6/d1b/f3f d0/d2/d37/fa1 0 2024-09-19T06:08:45.181 INFO:tasks.workunit.client.0.smithi037.stdout:6/409: creat d9/dd/d1c/f80 x:0 0 0 2024-09-19T06:08:45.182 INFO:tasks.workunit.client.0.smithi037.stdout:4/470: symlink d0/d6/d45/la2 0 2024-09-19T06:08:45.183 INFO:tasks.workunit.client.0.smithi037.stdout:4/471: symlink d0/d6/d45/d4a/d6f/d8e/la3 0 2024-09-19T06:08:45.183 INFO:tasks.workunit.client.0.smithi037.stdout:8/600: dwrite d1/d61/d7e/dbc/dc2/d59/d5d/f81 [0,4194304] 0 2024-09-19T06:08:45.184 INFO:tasks.workunit.client.0.smithi037.stdout:4/472: creat d0/d2/d37/d92/fa4 x:0 0 0 2024-09-19T06:08:45.197 INFO:tasks.workunit.client.0.smithi037.stdout:4/473: dread d0/d2/d2e/d36/f79 [0,4194304] 0 2024-09-19T06:08:45.197 INFO:tasks.workunit.client.0.smithi037.stdout:4/474: chown d0/d6/d1b/d20/f62 1895039 1 2024-09-19T06:08:45.219 INFO:tasks.workunit.client.0.smithi037.stdout:4/475: dwrite d0/d2/d37/fa1 [0,4194304] 0 2024-09-19T06:08:45.227 INFO:tasks.workunit.client.0.smithi037.stdout:8/601: rename d1/d61/d7e/dbc/dc2/d59/f85 to d1/d61/d7e/dbc/dc2/d9b/fce 0 2024-09-19T06:08:45.229 INFO:tasks.workunit.client.0.smithi037.stdout:4/476: creat d0/d2/d37/d92/fa5 x:0 0 0 2024-09-19T06:08:45.230 INFO:tasks.workunit.client.0.smithi037.stdout:8/602: creat d1/d61/d7e/d8b/d91/fcf x:0 0 0 2024-09-19T06:08:45.241 INFO:tasks.workunit.client.0.smithi037.stdout:9/552: sync 2024-09-19T06:08:45.241 INFO:tasks.workunit.client.0.smithi037.stdout:3/414: sync 2024-09-19T06:08:45.241 INFO:tasks.workunit.client.0.smithi037.stdout:1/380: sync 2024-09-19T06:08:45.241 INFO:tasks.workunit.client.0.smithi037.stdout:3/415: truncate d0/f5a 4820633 0 2024-09-19T06:08:45.241 INFO:tasks.workunit.client.0.smithi037.stdout:3/416: fdatasync d0/d16/f81 0 2024-09-19T06:08:45.243 INFO:tasks.workunit.client.0.smithi037.stdout:8/603: dread d1/d61/d7e/dbc/dc2/d59/d5d/f60 [0,4194304] 0 2024-09-19T06:08:45.243 INFO:tasks.workunit.client.0.smithi037.stdout:1/381: getdents d2/d12/d1e/d2d/d6f 0 2024-09-19T06:08:45.244 INFO:tasks.workunit.client.0.smithi037.stdout:9/553: mknod da/dd/d1b/d2f/d6d/cc6 0 2024-09-19T06:08:45.245 INFO:tasks.workunit.client.0.smithi037.stdout:3/417: truncate d0/d43/d23/d7a/d77/f5c 1558639 0 2024-09-19T06:08:45.247 INFO:tasks.workunit.client.0.smithi037.stdout:1/382: rename d2/d12/d1e/d2d/f7d to d2/d12/d1d/d47/f80 0 2024-09-19T06:08:45.248 INFO:tasks.workunit.client.0.smithi037.stdout:1/383: truncate d2/d12/d1d/f45 1412851 0 2024-09-19T06:08:45.248 INFO:tasks.workunit.client.0.smithi037.stdout:1/384: readlink d2/d12/d1d/l22 0 2024-09-19T06:08:45.248 INFO:tasks.workunit.client.0.smithi037.stdout:1/385: write d2/d12/f44 [4589326,129277] 0 2024-09-19T06:08:45.248 INFO:tasks.workunit.client.0.smithi037.stdout:1/386: stat d2/d12/d1e/d2a/c79 0 2024-09-19T06:08:45.248 INFO:tasks.workunit.client.0.smithi037.stdout:1/387: chown d2/f9 3382 1 2024-09-19T06:08:45.248 INFO:tasks.workunit.client.0.smithi037.stdout:8/604: mkdir d1/d61/d7e/dbc/dd0 0 2024-09-19T06:08:45.249 INFO:tasks.workunit.client.0.smithi037.stdout:9/554: truncate da/dd/d1b/d43/f66 2948065 0 2024-09-19T06:08:45.251 INFO:tasks.workunit.client.0.smithi037.stdout:3/418: symlink d0/d43/d23/d7a/d77/l92 0 2024-09-19T06:08:45.253 INFO:tasks.workunit.client.0.smithi037.stdout:1/388: creat d2/d48/f81 x:0 0 0 2024-09-19T06:08:45.253 INFO:tasks.workunit.client.0.smithi037.stdout:8/605: mknod d1/d61/d7e/dbc/dc2/d59/da9/cd1 0 2024-09-19T06:08:45.253 INFO:tasks.workunit.client.0.smithi037.stdout:8/606: readlink d1/d61/d7e/dbc/dc2/l70 0 2024-09-19T06:08:45.255 INFO:tasks.workunit.client.0.smithi037.stdout:9/555: mknod da/dd/d1b/d23/d6a/d8f/cc7 0 2024-09-19T06:08:45.255 INFO:tasks.workunit.client.0.smithi037.stdout:9/556: dread - da/dd/d1b/d62/fae zero size 2024-09-19T06:08:45.255 INFO:tasks.workunit.client.0.smithi037.stdout:9/557: write da/d20/f2a [3732115,45834] 0 2024-09-19T06:08:45.255 INFO:tasks.workunit.client.0.smithi037.stdout:9/558: fdatasync da/dd/d31/f3a 0 2024-09-19T06:08:45.256 INFO:tasks.workunit.client.0.smithi037.stdout:1/389: creat d2/d12/d15/d34/f82 x:0 0 0 2024-09-19T06:08:45.257 INFO:tasks.workunit.client.0.smithi037.stdout:8/607: truncate d1/d61/d68/f86 6473413 0 2024-09-19T06:08:45.259 INFO:tasks.workunit.client.0.smithi037.stdout:8/608: symlink d1/d61/d7e/dbc/dc2/daa/ld2 0 2024-09-19T06:08:45.259 INFO:tasks.workunit.client.0.smithi037.stdout:8/609: readlink d1/d61/d7e/d8b/d91/l47 0 2024-09-19T06:08:45.259 INFO:tasks.workunit.client.0.smithi037.stdout:8/610: fdatasync d1/f6c 0 2024-09-19T06:08:45.277 INFO:tasks.workunit.client.0.smithi037.stdout:3/419: dwrite d0/f17 [0,4194304] 0 2024-09-19T06:08:45.280 INFO:tasks.workunit.client.0.smithi037.stdout:3/420: symlink d0/d16/d19/d1d/d82/l93 0 2024-09-19T06:08:45.281 INFO:tasks.workunit.client.0.smithi037.stdout:1/390: dwrite d2/d12/f44 [4194304,4194304] 0 2024-09-19T06:08:45.282 INFO:tasks.workunit.client.0.smithi037.stdout:0/446: sync 2024-09-19T06:08:45.282 INFO:tasks.workunit.client.0.smithi037.stdout:5/439: sync 2024-09-19T06:08:45.282 INFO:tasks.workunit.client.0.smithi037.stdout:5/440: dread - d2/d12/d28/d22/d53/f93 zero size 2024-09-19T06:08:45.282 INFO:tasks.workunit.client.0.smithi037.stdout:0/447: write d5/d17/f5f [893301,22254] 0 2024-09-19T06:08:45.282 INFO:tasks.workunit.client.0.smithi037.stdout:2/510: sync 2024-09-19T06:08:45.285 INFO:tasks.workunit.client.0.smithi037.stdout:1/391: mknod d2/d12/d15/d5c/c83 0 2024-09-19T06:08:45.295 INFO:tasks.workunit.client.0.smithi037.stdout:3/421: dread d0/d16/f30 [0,4194304] 0 2024-09-19T06:08:45.301 INFO:tasks.workunit.client.0.smithi037.stdout:1/392: read d2/f6 [3540104,11685] 0 2024-09-19T06:08:45.305 INFO:tasks.workunit.client.0.smithi037.stdout:2/511: write d1/d6/f12 [3224804,120172] 0 2024-09-19T06:08:45.305 INFO:tasks.workunit.client.0.smithi037.stdout:2/512: chown d1/d33/c69 432213 1 2024-09-19T06:08:45.306 INFO:tasks.workunit.client.0.smithi037.stdout:1/393: creat d2/d12/d1e/d75/f84 x:0 0 0 2024-09-19T06:08:45.308 INFO:tasks.workunit.client.0.smithi037.stdout:2/513: link d1/da/f6d d1/d16/d4a/fb7 0 2024-09-19T06:08:45.308 INFO:tasks.workunit.client.0.smithi037.stdout:2/514: chown d1/d16/db1 3 1 2024-09-19T06:08:45.308 INFO:tasks.workunit.client.0.smithi037.stdout:2/515: fdatasync d1/da/dc/d21/d7d/dab/f50 0 2024-09-19T06:08:45.308 INFO:tasks.workunit.client.0.smithi037.stdout:2/516: readlink d1/da/dc/d21/d51/l8a 0 2024-09-19T06:08:45.309 INFO:tasks.workunit.client.0.smithi037.stdout:1/394: creat d2/d12/d1e/d2d/f85 x:0 0 0 2024-09-19T06:08:45.309 INFO:tasks.workunit.client.0.smithi037.stdout:1/395: rename d2/d12 to d2/d12/d1e/d75/d86 22 2024-09-19T06:08:45.309 INFO:tasks.workunit.client.0.smithi037.stdout:1/396: write d2/d12/d1e/d2a/d2e/f7f [501769,66991] 0 2024-09-19T06:08:45.310 INFO:tasks.workunit.client.0.smithi037.stdout:2/517: rmdir d1/d6/d8b 0 2024-09-19T06:08:45.312 INFO:tasks.workunit.client.0.smithi037.stdout:9/559: unlink da/f3b 0 2024-09-19T06:08:45.312 INFO:tasks.workunit.client.0.smithi037.stdout:9/560: write da/dd/d1b/d43/f88 [511023,70427] 0 2024-09-19T06:08:45.313 INFO:tasks.workunit.client.0.smithi037.stdout:5/441: dwrite d2/d10/f1e [0,4194304] 0 2024-09-19T06:08:45.313 INFO:tasks.workunit.client.0.smithi037.stdout:5/442: stat d2/d12/d28/d22/d53/l6b 0 2024-09-19T06:08:45.313 INFO:tasks.workunit.client.0.smithi037.stdout:1/397: mkdir d2/d12/d1e/d2d/d87 0 2024-09-19T06:08:45.313 INFO:tasks.workunit.client.0.smithi037.stdout:2/518: dread d1/da/dc/d21/d51/f52 [0,4194304] 0 2024-09-19T06:08:45.315 INFO:tasks.workunit.client.0.smithi037.stdout:3/422: dwrite d0/d16/d19/d1d/d7c/f85 [0,4194304] 0 2024-09-19T06:08:45.315 INFO:tasks.workunit.client.0.smithi037.stdout:3/423: stat d0/c11 0 2024-09-19T06:08:45.318 INFO:tasks.workunit.client.0.smithi037.stdout:5/443: mkdir d2/d12/d24/d58/d96 0 2024-09-19T06:08:45.318 INFO:tasks.workunit.client.0.smithi037.stdout:2/519: mknod d1/cb8 0 2024-09-19T06:08:45.322 INFO:tasks.workunit.client.0.smithi037.stdout:3/424: creat d0/d43/f94 x:0 0 0 2024-09-19T06:08:45.322 INFO:tasks.workunit.client.0.smithi037.stdout:5/444: mkdir d2/d12/d24/d97 0 2024-09-19T06:08:45.324 INFO:tasks.workunit.client.0.smithi037.stdout:2/520: symlink d1/da/dc/lb9 0 2024-09-19T06:08:45.325 INFO:tasks.workunit.client.0.smithi037.stdout:5/445: truncate d2/d10/f21 3965296 0 2024-09-19T06:08:45.325 INFO:tasks.workunit.client.0.smithi037.stdout:5/446: chown d2/d12/d28 8306881 1 2024-09-19T06:08:45.325 INFO:tasks.workunit.client.0.smithi037.stdout:2/521: rmdir d1/da/d6e/da0 39 2024-09-19T06:08:45.325 INFO:tasks.workunit.client.0.smithi037.stdout:2/522: truncate d1/da/dc/f3b 937130 0 2024-09-19T06:08:45.326 INFO:tasks.workunit.client.0.smithi037.stdout:5/447: symlink d2/d12/d24/d58/d7f/l98 0 2024-09-19T06:08:45.327 INFO:tasks.workunit.client.0.smithi037.stdout:5/448: getdents d2/d12/d24/d97 0 2024-09-19T06:08:45.327 INFO:tasks.workunit.client.0.smithi037.stdout:2/523: mknod d1/d33/d4c/cba 0 2024-09-19T06:08:45.328 INFO:tasks.workunit.client.0.smithi037.stdout:5/449: truncate d2/d5c/f7b 1333481 0 2024-09-19T06:08:45.328 INFO:tasks.workunit.client.0.smithi037.stdout:5/450: fsync d2/d12/d28/f48 0 2024-09-19T06:08:45.330 INFO:tasks.workunit.client.0.smithi037.stdout:5/451: unlink d2/d12/d24/d58/l63 0 2024-09-19T06:08:45.331 INFO:tasks.workunit.client.0.smithi037.stdout:5/452: truncate d2/f7 116322 0 2024-09-19T06:08:45.334 INFO:tasks.workunit.client.0.smithi037.stdout:7/335: sync 2024-09-19T06:08:45.335 INFO:tasks.workunit.client.0.smithi037.stdout:7/336: chown d6/d20/d4b/f5d 32532856 1 2024-09-19T06:08:45.335 INFO:tasks.workunit.client.0.smithi037.stdout:7/337: chown d6/d20/d4b/c53 0 1 2024-09-19T06:08:45.351 INFO:tasks.workunit.client.0.smithi037.stdout:2/524: write d1/da/fa5 [2604651,28041] 0 2024-09-19T06:08:45.351 INFO:tasks.workunit.client.0.smithi037.stdout:3/425: dwrite d0/d16/d19/f42 [0,4194304] 0 2024-09-19T06:08:45.351 INFO:tasks.workunit.client.0.smithi037.stdout:3/426: truncate d0/d16/d19/f3b 835291 0 2024-09-19T06:08:45.351 INFO:tasks.workunit.client.0.smithi037.stdout:9/561: dwrite da/dd/d31/f3a [0,4194304] 0 2024-09-19T06:08:45.351 INFO:tasks.workunit.client.0.smithi037.stdout:9/562: dread - da/fa5 zero size 2024-09-19T06:08:45.351 INFO:tasks.workunit.client.0.smithi037.stdout:1/398: dwrite d2/d12/d1e/d2d/f4c [0,4194304] 0 2024-09-19T06:08:45.352 INFO:tasks.workunit.client.0.smithi037.stdout:1/399: truncate d2/f38 303529 0 2024-09-19T06:08:45.354 INFO:tasks.workunit.client.0.smithi037.stdout:2/525: rename d1/da/dc/c65 to d1/da/d6e/da0/cbb 0 2024-09-19T06:08:45.358 INFO:tasks.workunit.client.0.smithi037.stdout:5/453: dread d2/fd [0,4194304] 0 2024-09-19T06:08:45.358 INFO:tasks.workunit.client.0.smithi037.stdout:5/454: chown d2/d12/f5d 61568284 1 2024-09-19T06:08:45.360 INFO:tasks.workunit.client.0.smithi037.stdout:1/400: getdents d2/d73 0 2024-09-19T06:08:45.361 INFO:tasks.workunit.client.0.smithi037.stdout:5/455: creat d2/d12/d24/d58/d8e/f99 x:0 0 0 2024-09-19T06:08:45.361 INFO:tasks.workunit.client.0.smithi037.stdout:5/456: chown d2/d10/f1f 42353 1 2024-09-19T06:08:45.362 INFO:tasks.workunit.client.0.smithi037.stdout:1/401: rmdir d2/d12/d1e/d75 39 2024-09-19T06:08:45.364 INFO:tasks.workunit.client.0.smithi037.stdout:7/338: dwrite d6/dc/d22/f1a [0,4194304] 0 2024-09-19T06:08:45.366 INFO:tasks.workunit.client.0.smithi037.stdout:7/339: symlink d6/d20/d4b/d60/d33/l65 0 2024-09-19T06:08:45.367 INFO:tasks.workunit.client.0.smithi037.stdout:7/340: write d6/dc/f16 [4898823,26433] 0 2024-09-19T06:08:45.369 INFO:tasks.workunit.client.0.smithi037.stdout:7/341: link d6/dc/f47 d6/d20/d34/f66 0 2024-09-19T06:08:45.371 INFO:tasks.workunit.client.0.smithi037.stdout:7/342: mknod d6/d20/d4b/d60/d33/d55/c67 0 2024-09-19T06:08:45.371 INFO:tasks.workunit.client.0.smithi037.stdout:7/343: write d6/f3a [642809,56916] 0 2024-09-19T06:08:45.371 INFO:tasks.workunit.client.0.smithi037.stdout:6/410: sync 2024-09-19T06:08:45.371 INFO:tasks.workunit.client.0.smithi037.stdout:6/411: write d9/dd/d2b/f61 [1226687,65915] 0 2024-09-19T06:08:45.372 INFO:tasks.workunit.client.0.smithi037.stdout:6/412: symlink d9/dd/d20/d5a/d6d/l81 0 2024-09-19T06:08:45.373 INFO:tasks.workunit.client.0.smithi037.stdout:6/413: mkdir d9/dd/d20/d5a/d6d/d82 0 2024-09-19T06:08:45.373 INFO:tasks.workunit.client.0.smithi037.stdout:6/414: chown d9/dd/d20 94757469 1 2024-09-19T06:08:45.374 INFO:tasks.workunit.client.0.smithi037.stdout:6/415: link d9/dd/f32 d9/d6e/f83 0 2024-09-19T06:08:45.375 INFO:tasks.workunit.client.0.smithi037.stdout:6/416: creat d9/dd/d20/d5a/d6d/d82/f84 x:0 0 0 2024-09-19T06:08:45.376 INFO:tasks.workunit.client.0.smithi037.stdout:6/417: mkdir d9/d78/d85 0 2024-09-19T06:08:45.376 INFO:tasks.workunit.client.0.smithi037.stdout:6/418: write d9/dd/d2b/d79/f51 [617797,65805] 0 2024-09-19T06:08:45.377 INFO:tasks.workunit.client.0.smithi037.stdout:6/419: chown d9/dd/d1c/f2e 754524 1 2024-09-19T06:08:45.377 INFO:tasks.workunit.client.0.smithi037.stdout:6/420: rename d9/dd/d20/d5a/f6a to d9/dd/d1c/d73/f86 0 2024-09-19T06:08:45.383 INFO:tasks.workunit.client.0.smithi037.stdout:2/526: write d1/d16/d4a/f8d [1676042,44979] 0 2024-09-19T06:08:45.383 INFO:tasks.workunit.client.0.smithi037.stdout:2/527: dread - d1/da/dc/d21/d55/fa4 zero size 2024-09-19T06:08:45.384 INFO:tasks.workunit.client.0.smithi037.stdout:2/528: rename d1/d9d to d1/da/dc/d21/d55/dbc 0 2024-09-19T06:08:45.392 INFO:tasks.workunit.client.0.smithi037.stdout:5/457: dwrite d2/d5c/f7b [0,4194304] 0 2024-09-19T06:08:45.392 INFO:tasks.workunit.client.0.smithi037.stdout:5/458: readlink d2/d5c/l6c 0 2024-09-19T06:08:45.393 INFO:tasks.workunit.client.0.smithi037.stdout:5/459: creat d2/d12/d24/d58/d8e/f9a x:0 0 0 2024-09-19T06:08:45.394 INFO:tasks.workunit.client.0.smithi037.stdout:5/460: rmdir d2/d5c 39 2024-09-19T06:08:45.395 INFO:tasks.workunit.client.0.smithi037.stdout:5/461: symlink d2/d12/d24/d58/d96/l9b 0 2024-09-19T06:08:45.396 INFO:tasks.workunit.client.0.smithi037.stdout:5/462: link d2/d12/f36 d2/d12/d24/d97/f9c 0 2024-09-19T06:08:45.398 INFO:tasks.workunit.client.0.smithi037.stdout:7/344: dwrite d6/d20/d34/f40 [0,4194304] 0 2024-09-19T06:08:45.398 INFO:tasks.workunit.client.0.smithi037.stdout:7/345: dread - d6/d20/d34/f58 zero size 2024-09-19T06:08:45.398 INFO:tasks.workunit.client.0.smithi037.stdout:6/421: dwrite d9/dd/d20/d5a/d6d/f7f [0,4194304] 0 2024-09-19T06:08:45.403 INFO:tasks.workunit.client.0.smithi037.stdout:6/422: dread d9/dd/d2b/f7c [0,4194304] 0 2024-09-19T06:08:45.403 INFO:tasks.workunit.client.0.smithi037.stdout:6/423: chown d9/dd/d20/c6c 37295 1 2024-09-19T06:08:45.403 INFO:tasks.workunit.client.0.smithi037.stdout:6/424: rmdir d9/d6e 39 2024-09-19T06:08:45.403 INFO:tasks.workunit.client.0.smithi037.stdout:6/425: chown d9/dd/d20/f48 2 1 2024-09-19T06:08:45.404 INFO:tasks.workunit.client.0.smithi037.stdout:6/426: symlink d9/dd/d1c/d73/l87 0 2024-09-19T06:08:45.406 INFO:tasks.workunit.client.0.smithi037.stdout:7/346: write d6/f38 [434361,115122] 0 2024-09-19T06:08:45.407 INFO:tasks.workunit.client.0.smithi037.stdout:7/347: mkdir d6/d21/d68 0 2024-09-19T06:08:45.408 INFO:tasks.workunit.client.0.smithi037.stdout:7/348: link d6/d20/d34/f40 d6/dc/df/f69 0 2024-09-19T06:08:45.408 INFO:tasks.workunit.client.0.smithi037.stdout:7/349: fsync d6/f2b 0 2024-09-19T06:08:45.408 INFO:tasks.workunit.client.0.smithi037.stdout:7/350: truncate d6/dc/d22/f5c 811086 0 2024-09-19T06:08:45.409 INFO:tasks.workunit.client.0.smithi037.stdout:7/351: symlink d6/d20/d34/l6a 0 2024-09-19T06:08:45.409 INFO:tasks.workunit.client.0.smithi037.stdout:7/352: fsync d6/d20/d34/f50 0 2024-09-19T06:08:45.418 INFO:tasks.workunit.client.0.smithi037.stdout:9/563: dwrite da/dd/d1b/d43/f54 [0,4194304] 0 2024-09-19T06:08:45.423 INFO:tasks.workunit.client.0.smithi037.stdout:5/463: write d2/d12/d28/d22/d53/f7d [3884045,11196] 0 2024-09-19T06:08:45.423 INFO:tasks.workunit.client.0.smithi037.stdout:5/464: write d2/d12/d28/d22/d53/f93 [29246,128483] 0 2024-09-19T06:08:45.426 INFO:tasks.workunit.client.0.smithi037.stdout:5/465: rename d2/d12/d24/l44 to d2/d12/d24/l9d 0 2024-09-19T06:08:45.431 INFO:tasks.workunit.client.0.smithi037.stdout:2/529: dread d1/d16/f74 [0,4194304] 0 2024-09-19T06:08:45.431 INFO:tasks.workunit.client.0.smithi037.stdout:6/427: dwrite d9/dd/d1c/f2e [0,4194304] 0 2024-09-19T06:08:45.431 INFO:tasks.workunit.client.0.smithi037.stdout:6/428: write d9/f19 [1276115,109398] 0 2024-09-19T06:08:45.431 INFO:tasks.workunit.client.0.smithi037.stdout:6/429: readlink d9/d16/l5c 0 2024-09-19T06:08:45.443 INFO:tasks.workunit.client.0.smithi037.stdout:5/466: dread d2/d12/d28/d22/f3c [0,4194304] 0 2024-09-19T06:08:45.443 INFO:tasks.workunit.client.0.smithi037.stdout:7/353: dwrite d6/d20/d4b/d60/f62 [0,4194304] 0 2024-09-19T06:08:45.444 INFO:tasks.workunit.client.0.smithi037.stdout:2/530: dread d1/d16/d4a/fb7 [0,4194304] 0 2024-09-19T06:08:45.446 INFO:tasks.workunit.client.0.smithi037.stdout:7/354: creat d6/d20/d4b/d60/d33/f6b x:0 0 0 2024-09-19T06:08:45.447 INFO:tasks.workunit.client.0.smithi037.stdout:7/355: write d6/dc/fd [993049,12032] 0 2024-09-19T06:08:45.447 INFO:tasks.workunit.client.0.smithi037.stdout:7/356: chown d6/d20/d4b/d60/d33/c4f 922742960 1 2024-09-19T06:08:45.447 INFO:tasks.workunit.client.0.smithi037.stdout:2/531: truncate d1/da/f2a 2281822 0 2024-09-19T06:08:45.448 INFO:tasks.workunit.client.0.smithi037.stdout:9/564: dwrite da/d4d/f87 [0,4194304] 0 2024-09-19T06:08:45.453 INFO:tasks.workunit.client.0.smithi037.stdout:9/565: link da/dd/cf da/dd/d1b/d2f/d6d/cc8 0 2024-09-19T06:08:45.456 INFO:tasks.workunit.client.0.smithi037.stdout:4/477: sync 2024-09-19T06:08:45.456 INFO:tasks.workunit.client.0.smithi037.stdout:4/478: write d0/d6/d1b/d20/d48/f9b [134918,124782] 0 2024-09-19T06:08:45.456 INFO:tasks.workunit.client.0.smithi037.stdout:4/479: getdents d0/d6/d45/d4a 0 2024-09-19T06:08:45.458 INFO:tasks.workunit.client.0.smithi037.stdout:4/480: rename d0/d6/d45/d4a/d6f/d8e/f97 to d0/d6/d1b/d20/d48/fa6 0 2024-09-19T06:08:45.458 INFO:tasks.workunit.client.0.smithi037.stdout:4/481: write d0/d6/d1b/d20/d4d/d64/f96 [1190848,1531] 0 2024-09-19T06:08:45.459 INFO:tasks.workunit.client.0.smithi037.stdout:4/482: getdents d0/d2/d37 0 2024-09-19T06:08:45.459 INFO:tasks.workunit.client.0.smithi037.stdout:4/483: readlink d0/d6/d45/l91 0 2024-09-19T06:08:45.459 INFO:tasks.workunit.client.0.smithi037.stdout:4/484: chown d0/d6/d1b/d20/d4d 77017 1 2024-09-19T06:08:45.460 INFO:tasks.workunit.client.0.smithi037.stdout:5/467: dread d2/d10/f1e [0,4194304] 0 2024-09-19T06:08:45.461 INFO:tasks.workunit.client.0.smithi037.stdout:7/357: read d6/dc/f2a [2088701,32146] 0 2024-09-19T06:08:45.461 INFO:tasks.workunit.client.0.smithi037.stdout:7/358: truncate d6/dc/f47 331265 0 2024-09-19T06:08:45.463 INFO:tasks.workunit.client.0.smithi037.stdout:4/485: unlink d0/d6/c74 0 2024-09-19T06:08:45.463 INFO:tasks.workunit.client.0.smithi037.stdout:4/486: chown d0/d2/d2e/d36/f63 13 1 2024-09-19T06:08:45.463 INFO:tasks.workunit.client.0.smithi037.stdout:6/430: dwrite d9/dd/d1c/d4e/d62/f74 [0,4194304] 0 2024-09-19T06:08:45.463 INFO:tasks.workunit.client.0.smithi037.stdout:4/487: write d0/d6/d45/d4a/f84 [683493,33356] 0 2024-09-19T06:08:45.463 INFO:tasks.workunit.client.0.smithi037.stdout:6/431: write d9/dd/d20/d5a/d6d/f72 [53840,110283] 0 2024-09-19T06:08:45.465 INFO:tasks.workunit.client.0.smithi037.stdout:7/359: rmdir d6/dc/d22 39 2024-09-19T06:08:45.465 INFO:tasks.workunit.client.0.smithi037.stdout:7/360: chown d6/dc/df/c32 173254564 1 2024-09-19T06:08:45.465 INFO:tasks.workunit.client.0.smithi037.stdout:7/361: truncate d6/d20/d4b/f5d 913327 0 2024-09-19T06:08:45.467 INFO:tasks.workunit.client.0.smithi037.stdout:4/488: mkdir d0/d6/d1b/d20/d48/da7 0 2024-09-19T06:08:45.469 INFO:tasks.workunit.client.0.smithi037.stdout:5/468: mkdir d2/d12/d28/d22/d4a/d9e 0 2024-09-19T06:08:45.469 INFO:tasks.workunit.client.0.smithi037.stdout:5/469: chown d2/d12/d28/l1d 86 1 2024-09-19T06:08:45.469 INFO:tasks.workunit.client.0.smithi037.stdout:5/470: write d2/d12/d28/f45 [1964718,101033] 0 2024-09-19T06:08:45.470 INFO:tasks.workunit.client.0.smithi037.stdout:7/362: creat d6/d20/f6c x:0 0 0 2024-09-19T06:08:45.470 INFO:tasks.workunit.client.0.smithi037.stdout:7/363: write d6/dc/fd [2498797,37437] 0 2024-09-19T06:08:45.473 INFO:tasks.workunit.client.0.smithi037.stdout:5/471: rename d2/d5c/d5f to d2/d12/d28/d22/d4a/d9f 0 2024-09-19T06:08:45.473 INFO:tasks.workunit.client.0.smithi037.stdout:5/472: chown d2/d12/d24/d58/d7f 186669 1 2024-09-19T06:08:45.473 INFO:tasks.workunit.client.0.smithi037.stdout:5/473: write d2/d12/d28/d22/d53/f8a [995215,50178] 0 2024-09-19T06:08:45.473 INFO:tasks.workunit.client.0.smithi037.stdout:5/474: write d2/d12/d28/d22/d53/f89 [960408,104639] 0 2024-09-19T06:08:45.476 INFO:tasks.workunit.client.0.smithi037.stdout:9/566: dwrite da/d20/fc2 [0,4194304] 0 2024-09-19T06:08:45.476 INFO:tasks.workunit.client.0.smithi037.stdout:5/475: rename d2/d12/d28/d57/d82/f86 to d2/d12/d28/d22/d35/fa0 0 2024-09-19T06:08:45.478 INFO:tasks.workunit.client.0.smithi037.stdout:5/476: unlink d2/d12/f32 0 2024-09-19T06:08:45.485 INFO:tasks.workunit.client.0.smithi037.stdout:5/477: mkdir d2/d10/da1 0 2024-09-19T06:08:45.486 INFO:tasks.workunit.client.0.smithi037.stdout:4/489: dread d0/f41 [0,4194304] 0 2024-09-19T06:08:45.487 INFO:tasks.workunit.client.0.smithi037.stdout:4/490: mknod d0/d6/d1b/d20/d77/ca8 0 2024-09-19T06:08:45.489 INFO:tasks.workunit.client.0.smithi037.stdout:6/432: write d9/d16/f4b [243257,21119] 0 2024-09-19T06:08:45.490 INFO:tasks.workunit.client.0.smithi037.stdout:5/478: dread d2/d12/d28/d22/d53/f93 [0,4194304] 0 2024-09-19T06:08:45.497 INFO:tasks.workunit.client.0.smithi037.stdout:4/491: mkdir d0/d6/d45/d4a/d6f/da9 0 2024-09-19T06:08:45.499 INFO:tasks.workunit.client.0.smithi037.stdout:7/364: dwrite d6/d20/d4b/d60/d33/f6b [0,4194304] 0 2024-09-19T06:08:45.499 INFO:tasks.workunit.client.0.smithi037.stdout:4/492: link d0/d6/d1b/d30/d80/l94 d0/d6/d1b/d20/d48/da7/laa 0 2024-09-19T06:08:45.500 INFO:tasks.workunit.client.0.smithi037.stdout:8/611: sync 2024-09-19T06:08:45.500 INFO:tasks.workunit.client.0.smithi037.stdout:0/448: sync 2024-09-19T06:08:45.500 INFO:tasks.workunit.client.0.smithi037.stdout:8/612: dread - d1/d61/d7e/d8b/d9f/fad zero size 2024-09-19T06:08:45.504 INFO:tasks.workunit.client.0.smithi037.stdout:4/493: truncate d0/d6/d1b/d20/d4d/f51 125418 0 2024-09-19T06:08:45.504 INFO:tasks.workunit.client.0.smithi037.stdout:4/494: write d0/f44 [5223468,62739] 0 2024-09-19T06:08:45.504 INFO:tasks.workunit.client.0.smithi037.stdout:8/613: write d1/d61/d7e/dbc/dc2/d59/d5d/f75 [346278,108448] 0 2024-09-19T06:08:45.504 INFO:tasks.workunit.client.0.smithi037.stdout:8/614: write d1/d61/d7e/d8b/d91/f3b [1571362,31399] 0 2024-09-19T06:08:45.506 INFO:tasks.workunit.client.0.smithi037.stdout:9/567: dwrite da/dd/d63/f9b [0,4194304] 0 2024-09-19T06:08:45.506 INFO:tasks.workunit.client.0.smithi037.stdout:7/365: dread d6/f1d [0,4194304] 0 2024-09-19T06:08:45.506 INFO:tasks.workunit.client.0.smithi037.stdout:9/568: write da/dd/d1b/d43/f66 [3094960,111950] 0 2024-09-19T06:08:45.506 INFO:tasks.workunit.client.0.smithi037.stdout:0/449: symlink d5/d20/l97 0 2024-09-19T06:08:45.506 INFO:tasks.workunit.client.0.smithi037.stdout:0/450: dread - d5/d8/f76 zero size 2024-09-19T06:08:45.506 INFO:tasks.workunit.client.0.smithi037.stdout:4/495: symlink d0/d6/d1b/d20/d77/lab 0 2024-09-19T06:08:45.508 INFO:tasks.workunit.client.0.smithi037.stdout:5/479: dread d2/d12/f4f [0,4194304] 0 2024-09-19T06:08:45.510 INFO:tasks.workunit.client.0.smithi037.stdout:7/366: mkdir d6/d20/d4b/d60/d33/d55/d6d 0 2024-09-19T06:08:45.510 INFO:tasks.workunit.client.0.smithi037.stdout:9/569: creat da/dd/fc9 x:0 0 0 2024-09-19T06:08:45.513 INFO:tasks.workunit.client.0.smithi037.stdout:0/451: rename d5/d20/d34/l35 to d5/d8/d22/d89/d96/l98 0 2024-09-19T06:08:45.514 INFO:tasks.workunit.client.0.smithi037.stdout:4/496: rmdir d0/d6/d1b/d20 39 2024-09-19T06:08:45.515 INFO:tasks.workunit.client.0.smithi037.stdout:9/570: link da/dd/d1b/d2f/fa2 da/dd/d1b/d23/d6a/d8f/fca 0 2024-09-19T06:08:45.515 INFO:tasks.workunit.client.0.smithi037.stdout:9/571: fsync da/dd/d1b/d23/d6a/f7f 0 2024-09-19T06:08:45.516 INFO:tasks.workunit.client.0.smithi037.stdout:0/452: creat d5/d18/d68/d85/f99 x:0 0 0 2024-09-19T06:08:45.518 INFO:tasks.workunit.client.0.smithi037.stdout:4/497: creat d0/d6/d45/d4a/fac x:0 0 0 2024-09-19T06:08:45.519 INFO:tasks.workunit.client.0.smithi037.stdout:4/498: chown d0/d6/d1b/d20/d4d/d64/f99 3941032 1 2024-09-19T06:08:45.522 INFO:tasks.workunit.client.0.smithi037.stdout:0/453: truncate d5/d8/d11/d32/f5e 649753 0 2024-09-19T06:08:45.527 INFO:tasks.workunit.client.0.smithi037.stdout:6/433: dwrite d9/dd/d2b/f61 [0,4194304] 0 2024-09-19T06:08:45.527 INFO:tasks.workunit.client.0.smithi037.stdout:6/434: dread - d9/dd/d2b/d42/f49 zero size 2024-09-19T06:08:45.527 INFO:tasks.workunit.client.0.smithi037.stdout:6/435: read - d9/dd/d1c/d73/f86 zero size 2024-09-19T06:08:45.530 INFO:tasks.workunit.client.0.smithi037.stdout:0/454: mkdir d5/d8/d79/d9a 0 2024-09-19T06:08:45.533 INFO:tasks.workunit.client.0.smithi037.stdout:6/436: truncate d9/f19 569532 0 2024-09-19T06:08:45.537 INFO:tasks.workunit.client.0.smithi037.stdout:8/615: dwrite d1/d61/d7e/d8b/d91/f3b [4194304,4194304] 0 2024-09-19T06:08:45.537 INFO:tasks.workunit.client.0.smithi037.stdout:8/616: fdatasync d1/f43 0 2024-09-19T06:08:45.546 INFO:tasks.workunit.client.0.smithi037.stdout:7/367: dwrite d6/dc/d22/f3b [0,4194304] 0 2024-09-19T06:08:45.547 INFO:tasks.workunit.client.0.smithi037.stdout:7/368: chown d6/dc/df/c63 493138 1 2024-09-19T06:08:45.547 INFO:tasks.workunit.client.0.smithi037.stdout:7/369: write d6/dc/f14 [4648123,123205] 0 2024-09-19T06:08:45.547 INFO:tasks.workunit.client.0.smithi037.stdout:5/480: dwrite d2/d12/d24/d58/f5e [0,4194304] 0 2024-09-19T06:08:45.550 INFO:tasks.workunit.client.0.smithi037.stdout:7/370: symlink d6/dc/df/l6e 0 2024-09-19T06:08:45.550 INFO:tasks.workunit.client.0.smithi037.stdout:7/371: stat d6/d20/l3f 0 2024-09-19T06:08:45.551 INFO:tasks.workunit.client.0.smithi037.stdout:7/372: rmdir d6/d20/d4b 39 2024-09-19T06:08:45.552 INFO:tasks.workunit.client.0.smithi037.stdout:7/373: fsync d6/d21/f5f 0 2024-09-19T06:08:45.552 INFO:tasks.workunit.client.0.smithi037.stdout:7/374: mknod d6/dc/c6f 0 2024-09-19T06:08:45.552 INFO:tasks.workunit.client.0.smithi037.stdout:7/375: readlink l3 0 2024-09-19T06:08:45.553 INFO:tasks.workunit.client.0.smithi037.stdout:7/376: getdents d6/dc/d22 0 2024-09-19T06:08:45.554 INFO:tasks.workunit.client.0.smithi037.stdout:7/377: mkdir d6/dc/d70 0 2024-09-19T06:08:45.555 INFO:tasks.workunit.client.0.smithi037.stdout:0/455: dwrite d5/d8/d44/d48/f5a [0,4194304] 0 2024-09-19T06:08:45.555 INFO:tasks.workunit.client.0.smithi037.stdout:0/456: chown d5/d8/d44/f56 1412712 1 2024-09-19T06:08:45.555 INFO:tasks.workunit.client.0.smithi037.stdout:4/499: dwrite d0/d6/d45/d4a/f84 [0,4194304] 0 2024-09-19T06:08:45.555 INFO:tasks.workunit.client.0.smithi037.stdout:4/500: write d0/d6/d1b/d20/d48/fa6 [538202,59914] 0 2024-09-19T06:08:45.556 INFO:tasks.workunit.client.0.smithi037.stdout:7/378: mkdir d6/d20/d71 0 2024-09-19T06:08:45.563 INFO:tasks.workunit.client.0.smithi037.stdout:4/501: creat d0/d6/d1b/d20/d77/fad x:0 0 0 2024-09-19T06:08:45.563 INFO:tasks.workunit.client.0.smithi037.stdout:7/379: creat d6/d20/d4b/d60/f72 x:0 0 0 2024-09-19T06:08:45.564 INFO:tasks.workunit.client.0.smithi037.stdout:4/502: mknod d0/d6/d1b/d20/cae 0 2024-09-19T06:08:45.564 INFO:tasks.workunit.client.0.smithi037.stdout:4/503: write d0/d6/f75 [121070,117574] 0 2024-09-19T06:08:45.564 INFO:tasks.workunit.client.0.smithi037.stdout:4/504: readlink d0/d6/l42 0 2024-09-19T06:08:45.565 INFO:tasks.workunit.client.0.smithi037.stdout:7/380: rename d6/dc/df/f69 to d6/d20/d4b/d60/f73 0 2024-09-19T06:08:45.570 INFO:tasks.workunit.client.0.smithi037.stdout:8/617: dwrite d1/d61/d7e/d8b/d91/f3b [8388608,4194304] 0 2024-09-19T06:08:45.572 INFO:tasks.workunit.client.0.smithi037.stdout:8/618: link d1/d35/fb4 d1/d61/d7e/dbc/dc2/fd3 0 2024-09-19T06:08:45.572 INFO:tasks.workunit.client.0.smithi037.stdout:5/481: dwrite d2/d12/d28/d57/f91 [0,4194304] 0 2024-09-19T06:08:45.573 INFO:tasks.workunit.client.0.smithi037.stdout:6/437: dwrite d9/dd/d2b/d79/f51 [0,4194304] 0 2024-09-19T06:08:45.573 INFO:tasks.workunit.client.0.smithi037.stdout:6/438: read - d9/dd/d20/d5a/d6d/d82/f84 zero size 2024-09-19T06:08:45.575 INFO:tasks.workunit.client.0.smithi037.stdout:8/619: unlink d1/dc7/fc9 0 2024-09-19T06:08:45.575 INFO:tasks.workunit.client.0.smithi037.stdout:8/620: chown d1/d6a/fa7 17 1 2024-09-19T06:08:45.575 INFO:tasks.workunit.client.0.smithi037.stdout:0/457: dwrite d5/d8/d44/f6f [0,4194304] 0 2024-09-19T06:08:45.577 INFO:tasks.workunit.client.0.smithi037.stdout:5/482: creat d2/d12/d28/d22/d4a/d9f/fa2 x:0 0 0 2024-09-19T06:08:45.577 INFO:tasks.workunit.client.0.smithi037.stdout:5/483: dread - d2/d12/d24/d58/f8f zero size 2024-09-19T06:08:45.579 INFO:tasks.workunit.client.0.smithi037.stdout:6/439: creat d9/dd/d1c/d4e/d33/f88 x:0 0 0 2024-09-19T06:08:45.580 INFO:tasks.workunit.client.0.smithi037.stdout:4/505: dread d0/d6/d1b/d20/d4d/d64/f96 [0,4194304] 0 2024-09-19T06:08:45.580 INFO:tasks.workunit.client.0.smithi037.stdout:4/506: dread - d0/d6/d45/d4a/d86/f9e zero size 2024-09-19T06:08:45.581 INFO:tasks.workunit.client.0.smithi037.stdout:8/621: truncate d1/d61/d7e/d8b/d91/d3d/f3c 639862 0 2024-09-19T06:08:45.581 INFO:tasks.workunit.client.0.smithi037.stdout:8/622: write d1/d35/f56 [4502794,108803] 0 2024-09-19T06:08:45.581 INFO:tasks.workunit.client.0.smithi037.stdout:8/623: readlink d1/d61/d7e/d8b/d91/d3d/l1b 0 2024-09-19T06:08:45.582 INFO:tasks.workunit.client.0.smithi037.stdout:0/458: symlink d5/d42/l9b 0 2024-09-19T06:08:45.582 INFO:tasks.workunit.client.0.smithi037.stdout:0/459: chown d5/d8/d44/d61/c6b 43767 1 2024-09-19T06:08:45.587 INFO:tasks.workunit.client.0.smithi037.stdout:7/381: write d6/dc/d22/f3b [3185296,88592] 0 2024-09-19T06:08:45.588 INFO:tasks.workunit.client.0.smithi037.stdout:5/484: truncate d2/d12/d28/f48 2287535 0 2024-09-19T06:08:45.588 INFO:tasks.workunit.client.0.smithi037.stdout:8/624: mknod d1/d61/d7e/d8b/d91/d3d/d66/cd4 0 2024-09-19T06:08:45.590 INFO:tasks.workunit.client.0.smithi037.stdout:7/382: rename d6/dc/f1b to d6/d20/d4b/d60/f74 0 2024-09-19T06:08:45.592 INFO:tasks.workunit.client.0.smithi037.stdout:8/625: dread d1/d61/d7e/dbc/dc2/fd3 [0,4194304] 0 2024-09-19T06:08:45.592 INFO:tasks.workunit.client.0.smithi037.stdout:7/383: creat d6/d20/d4b/d60/f75 x:0 0 0 2024-09-19T06:08:45.596 INFO:tasks.workunit.client.0.smithi037.stdout:6/440: dread d9/f24 [4194304,4194304] 0 2024-09-19T06:08:45.599 INFO:tasks.workunit.client.0.smithi037.stdout:6/441: mknod d9/dd/d1c/c89 0 2024-09-19T06:08:45.599 INFO:tasks.workunit.client.0.smithi037.stdout:6/442: chown d9/dd/d1c/c89 557771739 1 2024-09-19T06:08:45.615 INFO:tasks.workunit.client.0.smithi037.stdout:0/460: dread d5/d8/f3f [0,4194304] 0 2024-09-19T06:08:45.616 INFO:tasks.workunit.client.0.smithi037.stdout:0/461: chown d5/d8/d44 1 1 2024-09-19T06:08:45.624 INFO:tasks.workunit.client.0.smithi037.stdout:6/443: dread d9/dd/d1c/d4e/d62/f74 [0,4194304] 0 2024-09-19T06:08:45.624 INFO:tasks.workunit.client.0.smithi037.stdout:6/444: readlink d9/dd/d20/d5a/l64 0 2024-09-19T06:08:45.624 INFO:tasks.workunit.client.0.smithi037.stdout:6/445: fdatasync d9/dd/f59 0 2024-09-19T06:08:45.624 INFO:tasks.workunit.client.0.smithi037.stdout:6/446: fsync d9/dd/d20/d5a/d6d/d82/f84 0 2024-09-19T06:08:45.626 INFO:tasks.workunit.client.0.smithi037.stdout:6/447: truncate d9/dd/d20/f27 129698 0 2024-09-19T06:08:45.628 INFO:tasks.workunit.client.0.smithi037.stdout:6/448: creat d9/d16/f8a x:0 0 0 2024-09-19T06:08:45.628 INFO:tasks.workunit.client.0.smithi037.stdout:6/449: chown d9/dd/d20/d5a/d6d/f7f 5949074 1 2024-09-19T06:08:45.628 INFO:tasks.workunit.client.0.smithi037.stdout:6/450: dread - d9/dd/d1c/d4e/d33/f88 zero size 2024-09-19T06:08:45.628 INFO:tasks.workunit.client.0.smithi037.stdout:6/451: chown d9/la 8286 1 2024-09-19T06:08:45.628 INFO:tasks.workunit.client.0.smithi037.stdout:4/507: dwrite d0/f41 [0,4194304] 0 2024-09-19T06:08:45.629 INFO:tasks.workunit.client.0.smithi037.stdout:6/452: creat d9/dd/d1c/d4e/d65/f8b x:0 0 0 2024-09-19T06:08:45.634 INFO:tasks.workunit.client.0.smithi037.stdout:8/626: dwrite d1/d61/d7e/dbc/dc2/d59/daf/fb3 [0,4194304] 0 2024-09-19T06:08:45.635 INFO:tasks.workunit.client.0.smithi037.stdout:7/384: dwrite d6/f12 [4194304,4194304] 0 2024-09-19T06:08:45.636 INFO:tasks.workunit.client.0.smithi037.stdout:4/508: truncate d0/d2/d2e/d36/f63 1344055 0 2024-09-19T06:08:45.636 INFO:tasks.workunit.client.0.smithi037.stdout:4/509: readlink d0/la 0 2024-09-19T06:08:45.638 INFO:tasks.workunit.client.0.smithi037.stdout:5/485: dwrite d2/d12/d24/f70 [0,4194304] 0 2024-09-19T06:08:45.638 INFO:tasks.workunit.client.0.smithi037.stdout:5/486: write d2/d12/d28/d22/d53/f83 [1080684,38306] 0 2024-09-19T06:08:45.638 INFO:tasks.workunit.client.0.smithi037.stdout:5/487: chown d2/d12/d28/c64 256311264 1 2024-09-19T06:08:45.638 INFO:tasks.workunit.client.0.smithi037.stdout:6/453: rename d9/d78/d85 to d9/d78/d8c 0 2024-09-19T06:08:45.638 INFO:tasks.workunit.client.0.smithi037.stdout:6/454: readlink d9/dd/d20/l69 0 2024-09-19T06:08:45.638 INFO:tasks.workunit.client.0.smithi037.stdout:6/455: chown d9/dd/d2b 2 1 2024-09-19T06:08:45.639 INFO:tasks.workunit.client.0.smithi037.stdout:6/456: truncate d9/dd/d20/d5a/d6d/f7f 9081062 0 2024-09-19T06:08:45.643 INFO:tasks.workunit.client.0.smithi037.stdout:7/385: mkdir d6/d21/d76 0 2024-09-19T06:08:45.643 INFO:tasks.workunit.client.0.smithi037.stdout:7/386: chown d6/f3a 0 1 2024-09-19T06:08:45.643 INFO:tasks.workunit.client.0.smithi037.stdout:7/387: chown d6/dc/d22/f3b 81892274 1 2024-09-19T06:08:45.643 INFO:tasks.workunit.client.0.smithi037.stdout:7/388: stat d6/f38 0 2024-09-19T06:08:45.643 INFO:tasks.workunit.client.0.smithi037.stdout:7/389: fdatasync d6/d20/d4b/d60/d33/f57 0 2024-09-19T06:08:45.644 INFO:tasks.workunit.client.0.smithi037.stdout:0/462: dwrite d5/d8/d22/d89/f8a [0,4194304] 0 2024-09-19T06:08:45.650 INFO:tasks.workunit.client.0.smithi037.stdout:6/457: rmdir d9/dd/d1c 39 2024-09-19T06:08:45.651 INFO:tasks.workunit.client.0.smithi037.stdout:7/390: creat d6/dc/f77 x:0 0 0 2024-09-19T06:08:45.653 INFO:tasks.workunit.client.0.smithi037.stdout:0/463: creat d5/f9c x:0 0 0 2024-09-19T06:08:45.655 INFO:tasks.workunit.client.0.smithi037.stdout:5/488: symlink d2/d12/d28/d22/d4a/la3 0 2024-09-19T06:08:45.656 INFO:tasks.workunit.client.0.smithi037.stdout:6/458: mknod d9/dd/d1c/d4e/c8d 0 2024-09-19T06:08:45.656 INFO:tasks.workunit.client.0.smithi037.stdout:6/459: fsync d9/dd/d1c/f47 0 2024-09-19T06:08:45.656 INFO:tasks.workunit.client.0.smithi037.stdout:6/460: write d9/dd/d1c/d4e/d65/f67 [567509,72026] 0 2024-09-19T06:08:45.657 INFO:tasks.workunit.client.0.smithi037.stdout:1/402: sync 2024-09-19T06:08:45.657 INFO:tasks.workunit.client.0.smithi037.stdout:1/403: write d2/d12/d17/f18 [4871455,96408] 0 2024-09-19T06:08:45.657 INFO:tasks.workunit.client.0.smithi037.stdout:1/404: stat d2/f6 0 2024-09-19T06:08:45.657 INFO:tasks.workunit.client.0.smithi037.stdout:3/427: sync 2024-09-19T06:08:45.658 INFO:tasks.workunit.client.0.smithi037.stdout:4/510: truncate d0/d2/d2e/d36/f63 1356192 0 2024-09-19T06:08:45.662 INFO:tasks.workunit.client.0.smithi037.stdout:7/391: creat d6/dc/d22/f78 x:0 0 0 2024-09-19T06:08:45.664 INFO:tasks.workunit.client.0.smithi037.stdout:5/489: rename d2/d12/d28/c59 to d2/d10/da1/ca4 0 2024-09-19T06:08:45.664 INFO:tasks.workunit.client.0.smithi037.stdout:5/490: chown d2/d10/l65 1043268 1 2024-09-19T06:08:45.664 INFO:tasks.workunit.client.0.smithi037.stdout:1/405: getdents d2/d12/d17 0 2024-09-19T06:08:45.664 INFO:tasks.workunit.client.0.smithi037.stdout:1/406: write d2/f4 [6255664,127739] 0 2024-09-19T06:08:45.664 INFO:tasks.workunit.client.0.smithi037.stdout:3/428: symlink d0/d43/d23/d7a/d77/d45/l95 0 2024-09-19T06:08:45.666 INFO:tasks.workunit.client.0.smithi037.stdout:8/627: dwrite d1/d35/f95 [0,4194304] 0 2024-09-19T06:08:45.666 INFO:tasks.workunit.client.0.smithi037.stdout:1/407: creat d2/d12/d1e/d75/f88 x:0 0 0 2024-09-19T06:08:45.666 INFO:tasks.workunit.client.0.smithi037.stdout:1/408: getdents d2/d12 0 2024-09-19T06:08:45.666 INFO:tasks.workunit.client.0.smithi037.stdout:9/572: sync 2024-09-19T06:08:45.666 INFO:tasks.workunit.client.0.smithi037.stdout:2/532: sync 2024-09-19T06:08:45.670 INFO:tasks.workunit.client.0.smithi037.stdout:8/628: mkdir d1/d61/dd5 0 2024-09-19T06:08:45.671 INFO:tasks.workunit.client.0.smithi037.stdout:1/409: mkdir d2/d12/d1e/d75/d89 0 2024-09-19T06:08:45.672 INFO:tasks.workunit.client.0.smithi037.stdout:9/573: creat da/dd/d1b/d2f/d38/fcb x:0 0 0 2024-09-19T06:08:45.672 INFO:tasks.workunit.client.0.smithi037.stdout:9/574: chown da/dd/d1b/d62/f75 27 1 2024-09-19T06:08:45.674 INFO:tasks.workunit.client.0.smithi037.stdout:3/429: mkdir d0/d96 0 2024-09-19T06:08:45.675 INFO:tasks.workunit.client.0.smithi037.stdout:8/629: mknod d1/d61/d7e/d8b/cd6 0 2024-09-19T06:08:45.677 INFO:tasks.workunit.client.0.smithi037.stdout:9/575: mkdir da/dd/d1b/d2f/dcc 0 2024-09-19T06:08:45.677 INFO:tasks.workunit.client.0.smithi037.stdout:9/576: chown da/dd/d1b/d2f/f91 167162606 1 2024-09-19T06:08:45.678 INFO:tasks.workunit.client.0.smithi037.stdout:3/430: mknod d0/d5f/c97 0 2024-09-19T06:08:45.679 INFO:tasks.workunit.client.0.smithi037.stdout:9/577: creat da/dd/d1b/d56/fcd x:0 0 0 2024-09-19T06:08:45.682 INFO:tasks.workunit.client.0.smithi037.stdout:3/431: rmdir d0/d43/d23/d7a/d77/d48 0 2024-09-19T06:08:45.682 INFO:tasks.workunit.client.0.smithi037.stdout:3/432: readlink d0/d43/d23/d7a/d77/d45/l89 0 2024-09-19T06:08:45.682 INFO:tasks.workunit.client.0.smithi037.stdout:3/433: truncate d0/d5f/d70/f78 19982 0 2024-09-19T06:08:45.682 INFO:tasks.workunit.client.0.smithi037.stdout:3/434: read - d0/d43/d23/f6d zero size 2024-09-19T06:08:45.684 INFO:tasks.workunit.client.0.smithi037.stdout:9/578: mkdir da/dd/d1b/d2f/d6d/dce 0 2024-09-19T06:08:45.685 INFO:tasks.workunit.client.0.smithi037.stdout:1/410: dread d2/d12/f25 [0,4194304] 0 2024-09-19T06:08:45.687 INFO:tasks.workunit.client.0.smithi037.stdout:9/579: rename da/d20/fbf to da/dd/d1b/d2f/d6d/fcf 0 2024-09-19T06:08:45.687 INFO:tasks.workunit.client.0.smithi037.stdout:9/580: chown da/dd/d1b/d62 59923294 1 2024-09-19T06:08:45.687 INFO:tasks.workunit.client.0.smithi037.stdout:1/411: truncate d2/f3 159481 0 2024-09-19T06:08:45.688 INFO:tasks.workunit.client.0.smithi037.stdout:9/581: symlink da/ld0 0 2024-09-19T06:08:45.693 INFO:tasks.workunit.client.0.smithi037.stdout:4/511: dwrite d0/d2/d2e/d36/f4f [0,4194304] 0 2024-09-19T06:08:45.694 INFO:tasks.workunit.client.0.smithi037.stdout:4/512: stat d0/d2/d37/f90 0 2024-09-19T06:08:45.698 INFO:tasks.workunit.client.0.smithi037.stdout:5/491: dread d2/d12/d28/d57/f91 [0,4194304] 0 2024-09-19T06:08:45.698 INFO:tasks.workunit.client.0.smithi037.stdout:7/392: dread d6/dc/f16 [0,4194304] 0 2024-09-19T06:08:45.699 INFO:tasks.workunit.client.0.smithi037.stdout:1/412: dread d2/d12/d1e/d2a/d2e/f7f [0,4194304] 0 2024-09-19T06:08:45.708 INFO:tasks.workunit.client.0.smithi037.stdout:8/630: dread d1/d61/d7e/d8b/d91/d3d/f20 [0,4194304] 0 2024-09-19T06:08:45.708 INFO:tasks.workunit.client.0.smithi037.stdout:6/461: dwrite d9/f4c [0,4194304] 0 2024-09-19T06:08:45.708 INFO:tasks.workunit.client.0.smithi037.stdout:3/435: dread d0/f17 [0,4194304] 0 2024-09-19T06:08:45.709 INFO:tasks.workunit.client.0.smithi037.stdout:5/492: creat d2/d12/d24/d58/d7f/fa5 x:0 0 0 2024-09-19T06:08:45.710 INFO:tasks.workunit.client.0.smithi037.stdout:7/393: creat d6/d20/d71/f79 x:0 0 0 2024-09-19T06:08:45.712 INFO:tasks.workunit.client.0.smithi037.stdout:2/533: dwrite d1/d16/f61 [0,4194304] 0 2024-09-19T06:08:45.712 INFO:tasks.workunit.client.0.smithi037.stdout:5/493: creat d2/d12/d7e/fa6 x:0 0 0 2024-09-19T06:08:45.713 INFO:tasks.workunit.client.0.smithi037.stdout:7/394: symlink d6/d20/d4b/d60/d33/d61/l7a 0 2024-09-19T06:08:45.713 INFO:tasks.workunit.client.0.smithi037.stdout:7/395: fsync d6/d20/d34/f40 0 2024-09-19T06:08:45.713 INFO:tasks.workunit.client.0.smithi037.stdout:7/396: dread - d6/d20/d34/d49/f5e zero size 2024-09-19T06:08:45.715 INFO:tasks.workunit.client.0.smithi037.stdout:2/534: rename d1/da/dc/d21/d7d/dab/l70 to d1/d16/db1/lbd 0 2024-09-19T06:08:45.716 INFO:tasks.workunit.client.0.smithi037.stdout:2/535: stat d1/da/d6e 0 2024-09-19T06:08:45.728 INFO:tasks.workunit.client.0.smithi037.stdout:5/494: write d2/d10/f1f [931169,67995] 0 2024-09-19T06:08:45.729 INFO:tasks.workunit.client.0.smithi037.stdout:5/495: mkdir d2/d5c/da7 0 2024-09-19T06:08:45.729 INFO:tasks.workunit.client.0.smithi037.stdout:5/496: write d2/d12/d28/d57/f91 [4366107,125794] 0 2024-09-19T06:08:45.730 INFO:tasks.workunit.client.0.smithi037.stdout:5/497: unlink d2/d10/l33 0 2024-09-19T06:08:45.739 INFO:tasks.workunit.client.0.smithi037.stdout:7/397: dwrite d6/d20/d4b/f5d [0,4194304] 0 2024-09-19T06:08:45.739 INFO:tasks.workunit.client.0.smithi037.stdout:8/631: write d1/d61/d7e/fb2 [4190907,111373] 0 2024-09-19T06:08:45.740 INFO:tasks.workunit.client.0.smithi037.stdout:8/632: write d1/d61/d7e/dbc/dc2/d59/d5d/f60 [2531686,128567] 0 2024-09-19T06:08:45.740 INFO:tasks.workunit.client.0.smithi037.stdout:4/513: dwrite d0/f7a [0,4194304] 0 2024-09-19T06:08:45.740 INFO:tasks.workunit.client.0.smithi037.stdout:8/633: dread - d1/f52 zero size 2024-09-19T06:08:45.740 INFO:tasks.workunit.client.0.smithi037.stdout:8/634: truncate d1/d61/d7e/d8b/d91/d3d/f14 1127638 0 2024-09-19T06:08:45.740 INFO:tasks.workunit.client.0.smithi037.stdout:4/514: write d0/d6/d1b/f78 [688525,128884] 0 2024-09-19T06:08:45.741 INFO:tasks.workunit.client.0.smithi037.stdout:7/398: mkdir d6/dc/d7b 0 2024-09-19T06:08:45.741 INFO:tasks.workunit.client.0.smithi037.stdout:7/399: truncate d6/dc/d22/f1a 4594969 0 2024-09-19T06:08:45.744 INFO:tasks.workunit.client.0.smithi037.stdout:8/635: mkdir d1/d61/d7e/dbc/dd0/dd7 0 2024-09-19T06:08:45.745 INFO:tasks.workunit.client.0.smithi037.stdout:4/515: creat d0/d6/d1b/d20/d4d/d65/faf x:0 0 0 2024-09-19T06:08:45.745 INFO:tasks.workunit.client.0.smithi037.stdout:4/516: write d0/d6/d1b/d20/f72 [822256,80094] 0 2024-09-19T06:08:45.746 INFO:tasks.workunit.client.0.smithi037.stdout:7/400: truncate d6/f38 1102450 0 2024-09-19T06:08:45.748 INFO:tasks.workunit.client.0.smithi037.stdout:2/536: dwrite d1/da/fa5 [0,4194304] 0 2024-09-19T06:08:45.749 INFO:tasks.workunit.client.0.smithi037.stdout:8/636: mkdir d1/d61/d68/da3/dd8 0 2024-09-19T06:08:45.751 INFO:tasks.workunit.client.0.smithi037.stdout:4/517: mkdir d0/d6/d1b/d20/d4d/d64/db0 0 2024-09-19T06:08:45.754 INFO:tasks.workunit.client.0.smithi037.stdout:7/401: creat d6/d20/d34/d49/f7c x:0 0 0 2024-09-19T06:08:45.755 INFO:tasks.workunit.client.0.smithi037.stdout:8/637: dread d1/d61/d7e/d8b/d91/f50 [0,4194304] 0 2024-09-19T06:08:45.755 INFO:tasks.workunit.client.0.smithi037.stdout:8/638: stat d1/d6a/f7a 0 2024-09-19T06:08:45.755 INFO:tasks.workunit.client.0.smithi037.stdout:4/518: getdents d0/d2/d2e 0 2024-09-19T06:08:45.756 INFO:tasks.workunit.client.0.smithi037.stdout:7/402: getdents d6/d20/d34 0 2024-09-19T06:08:45.759 INFO:tasks.workunit.client.0.smithi037.stdout:5/498: dwrite d2/d12/d24/d58/d8e/f99 [0,4194304] 0 2024-09-19T06:08:45.759 INFO:tasks.workunit.client.0.smithi037.stdout:4/519: mkdir d0/d2/d37/d46/db1 0 2024-09-19T06:08:45.759 INFO:tasks.workunit.client.0.smithi037.stdout:4/520: chown d0/d6/d1b/d30/d80/l94 641474427 1 2024-09-19T06:08:45.761 INFO:tasks.workunit.client.0.smithi037.stdout:7/403: rename d6/dc/d70 to d6/d20/d34/d7d 0 2024-09-19T06:08:45.772 INFO:tasks.workunit.client.0.smithi037.stdout:4/521: creat d0/d2/fb2 x:0 0 0 2024-09-19T06:08:45.772 INFO:tasks.workunit.client.0.smithi037.stdout:4/522: write d0/d2/f2c [4659130,13878] 0 2024-09-19T06:08:45.772 INFO:tasks.workunit.client.0.smithi037.stdout:4/523: write d0/d6/f67 [4615289,63018] 0 2024-09-19T06:08:45.774 INFO:tasks.workunit.client.0.smithi037.stdout:7/404: mkdir d6/dc/df/d7e 0 2024-09-19T06:08:45.776 INFO:tasks.workunit.client.0.smithi037.stdout:4/524: unlink d0/d2/f1d 0 2024-09-19T06:08:45.776 INFO:tasks.workunit.client.0.smithi037.stdout:4/525: read - d0/d6/d1b/f5f zero size 2024-09-19T06:08:45.776 INFO:tasks.workunit.client.0.smithi037.stdout:4/526: write d0/f44 [5757434,44498] 0 2024-09-19T06:08:45.776 INFO:tasks.workunit.client.0.smithi037.stdout:5/499: dread d2/d12/f16 [0,4194304] 0 2024-09-19T06:08:45.777 INFO:tasks.workunit.client.0.smithi037.stdout:2/537: dwrite d1/d16/f37 [0,4194304] 0 2024-09-19T06:08:45.777 INFO:tasks.workunit.client.0.smithi037.stdout:5/500: mkdir d2/d12/d28/d22/d87/da8 0 2024-09-19T06:08:45.781 INFO:tasks.workunit.client.0.smithi037.stdout:5/501: mknod d2/d12/d28/ca9 0 2024-09-19T06:08:45.781 INFO:tasks.workunit.client.0.smithi037.stdout:5/502: read - d2/d12/d24/d58/d8e/f9a zero size 2024-09-19T06:08:45.783 INFO:tasks.workunit.client.0.smithi037.stdout:8/639: dwrite d1/d61/d7e/dbc/dc2/d59/d5d/f7c [0,4194304] 0 2024-09-19T06:08:45.785 INFO:tasks.workunit.client.0.smithi037.stdout:8/640: mknod d1/d8f/cd9 0 2024-09-19T06:08:45.789 INFO:tasks.workunit.client.0.smithi037.stdout:8/641: creat d1/d8f/da1/fda x:0 0 0 2024-09-19T06:08:45.790 INFO:tasks.workunit.client.0.smithi037.stdout:8/642: symlink d1/d61/ldb 0 2024-09-19T06:08:45.791 INFO:tasks.workunit.client.0.smithi037.stdout:8/643: write d1/d35/f73 [5102726,108591] 0 2024-09-19T06:08:45.793 INFO:tasks.workunit.client.0.smithi037.stdout:7/405: write d6/d20/d4b/f5d [512495,68189] 0 2024-09-19T06:08:45.806 INFO:tasks.workunit.client.0.smithi037.stdout:8/644: write d1/f10 [949461,52164] 0 2024-09-19T06:08:45.806 INFO:tasks.workunit.client.0.smithi037.stdout:4/527: dwrite d0/f16 [0,4194304] 0 2024-09-19T06:08:45.806 INFO:tasks.workunit.client.0.smithi037.stdout:8/645: write d1/d61/d7e/d8b/d91/f50 [1556525,117759] 0 2024-09-19T06:08:45.806 INFO:tasks.workunit.client.0.smithi037.stdout:8/646: stat d1/d61/d7e/dbc/dc2/daa/ld2 0 2024-09-19T06:08:45.807 INFO:tasks.workunit.client.0.smithi037.stdout:5/503: dwrite d2/d10/f19 [0,4194304] 0 2024-09-19T06:08:45.807 INFO:tasks.workunit.client.0.smithi037.stdout:5/504: chown d2/d12/d28/d22/c39 82619 1 2024-09-19T06:08:45.807 INFO:tasks.workunit.client.0.smithi037.stdout:5/505: chown d2/d12/d28/l43 2 1 2024-09-19T06:08:45.807 INFO:tasks.workunit.client.0.smithi037.stdout:8/647: rmdir d1/d61/d7e/dbc/dd0/dd7 0 2024-09-19T06:08:45.809 INFO:tasks.workunit.client.0.smithi037.stdout:4/528: creat d0/d6/d1b/d30/fb3 x:0 0 0 2024-09-19T06:08:45.809 INFO:tasks.workunit.client.0.smithi037.stdout:4/529: rename d0/d6/d1b/d20 to d0/d6/d1b/d20/d48/db4 22 2024-09-19T06:08:45.809 INFO:tasks.workunit.client.0.smithi037.stdout:4/530: getdents d0/d2/d37/d46/db1 0 2024-09-19T06:08:45.809 INFO:tasks.workunit.client.0.smithi037.stdout:5/506: symlink d2/d5c/laa 0 2024-09-19T06:08:45.809 INFO:tasks.workunit.client.0.smithi037.stdout:5/507: chown d2/d5c/f7b 113820022 1 2024-09-19T06:08:45.810 INFO:tasks.workunit.client.0.smithi037.stdout:8/648: link d1/f2a d1/d61/d7e/d8b/fdc 0 2024-09-19T06:08:45.810 INFO:tasks.workunit.client.0.smithi037.stdout:4/531: creat d0/d6/d1b/d20/d48/da7/fb5 x:0 0 0 2024-09-19T06:08:45.811 INFO:tasks.workunit.client.0.smithi037.stdout:4/532: dread - d0/d6/d1b/d20/d48/da7/fb5 zero size 2024-09-19T06:08:45.811 INFO:tasks.workunit.client.0.smithi037.stdout:7/406: write d6/f12 [5790771,41502] 0 2024-09-19T06:08:45.821 INFO:tasks.workunit.client.0.smithi037.stdout:5/508: dread d2/d12/f4f [0,4194304] 0 2024-09-19T06:08:45.821 INFO:tasks.workunit.client.0.smithi037.stdout:5/509: read d2/d12/d24/f95 [1739682,59018] 0 2024-09-19T06:08:45.821 INFO:tasks.workunit.client.0.smithi037.stdout:5/510: write d2/f52 [9156895,60081] 0 2024-09-19T06:08:45.821 INFO:tasks.workunit.client.0.smithi037.stdout:5/511: truncate d2/d12/d28/f29 1421577 0 2024-09-19T06:08:45.822 INFO:tasks.workunit.client.0.smithi037.stdout:4/533: read d0/d2/d2e/d36/f63 [309107,103053] 0 2024-09-19T06:08:45.822 INFO:tasks.workunit.client.0.smithi037.stdout:4/534: chown d0/d6/f67 15332985 1 2024-09-19T06:08:45.823 INFO:tasks.workunit.client.0.smithi037.stdout:4/535: link d0/la d0/d6/d1b/d20/d4d/d64/lb6 0 2024-09-19T06:08:45.824 INFO:tasks.workunit.client.0.smithi037.stdout:8/649: dread d1/d61/d7e/dbc/dc2/d59/d5d/f81 [0,4194304] 0 2024-09-19T06:08:45.824 INFO:tasks.workunit.client.0.smithi037.stdout:8/650: truncate d1/f18 2866749 0 2024-09-19T06:08:45.824 INFO:tasks.workunit.client.0.smithi037.stdout:8/651: chown d1/d61 12649452 1 2024-09-19T06:08:45.825 INFO:tasks.workunit.client.0.smithi037.stdout:8/652: truncate d1/d61/d7e/fb2 2246693 0 2024-09-19T06:08:45.827 INFO:tasks.workunit.client.0.smithi037.stdout:8/653: link d1/d61/d7e/d8b/d91/f6b d1/d61/d7e/dbc/dc0/fdd 0 2024-09-19T06:08:45.828 INFO:tasks.workunit.client.0.smithi037.stdout:8/654: creat d1/d6a/fde x:0 0 0 2024-09-19T06:08:45.830 INFO:tasks.workunit.client.0.smithi037.stdout:8/655: mknod d1/d61/d7e/d8b/d9f/cdf 0 2024-09-19T06:08:45.832 INFO:tasks.workunit.client.0.smithi037.stdout:8/656: creat d1/dc7/fe0 x:0 0 0 2024-09-19T06:08:45.834 INFO:tasks.workunit.client.0.smithi037.stdout:8/657: link d1/d61/l92 d1/d61/d7b/le1 0 2024-09-19T06:08:45.834 INFO:tasks.workunit.client.0.smithi037.stdout:8/658: write d1/f54 [1111088,12446] 0 2024-09-19T06:08:45.834 INFO:tasks.workunit.client.0.smithi037.stdout:8/659: fdatasync d1/d61/d7b/f99 0 2024-09-19T06:08:45.834 INFO:tasks.workunit.client.0.smithi037.stdout:8/660: chown d1/f2d 15 1 2024-09-19T06:08:45.835 INFO:tasks.workunit.client.0.smithi037.stdout:8/661: rmdir d1/d61/d7e 39 2024-09-19T06:08:45.838 INFO:tasks.workunit.client.0.smithi037.stdout:8/662: creat d1/d61/d7b/fe2 x:0 0 0 2024-09-19T06:08:45.842 INFO:tasks.workunit.client.0.smithi037.stdout:7/407: dwrite d6/d20/d71/f79 [0,4194304] 0 2024-09-19T06:08:45.847 INFO:tasks.workunit.client.0.smithi037.stdout:5/512: dwrite d2/d5c/f7b [0,4194304] 0 2024-09-19T06:08:45.857 INFO:tasks.workunit.client.0.smithi037.stdout:4/536: dwrite d0/d6/d1b/d20/f62 [0,4194304] 0 2024-09-19T06:08:45.857 INFO:tasks.workunit.client.0.smithi037.stdout:7/408: dread d6/f3a [0,4194304] 0 2024-09-19T06:08:45.859 INFO:tasks.workunit.client.0.smithi037.stdout:7/409: read - d6/d20/d34/d49/f5e zero size 2024-09-19T06:08:45.859 INFO:tasks.workunit.client.0.smithi037.stdout:7/410: chown d6/d20/d34/f50 92195 1 2024-09-19T06:08:45.862 INFO:tasks.workunit.client.0.smithi037.stdout:8/663: dwrite d1/d35/fb4 [0,4194304] 0 2024-09-19T06:08:45.871 INFO:tasks.workunit.client.0.smithi037.stdout:7/411: dread d6/dc/fd [0,4194304] 0 2024-09-19T06:08:45.873 INFO:tasks.workunit.client.0.smithi037.stdout:7/412: rmdir d6/d20 39 2024-09-19T06:08:45.874 INFO:tasks.workunit.client.0.smithi037.stdout:5/513: dwrite d2/d12/f36 [0,4194304] 0 2024-09-19T06:08:45.876 INFO:tasks.workunit.client.0.smithi037.stdout:7/413: mknod d6/d20/d34/c7f 0 2024-09-19T06:08:45.876 INFO:tasks.workunit.client.0.smithi037.stdout:7/414: chown d6/d21/d76 10418 1 2024-09-19T06:08:45.878 INFO:tasks.workunit.client.0.smithi037.stdout:5/514: creat d2/d12/d28/d22/d87/fab x:0 0 0 2024-09-19T06:08:45.884 INFO:tasks.workunit.client.0.smithi037.stdout:4/537: dwrite d0/d2/d37/d92/fa5 [0,4194304] 0 2024-09-19T06:08:45.889 INFO:tasks.workunit.client.0.smithi037.stdout:8/664: dwrite d1/d61/d7e/d8b/d91/f8d [0,4194304] 0 2024-09-19T06:08:45.896 INFO:tasks.workunit.client.0.smithi037.stdout:5/515: dread d2/d12/d28/f3f [0,4194304] 0 2024-09-19T06:08:45.896 INFO:tasks.workunit.client.0.smithi037.stdout:5/516: getdents d2/d12/d28/d57/d82 0 2024-09-19T06:08:45.898 INFO:tasks.workunit.client.0.smithi037.stdout:5/517: mkdir d2/d10/da1/dac 0 2024-09-19T06:08:45.898 INFO:tasks.workunit.client.0.smithi037.stdout:5/518: readlink d2/d12/d28/l1d 0 2024-09-19T06:08:45.905 INFO:tasks.workunit.client.0.smithi037.stdout:7/415: dwrite d6/d20/d4b/d60/f31 [4194304,4194304] 0 2024-09-19T06:08:45.909 INFO:tasks.workunit.client.0.smithi037.stdout:8/665: dread d1/d61/d7e/d8b/d91/d3d/f39 [0,4194304] 0 2024-09-19T06:08:45.909 INFO:tasks.workunit.client.0.smithi037.stdout:4/538: dwrite d0/d6/f23 [0,4194304] 0 2024-09-19T06:08:45.910 INFO:tasks.workunit.client.0.smithi037.stdout:4/539: dread d0/d2/d2e/d36/f4e [0,4194304] 0 2024-09-19T06:08:45.910 INFO:tasks.workunit.client.0.smithi037.stdout:8/666: symlink d1/d61/d7e/dbc/dc2/d59/d5d/le3 0 2024-09-19T06:08:45.911 INFO:tasks.workunit.client.0.smithi037.stdout:4/540: unlink d0/d6/c82 0 2024-09-19T06:08:45.912 INFO:tasks.workunit.client.0.smithi037.stdout:4/541: rename d0/d6/d1b/d20/f72 to d0/d6/d1b/d20/d4d/fb7 0 2024-09-19T06:08:45.930 INFO:tasks.workunit.client.0.smithi037.stdout:7/416: dwrite d6/f12 [4194304,4194304] 0 2024-09-19T06:08:45.931 INFO:tasks.workunit.client.0.smithi037.stdout:7/417: creat d6/d20/d4b/d60/d33/d61/f80 x:0 0 0 2024-09-19T06:08:45.933 INFO:tasks.workunit.client.0.smithi037.stdout:7/418: symlink d6/d20/d4b/d60/d33/d55/d6d/l81 0 2024-09-19T06:08:45.936 INFO:tasks.workunit.client.0.smithi037.stdout:4/542: dwrite d0/d2/d2e/f7e [0,4194304] 0 2024-09-19T06:08:45.936 INFO:tasks.workunit.client.0.smithi037.stdout:4/543: fsync d0/d2/f1a 0 2024-09-19T06:08:45.940 INFO:tasks.workunit.client.0.smithi037.stdout:8/667: dwrite d1/d61/d7e/dbc/dc2/d9b/fce [0,4194304] 0 2024-09-19T06:08:45.941 INFO:tasks.workunit.client.0.smithi037.stdout:8/668: readlink d1/d61/d7e/dbc/dc2/l70 0 2024-09-19T06:08:45.950 INFO:tasks.workunit.client.0.smithi037.stdout:7/419: dread d6/dc/fe [0,4194304] 0 2024-09-19T06:08:45.951 INFO:tasks.workunit.client.0.smithi037.stdout:7/420: mkdir d6/dc/d22/d82 0 2024-09-19T06:08:45.951 INFO:tasks.workunit.client.0.smithi037.stdout:7/421: getdents d6/dc/d22/d82 0 2024-09-19T06:08:45.952 INFO:tasks.workunit.client.0.smithi037.stdout:7/422: read - d6/dc/f77 zero size 2024-09-19T06:08:45.952 INFO:tasks.workunit.client.0.smithi037.stdout:7/423: fsync d6/dc/df/f41 0 2024-09-19T06:08:45.964 INFO:tasks.workunit.client.0.smithi037.stdout:4/544: dwrite d0/d6/d1b/f3f [0,4194304] 0 2024-09-19T06:08:45.965 INFO:tasks.workunit.client.0.smithi037.stdout:4/545: truncate d0/f27 2538194 0 2024-09-19T06:08:45.966 INFO:tasks.workunit.client.0.smithi037.stdout:8/669: dwrite d1/d61/d7e/dbc/dc0/fdd [4194304,4194304] 0 2024-09-19T06:08:45.967 INFO:tasks.workunit.client.0.smithi037.stdout:7/424: write d6/d20/d4b/d60/f31 [3812630,351] 0 2024-09-19T06:08:45.967 INFO:tasks.workunit.client.0.smithi037.stdout:8/670: mkdir d1/d61/d7e/d8b/d9f/de4 0 2024-09-19T06:08:45.967 INFO:tasks.workunit.client.0.smithi037.stdout:7/425: fsync d6/d20/d34/d49/f7c 0 2024-09-19T06:08:45.968 INFO:tasks.workunit.client.0.smithi037.stdout:8/671: creat d1/dc7/fe5 x:0 0 0 2024-09-19T06:08:45.969 INFO:tasks.workunit.client.0.smithi037.stdout:7/426: mknod d6/d21/d68/c83 0 2024-09-19T06:08:45.970 INFO:tasks.workunit.client.0.smithi037.stdout:7/427: creat d6/d20/d4b/d60/f84 x:0 0 0 2024-09-19T06:08:45.972 INFO:tasks.workunit.client.0.smithi037.stdout:7/428: unlink d6/d20/d4b/d60/f72 0 2024-09-19T06:08:45.974 INFO:tasks.workunit.client.0.smithi037.stdout:7/429: rename d6/dc/c30 to d6/d20/c85 0 2024-09-19T06:08:45.975 INFO:tasks.workunit.client.0.smithi037.stdout:7/430: creat d6/dc/df/f86 x:0 0 0 2024-09-19T06:08:45.975 INFO:tasks.workunit.client.0.smithi037.stdout:7/431: write d6/dc/d22/f78 [768633,9664] 0 2024-09-19T06:08:45.975 INFO:tasks.workunit.client.0.smithi037.stdout:7/432: fdatasync d6/dc/f2a 0 2024-09-19T06:08:45.975 INFO:tasks.workunit.client.0.smithi037.stdout:7/433: dread - d6/d20/d4b/d60/f75 zero size 2024-09-19T06:08:45.976 INFO:tasks.workunit.client.0.smithi037.stdout:7/434: mknod d6/d20/d71/c87 0 2024-09-19T06:08:45.978 INFO:tasks.workunit.client.0.smithi037.stdout:7/435: link d6/dc/d22/f36 d6/dc/df/d7e/f88 0 2024-09-19T06:08:45.981 INFO:tasks.workunit.client.0.smithi037.stdout:8/672: write d1/d61/d7e/dbc/dc2/d59/f9e [4192102,44352] 0 2024-09-19T06:08:45.988 INFO:tasks.workunit.client.0.smithi037.stdout:8/673: creat d1/d61/d68/da3/fe6 x:0 0 0 2024-09-19T06:08:45.988 INFO:tasks.workunit.client.0.smithi037.stdout:4/546: dread d0/d6/d45/f5b [0,4194304] 0 2024-09-19T06:08:45.989 INFO:tasks.workunit.client.0.smithi037.stdout:8/674: creat d1/d61/d7e/d8b/d9f/de4/fe7 x:0 0 0 2024-09-19T06:08:45.989 INFO:tasks.workunit.client.0.smithi037.stdout:8/675: fdatasync d1/d61/d7e/dbc/dc2/d59/d5d/f81 0 2024-09-19T06:08:45.989 INFO:tasks.workunit.client.0.smithi037.stdout:8/676: truncate d1/f6c 641874 0 2024-09-19T06:08:45.998 INFO:tasks.workunit.client.0.smithi037.stdout:7/436: dwrite d6/d20/d34/d49/f5e [0,4194304] 0 2024-09-19T06:08:46.000 INFO:tasks.workunit.client.0.smithi037.stdout:7/437: rmdir d6/d20/d4b/d60/d33/d55 39 2024-09-19T06:08:46.001 INFO:tasks.workunit.client.0.smithi037.stdout:7/438: link d6/dc/df/d7e/f88 d6/dc/f89 0 2024-09-19T06:08:46.002 INFO:tasks.workunit.client.0.smithi037.stdout:7/439: creat d6/f8a x:0 0 0 2024-09-19T06:08:46.003 INFO:tasks.workunit.client.0.smithi037.stdout:8/677: dread d1/d61/f89 [0,4194304] 0 2024-09-19T06:08:46.004 INFO:tasks.workunit.client.0.smithi037.stdout:8/678: rename d1/d61/d7e/d8b/d91/d3d/f2c to d1/d61/d7e/d8b/d91/fe8 0 2024-09-19T06:08:46.005 INFO:tasks.workunit.client.0.smithi037.stdout:8/679: truncate d1/d61/d7e/d8b/d9f/de4/fe7 296948 0 2024-09-19T06:08:46.006 INFO:tasks.workunit.client.0.smithi037.stdout:8/680: creat d1/d61/d7e/dbc/dc2/fe9 x:0 0 0 2024-09-19T06:08:46.006 INFO:tasks.workunit.client.0.smithi037.stdout:8/681: chown d1/d35/f73 5 1 2024-09-19T06:08:46.014 INFO:tasks.workunit.client.0.smithi037.stdout:4/547: dwrite d0/d6/d45/d4a/f93 [0,4194304] 0 2024-09-19T06:08:46.014 INFO:tasks.workunit.client.0.smithi037.stdout:4/548: write d0/d2/f57 [4221408,21654] 0 2024-09-19T06:08:46.014 INFO:tasks.workunit.client.0.smithi037.stdout:4/549: truncate d0/f24 1380319 0 2024-09-19T06:08:46.015 INFO:tasks.workunit.client.0.smithi037.stdout:4/550: getdents d0/d6/d45/d4a/d6f/da9 0 2024-09-19T06:08:46.015 INFO:tasks.workunit.client.0.smithi037.stdout:1/413: sync 2024-09-19T06:08:46.015 INFO:tasks.workunit.client.0.smithi037.stdout:0/464: sync 2024-09-19T06:08:46.015 INFO:tasks.workunit.client.0.smithi037.stdout:3/436: sync 2024-09-19T06:08:46.015 INFO:tasks.workunit.client.0.smithi037.stdout:1/414: chown d2/f6 139682 1 2024-09-19T06:08:46.015 INFO:tasks.workunit.client.0.smithi037.stdout:1/415: fsync d2/fa 0 2024-09-19T06:08:46.015 INFO:tasks.workunit.client.0.smithi037.stdout:1/416: chown d2/d48/f81 852456 1 2024-09-19T06:08:46.016 INFO:tasks.workunit.client.0.smithi037.stdout:9/582: sync 2024-09-19T06:08:46.016 INFO:tasks.workunit.client.0.smithi037.stdout:6/462: sync 2024-09-19T06:08:46.016 INFO:tasks.workunit.client.0.smithi037.stdout:9/583: fdatasync da/d57/f5c 0 2024-09-19T06:08:46.016 INFO:tasks.workunit.client.0.smithi037.stdout:9/584: chown da/dd/d1b/d23/d6a/d82/la9 251977 1 2024-09-19T06:08:46.017 INFO:tasks.workunit.client.0.smithi037.stdout:0/465: creat d5/d8/d79/d9a/f9d x:0 0 0 2024-09-19T06:08:46.018 INFO:tasks.workunit.client.0.smithi037.stdout:1/417: rmdir d2/d12/d1e 39 2024-09-19T06:08:46.019 INFO:tasks.workunit.client.0.smithi037.stdout:3/437: symlink d0/d16/d19/d33/l98 0 2024-09-19T06:08:46.019 INFO:tasks.workunit.client.0.smithi037.stdout:3/438: readlink d0/l31 0 2024-09-19T06:08:46.020 INFO:tasks.workunit.client.0.smithi037.stdout:8/682: dread d1/d61/d7e/d8b/d91/f8d [0,4194304] 0 2024-09-19T06:08:46.020 INFO:tasks.workunit.client.0.smithi037.stdout:8/683: truncate d1/d6a/fde 750835 0 2024-09-19T06:08:46.024 INFO:tasks.workunit.client.0.smithi037.stdout:1/418: mkdir d2/d12/d1e/d8a 0 2024-09-19T06:08:46.024 INFO:tasks.workunit.client.0.smithi037.stdout:0/466: mknod d5/d8/d11/d15/d21/c9e 0 2024-09-19T06:08:46.024 INFO:tasks.workunit.client.0.smithi037.stdout:0/467: getdents d5/d17/d6e 0 2024-09-19T06:08:46.024 INFO:tasks.workunit.client.0.smithi037.stdout:0/468: getdents d5/d17/d6e 0 2024-09-19T06:08:46.026 INFO:tasks.workunit.client.0.smithi037.stdout:1/419: mkdir d2/d12/d1d/d6b/d8b 0 2024-09-19T06:08:46.027 INFO:tasks.workunit.client.0.smithi037.stdout:0/469: rename d5/d8/d79/d9a/f9d to d5/d8/d11/d15/d8d/f9f 0 2024-09-19T06:08:46.028 INFO:tasks.workunit.client.0.smithi037.stdout:0/470: write d5/d42/f62 [1560367,121371] 0 2024-09-19T06:08:46.031 INFO:tasks.workunit.client.0.smithi037.stdout:4/551: dread d0/d6/f23 [0,4194304] 0 2024-09-19T06:08:46.031 INFO:tasks.workunit.client.0.smithi037.stdout:4/552: write d0/d6/f67 [4652990,60115] 0 2024-09-19T06:08:46.032 INFO:tasks.workunit.client.0.smithi037.stdout:0/471: link d5/d8/d11/l63 d5/d8/d11/d15/d8d/la0 0 2024-09-19T06:08:46.032 INFO:tasks.workunit.client.0.smithi037.stdout:9/585: write da/d4d/f68 [627408,28636] 0 2024-09-19T06:08:46.032 INFO:tasks.workunit.client.0.smithi037.stdout:9/586: truncate da/dd/d1b/f21 9183698 0 2024-09-19T06:08:46.032 INFO:tasks.workunit.client.0.smithi037.stdout:9/587: dread - da/dd/d1b/d62/f84 zero size 2024-09-19T06:08:46.032 INFO:tasks.workunit.client.0.smithi037.stdout:9/588: fsync da/dd/d1b/d62/f84 0 2024-09-19T06:08:46.032 INFO:tasks.workunit.client.0.smithi037.stdout:9/589: getdents da/d4d/dbb 0 2024-09-19T06:08:46.033 INFO:tasks.workunit.client.0.smithi037.stdout:9/590: stat da/d4d/cb1 0 2024-09-19T06:08:46.033 INFO:tasks.workunit.client.0.smithi037.stdout:9/591: chown da/fa5 5309 1 2024-09-19T06:08:46.033 INFO:tasks.workunit.client.0.smithi037.stdout:9/592: mknod da/dd/d1b/d23/dbe/cd1 0 2024-09-19T06:08:46.033 INFO:tasks.workunit.client.0.smithi037.stdout:9/593: read - da/dd/d1b/d2f/d6f/faf zero size 2024-09-19T06:08:46.034 INFO:tasks.workunit.client.0.smithi037.stdout:9/594: rename da/dd/d1b/d43/f88 to da/dd/d1b/d2f/d6d/db4/fd2 0 2024-09-19T06:08:46.044 INFO:tasks.workunit.client.0.smithi037.stdout:1/420: dread d2/d12/d1d/f23 [0,4194304] 0 2024-09-19T06:08:46.045 INFO:tasks.workunit.client.0.smithi037.stdout:1/421: truncate d2/d12/d1d/d47/f68 1394759 0 2024-09-19T06:08:46.046 INFO:tasks.workunit.client.0.smithi037.stdout:8/684: dwrite d1/f97 [0,4194304] 0 2024-09-19T06:08:46.046 INFO:tasks.workunit.client.0.smithi037.stdout:8/685: write d1/f52 [776464,79620] 0 2024-09-19T06:08:46.052 INFO:tasks.workunit.client.0.smithi037.stdout:3/439: dwrite d0/d16/f88 [0,4194304] 0 2024-09-19T06:08:46.052 INFO:tasks.workunit.client.0.smithi037.stdout:0/472: dread d5/d8/d44/f51 [0,4194304] 0 2024-09-19T06:08:46.052 INFO:tasks.workunit.client.0.smithi037.stdout:9/595: write da/d4d/f87 [1618783,66277] 0 2024-09-19T06:08:46.056 INFO:tasks.workunit.client.0.smithi037.stdout:3/440: symlink d0/d16/d19/d1d/l99 0 2024-09-19T06:08:46.057 INFO:tasks.workunit.client.0.smithi037.stdout:0/473: mkdir d5/d8/d44/da1 0 2024-09-19T06:08:46.057 INFO:tasks.workunit.client.0.smithi037.stdout:0/474: write d5/d8/d44/d48/f65 [4428598,120938] 0 2024-09-19T06:08:46.058 INFO:tasks.workunit.client.0.smithi037.stdout:4/553: dwrite d0/f24 [0,4194304] 0 2024-09-19T06:08:46.058 INFO:tasks.workunit.client.0.smithi037.stdout:9/596: mkdir da/dd/d63/dd3 0 2024-09-19T06:08:46.059 INFO:tasks.workunit.client.0.smithi037.stdout:3/441: mkdir d0/d43/d9a 0 2024-09-19T06:08:46.059 INFO:tasks.workunit.client.0.smithi037.stdout:3/442: dread - d0/d43/d37/f73 zero size 2024-09-19T06:08:46.060 INFO:tasks.workunit.client.0.smithi037.stdout:0/475: rename d5/d8/d44/d48/l8c to d5/d8/d11/d15/la2 0 2024-09-19T06:08:46.063 INFO:tasks.workunit.client.0.smithi037.stdout:4/554: mknod d0/d8f/cb8 0 2024-09-19T06:08:46.064 INFO:tasks.workunit.client.0.smithi037.stdout:9/597: link da/dd/d1b/f36 da/dd/d1b/d2f/dcc/fd4 0 2024-09-19T06:08:46.065 INFO:tasks.workunit.client.0.smithi037.stdout:3/443: rmdir d0/d43/d23 39 2024-09-19T06:08:46.065 INFO:tasks.workunit.client.0.smithi037.stdout:3/444: write d0/fc [1219360,106316] 0 2024-09-19T06:08:46.066 INFO:tasks.workunit.client.0.smithi037.stdout:4/555: mknod d0/d6/d1b/d20/cb9 0 2024-09-19T06:08:46.068 INFO:tasks.workunit.client.0.smithi037.stdout:9/598: unlink da/db3/fb6 0 2024-09-19T06:08:46.070 INFO:tasks.workunit.client.0.smithi037.stdout:9/599: symlink da/dd/d1b/d23/d6a/d8f/da4/ld5 0 2024-09-19T06:08:46.070 INFO:tasks.workunit.client.0.smithi037.stdout:9/600: write da/dd/d1b/d62/fa1 [5527818,60369] 0 2024-09-19T06:08:46.070 INFO:tasks.workunit.client.0.smithi037.stdout:9/601: chown da/dd/d1b/d23/d6a/d82/c8c 4161677 1 2024-09-19T06:08:46.075 INFO:tasks.workunit.client.0.smithi037.stdout:8/686: dwrite d1/f24 [0,4194304] 0 2024-09-19T06:08:46.076 INFO:tasks.workunit.client.0.smithi037.stdout:3/445: write d0/f17 [1104557,100865] 0 2024-09-19T06:08:46.079 INFO:tasks.workunit.client.0.smithi037.stdout:4/556: truncate d0/f24 3813398 0 2024-09-19T06:08:46.082 INFO:tasks.workunit.client.0.smithi037.stdout:3/446: symlink d0/d96/l9b 0 2024-09-19T06:08:46.083 INFO:tasks.workunit.client.0.smithi037.stdout:3/447: creat d0/d16/d19/f9c x:0 0 0 2024-09-19T06:08:46.085 INFO:tasks.workunit.client.0.smithi037.stdout:0/476: dwrite d5/d20/f7c [0,4194304] 0 2024-09-19T06:08:46.085 INFO:tasks.workunit.client.0.smithi037.stdout:0/477: write d5/d42/f8b [321111,97605] 0 2024-09-19T06:08:46.085 INFO:tasks.workunit.client.0.smithi037.stdout:3/448: creat d0/d16/d19/d33/f9d x:0 0 0 2024-09-19T06:08:46.085 INFO:tasks.workunit.client.0.smithi037.stdout:3/449: chown d0/d43/d23/d7a/d77/d45/c58 1816772 1 2024-09-19T06:08:46.089 INFO:tasks.workunit.client.0.smithi037.stdout:0/478: link d5/d20/d34/f74 d5/fa3 0 2024-09-19T06:08:46.091 INFO:tasks.workunit.client.0.smithi037.stdout:3/450: link d0/d16/d19/d1d/d5e/f74 d0/d16/f9e 0 2024-09-19T06:08:46.093 INFO:tasks.workunit.client.0.smithi037.stdout:4/557: dread d0/d6/d45/f5b [0,4194304] 0 2024-09-19T06:08:46.093 INFO:tasks.workunit.client.0.smithi037.stdout:4/558: chown d0/d6/f67 97832353 1 2024-09-19T06:08:46.096 INFO:tasks.workunit.client.0.smithi037.stdout:9/602: dwrite da/dd/d63/f9b [0,4194304] 0 2024-09-19T06:08:46.096 INFO:tasks.workunit.client.0.smithi037.stdout:0/479: rename d5/d8/c2c to d5/d8/d22/ca4 0 2024-09-19T06:08:46.096 INFO:tasks.workunit.client.0.smithi037.stdout:0/480: truncate d5/d20/d34/f91 29741 0 2024-09-19T06:08:46.097 INFO:tasks.workunit.client.0.smithi037.stdout:3/451: creat d0/d16/d19/d1d/d82/d86/f9f x:0 0 0 2024-09-19T06:08:46.098 INFO:tasks.workunit.client.0.smithi037.stdout:4/559: mkdir d0/d6/d45/d4a/d6f/da9/dba 0 2024-09-19T06:08:46.098 INFO:tasks.workunit.client.0.smithi037.stdout:4/560: write d0/d2/f2b [1676945,78533] 0 2024-09-19T06:08:46.098 INFO:tasks.workunit.client.0.smithi037.stdout:4/561: truncate d0/d6/d45/d4a/d86/f9e 582888 0 2024-09-19T06:08:46.098 INFO:tasks.workunit.client.0.smithi037.stdout:4/562: stat d0/d6/d1b/d20/cae 0 2024-09-19T06:08:46.099 INFO:tasks.workunit.client.0.smithi037.stdout:9/603: symlink da/dd/d1b/d23/d6a/d82/ld6 0 2024-09-19T06:08:46.099 INFO:tasks.workunit.client.0.smithi037.stdout:9/604: read - da/dd/d63/fc1 zero size 2024-09-19T06:08:46.100 INFO:tasks.workunit.client.0.smithi037.stdout:0/481: unlink d5/l19 0 2024-09-19T06:08:46.101 INFO:tasks.workunit.client.0.smithi037.stdout:3/452: truncate d0/d16/f30 696804 0 2024-09-19T06:08:46.101 INFO:tasks.workunit.client.0.smithi037.stdout:3/453: chown d0/d16/d19/d33 0 1 2024-09-19T06:08:46.103 INFO:tasks.workunit.client.0.smithi037.stdout:4/563: rename d0/d2/d2e/f98 to d0/d6/d45/d4a/d6f/fbb 0 2024-09-19T06:08:46.103 INFO:tasks.workunit.client.0.smithi037.stdout:4/564: dread - d0/d2/d37/d92/fa4 zero size 2024-09-19T06:08:46.103 INFO:tasks.workunit.client.0.smithi037.stdout:4/565: truncate d0/d2/d37/fa1 4678497 0 2024-09-19T06:08:46.104 INFO:tasks.workunit.client.0.smithi037.stdout:0/482: creat d5/d17/fa5 x:0 0 0 2024-09-19T06:08:46.106 INFO:tasks.workunit.client.0.smithi037.stdout:3/454: mkdir d0/d5f/da0 0 2024-09-19T06:08:46.106 INFO:tasks.workunit.client.0.smithi037.stdout:4/566: symlink d0/d2/lbc 0 2024-09-19T06:08:46.108 INFO:tasks.workunit.client.0.smithi037.stdout:0/483: mkdir d5/d8/d22/d89/da6 0 2024-09-19T06:08:46.109 INFO:tasks.workunit.client.0.smithi037.stdout:3/455: link d0/d43/d23/d7a/d77/d45/d55/f4a d0/fa1 0 2024-09-19T06:08:46.111 INFO:tasks.workunit.client.0.smithi037.stdout:3/456: symlink d0/d43/d26/la2 0 2024-09-19T06:08:46.112 INFO:tasks.workunit.client.0.smithi037.stdout:2/538: sync 2024-09-19T06:08:46.112 INFO:tasks.workunit.client.0.smithi037.stdout:2/539: chown d1/da/dc/d21/d7d/c5b 48851 1 2024-09-19T06:08:46.112 INFO:tasks.workunit.client.0.smithi037.stdout:2/540: fdatasync d1/d16/d4a/f75 0 2024-09-19T06:08:46.112 INFO:tasks.workunit.client.0.smithi037.stdout:2/541: chown d1/da/dc/d21/d55/dbc 27458 1 2024-09-19T06:08:46.114 INFO:tasks.workunit.client.0.smithi037.stdout:3/457: creat d0/fa3 x:0 0 0 2024-09-19T06:08:46.114 INFO:tasks.workunit.client.0.smithi037.stdout:3/458: write d0/d43/d23/d7a/d77/f41 [569466,40815] 0 2024-09-19T06:08:46.116 INFO:tasks.workunit.client.0.smithi037.stdout:2/542: mkdir d1/d6/da3/da8/dbe 0 2024-09-19T06:08:46.117 INFO:tasks.workunit.client.0.smithi037.stdout:3/459: creat d0/d43/fa4 x:0 0 0 2024-09-19T06:08:46.118 INFO:tasks.workunit.client.0.smithi037.stdout:3/460: chown d0/d16/d19/d1d/d82/l93 1 1 2024-09-19T06:08:46.128 INFO:tasks.workunit.client.0.smithi037.stdout:9/605: dwrite da/dd/d1b/d23/f9c [0,4194304] 0 2024-09-19T06:08:46.128 INFO:tasks.workunit.client.0.smithi037.stdout:9/606: stat da/d20 0 2024-09-19T06:08:46.128 INFO:tasks.workunit.client.0.smithi037.stdout:9/607: getdents da/dd/d1b/d2f/d6d/dce 0 2024-09-19T06:08:46.132 INFO:tasks.workunit.client.0.smithi037.stdout:9/608: creat da/dd/d1b/d23/d6a/d82/fd7 x:0 0 0 2024-09-19T06:08:46.132 INFO:tasks.workunit.client.0.smithi037.stdout:9/609: truncate da/f5a 812314 0 2024-09-19T06:08:46.134 INFO:tasks.workunit.client.0.smithi037.stdout:3/461: getdents d0/d43 0 2024-09-19T06:08:46.134 INFO:tasks.workunit.client.0.smithi037.stdout:3/462: read d0/d43/f4c [102962,42027] 0 2024-09-19T06:08:46.134 INFO:tasks.workunit.client.0.smithi037.stdout:3/463: chown d0/d16/d19 75 1 2024-09-19T06:08:46.134 INFO:tasks.workunit.client.0.smithi037.stdout:3/464: write d0/d16/f81 [4793138,57222] 0 2024-09-19T06:08:46.139 INFO:tasks.workunit.client.0.smithi037.stdout:0/484: dwrite d5/d20/d34/f74 [0,4194304] 0 2024-09-19T06:08:46.140 INFO:tasks.workunit.client.0.smithi037.stdout:4/567: dwrite d0/d2/d37/f49 [0,4194304] 0 2024-09-19T06:08:46.140 INFO:tasks.workunit.client.0.smithi037.stdout:4/568: chown d0/la 934 1 2024-09-19T06:08:46.148 INFO:tasks.workunit.client.0.smithi037.stdout:2/543: write d1/d16/f1c [3712708,37272] 0 2024-09-19T06:08:46.148 INFO:tasks.workunit.client.0.smithi037.stdout:2/544: chown d1/cb8 0 1 2024-09-19T06:08:46.150 INFO:tasks.workunit.client.0.smithi037.stdout:2/545: creat d1/d33/d4c/fbf x:0 0 0 2024-09-19T06:08:46.155 INFO:tasks.workunit.client.0.smithi037.stdout:4/569: dread d0/d2/d2e/f7e [0,4194304] 0 2024-09-19T06:08:46.156 INFO:tasks.workunit.client.0.smithi037.stdout:4/570: rmdir d0/d6 39 2024-09-19T06:08:46.157 INFO:tasks.workunit.client.0.smithi037.stdout:4/571: creat d0/d6/d45/d4a/d6f/d8e/fbd x:0 0 0 2024-09-19T06:08:46.158 INFO:tasks.workunit.client.0.smithi037.stdout:3/465: dwrite d0/d43/d37/f73 [0,4194304] 0 2024-09-19T06:08:46.160 INFO:tasks.workunit.client.0.smithi037.stdout:3/466: mknod d0/d43/d23/ca5 0 2024-09-19T06:08:46.160 INFO:tasks.workunit.client.0.smithi037.stdout:9/610: dwrite da/dd/d63/f9b [0,4194304] 0 2024-09-19T06:08:46.161 INFO:tasks.workunit.client.0.smithi037.stdout:3/467: mkdir d0/d16/da6 0 2024-09-19T06:08:46.162 INFO:tasks.workunit.client.0.smithi037.stdout:9/611: creat da/dd/d1b/d23/d6a/fd8 x:0 0 0 2024-09-19T06:08:46.164 INFO:tasks.workunit.client.0.smithi037.stdout:0/485: dwrite d5/d8/d11/f78 [0,4194304] 0 2024-09-19T06:08:46.167 INFO:tasks.workunit.client.0.smithi037.stdout:2/546: read d1/da/fa5 [405355,31169] 0 2024-09-19T06:08:46.167 INFO:tasks.workunit.client.0.smithi037.stdout:3/468: rename d0/d16/d19/d1d/f27 to d0/d43/d37/fa7 0 2024-09-19T06:08:46.167 INFO:tasks.workunit.client.0.smithi037.stdout:0/486: truncate d5/d8/d44/f51 1425641 0 2024-09-19T06:08:46.167 INFO:tasks.workunit.client.0.smithi037.stdout:3/469: chown d0/d43/d23/d7a/d77/d45/l95 0 1 2024-09-19T06:08:46.168 INFO:tasks.workunit.client.0.smithi037.stdout:2/547: creat d1/da/dc/d21/d55/dbc/db0/fc0 x:0 0 0 2024-09-19T06:08:46.169 INFO:tasks.workunit.client.0.smithi037.stdout:0/487: rename d5/c1a to d5/d8/d22/d89/ca7 0 2024-09-19T06:08:46.170 INFO:tasks.workunit.client.0.smithi037.stdout:2/548: mknod d1/da/dc/d21/d7d/d80/cc1 0 2024-09-19T06:08:46.172 INFO:tasks.workunit.client.0.smithi037.stdout:3/470: rename d0/d43/d23/d7a/d77/d45/d55/f4a to d0/d43/d23/d7a/fa8 0 2024-09-19T06:08:46.173 INFO:tasks.workunit.client.0.smithi037.stdout:0/488: creat d5/d8/d11/d15/d21/d4e/fa8 x:0 0 0 2024-09-19T06:08:46.174 INFO:tasks.workunit.client.0.smithi037.stdout:3/471: getdents d0/d16/d19/d1d/d5e/d61 0 2024-09-19T06:08:46.175 INFO:tasks.workunit.client.0.smithi037.stdout:0/489: mkdir d5/d8/d22/d89/da9 0 2024-09-19T06:08:46.181 INFO:tasks.workunit.client.0.smithi037.stdout:4/572: dwrite d0/d6/d45/d4a/d86/f9e [0,4194304] 0 2024-09-19T06:08:46.195 INFO:tasks.workunit.client.0.smithi037.stdout:4/573: read d0/d6/d1b/f78 [347073,45100] 0 2024-09-19T06:08:46.195 INFO:tasks.workunit.client.0.smithi037.stdout:4/574: readlink d0/l1 0 2024-09-19T06:08:46.196 INFO:tasks.workunit.client.0.smithi037.stdout:9/612: dwrite da/dd/d1b/d23/d6a/d82/fd7 [0,4194304] 0 2024-09-19T06:08:46.198 INFO:tasks.workunit.client.0.smithi037.stdout:4/575: truncate d0/d6/d1b/d20/f62 875325 0 2024-09-19T06:08:46.198 INFO:tasks.workunit.client.0.smithi037.stdout:0/490: dread d5/d20/d34/f74 [0,4194304] 0 2024-09-19T06:08:46.201 INFO:tasks.workunit.client.0.smithi037.stdout:9/613: creat da/d57/fd9 x:0 0 0 2024-09-19T06:08:46.201 INFO:tasks.workunit.client.0.smithi037.stdout:9/614: chown da/dd/d1b/d2f/d6d 26064 1 2024-09-19T06:08:46.201 INFO:tasks.workunit.client.0.smithi037.stdout:3/472: read d0/d16/d19/f59 [1225199,91103] 0 2024-09-19T06:08:46.202 INFO:tasks.workunit.client.0.smithi037.stdout:0/491: creat d5/d20/faa x:0 0 0 2024-09-19T06:08:46.203 INFO:tasks.workunit.client.0.smithi037.stdout:9/615: mknod da/dd/d1b/d56/cda 0 2024-09-19T06:08:46.207 INFO:tasks.workunit.client.0.smithi037.stdout:2/549: dwrite d1/d33/d4c/fbf [0,4194304] 0 2024-09-19T06:08:46.207 INFO:tasks.workunit.client.0.smithi037.stdout:2/550: readlink d1/d16/l1d 0 2024-09-19T06:08:46.208 INFO:tasks.workunit.client.0.smithi037.stdout:2/551: write d1/d16/d62/f73 [4738815,68933] 0 2024-09-19T06:08:46.208 INFO:tasks.workunit.client.0.smithi037.stdout:2/552: write d1/f43 [427231,38798] 0 2024-09-19T06:08:46.208 INFO:tasks.workunit.client.0.smithi037.stdout:2/553: write d1/d6/f12 [3338156,87565] 0 2024-09-19T06:08:46.208 INFO:tasks.workunit.client.0.smithi037.stdout:2/554: write d1/da/f6d [1434917,20545] 0 2024-09-19T06:08:46.213 INFO:tasks.workunit.client.0.smithi037.stdout:2/555: link d1/da/f6d d1/da/d6e/fc2 0 2024-09-19T06:08:46.213 INFO:tasks.workunit.client.0.smithi037.stdout:2/556: fsync d1/d16/d4a/f8d 0 2024-09-19T06:08:46.215 INFO:tasks.workunit.client.0.smithi037.stdout:3/473: dread d0/d43/d23/d7a/d77/f84 [0,4194304] 0 2024-09-19T06:08:46.218 INFO:tasks.workunit.client.0.smithi037.stdout:9/616: dread da/dd/d1b/d43/f66 [0,4194304] 0 2024-09-19T06:08:46.221 INFO:tasks.workunit.client.0.smithi037.stdout:5/519: sync 2024-09-19T06:08:46.221 INFO:tasks.workunit.client.0.smithi037.stdout:7/440: sync 2024-09-19T06:08:46.222 INFO:tasks.workunit.client.0.smithi037.stdout:9/617: symlink da/db3/ldb 0 2024-09-19T06:08:46.222 INFO:tasks.workunit.client.0.smithi037.stdout:7/441: getdents d6/d20/d34/d49 0 2024-09-19T06:08:46.223 INFO:tasks.workunit.client.0.smithi037.stdout:5/520: mknod d2/d12/d28/d22/cad 0 2024-09-19T06:08:46.224 INFO:tasks.workunit.client.0.smithi037.stdout:9/618: mkdir da/dd/d1b/d23/d6a/d8f/dac/ddc 0 2024-09-19T06:08:46.225 INFO:tasks.workunit.client.0.smithi037.stdout:7/442: creat d6/d20/d4b/d60/f8b x:0 0 0 2024-09-19T06:08:46.227 INFO:tasks.workunit.client.0.smithi037.stdout:9/619: creat da/dd/d1b/d2f/fdd x:0 0 0 2024-09-19T06:08:46.227 INFO:tasks.workunit.client.0.smithi037.stdout:7/443: mkdir d6/d20/d4b/d60/d33/d8c 0 2024-09-19T06:08:46.228 INFO:tasks.workunit.client.0.smithi037.stdout:7/444: mknod d6/d20/d34/d49/c8d 0 2024-09-19T06:08:46.228 INFO:tasks.workunit.client.0.smithi037.stdout:7/445: fdatasync d6/dc/f25 0 2024-09-19T06:08:46.229 INFO:tasks.workunit.client.0.smithi037.stdout:7/446: link d6/c1c d6/dc/df/c8e 0 2024-09-19T06:08:46.231 INFO:tasks.workunit.client.0.smithi037.stdout:7/447: creat d6/dc/df/f8f x:0 0 0 2024-09-19T06:08:46.231 INFO:tasks.workunit.client.0.smithi037.stdout:7/448: fsync d6/dc/d22/f4c 0 2024-09-19T06:08:46.231 INFO:tasks.workunit.client.0.smithi037.stdout:3/474: write d0/f9 [7992036,4705] 0 2024-09-19T06:08:46.231 INFO:tasks.workunit.client.0.smithi037.stdout:4/576: dwrite d0/d2/fb2 [0,4194304] 0 2024-09-19T06:08:46.232 INFO:tasks.workunit.client.0.smithi037.stdout:4/577: chown d0/f16 30839 1 2024-09-19T06:08:46.232 INFO:tasks.workunit.client.0.smithi037.stdout:7/449: rmdir d6/d21/d76 0 2024-09-19T06:08:46.233 INFO:tasks.workunit.client.0.smithi037.stdout:0/492: dwrite d5/d17/f58 [0,4194304] 0 2024-09-19T06:08:46.233 INFO:tasks.workunit.client.0.smithi037.stdout:0/493: getdents d5/d17/d6e 0 2024-09-19T06:08:46.233 INFO:tasks.workunit.client.0.smithi037.stdout:2/557: dwrite d1/d16/d62/fa2 [4194304,4194304] 0 2024-09-19T06:08:46.233 INFO:tasks.workunit.client.0.smithi037.stdout:2/558: chown d1/d33 3 1 2024-09-19T06:08:46.234 INFO:tasks.workunit.client.0.smithi037.stdout:4/578: truncate d0/d6/d45/d4a/f6c 4088584 0 2024-09-19T06:08:46.236 INFO:tasks.workunit.client.0.smithi037.stdout:7/450: creat d6/d20/d34/d7d/f90 x:0 0 0 2024-09-19T06:08:46.237 INFO:tasks.workunit.client.0.smithi037.stdout:5/521: dread d2/d10/f21 [0,4194304] 0 2024-09-19T06:08:46.241 INFO:tasks.workunit.client.0.smithi037.stdout:0/494: rename d5/d8/d22/d89/da6 to d5/d18/d68/d85/dab 0 2024-09-19T06:08:46.242 INFO:tasks.workunit.client.0.smithi037.stdout:2/559: getdents d1/d6/da3 0 2024-09-19T06:08:46.243 INFO:tasks.workunit.client.0.smithi037.stdout:7/451: symlink d6/d20/d4b/l91 0 2024-09-19T06:08:46.243 INFO:tasks.workunit.client.0.smithi037.stdout:7/452: write d6/d20/d4b/d60/f74 [2393868,21752] 0 2024-09-19T06:08:46.244 INFO:tasks.workunit.client.0.smithi037.stdout:9/620: dread da/dd/d1b/d23/d6a/d82/fd7 [0,4194304] 0 2024-09-19T06:08:46.245 INFO:tasks.workunit.client.0.smithi037.stdout:9/621: readlink da/dd/d1b/d23/d6a/d82/ld6 0 2024-09-19T06:08:46.245 INFO:tasks.workunit.client.0.smithi037.stdout:0/495: mknod d5/cac 0 2024-09-19T06:08:46.245 INFO:tasks.workunit.client.0.smithi037.stdout:0/496: getdents d5/d8/d44/da1 0 2024-09-19T06:08:46.246 INFO:tasks.workunit.client.0.smithi037.stdout:2/560: mkdir d1/dc3 0 2024-09-19T06:08:46.248 INFO:tasks.workunit.client.0.smithi037.stdout:7/453: rename d6/d20/d4b/d60/d33/d61/f80 to d6/f92 0 2024-09-19T06:08:46.249 INFO:tasks.workunit.client.0.smithi037.stdout:9/622: mkdir da/dd/d1b/d23/d6a/d82/dde 0 2024-09-19T06:08:46.252 INFO:tasks.workunit.client.0.smithi037.stdout:4/579: write d0/d6/d45/d4a/f93 [3537346,57622] 0 2024-09-19T06:08:46.252 INFO:tasks.workunit.client.0.smithi037.stdout:2/561: creat d1/d6/da3/da8/dbe/fc4 x:0 0 0 2024-09-19T06:08:46.252 INFO:tasks.workunit.client.0.smithi037.stdout:6/463: sync 2024-09-19T06:08:46.254 INFO:tasks.workunit.client.0.smithi037.stdout:9/623: creat da/dd/d1b/d23/dbe/fdf x:0 0 0 2024-09-19T06:08:46.254 INFO:tasks.workunit.client.0.smithi037.stdout:3/475: dwrite d0/d16/f30 [0,4194304] 0 2024-09-19T06:08:46.256 INFO:tasks.workunit.client.0.smithi037.stdout:4/580: creat d0/d2/d37/d46/fbe x:0 0 0 2024-09-19T06:08:46.258 INFO:tasks.workunit.client.0.smithi037.stdout:6/464: mknod d9/dd/d2b/d42/c8e 0 2024-09-19T06:08:46.261 INFO:tasks.workunit.client.0.smithi037.stdout:9/624: creat da/dd/d63/d80/dc4/fe0 x:0 0 0 2024-09-19T06:08:46.261 INFO:tasks.workunit.client.0.smithi037.stdout:9/625: write da/dd/d1b/d62/f84 [53826,114811] 0 2024-09-19T06:08:46.261 INFO:tasks.workunit.client.0.smithi037.stdout:9/626: write da/dd/d1b/d56/f83 [137986,83547] 0 2024-09-19T06:08:46.263 INFO:tasks.workunit.client.0.smithi037.stdout:5/522: dwrite d2/d12/d24/f70 [0,4194304] 0 2024-09-19T06:08:46.263 INFO:tasks.workunit.client.0.smithi037.stdout:5/523: fdatasync d2/d12/d28/d22/d4a/d9f/fa2 0 2024-09-19T06:08:46.263 INFO:tasks.workunit.client.0.smithi037.stdout:3/476: mkdir d0/d16/d19/d1d/d5e/da9 0 2024-09-19T06:08:46.265 INFO:tasks.workunit.client.0.smithi037.stdout:6/465: creat d9/d6e/f8f x:0 0 0 2024-09-19T06:08:46.267 INFO:tasks.workunit.client.0.smithi037.stdout:9/627: symlink da/dd/d1b/d2f/d6d/db4/le1 0 2024-09-19T06:08:46.270 INFO:tasks.workunit.client.0.smithi037.stdout:5/524: mkdir d2/d12/d28/d22/d35/dae 0 2024-09-19T06:08:46.270 INFO:tasks.workunit.client.0.smithi037.stdout:0/497: dwrite d5/d8/d22/d89/f8a [4194304,4194304] 0 2024-09-19T06:08:46.270 INFO:tasks.workunit.client.0.smithi037.stdout:7/454: dwrite d6/f1d [0,4194304] 0 2024-09-19T06:08:46.271 INFO:tasks.workunit.client.0.smithi037.stdout:7/455: read - d6/f8a zero size 2024-09-19T06:08:46.271 INFO:tasks.workunit.client.0.smithi037.stdout:6/466: mknod d9/dd/d1c/d73/c90 0 2024-09-19T06:08:46.272 INFO:tasks.workunit.client.0.smithi037.stdout:9/628: chown c7 4433300 1 2024-09-19T06:08:46.273 INFO:tasks.workunit.client.0.smithi037.stdout:2/562: dread d1/da/d95/f97 [0,4194304] 0 2024-09-19T06:08:46.274 INFO:tasks.workunit.client.0.smithi037.stdout:5/525: rename d2/d12/d28/d57/d82 to d2/d10/daf 0 2024-09-19T06:08:46.276 INFO:tasks.workunit.client.0.smithi037.stdout:0/498: creat d5/d17/fad x:0 0 0 2024-09-19T06:08:46.281 INFO:tasks.workunit.client.0.smithi037.stdout:4/581: dwrite d0/d6/d45/d4a/f8c [0,4194304] 0 2024-09-19T06:08:46.285 INFO:tasks.workunit.client.0.smithi037.stdout:6/467: getdents d9/dd/d1c/d4e 0 2024-09-19T06:08:46.285 INFO:tasks.workunit.client.0.smithi037.stdout:6/468: read - d9/dd/d20/d5a/d6d/d82/f84 zero size 2024-09-19T06:08:46.287 INFO:tasks.workunit.client.0.smithi037.stdout:9/629: creat da/dd/d1b/d2f/d6d/d92/fe2 x:0 0 0 2024-09-19T06:08:46.288 INFO:tasks.workunit.client.0.smithi037.stdout:3/477: dwrite d0/f7d [0,4194304] 0 2024-09-19T06:08:46.289 INFO:tasks.workunit.client.0.smithi037.stdout:2/563: creat d1/da/dc/d21/d51/fc5 x:0 0 0 2024-09-19T06:08:46.292 INFO:tasks.workunit.client.0.smithi037.stdout:0/499: mkdir d5/d8/d22/d89/d96/dae 0 2024-09-19T06:08:46.292 INFO:tasks.workunit.client.0.smithi037.stdout:4/582: mknod d0/d2/d2e/cbf 0 2024-09-19T06:08:46.292 INFO:tasks.workunit.client.0.smithi037.stdout:4/583: chown d0/f44 3 1 2024-09-19T06:08:46.293 INFO:tasks.workunit.client.0.smithi037.stdout:6/469: rmdir d9/dd 39 2024-09-19T06:08:46.294 INFO:tasks.workunit.client.0.smithi037.stdout:6/470: chown d9/dd/d20/d5a/d6d/d82 1276 1 2024-09-19T06:08:46.294 INFO:tasks.workunit.client.0.smithi037.stdout:6/471: write d9/dd/f1b [698823,87308] 0 2024-09-19T06:08:46.296 INFO:tasks.workunit.client.0.smithi037.stdout:3/478: rmdir d0/d16/d19/d1d/d7c 39 2024-09-19T06:08:46.297 INFO:tasks.workunit.client.0.smithi037.stdout:8/687: sync 2024-09-19T06:08:46.298 INFO:tasks.workunit.client.0.smithi037.stdout:1/422: sync 2024-09-19T06:08:46.298 INFO:tasks.workunit.client.0.smithi037.stdout:8/688: chown d1/d61/d7e/d8b/d91/d3d/c25 843505064 1 2024-09-19T06:08:46.298 INFO:tasks.workunit.client.0.smithi037.stdout:8/689: fsync d1/f15 0 2024-09-19T06:08:46.298 INFO:tasks.workunit.client.0.smithi037.stdout:7/456: rename d6/dc/df/f86 to d6/d20/d34/f93 0 2024-09-19T06:08:46.298 INFO:tasks.workunit.client.0.smithi037.stdout:7/457: truncate d6/d21/f5f 400629 0 2024-09-19T06:08:46.300 INFO:tasks.workunit.client.0.smithi037.stdout:0/500: mkdir d5/d8/d44/d48/daf 0 2024-09-19T06:08:46.301 INFO:tasks.workunit.client.0.smithi037.stdout:4/584: mkdir d0/d6/d1b/d30/dc0 0 2024-09-19T06:08:46.301 INFO:tasks.workunit.client.0.smithi037.stdout:4/585: chown d0/d2/f2c 13601449 1 2024-09-19T06:08:46.302 INFO:tasks.workunit.client.0.smithi037.stdout:5/526: dwrite d2/d12/d28/f3f [4194304,4194304] 0 2024-09-19T06:08:46.303 INFO:tasks.workunit.client.0.smithi037.stdout:6/472: rmdir d9/d78/d8c 0 2024-09-19T06:08:46.304 INFO:tasks.workunit.client.0.smithi037.stdout:3/479: creat d0/d16/d19/d33/d87/faa x:0 0 0 2024-09-19T06:08:46.307 INFO:tasks.workunit.client.0.smithi037.stdout:9/630: rename da/d57/f5c to da/dd/d1b/d23/d6a/d8f/dac/fe3 0 2024-09-19T06:08:46.308 INFO:tasks.workunit.client.0.smithi037.stdout:7/458: dread - d6/d20/d34/f58 zero size 2024-09-19T06:08:46.311 INFO:tasks.workunit.client.0.smithi037.stdout:0/501: read d5/d8/d22/f47 [2211273,11868] 0 2024-09-19T06:08:46.312 INFO:tasks.workunit.client.0.smithi037.stdout:6/473: link d9/dd/d1c/f80 d9/dd/d1c/d4e/d62/f91 0 2024-09-19T06:08:46.313 INFO:tasks.workunit.client.0.smithi037.stdout:3/480: getdents d0/d16/d19/d1d/d82/d86 0 2024-09-19T06:08:46.315 INFO:tasks.workunit.client.0.smithi037.stdout:2/564: rename d1/da/c3a to d1/da/dc/d21/d7d/dab/cc6 0 2024-09-19T06:08:46.319 INFO:tasks.workunit.client.0.smithi037.stdout:9/631: mkdir da/dd/d1b/d43/de4 0 2024-09-19T06:08:46.319 INFO:tasks.workunit.client.0.smithi037.stdout:4/586: rename d0/d2/d37/d92/c9d to d0/d2/d2e/d36/cc1 0 2024-09-19T06:08:46.319 INFO:tasks.workunit.client.0.smithi037.stdout:9/632: truncate da/dd/d1b/d2f/fdd 905065 0 2024-09-19T06:08:46.320 INFO:tasks.workunit.client.0.smithi037.stdout:1/423: dwrite d2/d12/d1e/f4e [0,4194304] 0 2024-09-19T06:08:46.321 INFO:tasks.workunit.client.0.smithi037.stdout:5/527: rename d2/d12/d24/d58/f5e to d2/d12/d28/d57/fb0 0 2024-09-19T06:08:46.325 INFO:tasks.workunit.client.0.smithi037.stdout:9/633: rename da/dd/d1b/d56 to da/dd/d1b/d23/d6a/d8f/da4/de5 0 2024-09-19T06:08:46.325 INFO:tasks.workunit.client.0.smithi037.stdout:7/459: dread d6/d20/d4b/d60/f73 [0,4194304] 0 2024-09-19T06:08:46.325 INFO:tasks.workunit.client.0.smithi037.stdout:7/460: fdatasync d6/d20/d4b/d60/f62 0 2024-09-19T06:08:46.326 INFO:tasks.workunit.client.0.smithi037.stdout:0/502: write d5/d8/d11/f16 [3286261,39908] 0 2024-09-19T06:08:46.326 INFO:tasks.workunit.client.0.smithi037.stdout:0/503: write d5/d8/d11/d15/f90 [5183653,83660] 0 2024-09-19T06:08:46.331 INFO:tasks.workunit.client.0.smithi037.stdout:8/690: dwrite d1/d61/d7e/dbc/dc2/d59/f8e [0,4194304] 0 2024-09-19T06:08:46.331 INFO:tasks.workunit.client.0.smithi037.stdout:8/691: dread - d1/dc7/fe5 zero size 2024-09-19T06:08:46.337 INFO:tasks.workunit.client.0.smithi037.stdout:0/504: link d5/d18/l77 d5/d8/d11/lb0 0 2024-09-19T06:08:46.337 INFO:tasks.workunit.client.0.smithi037.stdout:0/505: write d5/d8/d11/d15/d21/d4e/fa8 [787272,31713] 0 2024-09-19T06:08:46.338 INFO:tasks.workunit.client.0.smithi037.stdout:8/692: rmdir d1/d61/d7e/d8b 39 2024-09-19T06:08:46.342 INFO:tasks.workunit.client.0.smithi037.stdout:4/587: dread d0/f16 [0,4194304] 0 2024-09-19T06:08:46.342 INFO:tasks.workunit.client.0.smithi037.stdout:6/474: dwrite d9/dd/d1c/d4e/d33/f88 [0,4194304] 0 2024-09-19T06:08:46.347 INFO:tasks.workunit.client.0.smithi037.stdout:9/634: read da/dd/d1b/d2f/dcc/fd4 [1431866,105857] 0 2024-09-19T06:08:46.347 INFO:tasks.workunit.client.0.smithi037.stdout:4/588: mkdir d0/d6/d1b/d5d/dc2 0 2024-09-19T06:08:46.347 INFO:tasks.workunit.client.0.smithi037.stdout:4/589: fdatasync d0/d6/d45/d4a/d86/f8a 0 2024-09-19T06:08:46.348 INFO:tasks.workunit.client.0.smithi037.stdout:2/565: dread d1/d6/f24 [0,4194304] 0 2024-09-19T06:08:46.351 INFO:tasks.workunit.client.0.smithi037.stdout:1/424: dwrite d2/fa [0,4194304] 0 2024-09-19T06:08:46.351 INFO:tasks.workunit.client.0.smithi037.stdout:1/425: chown d2/f6 12 1 2024-09-19T06:08:46.351 INFO:tasks.workunit.client.0.smithi037.stdout:1/426: truncate d2/d12/d1e/d2a/d2e/f7e 869595 0 2024-09-19T06:08:46.351 INFO:tasks.workunit.client.0.smithi037.stdout:3/481: dwrite d0/f25 [0,4194304] 0 2024-09-19T06:08:46.354 INFO:tasks.workunit.client.0.smithi037.stdout:1/427: getdents d2/d12/d1e/d75 0 2024-09-19T06:08:46.354 INFO:tasks.workunit.client.0.smithi037.stdout:1/428: chown d2/d12/d1e/d2a/d2e 1 1 2024-09-19T06:08:46.355 INFO:tasks.workunit.client.0.smithi037.stdout:3/482: creat d0/d43/d23/d7a/d77/d62/fab x:0 0 0 2024-09-19T06:08:46.356 INFO:tasks.workunit.client.0.smithi037.stdout:3/483: fdatasync d0/d16/f9e 0 2024-09-19T06:08:46.356 INFO:tasks.workunit.client.0.smithi037.stdout:1/429: mknod d2/d12/d1e/c8c 0 2024-09-19T06:08:46.364 INFO:tasks.workunit.client.0.smithi037.stdout:2/566: dread d1/d6/f7b [0,4194304] 0 2024-09-19T06:08:46.365 INFO:tasks.workunit.client.0.smithi037.stdout:1/430: write d2/f38 [255462,108103] 0 2024-09-19T06:08:46.367 INFO:tasks.workunit.client.0.smithi037.stdout:2/567: mkdir d1/da/dc/d21/d7d/d80/dc7 0 2024-09-19T06:08:46.367 INFO:tasks.workunit.client.0.smithi037.stdout:4/590: write d0/d2/fb2 [3338065,85884] 0 2024-09-19T06:08:46.370 INFO:tasks.workunit.client.0.smithi037.stdout:5/528: dwrite d2/d12/d28/d57/fb0 [4194304,4194304] 0 2024-09-19T06:08:46.371 INFO:tasks.workunit.client.0.smithi037.stdout:3/484: dread d0/d43/d23/d7a/d77/d45/d55/f40 [0,4194304] 0 2024-09-19T06:08:46.371 INFO:tasks.workunit.client.0.smithi037.stdout:2/568: link d1/d6/f24 d1/da/dc/d21/d55/dbc/fc8 0 2024-09-19T06:08:46.371 INFO:tasks.workunit.client.0.smithi037.stdout:4/591: unlink d0/d2/d2e/l9f 0 2024-09-19T06:08:46.371 INFO:tasks.workunit.client.0.smithi037.stdout:4/592: fsync d0/d6/d1b/f78 0 2024-09-19T06:08:46.372 INFO:tasks.workunit.client.0.smithi037.stdout:7/461: dwrite d6/dc/df/f13 [0,4194304] 0 2024-09-19T06:08:46.372 INFO:tasks.workunit.client.0.smithi037.stdout:7/462: dread - d6/f3d zero size 2024-09-19T06:08:46.373 INFO:tasks.workunit.client.0.smithi037.stdout:3/485: rename d0/d16/f56 to d0/d16/d19/d33/fac 0 2024-09-19T06:08:46.375 INFO:tasks.workunit.client.0.smithi037.stdout:2/569: rename d1/da/dc/d21/f38 to d1/da/dc/d21/d7d/dab/fc9 0 2024-09-19T06:08:46.375 INFO:tasks.workunit.client.0.smithi037.stdout:2/570: write d1/d6/f12 [3234575,84655] 0 2024-09-19T06:08:46.376 INFO:tasks.workunit.client.0.smithi037.stdout:7/463: truncate d6/d20/d34/f40 203712 0 2024-09-19T06:08:46.377 INFO:tasks.workunit.client.0.smithi037.stdout:0/506: dwrite d5/d8/d11/d15/f1c [0,4194304] 0 2024-09-19T06:08:46.377 INFO:tasks.workunit.client.0.smithi037.stdout:0/507: readlink d5/d8/d11/l63 0 2024-09-19T06:08:46.377 INFO:tasks.workunit.client.0.smithi037.stdout:7/464: creat d6/dc/f94 x:0 0 0 2024-09-19T06:08:46.377 INFO:tasks.workunit.client.0.smithi037.stdout:7/465: dread - d6/d20/d4b/d60/f84 zero size 2024-09-19T06:08:46.378 INFO:tasks.workunit.client.0.smithi037.stdout:9/635: dwrite da/dd/d1b/d43/f66 [0,4194304] 0 2024-09-19T06:08:46.378 INFO:tasks.workunit.client.0.smithi037.stdout:9/636: write da/dd/fc9 [674065,8679] 0 2024-09-19T06:08:46.378 INFO:tasks.workunit.client.0.smithi037.stdout:0/508: getdents d5/d8/d22/d89 0 2024-09-19T06:08:46.379 INFO:tasks.workunit.client.0.smithi037.stdout:0/509: read d5/d8/d11/f3e [1043584,93663] 0 2024-09-19T06:08:46.380 INFO:tasks.workunit.client.0.smithi037.stdout:9/637: unlink da/dd/d1b/d2f/dcc/fd4 0 2024-09-19T06:08:46.380 INFO:tasks.workunit.client.0.smithi037.stdout:9/638: chown da/dd/d1b/d23/f9c 229189566 1 2024-09-19T06:08:46.381 INFO:tasks.workunit.client.0.smithi037.stdout:0/510: mknod d5/d8/d11/d32/cb1 0 2024-09-19T06:08:46.383 INFO:tasks.workunit.client.0.smithi037.stdout:0/511: symlink d5/d8/d11/d15/d21/d4e/lb2 0 2024-09-19T06:08:46.384 INFO:tasks.workunit.client.0.smithi037.stdout:9/639: rename da/d20/f2a to da/dd/d63/d80/fe6 0 2024-09-19T06:08:46.386 INFO:tasks.workunit.client.0.smithi037.stdout:6/475: dread d9/dd/d1c/d4e/d62/f74 [0,4194304] 0 2024-09-19T06:08:46.386 INFO:tasks.workunit.client.0.smithi037.stdout:8/693: dwrite d1/d61/d68/f86 [4194304,4194304] 0 2024-09-19T06:08:46.386 INFO:tasks.workunit.client.0.smithi037.stdout:9/640: mkdir da/dd/d1b/d2f/dcc/de7 0 2024-09-19T06:08:46.388 INFO:tasks.workunit.client.0.smithi037.stdout:3/486: write d0/d43/d23/d7a/d77/f41 [401479,106117] 0 2024-09-19T06:08:46.388 INFO:tasks.workunit.client.0.smithi037.stdout:3/487: write d0/d43/d23/d7a/d77/f2b [1207916,57604] 0 2024-09-19T06:08:46.389 INFO:tasks.workunit.client.0.smithi037.stdout:8/694: mkdir d1/d61/d7e/d8b/d91/dea 0 2024-09-19T06:08:46.395 INFO:tasks.workunit.client.0.smithi037.stdout:1/431: write d2/d12/d1e/f42 [152663,46992] 0 2024-09-19T06:08:46.396 INFO:tasks.workunit.client.0.smithi037.stdout:4/593: dread d0/d6/d1b/f55 [0,4194304] 0 2024-09-19T06:08:46.396 INFO:tasks.workunit.client.0.smithi037.stdout:4/594: read - d0/d6/d1b/d20/d4d/d65/faf zero size 2024-09-19T06:08:46.396 INFO:tasks.workunit.client.0.smithi037.stdout:4/595: chown d0/d8f 832316 1 2024-09-19T06:08:46.396 INFO:tasks.workunit.client.0.smithi037.stdout:4/596: read - d0/d6/d1b/d30/f32 zero size 2024-09-19T06:08:46.397 INFO:tasks.workunit.client.0.smithi037.stdout:6/476: creat d9/dd/d20/d5a/d6d/d82/f92 x:0 0 0 2024-09-19T06:08:46.397 INFO:tasks.workunit.client.0.smithi037.stdout:9/641: creat da/d4d/dbb/fe8 x:0 0 0 2024-09-19T06:08:46.397 INFO:tasks.workunit.client.0.smithi037.stdout:9/642: write da/dd/d1b/d2f/d6f/faf [231265,66406] 0 2024-09-19T06:08:46.400 INFO:tasks.workunit.client.0.smithi037.stdout:5/529: dwrite d2/d10/f19 [0,4194304] 0 2024-09-19T06:08:46.403 INFO:tasks.workunit.client.0.smithi037.stdout:2/571: dread d1/da/dc/d21/d55/f66 [0,4194304] 0 2024-09-19T06:08:46.403 INFO:tasks.workunit.client.0.smithi037.stdout:2/572: write d1/da/dc/d21/d55/f66 [3351998,53164] 0 2024-09-19T06:08:46.403 INFO:tasks.workunit.client.0.smithi037.stdout:8/695: truncate d1/f10 2039042 0 2024-09-19T06:08:46.403 INFO:tasks.workunit.client.0.smithi037.stdout:1/432: creat d2/d12/d1e/d75/d89/f8d x:0 0 0 2024-09-19T06:08:46.406 INFO:tasks.workunit.client.0.smithi037.stdout:4/597: mknod d0/d6/d1b/d20/d4d/d64/cc3 0 2024-09-19T06:08:46.406 INFO:tasks.workunit.client.0.smithi037.stdout:6/477: creat d9/dd/d1c/d73/f93 x:0 0 0 2024-09-19T06:08:46.407 INFO:tasks.workunit.client.0.smithi037.stdout:7/466: dwrite d6/d21/f44 [0,4194304] 0 2024-09-19T06:08:46.407 INFO:tasks.workunit.client.0.smithi037.stdout:7/467: chown d6 269101 1 2024-09-19T06:08:46.407 INFO:tasks.workunit.client.0.smithi037.stdout:7/468: readlink d6/l43 0 2024-09-19T06:08:46.407 INFO:tasks.workunit.client.0.smithi037.stdout:7/469: readlink d6/d20/d4b/d60/d33/d55/d6d/l81 0 2024-09-19T06:08:46.408 INFO:tasks.workunit.client.0.smithi037.stdout:9/643: rename da/dd/d1b/d23/d6a/d8f/da4/de5 to da/dd/d1b/d23/de9 0 2024-09-19T06:08:46.411 INFO:tasks.workunit.client.0.smithi037.stdout:2/573: symlink d1/d6/da3/da8/lca 0 2024-09-19T06:08:46.411 INFO:tasks.workunit.client.0.smithi037.stdout:0/512: dwrite d5/d8/d11/d15/d21/f72 [0,4194304] 0 2024-09-19T06:08:46.412 INFO:tasks.workunit.client.0.smithi037.stdout:8/696: getdents d1/d61/d7e/dbc/dc2/d59 0 2024-09-19T06:08:46.414 INFO:tasks.workunit.client.0.smithi037.stdout:1/433: symlink d2/d12/d1d/l8e 0 2024-09-19T06:08:46.417 INFO:tasks.workunit.client.0.smithi037.stdout:4/598: mkdir d0/d6/d1b/d20/d4d/d64/db0/dc4 0 2024-09-19T06:08:46.422 INFO:tasks.workunit.client.0.smithi037.stdout:6/478: rename d9/dd/l28 to d9/dd/d20/l94 0 2024-09-19T06:08:46.422 INFO:tasks.workunit.client.0.smithi037.stdout:6/479: fdatasync d9/dd/d1c/d4e/f34 0 2024-09-19T06:08:46.422 INFO:tasks.workunit.client.0.smithi037.stdout:6/480: fdatasync d9/dd/d2b/d79/f63 0 2024-09-19T06:08:46.423 INFO:tasks.workunit.client.0.smithi037.stdout:9/644: rmdir da/d4d/dbb 39 2024-09-19T06:08:46.424 INFO:tasks.workunit.client.0.smithi037.stdout:2/574: rmdir d1/da/d6e 39 2024-09-19T06:08:46.424 INFO:tasks.workunit.client.0.smithi037.stdout:0/513: write d5/d8/d11/d32/f43 [7572226,115639] 0 2024-09-19T06:08:46.427 INFO:tasks.workunit.client.0.smithi037.stdout:7/470: dwrite d6/d20/d4b/d60/f75 [0,4194304] 0 2024-09-19T06:08:46.428 INFO:tasks.workunit.client.0.smithi037.stdout:7/471: read - d6/d20/d34/d49/f7c zero size 2024-09-19T06:08:46.428 INFO:tasks.workunit.client.0.smithi037.stdout:8/697: mkdir d1/d61/d7e/d8b/d91/deb 0 2024-09-19T06:08:46.429 INFO:tasks.workunit.client.0.smithi037.stdout:1/434: mkdir d2/d12/d1e/d2a/d8f 0 2024-09-19T06:08:46.429 INFO:tasks.workunit.client.0.smithi037.stdout:4/599: getdents d0/d2/d37/d92 0 2024-09-19T06:08:46.429 INFO:tasks.workunit.client.0.smithi037.stdout:4/600: truncate d0/d6/d1b/d20/d4d/f51 1110531 0 2024-09-19T06:08:46.430 INFO:tasks.workunit.client.0.smithi037.stdout:6/481: symlink d9/dd/d2b/l95 0 2024-09-19T06:08:46.431 INFO:tasks.workunit.client.0.smithi037.stdout:9/645: creat da/dd/d1b/d2f/d6d/fea x:0 0 0 2024-09-19T06:08:46.432 INFO:tasks.workunit.client.0.smithi037.stdout:9/646: stat da/dd/d1b/d23/d6a/d82/l76 0 2024-09-19T06:08:46.432 INFO:tasks.workunit.client.0.smithi037.stdout:9/647: fdatasync da/f5a 0 2024-09-19T06:08:46.433 INFO:tasks.workunit.client.0.smithi037.stdout:0/514: link d5/d8/d11/d15/d21/f29 d5/d42/fb3 0 2024-09-19T06:08:46.433 INFO:tasks.workunit.client.0.smithi037.stdout:0/515: write d5/d42/f50 [431703,78621] 0 2024-09-19T06:08:46.433 INFO:tasks.workunit.client.0.smithi037.stdout:0/516: readlink d5/d8/d11/d15/d21/l59 0 2024-09-19T06:08:46.436 INFO:tasks.workunit.client.0.smithi037.stdout:7/472: creat d6/dc/df/f95 x:0 0 0 2024-09-19T06:08:46.436 INFO:tasks.workunit.client.0.smithi037.stdout:7/473: chown d6/d20/d4b/f5d 0 1 2024-09-19T06:08:46.437 INFO:tasks.workunit.client.0.smithi037.stdout:1/435: truncate d2/d12/d17/f18 2534475 0 2024-09-19T06:08:46.438 INFO:tasks.workunit.client.0.smithi037.stdout:4/601: getdents d0/d2 0 2024-09-19T06:08:46.440 INFO:tasks.workunit.client.0.smithi037.stdout:6/482: creat d9/dd/d1c/d4e/d62/f96 x:0 0 0 2024-09-19T06:08:46.441 INFO:tasks.workunit.client.0.smithi037.stdout:0/517: creat d5/d8/d22/d89/da9/fb4 x:0 0 0 2024-09-19T06:08:46.441 INFO:tasks.workunit.client.0.smithi037.stdout:0/518: chown d5/d8/d11/d32/l54 1044013803 1 2024-09-19T06:08:46.441 INFO:tasks.workunit.client.0.smithi037.stdout:0/519: fsync d5/d20/f7c 0 2024-09-19T06:08:46.442 INFO:tasks.workunit.client.0.smithi037.stdout:0/520: dread - d5/d18/d68/d85/f99 zero size 2024-09-19T06:08:46.444 INFO:tasks.workunit.client.0.smithi037.stdout:8/698: symlink d1/d35/lec 0 2024-09-19T06:08:46.445 INFO:tasks.workunit.client.0.smithi037.stdout:1/436: rmdir d2/d12/d1e/d8a 0 2024-09-19T06:08:46.445 INFO:tasks.workunit.client.0.smithi037.stdout:2/575: dwrite d1/da/dc/d21/d7d/f2e [0,4194304] 0 2024-09-19T06:08:46.446 INFO:tasks.workunit.client.0.smithi037.stdout:6/483: creat d9/dd/d1c/d4e/d33/f97 x:0 0 0 2024-09-19T06:08:46.447 INFO:tasks.workunit.client.0.smithi037.stdout:8/699: link d1/dc7/fe0 d1/d61/d7e/d8b/d91/d3d/fed 0 2024-09-19T06:08:46.449 INFO:tasks.workunit.client.0.smithi037.stdout:1/437: mkdir d2/d12/d15/d34/d90 0 2024-09-19T06:08:46.449 INFO:tasks.workunit.client.0.smithi037.stdout:1/438: write d2/f6 [4095934,12725] 0 2024-09-19T06:08:46.451 INFO:tasks.workunit.client.0.smithi037.stdout:6/484: rename d9/dd/d1c/f58 to d9/f98 0 2024-09-19T06:08:46.451 INFO:tasks.workunit.client.0.smithi037.stdout:6/485: stat d9/d6e/f83 0 2024-09-19T06:08:46.456 INFO:tasks.workunit.client.0.smithi037.stdout:4/602: dread d0/d6/d45/d4a/d86/f9e [0,4194304] 0 2024-09-19T06:08:46.456 INFO:tasks.workunit.client.0.smithi037.stdout:4/603: fsync d0/d2/d37/f5e 0 2024-09-19T06:08:46.456 INFO:tasks.workunit.client.0.smithi037.stdout:1/439: truncate d2/f26 2276123 0 2024-09-19T06:08:46.457 INFO:tasks.workunit.client.0.smithi037.stdout:6/486: mknod d9/dd/d20/d5a/d6d/c99 0 2024-09-19T06:08:46.458 INFO:tasks.workunit.client.0.smithi037.stdout:0/521: read d5/d8/d11/d15/f1c [3694787,1550] 0 2024-09-19T06:08:46.458 INFO:tasks.workunit.client.0.smithi037.stdout:0/522: chown d5/d8/d11/d15/d21/c9e 403451 1 2024-09-19T06:08:46.458 INFO:tasks.workunit.client.0.smithi037.stdout:1/440: mknod d2/d12/d1e/d2a/d8f/c91 0 2024-09-19T06:08:46.460 INFO:tasks.workunit.client.0.smithi037.stdout:6/487: creat d9/d6e/f9a x:0 0 0 2024-09-19T06:08:46.466 INFO:tasks.workunit.client.0.smithi037.stdout:2/576: write d1/da/d95/f97 [2258026,100709] 0 2024-09-19T06:08:46.466 INFO:tasks.workunit.client.0.smithi037.stdout:2/577: write d1/da/dc/d21/d51/f52 [1218293,43750] 0 2024-09-19T06:08:46.466 INFO:tasks.workunit.client.0.smithi037.stdout:2/578: chown d1/da/dc/f59 197435398 1 2024-09-19T06:08:46.466 INFO:tasks.workunit.client.0.smithi037.stdout:7/474: dwrite d6/d20/d34/f93 [0,4194304] 0 2024-09-19T06:08:46.467 INFO:tasks.workunit.client.0.smithi037.stdout:2/579: symlink d1/da/dc/d21/d51/lcb 0 2024-09-19T06:08:46.471 INFO:tasks.workunit.client.0.smithi037.stdout:7/475: creat d6/d20/d4b/d60/d33/d8c/f96 x:0 0 0 2024-09-19T06:08:46.471 INFO:tasks.workunit.client.0.smithi037.stdout:7/476: fsync d6/d20/d4b/d60/d33/f6b 0 2024-09-19T06:08:46.471 INFO:tasks.workunit.client.0.smithi037.stdout:7/477: chown d6/d20/d34/c7f 1670 1 2024-09-19T06:08:46.472 INFO:tasks.workunit.client.0.smithi037.stdout:7/478: dread d6/dc/d22/f5c [0,4194304] 0 2024-09-19T06:08:46.473 INFO:tasks.workunit.client.0.smithi037.stdout:2/580: creat d1/da/dc/d21/d7d/d80/dc7/fcc x:0 0 0 2024-09-19T06:08:46.474 INFO:tasks.workunit.client.0.smithi037.stdout:2/581: write d1/d33/d4c/f53 [2187034,75538] 0 2024-09-19T06:08:46.474 INFO:tasks.workunit.client.0.smithi037.stdout:2/582: read - d1/da/dc/d21/d51/fc5 zero size 2024-09-19T06:08:46.474 INFO:tasks.workunit.client.0.smithi037.stdout:2/583: chown d1/da/dc/d21/d7d/c60 2824 1 2024-09-19T06:08:46.475 INFO:tasks.workunit.client.0.smithi037.stdout:7/479: truncate d6/d20/d71/f79 330540 0 2024-09-19T06:08:46.478 INFO:tasks.workunit.client.0.smithi037.stdout:7/480: mkdir d6/d20/d34/d97 0 2024-09-19T06:08:46.479 INFO:tasks.workunit.client.0.smithi037.stdout:7/481: mknod d6/dc/d22/d59/c98 0 2024-09-19T06:08:46.481 INFO:tasks.workunit.client.0.smithi037.stdout:7/482: mkdir d6/dc/df/d7e/d99 0 2024-09-19T06:08:46.481 INFO:tasks.workunit.client.0.smithi037.stdout:0/523: read d5/fa [2769321,21667] 0 2024-09-19T06:08:46.482 INFO:tasks.workunit.client.0.smithi037.stdout:7/483: rmdir d6/dc 39 2024-09-19T06:08:46.482 INFO:tasks.workunit.client.0.smithi037.stdout:7/484: stat d6/d21/d68/c83 0 2024-09-19T06:08:46.483 INFO:tasks.workunit.client.0.smithi037.stdout:7/485: creat d6/d20/d34/f9a x:0 0 0 2024-09-19T06:08:46.483 INFO:tasks.workunit.client.0.smithi037.stdout:7/486: write d6/dc/d22/f5c [1042836,101221] 0 2024-09-19T06:08:46.483 INFO:tasks.workunit.client.0.smithi037.stdout:7/487: write d6/dc/df/d7e/f88 [603278,126562] 0 2024-09-19T06:08:46.484 INFO:tasks.workunit.client.0.smithi037.stdout:7/488: creat d6/d20/f9b x:0 0 0 2024-09-19T06:08:46.485 INFO:tasks.workunit.client.0.smithi037.stdout:8/700: dwrite d1/d61/d7e/dbc/dc2/daa/fca [0,4194304] 0 2024-09-19T06:08:46.486 INFO:tasks.workunit.client.0.smithi037.stdout:7/489: unlink d6/d20/d34/d49/f7c 0 2024-09-19T06:08:46.488 INFO:tasks.workunit.client.0.smithi037.stdout:1/441: dwrite d2/d12/d15/f58 [0,4194304] 0 2024-09-19T06:08:46.489 INFO:tasks.workunit.client.0.smithi037.stdout:4/604: dwrite d0/d6/d45/d4a/d86/f8a [0,4194304] 0 2024-09-19T06:08:46.489 INFO:tasks.workunit.client.0.smithi037.stdout:0/524: dread d5/d8/d11/f3e [0,4194304] 0 2024-09-19T06:08:46.489 INFO:tasks.workunit.client.0.smithi037.stdout:0/525: fsync d5/d42/f8b 0 2024-09-19T06:08:46.489 INFO:tasks.workunit.client.0.smithi037.stdout:4/605: dread - d0/d6/d45/d4a/d6f/d8e/fbd zero size 2024-09-19T06:08:46.490 INFO:tasks.workunit.client.0.smithi037.stdout:8/701: symlink d1/d8f/da1/lee 0 2024-09-19T06:08:46.492 INFO:tasks.workunit.client.0.smithi037.stdout:7/490: creat d6/d20/d34/f9c x:0 0 0 2024-09-19T06:08:46.492 INFO:tasks.workunit.client.0.smithi037.stdout:7/491: chown d6/d20/d4b 861 1 2024-09-19T06:08:46.493 INFO:tasks.workunit.client.0.smithi037.stdout:6/488: dwrite d9/dd/d1c/f2e [4194304,4194304] 0 2024-09-19T06:08:46.493 INFO:tasks.workunit.client.0.smithi037.stdout:6/489: write d9/dd/d20/d5a/d6d/d82/f84 [514873,62416] 0 2024-09-19T06:08:46.493 INFO:tasks.workunit.client.0.smithi037.stdout:6/490: chown d9/d6e 100873236 1 2024-09-19T06:08:46.496 INFO:tasks.workunit.client.0.smithi037.stdout:1/442: mknod d2/d12/d15/d5c/c92 0 2024-09-19T06:08:46.504 INFO:tasks.workunit.client.0.smithi037.stdout:0/526: dread d5/fa [4194304,4194304] 0 2024-09-19T06:08:46.504 INFO:tasks.workunit.client.0.smithi037.stdout:0/527: dread - d5/d17/fad zero size 2024-09-19T06:08:46.508 INFO:tasks.workunit.client.0.smithi037.stdout:8/702: dread d1/d61/d7b/f99 [0,4194304] 0 2024-09-19T06:08:46.511 INFO:tasks.workunit.client.0.smithi037.stdout:4/606: creat d0/d6/d45/d4a/fc5 x:0 0 0 2024-09-19T06:08:46.512 INFO:tasks.workunit.client.0.smithi037.stdout:1/443: truncate d2/d12/d15/d34/f46 3398449 0 2024-09-19T06:08:46.513 INFO:tasks.workunit.client.0.smithi037.stdout:0/528: creat d5/d8/d11/d15/d21/d4e/fb5 x:0 0 0 2024-09-19T06:08:46.513 INFO:tasks.workunit.client.0.smithi037.stdout:7/492: dread d6/d20/d4b/d60/f75 [0,4194304] 0 2024-09-19T06:08:46.514 INFO:tasks.workunit.client.0.smithi037.stdout:8/703: truncate d1/d61/f89 3484640 0 2024-09-19T06:08:46.514 INFO:tasks.workunit.client.0.smithi037.stdout:8/704: truncate d1/d61/d7e/d8b/d9f/fad 71211 0 2024-09-19T06:08:46.515 INFO:tasks.workunit.client.0.smithi037.stdout:0/529: rmdir d5/d18/d68/d85 39 2024-09-19T06:08:46.515 INFO:tasks.workunit.client.0.smithi037.stdout:6/491: dread d9/dd/d2b/d79/f51 [0,4194304] 0 2024-09-19T06:08:46.516 INFO:tasks.workunit.client.0.smithi037.stdout:6/492: readlink d9/dd/d1c/l30 0 2024-09-19T06:08:46.516 INFO:tasks.workunit.client.0.smithi037.stdout:6/493: stat d9/dd/d2b/f50 0 2024-09-19T06:08:46.517 INFO:tasks.workunit.client.0.smithi037.stdout:8/705: rename d1/d61/d7e/d8b/d91/d3d/f26 to d1/d61/d7e/fef 0 2024-09-19T06:08:46.517 INFO:tasks.workunit.client.0.smithi037.stdout:8/706: readlink d1/d61/l93 0 2024-09-19T06:08:46.517 INFO:tasks.workunit.client.0.smithi037.stdout:8/707: truncate d1/d8f/da1/fda 101967 0 2024-09-19T06:08:46.517 INFO:tasks.workunit.client.0.smithi037.stdout:8/708: fdatasync d1/f1e 0 2024-09-19T06:08:46.518 INFO:tasks.workunit.client.0.smithi037.stdout:6/494: link d9/dd/d1c/l68 d9/dd/d2b/l9b 0 2024-09-19T06:08:46.519 INFO:tasks.workunit.client.0.smithi037.stdout:8/709: creat d1/d61/d7e/d8b/d9f/de4/ff0 x:0 0 0 2024-09-19T06:08:46.525 INFO:tasks.workunit.client.0.smithi037.stdout:8/710: dread d1/d61/d7e/d8b/d91/d3d/f14 [0,4194304] 0 2024-09-19T06:08:46.525 INFO:tasks.workunit.client.0.smithi037.stdout:8/711: truncate d1/d61/d7e/d8b/d91/d3d/f20 1354063 0 2024-09-19T06:08:46.529 INFO:tasks.workunit.client.0.smithi037.stdout:4/607: read d0/d6/d45/d4a/d86/f8a [1200964,80846] 0 2024-09-19T06:08:46.530 INFO:tasks.workunit.client.0.smithi037.stdout:1/444: dread d2/d12/d1e/f42 [0,4194304] 0 2024-09-19T06:08:46.537 INFO:tasks.workunit.client.0.smithi037.stdout:7/493: dread d6/f1d [0,4194304] 0 2024-09-19T06:08:46.537 INFO:tasks.workunit.client.0.smithi037.stdout:0/530: dwrite d5/d8/d11/f16 [0,4194304] 0 2024-09-19T06:08:46.542 INFO:tasks.workunit.client.0.smithi037.stdout:8/712: unlink d1/d61/d7e/dbc/dc2/d59/f5c 0 2024-09-19T06:08:46.542 INFO:tasks.workunit.client.0.smithi037.stdout:6/495: write d9/dd/f5e [1780718,21589] 0 2024-09-19T06:08:46.542 INFO:tasks.workunit.client.0.smithi037.stdout:6/496: chown d9/dd/d1c/d73/l5f 42889558 1 2024-09-19T06:08:46.542 INFO:tasks.workunit.client.0.smithi037.stdout:6/497: stat d9/dd/d20/f48 0 2024-09-19T06:08:46.544 INFO:tasks.workunit.client.0.smithi037.stdout:4/608: truncate d0/d2/f2c 2067978 0 2024-09-19T06:08:46.544 INFO:tasks.workunit.client.0.smithi037.stdout:1/445: creat d2/d12/d1e/d63/f93 x:0 0 0 2024-09-19T06:08:46.544 INFO:tasks.workunit.client.0.smithi037.stdout:7/494: mknod d6/dc/df/d7e/d99/c9d 0 2024-09-19T06:08:46.544 INFO:tasks.workunit.client.0.smithi037.stdout:7/495: fsync d6/d20/d34/f9a 0 2024-09-19T06:08:46.545 INFO:tasks.workunit.client.0.smithi037.stdout:8/713: getdents d1 0 2024-09-19T06:08:46.546 INFO:tasks.workunit.client.0.smithi037.stdout:1/446: write d2/f8 [16447,69734] 0 2024-09-19T06:08:46.547 INFO:tasks.workunit.client.0.smithi037.stdout:1/447: chown d2/f26 0 1 2024-09-19T06:08:46.547 INFO:tasks.workunit.client.0.smithi037.stdout:6/498: mkdir d9/d9c 0 2024-09-19T06:08:46.550 INFO:tasks.workunit.client.0.smithi037.stdout:7/496: creat d6/d20/d34/d7d/f9e x:0 0 0 2024-09-19T06:08:46.550 INFO:tasks.workunit.client.0.smithi037.stdout:7/497: write d6/d20/f6c [562786,129973] 0 2024-09-19T06:08:46.551 INFO:tasks.workunit.client.0.smithi037.stdout:8/714: rename d1/f54 to d1/d61/d68/ff1 0 2024-09-19T06:08:46.552 INFO:tasks.workunit.client.0.smithi037.stdout:7/498: mkdir d6/d20/d4b/d60/d33/d9f 0 2024-09-19T06:08:46.556 INFO:tasks.workunit.client.0.smithi037.stdout:8/715: creat d1/d35/ff2 x:0 0 0 2024-09-19T06:08:46.560 INFO:tasks.workunit.client.0.smithi037.stdout:8/716: creat d1/dc7/ff3 x:0 0 0 2024-09-19T06:08:46.563 INFO:tasks.workunit.client.0.smithi037.stdout:8/717: mkdir d1/d61/d7e/dbc/dc2/df4 0 2024-09-19T06:08:46.565 INFO:tasks.workunit.client.0.smithi037.stdout:8/718: mkdir d1/d61/d7e/dbc/dc0/df5 0 2024-09-19T06:08:46.565 INFO:tasks.workunit.client.0.smithi037.stdout:0/531: dwrite d5/d8/d11/d15/d21/f4b [0,4194304] 0 2024-09-19T06:08:46.566 INFO:tasks.workunit.client.0.smithi037.stdout:1/448: write d2/d12/d1d/f4f [1416958,92859] 0 2024-09-19T06:08:46.568 INFO:tasks.workunit.client.0.smithi037.stdout:1/449: rename d2/d12/f21 to d2/d12/d1e/d75/f94 0 2024-09-19T06:08:46.568 INFO:tasks.workunit.client.0.smithi037.stdout:1/450: stat d2/d12/d15/d34 0 2024-09-19T06:08:46.568 INFO:tasks.workunit.client.0.smithi037.stdout:1/451: readlink d2/d12/l50 0 2024-09-19T06:08:46.575 INFO:tasks.workunit.client.0.smithi037.stdout:4/609: dwrite d0/d2/d2e/d36/f4e [0,4194304] 0 2024-09-19T06:08:46.578 INFO:tasks.workunit.client.0.smithi037.stdout:6/499: dwrite d9/dd/d2b/d42/f49 [0,4194304] 0 2024-09-19T06:08:46.583 INFO:tasks.workunit.client.0.smithi037.stdout:6/500: mknod d9/d16/c9d 0 2024-09-19T06:08:46.585 INFO:tasks.workunit.client.0.smithi037.stdout:6/501: rename d9/dd/d20/c6c to d9/d16/c9e 0 2024-09-19T06:08:46.585 INFO:tasks.workunit.client.0.smithi037.stdout:6/502: truncate d9/dd/d1c/d4e/f7b 652746 0 2024-09-19T06:08:46.585 INFO:tasks.workunit.client.0.smithi037.stdout:6/503: chown d9/dd/d20/d5a/d6d/d82/f84 741 1 2024-09-19T06:08:46.585 INFO:tasks.workunit.client.0.smithi037.stdout:6/504: chown d9/d16/l1e 71 1 2024-09-19T06:08:46.585 INFO:tasks.workunit.client.0.smithi037.stdout:0/532: dread d5/d8/d11/f78 [0,4194304] 0 2024-09-19T06:08:46.587 INFO:tasks.workunit.client.0.smithi037.stdout:0/533: unlink d5/d8/d11/d15/d21/f49 0 2024-09-19T06:08:46.591 INFO:tasks.workunit.client.0.smithi037.stdout:7/499: dread d6/d20/d4b/d60/f31 [0,4194304] 0 2024-09-19T06:08:46.591 INFO:tasks.workunit.client.0.smithi037.stdout:7/500: dread - d6/d20/d4b/d60/f84 zero size 2024-09-19T06:08:46.591 INFO:tasks.workunit.client.0.smithi037.stdout:7/501: write d6/d20/f9b [876736,114722] 0 2024-09-19T06:08:46.593 INFO:tasks.workunit.client.0.smithi037.stdout:4/610: write d0/d2/d37/f49 [1629856,81136] 0 2024-09-19T06:08:46.593 INFO:tasks.workunit.client.0.smithi037.stdout:4/611: fsync d0/d6/f26 0 2024-09-19T06:08:46.593 INFO:tasks.workunit.client.0.smithi037.stdout:7/502: creat d6/d20/d34/d97/fa0 x:0 0 0 2024-09-19T06:08:46.594 INFO:tasks.workunit.client.0.smithi037.stdout:4/612: unlink d0/d6/d1b/f68 0 2024-09-19T06:08:46.595 INFO:tasks.workunit.client.0.smithi037.stdout:7/503: mknod d6/dc/d22/d82/ca1 0 2024-09-19T06:08:46.595 INFO:tasks.workunit.client.0.smithi037.stdout:7/504: dread - d6/d20/d4b/d60/f8b zero size 2024-09-19T06:08:46.597 INFO:tasks.workunit.client.0.smithi037.stdout:7/505: link d6/d21/l54 d6/dc/d7b/la2 0 2024-09-19T06:08:46.597 INFO:tasks.workunit.client.0.smithi037.stdout:7/506: fsync d6/d21/f5f 0 2024-09-19T06:08:46.597 INFO:tasks.workunit.client.0.smithi037.stdout:7/507: fdatasync d6/d20/d4b/d60/f73 0 2024-09-19T06:08:46.597 INFO:tasks.workunit.client.0.smithi037.stdout:7/508: write d6/dc/df/f8f [694826,88757] 0 2024-09-19T06:08:46.597 INFO:tasks.workunit.client.0.smithi037.stdout:7/509: write d6/d20/d34/f9c [900440,129761] 0 2024-09-19T06:08:46.597 INFO:tasks.workunit.client.0.smithi037.stdout:8/719: read d1/d61/d7e/dbc/dc2/daa/fca [1226868,34807] 0 2024-09-19T06:08:46.599 INFO:tasks.workunit.client.0.smithi037.stdout:8/720: creat d1/dc8/ff6 x:0 0 0 2024-09-19T06:08:46.600 INFO:tasks.workunit.client.0.smithi037.stdout:8/721: rename d1/d61/d7e/d8b/d91/l9c to d1/d35/lf7 0 2024-09-19T06:08:46.601 INFO:tasks.workunit.client.0.smithi037.stdout:8/722: truncate d1/f97 455599 0 2024-09-19T06:08:46.602 INFO:tasks.workunit.client.0.smithi037.stdout:8/723: rename d1/d61/d7e/d8b/d91/d3d/f3c to d1/d61/d7b/ff8 0 2024-09-19T06:08:46.607 INFO:tasks.workunit.client.0.smithi037.stdout:6/505: write d9/dd/d2b/f61 [524854,1544] 0 2024-09-19T06:08:46.608 INFO:tasks.workunit.client.0.smithi037.stdout:6/506: read d9/dd/d1c/d4e/f7b [215230,10104] 0 2024-09-19T06:08:46.613 INFO:tasks.workunit.client.0.smithi037.stdout:6/507: dread d9/dd/f22 [0,4194304] 0 2024-09-19T06:08:46.616 INFO:tasks.workunit.client.0.smithi037.stdout:6/508: unlink d9/f98 0 2024-09-19T06:08:46.617 INFO:tasks.workunit.client.0.smithi037.stdout:6/509: rmdir d9/dd/d20/d5a 39 2024-09-19T06:08:46.618 INFO:tasks.workunit.client.0.smithi037.stdout:6/510: mkdir d9/dd/d20/d5a/d6d/d82/d9f 0 2024-09-19T06:08:46.619 INFO:tasks.workunit.client.0.smithi037.stdout:4/613: dwrite d0/d6/d1b/d20/d4d/d64/f99 [0,4194304] 0 2024-09-19T06:08:46.621 INFO:tasks.workunit.client.0.smithi037.stdout:6/511: symlink d9/dd/d1c/la0 0 2024-09-19T06:08:46.621 INFO:tasks.workunit.client.0.smithi037.stdout:6/512: truncate d9/dd/d1c/f41 4503287 0 2024-09-19T06:08:46.622 INFO:tasks.workunit.client.0.smithi037.stdout:8/724: dwrite d1/d61/d7b/ff8 [0,4194304] 0 2024-09-19T06:08:46.622 INFO:tasks.workunit.client.0.smithi037.stdout:8/725: truncate d1/dc7/ff3 638744 0 2024-09-19T06:08:46.622 INFO:tasks.workunit.client.0.smithi037.stdout:8/726: write d1/d35/ff2 [648843,125718] 0 2024-09-19T06:08:46.622 INFO:tasks.workunit.client.0.smithi037.stdout:4/614: rename d0/d2/d37/d92/fa5 to d0/d2/d2e/d36/fc6 0 2024-09-19T06:08:46.624 INFO:tasks.workunit.client.0.smithi037.stdout:6/513: creat d9/dd/d1c/d73/fa1 x:0 0 0 2024-09-19T06:08:46.624 INFO:tasks.workunit.client.0.smithi037.stdout:6/514: fsync d9/dd/d1c/f80 0 2024-09-19T06:08:46.645 INFO:tasks.workunit.client.0.smithi037.stdout:4/615: dread d0/d2/f57 [0,4194304] 0 2024-09-19T06:08:46.648 INFO:tasks.workunit.client.0.smithi037.stdout:4/616: rename d0/d2/f19 to d0/d6/d45/d4a/d6f/da9/fc7 0 2024-09-19T06:08:46.648 INFO:tasks.workunit.client.0.smithi037.stdout:6/515: dread d9/d16/f2a [0,4194304] 0 2024-09-19T06:08:46.648 INFO:tasks.workunit.client.0.smithi037.stdout:8/727: write d1/d61/d7e/fef [1452311,69422] 0 2024-09-19T06:08:46.648 INFO:tasks.workunit.client.0.smithi037.stdout:7/510: dwrite d6/d20/d34/f9c [0,4194304] 0 2024-09-19T06:08:46.649 INFO:tasks.workunit.client.0.smithi037.stdout:7/511: chown d6/d20/c85 3 1 2024-09-19T06:08:46.649 INFO:tasks.workunit.client.0.smithi037.stdout:6/516: creat d9/dd/d1c/d4e/d33/fa2 x:0 0 0 2024-09-19T06:08:46.658 INFO:tasks.workunit.client.0.smithi037.stdout:7/512: symlink d6/d21/d68/la3 0 2024-09-19T06:08:46.658 INFO:tasks.workunit.client.0.smithi037.stdout:7/513: chown d6/d20/d34/d97/fa0 3 1 2024-09-19T06:08:46.660 INFO:tasks.workunit.client.0.smithi037.stdout:4/617: dread d0/d2/d2e/f7e [0,4194304] 0 2024-09-19T06:08:46.661 INFO:tasks.workunit.client.0.smithi037.stdout:4/618: chown d0/d6/d1b/d20/d48 447658 1 2024-09-19T06:08:46.674 INFO:tasks.workunit.client.0.smithi037.stdout:6/517: dread d9/d6e/f83 [0,4194304] 0 2024-09-19T06:08:46.674 INFO:tasks.workunit.client.0.smithi037.stdout:8/728: dwrite d1/d61/d7e/d8b/d91/d3d/f23 [0,4194304] 0 2024-09-19T06:08:46.675 INFO:tasks.workunit.client.0.smithi037.stdout:6/518: creat d9/dd/d2b/fa3 x:0 0 0 2024-09-19T06:08:46.678 INFO:tasks.workunit.client.0.smithi037.stdout:6/519: rename d9/dd/d1c/d4e/d62 to d9/dd/d20/d5a/d6d/d82/d9f/da4 0 2024-09-19T06:08:46.680 INFO:tasks.workunit.client.0.smithi037.stdout:6/520: unlink d9/d16/c1a 0 2024-09-19T06:08:46.683 INFO:tasks.workunit.client.0.smithi037.stdout:7/514: dwrite d6/dc/f2a [0,4194304] 0 2024-09-19T06:08:46.686 INFO:tasks.workunit.client.0.smithi037.stdout:7/515: dread d6/dc/f47 [0,4194304] 0 2024-09-19T06:08:46.687 INFO:tasks.workunit.client.0.smithi037.stdout:7/516: mkdir d6/d21/da4 0 2024-09-19T06:08:46.687 INFO:tasks.workunit.client.0.smithi037.stdout:4/619: dwrite d0/d2/f57 [0,4194304] 0 2024-09-19T06:08:46.687 INFO:tasks.workunit.client.0.smithi037.stdout:8/729: dread d1/d35/ff2 [0,4194304] 0 2024-09-19T06:08:46.687 INFO:tasks.workunit.client.0.smithi037.stdout:8/730: chown d1/d61/d7e 33253759 1 2024-09-19T06:08:46.688 INFO:tasks.workunit.client.0.smithi037.stdout:7/517: rename d6/c37 to d6/d20/d71/ca5 0 2024-09-19T06:08:46.688 INFO:tasks.workunit.client.0.smithi037.stdout:7/518: chown d6/d20/d34/d49 22486887 1 2024-09-19T06:08:46.689 INFO:tasks.workunit.client.0.smithi037.stdout:4/620: rmdir d0/d6/d1b/d5d/dc2 0 2024-09-19T06:08:46.691 INFO:tasks.workunit.client.0.smithi037.stdout:7/519: link d6/d20/d4b/d60/f8b d6/dc/fa6 0 2024-09-19T06:08:46.691 INFO:tasks.workunit.client.0.smithi037.stdout:7/520: chown d6/dc/df/l6e 150 1 2024-09-19T06:08:46.691 INFO:tasks.workunit.client.0.smithi037.stdout:7/521: fdatasync d6/dc/df/f41 0 2024-09-19T06:08:46.691 INFO:tasks.workunit.client.0.smithi037.stdout:7/522: rmdir d6/d20/d4b/d60/d33/d55/d6d 39 2024-09-19T06:08:46.693 INFO:tasks.workunit.client.0.smithi037.stdout:7/523: creat d6/d20/fa7 x:0 0 0 2024-09-19T06:08:46.697 INFO:tasks.workunit.client.0.smithi037.stdout:3/488: sync 2024-09-19T06:08:46.697 INFO:tasks.workunit.client.0.smithi037.stdout:9/648: sync 2024-09-19T06:08:46.697 INFO:tasks.workunit.client.0.smithi037.stdout:2/584: sync 2024-09-19T06:08:46.697 INFO:tasks.workunit.client.0.smithi037.stdout:5/530: sync 2024-09-19T06:08:46.697 INFO:tasks.workunit.client.0.smithi037.stdout:9/649: stat da/dd/d1b/d2f/d6d 0 2024-09-19T06:08:46.697 INFO:tasks.workunit.client.0.smithi037.stdout:3/489: fsync d0/f7 0 2024-09-19T06:08:46.697 INFO:tasks.workunit.client.0.smithi037.stdout:3/490: dread - d0/d43/d23/f6d zero size 2024-09-19T06:08:46.698 INFO:tasks.workunit.client.0.smithi037.stdout:2/585: write d1/da/dc/d21/d7d/dab/f56 [299128,3271] 0 2024-09-19T06:08:46.698 INFO:tasks.workunit.client.0.smithi037.stdout:2/586: stat d1/da/dc/d21/d7d/c60 0 2024-09-19T06:08:46.707 INFO:tasks.workunit.client.0.smithi037.stdout:8/731: dread d1/d61/d7e/d8b/d91/f3b [8388608,4194304] 0 2024-09-19T06:08:46.723 INFO:tasks.workunit.client.0.smithi037.stdout:3/491: dwrite d0/d43/d23/d7a/fa8 [0,4194304] 0 2024-09-19T06:08:46.725 INFO:tasks.workunit.client.0.smithi037.stdout:9/650: dwrite da/dd/d1b/d43/f5f [0,4194304] 0 2024-09-19T06:08:46.725 INFO:tasks.workunit.client.0.smithi037.stdout:2/587: dread d1/da/dc/d21/f67 [0,4194304] 0 2024-09-19T06:08:46.725 INFO:tasks.workunit.client.0.smithi037.stdout:2/588: stat d1/da/dc/d21/d7d/dab/f50 0 2024-09-19T06:08:46.725 INFO:tasks.workunit.client.0.smithi037.stdout:3/492: creat d0/d16/d19/fad x:0 0 0 2024-09-19T06:08:46.725 INFO:tasks.workunit.client.0.smithi037.stdout:4/621: dwrite d0/d6/d45/d4a/f84 [4194304,4194304] 0 2024-09-19T06:08:46.725 INFO:tasks.workunit.client.0.smithi037.stdout:3/493: write d0/d43/f7f [986436,117578] 0 2024-09-19T06:08:46.727 INFO:tasks.workunit.client.0.smithi037.stdout:9/651: mknod da/dd/d1b/d23/dbe/ceb 0 2024-09-19T06:08:46.727 INFO:tasks.workunit.client.0.smithi037.stdout:8/732: write d1/d61/d7e/d8b/d91/d3d/f22 [8337629,64586] 0 2024-09-19T06:08:46.727 INFO:tasks.workunit.client.0.smithi037.stdout:9/652: write da/dd/d1b/d23/d6a/d85/f97 [2389898,80917] 0 2024-09-19T06:08:46.729 INFO:tasks.workunit.client.0.smithi037.stdout:3/494: creat d0/d43/d23/d7a/fae x:0 0 0 2024-09-19T06:08:46.732 INFO:tasks.workunit.client.0.smithi037.stdout:3/495: dread d0/d16/d19/d33/fac [0,4194304] 0 2024-09-19T06:08:46.732 INFO:tasks.workunit.client.0.smithi037.stdout:3/496: chown d0/d5f 2 1 2024-09-19T06:08:46.732 INFO:tasks.workunit.client.0.smithi037.stdout:3/497: truncate d0/d43/d23/f72 70768 0 2024-09-19T06:08:46.732 INFO:tasks.workunit.client.0.smithi037.stdout:8/733: creat d1/d61/d7e/ff9 x:0 0 0 2024-09-19T06:08:46.734 INFO:tasks.workunit.client.0.smithi037.stdout:8/734: truncate d1/d61/d7e/d8b/d91/d3d/f16 898001 0 2024-09-19T06:08:46.736 INFO:tasks.workunit.client.0.smithi037.stdout:8/735: mknod d1/d6a/cfa 0 2024-09-19T06:08:46.739 INFO:tasks.workunit.client.0.smithi037.stdout:4/622: write d0/f44 [2066823,3790] 0 2024-09-19T06:08:46.740 INFO:tasks.workunit.client.0.smithi037.stdout:4/623: creat d0/d6/d1b/d20/d4d/d64/db0/dc4/fc8 x:0 0 0 2024-09-19T06:08:46.741 INFO:tasks.workunit.client.0.smithi037.stdout:4/624: truncate d0/d2/d37/d46/f9c 828597 0 2024-09-19T06:08:46.742 INFO:tasks.workunit.client.0.smithi037.stdout:4/625: creat d0/fc9 x:0 0 0 2024-09-19T06:08:46.743 INFO:tasks.workunit.client.0.smithi037.stdout:4/626: mknod d0/d6/d1b/d20/cca 0 2024-09-19T06:08:46.752 INFO:tasks.workunit.client.0.smithi037.stdout:8/736: dread d1/d35/f56 [0,4194304] 0 2024-09-19T06:08:46.752 INFO:tasks.workunit.client.0.smithi037.stdout:8/737: chown d1/d35/fb4 582113543 1 2024-09-19T06:08:46.754 INFO:tasks.workunit.client.0.smithi037.stdout:3/498: dwrite d0/d16/d19/d33/fac [0,4194304] 0 2024-09-19T06:08:46.757 INFO:tasks.workunit.client.0.smithi037.stdout:3/499: rename d0/d16/d19/d1d/f2d to d0/d16/d19/d1d/d82/d86/faf 0 2024-09-19T06:08:46.769 INFO:tasks.workunit.client.0.smithi037.stdout:4/627: dwrite d0/d6/f67 [4194304,4194304] 0 2024-09-19T06:08:46.769 INFO:tasks.workunit.client.0.smithi037.stdout:4/628: mknod d0/d6/d1b/d20/d77/ccb 0 2024-09-19T06:08:46.769 INFO:tasks.workunit.client.0.smithi037.stdout:4/629: fdatasync d0/d6/d45/d4a/d86/f9e 0 2024-09-19T06:08:46.770 INFO:tasks.workunit.client.0.smithi037.stdout:4/630: symlink d0/d6/d1b/lcc 0 2024-09-19T06:08:46.773 INFO:tasks.workunit.client.0.smithi037.stdout:8/738: dread d1/d61/d7e/dbc/dc2/d59/d5d/f7c [0,4194304] 0 2024-09-19T06:08:46.780 INFO:tasks.workunit.client.0.smithi037.stdout:3/500: dwrite d0/d16/d19/d33/f9d [0,4194304] 0 2024-09-19T06:08:46.786 INFO:tasks.workunit.client.0.smithi037.stdout:1/452: sync 2024-09-19T06:08:46.786 INFO:tasks.workunit.client.0.smithi037.stdout:0/534: sync 2024-09-19T06:08:46.787 INFO:tasks.workunit.client.0.smithi037.stdout:4/631: read d0/d2/d2e/d36/f63 [3647505,8196] 0 2024-09-19T06:08:46.787 INFO:tasks.workunit.client.0.smithi037.stdout:1/453: unlink d2/d12/d1d/d47/f80 0 2024-09-19T06:08:46.789 INFO:tasks.workunit.client.0.smithi037.stdout:4/632: rename d0/d6/d45/d4a/d6f/da9/fc7 to d0/d6/d1b/d20/d4d/d65/fcd 0 2024-09-19T06:08:46.789 INFO:tasks.workunit.client.0.smithi037.stdout:8/739: read d1/d61/d7e/dbc/dc2/d59/daf/fb3 [1367458,50176] 0 2024-09-19T06:08:46.789 INFO:tasks.workunit.client.0.smithi037.stdout:8/740: creat d1/dc8/ffb x:0 0 0 2024-09-19T06:08:46.790 INFO:tasks.workunit.client.0.smithi037.stdout:1/454: mkdir d2/d12/d15/d95 0 2024-09-19T06:08:46.790 INFO:tasks.workunit.client.0.smithi037.stdout:1/455: rename d2 to d2/d48/d96 22 2024-09-19T06:08:46.791 INFO:tasks.workunit.client.0.smithi037.stdout:8/741: mkdir d1/d61/d7e/dbc/dc2/d59/d5d/dfc 0 2024-09-19T06:08:46.791 INFO:tasks.workunit.client.0.smithi037.stdout:8/742: stat d1/d61/d7e/dbc/dc2/d9b 0 2024-09-19T06:08:46.801 INFO:tasks.workunit.client.0.smithi037.stdout:3/501: dread d0/d16/d19/d33/f38 [0,4194304] 0 2024-09-19T06:08:46.801 INFO:tasks.workunit.client.0.smithi037.stdout:3/502: getdents d0/d43/d23/d7a/d77/d51 0 2024-09-19T06:08:46.801 INFO:tasks.workunit.client.0.smithi037.stdout:3/503: rmdir d0/d43 39 2024-09-19T06:08:46.809 INFO:tasks.workunit.client.0.smithi037.stdout:1/456: dwrite d2/f38 [0,4194304] 0 2024-09-19T06:08:46.809 INFO:tasks.workunit.client.0.smithi037.stdout:1/457: dread - d2/d48/f6d zero size 2024-09-19T06:08:46.813 INFO:tasks.workunit.client.0.smithi037.stdout:1/458: dread d2/d12/d1d/d47/f68 [0,4194304] 0 2024-09-19T06:08:46.816 INFO:tasks.workunit.client.0.smithi037.stdout:3/504: write d0/d16/f88 [2235506,124681] 0 2024-09-19T06:08:46.817 INFO:tasks.workunit.client.0.smithi037.stdout:3/505: creat d0/d16/d19/d1d/d7c/fb0 x:0 0 0 2024-09-19T06:08:46.818 INFO:tasks.workunit.client.0.smithi037.stdout:3/506: truncate d0/d16/f71 866707 0 2024-09-19T06:08:46.818 INFO:tasks.workunit.client.0.smithi037.stdout:3/507: rmdir d0/d16/d19 39 2024-09-19T06:08:46.819 INFO:tasks.workunit.client.0.smithi037.stdout:3/508: link d0/d43/d23/d7a/d77/d62/f90 d0/d5f/da0/fb1 0 2024-09-19T06:08:46.819 INFO:tasks.workunit.client.0.smithi037.stdout:3/509: stat d0/d43/d23/d7a/d77/c4b 0 2024-09-19T06:08:46.819 INFO:tasks.workunit.client.0.smithi037.stdout:3/510: fdatasync d0/d16/d19/d1d/f3d 0 2024-09-19T06:08:46.819 INFO:tasks.workunit.client.0.smithi037.stdout:3/511: fsync d0/d16/d19/fad 0 2024-09-19T06:08:46.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:08:46 smithi037 ceph-mon[31211]: pgmap v427: 129 pgs: 129 active+clean; 656 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 63 MiB/s rd, 77 MiB/s wr, 179 op/s 2024-09-19T06:08:46.832 INFO:tasks.workunit.client.0.smithi037.stdout:3/512: dread d0/d16/d19/f28 [0,4194304] 0 2024-09-19T06:08:46.832 INFO:tasks.workunit.client.0.smithi037.stdout:3/513: chown d0/d5f/da0 3439169 1 2024-09-19T06:08:46.833 INFO:tasks.workunit.client.0.smithi037.stdout:1/459: dwrite d2/d12/d1e/d2d/f85 [0,4194304] 0 2024-09-19T06:08:46.835 INFO:tasks.workunit.client.0.smithi037.stdout:1/460: truncate d2/f4 5287169 0 2024-09-19T06:08:46.836 INFO:tasks.workunit.client.0.smithi037.stdout:1/461: write d2/d12/d1d/f1f [828491,97166] 0 2024-09-19T06:08:46.848 INFO:tasks.workunit.client.0.smithi037.stdout:3/514: dread d0/d43/f5b [4194304,4194304] 0 2024-09-19T06:08:46.849 INFO:tasks.workunit.client.0.smithi037.stdout:3/515: stat d0/d16/d19/d1d/f3d 0 2024-09-19T06:08:46.849 INFO:tasks.workunit.client.0.smithi037.stdout:3/516: rmdir d0/d5f/d70 39 2024-09-19T06:08:46.852 INFO:tasks.workunit.client.0.smithi037.stdout:1/462: dread d2/d12/f44 [4194304,4194304] 0 2024-09-19T06:08:46.852 INFO:tasks.workunit.client.0.smithi037.stdout:1/463: mkdir d2/d12/d1e/d2a/d97 0 2024-09-19T06:08:46.857 INFO:tasks.workunit.client.0.smithi037.stdout:3/517: dread d0/d16/d19/d1d/d5e/f83 [0,4194304] 0 2024-09-19T06:08:46.857 INFO:tasks.workunit.client.0.smithi037.stdout:3/518: chown d0/d43/d23/d7a/d77/c4b 108058 1 2024-09-19T06:08:46.857 INFO:tasks.workunit.client.0.smithi037.stdout:3/519: truncate d0/d43/d23/d7a/d77/f3e 1782392 0 2024-09-19T06:08:46.859 INFO:tasks.workunit.client.0.smithi037.stdout:3/520: link d0/d43/f7f d0/d16/d19/fb2 0 2024-09-19T06:08:46.859 INFO:tasks.workunit.client.0.smithi037.stdout:3/521: truncate d0/d16/f9e 1029472 0 2024-09-19T06:08:46.859 INFO:tasks.workunit.client.0.smithi037.stdout:3/522: write d0/d43/d23/d7a/d77/f41 [1058354,53002] 0 2024-09-19T06:08:46.861 INFO:tasks.workunit.client.0.smithi037.stdout:3/523: truncate d0/f9 2374312 0 2024-09-19T06:08:46.862 INFO:tasks.workunit.client.0.smithi037.stdout:3/524: creat d0/d43/d26/fb3 x:0 0 0 2024-09-19T06:08:46.863 INFO:tasks.workunit.client.0.smithi037.stdout:3/525: mknod d0/d16/d19/d1d/d5e/da9/cb4 0 2024-09-19T06:08:46.865 INFO:tasks.workunit.client.0.smithi037.stdout:3/526: mkdir d0/d16/d19/d1d/d5e/da9/db5 0 2024-09-19T06:08:46.867 INFO:tasks.workunit.client.0.smithi037.stdout:3/527: rmdir d0/d16/d19/d1d/d5e/d61 39 2024-09-19T06:08:46.868 INFO:tasks.workunit.client.0.smithi037.stdout:3/528: write d0/d43/d23/d7a/d77/d51/f76 [588260,66100] 0 2024-09-19T06:08:46.872 INFO:tasks.workunit.client.0.smithi037.stdout:1/464: dwrite d2/d12/d1e/d2a/f60 [0,4194304] 0 2024-09-19T06:08:46.872 INFO:tasks.workunit.client.0.smithi037.stdout:1/465: fsync d2/d12/d1e/f4e 0 2024-09-19T06:08:46.875 INFO:tasks.workunit.client.0.smithi037.stdout:1/466: rename d2/d12/d17/c1c to d2/d12/d15/d34/d90/c98 0 2024-09-19T06:08:46.875 INFO:tasks.workunit.client.0.smithi037.stdout:1/467: write d2/d12/d1e/d2d/f74 [446516,73170] 0 2024-09-19T06:08:46.875 INFO:tasks.workunit.client.0.smithi037.stdout:3/529: dread d0/d16/d19/fb2 [0,4194304] 0 2024-09-19T06:08:46.875 INFO:tasks.workunit.client.0.smithi037.stdout:1/468: rmdir d2/d73 39 2024-09-19T06:08:46.877 INFO:tasks.workunit.client.0.smithi037.stdout:3/530: unlink d0/d16/d19/c32 0 2024-09-19T06:08:46.877 INFO:tasks.workunit.client.0.smithi037.stdout:3/531: write d0/d16/f88 [2759486,8796] 0 2024-09-19T06:08:46.879 INFO:tasks.workunit.client.0.smithi037.stdout:3/532: rename d0/d43/d37/f73 to d0/d5f/fb6 0 2024-09-19T06:08:46.880 INFO:tasks.workunit.client.0.smithi037.stdout:3/533: creat d0/d16/d19/d1d/d5e/d61/fb7 x:0 0 0 2024-09-19T06:08:46.880 INFO:tasks.workunit.client.0.smithi037.stdout:3/534: readlink d0/d43/d26/la2 0 2024-09-19T06:08:46.895 INFO:tasks.workunit.client.0.smithi037.stdout:3/535: write d0/d16/f30 [3409056,78583] 0 2024-09-19T06:08:46.895 INFO:tasks.workunit.client.0.smithi037.stdout:3/536: read d0/d16/f30 [1484928,80748] 0 2024-09-19T06:08:46.896 INFO:tasks.workunit.client.0.smithi037.stdout:3/537: rmdir d0/d43/d26 39 2024-09-19T06:08:46.896 INFO:tasks.workunit.client.0.smithi037.stdout:1/469: dread d2/d12/d1e/d2d/f3c [0,4194304] 0 2024-09-19T06:08:46.897 INFO:tasks.workunit.client.0.smithi037.stdout:1/470: creat d2/d12/d1e/d2a/d97/f99 x:0 0 0 2024-09-19T06:08:46.900 INFO:tasks.workunit.client.0.smithi037.stdout:1/471: mknod d2/d12/d1e/d63/c9a 0 2024-09-19T06:08:46.900 INFO:tasks.workunit.client.0.smithi037.stdout:1/472: stat d2/d12/d1e/d63/c9a 0 2024-09-19T06:08:46.901 INFO:tasks.workunit.client.0.smithi037.stdout:1/473: creat d2/d48/f9b x:0 0 0 2024-09-19T06:08:46.902 INFO:tasks.workunit.client.0.smithi037.stdout:1/474: getdents d2/d12/d1e/d2d/d87 0 2024-09-19T06:08:46.906 INFO:tasks.workunit.client.0.smithi037.stdout:0/535: sync 2024-09-19T06:08:46.906 INFO:tasks.workunit.client.0.smithi037.stdout:7/524: sync 2024-09-19T06:08:46.906 INFO:tasks.workunit.client.0.smithi037.stdout:9/653: sync 2024-09-19T06:08:46.907 INFO:tasks.workunit.client.0.smithi037.stdout:8/743: sync 2024-09-19T06:08:46.907 INFO:tasks.workunit.client.0.smithi037.stdout:0/536: fdatasync d5/d8/d44/d48/f65 0 2024-09-19T06:08:46.907 INFO:tasks.workunit.client.0.smithi037.stdout:0/537: chown d5/d8/d11/d15 107366611 1 2024-09-19T06:08:46.907 INFO:tasks.workunit.client.0.smithi037.stdout:0/538: chown d5/d8/d44/f51 1004 1 2024-09-19T06:08:46.907 INFO:tasks.workunit.client.0.smithi037.stdout:9/654: write da/dd/d1b/d23/de9/fcd [161213,42579] 0 2024-09-19T06:08:46.907 INFO:tasks.workunit.client.0.smithi037.stdout:8/744: write d1/d61/d7e/fef [544378,107614] 0 2024-09-19T06:08:46.907 INFO:tasks.workunit.client.0.smithi037.stdout:9/655: dread - da/dd/d63/d80/dc4/fe0 zero size 2024-09-19T06:08:46.907 INFO:tasks.workunit.client.0.smithi037.stdout:0/539: write d5/d18/d68/d85/f99 [453511,43302] 0 2024-09-19T06:08:46.907 INFO:tasks.workunit.client.0.smithi037.stdout:9/656: dread - da/dd/d1b/d23/d6a/d8f/dac/fe3 zero size 2024-09-19T06:08:46.907 INFO:tasks.workunit.client.0.smithi037.stdout:9/657: chown da/dd/c14 441450114 1 2024-09-19T06:08:46.907 INFO:tasks.workunit.client.0.smithi037.stdout:2/589: sync 2024-09-19T06:08:46.908 INFO:tasks.workunit.client.0.smithi037.stdout:5/531: sync 2024-09-19T06:08:46.908 INFO:tasks.workunit.client.0.smithi037.stdout:6/521: sync 2024-09-19T06:08:46.908 INFO:tasks.workunit.client.0.smithi037.stdout:4/633: sync 2024-09-19T06:08:46.908 INFO:tasks.workunit.client.0.smithi037.stdout:3/538: dread d0/f17 [0,4194304] 0 2024-09-19T06:08:46.908 INFO:tasks.workunit.client.0.smithi037.stdout:7/525: dread d6/d20/d4b/d60/f73 [0,4194304] 0 2024-09-19T06:08:46.912 INFO:tasks.workunit.client.0.smithi037.stdout:6/522: link d9/dd/d2b/fa3 d9/d6e/fa5 0 2024-09-19T06:08:46.912 INFO:tasks.workunit.client.0.smithi037.stdout:4/634: link d0/f53 d0/d6/d1b/d20/d77/fce 0 2024-09-19T06:08:46.912 INFO:tasks.workunit.client.0.smithi037.stdout:9/658: mkdir da/dec 0 2024-09-19T06:08:46.912 INFO:tasks.workunit.client.0.smithi037.stdout:9/659: read - da/dd/d1b/d23/dbe/fdf zero size 2024-09-19T06:08:46.912 INFO:tasks.workunit.client.0.smithi037.stdout:2/590: truncate d1/d16/f1c 1186404 0 2024-09-19T06:08:46.913 INFO:tasks.workunit.client.0.smithi037.stdout:0/540: getdents d5/d8/d11/d15/d21/d4e 0 2024-09-19T06:08:46.914 INFO:tasks.workunit.client.0.smithi037.stdout:8/745: truncate d1/f24 2847422 0 2024-09-19T06:08:46.916 INFO:tasks.workunit.client.0.smithi037.stdout:7/526: mkdir d6/dc/d22/d59/da8 0 2024-09-19T06:08:46.919 INFO:tasks.workunit.client.0.smithi037.stdout:6/523: rename d9/dd/d2b/f37 to d9/dd/d20/d5a/d6d/d82/fa6 0 2024-09-19T06:08:46.921 INFO:tasks.workunit.client.0.smithi037.stdout:0/541: truncate d5/d8/d11/d15/d21/f29 4098949 0 2024-09-19T06:08:46.922 INFO:tasks.workunit.client.0.smithi037.stdout:7/527: symlink d6/d20/d34/d49/la9 0 2024-09-19T06:08:46.924 INFO:tasks.workunit.client.0.smithi037.stdout:9/660: rename da/dd/d1b/d2f/d38 to da/dd/d1b/d2f/d6d/db4/ded 0 2024-09-19T06:08:46.926 INFO:tasks.workunit.client.0.smithi037.stdout:6/524: link d9/d16/l77 d9/dd/la7 0 2024-09-19T06:08:46.926 INFO:tasks.workunit.client.0.smithi037.stdout:6/525: write d9/dd/d20/d5a/d6d/d82/f92 [772545,21251] 0 2024-09-19T06:08:46.926 INFO:tasks.workunit.client.0.smithi037.stdout:4/635: dread d0/d2/d2e/f43 [0,4194304] 0 2024-09-19T06:08:46.926 INFO:tasks.workunit.client.0.smithi037.stdout:4/636: write d0/d2/d2e/d36/f63 [5659420,82106] 0 2024-09-19T06:08:46.926 INFO:tasks.workunit.client.0.smithi037.stdout:4/637: write d0/d2/d37/d92/fa4 [497496,31796] 0 2024-09-19T06:08:46.926 INFO:tasks.workunit.client.0.smithi037.stdout:0/542: symlink d5/d8/d44/d61/lb6 0 2024-09-19T06:08:46.927 INFO:tasks.workunit.client.0.smithi037.stdout:0/543: dread - d5/d8/d44/f71 zero size 2024-09-19T06:08:46.927 INFO:tasks.workunit.client.0.smithi037.stdout:8/746: rename d1/d61/d7b/ff8 to d1/d61/d7e/d8b/d9f/de4/ffd 0 2024-09-19T06:08:46.929 INFO:tasks.workunit.client.0.smithi037.stdout:6/526: creat d9/fa8 x:0 0 0 2024-09-19T06:08:46.929 INFO:tasks.workunit.client.0.smithi037.stdout:4/638: dread d0/d6/d1b/d20/d48/f9b [0,4194304] 0 2024-09-19T06:08:46.929 INFO:tasks.workunit.client.0.smithi037.stdout:4/639: write d0/d6/d1b/d20/d4d/d65/f7b [920653,46940] 0 2024-09-19T06:08:46.930 INFO:tasks.workunit.client.0.smithi037.stdout:0/544: creat d5/d18/d68/d85/fb7 x:0 0 0 2024-09-19T06:08:46.931 INFO:tasks.workunit.client.0.smithi037.stdout:7/528: rename d6/f38 to d6/dc/d22/d59/da8/faa 0 2024-09-19T06:08:46.934 INFO:tasks.workunit.client.0.smithi037.stdout:0/545: unlink d5/d8/d22/d89/da9/fb4 0 2024-09-19T06:08:46.935 INFO:tasks.workunit.client.0.smithi037.stdout:7/529: creat d6/d20/d4b/d60/d33/fab x:0 0 0 2024-09-19T06:08:46.936 INFO:tasks.workunit.client.0.smithi037.stdout:8/747: symlink d1/d8f/lfe 0 2024-09-19T06:08:46.938 INFO:tasks.workunit.client.0.smithi037.stdout:0/546: rmdir d5/d8/d44/d61 39 2024-09-19T06:08:46.938 INFO:tasks.workunit.client.0.smithi037.stdout:0/547: write d5/d20/d34/f91 [525877,62742] 0 2024-09-19T06:08:46.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:08:46 smithi099 ceph-mon[35300]: pgmap v427: 129 pgs: 129 active+clean; 656 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 63 MiB/s rd, 77 MiB/s wr, 179 op/s 2024-09-19T06:08:46.939 INFO:tasks.workunit.client.0.smithi037.stdout:7/530: mkdir d6/d20/d4b/d60/d33/dac 0 2024-09-19T06:08:46.940 INFO:tasks.workunit.client.0.smithi037.stdout:8/748: symlink d1/d61/d7e/dbc/dc2/d59/d5d/dfc/lff 0 2024-09-19T06:08:46.946 INFO:tasks.workunit.client.0.smithi037.stdout:5/532: dwrite d2/d12/d24/d58/d7f/fa5 [0,4194304] 0 2024-09-19T06:08:46.946 INFO:tasks.workunit.client.0.smithi037.stdout:9/661: dread da/dd/d63/f90 [0,4194304] 0 2024-09-19T06:08:46.946 INFO:tasks.workunit.client.0.smithi037.stdout:5/533: chown d2/d12/d28/d22/f3c 467 1 2024-09-19T06:08:46.947 INFO:tasks.workunit.client.0.smithi037.stdout:0/548: mknod d5/d8/d44/d48/daf/cb8 0 2024-09-19T06:08:46.947 INFO:tasks.workunit.client.0.smithi037.stdout:0/549: chown d5/d8/d79 2197 1 2024-09-19T06:08:46.947 INFO:tasks.workunit.client.0.smithi037.stdout:8/749: creat d1/d61/d7e/d8b/d91/d3d/d66/f100 x:0 0 0 2024-09-19T06:08:46.950 INFO:tasks.workunit.client.0.smithi037.stdout:9/662: mknod da/dd/d1b/d23/d6a/d82/cee 0 2024-09-19T06:08:46.950 INFO:tasks.workunit.client.0.smithi037.stdout:9/663: truncate da/dd/d1b/d23/d6a/d8f/dac/fb5 791614 0 2024-09-19T06:08:46.950 INFO:tasks.workunit.client.0.smithi037.stdout:0/550: creat d5/d8/d79/fb9 x:0 0 0 2024-09-19T06:08:46.952 INFO:tasks.workunit.client.0.smithi037.stdout:8/750: rename d1/d61/d68/da3/dd8 to d1/d8f/d101 0 2024-09-19T06:08:46.952 INFO:tasks.workunit.client.0.smithi037.stdout:8/751: stat d1/d61/d7e/d8b/d91/c48 0 2024-09-19T06:08:46.955 INFO:tasks.workunit.client.0.smithi037.stdout:0/551: unlink d5/d42/f62 0 2024-09-19T06:08:46.955 INFO:tasks.workunit.client.0.smithi037.stdout:0/552: readlink d5/d8/d22/l53 0 2024-09-19T06:08:46.956 INFO:tasks.workunit.client.0.smithi037.stdout:0/553: truncate d5/d8/d11/d15/d21/d4e/fb5 769997 0 2024-09-19T06:08:46.958 INFO:tasks.workunit.client.0.smithi037.stdout:9/664: rename da/dd/fc9 to da/dd/d1b/d2f/dcc/de7/fef 0 2024-09-19T06:08:46.959 INFO:tasks.workunit.client.0.smithi037.stdout:8/752: creat d1/d61/d7e/dbc/dd0/f102 x:0 0 0 2024-09-19T06:08:46.959 INFO:tasks.workunit.client.0.smithi037.stdout:8/753: chown d1/d61/d7e/l83 1 1 2024-09-19T06:08:46.959 INFO:tasks.workunit.client.0.smithi037.stdout:8/754: chown d1/d6a/c82 5814 1 2024-09-19T06:08:46.960 INFO:tasks.workunit.client.0.smithi037.stdout:8/755: rename d1/d35/lf7 to d1/d61/d7e/d8b/d91/d3d/l103 0 2024-09-19T06:08:46.964 INFO:tasks.workunit.client.0.smithi037.stdout:4/640: dwrite d0/d6/d1b/d20/d4d/f51 [0,4194304] 0 2024-09-19T06:08:46.964 INFO:tasks.workunit.client.0.smithi037.stdout:4/641: fsync d0/d2/d2e/d36/f4e 0 2024-09-19T06:08:46.964 INFO:tasks.workunit.client.0.smithi037.stdout:4/642: write d0/d6/d45/d4a/d6f/d8e/fbd [632857,99553] 0 2024-09-19T06:08:46.966 INFO:tasks.workunit.client.0.smithi037.stdout:5/534: dread d2/d12/d28/d22/d35/fa0 [0,4194304] 0 2024-09-19T06:08:46.966 INFO:tasks.workunit.client.0.smithi037.stdout:6/527: dwrite d9/dd/d1c/f47 [0,4194304] 0 2024-09-19T06:08:46.966 INFO:tasks.workunit.client.0.smithi037.stdout:0/554: dread d5/d17/f5f [0,4194304] 0 2024-09-19T06:08:46.966 INFO:tasks.workunit.client.0.smithi037.stdout:4/643: link d0/d6/d1b/f5f d0/d2/d37/d46/fcf 0 2024-09-19T06:08:46.971 INFO:tasks.workunit.client.0.smithi037.stdout:6/528: mkdir d9/dd/d20/d5a/d6d/d82/da9 0 2024-09-19T06:08:46.971 INFO:tasks.workunit.client.0.smithi037.stdout:7/531: dwrite d6/f8a [0,4194304] 0 2024-09-19T06:08:46.972 INFO:tasks.workunit.client.0.smithi037.stdout:9/665: dread da/dd/d1b/d2f/d6d/fcf [0,4194304] 0 2024-09-19T06:08:46.972 INFO:tasks.workunit.client.0.smithi037.stdout:9/666: chown da/dd/d1b/d23/de9/fcd 259854443 1 2024-09-19T06:08:46.972 INFO:tasks.workunit.client.0.smithi037.stdout:4/644: truncate d0/f44 781832 0 2024-09-19T06:08:46.973 INFO:tasks.workunit.client.0.smithi037.stdout:5/535: dread d2/d12/d28/f29 [0,4194304] 0 2024-09-19T06:08:46.974 INFO:tasks.workunit.client.0.smithi037.stdout:6/529: rename d9/dd/d2b/c2c to d9/dd/caa 0 2024-09-19T06:08:46.974 INFO:tasks.workunit.client.0.smithi037.stdout:6/530: stat d9/dd/d2b/f50 0 2024-09-19T06:08:46.975 INFO:tasks.workunit.client.0.smithi037.stdout:8/756: write d1/d61/d7e/dbc/dc2/d59/d5d/f7c [2486907,99565] 0 2024-09-19T06:08:46.975 INFO:tasks.workunit.client.0.smithi037.stdout:8/757: getdents d1/d61/dd5 0 2024-09-19T06:08:46.976 INFO:tasks.workunit.client.0.smithi037.stdout:7/532: mkdir d6/dad 0 2024-09-19T06:08:46.976 INFO:tasks.workunit.client.0.smithi037.stdout:7/533: stat d6/d20/d4b/d60/d33/c39 0 2024-09-19T06:08:46.976 INFO:tasks.workunit.client.0.smithi037.stdout:9/667: creat da/dd/d1b/d2f/d6d/db4/ff0 x:0 0 0 2024-09-19T06:08:46.977 INFO:tasks.workunit.client.0.smithi037.stdout:6/531: truncate d9/d16/f26 4905493 0 2024-09-19T06:08:46.979 INFO:tasks.workunit.client.0.smithi037.stdout:8/758: rename d1/d61/d7e/dbc/dc2/daa/ld2 to d1/d61/dd5/l104 0 2024-09-19T06:08:46.981 INFO:tasks.workunit.client.0.smithi037.stdout:7/534: getdents d6/d20/d34 0 2024-09-19T06:08:46.982 INFO:tasks.workunit.client.0.smithi037.stdout:9/668: rmdir da/dd/d1b/d2f/d6d/db4 39 2024-09-19T06:08:46.983 INFO:tasks.workunit.client.0.smithi037.stdout:9/669: write da/dd/d1b/d2f/f91 [284095,16673] 0 2024-09-19T06:08:46.983 INFO:tasks.workunit.client.0.smithi037.stdout:8/759: write d1/d61/d68/ff1 [414120,96767] 0 2024-09-19T06:08:46.983 INFO:tasks.workunit.client.0.smithi037.stdout:4/645: dread d0/d2/d37/d92/fa4 [0,4194304] 0 2024-09-19T06:08:46.983 INFO:tasks.workunit.client.0.smithi037.stdout:4/646: fsync d0/d6/d1b/d20/f62 0 2024-09-19T06:08:46.984 INFO:tasks.workunit.client.0.smithi037.stdout:6/532: mknod d9/dd/d1c/d73/cab 0 2024-09-19T06:08:46.984 INFO:tasks.workunit.client.0.smithi037.stdout:6/533: stat d9/dd/d20/d5a 0 2024-09-19T06:08:46.986 INFO:tasks.workunit.client.0.smithi037.stdout:7/535: rmdir d6/d20/d34/d7d 39 2024-09-19T06:08:46.986 INFO:tasks.workunit.client.0.smithi037.stdout:7/536: dread - d6/f3d zero size 2024-09-19T06:08:46.987 INFO:tasks.workunit.client.0.smithi037.stdout:0/555: dwrite d5/d8/d11/f55 [0,4194304] 0 2024-09-19T06:08:46.988 INFO:tasks.workunit.client.0.smithi037.stdout:9/670: mknod da/dd/d1b/d23/dbe/cf1 0 2024-09-19T06:08:46.989 INFO:tasks.workunit.client.0.smithi037.stdout:4/647: mkdir d0/d8f/dd0 0 2024-09-19T06:08:46.991 INFO:tasks.workunit.client.0.smithi037.stdout:0/556: mkdir d5/d18/d68/d85/dab/dba 0 2024-09-19T06:08:46.991 INFO:tasks.workunit.client.0.smithi037.stdout:9/671: creat da/dd/d1b/d2f/d6f/ff2 x:0 0 0 2024-09-19T06:08:46.991 INFO:tasks.workunit.client.0.smithi037.stdout:9/672: readlink da/dd/d1b/d23/d6a/d82/l5e 0 2024-09-19T06:08:46.992 INFO:tasks.workunit.client.0.smithi037.stdout:4/648: link d0/d6/d45/d4a/f8c d0/d6/d1b/d20/d4d/d64/fd1 0 2024-09-19T06:08:46.993 INFO:tasks.workunit.client.0.smithi037.stdout:0/557: symlink d5/d8/lbb 0 2024-09-19T06:08:46.998 INFO:tasks.workunit.client.0.smithi037.stdout:8/760: dread d1/d61/d7b/f99 [0,4194304] 0 2024-09-19T06:08:46.998 INFO:tasks.workunit.client.0.smithi037.stdout:4/649: truncate d0/d2/f2c 1138985 0 2024-09-19T06:08:46.999 INFO:tasks.workunit.client.0.smithi037.stdout:4/650: dread d0/f7c [0,4194304] 0 2024-09-19T06:08:46.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:08:46 smithi117 ceph-mon[35050]: pgmap v427: 129 pgs: 129 active+clean; 656 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 63 MiB/s rd, 77 MiB/s wr, 179 op/s 2024-09-19T06:08:47.000 INFO:tasks.workunit.client.0.smithi037.stdout:7/537: dread d6/dc/d22/f78 [0,4194304] 0 2024-09-19T06:08:47.001 INFO:tasks.workunit.client.0.smithi037.stdout:8/761: creat d1/d61/d7e/dbc/dc2/d59/d5d/f105 x:0 0 0 2024-09-19T06:08:47.001 INFO:tasks.workunit.client.0.smithi037.stdout:8/762: readlink d1/d35/lec 0 2024-09-19T06:08:47.003 INFO:tasks.workunit.client.0.smithi037.stdout:4/651: symlink d0/d2/d37/ld2 0 2024-09-19T06:08:47.003 INFO:tasks.workunit.client.0.smithi037.stdout:4/652: write d0/f44 [1235904,2510] 0 2024-09-19T06:08:47.006 INFO:tasks.workunit.client.0.smithi037.stdout:5/536: dwrite d2/d12/d24/d97/f9c [0,4194304] 0 2024-09-19T06:08:47.008 INFO:tasks.workunit.client.0.smithi037.stdout:8/763: dread d1/d61/d7e/dbc/dc2/d59/d5d/f75 [0,4194304] 0 2024-09-19T06:08:47.008 INFO:tasks.workunit.client.0.smithi037.stdout:8/764: stat d1/dc8/ffb 0 2024-09-19T06:08:47.008 INFO:tasks.workunit.client.0.smithi037.stdout:8/765: read d1/d61/d7e/dbc/dc2/d59/d5d/f7c [4104094,83024] 0 2024-09-19T06:08:47.010 INFO:tasks.workunit.client.0.smithi037.stdout:8/766: creat d1/d8f/f106 x:0 0 0 2024-09-19T06:08:47.010 INFO:tasks.workunit.client.0.smithi037.stdout:8/767: stat d1/d61/d7e/d8b/d91/d3d/f14 0 2024-09-19T06:08:47.011 INFO:tasks.workunit.client.0.smithi037.stdout:6/534: write d9/dd/d2b/f50 [1024468,85369] 0 2024-09-19T06:08:47.011 INFO:tasks.workunit.client.0.smithi037.stdout:8/768: creat d1/d61/d7e/d8b/d91/d3d/d66/f107 x:0 0 0 2024-09-19T06:08:47.014 INFO:tasks.workunit.client.0.smithi037.stdout:6/535: creat d9/dd/d20/d5a/d6d/fac x:0 0 0 2024-09-19T06:08:47.015 INFO:tasks.workunit.client.0.smithi037.stdout:6/536: mkdir d9/dd/d2b/d42/dad 0 2024-09-19T06:08:47.017 INFO:tasks.workunit.client.0.smithi037.stdout:6/537: unlink d9/d6e/f83 0 2024-09-19T06:08:47.017 INFO:tasks.workunit.client.0.smithi037.stdout:6/538: readlink d9/dd/d1c/l1f 0 2024-09-19T06:08:47.017 INFO:tasks.workunit.client.0.smithi037.stdout:6/539: write d9/dd/d1c/d4e/d65/f67 [931853,9716] 0 2024-09-19T06:08:47.027 INFO:tasks.workunit.client.0.smithi037.stdout:4/653: dread d0/d2/d2e/d36/f79 [0,4194304] 0 2024-09-19T06:08:47.027 INFO:tasks.workunit.client.0.smithi037.stdout:4/654: chown d0/d6/d45/d4a/d86/f8a 583 1 2024-09-19T06:08:47.028 INFO:tasks.workunit.client.0.smithi037.stdout:7/538: dwrite d6/dc/df/f41 [0,4194304] 0 2024-09-19T06:08:47.028 INFO:tasks.workunit.client.0.smithi037.stdout:0/558: dwrite d5/d8/d79/fb9 [0,4194304] 0 2024-09-19T06:08:47.029 INFO:tasks.workunit.client.0.smithi037.stdout:4/655: creat d0/d8f/fd3 x:0 0 0 2024-09-19T06:08:47.029 INFO:tasks.workunit.client.0.smithi037.stdout:0/559: dread d5/d8/d11/d32/f5e [0,4194304] 0 2024-09-19T06:08:47.029 INFO:tasks.workunit.client.0.smithi037.stdout:7/539: creat d6/dc/df/fae x:0 0 0 2024-09-19T06:08:47.031 INFO:tasks.workunit.client.0.smithi037.stdout:4/656: getdents d0/d6/d1b/d5d 0 2024-09-19T06:08:47.032 INFO:tasks.workunit.client.0.smithi037.stdout:7/540: mkdir d6/dc/daf 0 2024-09-19T06:08:47.037 INFO:tasks.workunit.client.0.smithi037.stdout:4/657: symlink d0/d6/d45/d4a/ld4 0 2024-09-19T06:08:47.038 INFO:tasks.workunit.client.0.smithi037.stdout:8/769: dwrite d1/d61/d7e/dbc/dc2/d59/f74 [0,4194304] 0 2024-09-19T06:08:47.038 INFO:tasks.workunit.client.0.smithi037.stdout:8/770: chown d1/dc7/ff3 2675915 1 2024-09-19T06:08:47.038 INFO:tasks.workunit.client.0.smithi037.stdout:7/541: mkdir d6/db0 0 2024-09-19T06:08:47.040 INFO:tasks.workunit.client.0.smithi037.stdout:4/658: mknod d0/d2/d37/cd5 0 2024-09-19T06:08:47.041 INFO:tasks.workunit.client.0.smithi037.stdout:8/771: creat d1/d61/d7e/f108 x:0 0 0 2024-09-19T06:08:47.042 INFO:tasks.workunit.client.0.smithi037.stdout:7/542: mknod d6/dc/d22/d59/da8/cb1 0 2024-09-19T06:08:47.043 INFO:tasks.workunit.client.0.smithi037.stdout:7/543: mknod d6/dc/df/d7e/cb2 0 2024-09-19T06:08:47.043 INFO:tasks.workunit.client.0.smithi037.stdout:6/540: dwrite d9/dd/d1c/d4e/d33/f97 [0,4194304] 0 2024-09-19T06:08:47.046 INFO:tasks.workunit.client.0.smithi037.stdout:6/541: stat d9/l17 0 2024-09-19T06:08:47.048 INFO:tasks.workunit.client.0.smithi037.stdout:6/542: creat d9/d6e/fae x:0 0 0 2024-09-19T06:08:47.049 INFO:tasks.workunit.client.0.smithi037.stdout:6/543: mknod d9/dd/d20/d5a/d6d/d82/caf 0 2024-09-19T06:08:47.050 INFO:tasks.workunit.client.0.smithi037.stdout:6/544: mkdir d9/dd/d1c/d4e/d65/db0 0 2024-09-19T06:08:47.051 INFO:tasks.workunit.client.0.smithi037.stdout:6/545: truncate d9/dd/d2b/f50 1687017 0 2024-09-19T06:08:47.052 INFO:tasks.workunit.client.0.smithi037.stdout:0/560: dwrite d5/d17/fad [0,4194304] 0 2024-09-19T06:08:47.056 INFO:tasks.workunit.client.0.smithi037.stdout:0/561: creat d5/d18/fbc x:0 0 0 2024-09-19T06:08:47.056 INFO:tasks.workunit.client.0.smithi037.stdout:7/544: dread d6/d20/d34/f93 [0,4194304] 0 2024-09-19T06:08:47.056 INFO:tasks.workunit.client.0.smithi037.stdout:7/545: stat d6/dc/fa6 0 2024-09-19T06:08:47.056 INFO:tasks.workunit.client.0.smithi037.stdout:7/546: fdatasync d6/d20/d4b/d60/f74 0 2024-09-19T06:08:47.058 INFO:tasks.workunit.client.0.smithi037.stdout:7/547: mknod d6/dc/df/cb3 0 2024-09-19T06:08:47.058 INFO:tasks.workunit.client.0.smithi037.stdout:7/548: write d6/dc/f77 [693897,13214] 0 2024-09-19T06:08:47.060 INFO:tasks.workunit.client.0.smithi037.stdout:0/562: rename d5/d8/d11/d15/l81 to d5/d18/d68/d85/lbd 0 2024-09-19T06:08:47.060 INFO:tasks.workunit.client.0.smithi037.stdout:0/563: write d5/d20/d34/f91 [1502782,51465] 0 2024-09-19T06:08:47.061 INFO:tasks.workunit.client.0.smithi037.stdout:0/564: truncate d5/d8/d11/d15/d21/d4e/fa8 288856 0 2024-09-19T06:08:47.062 INFO:tasks.workunit.client.0.smithi037.stdout:0/565: symlink d5/d8/d11/d15/d21/lbe 0 2024-09-19T06:08:47.063 INFO:tasks.workunit.client.0.smithi037.stdout:4/659: dwrite d0/f24 [0,4194304] 0 2024-09-19T06:08:47.064 INFO:tasks.workunit.client.0.smithi037.stdout:0/566: mknod d5/d8/d11/d32/cbf 0 2024-09-19T06:08:47.065 INFO:tasks.workunit.client.0.smithi037.stdout:0/567: link d5/d17/c1d d5/d8/d44/da1/cc0 0 2024-09-19T06:08:47.066 INFO:tasks.workunit.client.0.smithi037.stdout:0/568: creat d5/d18/d68/d85/dab/dba/fc1 x:0 0 0 2024-09-19T06:08:47.067 INFO:tasks.workunit.client.0.smithi037.stdout:0/569: write d5/f7 [2199673,67606] 0 2024-09-19T06:08:47.067 INFO:tasks.workunit.client.0.smithi037.stdout:0/570: fdatasync d5/d8/f3f 0 2024-09-19T06:08:47.074 INFO:tasks.workunit.client.0.smithi037.stdout:0/571: getdents d5/d8/d11/d32 0 2024-09-19T06:08:47.074 INFO:tasks.workunit.client.0.smithi037.stdout:0/572: write d5/d8/d11/d15/d21/f4b [4994826,91762] 0 2024-09-19T06:08:47.077 INFO:tasks.workunit.client.0.smithi037.stdout:7/549: dread d6/d20/d4b/d60/f62 [0,4194304] 0 2024-09-19T06:08:47.078 INFO:tasks.workunit.client.0.smithi037.stdout:4/660: dread d0/d2/d2e/d36/f63 [0,4194304] 0 2024-09-19T06:08:47.078 INFO:tasks.workunit.client.0.smithi037.stdout:4/661: chown d0/d2/d37/d46/fcf 8066922 1 2024-09-19T06:08:47.078 INFO:tasks.workunit.client.0.smithi037.stdout:7/550: creat d6/dad/fb4 x:0 0 0 2024-09-19T06:08:47.079 INFO:tasks.workunit.client.0.smithi037.stdout:4/662: creat d0/d6/d1b/d20/fd6 x:0 0 0 2024-09-19T06:08:47.079 INFO:tasks.workunit.client.0.smithi037.stdout:4/663: truncate d0/d6/d45/d4a/f84 8850010 0 2024-09-19T06:08:47.087 INFO:tasks.workunit.client.0.smithi037.stdout:4/664: write d0/d6/d45/d4a/d86/f9e [3550012,95347] 0 2024-09-19T06:08:47.088 INFO:tasks.workunit.client.0.smithi037.stdout:0/573: dread d5/d20/f7c [0,4194304] 0 2024-09-19T06:08:47.089 INFO:tasks.workunit.client.0.smithi037.stdout:4/665: link d0/d2/f57 d0/d6/fd7 0 2024-09-19T06:08:47.091 INFO:tasks.workunit.client.0.smithi037.stdout:0/574: getdents d5/d8/d44/da1 0 2024-09-19T06:08:47.093 INFO:tasks.workunit.client.0.smithi037.stdout:4/666: unlink d0/d6/fd7 0 2024-09-19T06:08:47.093 INFO:tasks.workunit.client.0.smithi037.stdout:0/575: creat d5/d8/fc2 x:0 0 0 2024-09-19T06:08:47.095 INFO:tasks.workunit.client.0.smithi037.stdout:7/551: dread d6/f1d [0,4194304] 0 2024-09-19T06:08:47.095 INFO:tasks.workunit.client.0.smithi037.stdout:0/576: mknod d5/d8/d22/cc3 0 2024-09-19T06:08:47.095 INFO:tasks.workunit.client.0.smithi037.stdout:0/577: fsync d5/f7 0 2024-09-19T06:08:47.096 INFO:tasks.workunit.client.0.smithi037.stdout:7/552: creat d6/fb5 x:0 0 0 2024-09-19T06:08:47.096 INFO:tasks.workunit.client.0.smithi037.stdout:4/667: dread d0/d6/d45/d4a/f5c [0,4194304] 0 2024-09-19T06:08:47.098 INFO:tasks.workunit.client.0.smithi037.stdout:0/578: rename d5/d8/d11/d15/d21/l59 to d5/d42/lc4 0 2024-09-19T06:08:47.098 INFO:tasks.workunit.client.0.smithi037.stdout:7/553: fsync d6/d20/d34/d7d/f90 0 2024-09-19T06:08:47.098 INFO:tasks.workunit.client.0.smithi037.stdout:4/668: symlink d0/d2/d2e/ld8 0 2024-09-19T06:08:47.099 INFO:tasks.workunit.client.0.smithi037.stdout:4/669: readlink d0/d2/d2e/ld8 0 2024-09-19T06:08:47.099 INFO:tasks.workunit.client.0.smithi037.stdout:4/670: readlink d0/d6/d1b/d20/d4d/d65/l66 0 2024-09-19T06:08:47.099 INFO:tasks.workunit.client.0.smithi037.stdout:0/579: mkdir d5/d8/d22/d89/d96/dc5 0 2024-09-19T06:08:47.099 INFO:tasks.workunit.client.0.smithi037.stdout:0/580: fsync d5/d8/d44/f56 0 2024-09-19T06:08:47.100 INFO:tasks.workunit.client.0.smithi037.stdout:7/554: creat d6/dc/d7b/fb6 x:0 0 0 2024-09-19T06:08:47.101 INFO:tasks.workunit.client.0.smithi037.stdout:7/555: symlink d6/d20/d4b/d60/d33/d61/lb7 0 2024-09-19T06:08:47.102 INFO:tasks.workunit.client.0.smithi037.stdout:7/556: chown d6/d20/d34/d49 71 1 2024-09-19T06:08:47.102 INFO:tasks.workunit.client.0.smithi037.stdout:7/557: chown d6/d20/d4b/d60 721 1 2024-09-19T06:08:47.103 INFO:tasks.workunit.client.0.smithi037.stdout:7/558: mknod d6/d20/d4b/d60/d33/d55/d6d/cb8 0 2024-09-19T06:08:47.103 INFO:tasks.workunit.client.0.smithi037.stdout:0/581: dread d5/d18/d68/d85/f99 [0,4194304] 0 2024-09-19T06:08:47.103 INFO:tasks.workunit.client.0.smithi037.stdout:0/582: readlink d5/d18/l77 0 2024-09-19T06:08:47.104 INFO:tasks.workunit.client.0.smithi037.stdout:7/559: write d6/dc/f94 [659954,116360] 0 2024-09-19T06:08:47.104 INFO:tasks.workunit.client.0.smithi037.stdout:0/583: symlink d5/d18/d68/d85/dab/lc6 0 2024-09-19T06:08:47.106 INFO:tasks.workunit.client.0.smithi037.stdout:7/560: creat d6/d20/fb9 x:0 0 0 2024-09-19T06:08:47.110 INFO:tasks.workunit.client.0.smithi037.stdout:4/671: rename d0/d2/d2e to d0/d6/d45/dd9 0 2024-09-19T06:08:47.112 INFO:tasks.workunit.client.0.smithi037.stdout:4/672: getdents d0/d2/d37 0 2024-09-19T06:08:47.113 INFO:tasks.workunit.client.0.smithi037.stdout:4/673: rename d0/d6/d1b/d30/fb3 to d0/d6/d1b/d20/d48/fda 0 2024-09-19T06:08:47.114 INFO:tasks.workunit.client.0.smithi037.stdout:4/674: unlink d0/d2/l7f 0 2024-09-19T06:08:47.115 INFO:tasks.workunit.client.0.smithi037.stdout:4/675: chown d0/d2/f1a 159600 1 2024-09-19T06:08:47.115 INFO:tasks.workunit.client.0.smithi037.stdout:4/676: creat d0/d6/d1b/d5d/fdb x:0 0 0 2024-09-19T06:08:47.117 INFO:tasks.workunit.client.0.smithi037.stdout:0/584: dread d5/d17/f58 [0,4194304] 0 2024-09-19T06:08:47.118 INFO:tasks.workunit.client.0.smithi037.stdout:0/585: creat d5/d8/d79/d9a/fc7 x:0 0 0 2024-09-19T06:08:47.126 INFO:tasks.workunit.client.0.smithi037.stdout:7/561: dwrite d6/d20/d4b/d60/f62 [0,4194304] 0 2024-09-19T06:08:47.127 INFO:tasks.workunit.client.0.smithi037.stdout:7/562: chown d6/dc/l5b 21983503 1 2024-09-19T06:08:47.128 INFO:tasks.workunit.client.0.smithi037.stdout:7/563: stat d6/l43 0 2024-09-19T06:08:47.128 INFO:tasks.workunit.client.0.smithi037.stdout:7/564: read - d6/d20/d34/d7d/f9e zero size 2024-09-19T06:08:47.128 INFO:tasks.workunit.client.0.smithi037.stdout:7/565: chown d6/d20/d34/d7d 117895 1 2024-09-19T06:08:47.128 INFO:tasks.workunit.client.0.smithi037.stdout:7/566: write d6/d20/d4b/d60/d33/d8c/f96 [507275,24603] 0 2024-09-19T06:08:47.128 INFO:tasks.workunit.client.0.smithi037.stdout:1/475: sync 2024-09-19T06:08:47.128 INFO:tasks.workunit.client.0.smithi037.stdout:3/539: sync 2024-09-19T06:08:47.128 INFO:tasks.workunit.client.0.smithi037.stdout:1/476: readlink d2/d12/d15/d34/l5e 0 2024-09-19T06:08:47.129 INFO:tasks.workunit.client.0.smithi037.stdout:1/477: stat d2/d12/d1e/d63/f93 0 2024-09-19T06:08:47.129 INFO:tasks.workunit.client.0.smithi037.stdout:7/567: mknod d6/d20/d34/d49/cba 0 2024-09-19T06:08:47.129 INFO:tasks.workunit.client.0.smithi037.stdout:7/568: readlink l3 0 2024-09-19T06:08:47.129 INFO:tasks.workunit.client.0.smithi037.stdout:1/478: rmdir d2/d73 39 2024-09-19T06:08:47.129 INFO:tasks.workunit.client.0.smithi037.stdout:7/569: mkdir d6/d20/d71/dbb 0 2024-09-19T06:08:47.130 INFO:tasks.workunit.client.0.smithi037.stdout:7/570: dread - d6/d20/d34/f9a zero size 2024-09-19T06:08:47.132 INFO:tasks.workunit.client.0.smithi037.stdout:7/571: mknod d6/dc/daf/cbc 0 2024-09-19T06:08:47.132 INFO:tasks.workunit.client.0.smithi037.stdout:7/572: truncate d6/dc/d22/f78 1738604 0 2024-09-19T06:08:47.134 INFO:tasks.workunit.client.0.smithi037.stdout:7/573: getdents d6/dc 0 2024-09-19T06:08:47.135 INFO:tasks.workunit.client.0.smithi037.stdout:7/574: rmdir d6/dc/d22/d59/da8 39 2024-09-19T06:08:47.137 INFO:tasks.workunit.client.0.smithi037.stdout:1/479: read d2/d12/d1e/f67 [137911,40024] 0 2024-09-19T06:08:47.137 INFO:tasks.workunit.client.0.smithi037.stdout:1/480: stat d2/f6 0 2024-09-19T06:08:47.137 INFO:tasks.workunit.client.0.smithi037.stdout:1/481: write d2/d12/d1e/d63/f77 [975563,72522] 0 2024-09-19T06:08:47.138 INFO:tasks.workunit.client.0.smithi037.stdout:1/482: creat d2/d12/d1e/d75/f9c x:0 0 0 2024-09-19T06:08:47.139 INFO:tasks.workunit.client.0.smithi037.stdout:1/483: truncate d2/fa 2584100 0 2024-09-19T06:08:47.139 INFO:tasks.workunit.client.0.smithi037.stdout:1/484: write d2/d12/d1e/d63/f93 [50319,99617] 0 2024-09-19T06:08:47.140 INFO:tasks.workunit.client.0.smithi037.stdout:0/586: dwrite d5/d8/d22/d89/f8a [0,4194304] 0 2024-09-19T06:08:47.141 INFO:tasks.workunit.client.0.smithi037.stdout:1/485: link d2/f4 d2/d12/d17/f9d 0 2024-09-19T06:08:47.143 INFO:tasks.workunit.client.0.smithi037.stdout:0/587: rmdir d5/d8/d11/d32 39 2024-09-19T06:08:47.143 INFO:tasks.workunit.client.0.smithi037.stdout:0/588: truncate d5/d8/fc2 351029 0 2024-09-19T06:08:47.143 INFO:tasks.workunit.client.0.smithi037.stdout:0/589: readlink d5/d8/d11/d15/d21/lbe 0 2024-09-19T06:08:47.143 INFO:tasks.workunit.client.0.smithi037.stdout:0/590: stat d5/cac 0 2024-09-19T06:08:47.145 INFO:tasks.workunit.client.0.smithi037.stdout:1/486: mkdir d2/d12/d1e/d63/d9e 0 2024-09-19T06:08:47.147 INFO:tasks.workunit.client.0.smithi037.stdout:0/591: unlink d5/d20/l97 0 2024-09-19T06:08:47.148 INFO:tasks.workunit.client.0.smithi037.stdout:1/487: link d2/d12/d15/c3d d2/d12/d1e/d2a/c9f 0 2024-09-19T06:08:47.149 INFO:tasks.workunit.client.0.smithi037.stdout:0/592: creat d5/d8/d11/d15/fc8 x:0 0 0 2024-09-19T06:08:47.151 INFO:tasks.workunit.client.0.smithi037.stdout:0/593: creat d5/d8/d22/d89/d96/fc9 x:0 0 0 2024-09-19T06:08:47.152 INFO:tasks.workunit.client.0.smithi037.stdout:4/677: dwrite d0/d6/d1b/d20/d4d/d64/db0/dc4/fc8 [0,4194304] 0 2024-09-19T06:08:47.152 INFO:tasks.workunit.client.0.smithi037.stdout:4/678: dread - d0/d8f/fd3 zero size 2024-09-19T06:08:47.152 INFO:tasks.workunit.client.0.smithi037.stdout:7/575: dread d6/d20/d4b/d60/d33/f6b [0,4194304] 0 2024-09-19T06:08:47.152 INFO:tasks.workunit.client.0.smithi037.stdout:4/679: fsync d0/d6/d1b/d20/d48/f9b 0 2024-09-19T06:08:47.152 INFO:tasks.workunit.client.0.smithi037.stdout:7/576: write d6/f2b [5044281,68480] 0 2024-09-19T06:08:47.154 INFO:tasks.workunit.client.0.smithi037.stdout:4/680: mknod d0/d6/d1b/d20/d48/cdc 0 2024-09-19T06:08:47.155 INFO:tasks.workunit.client.0.smithi037.stdout:7/577: mknod d6/dc/d22/cbd 0 2024-09-19T06:08:47.156 INFO:tasks.workunit.client.0.smithi037.stdout:0/594: mkdir d5/d8/d11/d15/dca 0 2024-09-19T06:08:47.158 INFO:tasks.workunit.client.0.smithi037.stdout:4/681: creat d0/d2/d37/d46/fdd x:0 0 0 2024-09-19T06:08:47.159 INFO:tasks.workunit.client.0.smithi037.stdout:7/578: dread d6/dc/f89 [0,4194304] 0 2024-09-19T06:08:47.160 INFO:tasks.workunit.client.0.smithi037.stdout:0/595: rename d5/d20/d34/c4f to d5/d8/d44/ccb 0 2024-09-19T06:08:47.161 INFO:tasks.workunit.client.0.smithi037.stdout:4/682: mknod d0/d2/cde 0 2024-09-19T06:08:47.162 INFO:tasks.workunit.client.0.smithi037.stdout:7/579: truncate d6/f12 4601372 0 2024-09-19T06:08:47.163 INFO:tasks.workunit.client.0.smithi037.stdout:0/596: getdents d5/d8/d22 0 2024-09-19T06:08:47.163 INFO:tasks.workunit.client.0.smithi037.stdout:0/597: fdatasync d5/d20/faa 0 2024-09-19T06:08:47.165 INFO:tasks.workunit.client.0.smithi037.stdout:4/683: rename d0/d6/d45/dd9/d36/f4f to d0/d6/d1b/d20/d48/fdf 0 2024-09-19T06:08:47.165 INFO:tasks.workunit.client.0.smithi037.stdout:7/580: truncate d6/d20/d4b/d60/d33/f6b 3871769 0 2024-09-19T06:08:47.166 INFO:tasks.workunit.client.0.smithi037.stdout:4/684: creat d0/d6/d45/dd9/d36/fe0 x:0 0 0 2024-09-19T06:08:47.167 INFO:tasks.workunit.client.0.smithi037.stdout:4/685: write d0/d8f/fd3 [1010015,18945] 0 2024-09-19T06:08:47.167 INFO:tasks.workunit.client.0.smithi037.stdout:7/581: dread - d6/d20/d34/f50 zero size 2024-09-19T06:08:47.167 INFO:tasks.workunit.client.0.smithi037.stdout:7/582: stat d6/f3e 0 2024-09-19T06:08:47.167 INFO:tasks.workunit.client.0.smithi037.stdout:0/598: read d5/d20/d34/f91 [353826,107811] 0 2024-09-19T06:08:47.176 INFO:tasks.workunit.client.0.smithi037.stdout:4/686: mkdir d0/d6/d45/d4a/de1 0 2024-09-19T06:08:47.176 INFO:tasks.workunit.client.0.smithi037.stdout:4/687: write d0/f7c [1068806,120204] 0 2024-09-19T06:08:47.193 INFO:tasks.workunit.client.0.smithi037.stdout:0/599: dwrite d5/d8/d22/f4d [0,4194304] 0 2024-09-19T06:08:47.194 INFO:tasks.workunit.client.0.smithi037.stdout:7/583: dwrite d6/f8a [0,4194304] 0 2024-09-19T06:08:47.194 INFO:tasks.workunit.client.0.smithi037.stdout:7/584: fsync d6/fb5 0 2024-09-19T06:08:47.195 INFO:tasks.workunit.client.0.smithi037.stdout:7/585: mknod d6/db0/cbe 0 2024-09-19T06:08:47.195 INFO:tasks.workunit.client.0.smithi037.stdout:2/591: sync 2024-09-19T06:08:47.195 INFO:tasks.workunit.client.0.smithi037.stdout:9/673: sync 2024-09-19T06:08:47.197 INFO:tasks.workunit.client.0.smithi037.stdout:2/592: rmdir d1/d6/da3/da8/db2 0 2024-09-19T06:08:47.198 INFO:tasks.workunit.client.0.smithi037.stdout:2/593: unlink d1/da/dc/f3b 0 2024-09-19T06:08:47.198 INFO:tasks.workunit.client.0.smithi037.stdout:2/594: symlink d1/d33/d4c/lcd 0 2024-09-19T06:08:47.208 INFO:tasks.workunit.client.0.smithi037.stdout:0/600: dread d5/d8/d11/d15/d21/d4e/fa8 [0,4194304] 0 2024-09-19T06:08:47.211 INFO:tasks.workunit.client.0.smithi037.stdout:0/601: link d5/d8/d11/d15/d21/d4e/fa8 d5/d8/d22/d89/d96/dae/fcc 0 2024-09-19T06:08:47.211 INFO:tasks.workunit.client.0.smithi037.stdout:2/595: dread d1/da/dc/d21/d7d/f2e [0,4194304] 0 2024-09-19T06:08:47.212 INFO:tasks.workunit.client.0.smithi037.stdout:0/602: rename d5/d18/l73 to d5/d8/d79/d9a/lcd 0 2024-09-19T06:08:47.213 INFO:tasks.workunit.client.0.smithi037.stdout:0/603: creat d5/d8/d11/d15/dca/fce x:0 0 0 2024-09-19T06:08:47.214 INFO:tasks.workunit.client.0.smithi037.stdout:2/596: mkdir d1/da/d95/dce 0 2024-09-19T06:08:47.217 INFO:tasks.workunit.client.0.smithi037.stdout:0/604: link d5/d8/d44/f51 d5/d8/d44/d61/fcf 0 2024-09-19T06:08:47.225 INFO:tasks.workunit.client.0.smithi037.stdout:7/586: dwrite d6/dc/f2a [0,4194304] 0 2024-09-19T06:08:47.225 INFO:tasks.workunit.client.0.smithi037.stdout:9/674: dwrite da/dd/d1b/d2f/d6d/db4/ded/fcb [0,4194304] 0 2024-09-19T06:08:47.227 INFO:tasks.workunit.client.0.smithi037.stdout:7/587: symlink d6/d20/d4b/d60/d33/d8c/lbf 0 2024-09-19T06:08:47.228 INFO:tasks.workunit.client.0.smithi037.stdout:9/675: creat da/dd/d1b/d23/de9/ff3 x:0 0 0 2024-09-19T06:08:47.229 INFO:tasks.workunit.client.0.smithi037.stdout:9/676: rmdir da/d20 39 2024-09-19T06:08:47.229 INFO:tasks.workunit.client.0.smithi037.stdout:9/677: stat da/dd/d1b/d23/d3f/c8d 0 2024-09-19T06:08:47.229 INFO:tasks.workunit.client.0.smithi037.stdout:9/678: readlink da/l32 0 2024-09-19T06:08:47.230 INFO:tasks.workunit.client.0.smithi037.stdout:9/679: mkdir da/dd/d1b/d62/df4 0 2024-09-19T06:08:47.232 INFO:tasks.workunit.client.0.smithi037.stdout:9/680: creat da/dd/d1b/d23/de9/ff5 x:0 0 0 2024-09-19T06:08:47.237 INFO:tasks.workunit.client.0.smithi037.stdout:9/681: dread da/dd/d1b/d23/d6a/f7f [0,4194304] 0 2024-09-19T06:08:47.242 INFO:tasks.workunit.client.0.smithi037.stdout:0/605: dwrite d5/d8/d11/d32/f43 [4194304,4194304] 0 2024-09-19T06:08:47.245 INFO:tasks.workunit.client.0.smithi037.stdout:2/597: dwrite d1/d16/f61 [0,4194304] 0 2024-09-19T06:08:47.246 INFO:tasks.workunit.client.0.smithi037.stdout:0/606: symlink d5/d8/d44/ld0 0 2024-09-19T06:08:47.247 INFO:tasks.workunit.client.0.smithi037.stdout:2/598: link d1/da/f3e d1/da/d95/dce/fcf 0 2024-09-19T06:08:47.248 INFO:tasks.workunit.client.0.smithi037.stdout:2/599: mkdir d1/d16/d96/dd0 0 2024-09-19T06:08:47.249 INFO:tasks.workunit.client.0.smithi037.stdout:2/600: rename d1/d33/d4c/f53 to d1/da/dc/fd1 0 2024-09-19T06:08:47.250 INFO:tasks.workunit.client.0.smithi037.stdout:2/601: stat d1/da/d95 0 2024-09-19T06:08:47.253 INFO:tasks.workunit.client.0.smithi037.stdout:7/588: dwrite d6/dc/d22/f1a [0,4194304] 0 2024-09-19T06:08:47.253 INFO:tasks.workunit.client.0.smithi037.stdout:7/589: read - d6/d20/d34/f50 zero size 2024-09-19T06:08:47.253 INFO:tasks.workunit.client.0.smithi037.stdout:7/590: dread - d6/d20/d34/f9a zero size 2024-09-19T06:08:47.254 INFO:tasks.workunit.client.0.smithi037.stdout:7/591: mkdir d6/d20/d34/dc0 0 2024-09-19T06:08:47.255 INFO:tasks.workunit.client.0.smithi037.stdout:7/592: chown d6/dc/f2a 528795 1 2024-09-19T06:08:47.255 INFO:tasks.workunit.client.0.smithi037.stdout:7/593: dread - d6/dc/fa6 zero size 2024-09-19T06:08:47.255 INFO:tasks.workunit.client.0.smithi037.stdout:7/594: symlink d6/dc/d22/d59/lc1 0 2024-09-19T06:08:47.255 INFO:tasks.workunit.client.0.smithi037.stdout:7/595: dread - d6/d20/d4b/d60/f84 zero size 2024-09-19T06:08:47.259 INFO:tasks.workunit.client.0.smithi037.stdout:7/596: dread d6/dc/f94 [0,4194304] 0 2024-09-19T06:08:47.260 INFO:tasks.workunit.client.0.smithi037.stdout:7/597: truncate d6/d20/d34/f66 1230294 0 2024-09-19T06:08:47.267 INFO:tasks.workunit.client.0.smithi037.stdout:2/602: dread d1/da/fa5 [0,4194304] 0 2024-09-19T06:08:47.269 INFO:tasks.workunit.client.0.smithi037.stdout:9/682: dwrite da/dd/d1b/d2f/dcc/de7/fef [0,4194304] 0 2024-09-19T06:08:47.270 INFO:tasks.workunit.client.0.smithi037.stdout:0/607: dwrite d5/d8/d11/d32/f43 [0,4194304] 0 2024-09-19T06:08:47.271 INFO:tasks.workunit.client.0.smithi037.stdout:9/683: mknod da/dd/d1b/d23/d3f/cf6 0 2024-09-19T06:08:47.272 INFO:tasks.workunit.client.0.smithi037.stdout:0/608: mkdir d5/d8/d44/d48/dd1 0 2024-09-19T06:08:47.273 INFO:tasks.workunit.client.0.smithi037.stdout:9/684: truncate da/dd/d1b/f4c 549694 0 2024-09-19T06:08:47.275 INFO:tasks.workunit.client.0.smithi037.stdout:0/609: creat d5/d8/d44/d48/daf/fd2 x:0 0 0 2024-09-19T06:08:47.277 INFO:tasks.workunit.client.0.smithi037.stdout:9/685: truncate da/dd/d1b/d2f/d6d/db4/ded/f4e 624890 0 2024-09-19T06:08:47.277 INFO:tasks.workunit.client.0.smithi037.stdout:9/686: chown da/dd/d1b/d23/d6a/d8f/da4/ld5 9 1 2024-09-19T06:08:47.278 INFO:tasks.workunit.client.0.smithi037.stdout:9/687: symlink da/dd/d1b/d23/dbe/lf7 0 2024-09-19T06:08:47.287 INFO:tasks.workunit.client.0.smithi037.stdout:7/598: dwrite d6/dc/f14 [4194304,4194304] 0 2024-09-19T06:08:47.287 INFO:tasks.workunit.client.0.smithi037.stdout:7/599: readlink d6/dc/l5b 0 2024-09-19T06:08:47.290 INFO:tasks.workunit.client.0.smithi037.stdout:2/603: dread d1/d6/f24 [0,4194304] 0 2024-09-19T06:08:47.291 INFO:tasks.workunit.client.0.smithi037.stdout:2/604: rename d1/da/dc/d21/d7d/c60 to d1/d6/da3/da8/dbe/cd2 0 2024-09-19T06:08:47.293 INFO:tasks.workunit.client.0.smithi037.stdout:8/772: sync 2024-09-19T06:08:47.293 INFO:tasks.workunit.client.0.smithi037.stdout:6/546: sync 2024-09-19T06:08:47.293 INFO:tasks.workunit.client.0.smithi037.stdout:5/537: sync 2024-09-19T06:08:47.294 INFO:tasks.workunit.client.0.smithi037.stdout:6/547: link d9/d16/f4a d9/dd/d20/d5a/d6d/fb1 0 2024-09-19T06:08:47.295 INFO:tasks.workunit.client.0.smithi037.stdout:8/773: creat d1/d61/d7e/d8b/f109 x:0 0 0 2024-09-19T06:08:47.296 INFO:tasks.workunit.client.0.smithi037.stdout:5/538: creat d2/d12/d28/d22/d4a/d9e/fb1 x:0 0 0 2024-09-19T06:08:47.296 INFO:tasks.workunit.client.0.smithi037.stdout:5/539: readlink d2/lf 0 2024-09-19T06:08:47.296 INFO:tasks.workunit.client.0.smithi037.stdout:5/540: truncate d2/d12/d28/d22/d4a/d9e/fb1 371183 0 2024-09-19T06:08:47.296 INFO:tasks.workunit.client.0.smithi037.stdout:5/541: write d2/d12/f5d [300660,100006] 0 2024-09-19T06:08:47.297 INFO:tasks.workunit.client.0.smithi037.stdout:8/774: link d1/d61/d7e/dbc/dc2/l5b d1/d61/d7e/dbc/dc2/l10a 0 2024-09-19T06:08:47.305 INFO:tasks.workunit.client.0.smithi037.stdout:9/688: dwrite da/dd/d1b/d23/de9/ff3 [0,4194304] 0 2024-09-19T06:08:47.319 INFO:tasks.workunit.client.0.smithi037.stdout:2/605: write d1/d6/f2f [716027,28911] 0 2024-09-19T06:08:47.320 INFO:tasks.workunit.client.0.smithi037.stdout:7/600: dwrite d6/d20/f3c [4194304,4194304] 0 2024-09-19T06:08:47.320 INFO:tasks.workunit.client.0.smithi037.stdout:7/601: readlink l3 0 2024-09-19T06:08:47.320 INFO:tasks.workunit.client.0.smithi037.stdout:2/606: rmdir d1/d33/d4c 39 2024-09-19T06:08:47.322 INFO:tasks.workunit.client.0.smithi037.stdout:7/602: creat d6/d20/d71/dbb/fc2 x:0 0 0 2024-09-19T06:08:47.322 INFO:tasks.workunit.client.0.smithi037.stdout:7/603: write d6/dc/d22/d59/da8/faa [966526,108544] 0 2024-09-19T06:08:47.322 INFO:tasks.workunit.client.0.smithi037.stdout:7/604: write d6/dc/f94 [693619,75794] 0 2024-09-19T06:08:47.322 INFO:tasks.workunit.client.0.smithi037.stdout:7/605: stat d6/dc/df/f41 0 2024-09-19T06:08:47.322 INFO:tasks.workunit.client.0.smithi037.stdout:7/606: stat d6/dc/d22/d59/c98 0 2024-09-19T06:08:47.322 INFO:tasks.workunit.client.0.smithi037.stdout:6/548: dwrite d9/dd/d1c/f2e [4194304,4194304] 0 2024-09-19T06:08:47.322 INFO:tasks.workunit.client.0.smithi037.stdout:5/542: write d2/d10/f19 [3507103,69583] 0 2024-09-19T06:08:47.324 INFO:tasks.workunit.client.0.smithi037.stdout:8/775: dread d1/d61/d7e/d8b/d9f/de4/ffd [0,4194304] 0 2024-09-19T06:08:47.325 INFO:tasks.workunit.client.0.smithi037.stdout:7/607: creat d6/dc/df/d7e/fc3 x:0 0 0 2024-09-19T06:08:47.325 INFO:tasks.workunit.client.0.smithi037.stdout:7/608: write d6/dc/fa6 [517907,85717] 0 2024-09-19T06:08:47.325 INFO:tasks.workunit.client.0.smithi037.stdout:6/549: creat d9/fb2 x:0 0 0 2024-09-19T06:08:47.326 INFO:tasks.workunit.client.0.smithi037.stdout:6/550: chown d9/dd/d20/l69 16954076 1 2024-09-19T06:08:47.326 INFO:tasks.workunit.client.0.smithi037.stdout:6/551: write d9/dd/d1c/f80 [419955,14043] 0 2024-09-19T06:08:47.326 INFO:tasks.workunit.client.0.smithi037.stdout:5/543: symlink d2/d12/d28/d22/d4a/d9f/lb2 0 2024-09-19T06:08:47.327 INFO:tasks.workunit.client.0.smithi037.stdout:8/776: symlink d1/dc8/l10b 0 2024-09-19T06:08:47.332 INFO:tasks.workunit.client.0.smithi037.stdout:9/689: dwrite da/dd/d1b/d43/fa3 [0,4194304] 0 2024-09-19T06:08:47.344 INFO:tasks.workunit.client.0.smithi037.stdout:2/607: write d1/d6/f6c [237841,99675] 0 2024-09-19T06:08:47.348 INFO:tasks.workunit.client.0.smithi037.stdout:2/608: creat d1/d16/d96/fd3 x:0 0 0 2024-09-19T06:08:47.349 INFO:tasks.workunit.client.0.smithi037.stdout:5/544: dread d2/d10/f4e [0,4194304] 0 2024-09-19T06:08:47.349 INFO:tasks.workunit.client.0.smithi037.stdout:2/609: getdents d1/da 0 2024-09-19T06:08:47.349 INFO:tasks.workunit.client.0.smithi037.stdout:9/690: dread da/dd/d1b/d23/d6a/f7f [0,4194304] 0 2024-09-19T06:08:47.349 INFO:tasks.workunit.client.0.smithi037.stdout:5/545: mknod d2/d12/d28/d22/d53/cb3 0 2024-09-19T06:08:47.349 INFO:tasks.workunit.client.0.smithi037.stdout:2/610: chown d1/da/d95/la9 1570 1 2024-09-19T06:08:47.349 INFO:tasks.workunit.client.0.smithi037.stdout:2/611: chown d1/da/dc/d21/c77 201260368 1 2024-09-19T06:08:47.349 INFO:tasks.workunit.client.0.smithi037.stdout:9/691: mkdir da/dd/d1b/d2f/df8 0 2024-09-19T06:08:47.349 INFO:tasks.workunit.client.0.smithi037.stdout:9/692: write da/dd/d1b/d23/de9/fa6 [1261438,109906] 0 2024-09-19T06:08:47.349 INFO:tasks.workunit.client.0.smithi037.stdout:2/612: truncate d1/d6/fe 4587318 0 2024-09-19T06:08:47.350 INFO:tasks.workunit.client.0.smithi037.stdout:8/777: dwrite d1/d61/d7e/dbc/dc2/d59/f9e [0,4194304] 0 2024-09-19T06:08:47.350 INFO:tasks.workunit.client.0.smithi037.stdout:8/778: fdatasync d1/dc7/fe0 0 2024-09-19T06:08:47.350 INFO:tasks.workunit.client.0.smithi037.stdout:8/779: truncate d1/d35/ff2 1735848 0 2024-09-19T06:08:47.350 INFO:tasks.workunit.client.0.smithi037.stdout:6/552: write d9/dd/d1c/d4e/d33/f88 [3690674,40826] 0 2024-09-19T06:08:47.350 INFO:tasks.workunit.client.0.smithi037.stdout:2/613: mknod d1/d33/d4c/cd4 0 2024-09-19T06:08:47.351 INFO:tasks.workunit.client.0.smithi037.stdout:6/553: rename d9/dd/d2b/d79/f7a to d9/d6e/fb3 0 2024-09-19T06:08:47.352 INFO:tasks.workunit.client.0.smithi037.stdout:8/780: mknod d1/d61/d7e/dbc/dc2/d59/d5d/c10c 0 2024-09-19T06:08:47.352 INFO:tasks.workunit.client.0.smithi037.stdout:8/781: chown d1/d61/d7e/dbc/dc2/d59/daf/cc4 1469 1 2024-09-19T06:08:47.353 INFO:tasks.workunit.client.0.smithi037.stdout:6/554: symlink d9/dd/d2b/d42/dad/lb4 0 2024-09-19T06:08:47.354 INFO:tasks.workunit.client.0.smithi037.stdout:8/782: dread d1/d61/d7e/d8b/d9f/de4/fe7 [0,4194304] 0 2024-09-19T06:08:47.355 INFO:tasks.workunit.client.0.smithi037.stdout:6/555: rename d9/dd/d20/d5a/d6d/f7f to d9/dd/d20/d5a/d6d/d82/d9f/fb5 0 2024-09-19T06:08:47.358 INFO:tasks.workunit.client.0.smithi037.stdout:8/783: creat d1/f10d x:0 0 0 2024-09-19T06:08:47.358 INFO:tasks.workunit.client.0.smithi037.stdout:8/784: dread - d1/d61/d7e/dbc/dc2/fc1 zero size 2024-09-19T06:08:47.359 INFO:tasks.workunit.client.0.smithi037.stdout:6/556: unlink d9/dd/d2b/l9b 0 2024-09-19T06:08:47.361 INFO:tasks.workunit.client.0.smithi037.stdout:5/546: dread d2/d12/d28/f48 [0,4194304] 0 2024-09-19T06:08:47.361 INFO:tasks.workunit.client.0.smithi037.stdout:5/547: write d2/d12/d24/d58/d8e/f94 [78845,78442] 0 2024-09-19T06:08:47.361 INFO:tasks.workunit.client.0.smithi037.stdout:5/548: chown d2/d12/d28/d57/f73 9019 1 2024-09-19T06:08:47.364 INFO:tasks.workunit.client.0.smithi037.stdout:8/785: rmdir d1/d61/d7b 39 2024-09-19T06:08:47.365 INFO:tasks.workunit.client.0.smithi037.stdout:6/557: symlink d9/dd/d1c/d4e/d65/db0/lb6 0 2024-09-19T06:08:47.366 INFO:tasks.workunit.client.0.smithi037.stdout:7/609: dwrite d6/dc/f89 [0,4194304] 0 2024-09-19T06:08:47.374 INFO:tasks.workunit.client.0.smithi037.stdout:5/549: creat d2/d10/daf/fb4 x:0 0 0 2024-09-19T06:08:47.374 INFO:tasks.workunit.client.0.smithi037.stdout:8/786: link d1/d61/f77 d1/d61/d7e/dbc/dd0/f10e 0 2024-09-19T06:08:47.374 INFO:tasks.workunit.client.0.smithi037.stdout:5/550: dread - d2/d12/d24/d58/d8e/f9a zero size 2024-09-19T06:08:47.376 INFO:tasks.workunit.client.0.smithi037.stdout:2/614: dwrite d1/d33/d4c/f57 [0,4194304] 0 2024-09-19T06:08:47.376 INFO:tasks.workunit.client.0.smithi037.stdout:2/615: readlink d1/d16/l1d 0 2024-09-19T06:08:47.376 INFO:tasks.workunit.client.0.smithi037.stdout:7/610: mkdir d6/dc/d22/d59/da8/dc4 0 2024-09-19T06:08:47.376 INFO:tasks.workunit.client.0.smithi037.stdout:8/787: symlink d1/d61/d7e/d8b/d9f/de4/l10f 0 2024-09-19T06:08:47.377 INFO:tasks.workunit.client.0.smithi037.stdout:8/788: write d1/d8f/f106 [361292,9864] 0 2024-09-19T06:08:47.377 INFO:tasks.workunit.client.0.smithi037.stdout:8/789: readlink d1/d61/d7e/d8b/la8 0 2024-09-19T06:08:47.377 INFO:tasks.workunit.client.0.smithi037.stdout:5/551: creat d2/d10/da1/fb5 x:0 0 0 2024-09-19T06:08:47.385 INFO:tasks.workunit.client.0.smithi037.stdout:7/611: truncate d6/d20/d34/f93 1234519 0 2024-09-19T06:08:47.385 INFO:tasks.workunit.client.0.smithi037.stdout:7/612: dread - d6/d20/d34/f9a zero size 2024-09-19T06:08:47.385 INFO:tasks.workunit.client.0.smithi037.stdout:7/613: truncate d6/f92 442069 0 2024-09-19T06:08:47.385 INFO:tasks.workunit.client.0.smithi037.stdout:7/614: write d6/f12 [2547806,101777] 0 2024-09-19T06:08:47.392 INFO:tasks.workunit.client.0.smithi037.stdout:6/558: dwrite d9/dd/d20/d5a/d6d/d82/f84 [0,4194304] 0 2024-09-19T06:08:47.399 INFO:tasks.workunit.client.0.smithi037.stdout:6/559: rename d9/d6e/l6f to d9/dd/d1c/d4e/d33/lb7 0 2024-09-19T06:08:47.400 INFO:tasks.workunit.client.0.smithi037.stdout:6/560: creat d9/dd/d20/d5a/d6d/d82/d9f/fb8 x:0 0 0 2024-09-19T06:08:47.402 INFO:tasks.workunit.client.0.smithi037.stdout:4/688: sync 2024-09-19T06:08:47.402 INFO:tasks.workunit.client.0.smithi037.stdout:3/540: sync 2024-09-19T06:08:47.402 INFO:tasks.workunit.client.0.smithi037.stdout:8/790: write d1/d35/f95 [3992523,2015] 0 2024-09-19T06:08:47.402 INFO:tasks.workunit.client.0.smithi037.stdout:2/616: dwrite d1/da/dc/d21/d7d/f82 [0,4194304] 0 2024-09-19T06:08:47.402 INFO:tasks.workunit.client.0.smithi037.stdout:1/488: sync 2024-09-19T06:08:47.402 INFO:tasks.workunit.client.0.smithi037.stdout:1/489: stat d2/d12/d15/d5c/c92 0 2024-09-19T06:08:47.403 INFO:tasks.workunit.client.0.smithi037.stdout:3/541: rmdir d0/d43/d23/d7a/d77 39 2024-09-19T06:08:47.403 INFO:tasks.workunit.client.0.smithi037.stdout:3/542: write d0/d43/d37/f8c [918406,63051] 0 2024-09-19T06:08:47.403 INFO:tasks.workunit.client.0.smithi037.stdout:2/617: mknod d1/da/dc/cd5 0 2024-09-19T06:08:47.404 INFO:tasks.workunit.client.0.smithi037.stdout:3/543: mkdir d0/d43/d23/d7a/d77/db8 0 2024-09-19T06:08:47.405 INFO:tasks.workunit.client.0.smithi037.stdout:2/618: getdents d1/da/dc/d21/d7d/d80 0 2024-09-19T06:08:47.407 INFO:tasks.workunit.client.0.smithi037.stdout:3/544: unlink d0/d16/d19/d33/fac 0 2024-09-19T06:08:47.410 INFO:tasks.workunit.client.0.smithi037.stdout:3/545: getdents d0/d16/d19/d33 0 2024-09-19T06:08:47.413 INFO:tasks.workunit.client.0.smithi037.stdout:2/619: read d1/d33/fa1 [332359,45458] 0 2024-09-19T06:08:47.413 INFO:tasks.workunit.client.0.smithi037.stdout:2/620: rmdir d1/da/d95/dce 39 2024-09-19T06:08:47.413 INFO:tasks.workunit.client.0.smithi037.stdout:2/621: readlink d1/d16/l1a 0 2024-09-19T06:08:47.418 INFO:tasks.workunit.client.0.smithi037.stdout:8/791: dread d1/d61/d7e/d8b/f98 [0,4194304] 0 2024-09-19T06:08:47.420 INFO:tasks.workunit.client.0.smithi037.stdout:8/792: rename d1/d61/l6d to d1/d61/d7e/dbc/dc2/d59/da9/l110 0 2024-09-19T06:08:47.420 INFO:tasks.workunit.client.0.smithi037.stdout:8/793: write d1/d61/d7e/dbc/dc2/fc1 [809750,36863] 0 2024-09-19T06:08:47.420 INFO:tasks.workunit.client.0.smithi037.stdout:8/794: chown d1/d61/d7e/d8b/f98 8525 1 2024-09-19T06:08:47.427 INFO:tasks.workunit.client.0.smithi037.stdout:6/561: dwrite d9/dd/d20/f76 [0,4194304] 0 2024-09-19T06:08:47.430 INFO:tasks.workunit.client.0.smithi037.stdout:3/546: dread d0/d5f/fb6 [0,4194304] 0 2024-09-19T06:08:47.430 INFO:tasks.workunit.client.0.smithi037.stdout:3/547: readlink d0/d43/d23/d7a/d77/l92 0 2024-09-19T06:08:47.430 INFO:tasks.workunit.client.0.smithi037.stdout:2/622: write d1/da/d95/fac [3069704,13346] 0 2024-09-19T06:08:47.431 INFO:tasks.workunit.client.0.smithi037.stdout:1/490: dwrite d2/d12/d1e/d75/f88 [0,4194304] 0 2024-09-19T06:08:47.431 INFO:tasks.workunit.client.0.smithi037.stdout:1/491: chown d2/d12/d1d/d47/f72 0 1 2024-09-19T06:08:47.431 INFO:tasks.workunit.client.0.smithi037.stdout:1/492: truncate d2/d12/d1d/d47/f68 2422391 0 2024-09-19T06:08:47.431 INFO:tasks.workunit.client.0.smithi037.stdout:3/548: unlink d0/d43/d23/d7a/d77/d45/d55/f40 0 2024-09-19T06:08:47.432 INFO:tasks.workunit.client.0.smithi037.stdout:2/623: rmdir d1/da/dc/d21/d55 39 2024-09-19T06:08:47.434 INFO:tasks.workunit.client.0.smithi037.stdout:3/549: creat d0/d43/d23/d7a/d77/d51/fb9 x:0 0 0 2024-09-19T06:08:47.435 INFO:tasks.workunit.client.0.smithi037.stdout:2/624: mknod d1/da/d6e/da0/cd6 0 2024-09-19T06:08:47.436 INFO:tasks.workunit.client.0.smithi037.stdout:6/562: write d9/dd/f23 [1639822,118581] 0 2024-09-19T06:08:47.436 INFO:tasks.workunit.client.0.smithi037.stdout:6/563: read - d9/d6e/f8f zero size 2024-09-19T06:08:47.436 INFO:tasks.workunit.client.0.smithi037.stdout:3/550: creat d0/d5f/d70/fba x:0 0 0 2024-09-19T06:08:47.436 INFO:tasks.workunit.client.0.smithi037.stdout:3/551: write d0/d43/d23/d7a/d77/f5c [902524,87195] 0 2024-09-19T06:08:47.437 INFO:tasks.workunit.client.0.smithi037.stdout:1/493: dread d2/d12/d15/f36 [0,4194304] 0 2024-09-19T06:08:47.437 INFO:tasks.workunit.client.0.smithi037.stdout:2/625: mkdir d1/da/dd7 0 2024-09-19T06:08:47.439 INFO:tasks.workunit.client.0.smithi037.stdout:6/564: rename d9/dd/d1c/d4e/d33/l66 to d9/dd/lb9 0 2024-09-19T06:08:47.439 INFO:tasks.workunit.client.0.smithi037.stdout:6/565: truncate d9/fb2 684117 0 2024-09-19T06:08:47.440 INFO:tasks.workunit.client.0.smithi037.stdout:3/552: mknod d0/d16/da6/cbb 0 2024-09-19T06:08:47.450 INFO:tasks.workunit.client.0.smithi037.stdout:2/626: dread d1/d16/d4a/fb7 [0,4194304] 0 2024-09-19T06:08:47.451 INFO:tasks.workunit.client.0.smithi037.stdout:2/627: creat d1/da/d6e/da0/fd8 x:0 0 0 2024-09-19T06:08:47.452 INFO:tasks.workunit.client.0.smithi037.stdout:2/628: unlink d1/da/dc/fd1 0 2024-09-19T06:08:47.453 INFO:tasks.workunit.client.0.smithi037.stdout:2/629: truncate d1/da/dc/d21/f4d 121854 0 2024-09-19T06:08:47.453 INFO:tasks.workunit.client.0.smithi037.stdout:2/630: write d1/da/d95/dce/fcf [517266,69554] 0 2024-09-19T06:08:47.454 INFO:tasks.workunit.client.0.smithi037.stdout:2/631: truncate d1/da/dc/d21/d7d/dab/fc9 151776 0 2024-09-19T06:08:47.454 INFO:tasks.workunit.client.0.smithi037.stdout:2/632: dread - d1/da/dc/d21/d51/fc5 zero size 2024-09-19T06:08:47.454 INFO:tasks.workunit.client.0.smithi037.stdout:2/633: fsync d1/d16/d96/fd3 0 2024-09-19T06:08:47.469 INFO:tasks.workunit.client.0.smithi037.stdout:6/566: dwrite d9/dd/f52 [0,4194304] 0 2024-09-19T06:08:47.471 INFO:tasks.workunit.client.0.smithi037.stdout:6/567: rmdir d9/dd/d1c/d73 39 2024-09-19T06:08:47.472 INFO:tasks.workunit.client.0.smithi037.stdout:6/568: rename d9/dd/d1c/d73/l5f to d9/lba 0 2024-09-19T06:08:47.473 INFO:tasks.workunit.client.0.smithi037.stdout:6/569: symlink d9/dd/d20/lbb 0 2024-09-19T06:08:47.473 INFO:tasks.workunit.client.0.smithi037.stdout:6/570: chown d9/dd/d1c/f41 10 1 2024-09-19T06:08:47.474 INFO:tasks.workunit.client.0.smithi037.stdout:1/494: dwrite d2/d12/d15/d34/f82 [0,4194304] 0 2024-09-19T06:08:47.475 INFO:tasks.workunit.client.0.smithi037.stdout:2/634: dread d1/da/dc/d21/d51/f9c [0,4194304] 0 2024-09-19T06:08:47.476 INFO:tasks.workunit.client.0.smithi037.stdout:1/495: mkdir d2/d12/d15/d95/da0 0 2024-09-19T06:08:47.476 INFO:tasks.workunit.client.0.smithi037.stdout:1/496: truncate d2/d12/d1e/d75/f9c 254844 0 2024-09-19T06:08:47.477 INFO:tasks.workunit.client.0.smithi037.stdout:2/635: mknod d1/da/dc/d21/d55/dbc/cd9 0 2024-09-19T06:08:47.477 INFO:tasks.workunit.client.0.smithi037.stdout:2/636: readlink d1/da/dc/d21/d51/la6 0 2024-09-19T06:08:47.477 INFO:tasks.workunit.client.0.smithi037.stdout:2/637: dread - d1/da/dc/d21/d55/fa4 zero size 2024-09-19T06:08:47.477 INFO:tasks.workunit.client.0.smithi037.stdout:2/638: write d1/da/d95/dce/fcf [592796,96977] 0 2024-09-19T06:08:47.480 INFO:tasks.workunit.client.0.smithi037.stdout:1/497: creat d2/d12/d1e/d2a/d8f/fa1 x:0 0 0 2024-09-19T06:08:47.481 INFO:tasks.workunit.client.0.smithi037.stdout:2/639: symlink d1/da/d6e/lda 0 2024-09-19T06:08:47.482 INFO:tasks.workunit.client.0.smithi037.stdout:1/498: getdents d2/d12 0 2024-09-19T06:08:47.508 INFO:tasks.workunit.client.0.smithi037.stdout:2/640: dwrite d1/d33/fa1 [0,4194304] 0 2024-09-19T06:08:47.508 INFO:tasks.workunit.client.0.smithi037.stdout:1/499: dwrite d2/d12/d1e/f67 [0,4194304] 0 2024-09-19T06:08:47.511 INFO:tasks.workunit.client.0.smithi037.stdout:1/500: symlink d2/d12/d1e/d2a/la2 0 2024-09-19T06:08:47.512 INFO:tasks.workunit.client.0.smithi037.stdout:1/501: stat d2/d12/d1e/d2d/c51 0 2024-09-19T06:08:47.512 INFO:tasks.workunit.client.0.smithi037.stdout:1/502: readlink d2/d12/d1e/d2a/l7a 0 2024-09-19T06:08:47.513 INFO:tasks.workunit.client.0.smithi037.stdout:2/641: write d1/da/dc/d21/d51/f52 [628632,125225] 0 2024-09-19T06:08:47.513 INFO:tasks.workunit.client.0.smithi037.stdout:2/642: write d1/d16/f61 [4795212,30486] 0 2024-09-19T06:08:47.513 INFO:tasks.workunit.client.0.smithi037.stdout:2/643: truncate d1/da/dc/d21/d55/f86 1552842 0 2024-09-19T06:08:47.513 INFO:tasks.workunit.client.0.smithi037.stdout:2/644: write d1/d16/d62/f73 [5013607,121031] 0 2024-09-19T06:08:47.513 INFO:tasks.workunit.client.0.smithi037.stdout:2/645: truncate d1/da/fa5 2739481 0 2024-09-19T06:08:47.514 INFO:tasks.workunit.client.0.smithi037.stdout:2/646: fsync d1/da/dc/d21/d55/dbc/fc8 0 2024-09-19T06:08:47.514 INFO:tasks.workunit.client.0.smithi037.stdout:2/647: chown d1/d6/da3/da8/dbe/fc4 4920234 1 2024-09-19T06:08:47.514 INFO:tasks.workunit.client.0.smithi037.stdout:2/648: chown d1/d16/f91 0 1 2024-09-19T06:08:47.515 INFO:tasks.workunit.client.0.smithi037.stdout:2/649: mknod d1/da/d6e/cdb 0 2024-09-19T06:08:47.516 INFO:tasks.workunit.client.0.smithi037.stdout:2/650: rename d1/da/f6d to d1/d9e/fdc 0 2024-09-19T06:08:47.518 INFO:tasks.workunit.client.0.smithi037.stdout:2/651: creat d1/d6/fdd x:0 0 0 2024-09-19T06:08:47.519 INFO:tasks.workunit.client.0.smithi037.stdout:2/652: mkdir d1/d16/dde 0 2024-09-19T06:08:47.519 INFO:tasks.workunit.client.0.smithi037.stdout:2/653: dread - d1/d33/d4c/f88 zero size 2024-09-19T06:08:47.519 INFO:tasks.workunit.client.0.smithi037.stdout:2/654: fsync d1/d33/d4c/fbf 0 2024-09-19T06:08:47.531 INFO:tasks.workunit.client.0.smithi037.stdout:2/655: dread d1/d33/fa1 [0,4194304] 0 2024-09-19T06:08:47.531 INFO:tasks.workunit.client.0.smithi037.stdout:2/656: readlink d1/d33/d4c/l64 0 2024-09-19T06:08:47.533 INFO:tasks.workunit.client.0.smithi037.stdout:1/503: dwrite d2/d12/d15/d34/f52 [0,4194304] 0 2024-09-19T06:08:47.534 INFO:tasks.workunit.client.0.smithi037.stdout:2/657: write d1/d16/d96/f9b [331113,124589] 0 2024-09-19T06:08:47.534 INFO:tasks.workunit.client.0.smithi037.stdout:2/658: stat d1/da/dc/d21/d7d 0 2024-09-19T06:08:47.549 INFO:tasks.workunit.client.0.smithi037.stdout:0/610: sync 2024-09-19T06:08:47.549 INFO:tasks.workunit.client.0.smithi037.stdout:9/693: sync 2024-09-19T06:08:47.550 INFO:tasks.workunit.client.0.smithi037.stdout:0/611: chown d5/d8/d44/ccb 107 1 2024-09-19T06:08:47.552 INFO:tasks.workunit.client.0.smithi037.stdout:9/694: rename da/dd/d1b/d43/f54 to da/dd/d1b/d23/dbe/ff9 0 2024-09-19T06:08:47.553 INFO:tasks.workunit.client.0.smithi037.stdout:9/695: getdents da/dd/d1b/d23/d6a/d85 0 2024-09-19T06:08:47.553 INFO:tasks.workunit.client.0.smithi037.stdout:9/696: creat da/dd/ffa x:0 0 0 2024-09-19T06:08:47.554 INFO:tasks.workunit.client.0.smithi037.stdout:9/697: write da/dd/d1b/d23/dbe/ff9 [4258950,118748] 0 2024-09-19T06:08:47.555 INFO:tasks.workunit.client.0.smithi037.stdout:2/659: dread d1/f1e [0,4194304] 0 2024-09-19T06:08:47.556 INFO:tasks.workunit.client.0.smithi037.stdout:1/504: dwrite d2/d12/d1e/d75/f94 [0,4194304] 0 2024-09-19T06:08:47.558 INFO:tasks.workunit.client.0.smithi037.stdout:9/698: getdents da/dd/d1b/d23/dbe 0 2024-09-19T06:08:47.558 INFO:tasks.workunit.client.0.smithi037.stdout:9/699: readlink da/dd/d63/d80/lbd 0 2024-09-19T06:08:47.558 INFO:tasks.workunit.client.0.smithi037.stdout:9/700: dread - da/dd/d1b/d23/de9/ff5 zero size 2024-09-19T06:08:47.560 INFO:tasks.workunit.client.0.smithi037.stdout:1/505: rename d2/d12/d1e/f42 to d2/d12/d1e/d2d/d87/fa3 0 2024-09-19T06:08:47.561 INFO:tasks.workunit.client.0.smithi037.stdout:2/660: mknod d1/da/dc/cdf 0 2024-09-19T06:08:47.563 INFO:tasks.workunit.client.0.smithi037.stdout:1/506: symlink d2/la4 0 2024-09-19T06:08:47.564 INFO:tasks.workunit.client.0.smithi037.stdout:1/507: mknod d2/d12/d1d/d6b/d8b/ca5 0 2024-09-19T06:08:47.566 INFO:tasks.workunit.client.0.smithi037.stdout:1/508: mkdir d2/d12/d1e/d2a/d8f/da6 0 2024-09-19T06:08:47.567 INFO:tasks.workunit.client.0.smithi037.stdout:1/509: symlink d2/d12/d1e/la7 0 2024-09-19T06:08:47.570 INFO:tasks.workunit.client.0.smithi037.stdout:2/661: dread d1/d16/f74 [4194304,4194304] 0 2024-09-19T06:08:47.575 INFO:tasks.workunit.client.0.smithi037.stdout:0/612: dwrite d5/d8/f76 [0,4194304] 0 2024-09-19T06:08:47.577 INFO:tasks.workunit.client.0.smithi037.stdout:0/613: symlink d5/d8/d44/da1/ld3 0 2024-09-19T06:08:47.578 INFO:tasks.workunit.client.0.smithi037.stdout:0/614: creat d5/d8/d22/d89/d96/fd4 x:0 0 0 2024-09-19T06:08:47.579 INFO:tasks.workunit.client.0.smithi037.stdout:0/615: chown d5/d8/d11/d15/l36 45 1 2024-09-19T06:08:47.580 INFO:tasks.workunit.client.0.smithi037.stdout:0/616: mkdir d5/dd5 0 2024-09-19T06:08:47.581 INFO:tasks.workunit.client.0.smithi037.stdout:9/701: dread da/dd/d1b/d2f/fb2 [0,4194304] 0 2024-09-19T06:08:47.581 INFO:tasks.workunit.client.0.smithi037.stdout:9/702: stat da/dd/d1b/f4c 0 2024-09-19T06:08:47.581 INFO:tasks.workunit.client.0.smithi037.stdout:0/617: creat d5/fd6 x:0 0 0 2024-09-19T06:08:47.582 INFO:tasks.workunit.client.0.smithi037.stdout:9/703: link da/dd/d1b/d43/f46 da/dd/d1b/d2f/d6f/ffb 0 2024-09-19T06:08:47.583 INFO:tasks.workunit.client.0.smithi037.stdout:9/704: chown da/dd/d63/f90 399565 1 2024-09-19T06:08:47.584 INFO:tasks.workunit.client.0.smithi037.stdout:1/510: dread d2/d12/d15/d34/f82 [0,4194304] 0 2024-09-19T06:08:47.584 INFO:tasks.workunit.client.0.smithi037.stdout:0/618: getdents d5/d18/d68/d85 0 2024-09-19T06:08:47.584 INFO:tasks.workunit.client.0.smithi037.stdout:1/511: chown d2/d12/d1d/f4f 1193861087 1 2024-09-19T06:08:47.585 INFO:tasks.workunit.client.0.smithi037.stdout:0/619: getdents d5/d8/d22/d89/d96/dae 0 2024-09-19T06:08:47.586 INFO:tasks.workunit.client.0.smithi037.stdout:0/620: link d5/d8/d44/d61/c6b d5/d18/d68/d85/dab/dba/cd7 0 2024-09-19T06:08:47.587 INFO:tasks.workunit.client.0.smithi037.stdout:0/621: write d5/d8/d11/d15/f1c [535970,27071] 0 2024-09-19T06:08:47.588 INFO:tasks.workunit.client.0.smithi037.stdout:0/622: getdents d5/d8/d44/d61 0 2024-09-19T06:08:47.588 INFO:tasks.workunit.client.0.smithi037.stdout:0/623: write d5/d8/d22/d89/d96/fc9 [286861,106863] 0 2024-09-19T06:08:47.588 INFO:tasks.workunit.client.0.smithi037.stdout:0/624: readlink d5/d8/d79/d9a/lcd 0 2024-09-19T06:08:47.591 INFO:tasks.workunit.client.0.smithi037.stdout:2/662: dwrite d1/d16/d4a/f75 [4194304,4194304] 0 2024-09-19T06:08:47.591 INFO:tasks.workunit.client.0.smithi037.stdout:2/663: write d1/da/d95/dce/fcf [870182,54719] 0 2024-09-19T06:08:47.592 INFO:tasks.workunit.client.0.smithi037.stdout:2/664: mkdir d1/da/dc/d21/d55/dbc/db0/de0 0 2024-09-19T06:08:47.593 INFO:tasks.workunit.client.0.smithi037.stdout:2/665: getdents d1/d6/da3/da8 0 2024-09-19T06:08:47.594 INFO:tasks.workunit.client.0.smithi037.stdout:2/666: symlink d1/d16/db1/le1 0 2024-09-19T06:08:47.594 INFO:tasks.workunit.client.0.smithi037.stdout:9/705: dread da/dd/d1b/d23/d6a/d82/fd7 [0,4194304] 0 2024-09-19T06:08:47.594 INFO:tasks.workunit.client.0.smithi037.stdout:9/706: fsync da/d4d/f87 0 2024-09-19T06:08:47.595 INFO:tasks.workunit.client.0.smithi037.stdout:2/667: link d1/d33/d4c/f57 d1/d16/fe2 0 2024-09-19T06:08:47.595 INFO:tasks.workunit.client.0.smithi037.stdout:2/668: readlink d1/d16/l1d 0 2024-09-19T06:08:47.598 INFO:tasks.workunit.client.0.smithi037.stdout:1/512: dread d2/d12/d15/d34/f52 [0,4194304] 0 2024-09-19T06:08:47.614 INFO:tasks.workunit.client.0.smithi037.stdout:1/513: dread d2/f10 [0,4194304] 0 2024-09-19T06:08:47.615 INFO:tasks.workunit.client.0.smithi037.stdout:0/625: dwrite d5/d8/d11/f78 [0,4194304] 0 2024-09-19T06:08:47.620 INFO:tasks.workunit.client.0.smithi037.stdout:9/707: dwrite da/dd/d1b/d2f/fb2 [4194304,4194304] 0 2024-09-19T06:08:47.620 INFO:tasks.workunit.client.0.smithi037.stdout:9/708: chown da/dd/d63/d80/dc4/fe0 128 1 2024-09-19T06:08:47.620 INFO:tasks.workunit.client.0.smithi037.stdout:9/709: write da/dd/d1b/d23/dbe/fdf [282285,104702] 0 2024-09-19T06:08:47.622 INFO:tasks.workunit.client.0.smithi037.stdout:5/552: sync 2024-09-19T06:08:47.624 INFO:tasks.workunit.client.0.smithi037.stdout:5/553: symlink d2/lb6 0 2024-09-19T06:08:47.624 INFO:tasks.workunit.client.0.smithi037.stdout:5/554: dread - d2/d12/d28/d22/f8b zero size 2024-09-19T06:08:47.624 INFO:tasks.workunit.client.0.smithi037.stdout:5/555: chown d2/d10/da1 17 1 2024-09-19T06:08:47.624 INFO:tasks.workunit.client.0.smithi037.stdout:5/556: write d2/d12/d28/d57/f75 [1224425,48851] 0 2024-09-19T06:08:47.624 INFO:tasks.workunit.client.0.smithi037.stdout:5/557: dread - d2/d12/d28/d22/d35/f77 zero size 2024-09-19T06:08:47.624 INFO:tasks.workunit.client.0.smithi037.stdout:5/558: stat d2/f52 0 2024-09-19T06:08:47.625 INFO:tasks.workunit.client.0.smithi037.stdout:2/669: write d1/d16/d62/fa2 [6641924,20093] 0 2024-09-19T06:08:47.640 INFO:tasks.workunit.client.0.smithi037.stdout:0/626: dwrite d5/fa3 [0,4194304] 0 2024-09-19T06:08:47.643 INFO:tasks.workunit.client.0.smithi037.stdout:0/627: truncate d5/d8/d11/d15/d8d/f9f 1019436 0 2024-09-19T06:08:47.648 INFO:tasks.workunit.client.0.smithi037.stdout:1/514: dwrite d2/d12/d15/d34/f46 [0,4194304] 0 2024-09-19T06:08:47.650 INFO:tasks.workunit.client.0.smithi037.stdout:1/515: mknod d2/d12/d1e/d2a/d2e/ca8 0 2024-09-19T06:08:47.650 INFO:tasks.workunit.client.0.smithi037.stdout:9/710: dwrite da/dd/d1b/d23/dbe/ff9 [4194304,4194304] 0 2024-09-19T06:08:47.654 INFO:tasks.workunit.client.0.smithi037.stdout:2/670: dwrite d1/d6/f24 [0,4194304] 0 2024-09-19T06:08:47.654 INFO:tasks.workunit.client.0.smithi037.stdout:2/671: rename d1/d6 to d1/d6/da3/da8/dbe/de3 22 2024-09-19T06:08:47.654 INFO:tasks.workunit.client.0.smithi037.stdout:2/672: readlink d1/da/l27 0 2024-09-19T06:08:47.654 INFO:tasks.workunit.client.0.smithi037.stdout:5/559: dwrite d2/d12/d28/d22/d4a/d9f/f69 [0,4194304] 0 2024-09-19T06:08:47.655 INFO:tasks.workunit.client.0.smithi037.stdout:9/711: link da/dd/d31/c35 da/dd/d1b/d23/d6a/d82/dde/cfc 0 2024-09-19T06:08:47.657 INFO:tasks.workunit.client.0.smithi037.stdout:2/673: link d1/d16/db1/lbd d1/da/dc/d21/d55/dbc/db0/le4 0 2024-09-19T06:08:47.657 INFO:tasks.workunit.client.0.smithi037.stdout:2/674: write d1/da/d95/f97 [1778762,47041] 0 2024-09-19T06:08:47.658 INFO:tasks.workunit.client.0.smithi037.stdout:0/628: dread d5/d8/d22/f47 [0,4194304] 0 2024-09-19T06:08:47.661 INFO:tasks.workunit.client.0.smithi037.stdout:5/560: symlink d2/d12/d28/d22/d87/da8/lb7 0 2024-09-19T06:08:47.662 INFO:tasks.workunit.client.0.smithi037.stdout:7/615: sync 2024-09-19T06:08:47.663 INFO:tasks.workunit.client.0.smithi037.stdout:2/675: link d1/da/dc/d21/d7d/d80/dc7/fcc d1/d6/da3/da8/fe5 0 2024-09-19T06:08:47.665 INFO:tasks.workunit.client.0.smithi037.stdout:0/629: mkdir d5/d8/d44/d48/dd1/dd8 0 2024-09-19T06:08:47.666 INFO:tasks.workunit.client.0.smithi037.stdout:5/561: mkdir d2/d12/d28/db8 0 2024-09-19T06:08:47.667 INFO:tasks.workunit.client.0.smithi037.stdout:7/616: mknod d6/dc/df/d7e/d99/cc5 0 2024-09-19T06:08:47.667 INFO:tasks.workunit.client.0.smithi037.stdout:7/617: read - d6/d20/fa7 zero size 2024-09-19T06:08:47.668 INFO:tasks.workunit.client.0.smithi037.stdout:7/618: write d6/dc/f89 [4454613,77863] 0 2024-09-19T06:08:47.668 INFO:tasks.workunit.client.0.smithi037.stdout:7/619: chown d6/d21/c27 254061772 1 2024-09-19T06:08:47.668 INFO:tasks.workunit.client.0.smithi037.stdout:3/553: sync 2024-09-19T06:08:47.668 INFO:tasks.workunit.client.0.smithi037.stdout:4/689: sync 2024-09-19T06:08:47.668 INFO:tasks.workunit.client.0.smithi037.stdout:6/571: sync 2024-09-19T06:08:47.672 INFO:tasks.workunit.client.0.smithi037.stdout:2/676: rename d1/da/f3e to d1/da/dc/d21/d55/fe6 0 2024-09-19T06:08:47.672 INFO:tasks.workunit.client.0.smithi037.stdout:0/630: symlink d5/d18/d68/d85/dab/ld9 0 2024-09-19T06:08:47.673 INFO:tasks.workunit.client.0.smithi037.stdout:3/554: unlink d0/f2 0 2024-09-19T06:08:47.674 INFO:tasks.workunit.client.0.smithi037.stdout:8/795: sync 2024-09-19T06:08:47.675 INFO:tasks.workunit.client.0.smithi037.stdout:9/712: dwrite da/dd/d1b/d23/d6a/d8f/fb7 [0,4194304] 0 2024-09-19T06:08:47.676 INFO:tasks.workunit.client.0.smithi037.stdout:9/713: stat da/dd/l4b 0 2024-09-19T06:08:47.676 INFO:tasks.workunit.client.0.smithi037.stdout:0/631: rmdir d5/d8/d44/d48/dd1 39 2024-09-19T06:08:47.676 INFO:tasks.workunit.client.0.smithi037.stdout:3/555: mknod d0/d5f/da0/cbc 0 2024-09-19T06:08:47.677 INFO:tasks.workunit.client.0.smithi037.stdout:3/556: write d0/d5f/d70/fba [58117,55306] 0 2024-09-19T06:08:47.677 INFO:tasks.workunit.client.0.smithi037.stdout:7/620: dread d6/d21/f5f [0,4194304] 0 2024-09-19T06:08:47.679 INFO:tasks.workunit.client.0.smithi037.stdout:8/796: dread d1/d61/d68/fcb [0,4194304] 0 2024-09-19T06:08:47.679 INFO:tasks.workunit.client.0.smithi037.stdout:9/714: rename da/dd/d1b/d23/dbe/fdf to da/dd/d1b/d23/d6a/d85/ffd 0 2024-09-19T06:08:47.680 INFO:tasks.workunit.client.0.smithi037.stdout:0/632: fsync d5/d8/d11/d15/f31 0 2024-09-19T06:08:47.681 INFO:tasks.workunit.client.0.smithi037.stdout:3/557: mkdir d0/d16/d19/d33/d87/dbd 0 2024-09-19T06:08:47.684 INFO:tasks.workunit.client.0.smithi037.stdout:4/690: dread d0/f41 [0,4194304] 0 2024-09-19T06:08:47.684 INFO:tasks.workunit.client.0.smithi037.stdout:7/621: rmdir d6/d20/d4b/d60/d33/dac 0 2024-09-19T06:08:47.685 INFO:tasks.workunit.client.0.smithi037.stdout:8/797: creat d1/d61/d7e/dbc/dc2/d9b/f111 x:0 0 0 2024-09-19T06:08:47.687 INFO:tasks.workunit.client.0.smithi037.stdout:9/715: link da/d4d/l74 da/dd/d63/lfe 0 2024-09-19T06:08:47.687 INFO:tasks.workunit.client.0.smithi037.stdout:9/716: stat da/dd/d1b/d23/dbe/ceb 0 2024-09-19T06:08:47.688 INFO:tasks.workunit.client.0.smithi037.stdout:4/691: dread d0/d6/f75 [0,4194304] 0 2024-09-19T06:08:47.688 INFO:tasks.workunit.client.0.smithi037.stdout:4/692: stat d0/d2/d37/fa1 0 2024-09-19T06:08:47.688 INFO:tasks.workunit.client.0.smithi037.stdout:0/633: mknod d5/d8/d11/cda 0 2024-09-19T06:08:47.690 INFO:tasks.workunit.client.0.smithi037.stdout:3/558: mknod d0/d16/d19/d1d/d5e/da9/cbe 0 2024-09-19T06:08:47.690 INFO:tasks.workunit.client.0.smithi037.stdout:3/559: readlink d0/d43/d23/d7a/d77/d45/l95 0 2024-09-19T06:08:47.690 INFO:tasks.workunit.client.0.smithi037.stdout:3/560: write d0/d16/d19/d1d/f39 [1236100,26123] 0 2024-09-19T06:08:47.690 INFO:tasks.workunit.client.0.smithi037.stdout:3/561: dread - d0/d16/d19/d33/d87/faa zero size 2024-09-19T06:08:47.691 INFO:tasks.workunit.client.0.smithi037.stdout:7/622: unlink d6/dc/fd 0 2024-09-19T06:08:47.692 INFO:tasks.workunit.client.0.smithi037.stdout:7/623: readlink d6/d20/d4b/d60/d33/d61/l7a 0 2024-09-19T06:08:47.693 INFO:tasks.workunit.client.0.smithi037.stdout:8/798: symlink d1/d61/d7e/dbc/dc2/d59/daf/l112 0 2024-09-19T06:08:47.694 INFO:tasks.workunit.client.0.smithi037.stdout:9/717: truncate da/dd/d1b/d23/d6a/d82/f48 220076 0 2024-09-19T06:08:47.694 INFO:tasks.workunit.client.0.smithi037.stdout:9/718: read - da/dd/d63/fc1 zero size 2024-09-19T06:08:47.696 INFO:tasks.workunit.client.0.smithi037.stdout:0/634: mkdir d5/d8/d79/d9a/ddb 0 2024-09-19T06:08:47.697 INFO:tasks.workunit.client.0.smithi037.stdout:3/562: getdents d0/d5f/d70 0 2024-09-19T06:08:47.697 INFO:tasks.workunit.client.0.smithi037.stdout:2/677: dwrite d1/d6/f7b [0,4194304] 0 2024-09-19T06:08:47.697 INFO:tasks.workunit.client.0.smithi037.stdout:2/678: write d1/da/fa5 [2403328,97560] 0 2024-09-19T06:08:47.698 INFO:tasks.workunit.client.0.smithi037.stdout:8/799: mkdir d1/d61/d7e/dbc/dc0/d113 0 2024-09-19T06:08:47.698 INFO:tasks.workunit.client.0.smithi037.stdout:5/562: dwrite d2/d12/d24/d97/f9c [0,4194304] 0 2024-09-19T06:08:47.700 INFO:tasks.workunit.client.0.smithi037.stdout:3/563: unlink d0/d43/d23/f6d 0 2024-09-19T06:08:47.700 INFO:tasks.workunit.client.0.smithi037.stdout:3/564: write d0/d43/d23/f72 [122580,117486] 0 2024-09-19T06:08:47.703 INFO:tasks.workunit.client.0.smithi037.stdout:2/679: creat d1/d9e/fe7 x:0 0 0 2024-09-19T06:08:47.704 INFO:tasks.workunit.client.0.smithi037.stdout:8/800: mkdir d1/d61/d7e/dbc/dc2/d59/d114 0 2024-09-19T06:08:47.705 INFO:tasks.workunit.client.0.smithi037.stdout:5/563: truncate d2/d12/d24/d58/d8e/f94 77835 0 2024-09-19T06:08:47.708 INFO:tasks.workunit.client.0.smithi037.stdout:3/565: unlink d0/d16/d19/f59 0 2024-09-19T06:08:47.712 INFO:tasks.workunit.client.0.smithi037.stdout:2/680: creat d1/fe8 x:0 0 0 2024-09-19T06:08:47.714 INFO:tasks.workunit.client.0.smithi037.stdout:5/564: creat d2/d12/d28/d22/d4a/d9f/fb9 x:0 0 0 2024-09-19T06:08:47.716 INFO:tasks.workunit.client.0.smithi037.stdout:2/681: truncate d1/d16/d62/f73 4756204 0 2024-09-19T06:08:47.716 INFO:tasks.workunit.client.0.smithi037.stdout:0/635: write d5/d8/d11/f78 [4186139,109950] 0 2024-09-19T06:08:47.718 INFO:tasks.workunit.client.0.smithi037.stdout:2/682: symlink d1/d6/le9 0 2024-09-19T06:08:47.719 INFO:tasks.workunit.client.0.smithi037.stdout:2/683: mknod d1/da/dc/d21/d55/dbc/db0/cea 0 2024-09-19T06:08:47.719 INFO:tasks.workunit.client.0.smithi037.stdout:2/684: truncate d1/da/dc/f18 4604487 0 2024-09-19T06:08:47.725 INFO:tasks.workunit.client.0.smithi037.stdout:4/693: dwrite d0/d6/d45/d4a/f5c [0,4194304] 0 2024-09-19T06:08:47.726 INFO:tasks.workunit.client.0.smithi037.stdout:9/719: dwrite da/dd/d1b/d23/d6a/d8f/fca [0,4194304] 0 2024-09-19T06:08:47.726 INFO:tasks.workunit.client.0.smithi037.stdout:9/720: stat da/dd/d31/c6b 0 2024-09-19T06:08:47.731 INFO:tasks.workunit.client.0.smithi037.stdout:3/566: read d0/d16/d19/d33/f9d [3975306,49196] 0 2024-09-19T06:08:47.731 INFO:tasks.workunit.client.0.smithi037.stdout:3/567: chown d0/d43/d23/d7a/d77/f3e 241942 1 2024-09-19T06:08:47.731 INFO:tasks.workunit.client.0.smithi037.stdout:7/624: dwrite d6/f92 [0,4194304] 0 2024-09-19T06:08:47.735 INFO:tasks.workunit.client.0.smithi037.stdout:3/568: link d0/d16/d19/d1d/d5e/f6c d0/d16/da6/fbf 0 2024-09-19T06:08:47.744 INFO:tasks.workunit.client.0.smithi037.stdout:9/721: dread da/dd/d1b/d23/d6a/d8f/fca [0,4194304] 0 2024-09-19T06:08:47.745 INFO:tasks.workunit.client.0.smithi037.stdout:9/722: mkdir da/dd/d63/dd3/dff 0 2024-09-19T06:08:47.745 INFO:tasks.workunit.client.0.smithi037.stdout:9/723: write da/dd/d1b/d2f/d6d/db4/ded/f78 [1552116,28952] 0 2024-09-19T06:08:47.746 INFO:tasks.workunit.client.0.smithi037.stdout:9/724: mkdir da/dd/d1b/d23/d6a/d8f/da4/d100 0 2024-09-19T06:08:47.747 INFO:tasks.workunit.client.0.smithi037.stdout:2/685: write d1/d16/fe2 [3711949,13466] 0 2024-09-19T06:08:47.748 INFO:tasks.workunit.client.0.smithi037.stdout:0/636: dwrite d5/d8/d11/d15/fc8 [0,4194304] 0 2024-09-19T06:08:47.748 INFO:tasks.workunit.client.0.smithi037.stdout:0/637: chown d5/d8/d11/d15/d21/f4b 33939 1 2024-09-19T06:08:47.748 INFO:tasks.workunit.client.0.smithi037.stdout:9/725: mkdir da/dd/d63/d80/dc4/d101 0 2024-09-19T06:08:47.748 INFO:tasks.workunit.client.0.smithi037.stdout:4/694: dread d0/d6/d45/d4a/f8c [0,4194304] 0 2024-09-19T06:08:47.748 INFO:tasks.workunit.client.0.smithi037.stdout:4/695: fsync d0/d6/d1b/f55 0 2024-09-19T06:08:47.748 INFO:tasks.workunit.client.0.smithi037.stdout:4/696: read - d0/d6/d1b/d20/fd6 zero size 2024-09-19T06:08:47.748 INFO:tasks.workunit.client.0.smithi037.stdout:4/697: read d0/d6/d1b/f78 [151278,30698] 0 2024-09-19T06:08:47.749 INFO:tasks.workunit.client.0.smithi037.stdout:2/686: mknod d1/d16/db1/ceb 0 2024-09-19T06:08:47.750 INFO:tasks.workunit.client.0.smithi037.stdout:5/565: dwrite d2/d12/f27 [0,4194304] 0 2024-09-19T06:08:47.751 INFO:tasks.workunit.client.0.smithi037.stdout:9/726: mknod da/dec/c102 0 2024-09-19T06:08:47.762 INFO:tasks.workunit.client.0.smithi037.stdout:4/698: rmdir d0/d6/d1b/d20/d4d 39 2024-09-19T06:08:47.762 INFO:tasks.workunit.client.0.smithi037.stdout:0/638: mkdir d5/d8/d11/d15/ddc 0 2024-09-19T06:08:47.762 INFO:tasks.workunit.client.0.smithi037.stdout:5/566: rmdir d2/d5c/da7 0 2024-09-19T06:08:47.762 INFO:tasks.workunit.client.0.smithi037.stdout:5/567: write d2/d12/d28/d22/d87/fab [260426,125954] 0 2024-09-19T06:08:47.763 INFO:tasks.workunit.client.0.smithi037.stdout:5/568: chown d2/d12/d28/d22/cad 888 1 2024-09-19T06:08:47.763 INFO:tasks.workunit.client.0.smithi037.stdout:7/625: dwrite d6/d20/d34/f50 [0,4194304] 0 2024-09-19T06:08:47.764 INFO:tasks.workunit.client.0.smithi037.stdout:7/626: chown d6/dc/c6f 0 1 2024-09-19T06:08:47.764 INFO:tasks.workunit.client.0.smithi037.stdout:7/627: dread - d6/d20/d71/dbb/fc2 zero size 2024-09-19T06:08:47.764 INFO:tasks.workunit.client.0.smithi037.stdout:7/628: write d6/dc/d22/d59/da8/faa [5501096,127040] 0 2024-09-19T06:08:47.764 INFO:tasks.workunit.client.0.smithi037.stdout:7/629: fsync d6/d20/fb9 0 2024-09-19T06:08:47.774 INFO:tasks.workunit.client.0.smithi037.stdout:3/569: dwrite d0/d16/d19/d1d/d7c/fb0 [0,4194304] 0 2024-09-19T06:08:47.776 INFO:tasks.workunit.client.0.smithi037.stdout:3/570: creat d0/d5f/fc0 x:0 0 0 2024-09-19T06:08:47.776 INFO:tasks.workunit.client.0.smithi037.stdout:3/571: stat d0/d16/d19/d33/c49 0 2024-09-19T06:08:47.776 INFO:tasks.workunit.client.0.smithi037.stdout:3/572: dread - d0/d16/d19/d1d/d5e/f6c zero size 2024-09-19T06:08:47.776 INFO:tasks.workunit.client.0.smithi037.stdout:9/727: dwrite da/d4d/fc0 [0,4194304] 0 2024-09-19T06:08:47.777 INFO:tasks.workunit.client.0.smithi037.stdout:3/573: creat d0/d5f/da0/fc1 x:0 0 0 2024-09-19T06:08:47.777 INFO:tasks.workunit.client.0.smithi037.stdout:3/574: chown d0/d43/d23/d7a/d77/d51 8430575 1 2024-09-19T06:08:47.777 INFO:tasks.workunit.client.0.smithi037.stdout:3/575: chown d0/d43/f4c 989651329 1 2024-09-19T06:08:47.778 INFO:tasks.workunit.client.0.smithi037.stdout:0/639: write d5/d17/fad [1767638,100982] 0 2024-09-19T06:08:47.778 INFO:tasks.workunit.client.0.smithi037.stdout:0/640: write d5/d8/d22/d89/d96/fc9 [350424,84155] 0 2024-09-19T06:08:47.778 INFO:tasks.workunit.client.0.smithi037.stdout:0/641: dread - d5/f9c zero size 2024-09-19T06:08:47.778 INFO:tasks.workunit.client.0.smithi037.stdout:9/728: creat da/dd/d1b/d23/d6a/d8f/dac/f103 x:0 0 0 2024-09-19T06:08:47.779 INFO:tasks.workunit.client.0.smithi037.stdout:3/576: truncate d0/f7 3052908 0 2024-09-19T06:08:47.780 INFO:tasks.workunit.client.0.smithi037.stdout:0/642: rmdir d5/d8/d44/d48/dd1/dd8 0 2024-09-19T06:08:47.780 INFO:tasks.workunit.client.0.smithi037.stdout:0/643: readlink d5/d18/d68/d85/dab/ld9 0 2024-09-19T06:08:47.781 INFO:tasks.workunit.client.0.smithi037.stdout:9/729: creat da/dd/d1b/d23/de9/f104 x:0 0 0 2024-09-19T06:08:47.781 INFO:tasks.workunit.client.0.smithi037.stdout:9/730: stat da/dd/d1b/d43/f46 0 2024-09-19T06:08:47.782 INFO:tasks.workunit.client.0.smithi037.stdout:9/731: chown da/dd/d1b/d2f/f70 0 1 2024-09-19T06:08:47.783 INFO:tasks.workunit.client.0.smithi037.stdout:3/577: symlink d0/d16/lc2 0 2024-09-19T06:08:47.783 INFO:tasks.workunit.client.0.smithi037.stdout:3/578: write d0/d16/f71 [1440833,652] 0 2024-09-19T06:08:47.783 INFO:tasks.workunit.client.0.smithi037.stdout:3/579: fdatasync d0/d16/d19/d1d/f39 0 2024-09-19T06:08:47.783 INFO:tasks.workunit.client.0.smithi037.stdout:0/644: dread d5/d18/d68/d85/f99 [0,4194304] 0 2024-09-19T06:08:47.784 INFO:tasks.workunit.client.0.smithi037.stdout:0/645: chown d5/d8/d11/d32/f43 18971 1 2024-09-19T06:08:47.784 INFO:tasks.workunit.client.0.smithi037.stdout:3/580: mkdir d0/d43/d23/d7a/d77/dc3 0 2024-09-19T06:08:47.784 INFO:tasks.workunit.client.0.smithi037.stdout:5/569: dread d2/d12/d24/f51 [0,4194304] 0 2024-09-19T06:08:47.786 INFO:tasks.workunit.client.0.smithi037.stdout:0/646: rename d5/d20/d34/f91 to d5/d17/d6e/fdd 0 2024-09-19T06:08:47.786 INFO:tasks.workunit.client.0.smithi037.stdout:0/647: fdatasync d5/d8/d44/d48/f65 0 2024-09-19T06:08:47.787 INFO:tasks.workunit.client.0.smithi037.stdout:5/570: chown d2/d12/d28/d22/d4a/l68 7342925 1 2024-09-19T06:08:47.787 INFO:tasks.workunit.client.0.smithi037.stdout:5/571: write d2/d12/f26 [923487,101121] 0 2024-09-19T06:08:47.788 INFO:tasks.workunit.client.0.smithi037.stdout:5/572: fdatasync d2/d10/da1/fb5 0 2024-09-19T06:08:47.791 INFO:tasks.workunit.client.0.smithi037.stdout:0/648: truncate d5/d8/f76 752283 0 2024-09-19T06:08:47.791 INFO:tasks.workunit.client.0.smithi037.stdout:7/630: write d6/dc/df/d7e/f88 [3087006,89168] 0 2024-09-19T06:08:47.793 INFO:tasks.workunit.client.0.smithi037.stdout:0/649: rename d5/d18/d68/d85/c8e to d5/d8/cde 0 2024-09-19T06:08:47.795 INFO:tasks.workunit.client.0.smithi037.stdout:7/631: mkdir d6/dc/dc6 0 2024-09-19T06:08:47.796 INFO:tasks.workunit.client.0.smithi037.stdout:9/732: dread da/dd/d1b/f21 [4194304,4194304] 0 2024-09-19T06:08:47.796 INFO:tasks.workunit.client.0.smithi037.stdout:0/650: creat d5/d8/d11/d15/d8d/fdf x:0 0 0 2024-09-19T06:08:47.802 INFO:tasks.workunit.client.0.smithi037.stdout:7/632: mkdir d6/d21/d68/dc7 0 2024-09-19T06:08:47.803 INFO:tasks.workunit.client.0.smithi037.stdout:0/651: mkdir d5/d8/d11/d15/d8d/de0 0 2024-09-19T06:08:47.803 INFO:tasks.workunit.client.0.smithi037.stdout:7/633: write d6/d20/f6c [918277,75835] 0 2024-09-19T06:08:47.806 INFO:tasks.workunit.client.0.smithi037.stdout:0/652: mkdir d5/d8/d79/de1 0 2024-09-19T06:08:47.807 INFO:tasks.workunit.client.0.smithi037.stdout:7/634: creat d6/dc/d22/fc8 x:0 0 0 2024-09-19T06:08:47.808 INFO:tasks.workunit.client.0.smithi037.stdout:0/653: mkdir d5/d8/d44/d48/dd1/de2 0 2024-09-19T06:08:47.809 INFO:tasks.workunit.client.0.smithi037.stdout:5/573: dwrite d2/d12/f4f [0,4194304] 0 2024-09-19T06:08:47.809 INFO:tasks.workunit.client.0.smithi037.stdout:7/635: rename d6/dc/df/f41 to d6/dc/fc9 0 2024-09-19T06:08:47.810 INFO:tasks.workunit.client.0.smithi037.stdout:0/654: creat d5/d8/d44/d48/dd1/fe3 x:0 0 0 2024-09-19T06:08:47.810 INFO:tasks.workunit.client.0.smithi037.stdout:0/655: truncate d5/d17/f5f 1591585 0 2024-09-19T06:08:47.811 INFO:tasks.workunit.client.0.smithi037.stdout:5/574: symlink d2/d12/d28/d22/d4a/d9e/lba 0 2024-09-19T06:08:47.813 INFO:tasks.workunit.client.0.smithi037.stdout:7/636: rename d6/d20/fa7 to d6/dc/df/d7e/d99/fca 0 2024-09-19T06:08:47.813 INFO:tasks.workunit.client.0.smithi037.stdout:7/637: write d6/f3a [1039092,78550] 0 2024-09-19T06:08:47.814 INFO:tasks.workunit.client.0.smithi037.stdout:5/575: unlink d2/d12/d28/d22/d53/f89 0 2024-09-19T06:08:47.816 INFO:tasks.workunit.client.0.smithi037.stdout:0/656: rename d5/d8/d22/l7d to d5/d8/d44/d48/daf/le4 0 2024-09-19T06:08:47.817 INFO:tasks.workunit.client.0.smithi037.stdout:5/576: rename d2/d12/d28/d22/d35/f77 to d2/d12/d28/d22/d35/fbb 0 2024-09-19T06:08:47.817 INFO:tasks.workunit.client.0.smithi037.stdout:9/733: dwrite da/dd/d1b/d2f/fdd [0,4194304] 0 2024-09-19T06:08:47.820 INFO:tasks.workunit.client.0.smithi037.stdout:5/577: truncate d2/d12/d24/f70 2886057 0 2024-09-19T06:08:47.821 INFO:tasks.workunit.client.0.smithi037.stdout:9/734: creat da/dd/d1b/d2f/dcc/de7/f105 x:0 0 0 2024-09-19T06:08:47.821 INFO:tasks.workunit.client.0.smithi037.stdout:9/735: fsync da/dd/d1b/d23/d6a/d8f/fca 0 2024-09-19T06:08:47.821 INFO:tasks.workunit.client.0.smithi037.stdout:5/578: dread d2/d12/d28/d22/d4a/d9e/fb1 [0,4194304] 0 2024-09-19T06:08:47.822 INFO:tasks.workunit.client.0.smithi037.stdout:9/736: symlink da/dd/d1b/d23/d6a/d8f/dac/ddc/l106 0 2024-09-19T06:08:47.824 INFO:tasks.workunit.client.0.smithi037.stdout:5/579: mkdir d2/d12/d24/d97/dbc 0 2024-09-19T06:08:47.824 INFO:tasks.workunit.client.0.smithi037.stdout:5/580: chown d2/d12/f26 35 1 2024-09-19T06:08:47.824 INFO:tasks.workunit.client.0.smithi037.stdout:5/581: read - d2/d12/d28/d22/f8b zero size 2024-09-19T06:08:47.824 INFO:tasks.workunit.client.0.smithi037.stdout:9/737: creat da/dd/d63/f107 x:0 0 0 2024-09-19T06:08:47.826 INFO:tasks.workunit.client.0.smithi037.stdout:9/738: creat da/d4d/dbb/f108 x:0 0 0 2024-09-19T06:08:47.826 INFO:tasks.workunit.client.0.smithi037.stdout:9/739: write da/d4d/dbb/f108 [383001,88878] 0 2024-09-19T06:08:47.827 INFO:tasks.workunit.client.0.smithi037.stdout:9/740: getdents da/dd/d1b/d23/d6a 0 2024-09-19T06:08:47.828 INFO:tasks.workunit.client.0.smithi037.stdout:9/741: mknod da/dd/d1b/d2f/d6f/c109 0 2024-09-19T06:08:47.828 INFO:tasks.workunit.client.0.smithi037.stdout:9/742: stat da/dd/d1b/d2f/d6d/dce 0 2024-09-19T06:08:47.828 INFO:tasks.workunit.client.0.smithi037.stdout:7/638: write d6/d20/d34/d49/f5e [3235816,1991] 0 2024-09-19T06:08:47.828 INFO:tasks.workunit.client.0.smithi037.stdout:7/639: chown d6/dc/l5b 1652 1 2024-09-19T06:08:47.829 INFO:tasks.workunit.client.0.smithi037.stdout:7/640: chown d6/d20/d34/d49/la9 808337 1 2024-09-19T06:08:47.830 INFO:tasks.workunit.client.0.smithi037.stdout:9/743: rename da/dd/d1b/d62/fa1 to da/dd/d1b/d23/d6a/d82/f10a 0 2024-09-19T06:08:47.833 INFO:tasks.workunit.client.0.smithi037.stdout:7/641: symlink d6/d20/d34/dc0/lcb 0 2024-09-19T06:08:47.835 INFO:tasks.workunit.client.0.smithi037.stdout:9/744: mknod da/dd/d1b/d2f/c10b 0 2024-09-19T06:08:47.836 INFO:tasks.workunit.client.0.smithi037.stdout:9/745: link da/dd/d31/c6b da/d57/c10c 0 2024-09-19T06:08:47.836 INFO:tasks.workunit.client.0.smithi037.stdout:9/746: fdatasync da/dd/d1b/d23/d6a/d8f/dac/f103 0 2024-09-19T06:08:47.837 INFO:tasks.workunit.client.0.smithi037.stdout:9/747: symlink da/dd/d1b/d23/d6a/d82/dde/l10d 0 2024-09-19T06:08:47.838 INFO:tasks.workunit.client.0.smithi037.stdout:5/582: read d2/f7a [3029089,78860] 0 2024-09-19T06:08:47.838 INFO:tasks.workunit.client.0.smithi037.stdout:9/748: mkdir da/db3/d10e 0 2024-09-19T06:08:47.839 INFO:tasks.workunit.client.0.smithi037.stdout:9/749: mkdir da/dd/d31/d10f 0 2024-09-19T06:08:47.839 INFO:tasks.workunit.client.0.smithi037.stdout:0/657: dwrite d5/d20/faa [0,4194304] 0 2024-09-19T06:08:47.841 INFO:tasks.workunit.client.0.smithi037.stdout:9/750: rename da/d4d/fc0 to da/dd/d1b/d23/d6a/d85/f110 0 2024-09-19T06:08:47.854 INFO:tasks.workunit.client.0.smithi037.stdout:5/583: dread d2/d5c/f7b [0,4194304] 0 2024-09-19T06:08:47.855 INFO:tasks.workunit.client.0.smithi037.stdout:0/658: mkdir d5/dd5/de5 0 2024-09-19T06:08:47.859 INFO:tasks.workunit.client.0.smithi037.stdout:7/642: write d6/dc/fc9 [229161,84511] 0 2024-09-19T06:08:47.859 INFO:tasks.workunit.client.0.smithi037.stdout:7/643: fdatasync d6/d20/d4b/d60/d33/f57 0 2024-09-19T06:08:47.859 INFO:tasks.workunit.client.0.smithi037.stdout:7/644: truncate d6/d20/d34/f93 1858127 0 2024-09-19T06:08:47.859 INFO:tasks.workunit.client.0.smithi037.stdout:7/645: write d6/d21/f52 [620099,66023] 0 2024-09-19T06:08:47.859 INFO:tasks.workunit.client.0.smithi037.stdout:0/659: rename d5/d8/c88 to d5/d18/ce6 0 2024-09-19T06:08:47.859 INFO:tasks.workunit.client.0.smithi037.stdout:0/660: stat d5/d18/d68/d85 0 2024-09-19T06:08:47.861 INFO:tasks.workunit.client.0.smithi037.stdout:0/661: mkdir d5/d8/d22/d89/de7 0 2024-09-19T06:08:47.865 INFO:tasks.workunit.client.0.smithi037.stdout:0/662: creat d5/d8/d22/d89/d96/dc5/fe8 x:0 0 0 2024-09-19T06:08:47.871 INFO:tasks.workunit.client.0.smithi037.stdout:0/663: rename d5/d8/d11/d15 to d5/dd5/de9 0 2024-09-19T06:08:47.872 INFO:tasks.workunit.client.0.smithi037.stdout:7/646: dread d6/d20/f6c [0,4194304] 0 2024-09-19T06:08:47.872 INFO:tasks.workunit.client.0.smithi037.stdout:9/751: dwrite da/dd/d1b/d23/de9/fcd [0,4194304] 0 2024-09-19T06:08:47.872 INFO:tasks.workunit.client.0.smithi037.stdout:9/752: chown da/dd/d1b/d23/d6a/d85/ffd 960108601 1 2024-09-19T06:08:47.872 INFO:tasks.workunit.client.0.smithi037.stdout:0/664: mkdir d5/dd5/de9/d8d/de0/dea 0 2024-09-19T06:08:47.874 INFO:tasks.workunit.client.0.smithi037.stdout:7/647: creat d6/dc/daf/fcc x:0 0 0 2024-09-19T06:08:47.877 INFO:tasks.workunit.client.0.smithi037.stdout:9/753: symlink da/dd/d1b/d23/dbe/l111 0 2024-09-19T06:08:47.878 INFO:tasks.workunit.client.0.smithi037.stdout:9/754: write da/fa5 [32965,35773] 0 2024-09-19T06:08:47.879 INFO:tasks.workunit.client.0.smithi037.stdout:5/584: dwrite d2/d12/d24/d58/d8e/f99 [0,4194304] 0 2024-09-19T06:08:47.879 INFO:tasks.workunit.client.0.smithi037.stdout:0/665: rename d5/d8/d22/f47 to d5/d18/d68/d85/dab/feb 0 2024-09-19T06:08:47.881 INFO:tasks.workunit.client.0.smithi037.stdout:9/755: mkdir da/d57/d112 0 2024-09-19T06:08:47.881 INFO:tasks.workunit.client.0.smithi037.stdout:9/756: getdents da/dd/d1b/d23/d6a 0 2024-09-19T06:08:47.881 INFO:tasks.workunit.client.0.smithi037.stdout:5/585: creat d2/d12/d28/d57/fbd x:0 0 0 2024-09-19T06:08:47.882 INFO:tasks.workunit.client.0.smithi037.stdout:0/666: link d5/d17/l7e d5/dd5/de9/dca/lec 0 2024-09-19T06:08:47.883 INFO:tasks.workunit.client.0.smithi037.stdout:9/757: creat da/dd/d63/dd3/f113 x:0 0 0 2024-09-19T06:08:47.884 INFO:tasks.workunit.client.0.smithi037.stdout:0/667: mknod d5/d8/ced 0 2024-09-19T06:08:47.884 INFO:tasks.workunit.client.0.smithi037.stdout:0/668: getdents d5/d8/d44/d48/dd1/de2 0 2024-09-19T06:08:47.886 INFO:tasks.workunit.client.0.smithi037.stdout:9/758: creat da/dd/d1b/d23/d6a/d8f/f114 x:0 0 0 2024-09-19T06:08:47.887 INFO:tasks.workunit.client.0.smithi037.stdout:0/669: link d5/d8/d11/d32/l54 d5/dd5/de5/lee 0 2024-09-19T06:08:47.887 INFO:tasks.workunit.client.0.smithi037.stdout:7/648: dread d6/dc/d22/f3b [0,4194304] 0 2024-09-19T06:08:47.887 INFO:tasks.workunit.client.0.smithi037.stdout:7/649: dread - d6/d20/d4b/d60/d33/f57 zero size 2024-09-19T06:08:47.888 INFO:tasks.workunit.client.0.smithi037.stdout:9/759: stat da/d20/c7a 0 2024-09-19T06:08:47.889 INFO:tasks.workunit.client.0.smithi037.stdout:7/650: creat d6/dc/d22/d59/da8/dc4/fcd x:0 0 0 2024-09-19T06:08:47.889 INFO:tasks.workunit.client.0.smithi037.stdout:9/760: rmdir da/d4d 39 2024-09-19T06:08:47.891 INFO:tasks.workunit.client.0.smithi037.stdout:7/651: rename d6/d20/d4b/d60/f73 to d6/d20/d34/d7d/fce 0 2024-09-19T06:08:47.892 INFO:tasks.workunit.client.0.smithi037.stdout:9/761: rename da/dd/d1b/d23/f9c to da/dd/d1b/d23/f115 0 2024-09-19T06:08:47.892 INFO:tasks.workunit.client.0.smithi037.stdout:9/762: write da/dd/d1b/d2f/d6d/db4/ded/f55 [1251643,28571] 0 2024-09-19T06:08:47.893 INFO:tasks.workunit.client.0.smithi037.stdout:7/652: mkdir d6/d20/d34/dc0/dcf 0 2024-09-19T06:08:47.893 INFO:tasks.workunit.client.0.smithi037.stdout:7/653: chown d6/d20/d71/dbb 1083284349 1 2024-09-19T06:08:47.893 INFO:tasks.workunit.client.0.smithi037.stdout:9/763: truncate da/dd/d1b/f3d 3273528 0 2024-09-19T06:08:47.899 INFO:tasks.workunit.client.0.smithi037.stdout:5/586: write d2/d12/d28/d57/fb0 [129465,104078] 0 2024-09-19T06:08:47.899 INFO:tasks.workunit.client.0.smithi037.stdout:5/587: fsync d2/d10/f21 0 2024-09-19T06:08:47.900 INFO:tasks.workunit.client.0.smithi037.stdout:0/670: dread d5/d8/f66 [0,4194304] 0 2024-09-19T06:08:47.910 INFO:tasks.workunit.client.0.smithi037.stdout:0/671: dread d5/d8/f66 [0,4194304] 0 2024-09-19T06:08:47.910 INFO:tasks.workunit.client.0.smithi037.stdout:0/672: chown d5/d8/ced 1685934 1 2024-09-19T06:08:47.911 INFO:tasks.workunit.client.0.smithi037.stdout:6/572: sync 2024-09-19T06:08:47.911 INFO:tasks.workunit.client.0.smithi037.stdout:1/516: sync 2024-09-19T06:08:47.912 INFO:tasks.workunit.client.0.smithi037.stdout:9/764: rename da/dd to da/dec/d116 0 2024-09-19T06:08:47.913 INFO:tasks.workunit.client.0.smithi037.stdout:0/673: mknod d5/cef 0 2024-09-19T06:08:47.913 INFO:tasks.workunit.client.0.smithi037.stdout:6/573: truncate d9/dd/d20/d5a/d6d/d82/f84 1596472 0 2024-09-19T06:08:47.915 INFO:tasks.workunit.client.0.smithi037.stdout:5/588: rename d2/d12/d24/d58/d8e/f99 to d2/d12/d28/d22/fbe 0 2024-09-19T06:08:47.915 INFO:tasks.workunit.client.0.smithi037.stdout:5/589: write d2/d12/d28/d22/f8b [657427,59328] 0 2024-09-19T06:08:47.916 INFO:tasks.workunit.client.0.smithi037.stdout:6/574: creat d9/fbc x:0 0 0 2024-09-19T06:08:47.916 INFO:tasks.workunit.client.0.smithi037.stdout:5/590: mkdir d2/d12/d24/d58/dbf 0 2024-09-19T06:08:47.917 INFO:tasks.workunit.client.0.smithi037.stdout:6/575: symlink d9/dd/lbd 0 2024-09-19T06:08:47.918 INFO:tasks.workunit.client.0.smithi037.stdout:5/591: rmdir d2/d12/d28/db8 0 2024-09-19T06:08:47.919 INFO:tasks.workunit.client.0.smithi037.stdout:6/576: creat d9/dd/d20/d5a/d6d/d82/d9f/da4/fbe x:0 0 0 2024-09-19T06:08:47.921 INFO:tasks.workunit.client.0.smithi037.stdout:5/592: link d2/d12/d28/d57/fb0 d2/d12/d28/d22/d4a/d9f/fc0 0 2024-09-19T06:08:47.922 INFO:tasks.workunit.client.0.smithi037.stdout:5/593: chown d2/d12/d28/d22/d35/fa0 207093189 1 2024-09-19T06:08:47.922 INFO:tasks.workunit.client.0.smithi037.stdout:5/594: write d2/d12/d28/d22/d53/f8a [2005446,95498] 0 2024-09-19T06:08:47.922 INFO:tasks.workunit.client.0.smithi037.stdout:5/595: stat d2/f80 0 2024-09-19T06:08:47.922 INFO:tasks.workunit.client.0.smithi037.stdout:5/596: chown d2/d5c/f60 27565 1 2024-09-19T06:08:47.922 INFO:tasks.workunit.client.0.smithi037.stdout:5/597: chown d2/d12/d24/d58/d96/l9b 13160 1 2024-09-19T06:08:47.922 INFO:tasks.workunit.client.0.smithi037.stdout:6/577: symlink d9/dd/d20/lbf 0 2024-09-19T06:08:47.923 INFO:tasks.workunit.client.0.smithi037.stdout:5/598: creat d2/d12/d28/d22/fc1 x:0 0 0 2024-09-19T06:08:47.924 INFO:tasks.workunit.client.0.smithi037.stdout:6/578: symlink d9/d78/lc0 0 2024-09-19T06:08:47.924 INFO:tasks.workunit.client.0.smithi037.stdout:6/579: fsync d9/dd/d20/d5a/d6d/d82/f84 0 2024-09-19T06:08:47.925 INFO:tasks.workunit.client.0.smithi037.stdout:6/580: symlink d9/dd/d20/d5a/d6d/d82/da9/lc1 0 2024-09-19T06:08:47.925 INFO:tasks.workunit.client.0.smithi037.stdout:9/765: dread da/dec/d116/d1b/d23/de9/fcd [0,4194304] 0 2024-09-19T06:08:47.926 INFO:tasks.workunit.client.0.smithi037.stdout:9/766: creat da/dec/d116/d1b/d2f/dcc/f117 x:0 0 0 2024-09-19T06:08:47.933 INFO:tasks.workunit.client.0.smithi037.stdout:9/767: dread da/dec/d116/d1b/d23/de9/f58 [0,4194304] 0 2024-09-19T06:08:47.934 INFO:tasks.workunit.client.0.smithi037.stdout:9/768: creat da/d20/f118 x:0 0 0 2024-09-19T06:08:47.935 INFO:tasks.workunit.client.0.smithi037.stdout:9/769: mknod da/db3/c119 0 2024-09-19T06:08:47.935 INFO:tasks.workunit.client.0.smithi037.stdout:9/770: truncate da/fa5 83353 0 2024-09-19T06:08:47.936 INFO:tasks.workunit.client.0.smithi037.stdout:9/771: creat da/d20/f11a x:0 0 0 2024-09-19T06:08:47.937 INFO:tasks.workunit.client.0.smithi037.stdout:9/772: mkdir da/dec/d116/d63/d80/dc4/d11b 0 2024-09-19T06:08:47.937 INFO:tasks.workunit.client.0.smithi037.stdout:9/773: chown da/f5a 24356 1 2024-09-19T06:08:47.938 INFO:tasks.workunit.client.0.smithi037.stdout:9/774: unlink da/dec/d116/d1b/d2f/d6d/fcf 0 2024-09-19T06:08:47.938 INFO:tasks.workunit.client.0.smithi037.stdout:9/775: write da/d20/f11a [1007599,6332] 0 2024-09-19T06:08:47.938 INFO:tasks.workunit.client.0.smithi037.stdout:1/517: dwrite d2/f8 [0,4194304] 0 2024-09-19T06:08:47.939 INFO:tasks.workunit.client.0.smithi037.stdout:0/674: read d5/d8/d44/d48/f65 [1509655,15817] 0 2024-09-19T06:08:47.941 INFO:tasks.workunit.client.0.smithi037.stdout:1/518: unlink d2/d12/d1d/l22 0 2024-09-19T06:08:47.941 INFO:tasks.workunit.client.0.smithi037.stdout:1/519: fsync d2/d12/d1d/d47/f68 0 2024-09-19T06:08:47.942 INFO:tasks.workunit.client.0.smithi037.stdout:9/776: rename da/dec/d116/d1b/d23/d6a/d8f/dac to da/d20/d11c 0 2024-09-19T06:08:47.942 INFO:tasks.workunit.client.0.smithi037.stdout:9/777: readlink da/dec/d116/d1b/d23/de9/l64 0 2024-09-19T06:08:47.943 INFO:tasks.workunit.client.0.smithi037.stdout:0/675: truncate d5/dd5/de9/d21/f4b 898734 0 2024-09-19T06:08:47.943 INFO:tasks.workunit.client.0.smithi037.stdout:1/520: mknod d2/d12/d15/d34/d90/ca9 0 2024-09-19T06:08:47.944 INFO:tasks.workunit.client.0.smithi037.stdout:5/599: dread d2/d12/d24/d97/f9c [0,4194304] 0 2024-09-19T06:08:47.945 INFO:tasks.workunit.client.0.smithi037.stdout:5/600: truncate d2/d12/d28/d22/fc1 119786 0 2024-09-19T06:08:47.945 INFO:tasks.workunit.client.0.smithi037.stdout:5/601: dread - d2/d12/d24/d58/f8f zero size 2024-09-19T06:08:47.945 INFO:tasks.workunit.client.0.smithi037.stdout:5/602: fsync d2/d12/d28/f48 0 2024-09-19T06:08:47.945 INFO:tasks.workunit.client.0.smithi037.stdout:0/676: mknod d5/d8/d79/de1/cf0 0 2024-09-19T06:08:47.945 INFO:tasks.workunit.client.0.smithi037.stdout:1/521: rmdir d2/d12/d1e/d2d/d6f 39 2024-09-19T06:08:47.947 INFO:tasks.workunit.client.0.smithi037.stdout:0/677: creat d5/d18/ff1 x:0 0 0 2024-09-19T06:08:47.947 INFO:tasks.workunit.client.0.smithi037.stdout:1/522: mknod d2/d12/d1d/d6b/d8b/caa 0 2024-09-19T06:08:47.949 INFO:tasks.workunit.client.0.smithi037.stdout:0/678: rename d5/d8/d44/f6f to d5/d8/d22/d89/de7/ff2 0 2024-09-19T06:08:47.949 INFO:tasks.workunit.client.0.smithi037.stdout:0/679: fdatasync d5/d18/fbc 0 2024-09-19T06:08:47.949 INFO:tasks.workunit.client.0.smithi037.stdout:0/680: fsync d5/d8/d44/d61/fcf 0 2024-09-19T06:08:47.949 INFO:tasks.workunit.client.0.smithi037.stdout:0/681: chown d5/d8 738115654 1 2024-09-19T06:08:47.951 INFO:tasks.workunit.client.0.smithi037.stdout:0/682: creat d5/d17/d6e/ff3 x:0 0 0 2024-09-19T06:08:47.953 INFO:tasks.workunit.client.0.smithi037.stdout:9/778: dread da/dec/d116/d1b/d2f/fa2 [0,4194304] 0 2024-09-19T06:08:47.953 INFO:tasks.workunit.client.0.smithi037.stdout:5/603: dread d2/d12/f16 [4194304,4194304] 0 2024-09-19T06:08:47.954 INFO:tasks.workunit.client.0.smithi037.stdout:6/581: dwrite d9/dd/d2b/d79/f63 [0,4194304] 0 2024-09-19T06:08:47.954 INFO:tasks.workunit.client.0.smithi037.stdout:6/582: write d9/dd/d20/f27 [1009404,91756] 0 2024-09-19T06:08:47.955 INFO:tasks.workunit.client.0.smithi037.stdout:9/779: unlink da/dec/d116/cf 0 2024-09-19T06:08:47.955 INFO:tasks.workunit.client.0.smithi037.stdout:9/780: getdents da/dec/d116/d1b/d23/d6a 0 2024-09-19T06:08:47.959 INFO:tasks.workunit.client.0.smithi037.stdout:9/781: rmdir da/dec/d116/d1b/d23/d6a 39 2024-09-19T06:08:47.960 INFO:tasks.workunit.client.0.smithi037.stdout:9/782: rmdir da/d57/d112 0 2024-09-19T06:08:47.961 INFO:tasks.workunit.client.0.smithi037.stdout:9/783: dread - da/dec/d116/d1b/d2f/d6d/fea zero size 2024-09-19T06:08:47.961 INFO:tasks.workunit.client.0.smithi037.stdout:9/784: write da/d20/fc2 [4612356,124142] 0 2024-09-19T06:08:47.961 INFO:tasks.workunit.client.0.smithi037.stdout:9/785: mkdir da/d4d/dbb/d11d 0 2024-09-19T06:08:47.961 INFO:tasks.workunit.client.0.smithi037.stdout:9/786: truncate da/dec/d116/d1b/d2f/d6d/fea 750806 0 2024-09-19T06:08:47.963 INFO:tasks.workunit.client.0.smithi037.stdout:9/787: unlink da/dec/d116/d1b/d23/de9/l89 0 2024-09-19T06:08:47.963 INFO:tasks.workunit.client.0.smithi037.stdout:1/523: dread d2/d12/d1e/d2a/f60 [0,4194304] 0 2024-09-19T06:08:47.963 INFO:tasks.workunit.client.0.smithi037.stdout:1/524: fsync d2/d12/f13 0 2024-09-19T06:08:47.964 INFO:tasks.workunit.client.0.smithi037.stdout:9/788: mkdir da/dec/d116/d63/d80/dc4/d11e 0 2024-09-19T06:08:47.966 INFO:tasks.workunit.client.0.smithi037.stdout:1/525: unlink d2/f10 0 2024-09-19T06:08:47.966 INFO:tasks.workunit.client.0.smithi037.stdout:1/526: write d2/d48/f9b [463456,70025] 0 2024-09-19T06:08:47.967 INFO:tasks.workunit.client.0.smithi037.stdout:6/583: dread d9/dd/d1c/d4e/f34 [0,4194304] 0 2024-09-19T06:08:47.967 INFO:tasks.workunit.client.0.smithi037.stdout:6/584: chown d9/dd/l13 40748 1 2024-09-19T06:08:47.968 INFO:tasks.workunit.client.0.smithi037.stdout:9/789: link da/dec/d116/d1b/d23/d6a/fd8 da/dec/d116/d1b/d2f/df8/f11f 0 2024-09-19T06:08:47.971 INFO:tasks.workunit.client.0.smithi037.stdout:6/585: creat d9/dd/d1c/fc2 x:0 0 0 2024-09-19T06:08:47.971 INFO:tasks.workunit.client.0.smithi037.stdout:6/586: readlink d9/dd/d20/d5a/l64 0 2024-09-19T06:08:47.971 INFO:tasks.workunit.client.0.smithi037.stdout:6/587: stat d9/d16/l1e 0 2024-09-19T06:08:47.972 INFO:tasks.workunit.client.0.smithi037.stdout:6/588: unlink d9/dd/d20/f76 0 2024-09-19T06:08:47.972 INFO:tasks.workunit.client.0.smithi037.stdout:6/589: write d9/d6e/f9a [200444,15112] 0 2024-09-19T06:08:47.975 INFO:tasks.workunit.client.0.smithi037.stdout:6/590: getdents d9/dd/d20/d5a/d6d/d82/d9f 0 2024-09-19T06:08:47.975 INFO:tasks.workunit.client.0.smithi037.stdout:6/591: readlink d9/d78/lc0 0 2024-09-19T06:08:47.975 INFO:tasks.workunit.client.0.smithi037.stdout:6/592: truncate d9/dd/d1c/d4e/d65/f8b 126676 0 2024-09-19T06:08:47.975 INFO:tasks.workunit.client.0.smithi037.stdout:6/593: write d9/fa8 [804350,9391] 0 2024-09-19T06:08:47.981 INFO:tasks.workunit.client.0.smithi037.stdout:1/527: write d2/d12/d1e/d2d/f4c [1866167,52461] 0 2024-09-19T06:08:47.981 INFO:tasks.workunit.client.0.smithi037.stdout:1/528: write d2/f6 [947632,114566] 0 2024-09-19T06:08:47.986 INFO:tasks.workunit.client.0.smithi037.stdout:1/529: symlink d2/d73/lab 0 2024-09-19T06:08:47.989 INFO:tasks.workunit.client.0.smithi037.stdout:8/801: sync 2024-09-19T06:08:47.992 INFO:tasks.workunit.client.0.smithi037.stdout:1/530: getdents d2/d12/d17 0 2024-09-19T06:08:47.993 INFO:tasks.workunit.client.0.smithi037.stdout:1/531: mkdir d2/d12/d1e/d2d/d6f/dac 0 2024-09-19T06:08:47.994 INFO:tasks.workunit.client.0.smithi037.stdout:1/532: rmdir d2 39 2024-09-19T06:08:47.996 INFO:tasks.workunit.client.0.smithi037.stdout:1/533: symlink d2/lad 0 2024-09-19T06:08:47.996 INFO:tasks.workunit.client.0.smithi037.stdout:1/534: write d2/f9 [1756645,22867] 0 2024-09-19T06:08:47.997 INFO:tasks.workunit.client.0.smithi037.stdout:1/535: creat d2/d12/d1e/d2a/d2e/fae x:0 0 0 2024-09-19T06:08:47.997 INFO:tasks.workunit.client.0.smithi037.stdout:1/536: truncate d2/f8 3552613 0 2024-09-19T06:08:47.998 INFO:tasks.workunit.client.0.smithi037.stdout:1/537: creat d2/d12/d15/d34/faf x:0 0 0 2024-09-19T06:08:48.020 INFO:tasks.workunit.client.0.smithi037.stdout:1/538: dwrite d2/d12/d1e/d2a/d2e/fae [0,4194304] 0 2024-09-19T06:08:48.047 INFO:tasks.workunit.client.0.smithi037.stdout:1/539: dwrite d2/d12/d17/f2b [0,4194304] 0 2024-09-19T06:08:48.049 INFO:tasks.workunit.client.0.smithi037.stdout:1/540: write d2/d12/d1d/d47/f68 [2194521,88787] 0 2024-09-19T06:08:48.051 INFO:tasks.workunit.client.0.smithi037.stdout:1/541: dread d2/d12/d1e/d2d/f55 [0,4194304] 0 2024-09-19T06:08:48.052 INFO:tasks.workunit.client.0.smithi037.stdout:1/542: link d2/d12/d1e/f4e d2/d12/d1d/d6b/fb0 0 2024-09-19T06:08:48.071 INFO:tasks.workunit.client.0.smithi037.stdout:1/543: dwrite d2/d12/d1e/d75/f94 [0,4194304] 0 2024-09-19T06:08:48.082 INFO:tasks.workunit.client.0.smithi037.stdout:1/544: dread d2/f9 [0,4194304] 0 2024-09-19T06:08:48.083 INFO:tasks.workunit.client.0.smithi037.stdout:1/545: mknod d2/d12/d1e/d2a/d97/cb1 0 2024-09-19T06:08:48.105 INFO:tasks.workunit.client.0.smithi037.stdout:4/699: sync 2024-09-19T06:08:48.105 INFO:tasks.workunit.client.0.smithi037.stdout:2/687: sync 2024-09-19T06:08:48.105 INFO:tasks.workunit.client.0.smithi037.stdout:3/581: sync 2024-09-19T06:08:48.105 INFO:tasks.workunit.client.0.smithi037.stdout:4/700: stat d0/d6/d1b/l2a 0 2024-09-19T06:08:48.105 INFO:tasks.workunit.client.0.smithi037.stdout:1/546: dwrite d2/d12/d1e/f5d [0,4194304] 0 2024-09-19T06:08:48.106 INFO:tasks.workunit.client.0.smithi037.stdout:3/582: mkdir d0/d16/d19/d1d/d5e/d61/dc4 0 2024-09-19T06:08:48.107 INFO:tasks.workunit.client.0.smithi037.stdout:2/688: symlink d1/d16/d4a/lec 0 2024-09-19T06:08:48.108 INFO:tasks.workunit.client.0.smithi037.stdout:4/701: creat d0/d6/fe2 x:0 0 0 2024-09-19T06:08:48.108 INFO:tasks.workunit.client.0.smithi037.stdout:4/702: stat d0/d6/d45/d4a/f84 0 2024-09-19T06:08:48.108 INFO:tasks.workunit.client.0.smithi037.stdout:3/583: truncate d0/d16/d19/d1d/d82/d86/faf 1101950 0 2024-09-19T06:08:48.109 INFO:tasks.workunit.client.0.smithi037.stdout:2/689: mkdir d1/d6/da3/da8/ded 0 2024-09-19T06:08:48.109 INFO:tasks.workunit.client.0.smithi037.stdout:2/690: chown d1/d16/d96 0 1 2024-09-19T06:08:48.109 INFO:tasks.workunit.client.0.smithi037.stdout:4/703: mknod d0/d6/d45/d4a/de1/ce3 0 2024-09-19T06:08:48.110 INFO:tasks.workunit.client.0.smithi037.stdout:3/584: getdents d0/d16 0 2024-09-19T06:08:48.112 INFO:tasks.workunit.client.0.smithi037.stdout:4/704: creat d0/d2/d37/d46/db1/fe4 x:0 0 0 2024-09-19T06:08:48.113 INFO:tasks.workunit.client.0.smithi037.stdout:3/585: creat d0/d16/d19/d1d/d5e/d61/dc4/fc5 x:0 0 0 2024-09-19T06:08:48.115 INFO:tasks.workunit.client.0.smithi037.stdout:3/586: rename d0/d16/d19/d1d/f39 to d0/d16/fc6 0 2024-09-19T06:08:48.116 INFO:tasks.workunit.client.0.smithi037.stdout:3/587: mkdir d0/d16/d19/d1d/dc7 0 2024-09-19T06:08:48.117 INFO:tasks.workunit.client.0.smithi037.stdout:2/691: write d1/da/dc/d21/f4d [585336,114015] 0 2024-09-19T06:08:48.118 INFO:tasks.workunit.client.0.smithi037.stdout:2/692: truncate d1/da/dc/d21/d51/f52 1031793 0 2024-09-19T06:08:48.118 INFO:tasks.workunit.client.0.smithi037.stdout:2/693: write d1/da/dc/d21/d55/fe6 [940158,73365] 0 2024-09-19T06:08:48.119 INFO:tasks.workunit.client.0.smithi037.stdout:2/694: unlink d1/da/d95/cb6 0 2024-09-19T06:08:48.119 INFO:tasks.workunit.client.0.smithi037.stdout:2/695: chown d1/da/dc/d21/d7d/cad 776 1 2024-09-19T06:08:48.120 INFO:tasks.workunit.client.0.smithi037.stdout:2/696: mknod d1/dc3/cee 0 2024-09-19T06:08:48.122 INFO:tasks.workunit.client.0.smithi037.stdout:3/588: write d0/d43/d37/f8c [700027,69864] 0 2024-09-19T06:08:48.122 INFO:tasks.workunit.client.0.smithi037.stdout:2/697: rename d1/d16/f61 to d1/d6/da3/da8/dbe/fef 0 2024-09-19T06:08:48.123 INFO:tasks.workunit.client.0.smithi037.stdout:3/589: dread d0/d16/d19/d1d/d5e/f74 [0,4194304] 0 2024-09-19T06:08:48.123 INFO:tasks.workunit.client.0.smithi037.stdout:3/590: read - d0/d43/d23/f8d zero size 2024-09-19T06:08:48.124 INFO:tasks.workunit.client.0.smithi037.stdout:3/591: creat d0/d43/d23/d7a/d77/dc3/fc8 x:0 0 0 2024-09-19T06:08:48.124 INFO:tasks.workunit.client.0.smithi037.stdout:3/592: write d0/d43/d23/d7a/d77/dc3/fc8 [16981,80227] 0 2024-09-19T06:08:48.124 INFO:tasks.workunit.client.0.smithi037.stdout:3/593: fdatasync d0/f7d 0 2024-09-19T06:08:48.127 INFO:tasks.workunit.client.0.smithi037.stdout:4/705: read d0/d6/d45/d4a/f5c [4080157,130563] 0 2024-09-19T06:08:48.129 INFO:tasks.workunit.client.0.smithi037.stdout:4/706: rename d0/d6/d45/d4a to d0/d2/d37/d46/de5 0 2024-09-19T06:08:48.129 INFO:tasks.workunit.client.0.smithi037.stdout:4/707: chown d0/d6/f67 28 1 2024-09-19T06:08:48.132 INFO:tasks.workunit.client.0.smithi037.stdout:3/594: dread d0/d16/d19/d1d/d5e/f83 [0,4194304] 0 2024-09-19T06:08:48.137 INFO:tasks.workunit.client.0.smithi037.stdout:2/698: dread d1/da/dc/d21/d55/dbc/fc8 [0,4194304] 0 2024-09-19T06:08:48.137 INFO:tasks.workunit.client.0.smithi037.stdout:2/699: chown d1/da/dc/d21/d7d/f2e 112 1 2024-09-19T06:08:48.137 INFO:tasks.workunit.client.0.smithi037.stdout:2/700: chown d1/da/dc/d21/d7d/c5b 1865 1 2024-09-19T06:08:48.146 INFO:tasks.workunit.client.0.smithi037.stdout:3/595: dread d0/d16/d19/f29 [0,4194304] 0 2024-09-19T06:08:48.148 INFO:tasks.workunit.client.0.smithi037.stdout:3/596: mknod d0/d16/d19/d1d/d82/cc9 0 2024-09-19T06:08:48.150 INFO:tasks.workunit.client.0.smithi037.stdout:3/597: symlink d0/d43/d23/lca 0 2024-09-19T06:08:48.150 INFO:tasks.workunit.client.0.smithi037.stdout:3/598: write d0/d16/d19/f9c [81087,120585] 0 2024-09-19T06:08:48.150 INFO:tasks.workunit.client.0.smithi037.stdout:3/599: fsync d0/d43/d26/f5d 0 2024-09-19T06:08:48.155 INFO:tasks.workunit.client.0.smithi037.stdout:4/708: dwrite d0/d2/d37/d46/db1/fe4 [0,4194304] 0 2024-09-19T06:08:48.159 INFO:tasks.workunit.client.0.smithi037.stdout:2/701: dwrite d1/d6/f12 [0,4194304] 0 2024-09-19T06:08:48.160 INFO:tasks.workunit.client.0.smithi037.stdout:2/702: mknod d1/da/cf0 0 2024-09-19T06:08:48.160 INFO:tasks.workunit.client.0.smithi037.stdout:2/703: read d1/da/f63 [322702,23562] 0 2024-09-19T06:08:48.160 INFO:tasks.workunit.client.0.smithi037.stdout:2/704: write d1/d9e/fe7 [493475,65889] 0 2024-09-19T06:08:48.161 INFO:tasks.workunit.client.0.smithi037.stdout:2/705: mkdir d1/d6/da3/df1 0 2024-09-19T06:08:48.163 INFO:tasks.workunit.client.0.smithi037.stdout:2/706: rmdir d1/d16/dde 0 2024-09-19T06:08:48.163 INFO:tasks.workunit.client.0.smithi037.stdout:2/707: truncate d1/f1e 3599774 0 2024-09-19T06:08:48.164 INFO:tasks.workunit.client.0.smithi037.stdout:2/708: rmdir d1/d6/da3/da8 39 2024-09-19T06:08:48.167 INFO:tasks.workunit.client.0.smithi037.stdout:4/709: write d0/d2/d37/d46/de5/f8c [3068187,11586] 0 2024-09-19T06:08:48.170 INFO:tasks.workunit.client.0.smithi037.stdout:3/600: dwrite d0/d43/d23/d7a/d77/dc3/fc8 [0,4194304] 0 2024-09-19T06:08:48.170 INFO:tasks.workunit.client.0.smithi037.stdout:3/601: truncate d0/d16/d19/d1d/d5e/f6c 242986 0 2024-09-19T06:08:48.171 INFO:tasks.workunit.client.0.smithi037.stdout:3/602: stat d0/d5f/da0/cbc 0 2024-09-19T06:08:48.171 INFO:tasks.workunit.client.0.smithi037.stdout:3/603: chown d0/d43/d23/d7a/d77/d51/c68 26296646 1 2024-09-19T06:08:48.174 INFO:tasks.workunit.client.0.smithi037.stdout:3/604: truncate d0/d16/d19/d1d/d5e/f6c 97842 0 2024-09-19T06:08:48.175 INFO:tasks.workunit.client.0.smithi037.stdout:3/605: mkdir d0/d16/d19/d1d/d5e/d61/dcb 0 2024-09-19T06:08:48.176 INFO:tasks.workunit.client.0.smithi037.stdout:3/606: creat d0/d5f/fcc x:0 0 0 2024-09-19T06:08:48.177 INFO:tasks.workunit.client.0.smithi037.stdout:3/607: mknod d0/d16/da6/ccd 0 2024-09-19T06:08:48.178 INFO:tasks.workunit.client.0.smithi037.stdout:3/608: mknod d0/d43/d23/d7a/d77/dc3/cce 0 2024-09-19T06:08:48.179 INFO:tasks.workunit.client.0.smithi037.stdout:3/609: rename d0/d16/d19/d1d/d5e/f74 to d0/d43/d23/d7a/d77/d51/fcf 0 2024-09-19T06:08:48.180 INFO:tasks.workunit.client.0.smithi037.stdout:3/610: write d0/d16/f9e [1018853,35142] 0 2024-09-19T06:08:48.196 INFO:tasks.workunit.client.0.smithi037.stdout:3/611: dread d0/d16/d19/f29 [0,4194304] 0 2024-09-19T06:08:48.196 INFO:tasks.workunit.client.0.smithi037.stdout:2/709: write d1/f1e [2126509,43328] 0 2024-09-19T06:08:48.196 INFO:tasks.workunit.client.0.smithi037.stdout:2/710: getdents d1/d33 0 2024-09-19T06:08:48.196 INFO:tasks.workunit.client.0.smithi037.stdout:4/710: dwrite d0/d6/d1b/f78 [0,4194304] 0 2024-09-19T06:08:48.197 INFO:tasks.workunit.client.0.smithi037.stdout:2/711: write d1/d6/f6c [3664627,71415] 0 2024-09-19T06:08:48.198 INFO:tasks.workunit.client.0.smithi037.stdout:3/612: rename d0/d43/d23/d7a/d77/d45/l89 to d0/d43/d23/d7a/d77/d51/ld0 0 2024-09-19T06:08:48.201 INFO:tasks.workunit.client.0.smithi037.stdout:4/711: link d0/d6/d45/dd9/d36/c54 d0/d8f/ce6 0 2024-09-19T06:08:48.203 INFO:tasks.workunit.client.0.smithi037.stdout:3/613: mkdir d0/d16/d19/d1d/dd1 0 2024-09-19T06:08:48.204 INFO:tasks.workunit.client.0.smithi037.stdout:4/712: mkdir d0/d6/d1b/d20/d4d/d64/de7 0 2024-09-19T06:08:48.205 INFO:tasks.workunit.client.0.smithi037.stdout:4/713: getdents d0/d2/d37/d46/de5/d6f 0 2024-09-19T06:08:48.206 INFO:tasks.workunit.client.0.smithi037.stdout:4/714: rmdir d0/d2/d37/d46/db1 39 2024-09-19T06:08:48.207 INFO:tasks.workunit.client.0.smithi037.stdout:4/715: symlink d0/d6/d1b/d20/d4d/le8 0 2024-09-19T06:08:48.208 INFO:tasks.workunit.client.0.smithi037.stdout:4/716: mknod d0/d6/d1b/d20/d4d/d64/ce9 0 2024-09-19T06:08:48.209 INFO:tasks.workunit.client.0.smithi037.stdout:2/712: dread d1/d16/f74 [0,4194304] 0 2024-09-19T06:08:48.209 INFO:tasks.workunit.client.0.smithi037.stdout:7/654: sync 2024-09-19T06:08:48.211 INFO:tasks.workunit.client.0.smithi037.stdout:7/655: creat d6/dc/df/fd0 x:0 0 0 2024-09-19T06:08:48.211 INFO:tasks.workunit.client.0.smithi037.stdout:7/656: read d6/dc/fc9 [806209,83585] 0 2024-09-19T06:08:48.211 INFO:tasks.workunit.client.0.smithi037.stdout:3/614: dread d0/f9 [0,4194304] 0 2024-09-19T06:08:48.212 INFO:tasks.workunit.client.0.smithi037.stdout:7/657: unlink d6/dc/fc9 0 2024-09-19T06:08:48.213 INFO:tasks.workunit.client.0.smithi037.stdout:7/658: truncate d6/dc/f94 575014 0 2024-09-19T06:08:48.213 INFO:tasks.workunit.client.0.smithi037.stdout:7/659: stat d6/d20/d34/f50 0 2024-09-19T06:08:48.213 INFO:tasks.workunit.client.0.smithi037.stdout:7/660: stat d6/d20/d71/ca5 0 2024-09-19T06:08:48.213 INFO:tasks.workunit.client.0.smithi037.stdout:7/661: fdatasync d6/d20/d34/f9a 0 2024-09-19T06:08:48.234 INFO:tasks.workunit.client.0.smithi037.stdout:7/662: dwrite d6/dc/daf/fcc [0,4194304] 0 2024-09-19T06:08:48.235 INFO:tasks.workunit.client.0.smithi037.stdout:4/717: dwrite d0/f24 [0,4194304] 0 2024-09-19T06:08:48.235 INFO:tasks.workunit.client.0.smithi037.stdout:7/663: rmdir d6/d20/d4b 39 2024-09-19T06:08:48.236 INFO:tasks.workunit.client.0.smithi037.stdout:7/664: readlink d6/d21/l54 0 2024-09-19T06:08:48.236 INFO:tasks.workunit.client.0.smithi037.stdout:7/665: write d6/d21/f5f [62047,52546] 0 2024-09-19T06:08:48.236 INFO:tasks.workunit.client.0.smithi037.stdout:2/713: dwrite d1/d6/da3/da8/dbe/fef [0,4194304] 0 2024-09-19T06:08:48.236 INFO:tasks.workunit.client.0.smithi037.stdout:2/714: chown d1/d6/f12 105234803 1 2024-09-19T06:08:48.236 INFO:tasks.workunit.client.0.smithi037.stdout:2/715: write d1/d16/d62/f73 [5415992,122812] 0 2024-09-19T06:08:48.243 INFO:tasks.workunit.client.0.smithi037.stdout:2/716: dread d1/da/d6e/fc2 [0,4194304] 0 2024-09-19T06:08:48.243 INFO:tasks.workunit.client.0.smithi037.stdout:2/717: dread - d1/da/dc/d21/d55/dbc/db0/fc0 zero size 2024-09-19T06:08:48.250 INFO:tasks.workunit.client.0.smithi037.stdout:4/718: dread d0/f16 [0,4194304] 0 2024-09-19T06:08:48.251 INFO:tasks.workunit.client.0.smithi037.stdout:4/719: link d0/d6/d1b/d20/d4d/d65/fcd d0/d8f/fea 0 2024-09-19T06:08:48.251 INFO:tasks.workunit.client.0.smithi037.stdout:4/720: stat d0/d6/c9a 0 2024-09-19T06:08:48.252 INFO:tasks.workunit.client.0.smithi037.stdout:7/666: dread d6/f3e [0,4194304] 0 2024-09-19T06:08:48.252 INFO:tasks.workunit.client.0.smithi037.stdout:7/667: chown d6/f2b 222 1 2024-09-19T06:08:48.253 INFO:tasks.workunit.client.0.smithi037.stdout:4/721: symlink d0/d6/d45/dd9/leb 0 2024-09-19T06:08:48.253 INFO:tasks.workunit.client.0.smithi037.stdout:7/668: truncate d6/dc/f89 4745661 0 2024-09-19T06:08:48.254 INFO:tasks.workunit.client.0.smithi037.stdout:7/669: symlink d6/dc/ld1 0 2024-09-19T06:08:48.260 INFO:tasks.workunit.client.0.smithi037.stdout:2/718: dread d1/da/dc/d21/d51/f9c [0,4194304] 0 2024-09-19T06:08:48.261 INFO:tasks.workunit.client.0.smithi037.stdout:2/719: write d1/d6/fdd [15314,110342] 0 2024-09-19T06:08:48.267 INFO:tasks.workunit.client.0.smithi037.stdout:7/670: dread d6/d20/d4b/d60/f31 [4194304,4194304] 0 2024-09-19T06:08:48.269 INFO:tasks.workunit.client.0.smithi037.stdout:7/671: symlink d6/dc/df/d7e/ld2 0 2024-09-19T06:08:48.271 INFO:tasks.workunit.client.0.smithi037.stdout:7/672: creat d6/d20/d4b/fd3 x:0 0 0 2024-09-19T06:08:48.275 INFO:tasks.workunit.client.0.smithi037.stdout:4/722: dwrite d0/d6/d1b/d20/d4d/fb7 [0,4194304] 0 2024-09-19T06:08:48.275 INFO:tasks.workunit.client.0.smithi037.stdout:4/723: dread - d0/d6/d1b/d20/d4d/d65/faf zero size 2024-09-19T06:08:48.277 INFO:tasks.workunit.client.0.smithi037.stdout:5/604: sync 2024-09-19T06:08:48.277 INFO:tasks.workunit.client.0.smithi037.stdout:0/683: sync 2024-09-19T06:08:48.277 INFO:tasks.workunit.client.0.smithi037.stdout:0/684: write d5/d17/fa5 [398065,118777] 0 2024-09-19T06:08:48.278 INFO:tasks.workunit.client.0.smithi037.stdout:5/605: truncate d2/d10/f4e 567811 0 2024-09-19T06:08:48.279 INFO:tasks.workunit.client.0.smithi037.stdout:0/685: truncate d5/d8/d44/d48/f5a 353316 0 2024-09-19T06:08:48.279 INFO:tasks.workunit.client.0.smithi037.stdout:0/686: write d5/d8/d44/f51 [1770090,89034] 0 2024-09-19T06:08:48.279 INFO:tasks.workunit.client.0.smithi037.stdout:0/687: write d5/d8/d22/d89/d96/dae/fcc [822068,42875] 0 2024-09-19T06:08:48.279 INFO:tasks.workunit.client.0.smithi037.stdout:5/606: creat d2/d12/d24/d58/d7f/fc2 x:0 0 0 2024-09-19T06:08:48.280 INFO:tasks.workunit.client.0.smithi037.stdout:0/688: creat d5/ff4 x:0 0 0 2024-09-19T06:08:48.281 INFO:tasks.workunit.client.0.smithi037.stdout:5/607: creat d2/d12/d28/d22/d35/dae/fc3 x:0 0 0 2024-09-19T06:08:48.281 INFO:tasks.workunit.client.0.smithi037.stdout:5/608: fsync d2/d12/d28/d22/d4a/d9f/fc0 0 2024-09-19T06:08:48.281 INFO:tasks.workunit.client.0.smithi037.stdout:5/609: chown d2/d12/d28/l43 21 1 2024-09-19T06:08:48.281 INFO:tasks.workunit.client.0.smithi037.stdout:0/689: rmdir d5/d8 39 2024-09-19T06:08:48.282 INFO:tasks.workunit.client.0.smithi037.stdout:0/690: write d5/dd5/de9/d21/f72 [4727971,39420] 0 2024-09-19T06:08:48.282 INFO:tasks.workunit.client.0.smithi037.stdout:5/610: mkdir d2/d12/d28/d57/dc4 0 2024-09-19T06:08:48.285 INFO:tasks.workunit.client.0.smithi037.stdout:0/691: unlink d5/d8/f3f 0 2024-09-19T06:08:48.286 INFO:tasks.workunit.client.0.smithi037.stdout:2/720: dwrite d1/da/dc/d21/f67 [0,4194304] 0 2024-09-19T06:08:48.286 INFO:tasks.workunit.client.0.smithi037.stdout:0/692: creat d5/d8/d22/d89/de7/ff5 x:0 0 0 2024-09-19T06:08:48.290 INFO:tasks.workunit.client.0.smithi037.stdout:2/721: mkdir d1/da/dc/d21/d7d/dab/df2 0 2024-09-19T06:08:48.290 INFO:tasks.workunit.client.0.smithi037.stdout:4/724: dread d0/d8f/fea [0,4194304] 0 2024-09-19T06:08:48.290 INFO:tasks.workunit.client.0.smithi037.stdout:2/722: fsync d1/d16/d96/f9b 0 2024-09-19T06:08:48.291 INFO:tasks.workunit.client.0.smithi037.stdout:4/725: getdents d0/d2 0 2024-09-19T06:08:48.292 INFO:tasks.workunit.client.0.smithi037.stdout:7/673: write d6/d20/d4b/d60/d33/d61/f64 [2098961,74334] 0 2024-09-19T06:08:48.292 INFO:tasks.workunit.client.0.smithi037.stdout:4/726: rename d0/d6/d45/f5b to d0/d6/d1b/d20/d4d/d65/fec 0 2024-09-19T06:08:48.293 INFO:tasks.workunit.client.0.smithi037.stdout:5/611: dread d2/d12/d24/d58/d8e/f94 [0,4194304] 0 2024-09-19T06:08:48.294 INFO:tasks.workunit.client.0.smithi037.stdout:7/674: mkdir d6/dc/d22/d59/da8/dd4 0 2024-09-19T06:08:48.295 INFO:tasks.workunit.client.0.smithi037.stdout:4/727: symlink d0/d2/d37/d46/de5/d6f/da9/dba/led 0 2024-09-19T06:08:48.296 INFO:tasks.workunit.client.0.smithi037.stdout:4/728: truncate d0/f41 4988234 0 2024-09-19T06:08:48.296 INFO:tasks.workunit.client.0.smithi037.stdout:5/612: mknod d2/d12/d28/d22/d87/da8/cc5 0 2024-09-19T06:08:48.297 INFO:tasks.workunit.client.0.smithi037.stdout:4/729: mkdir d0/d6/d1b/d30/dee 0 2024-09-19T06:08:48.298 INFO:tasks.workunit.client.0.smithi037.stdout:5/613: symlink d2/lc6 0 2024-09-19T06:08:48.299 INFO:tasks.workunit.client.0.smithi037.stdout:4/730: symlink d0/d6/d1b/d5d/lef 0 2024-09-19T06:08:48.301 INFO:tasks.workunit.client.0.smithi037.stdout:5/614: symlink d2/d12/d28/d22/d53/lc7 0 2024-09-19T06:08:48.303 INFO:tasks.workunit.client.0.smithi037.stdout:8/802: sync 2024-09-19T06:08:48.303 INFO:tasks.workunit.client.0.smithi037.stdout:1/547: sync 2024-09-19T06:08:48.303 INFO:tasks.workunit.client.0.smithi037.stdout:9/790: sync 2024-09-19T06:08:48.303 INFO:tasks.workunit.client.0.smithi037.stdout:6/594: sync 2024-09-19T06:08:48.303 INFO:tasks.workunit.client.0.smithi037.stdout:6/595: readlink d9/dd/d20/l40 0 2024-09-19T06:08:48.303 INFO:tasks.workunit.client.0.smithi037.stdout:9/791: write da/dec/d116/d1b/d23/de9/ff5 [297047,77517] 0 2024-09-19T06:08:48.303 INFO:tasks.workunit.client.0.smithi037.stdout:6/596: read d9/dd/d2b/f61 [1651506,111202] 0 2024-09-19T06:08:48.304 INFO:tasks.workunit.client.0.smithi037.stdout:1/548: creat d2/d12/d1d/d6b/fb2 x:0 0 0 2024-09-19T06:08:48.305 INFO:tasks.workunit.client.0.smithi037.stdout:8/803: creat d1/d61/d7e/dbc/dc2/d59/d5d/f115 x:0 0 0 2024-09-19T06:08:48.308 INFO:tasks.workunit.client.0.smithi037.stdout:5/615: read d2/d12/d28/d22/d53/f83 [366150,109137] 0 2024-09-19T06:08:48.308 INFO:tasks.workunit.client.0.smithi037.stdout:6/597: symlink d9/dd/d20/d5a/d6d/d82/da9/lc3 0 2024-09-19T06:08:48.308 INFO:tasks.workunit.client.0.smithi037.stdout:6/598: write d9/dd/d20/f48 [1173646,29457] 0 2024-09-19T06:08:48.309 INFO:tasks.workunit.client.0.smithi037.stdout:1/549: creat d2/d12/d1e/d2a/fb3 x:0 0 0 2024-09-19T06:08:48.310 INFO:tasks.workunit.client.0.smithi037.stdout:2/723: dread d1/da/dc/f15 [0,4194304] 0 2024-09-19T06:08:48.310 INFO:tasks.workunit.client.0.smithi037.stdout:2/724: readlink d1/da/lb4 0 2024-09-19T06:08:48.310 INFO:tasks.workunit.client.0.smithi037.stdout:8/804: creat d1/d61/d7e/dbc/dc2/d59/f116 x:0 0 0 2024-09-19T06:08:48.310 INFO:tasks.workunit.client.0.smithi037.stdout:0/693: dwrite d5/d8/f6c [0,4194304] 0 2024-09-19T06:08:48.313 INFO:tasks.workunit.client.0.smithi037.stdout:5/616: mknod d2/d12/d28/d57/dc4/cc8 0 2024-09-19T06:08:48.314 INFO:tasks.workunit.client.0.smithi037.stdout:6/599: symlink d9/dd/d2b/d42/dad/lc4 0 2024-09-19T06:08:48.314 INFO:tasks.workunit.client.0.smithi037.stdout:6/600: fdatasync d9/dd/f23 0 2024-09-19T06:08:48.316 INFO:tasks.workunit.client.0.smithi037.stdout:5/617: dread d2/d12/d28/d22/d4a/d9e/fb1 [0,4194304] 0 2024-09-19T06:08:48.316 INFO:tasks.workunit.client.0.smithi037.stdout:1/550: link d2/d12/d15/c3d d2/d12/d1e/d2a/cb4 0 2024-09-19T06:08:48.316 INFO:tasks.workunit.client.0.smithi037.stdout:1/551: readlink d2/d12/d1e/d2a/d2e/l61 0 2024-09-19T06:08:48.319 INFO:tasks.workunit.client.0.smithi037.stdout:8/805: dread d1/d35/ff2 [0,4194304] 0 2024-09-19T06:08:48.319 INFO:tasks.workunit.client.0.smithi037.stdout:8/806: fsync d1/d61/d7e/d8b/d91/d3d/d66/f107 0 2024-09-19T06:08:48.319 INFO:tasks.workunit.client.0.smithi037.stdout:8/807: truncate d1/d61/d7e/dbc/dc2/fe9 616712 0 2024-09-19T06:08:48.320 INFO:tasks.workunit.client.0.smithi037.stdout:0/694: link d5/d20/f57 d5/d8/d22/ff6 0 2024-09-19T06:08:48.321 INFO:tasks.workunit.client.0.smithi037.stdout:6/601: getdents d9/dd/d1c 0 2024-09-19T06:08:48.324 INFO:tasks.workunit.client.0.smithi037.stdout:0/695: creat d5/d8/d44/d48/daf/ff7 x:0 0 0 2024-09-19T06:08:48.324 INFO:tasks.workunit.client.0.smithi037.stdout:6/602: mkdir d9/d16/dc5 0 2024-09-19T06:08:48.324 INFO:tasks.workunit.client.0.smithi037.stdout:6/603: write d9/dd/f59 [1075812,76556] 0 2024-09-19T06:08:48.325 INFO:tasks.workunit.client.0.smithi037.stdout:0/696: creat d5/ff8 x:0 0 0 2024-09-19T06:08:48.326 INFO:tasks.workunit.client.0.smithi037.stdout:7/675: dwrite d6/d21/f5f [0,4194304] 0 2024-09-19T06:08:48.326 INFO:tasks.workunit.client.0.smithi037.stdout:7/676: fdatasync d6/d20/d34/f66 0 2024-09-19T06:08:48.326 INFO:tasks.workunit.client.0.smithi037.stdout:0/697: symlink d5/d8/d22/d89/d96/dc5/lf9 0 2024-09-19T06:08:48.328 INFO:tasks.workunit.client.0.smithi037.stdout:7/677: mknod d6/dc/d22/d59/da8/dc4/cd5 0 2024-09-19T06:08:48.328 INFO:tasks.workunit.client.0.smithi037.stdout:7/678: write d6/dc/f89 [3280999,705] 0 2024-09-19T06:08:48.328 INFO:tasks.workunit.client.0.smithi037.stdout:7/679: stat d6/f2b 0 2024-09-19T06:08:48.328 INFO:tasks.workunit.client.0.smithi037.stdout:7/680: readlink d6/dc/df/l1f 0 2024-09-19T06:08:48.334 INFO:tasks.workunit.client.0.smithi037.stdout:0/698: symlink d5/d18/d68/d85/lfa 0 2024-09-19T06:08:48.336 INFO:tasks.workunit.client.0.smithi037.stdout:0/699: unlink d5/c13 0 2024-09-19T06:08:48.336 INFO:tasks.workunit.client.0.smithi037.stdout:8/808: dread d1/d61/d68/f86 [0,4194304] 0 2024-09-19T06:08:48.337 INFO:tasks.workunit.client.0.smithi037.stdout:5/618: dread d2/d12/d28/f45 [0,4194304] 0 2024-09-19T06:08:48.337 INFO:tasks.workunit.client.0.smithi037.stdout:4/731: dwrite d0/d6/f26 [0,4194304] 0 2024-09-19T06:08:48.337 INFO:tasks.workunit.client.0.smithi037.stdout:2/725: dwrite d1/d16/d96/f9b [0,4194304] 0 2024-09-19T06:08:48.342 INFO:tasks.workunit.client.0.smithi037.stdout:2/726: rmdir d1/d6/da3/da8/ded 0 2024-09-19T06:08:48.343 INFO:tasks.workunit.client.0.smithi037.stdout:1/552: dread d2/d12/d17/f2b [0,4194304] 0 2024-09-19T06:08:48.345 INFO:tasks.workunit.client.0.smithi037.stdout:2/727: mknod d1/da/dc/cf3 0 2024-09-19T06:08:48.347 INFO:tasks.workunit.client.0.smithi037.stdout:1/553: symlink d2/d12/d1e/d2a/lb5 0 2024-09-19T06:08:48.348 INFO:tasks.workunit.client.0.smithi037.stdout:2/728: mkdir d1/d6/da3/da8/dbe/df4 0 2024-09-19T06:08:48.349 INFO:tasks.workunit.client.0.smithi037.stdout:1/554: rmdir d2/d12 39 2024-09-19T06:08:48.349 INFO:tasks.workunit.client.0.smithi037.stdout:1/555: readlink d2/d12/d1e/d2a/l4a 0 2024-09-19T06:08:48.350 INFO:tasks.workunit.client.0.smithi037.stdout:1/556: truncate d2/d12/d1e/d2a/d97/f99 592767 0 2024-09-19T06:08:48.352 INFO:tasks.workunit.client.0.smithi037.stdout:2/729: symlink d1/da/d6e/lf5 0 2024-09-19T06:08:48.353 INFO:tasks.workunit.client.0.smithi037.stdout:1/557: mkdir d2/d12/d1d/d47/db6 0 2024-09-19T06:08:48.354 INFO:tasks.workunit.client.0.smithi037.stdout:7/681: read d6/d20/d4b/d60/f75 [1822999,23230] 0 2024-09-19T06:08:48.354 INFO:tasks.workunit.client.0.smithi037.stdout:6/604: dwrite d9/d6e/fb3 [0,4194304] 0 2024-09-19T06:08:48.355 INFO:tasks.workunit.client.0.smithi037.stdout:5/619: dread d2/d12/f4f [0,4194304] 0 2024-09-19T06:08:48.355 INFO:tasks.workunit.client.0.smithi037.stdout:5/620: chown d2/d12/d28/d22/d4a/d9e 29 1 2024-09-19T06:08:48.355 INFO:tasks.workunit.client.0.smithi037.stdout:5/621: chown d2/d12 2 1 2024-09-19T06:08:48.356 INFO:tasks.workunit.client.0.smithi037.stdout:1/558: rename d2/d12/d1e/d2a/cb4 to d2/d12/d15/d5c/cb7 0 2024-09-19T06:08:48.359 INFO:tasks.workunit.client.0.smithi037.stdout:6/605: creat d9/d16/fc6 x:0 0 0 2024-09-19T06:08:48.360 INFO:tasks.workunit.client.0.smithi037.stdout:1/559: creat d2/d12/d1e/d2d/d87/fb8 x:0 0 0 2024-09-19T06:08:48.360 INFO:tasks.workunit.client.0.smithi037.stdout:1/560: write d2/d12/d1e/d2d/f4c [264707,59623] 0 2024-09-19T06:08:48.361 INFO:tasks.workunit.client.0.smithi037.stdout:7/682: symlink d6/d20/d34/ld6 0 2024-09-19T06:08:48.361 INFO:tasks.workunit.client.0.smithi037.stdout:7/683: chown d6/dc/d22/f1a 16634421 1 2024-09-19T06:08:48.362 INFO:tasks.workunit.client.0.smithi037.stdout:6/606: link d9/dd/d20/d5a/d6d/d82/d9f/da4/f96 d9/dd/d20/d5a/d6d/d82/d9f/da4/fc7 0 2024-09-19T06:08:48.363 INFO:tasks.workunit.client.0.smithi037.stdout:7/684: symlink d6/dc/d7b/ld7 0 2024-09-19T06:08:48.365 INFO:tasks.workunit.client.0.smithi037.stdout:6/607: unlink d9/dd/d1c/la0 0 2024-09-19T06:08:48.365 INFO:tasks.workunit.client.0.smithi037.stdout:4/732: dwrite d0/d2/d37/d46/de5/f6c [0,4194304] 0 2024-09-19T06:08:48.368 INFO:tasks.workunit.client.0.smithi037.stdout:6/608: symlink d9/d6e/lc8 0 2024-09-19T06:08:48.369 INFO:tasks.workunit.client.0.smithi037.stdout:0/700: dwrite d5/d17/d6e/ff3 [0,4194304] 0 2024-09-19T06:08:48.371 INFO:tasks.workunit.client.0.smithi037.stdout:6/609: unlink d9/dd/f5e 0 2024-09-19T06:08:48.371 INFO:tasks.workunit.client.0.smithi037.stdout:6/610: truncate d9/dd/d2b/f61 4481356 0 2024-09-19T06:08:48.371 INFO:tasks.workunit.client.0.smithi037.stdout:5/622: dread d2/fa [0,4194304] 0 2024-09-19T06:08:48.371 INFO:tasks.workunit.client.0.smithi037.stdout:5/623: write d2/d12/d28/f48 [653342,50901] 0 2024-09-19T06:08:48.372 INFO:tasks.workunit.client.0.smithi037.stdout:5/624: write d2/d12/d28/d57/f75 [2321761,86321] 0 2024-09-19T06:08:48.373 INFO:tasks.workunit.client.0.smithi037.stdout:0/701: symlink d5/d8/d44/d61/lfb 0 2024-09-19T06:08:48.374 INFO:tasks.workunit.client.0.smithi037.stdout:6/611: truncate d9/dd/d1c/d4e/d33/f88 2083814 0 2024-09-19T06:08:48.377 INFO:tasks.workunit.client.0.smithi037.stdout:0/702: truncate d5/dd5/de9/d21/f4b 357583 0 2024-09-19T06:08:48.377 INFO:tasks.workunit.client.0.smithi037.stdout:0/703: getdents d5/dd5/de9/ddc 0 2024-09-19T06:08:48.377 INFO:tasks.workunit.client.0.smithi037.stdout:0/704: stat d5/d17/c2b 0 2024-09-19T06:08:48.377 INFO:tasks.workunit.client.0.smithi037.stdout:0/705: readlink d5/dd5/de9/dca/lec 0 2024-09-19T06:08:48.384 INFO:tasks.workunit.client.0.smithi037.stdout:7/685: dread d6/d20/d4b/d60/f74 [0,4194304] 0 2024-09-19T06:08:48.384 INFO:tasks.workunit.client.0.smithi037.stdout:7/686: stat d6/d21/f44 0 2024-09-19T06:08:48.389 INFO:tasks.workunit.client.0.smithi037.stdout:5/625: read d2/d12/f16 [884370,76838] 0 2024-09-19T06:08:48.389 INFO:tasks.workunit.client.0.smithi037.stdout:2/730: dwrite d1/d16/f74 [0,4194304] 0 2024-09-19T06:08:48.389 INFO:tasks.workunit.client.0.smithi037.stdout:5/626: write d2/d12/d28/d57/fb0 [1305743,108454] 0 2024-09-19T06:08:48.390 INFO:tasks.workunit.client.0.smithi037.stdout:5/627: truncate d2/d12/d28/d22/fc1 400565 0 2024-09-19T06:08:48.391 INFO:tasks.workunit.client.0.smithi037.stdout:2/731: getdents d1/da/d95/dce 0 2024-09-19T06:08:48.392 INFO:tasks.workunit.client.0.smithi037.stdout:5/628: mknod d2/d12/d28/d22/d53/cc9 0 2024-09-19T06:08:48.393 INFO:tasks.workunit.client.0.smithi037.stdout:1/561: dwrite d2/d12/d1e/d2d/f55 [0,4194304] 0 2024-09-19T06:08:48.393 INFO:tasks.workunit.client.0.smithi037.stdout:1/562: fsync d2/d48/f62 0 2024-09-19T06:08:48.394 INFO:tasks.workunit.client.0.smithi037.stdout:4/733: dwrite d0/d6/d1b/d20/f95 [0,4194304] 0 2024-09-19T06:08:48.394 INFO:tasks.workunit.client.0.smithi037.stdout:4/734: chown d0/d6/d45/dd9/l61 2 1 2024-09-19T06:08:48.394 INFO:tasks.workunit.client.0.smithi037.stdout:5/629: creat d2/d10/daf/fca x:0 0 0 2024-09-19T06:08:48.395 INFO:tasks.workunit.client.0.smithi037.stdout:6/612: write d9/dd/d20/d5a/d6d/d82/fa6 [1822286,76501] 0 2024-09-19T06:08:48.398 INFO:tasks.workunit.client.0.smithi037.stdout:6/613: creat d9/fc9 x:0 0 0 2024-09-19T06:08:48.399 INFO:tasks.workunit.client.0.smithi037.stdout:6/614: unlink d9/f4c 0 2024-09-19T06:08:48.399 INFO:tasks.workunit.client.0.smithi037.stdout:6/615: chown d9/dd/d1c/f3e 262724937 1 2024-09-19T06:08:48.399 INFO:tasks.workunit.client.0.smithi037.stdout:6/616: write d9/d16/f8a [70624,56139] 0 2024-09-19T06:08:48.400 INFO:tasks.workunit.client.0.smithi037.stdout:6/617: rename d9/fc9 to d9/dd/d20/d5a/d6d/d82/d9f/fca 0 2024-09-19T06:08:48.402 INFO:tasks.workunit.client.0.smithi037.stdout:6/618: mknod d9/dd/d1c/d4e/d65/ccb 0 2024-09-19T06:08:48.403 INFO:tasks.workunit.client.0.smithi037.stdout:6/619: truncate d9/f19 1064260 0 2024-09-19T06:08:48.404 INFO:tasks.workunit.client.0.smithi037.stdout:6/620: truncate d9/fa8 777241 0 2024-09-19T06:08:48.404 INFO:tasks.workunit.client.0.smithi037.stdout:6/621: chown d9/d6e/f8f 27 1 2024-09-19T06:08:48.406 INFO:tasks.workunit.client.0.smithi037.stdout:6/622: unlink d9/dd/d1c/d73/cab 0 2024-09-19T06:08:48.408 INFO:tasks.workunit.client.0.smithi037.stdout:6/623: creat d9/dd/d1c/d4e/fcc x:0 0 0 2024-09-19T06:08:48.414 INFO:tasks.workunit.client.0.smithi037.stdout:6/624: creat d9/d9c/fcd x:0 0 0 2024-09-19T06:08:48.414 INFO:tasks.workunit.client.0.smithi037.stdout:6/625: write d9/d6e/fa5 [159416,31208] 0 2024-09-19T06:08:48.414 INFO:tasks.workunit.client.0.smithi037.stdout:6/626: write d9/dd/d20/d5a/d6d/d82/d9f/fb8 [847292,28364] 0 2024-09-19T06:08:48.417 INFO:tasks.workunit.client.0.smithi037.stdout:7/687: dwrite d6/d20/d34/f50 [0,4194304] 0 2024-09-19T06:08:48.417 INFO:tasks.workunit.client.0.smithi037.stdout:7/688: readlink d6/l43 0 2024-09-19T06:08:48.423 INFO:tasks.workunit.client.0.smithi037.stdout:6/627: symlink d9/dd/d1c/d4e/d65/db0/lce 0 2024-09-19T06:08:48.423 INFO:tasks.workunit.client.0.smithi037.stdout:2/732: dwrite d1/da/dc/d21/d55/fe6 [0,4194304] 0 2024-09-19T06:08:48.426 INFO:tasks.workunit.client.0.smithi037.stdout:7/689: creat d6/d20/d34/dc0/fd8 x:0 0 0 2024-09-19T06:08:48.428 INFO:tasks.workunit.client.0.smithi037.stdout:7/690: rename d6/d20/d34/f50 to d6/d20/d71/fd9 0 2024-09-19T06:08:48.430 INFO:tasks.workunit.client.0.smithi037.stdout:3/615: sync 2024-09-19T06:08:48.430 INFO:tasks.workunit.client.0.smithi037.stdout:3/616: write d0/d16/fc6 [2239560,41684] 0 2024-09-19T06:08:48.431 INFO:tasks.workunit.client.0.smithi037.stdout:3/617: rename d0/d16/d19/c34 to d0/d16/d19/d33/cd2 0 2024-09-19T06:08:48.433 INFO:tasks.workunit.client.0.smithi037.stdout:3/618: unlink d0/d43/d23/d7a/d77/dc3/fc8 0 2024-09-19T06:08:48.433 INFO:tasks.workunit.client.0.smithi037.stdout:3/619: write d0/d43/d23/f8d [881133,50039] 0 2024-09-19T06:08:48.434 INFO:tasks.workunit.client.0.smithi037.stdout:3/620: creat d0/d43/d23/d7a/d77/d45/fd3 x:0 0 0 2024-09-19T06:08:48.434 INFO:tasks.workunit.client.0.smithi037.stdout:3/621: write d0/d16/d19/f2e [4344654,57515] 0 2024-09-19T06:08:48.435 INFO:tasks.workunit.client.0.smithi037.stdout:3/622: rename d0/d43/d9a to d0/d16/da6/dd4 0 2024-09-19T06:08:48.436 INFO:tasks.workunit.client.0.smithi037.stdout:3/623: stat d0/d5f/da0/cbc 0 2024-09-19T06:08:48.436 INFO:tasks.workunit.client.0.smithi037.stdout:2/733: dread d1/d6/f6c [0,4194304] 0 2024-09-19T06:08:48.436 INFO:tasks.workunit.client.0.smithi037.stdout:5/630: dwrite d2/d12/f5d [0,4194304] 0 2024-09-19T06:08:48.437 INFO:tasks.workunit.client.0.smithi037.stdout:2/734: dread - d1/d6/da3/da8/fe5 zero size 2024-09-19T06:08:48.437 INFO:tasks.workunit.client.0.smithi037.stdout:3/624: mkdir d0/d16/da6/dd5 0 2024-09-19T06:08:48.438 INFO:tasks.workunit.client.0.smithi037.stdout:5/631: getdents d2/d12/d28/d22/d87/da8 0 2024-09-19T06:08:48.439 INFO:tasks.workunit.client.0.smithi037.stdout:5/632: mknod d2/d12/d28/d22/d35/dae/ccb 0 2024-09-19T06:08:48.439 INFO:tasks.workunit.client.0.smithi037.stdout:5/633: truncate d2/d12/d28/d22/d4a/d9f/fb9 27580 0 2024-09-19T06:08:48.439 INFO:tasks.workunit.client.0.smithi037.stdout:5/634: chown d2/d12/d28/d22/f3c 1 1 2024-09-19T06:08:48.439 INFO:tasks.workunit.client.0.smithi037.stdout:5/635: chown d2/d10/daf/fb4 56 1 2024-09-19T06:08:48.440 INFO:tasks.workunit.client.0.smithi037.stdout:2/735: link d1/d6/c4b d1/da/dd7/cf6 0 2024-09-19T06:08:48.440 INFO:tasks.workunit.client.0.smithi037.stdout:2/736: write d1/da/d95/f97 [2813072,96731] 0 2024-09-19T06:08:48.440 INFO:tasks.workunit.client.0.smithi037.stdout:2/737: write d1/d16/d62/fa2 [4348474,16415] 0 2024-09-19T06:08:48.441 INFO:tasks.workunit.client.0.smithi037.stdout:2/738: chown d1/d16/d62/f73 313 1 2024-09-19T06:08:48.446 INFO:tasks.workunit.client.0.smithi037.stdout:2/739: creat d1/d6/da3/da8/ff7 x:0 0 0 2024-09-19T06:08:48.448 INFO:tasks.workunit.client.0.smithi037.stdout:7/691: dread d6/d20/d4b/d60/d33/d8c/f96 [0,4194304] 0 2024-09-19T06:08:48.449 INFO:tasks.workunit.client.0.smithi037.stdout:6/628: dwrite d9/dd/d2b/d79/f53 [0,4194304] 0 2024-09-19T06:08:48.459 INFO:tasks.workunit.client.0.smithi037.stdout:7/692: symlink d6/d20/d34/d97/lda 0 2024-09-19T06:08:48.467 INFO:tasks.workunit.client.0.smithi037.stdout:5/636: dwrite d2/d12/d24/d58/d8e/f94 [0,4194304] 0 2024-09-19T06:08:48.468 INFO:tasks.workunit.client.0.smithi037.stdout:5/637: chown d2/d12/d28/d22/d4a/d9e 117970 1 2024-09-19T06:08:48.469 INFO:tasks.workunit.client.0.smithi037.stdout:3/625: dwrite d0/d43/d26/fb3 [0,4194304] 0 2024-09-19T06:08:48.469 INFO:tasks.workunit.client.0.smithi037.stdout:3/626: chown d0/d16/d19/d1d/d5e/d61/dc4 7 1 2024-09-19T06:08:48.469 INFO:tasks.workunit.client.0.smithi037.stdout:3/627: fdatasync d0/d43/d23/d7a/d77/f53 0 2024-09-19T06:08:48.471 INFO:tasks.workunit.client.0.smithi037.stdout:7/693: write d6/d20/d4b/d60/d33/f6b [840595,128133] 0 2024-09-19T06:08:48.471 INFO:tasks.workunit.client.0.smithi037.stdout:3/628: rmdir d0/d16/da6 39 2024-09-19T06:08:48.471 INFO:tasks.workunit.client.0.smithi037.stdout:3/629: getdents d0/d16/d19/d33/d87/dbd 0 2024-09-19T06:08:48.471 INFO:tasks.workunit.client.0.smithi037.stdout:7/694: creat d6/dc/d22/d59/da8/dc4/fdb x:0 0 0 2024-09-19T06:08:48.472 INFO:tasks.workunit.client.0.smithi037.stdout:7/695: fsync d6/dc/df/d7e/fc3 0 2024-09-19T06:08:48.472 INFO:tasks.workunit.client.0.smithi037.stdout:3/630: creat d0/d43/d23/d7a/d77/fd6 x:0 0 0 2024-09-19T06:08:48.472 INFO:tasks.workunit.client.0.smithi037.stdout:3/631: write d0/d5f/da0/fc1 [438211,62539] 0 2024-09-19T06:08:48.472 INFO:tasks.workunit.client.0.smithi037.stdout:3/632: stat d0/d43/d23/d7a/d77/d45/d55/l8a 0 2024-09-19T06:08:48.472 INFO:tasks.workunit.client.0.smithi037.stdout:3/633: chown d0/d16/d19/d1d 111 1 2024-09-19T06:08:48.473 INFO:tasks.workunit.client.0.smithi037.stdout:2/740: dwrite d1/d9e/fdc [0,4194304] 0 2024-09-19T06:08:48.479 INFO:tasks.workunit.client.0.smithi037.stdout:2/741: symlink d1/da/dc/d21/d7d/d80/dc7/lf8 0 2024-09-19T06:08:48.480 INFO:tasks.workunit.client.0.smithi037.stdout:6/629: dwrite d9/dd/d2b/d79/f70 [0,4194304] 0 2024-09-19T06:08:48.480 INFO:tasks.workunit.client.0.smithi037.stdout:6/630: fsync d9/dd/d2b/f7c 0 2024-09-19T06:08:48.485 INFO:tasks.workunit.client.0.smithi037.stdout:5/638: dread d2/d12/d24/d58/d8e/f94 [0,4194304] 0 2024-09-19T06:08:48.487 INFO:tasks.workunit.client.0.smithi037.stdout:5/639: rename d2/d12/f36 to d2/d12/d28/d22/d4a/d9f/fcc 0 2024-09-19T06:08:48.492 INFO:tasks.workunit.client.0.smithi037.stdout:9/792: sync 2024-09-19T06:08:48.492 INFO:tasks.workunit.client.0.smithi037.stdout:9/793: write da/dec/d116/d1b/f1f [2069903,34513] 0 2024-09-19T06:08:48.492 INFO:tasks.workunit.client.0.smithi037.stdout:9/794: fdatasync da/dec/d116/d1b/d23/f73 0 2024-09-19T06:08:48.492 INFO:tasks.workunit.client.0.smithi037.stdout:9/795: truncate da/dec/d116/d1b/d62/f84 583479 0 2024-09-19T06:08:48.493 INFO:tasks.workunit.client.0.smithi037.stdout:8/809: sync 2024-09-19T06:08:48.493 INFO:tasks.workunit.client.0.smithi037.stdout:0/706: sync 2024-09-19T06:08:48.493 INFO:tasks.workunit.client.0.smithi037.stdout:0/707: dread - d5/d18/fbc zero size 2024-09-19T06:08:48.493 INFO:tasks.workunit.client.0.smithi037.stdout:0/708: stat d5/ff8 0 2024-09-19T06:08:48.493 INFO:tasks.workunit.client.0.smithi037.stdout:0/709: fdatasync d5/d8/d22/d89/d96/dc5/fe8 0 2024-09-19T06:08:48.493 INFO:tasks.workunit.client.0.smithi037.stdout:4/735: sync 2024-09-19T06:08:48.493 INFO:tasks.workunit.client.0.smithi037.stdout:1/563: sync 2024-09-19T06:08:48.495 INFO:tasks.workunit.client.0.smithi037.stdout:8/810: rmdir d1/d61/d68 39 2024-09-19T06:08:48.496 INFO:tasks.workunit.client.0.smithi037.stdout:0/710: link d5/dd5/de9/dca/fce d5/d8/d22/d89/d96/ffc 0 2024-09-19T06:08:48.498 INFO:tasks.workunit.client.0.smithi037.stdout:1/564: rename d2/d12/d1e/d2a/d8f/c91 to d2/d12/d1e/d75/cb9 0 2024-09-19T06:08:48.499 INFO:tasks.workunit.client.0.smithi037.stdout:8/811: rmdir d1/d61/d68 39 2024-09-19T06:08:48.500 INFO:tasks.workunit.client.0.smithi037.stdout:0/711: creat d5/dd5/de9/d8d/ffd x:0 0 0 2024-09-19T06:08:48.501 INFO:tasks.workunit.client.0.smithi037.stdout:1/565: creat d2/d12/d1e/d2a/d8f/da6/fba x:0 0 0 2024-09-19T06:08:48.502 INFO:tasks.workunit.client.0.smithi037.stdout:8/812: unlink d1/d61/d7e/dbc/dc2/d59/f116 0 2024-09-19T06:08:48.504 INFO:tasks.workunit.client.0.smithi037.stdout:1/566: mknod d2/d12/d1d/d6b/cbb 0 2024-09-19T06:08:48.507 INFO:tasks.workunit.client.0.smithi037.stdout:3/634: dwrite d0/d5f/fc0 [0,4194304] 0 2024-09-19T06:08:48.510 INFO:tasks.workunit.client.0.smithi037.stdout:7/696: dwrite d6/d20/d71/dbb/fc2 [0,4194304] 0 2024-09-19T06:08:48.515 INFO:tasks.workunit.client.0.smithi037.stdout:7/697: mkdir d6/d20/d4b/ddc 0 2024-09-19T06:08:48.515 INFO:tasks.workunit.client.0.smithi037.stdout:7/698: write d6/dc/df/fae [535411,79538] 0 2024-09-19T06:08:48.518 INFO:tasks.workunit.client.0.smithi037.stdout:7/699: unlink d6/dc/df/d7e/d99/fca 0 2024-09-19T06:08:48.520 INFO:tasks.workunit.client.0.smithi037.stdout:7/700: creat d6/dad/fdd x:0 0 0 2024-09-19T06:08:48.524 INFO:tasks.workunit.client.0.smithi037.stdout:5/640: write d2/f23 [4178917,10306] 0 2024-09-19T06:08:48.524 INFO:tasks.workunit.client.0.smithi037.stdout:2/742: dwrite d1/da/dc/d21/d55/fe6 [0,4194304] 0 2024-09-19T06:08:48.524 INFO:tasks.workunit.client.0.smithi037.stdout:2/743: chown d1/da/cf0 180550 1 2024-09-19T06:08:48.524 INFO:tasks.workunit.client.0.smithi037.stdout:2/744: fdatasync d1/da/d6e/da0/fd8 0 2024-09-19T06:08:48.525 INFO:tasks.workunit.client.0.smithi037.stdout:2/745: dread - d1/d16/f40 zero size 2024-09-19T06:08:48.525 INFO:tasks.workunit.client.0.smithi037.stdout:2/746: getdents d1/da/d95/dce 0 2024-09-19T06:08:48.527 INFO:tasks.workunit.client.0.smithi037.stdout:2/747: symlink d1/da/d6e/lf9 0 2024-09-19T06:08:48.528 INFO:tasks.workunit.client.0.smithi037.stdout:5/641: rename d2/d12/d28/f48 to d2/d12/d28/d22/d4a/fcd 0 2024-09-19T06:08:48.529 INFO:tasks.workunit.client.0.smithi037.stdout:2/748: mkdir d1/d9e/dfa 0 2024-09-19T06:08:48.529 INFO:tasks.workunit.client.0.smithi037.stdout:8/813: write d1/d35/fb4 [1691850,35181] 0 2024-09-19T06:08:48.530 INFO:tasks.workunit.client.0.smithi037.stdout:2/749: mknod d1/d6/da3/df1/cfb 0 2024-09-19T06:08:48.530 INFO:tasks.workunit.client.0.smithi037.stdout:2/750: chown d1/da/dd7 3862 1 2024-09-19T06:08:48.532 INFO:tasks.workunit.client.0.smithi037.stdout:2/751: creat d1/da/d95/ffc x:0 0 0 2024-09-19T06:08:48.532 INFO:tasks.workunit.client.0.smithi037.stdout:2/752: chown d1/da/d6e/da0/faf 1822 1 2024-09-19T06:08:48.533 INFO:tasks.workunit.client.0.smithi037.stdout:9/796: dread da/dec/d116/d63/f90 [0,4194304] 0 2024-09-19T06:08:48.533 INFO:tasks.workunit.client.0.smithi037.stdout:6/631: dwrite d9/dd/d20/d5a/d6d/d82/fa6 [4194304,4194304] 0 2024-09-19T06:08:48.533 INFO:tasks.workunit.client.0.smithi037.stdout:9/797: stat da/dec/d116/d1b 0 2024-09-19T06:08:48.534 INFO:tasks.workunit.client.0.smithi037.stdout:4/736: dwrite d0/d6/f23 [0,4194304] 0 2024-09-19T06:08:48.534 INFO:tasks.workunit.client.0.smithi037.stdout:4/737: chown d0/d2/d37/d46/de5/fc5 723894280 1 2024-09-19T06:08:48.534 INFO:tasks.workunit.client.0.smithi037.stdout:4/738: write d0/d2/d37/d46/de5/f5c [4429281,60600] 0 2024-09-19T06:08:48.534 INFO:tasks.workunit.client.0.smithi037.stdout:4/739: readlink d0/d2/lbc 0 2024-09-19T06:08:48.534 INFO:tasks.workunit.client.0.smithi037.stdout:6/632: dread d9/dd/d1c/d4e/d65/f8b [0,4194304] 0 2024-09-19T06:08:48.541 INFO:tasks.workunit.client.0.smithi037.stdout:2/753: mkdir d1/d6/da3/da8/dfd 0 2024-09-19T06:08:48.541 INFO:tasks.workunit.client.0.smithi037.stdout:1/567: dwrite d2/d12/d1e/d2a/f60 [0,4194304] 0 2024-09-19T06:08:48.545 INFO:tasks.workunit.client.0.smithi037.stdout:6/633: mkdir d9/d16/dcf 0 2024-09-19T06:08:48.545 INFO:tasks.workunit.client.0.smithi037.stdout:6/634: fdatasync d9/dd/d2b/d79/f63 0 2024-09-19T06:08:48.545 INFO:tasks.workunit.client.0.smithi037.stdout:2/754: rmdir d1/d33 39 2024-09-19T06:08:48.546 INFO:tasks.workunit.client.0.smithi037.stdout:6/635: truncate d9/dd/f52 714365 0 2024-09-19T06:08:48.546 INFO:tasks.workunit.client.0.smithi037.stdout:6/636: fsync d9/dd/f22 0 2024-09-19T06:08:48.547 INFO:tasks.workunit.client.0.smithi037.stdout:6/637: stat d9/dd/lbd 0 2024-09-19T06:08:48.547 INFO:tasks.workunit.client.0.smithi037.stdout:2/755: creat d1/da/dc/d21/d55/dbc/db0/de0/ffe x:0 0 0 2024-09-19T06:08:48.548 INFO:tasks.workunit.client.0.smithi037.stdout:2/756: creat d1/da/dc/d21/d7d/d80/fff x:0 0 0 2024-09-19T06:08:48.549 INFO:tasks.workunit.client.0.smithi037.stdout:5/642: read d2/d12/d28/d22/d35/fa0 [7431847,106846] 0 2024-09-19T06:08:48.549 INFO:tasks.workunit.client.0.smithi037.stdout:5/643: stat d2/fd 0 2024-09-19T06:08:48.549 INFO:tasks.workunit.client.0.smithi037.stdout:5/644: chown d2/d12/d24 62597 1 2024-09-19T06:08:48.549 INFO:tasks.workunit.client.0.smithi037.stdout:5/645: write d2/d12/d7e/fa6 [302597,1948] 0 2024-09-19T06:08:48.549 INFO:tasks.workunit.client.0.smithi037.stdout:2/757: mkdir d1/da/d6e/d100 0 2024-09-19T06:08:48.549 INFO:tasks.workunit.client.0.smithi037.stdout:2/758: write d1/da/dc/d21/d7d/d80/f81 [655510,80593] 0 2024-09-19T06:08:48.556 INFO:tasks.workunit.client.0.smithi037.stdout:1/568: write d2/d12/d15/d34/f52 [2189818,117632] 0 2024-09-19T06:08:48.556 INFO:tasks.workunit.client.0.smithi037.stdout:1/569: stat d2/d12/d1e/d2a/d8f/fa1 0 2024-09-19T06:08:48.556 INFO:tasks.workunit.client.0.smithi037.stdout:3/635: dwrite d0/d5f/fcc [0,4194304] 0 2024-09-19T06:08:48.558 INFO:tasks.workunit.client.0.smithi037.stdout:7/701: dwrite d6/d20/d34/d7d/f90 [0,4194304] 0 2024-09-19T06:08:48.558 INFO:tasks.workunit.client.0.smithi037.stdout:7/702: dread - d6/d20/d4b/d60/d33/fab zero size 2024-09-19T06:08:48.558 INFO:tasks.workunit.client.0.smithi037.stdout:7/703: truncate d6/d20/f6c 1737451 0 2024-09-19T06:08:48.561 INFO:tasks.workunit.client.0.smithi037.stdout:1/570: symlink d2/d12/d1e/d2a/lbc 0 2024-09-19T06:08:48.561 INFO:tasks.workunit.client.0.smithi037.stdout:3/636: rename d0/d16/d19/d1d/l99 to d0/d16/d19/d33/d87/dbd/ld7 0 2024-09-19T06:08:48.561 INFO:tasks.workunit.client.0.smithi037.stdout:3/637: chown d0/d43/d23/l6b 498884402 1 2024-09-19T06:08:48.564 INFO:tasks.workunit.client.0.smithi037.stdout:4/740: dwrite d0/d6/d1b/d20/d48/da7/fb5 [0,4194304] 0 2024-09-19T06:08:48.564 INFO:tasks.workunit.client.0.smithi037.stdout:5/646: dread d2/d12/d28/d22/d4a/d9f/fcc [0,4194304] 0 2024-09-19T06:08:48.564 INFO:tasks.workunit.client.0.smithi037.stdout:7/704: creat d6/d20/fde x:0 0 0 2024-09-19T06:08:48.564 INFO:tasks.workunit.client.0.smithi037.stdout:7/705: truncate d6/dc/d7b/fb6 78180 0 2024-09-19T06:08:48.564 INFO:tasks.workunit.client.0.smithi037.stdout:5/647: write d2/d12/d28/f38 [5537528,92319] 0 2024-09-19T06:08:48.565 INFO:tasks.workunit.client.0.smithi037.stdout:1/571: creat d2/d12/d1d/d47/fbd x:0 0 0 2024-09-19T06:08:48.568 INFO:tasks.workunit.client.0.smithi037.stdout:2/759: write d1/d6/f12 [4051291,76804] 0 2024-09-19T06:08:48.572 INFO:tasks.workunit.client.0.smithi037.stdout:6/638: read d9/dd/d2b/d79/f53 [2899389,57625] 0 2024-09-19T06:08:48.572 INFO:tasks.workunit.client.0.smithi037.stdout:6/639: fsync d9/dd/d20/f27 0 2024-09-19T06:08:48.572 INFO:tasks.workunit.client.0.smithi037.stdout:6/640: truncate d9/d6e/f9a 1259476 0 2024-09-19T06:08:48.572 INFO:tasks.workunit.client.0.smithi037.stdout:6/641: chown d9/dd/lbd 913889 1 2024-09-19T06:08:48.574 INFO:tasks.workunit.client.0.smithi037.stdout:7/706: mkdir d6/d20/d4b/d60/ddf 0 2024-09-19T06:08:48.575 INFO:tasks.workunit.client.0.smithi037.stdout:9/798: write da/dec/d116/d1b/d2f/d6d/db4/ded/fcb [2599193,87215] 0 2024-09-19T06:08:48.577 INFO:tasks.workunit.client.0.smithi037.stdout:4/741: dread d0/f7a [0,4194304] 0 2024-09-19T06:08:48.577 INFO:tasks.workunit.client.0.smithi037.stdout:5/648: symlink d2/d12/d24/lce 0 2024-09-19T06:08:48.578 INFO:tasks.workunit.client.0.smithi037.stdout:1/572: mkdir d2/d12/d1e/dbe 0 2024-09-19T06:08:48.578 INFO:tasks.workunit.client.0.smithi037.stdout:5/649: truncate d2/d5c/f60 1326956 0 2024-09-19T06:08:48.578 INFO:tasks.workunit.client.0.smithi037.stdout:5/650: stat d2/d12/d28/d22/c39 0 2024-09-19T06:08:48.578 INFO:tasks.workunit.client.0.smithi037.stdout:2/760: creat d1/da/d95/dce/f101 x:0 0 0 2024-09-19T06:08:48.578 INFO:tasks.workunit.client.0.smithi037.stdout:2/761: write d1/d6/f24 [4561033,103157] 0 2024-09-19T06:08:48.578 INFO:tasks.workunit.client.0.smithi037.stdout:6/642: symlink d9/dd/d1c/d73/ld0 0 2024-09-19T06:08:48.578 INFO:tasks.workunit.client.0.smithi037.stdout:6/643: truncate d9/d6e/fae 318487 0 2024-09-19T06:08:48.578 INFO:tasks.workunit.client.0.smithi037.stdout:6/644: write d9/dd/d1c/fc2 [473263,78108] 0 2024-09-19T06:08:48.578 INFO:tasks.workunit.client.0.smithi037.stdout:6/645: write d9/dd/d1c/d4e/f7b [720709,82150] 0 2024-09-19T06:08:48.580 INFO:tasks.workunit.client.0.smithi037.stdout:9/799: mknod da/dec/d116/d1b/d2f/d6f/c120 0 2024-09-19T06:08:48.580 INFO:tasks.workunit.client.0.smithi037.stdout:9/800: fdatasync da/dec/d116/d1b/d62/fa8 0 2024-09-19T06:08:48.581 INFO:tasks.workunit.client.0.smithi037.stdout:1/573: link d2/d12/d1d/d47/f68 d2/d12/d1e/d2a/d8f/da6/fbf 0 2024-09-19T06:08:48.582 INFO:tasks.workunit.client.0.smithi037.stdout:5/651: creat d2/d10/daf/fcf x:0 0 0 2024-09-19T06:08:48.582 INFO:tasks.workunit.client.0.smithi037.stdout:3/638: dread d0/d16/d19/d33/f9d [0,4194304] 0 2024-09-19T06:08:48.582 INFO:tasks.workunit.client.0.smithi037.stdout:3/639: fsync d0/d43/d23/d7a/d77/d51/fb9 0 2024-09-19T06:08:48.582 INFO:tasks.workunit.client.0.smithi037.stdout:4/742: write d0/d2/d37/d92/fa4 [413083,44452] 0 2024-09-19T06:08:48.583 INFO:tasks.workunit.client.0.smithi037.stdout:6/646: link d9/d16/fc6 d9/d78/fd1 0 2024-09-19T06:08:48.583 INFO:tasks.workunit.client.0.smithi037.stdout:6/647: readlink d9/dd/d2b/d42/dad/lb4 0 2024-09-19T06:08:48.583 INFO:tasks.workunit.client.0.smithi037.stdout:5/652: mknod d2/d12/d24/d58/dbf/cd0 0 2024-09-19T06:08:48.584 INFO:tasks.workunit.client.0.smithi037.stdout:5/653: chown d2/d12/d28/ca9 5191274 1 2024-09-19T06:08:48.585 INFO:tasks.workunit.client.0.smithi037.stdout:3/640: getdents d0/d43/d23 0 2024-09-19T06:08:48.585 INFO:tasks.workunit.client.0.smithi037.stdout:6/648: truncate d9/dd/d20/d5a/d6d/d82/d9f/da4/f74 788502 0 2024-09-19T06:08:48.586 INFO:tasks.workunit.client.0.smithi037.stdout:5/654: creat d2/d12/d28/fd1 x:0 0 0 2024-09-19T06:08:48.588 INFO:tasks.workunit.client.0.smithi037.stdout:5/655: creat d2/d12/d24/d58/d8e/fd2 x:0 0 0 2024-09-19T06:08:48.588 INFO:tasks.workunit.client.0.smithi037.stdout:2/762: dread d1/da/f19 [0,4194304] 0 2024-09-19T06:08:48.588 INFO:tasks.workunit.client.0.smithi037.stdout:2/763: truncate d1/d16/f37 4389482 0 2024-09-19T06:08:48.592 INFO:tasks.workunit.client.0.smithi037.stdout:5/656: link d2/d12/d28/d22/fbe d2/d12/d28/d22/d87/da8/fd3 0 2024-09-19T06:08:48.592 INFO:tasks.workunit.client.0.smithi037.stdout:7/707: write d6/f8a [197064,110527] 0 2024-09-19T06:08:48.592 INFO:tasks.workunit.client.0.smithi037.stdout:5/657: stat d2/d12/d28/d22/d4a/d9f/f69 0 2024-09-19T06:08:48.593 INFO:tasks.workunit.client.0.smithi037.stdout:7/708: mkdir d6/d20/d4b/d60/ddf/de0 0 2024-09-19T06:08:48.594 INFO:tasks.workunit.client.0.smithi037.stdout:7/709: mkdir d6/d20/d71/de1 0 2024-09-19T06:08:48.594 INFO:tasks.workunit.client.0.smithi037.stdout:7/710: read d6/f2b [3817983,59967] 0 2024-09-19T06:08:48.595 INFO:tasks.workunit.client.0.smithi037.stdout:6/649: dread d9/dd/d1c/d4e/d33/f88 [0,4194304] 0 2024-09-19T06:08:48.595 INFO:tasks.workunit.client.0.smithi037.stdout:2/764: dread d1/da/dc/d21/d7d/dab/fc9 [0,4194304] 0 2024-09-19T06:08:48.595 INFO:tasks.workunit.client.0.smithi037.stdout:2/765: fsync d1/d16/f37 0 2024-09-19T06:08:48.595 INFO:tasks.workunit.client.0.smithi037.stdout:2/766: chown d1/d16/d96/c98 0 1 2024-09-19T06:08:48.595 INFO:tasks.workunit.client.0.smithi037.stdout:2/767: readlink d1/d6/da3/da8/lca 0 2024-09-19T06:08:48.595 INFO:tasks.workunit.client.0.smithi037.stdout:2/768: write d1/da/dc/f18 [2956275,45000] 0 2024-09-19T06:08:48.595 INFO:tasks.workunit.client.0.smithi037.stdout:7/711: mkdir d6/dc/d22/d59/da8/dd4/de2 0 2024-09-19T06:08:48.595 INFO:tasks.workunit.client.0.smithi037.stdout:2/769: fsync d1/d16/fe2 0 2024-09-19T06:08:48.597 INFO:tasks.workunit.client.0.smithi037.stdout:2/770: mknod d1/d33/d4c/c102 0 2024-09-19T06:08:48.600 INFO:tasks.workunit.client.0.smithi037.stdout:1/574: dread d2/fb [0,4194304] 0 2024-09-19T06:08:48.600 INFO:tasks.workunit.client.0.smithi037.stdout:1/575: truncate d2/f9 2007917 0 2024-09-19T06:08:48.601 INFO:tasks.workunit.client.0.smithi037.stdout:1/576: symlink d2/d12/d1e/d75/d89/lc0 0 2024-09-19T06:08:48.606 INFO:tasks.workunit.client.0.smithi037.stdout:6/650: dread d9/dd/d2b/f50 [0,4194304] 0 2024-09-19T06:08:48.607 INFO:tasks.workunit.client.0.smithi037.stdout:6/651: chown d9/d16/f4a 105 1 2024-09-19T06:08:48.608 INFO:tasks.workunit.client.0.smithi037.stdout:3/641: write d0/d5f/fcc [843152,69459] 0 2024-09-19T06:08:48.608 INFO:tasks.workunit.client.0.smithi037.stdout:6/652: mkdir d9/dd/d20/d5a/dd2 0 2024-09-19T06:08:48.610 INFO:tasks.workunit.client.0.smithi037.stdout:3/642: unlink d0/d16/lc2 0 2024-09-19T06:08:48.617 INFO:tasks.workunit.client.0.smithi037.stdout:4/743: dread d0/d2/d37/d46/db1/fe4 [0,4194304] 0 2024-09-19T06:08:48.617 INFO:tasks.workunit.client.0.smithi037.stdout:4/744: chown d0/d6/d1b/d20/d4d/d64/db0/dc4/fc8 0 1 2024-09-19T06:08:48.618 INFO:tasks.workunit.client.0.smithi037.stdout:9/801: dwrite da/dec/d116/d1b/d2f/dcc/f117 [0,4194304] 0 2024-09-19T06:08:48.618 INFO:tasks.workunit.client.0.smithi037.stdout:9/802: read - da/dec/d116/d63/dd3/f113 zero size 2024-09-19T06:08:48.618 INFO:tasks.workunit.client.0.smithi037.stdout:9/803: fdatasync da/d20/f8e 0 2024-09-19T06:08:48.619 INFO:tasks.workunit.client.0.smithi037.stdout:4/745: rmdir d0/d6/d1b/d20/d48 39 2024-09-19T06:08:48.619 INFO:tasks.workunit.client.0.smithi037.stdout:4/746: chown d0/d2/d37/d46/de5/d6f 252 1 2024-09-19T06:08:48.621 INFO:tasks.workunit.client.0.smithi037.stdout:4/747: getdents d0/d6/d1b 0 2024-09-19T06:08:48.622 INFO:tasks.workunit.client.0.smithi037.stdout:7/712: write d6/d20/d34/d7d/f90 [3430417,122626] 0 2024-09-19T06:08:48.622 INFO:tasks.workunit.client.0.smithi037.stdout:9/804: dread da/d20/d11c/fb5 [0,4194304] 0 2024-09-19T06:08:48.628 INFO:tasks.workunit.client.0.smithi037.stdout:9/805: creat da/db3/d10e/f121 x:0 0 0 2024-09-19T06:08:48.631 INFO:tasks.workunit.client.0.smithi037.stdout:9/806: mknod da/d20/d11c/ddc/c122 0 2024-09-19T06:08:48.631 INFO:tasks.workunit.client.0.smithi037.stdout:9/807: chown da/dec/d116/d1b/d43/f46 1283735 1 2024-09-19T06:08:48.631 INFO:tasks.workunit.client.0.smithi037.stdout:9/808: write da/dec/d116/d1b/d23/f69 [779056,16562] 0 2024-09-19T06:08:48.633 INFO:tasks.workunit.client.0.smithi037.stdout:9/809: creat da/dec/d116/d31/f123 x:0 0 0 2024-09-19T06:08:48.636 INFO:tasks.workunit.client.0.smithi037.stdout:1/577: dwrite d2/d12/f44 [4194304,4194304] 0 2024-09-19T06:08:48.637 INFO:tasks.workunit.client.0.smithi037.stdout:2/771: dwrite d1/da/fa5 [0,4194304] 0 2024-09-19T06:08:48.639 INFO:tasks.workunit.client.0.smithi037.stdout:1/578: mknod d2/d12/d1e/d63/cc1 0 2024-09-19T06:08:48.639 INFO:tasks.workunit.client.0.smithi037.stdout:1/579: dread - d2/d48/f6d zero size 2024-09-19T06:08:48.640 INFO:tasks.workunit.client.0.smithi037.stdout:3/643: dwrite d0/d16/f30 [0,4194304] 0 2024-09-19T06:08:48.641 INFO:tasks.workunit.client.0.smithi037.stdout:3/644: fsync d0/f17 0 2024-09-19T06:08:48.641 INFO:tasks.workunit.client.0.smithi037.stdout:3/645: fdatasync d0/d16/f71 0 2024-09-19T06:08:48.641 INFO:tasks.workunit.client.0.smithi037.stdout:3/646: write d0/d43/d23/d7a/d77/d51/f76 [861784,102358] 0 2024-09-19T06:08:48.641 INFO:tasks.workunit.client.0.smithi037.stdout:2/772: stat d1/da/dd7/cf6 0 2024-09-19T06:08:48.641 INFO:tasks.workunit.client.0.smithi037.stdout:2/773: write d1/da/dc/d21/d55/dbc/db0/de0/ffe [195513,108751] 0 2024-09-19T06:08:48.641 INFO:tasks.workunit.client.0.smithi037.stdout:2/774: write d1/d16/f3d [4259824,106878] 0 2024-09-19T06:08:48.644 INFO:tasks.workunit.client.0.smithi037.stdout:1/580: rename d2/d12/d1e/c40 to d2/d12/d1e/d63/d9e/cc2 0 2024-09-19T06:08:48.644 INFO:tasks.workunit.client.0.smithi037.stdout:5/658: dwrite d2/d12/d28/d22/d35/dae/fc3 [0,4194304] 0 2024-09-19T06:08:48.644 INFO:tasks.workunit.client.0.smithi037.stdout:5/659: dread - d2/d12/d24/d58/f8f zero size 2024-09-19T06:08:48.645 INFO:tasks.workunit.client.0.smithi037.stdout:5/660: chown d2/d12/d28/d57/dc4 1103 1 2024-09-19T06:08:48.648 INFO:tasks.workunit.client.0.smithi037.stdout:3/647: symlink d0/d16/d19/d1d/d5e/da9/ld8 0 2024-09-19T06:08:48.648 INFO:tasks.workunit.client.0.smithi037.stdout:1/581: link d2/f9 d2/d12/d15/d95/fc3 0 2024-09-19T06:08:48.650 INFO:tasks.workunit.client.0.smithi037.stdout:7/713: dwrite d6/d20/d4b/d60/d33/f57 [0,4194304] 0 2024-09-19T06:08:48.650 INFO:tasks.workunit.client.0.smithi037.stdout:4/748: dwrite d0/d6/d45/dd9/d36/f47 [0,4194304] 0 2024-09-19T06:08:48.651 INFO:tasks.workunit.client.0.smithi037.stdout:3/648: symlink d0/d16/d19/d1d/dc7/ld9 0 2024-09-19T06:08:48.652 INFO:tasks.workunit.client.0.smithi037.stdout:1/582: mknod d2/d12/d1e/d2d/cc4 0 2024-09-19T06:08:48.655 INFO:tasks.workunit.client.0.smithi037.stdout:5/661: write d2/d12/d28/d22/d53/f8a [626023,128770] 0 2024-09-19T06:08:48.655 INFO:tasks.workunit.client.0.smithi037.stdout:7/714: rename d6/d20/c45 to d6/d20/d34/d97/ce3 0 2024-09-19T06:08:48.655 INFO:tasks.workunit.client.0.smithi037.stdout:7/715: dread - d6/d20/d4b/fd3 zero size 2024-09-19T06:08:48.658 INFO:tasks.workunit.client.0.smithi037.stdout:4/749: getdents d0/d6/d45 0 2024-09-19T06:08:48.661 INFO:tasks.workunit.client.0.smithi037.stdout:3/649: unlink d0/f17 0 2024-09-19T06:08:48.662 INFO:tasks.workunit.client.0.smithi037.stdout:1/583: creat d2/d12/d1e/d2d/d6f/fc5 x:0 0 0 2024-09-19T06:08:48.663 INFO:tasks.workunit.client.0.smithi037.stdout:3/650: creat d0/d43/d37/fda x:0 0 0 2024-09-19T06:08:48.665 INFO:tasks.workunit.client.0.smithi037.stdout:7/716: dread d6/d20/d34/f40 [0,4194304] 0 2024-09-19T06:08:48.665 INFO:tasks.workunit.client.0.smithi037.stdout:7/717: dread - d6/dc/d22/d59/da8/dc4/fcd zero size 2024-09-19T06:08:48.665 INFO:tasks.workunit.client.0.smithi037.stdout:7/718: chown d6/dc/df/l6e 68907 1 2024-09-19T06:08:48.665 INFO:tasks.workunit.client.0.smithi037.stdout:7/719: fdatasync d6/f8a 0 2024-09-19T06:08:48.665 INFO:tasks.workunit.client.0.smithi037.stdout:2/775: dwrite d1/d16/d96/f9b [0,4194304] 0 2024-09-19T06:08:48.666 INFO:tasks.workunit.client.0.smithi037.stdout:7/720: getdents d6/d20/d4b/d60/d33/d8c 0 2024-09-19T06:08:48.666 INFO:tasks.workunit.client.0.smithi037.stdout:7/721: chown d6/dc/daf 109 1 2024-09-19T06:08:48.666 INFO:tasks.workunit.client.0.smithi037.stdout:7/722: write d6/dc/d22/f5c [1398384,61492] 0 2024-09-19T06:08:48.667 INFO:tasks.workunit.client.0.smithi037.stdout:2/776: mknod d1/d33/c103 0 2024-09-19T06:08:48.668 INFO:tasks.workunit.client.0.smithi037.stdout:2/777: mkdir d1/d6/da3/d104 0 2024-09-19T06:08:48.669 INFO:tasks.workunit.client.0.smithi037.stdout:2/778: link d1/d16/f3d d1/da/dc/d21/d51/f105 0 2024-09-19T06:08:48.669 INFO:tasks.workunit.client.0.smithi037.stdout:2/779: chown d1/da/dc/d21/d7d/dab/f50 22 1 2024-09-19T06:08:48.669 INFO:tasks.workunit.client.0.smithi037.stdout:2/780: stat d1/da/dc/d21/d7d/d80/f81 0 2024-09-19T06:08:48.670 INFO:tasks.workunit.client.0.smithi037.stdout:2/781: symlink d1/da/dc/d21/d7d/dab/l106 0 2024-09-19T06:08:48.673 INFO:tasks.workunit.client.0.smithi037.stdout:2/782: link d1/da/d95/dce/f101 d1/da/dd7/f107 0 2024-09-19T06:08:48.674 INFO:tasks.workunit.client.0.smithi037.stdout:2/783: chown d1/d16/d62/ca7 6672523 1 2024-09-19T06:08:48.674 INFO:tasks.workunit.client.0.smithi037.stdout:1/584: write d2/fa [1861244,95592] 0 2024-09-19T06:08:48.682 INFO:tasks.workunit.client.0.smithi037.stdout:5/662: dread d2/d12/d28/d22/d35/dae/fc3 [0,4194304] 0 2024-09-19T06:08:48.682 INFO:tasks.workunit.client.0.smithi037.stdout:5/663: readlink d2/d12/d24/l9d 0 2024-09-19T06:08:48.682 INFO:tasks.workunit.client.0.smithi037.stdout:2/784: dread d1/d9e/fe7 [0,4194304] 0 2024-09-19T06:08:48.683 INFO:tasks.workunit.client.0.smithi037.stdout:2/785: mknod d1/d9e/c108 0 2024-09-19T06:08:48.684 INFO:tasks.workunit.client.0.smithi037.stdout:2/786: fdatasync d1/d16/d96/f9b 0 2024-09-19T06:08:48.690 INFO:tasks.workunit.client.0.smithi037.stdout:2/787: mkdir d1/d6/da3/da8/dbe/df4/d109 0 2024-09-19T06:08:48.698 INFO:tasks.workunit.client.0.smithi037.stdout:5/664: dread d2/d12/d28/d22/d35/fa0 [0,4194304] 0 2024-09-19T06:08:48.699 INFO:tasks.workunit.client.0.smithi037.stdout:5/665: unlink d2/d12/c37 0 2024-09-19T06:08:48.701 INFO:tasks.workunit.client.0.smithi037.stdout:5/666: truncate d2/d12/d24/d97/f9c 3987308 0 2024-09-19T06:08:48.702 INFO:tasks.workunit.client.0.smithi037.stdout:7/723: dwrite d6/d20/d71/fd9 [0,4194304] 0 2024-09-19T06:08:48.702 INFO:tasks.workunit.client.0.smithi037.stdout:5/667: rename d2/d12/d24/d58/dbf/cd0 to d2/d12/d28/d22/cd4 0 2024-09-19T06:08:48.704 INFO:tasks.workunit.client.0.smithi037.stdout:5/668: link d2/d12/d24/lce d2/d10/ld5 0 2024-09-19T06:08:48.704 INFO:tasks.workunit.client.0.smithi037.stdout:5/669: truncate d2/d10/daf/fb4 30939 0 2024-09-19T06:08:48.705 INFO:tasks.workunit.client.0.smithi037.stdout:5/670: rename d2/d12/d24/d58/d8e/f9a to d2/d10/da1/dac/fd6 0 2024-09-19T06:08:48.705 INFO:tasks.workunit.client.0.smithi037.stdout:5/671: readlink d2/lc6 0 2024-09-19T06:08:48.705 INFO:tasks.workunit.client.0.smithi037.stdout:5/672: fsync d2/f7a 0 2024-09-19T06:08:48.707 INFO:tasks.workunit.client.0.smithi037.stdout:3/651: dread d0/f25 [0,4194304] 0 2024-09-19T06:08:48.707 INFO:tasks.workunit.client.0.smithi037.stdout:4/750: dwrite d0/f27 [0,4194304] 0 2024-09-19T06:08:48.711 INFO:tasks.workunit.client.0.smithi037.stdout:7/724: dread d6/d20/f6c [0,4194304] 0 2024-09-19T06:08:48.712 INFO:tasks.workunit.client.0.smithi037.stdout:7/725: rename d6/d20/d4b/d60/d33/d55/c67 to d6/d20/d71/dbb/ce4 0 2024-09-19T06:08:48.713 INFO:tasks.workunit.client.0.smithi037.stdout:2/788: dwrite d1/d6/da3/da8/dbe/fef [0,4194304] 0 2024-09-19T06:08:48.713 INFO:tasks.workunit.client.0.smithi037.stdout:2/789: chown d1/d33/d4c/l64 588524530 1 2024-09-19T06:08:48.714 INFO:tasks.workunit.client.0.smithi037.stdout:7/726: creat d6/d20/d34/d7d/fe5 x:0 0 0 2024-09-19T06:08:48.714 INFO:tasks.workunit.client.0.smithi037.stdout:7/727: chown d6/f3a 890707434 1 2024-09-19T06:08:48.714 INFO:tasks.workunit.client.0.smithi037.stdout:2/790: symlink d1/d33/d4c/l10a 0 2024-09-19T06:08:48.716 INFO:tasks.workunit.client.0.smithi037.stdout:2/791: creat d1/d16/d62/f10b x:0 0 0 2024-09-19T06:08:48.718 INFO:tasks.workunit.client.0.smithi037.stdout:7/728: write d6/d20/d34/f93 [1849235,39860] 0 2024-09-19T06:08:48.718 INFO:tasks.workunit.client.0.smithi037.stdout:7/729: truncate d6/d20/d34/f9a 609734 0 2024-09-19T06:08:48.718 INFO:tasks.workunit.client.0.smithi037.stdout:7/730: truncate d6/d20/f9b 489773 0 2024-09-19T06:08:48.719 INFO:tasks.workunit.client.0.smithi037.stdout:2/792: dread d1/da/dc/d21/d55/dbc/db0/de0/ffe [0,4194304] 0 2024-09-19T06:08:48.720 INFO:tasks.workunit.client.0.smithi037.stdout:2/793: truncate d1/da/dc/d21/f67 4229946 0 2024-09-19T06:08:48.735 INFO:tasks.workunit.client.0.smithi037.stdout:4/751: dwrite d0/d2/d37/d46/de5/f93 [0,4194304] 0 2024-09-19T06:08:48.735 INFO:tasks.workunit.client.0.smithi037.stdout:4/752: chown d0/d6/f23 67 1 2024-09-19T06:08:48.737 INFO:tasks.workunit.client.0.smithi037.stdout:4/753: symlink d0/d2/d37/d46/de5/d6f/lf0 0 2024-09-19T06:08:48.741 INFO:tasks.workunit.client.0.smithi037.stdout:7/731: write d6/d20/d71/fd9 [2050514,29306] 0 2024-09-19T06:08:48.741 INFO:tasks.workunit.client.0.smithi037.stdout:7/732: truncate d6/d20/d4b/d60/d33/f6b 4517233 0 2024-09-19T06:08:48.741 INFO:tasks.workunit.client.0.smithi037.stdout:7/733: write d6/d20/d71/fd9 [4247336,89397] 0 2024-09-19T06:08:48.742 INFO:tasks.workunit.client.0.smithi037.stdout:7/734: truncate d6/fb5 739316 0 2024-09-19T06:08:48.742 INFO:tasks.workunit.client.0.smithi037.stdout:2/794: write d1/da/dc/d21/d7d/f82 [1012804,77433] 0 2024-09-19T06:08:48.742 INFO:tasks.workunit.client.0.smithi037.stdout:7/735: mkdir d6/dc/daf/de6 0 2024-09-19T06:08:48.742 INFO:tasks.workunit.client.0.smithi037.stdout:2/795: mkdir d1/da/dc/d21/d51/d10c 0 2024-09-19T06:08:48.743 INFO:tasks.workunit.client.0.smithi037.stdout:7/736: rmdir d6/dad 39 2024-09-19T06:08:48.743 INFO:tasks.workunit.client.0.smithi037.stdout:7/737: write d6/dc/d22/f1a [4829038,117630] 0 2024-09-19T06:08:48.743 INFO:tasks.workunit.client.0.smithi037.stdout:7/738: fsync d6/d21/f52 0 2024-09-19T06:08:48.744 INFO:tasks.workunit.client.0.smithi037.stdout:2/796: creat d1/d16/db1/f10d x:0 0 0 2024-09-19T06:08:48.746 INFO:tasks.workunit.client.0.smithi037.stdout:3/652: write d0/d16/d19/d1d/d7c/f85 [2880610,35907] 0 2024-09-19T06:08:48.747 INFO:tasks.workunit.client.0.smithi037.stdout:5/673: dwrite d2/d10/daf/fb4 [0,4194304] 0 2024-09-19T06:08:48.750 INFO:tasks.workunit.client.0.smithi037.stdout:3/653: truncate d0/f5a 947539 0 2024-09-19T06:08:48.750 INFO:tasks.workunit.client.0.smithi037.stdout:3/654: write d0/d16/f81 [5327042,116940] 0 2024-09-19T06:08:48.751 INFO:tasks.workunit.client.0.smithi037.stdout:5/674: rename d2/d12/d28/d57/dc4 to d2/d12/d24/d58/d96/dd7 0 2024-09-19T06:08:48.751 INFO:tasks.workunit.client.0.smithi037.stdout:5/675: dread - d2/d10/daf/fca zero size 2024-09-19T06:08:48.753 INFO:tasks.workunit.client.0.smithi037.stdout:3/655: creat d0/d5f/da0/fdb x:0 0 0 2024-09-19T06:08:48.755 INFO:tasks.workunit.client.0.smithi037.stdout:5/676: write d2/d10/f1f [4948020,99525] 0 2024-09-19T06:08:48.755 INFO:tasks.workunit.client.0.smithi037.stdout:4/754: write d0/d6/d1b/f78 [2171028,113920] 0 2024-09-19T06:08:48.762 INFO:tasks.workunit.client.0.smithi037.stdout:2/797: read d1/d16/f37 [1098790,26551] 0 2024-09-19T06:08:48.771 INFO:tasks.workunit.client.0.smithi037.stdout:7/739: dwrite d6/dc/f47 [0,4194304] 0 2024-09-19T06:08:48.776 INFO:tasks.workunit.client.0.smithi037.stdout:5/677: dread d2/d12/d28/d22/d4a/d9f/f69 [0,4194304] 0 2024-09-19T06:08:48.776 INFO:tasks.workunit.client.0.smithi037.stdout:5/678: rename d2/d12/d24/d58 to d2/d12/d24/d58/dd8 22 2024-09-19T06:08:48.778 INFO:tasks.workunit.client.0.smithi037.stdout:5/679: dread d2/d12/d28/d22/d53/f93 [0,4194304] 0 2024-09-19T06:08:48.778 INFO:tasks.workunit.client.0.smithi037.stdout:5/680: read d2/d12/d28/f3f [3346368,93347] 0 2024-09-19T06:08:48.778 INFO:tasks.workunit.client.0.smithi037.stdout:5/681: truncate d2/d12/d28/d57/f73 4518194 0 2024-09-19T06:08:48.779 INFO:tasks.workunit.client.0.smithi037.stdout:5/682: mknod d2/d12/d24/d58/d96/dd7/cd9 0 2024-09-19T06:08:48.781 INFO:tasks.workunit.client.0.smithi037.stdout:5/683: mkdir d2/d5c/dda 0 2024-09-19T06:08:48.781 INFO:tasks.workunit.client.0.smithi037.stdout:5/684: truncate d2/d12/d28/d22/fc1 878694 0 2024-09-19T06:08:48.783 INFO:tasks.workunit.client.0.smithi037.stdout:5/685: creat d2/d12/d24/d58/d96/dd7/fdb x:0 0 0 2024-09-19T06:08:48.783 INFO:tasks.workunit.client.0.smithi037.stdout:0/712: sync 2024-09-19T06:08:48.783 INFO:tasks.workunit.client.0.smithi037.stdout:0/713: chown d5/l6 8179 1 2024-09-19T06:08:48.785 INFO:tasks.workunit.client.0.smithi037.stdout:0/714: symlink d5/d8/d79/d9a/lfe 0 2024-09-19T06:08:48.785 INFO:tasks.workunit.client.0.smithi037.stdout:0/715: write d5/d8/d22/f4d [5115528,12388] 0 2024-09-19T06:08:48.785 INFO:tasks.workunit.client.0.smithi037.stdout:0/716: write d5/d18/d68/d85/fb7 [662058,64934] 0 2024-09-19T06:08:48.785 INFO:tasks.workunit.client.0.smithi037.stdout:0/717: read - d5/d18/f86 zero size 2024-09-19T06:08:48.787 INFO:tasks.workunit.client.0.smithi037.stdout:7/740: read d6/dc/df/f13 [1205394,11510] 0 2024-09-19T06:08:48.788 INFO:tasks.workunit.client.0.smithi037.stdout:2/798: dwrite d1/d16/d62/f73 [0,4194304] 0 2024-09-19T06:08:48.791 INFO:tasks.workunit.client.0.smithi037.stdout:7/741: unlink d6/d20/fb9 0 2024-09-19T06:08:48.791 INFO:tasks.workunit.client.0.smithi037.stdout:7/742: write d6/d20/d4b/d60/f75 [4249860,65335] 0 2024-09-19T06:08:48.792 INFO:tasks.workunit.client.0.smithi037.stdout:2/799: creat d1/d16/d96/f10e x:0 0 0 2024-09-19T06:08:48.793 INFO:tasks.workunit.client.0.smithi037.stdout:7/743: creat d6/dc/d22/d59/fe7 x:0 0 0 2024-09-19T06:08:48.794 INFO:tasks.workunit.client.0.smithi037.stdout:2/800: creat d1/d33/d4c/f10f x:0 0 0 2024-09-19T06:08:48.795 INFO:tasks.workunit.client.0.smithi037.stdout:7/744: creat d6/d20/d4b/d60/fe8 x:0 0 0 2024-09-19T06:08:48.795 INFO:tasks.workunit.client.0.smithi037.stdout:7/745: write d6/d20/d4b/fd3 [71049,68544] 0 2024-09-19T06:08:48.797 INFO:tasks.workunit.client.0.smithi037.stdout:7/746: link d6/dc/d22/d82/ca1 d6/d20/d4b/d60/ddf/de0/ce9 0 2024-09-19T06:08:48.797 INFO:tasks.workunit.client.0.smithi037.stdout:7/747: read d6/d20/d4b/f5d [445144,122398] 0 2024-09-19T06:08:48.801 INFO:tasks.workunit.client.0.smithi037.stdout:2/801: dread d1/da/dc/d21/d51/f52 [0,4194304] 0 2024-09-19T06:08:48.808 INFO:tasks.workunit.client.0.smithi037.stdout:5/686: dwrite d2/d12/d28/d57/fb0 [8388608,4194304] 0 2024-09-19T06:08:48.809 INFO:tasks.workunit.client.0.smithi037.stdout:5/687: rename d2/d12/d24/d58/l8d to d2/d12/d28/d22/d35/ldc 0 2024-09-19T06:08:48.810 INFO:tasks.workunit.client.0.smithi037.stdout:5/688: mknod d2/d12/d28/d22/d35/dae/cdd 0 2024-09-19T06:08:48.810 INFO:tasks.workunit.client.0.smithi037.stdout:5/689: stat d2/d12/d28/d57/f91 0 2024-09-19T06:08:48.823 INFO:tasks.workunit.client.0.smithi037.stdout:2/802: dwrite d1/d33/d4c/f88 [0,4194304] 0 2024-09-19T06:08:48.823 INFO:tasks.workunit.client.0.smithi037.stdout:2/803: readlink d1/d16/d4a/lec 0 2024-09-19T06:08:48.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:08:48 smithi037 ceph-mon[31211]: pgmap v428: 129 pgs: 129 active+clean; 1010 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 101 MiB/s rd, 129 MiB/s wr, 216 op/s 2024-09-19T06:08:48.836 INFO:tasks.workunit.client.0.smithi037.stdout:2/804: dread d1/da/d6e/fc2 [0,4194304] 0 2024-09-19T06:08:48.836 INFO:tasks.workunit.client.0.smithi037.stdout:2/805: chown d1/da/dc/d21/d7d/c5d 0 1 2024-09-19T06:08:48.837 INFO:tasks.workunit.client.0.smithi037.stdout:2/806: creat d1/da/dc/d21/d55/dbc/f110 x:0 0 0 2024-09-19T06:08:48.837 INFO:tasks.workunit.client.0.smithi037.stdout:2/807: read - d1/d16/f40 zero size 2024-09-19T06:08:48.837 INFO:tasks.workunit.client.0.smithi037.stdout:2/808: creat d1/da/dc/d21/d7d/dab/df2/f111 x:0 0 0 2024-09-19T06:08:48.838 INFO:tasks.workunit.client.0.smithi037.stdout:2/809: creat d1/f112 x:0 0 0 2024-09-19T06:08:48.859 INFO:tasks.workunit.client.0.smithi037.stdout:2/810: dwrite d1/d33/d4c/f57 [0,4194304] 0 2024-09-19T06:08:48.860 INFO:tasks.workunit.client.0.smithi037.stdout:2/811: rmdir d1/da/d95 39 2024-09-19T06:08:48.861 INFO:tasks.workunit.client.0.smithi037.stdout:2/812: truncate d1/d16/f37 2769296 0 2024-09-19T06:08:48.861 INFO:tasks.workunit.client.0.smithi037.stdout:2/813: getdents d1/d16/d96/dd0 0 2024-09-19T06:08:48.862 INFO:tasks.workunit.client.0.smithi037.stdout:2/814: unlink d1/d9e/fe7 0 2024-09-19T06:08:48.862 INFO:tasks.workunit.client.0.smithi037.stdout:2/815: write d1/d16/f3d [4709057,27012] 0 2024-09-19T06:08:48.862 INFO:tasks.workunit.client.0.smithi037.stdout:2/816: dread - d1/da/dc/d21/d7d/d80/fff zero size 2024-09-19T06:08:48.863 INFO:tasks.workunit.client.0.smithi037.stdout:2/817: symlink d1/da/dc/d21/l113 0 2024-09-19T06:08:48.883 INFO:tasks.workunit.client.0.smithi037.stdout:2/818: dwrite d1/d16/d4a/f75 [4194304,4194304] 0 2024-09-19T06:08:48.884 INFO:tasks.workunit.client.0.smithi037.stdout:2/819: mkdir d1/d33/d4c/d114 0 2024-09-19T06:08:48.885 INFO:tasks.workunit.client.0.smithi037.stdout:2/820: mknod d1/d6/da3/da8/dbe/df4/d109/c115 0 2024-09-19T06:08:48.886 INFO:tasks.workunit.client.0.smithi037.stdout:2/821: rmdir d1/d6 39 2024-09-19T06:08:48.887 INFO:tasks.workunit.client.0.smithi037.stdout:2/822: rename d1/da/dc/d21/d7d/d80/f81 to d1/da/dc/d21/d55/dbc/db0/f116 0 2024-09-19T06:08:48.904 INFO:tasks.workunit.client.0.smithi037.stdout:2/823: dwrite d1/d9e/fdc [4194304,4194304] 0 2024-09-19T06:08:48.912 INFO:tasks.workunit.client.0.smithi037.stdout:8/814: sync 2024-09-19T06:08:48.912 INFO:tasks.workunit.client.0.smithi037.stdout:6/653: sync 2024-09-19T06:08:48.912 INFO:tasks.workunit.client.0.smithi037.stdout:6/654: chown d9/dd/d20/f48 111160 1 2024-09-19T06:08:48.912 INFO:tasks.workunit.client.0.smithi037.stdout:8/815: chown d1/dc7/fe5 1523702 1 2024-09-19T06:08:48.913 INFO:tasks.workunit.client.0.smithi037.stdout:6/655: mkdir d9/dd/d2b/d79/dd3 0 2024-09-19T06:08:48.922 INFO:tasks.workunit.client.0.smithi037.stdout:2/824: dwrite d1/da/dc/d21/f4d [0,4194304] 0 2024-09-19T06:08:48.925 INFO:tasks.workunit.client.0.smithi037.stdout:2/825: creat d1/da/dd7/f117 x:0 0 0 2024-09-19T06:08:48.926 INFO:tasks.workunit.client.0.smithi037.stdout:2/826: mkdir d1/d9e/d118 0 2024-09-19T06:08:48.928 INFO:tasks.workunit.client.0.smithi037.stdout:2/827: truncate d1/da/f32 1671590 0 2024-09-19T06:08:48.933 INFO:tasks.workunit.client.0.smithi037.stdout:8/816: dwrite d1/d61/d7e/d8b/d91/d3d/fba [0,4194304] 0 2024-09-19T06:08:48.936 INFO:tasks.workunit.client.0.smithi037.stdout:8/817: creat d1/d61/d7e/d8b/d91/dea/f117 x:0 0 0 2024-09-19T06:08:48.937 INFO:tasks.workunit.client.0.smithi037.stdout:8/818: mkdir d1/d35/d118 0 2024-09-19T06:08:48.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:08:48 smithi099 ceph-mon[35300]: pgmap v428: 129 pgs: 129 active+clean; 1010 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 101 MiB/s rd, 129 MiB/s wr, 216 op/s 2024-09-19T06:08:48.938 INFO:tasks.workunit.client.0.smithi037.stdout:8/819: link d1/d61/d7e/d8b/d91/d3d/fb1 d1/d61/d7e/d8b/d91/dea/f119 0 2024-09-19T06:08:48.939 INFO:tasks.workunit.client.0.smithi037.stdout:6/656: dwrite d9/dd/f32 [0,4194304] 0 2024-09-19T06:08:48.942 INFO:tasks.workunit.client.0.smithi037.stdout:6/657: dread d9/d6e/fa5 [0,4194304] 0 2024-09-19T06:08:48.949 INFO:tasks.workunit.client.0.smithi037.stdout:6/658: rename d9/dd/d20/d5a/d6d/d82/d9f/da4/fc7 to d9/dd/d20/d5a/dd2/fd4 0 2024-09-19T06:08:48.950 INFO:tasks.workunit.client.0.smithi037.stdout:6/659: mkdir d9/dd/d20/dd5 0 2024-09-19T06:08:48.951 INFO:tasks.workunit.client.0.smithi037.stdout:6/660: link d9/dd/d20/d5a/d6d/d82/da9/lc1 d9/d78/ld6 0 2024-09-19T06:08:48.952 INFO:tasks.workunit.client.0.smithi037.stdout:6/661: creat d9/dd/d1c/d4e/d65/fd7 x:0 0 0 2024-09-19T06:08:48.953 INFO:tasks.workunit.client.0.smithi037.stdout:6/662: link d9/dd/d20/d5a/d6d/d82/f84 d9/dd/d20/d5a/d6d/fd8 0 2024-09-19T06:08:48.962 INFO:tasks.workunit.client.0.smithi037.stdout:2/828: dwrite d1/da/dc/d21/f67 [4194304,4194304] 0 2024-09-19T06:08:48.967 INFO:tasks.workunit.client.0.smithi037.stdout:8/820: dwrite d1/d61/d7e/d8b/d91/dea/f119 [0,4194304] 0 2024-09-19T06:08:48.970 INFO:tasks.workunit.client.0.smithi037.stdout:8/821: link d1/d6a/c87 d1/d61/dd5/c11a 0 2024-09-19T06:08:48.973 INFO:tasks.workunit.client.0.smithi037.stdout:6/663: write d9/dd/f32 [3394579,19306] 0 2024-09-19T06:08:48.975 INFO:tasks.workunit.client.0.smithi037.stdout:6/664: mknod d9/d6e/cd9 0 2024-09-19T06:08:48.975 INFO:tasks.workunit.client.0.smithi037.stdout:6/665: stat d9/dd/d2b/d79/f70 0 2024-09-19T06:08:48.975 INFO:tasks.workunit.client.0.smithi037.stdout:6/666: fdatasync d9/dd/d1c/d4e/d33/f97 0 2024-09-19T06:08:48.976 INFO:tasks.workunit.client.0.smithi037.stdout:6/667: stat d9/fbc 0 2024-09-19T06:08:48.976 INFO:tasks.workunit.client.0.smithi037.stdout:6/668: dread - d9/d16/fc6 zero size 2024-09-19T06:08:48.976 INFO:tasks.workunit.client.0.smithi037.stdout:6/669: chown d9/f24 30 1 2024-09-19T06:08:48.980 INFO:tasks.workunit.client.0.smithi037.stdout:2/829: dread d1/d6/fe [0,4194304] 0 2024-09-19T06:08:48.989 INFO:tasks.workunit.client.0.smithi037.stdout:6/670: write d9/dd/d2b/d79/f63 [4094613,124665] 0 2024-09-19T06:08:48.990 INFO:tasks.workunit.client.0.smithi037.stdout:6/671: creat d9/dd/d20/d5a/dd2/fda x:0 0 0 2024-09-19T06:08:48.991 INFO:tasks.workunit.client.0.smithi037.stdout:6/672: truncate d9/dd/d1c/d4e/f34 3995465 0 2024-09-19T06:08:48.991 INFO:tasks.workunit.client.0.smithi037.stdout:8/822: dwrite d1/d61/d7e/d8b/d91/d3d/fed [0,4194304] 0 2024-09-19T06:08:48.995 INFO:tasks.workunit.client.0.smithi037.stdout:6/673: unlink d9/dd/d1c/d4e/d65/f67 0 2024-09-19T06:08:48.995 INFO:tasks.workunit.client.0.smithi037.stdout:2/830: dread d1/d33/fa1 [0,4194304] 0 2024-09-19T06:08:48.995 INFO:tasks.workunit.client.0.smithi037.stdout:6/674: fsync d9/dd/d20/d5a/d6d/fb1 0 2024-09-19T06:08:48.995 INFO:tasks.workunit.client.0.smithi037.stdout:2/831: truncate d1/da/d6e/da0/faf 125084 0 2024-09-19T06:08:48.995 INFO:tasks.workunit.client.0.smithi037.stdout:8/823: creat d1/d61/d7e/dbc/dc2/d59/daf/f11b x:0 0 0 2024-09-19T06:08:48.996 INFO:tasks.workunit.client.0.smithi037.stdout:2/832: creat d1/d33/f119 x:0 0 0 2024-09-19T06:08:48.997 INFO:tasks.workunit.client.0.smithi037.stdout:8/824: unlink d1/d8f/da1/fda 0 2024-09-19T06:08:48.997 INFO:tasks.workunit.client.0.smithi037.stdout:8/825: chown d1/d61/d68/da3/lc5 8 1 2024-09-19T06:08:48.997 INFO:tasks.workunit.client.0.smithi037.stdout:8/826: chown d1/d61/l92 39 1 2024-09-19T06:08:48.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:08:48 smithi117 ceph-mon[35050]: pgmap v428: 129 pgs: 129 active+clean; 1010 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 101 MiB/s rd, 129 MiB/s wr, 216 op/s 2024-09-19T06:08:49.019 INFO:tasks.workunit.client.0.smithi037.stdout:6/675: dwrite d9/d78/fd1 [0,4194304] 0 2024-09-19T06:08:49.020 INFO:tasks.workunit.client.0.smithi037.stdout:8/827: write d1/dc7/fe0 [2279450,53142] 0 2024-09-19T06:08:49.021 INFO:tasks.workunit.client.0.smithi037.stdout:2/833: dwrite d1/f43 [0,4194304] 0 2024-09-19T06:08:49.024 INFO:tasks.workunit.client.0.smithi037.stdout:8/828: stat d1/d61/d7b/lcc 0 2024-09-19T06:08:49.024 INFO:tasks.workunit.client.0.smithi037.stdout:2/834: truncate d1/d16/d4a/f75 8273307 0 2024-09-19T06:08:49.025 INFO:tasks.workunit.client.0.smithi037.stdout:2/835: readlink d1/da/dc/d21/d55/l92 0 2024-09-19T06:08:49.027 INFO:tasks.workunit.client.0.smithi037.stdout:2/836: creat d1/d9e/d118/f11a x:0 0 0 2024-09-19T06:08:49.027 INFO:tasks.workunit.client.0.smithi037.stdout:2/837: dread - d1/d33/d4c/f10f zero size 2024-09-19T06:08:49.027 INFO:tasks.workunit.client.0.smithi037.stdout:2/838: creat d1/d16/d62/f11b x:0 0 0 2024-09-19T06:08:49.029 INFO:tasks.workunit.client.0.smithi037.stdout:2/839: unlink d1/d16/d62/l94 0 2024-09-19T06:08:49.029 INFO:tasks.workunit.client.0.smithi037.stdout:2/840: stat d1/da/d6e/cdb 0 2024-09-19T06:08:49.029 INFO:tasks.workunit.client.0.smithi037.stdout:8/829: dread d1/f1e [0,4194304] 0 2024-09-19T06:08:49.029 INFO:tasks.workunit.client.0.smithi037.stdout:8/830: fsync d1/d35/ff2 0 2024-09-19T06:08:49.030 INFO:tasks.workunit.client.0.smithi037.stdout:2/841: symlink d1/da/dc/d21/d55/l11c 0 2024-09-19T06:08:49.049 INFO:tasks.workunit.client.0.smithi037.stdout:9/810: sync 2024-09-19T06:08:49.050 INFO:tasks.workunit.client.0.smithi037.stdout:2/842: dwrite d1/da/dc/f18 [0,4194304] 0 2024-09-19T06:08:49.050 INFO:tasks.workunit.client.0.smithi037.stdout:2/843: chown d1/da/dc/d21/d51/c93 28657 1 2024-09-19T06:08:49.051 INFO:tasks.workunit.client.0.smithi037.stdout:2/844: symlink d1/d6/da3/da8/dbe/l11d 0 2024-09-19T06:08:49.070 INFO:tasks.workunit.client.0.smithi037.stdout:9/811: dwrite da/dec/d116/d1b/d2f/d6d/d92/fe2 [0,4194304] 0 2024-09-19T06:08:49.072 INFO:tasks.workunit.client.0.smithi037.stdout:9/812: symlink da/dec/d116/l124 0 2024-09-19T06:08:49.074 INFO:tasks.workunit.client.0.smithi037.stdout:2/845: dwrite d1/d16/f37 [0,4194304] 0 2024-09-19T06:08:49.074 INFO:tasks.workunit.client.0.smithi037.stdout:9/813: rename da/dec/d116/d1b/d2f/d6d/fea to da/dec/d116/d1b/f125 0 2024-09-19T06:08:49.076 INFO:tasks.workunit.client.0.smithi037.stdout:9/814: truncate da/dec/d116/d1b/d23/de9/ff5 163735 0 2024-09-19T06:08:49.079 INFO:tasks.workunit.client.0.smithi037.stdout:9/815: write da/dec/d116/d1b/f36 [4385291,59593] 0 2024-09-19T06:08:49.080 INFO:tasks.workunit.client.0.smithi037.stdout:9/816: creat da/dec/d116/d1b/d43/de4/f126 x:0 0 0 2024-09-19T06:08:49.098 INFO:tasks.workunit.client.0.smithi037.stdout:9/817: dwrite da/dec/d116/d1b/d2f/dcc/de7/f105 [0,4194304] 0 2024-09-19T06:08:49.100 INFO:tasks.workunit.client.0.smithi037.stdout:9/818: truncate da/d20/fc2 3646178 0 2024-09-19T06:08:49.100 INFO:tasks.workunit.client.0.smithi037.stdout:9/819: mknod da/dec/d116/d1b/d2f/df8/c127 0 2024-09-19T06:08:49.101 INFO:tasks.workunit.client.0.smithi037.stdout:9/820: mknod da/dec/d116/d1b/d2f/d6d/c128 0 2024-09-19T06:08:49.102 INFO:tasks.workunit.client.0.smithi037.stdout:9/821: readlink da/dec/d116/d31/la7 0 2024-09-19T06:08:49.102 INFO:tasks.workunit.client.0.smithi037.stdout:9/822: readlink l2 0 2024-09-19T06:08:49.113 INFO:tasks.workunit.client.0.smithi037.stdout:9/823: write da/dec/d116/d1b/d2f/f65 [5876266,18488] 0 2024-09-19T06:08:49.113 INFO:tasks.workunit.client.0.smithi037.stdout:9/824: stat da/dec/d116/d1b/d23/dbe/l111 0 2024-09-19T06:08:49.113 INFO:tasks.workunit.client.0.smithi037.stdout:9/825: getdents da/dec/d116/d63/d80/dc4/d11b 0 2024-09-19T06:08:49.116 INFO:tasks.workunit.client.0.smithi037.stdout:1/585: sync 2024-09-19T06:08:49.136 INFO:tasks.workunit.client.0.smithi037.stdout:9/826: dwrite da/dec/d116/d1b/d23/de9/fa6 [0,4194304] 0 2024-09-19T06:08:49.136 INFO:tasks.workunit.client.0.smithi037.stdout:1/586: dwrite d2/d12/d1e/d75/d89/f8d [0,4194304] 0 2024-09-19T06:08:49.138 INFO:tasks.workunit.client.0.smithi037.stdout:9/827: read da/dec/d116/d1b/d23/de9/ff5 [151827,4066] 0 2024-09-19T06:08:49.139 INFO:tasks.workunit.client.0.smithi037.stdout:1/587: rename d2/d12/d1e/d75/d89/f8d to d2/d12/d1e/d2a/d8f/fc6 0 2024-09-19T06:08:49.139 INFO:tasks.workunit.client.0.smithi037.stdout:1/588: fsync d2/d12/d1e/d2a/d2e/f7f 0 2024-09-19T06:08:49.140 INFO:tasks.workunit.client.0.smithi037.stdout:9/828: symlink da/dec/d116/d63/dd3/dff/l129 0 2024-09-19T06:08:49.140 INFO:tasks.workunit.client.0.smithi037.stdout:9/829: truncate da/dec/d116/d1b/d43/f46 1216763 0 2024-09-19T06:08:49.141 INFO:tasks.workunit.client.0.smithi037.stdout:1/589: creat d2/d12/d15/d34/fc7 x:0 0 0 2024-09-19T06:08:49.142 INFO:tasks.workunit.client.0.smithi037.stdout:9/830: mkdir da/dec/d116/d63/d80/dc4/d11b/d12a 0 2024-09-19T06:08:49.142 INFO:tasks.workunit.client.0.smithi037.stdout:1/590: symlink d2/d12/d1e/d63/lc8 0 2024-09-19T06:08:49.144 INFO:tasks.workunit.client.0.smithi037.stdout:9/831: rename da/dec/d116/d1b/d2f/d6d/db4/ded to da/dec/d116/d1b/d43/d12b 0 2024-09-19T06:08:49.144 INFO:tasks.workunit.client.0.smithi037.stdout:9/832: fdatasync da/dec/d116/d1b/d43/f5f 0 2024-09-19T06:08:49.145 INFO:tasks.workunit.client.0.smithi037.stdout:9/833: rename da/dec/d116/d1b/d23/d6a/d82/f48 to da/dec/d116/d31/f12c 0 2024-09-19T06:08:49.145 INFO:tasks.workunit.client.0.smithi037.stdout:9/834: fdatasync da/dec/d116/d63/dd3/f113 0 2024-09-19T06:08:49.145 INFO:tasks.workunit.client.0.smithi037.stdout:1/591: symlink d2/d12/d1e/d2d/lc9 0 2024-09-19T06:08:49.166 INFO:tasks.workunit.client.0.smithi037.stdout:1/592: dwrite d2/d12/d1e/d2d/f74 [0,4194304] 0 2024-09-19T06:08:49.167 INFO:tasks.workunit.client.0.smithi037.stdout:1/593: creat d2/d12/d15/d5c/fca x:0 0 0 2024-09-19T06:08:49.168 INFO:tasks.workunit.client.0.smithi037.stdout:1/594: creat d2/d73/fcb x:0 0 0 2024-09-19T06:08:49.168 INFO:tasks.workunit.client.0.smithi037.stdout:1/595: fsync d2/d48/f6d 0 2024-09-19T06:08:49.171 INFO:tasks.workunit.client.0.smithi037.stdout:1/596: read d2/d48/f9b [97589,35748] 0 2024-09-19T06:08:49.172 INFO:tasks.workunit.client.0.smithi037.stdout:1/597: link d2/d12/d1d/d47/f68 d2/d73/fcc 0 2024-09-19T06:08:49.184 INFO:tasks.workunit.client.0.smithi037.stdout:1/598: read d2/d12/d1e/f4e [2349333,3530] 0 2024-09-19T06:08:49.222 INFO:tasks.workunit.client.0.smithi037.stdout:3/656: sync 2024-09-19T06:08:49.222 INFO:tasks.workunit.client.0.smithi037.stdout:7/748: sync 2024-09-19T06:08:49.222 INFO:tasks.workunit.client.0.smithi037.stdout:5/690: sync 2024-09-19T06:08:49.222 INFO:tasks.workunit.client.0.smithi037.stdout:4/755: sync 2024-09-19T06:08:49.222 INFO:tasks.workunit.client.0.smithi037.stdout:0/718: sync 2024-09-19T06:08:49.223 INFO:tasks.workunit.client.0.smithi037.stdout:4/756: readlink d0/d6/d45/dd9/ld8 0 2024-09-19T06:08:49.223 INFO:tasks.workunit.client.0.smithi037.stdout:3/657: chown d0/d43/d23/d7a/d77/dc3/cce 540 1 2024-09-19T06:08:49.224 INFO:tasks.workunit.client.0.smithi037.stdout:5/691: rename d2/d12/d28/d22/d35/l5a to d2/d12/d24/d58/d7f/lde 0 2024-09-19T06:08:49.224 INFO:tasks.workunit.client.0.smithi037.stdout:3/658: truncate d0/d16/d19/f42 2936057 0 2024-09-19T06:08:49.226 INFO:tasks.workunit.client.0.smithi037.stdout:5/692: mkdir d2/d12/d7e/ddf 0 2024-09-19T06:08:49.227 INFO:tasks.workunit.client.0.smithi037.stdout:3/659: creat d0/d16/d19/d1d/d82/d86/fdc x:0 0 0 2024-09-19T06:08:49.227 INFO:tasks.workunit.client.0.smithi037.stdout:3/660: fsync d0/d16/f30 0 2024-09-19T06:08:49.228 INFO:tasks.workunit.client.0.smithi037.stdout:0/719: rmdir d5/dd5/de9/ddc 0 2024-09-19T06:08:49.229 INFO:tasks.workunit.client.0.smithi037.stdout:3/661: creat d0/d43/d23/d7a/d77/d51/fdd x:0 0 0 2024-09-19T06:08:49.229 INFO:tasks.workunit.client.0.smithi037.stdout:3/662: fdatasync d0/d16/d19/d1d/d7c/fb0 0 2024-09-19T06:08:49.230 INFO:tasks.workunit.client.0.smithi037.stdout:0/720: creat d5/d17/d6e/fff x:0 0 0 2024-09-19T06:08:49.230 INFO:tasks.workunit.client.0.smithi037.stdout:0/721: chown d5/d8/fc2 29519350 1 2024-09-19T06:08:49.231 INFO:tasks.workunit.client.0.smithi037.stdout:0/722: creat d5/d8/d79/d9a/ddb/f100 x:0 0 0 2024-09-19T06:08:49.233 INFO:tasks.workunit.client.0.smithi037.stdout:0/723: mknod d5/d20/d34/c101 0 2024-09-19T06:08:49.233 INFO:tasks.workunit.client.0.smithi037.stdout:0/724: chown d5/d20/d34/c67 283710 1 2024-09-19T06:08:49.233 INFO:tasks.workunit.client.0.smithi037.stdout:0/725: fdatasync d5/d20/faa 0 2024-09-19T06:08:49.233 INFO:tasks.workunit.client.0.smithi037.stdout:0/726: truncate d5/fa3 2947198 0 2024-09-19T06:08:49.244 INFO:tasks.workunit.client.0.smithi037.stdout:5/693: dread d2/d12/f4f [0,4194304] 0 2024-09-19T06:08:49.244 INFO:tasks.workunit.client.0.smithi037.stdout:5/694: chown d2/d12/d28/d22/d4a/d9f/fcc 12 1 2024-09-19T06:08:49.244 INFO:tasks.workunit.client.0.smithi037.stdout:5/695: fsync d2/d12/d28/d22/d53/f93 0 2024-09-19T06:08:49.246 INFO:tasks.workunit.client.0.smithi037.stdout:5/696: rename d2/d12/d28/d57/f75 to d2/d12/d24/d58/dbf/fe0 0 2024-09-19T06:08:49.246 INFO:tasks.workunit.client.0.smithi037.stdout:7/749: dread d6/dc/df/d7e/f88 [0,4194304] 0 2024-09-19T06:08:49.246 INFO:tasks.workunit.client.0.smithi037.stdout:7/750: dread - d6/dc/d22/fc8 zero size 2024-09-19T06:08:49.246 INFO:tasks.workunit.client.0.smithi037.stdout:7/751: symlink d6/d20/d4b/d60/d33/d61/lea 0 2024-09-19T06:08:49.247 INFO:tasks.workunit.client.0.smithi037.stdout:7/752: link d6/dc/f2a d6/d20/d4b/d60/feb 0 2024-09-19T06:08:49.248 INFO:tasks.workunit.client.0.smithi037.stdout:4/757: dwrite d0/f53 [4194304,4194304] 0 2024-09-19T06:08:49.248 INFO:tasks.workunit.client.0.smithi037.stdout:7/753: mkdir d6/d20/d34/dc0/dcf/dec 0 2024-09-19T06:08:49.249 INFO:tasks.workunit.client.0.smithi037.stdout:7/754: creat d6/d20/d34/dc0/fed x:0 0 0 2024-09-19T06:08:49.249 INFO:tasks.workunit.client.0.smithi037.stdout:7/755: truncate d6/dc/d22/fc8 139382 0 2024-09-19T06:08:49.256 INFO:tasks.workunit.client.0.smithi037.stdout:7/756: dread d6/dc/f94 [0,4194304] 0 2024-09-19T06:08:49.257 INFO:tasks.workunit.client.0.smithi037.stdout:7/757: rmdir d6 39 2024-09-19T06:08:49.258 INFO:tasks.workunit.client.0.smithi037.stdout:7/758: link d6/d20/d4b/d60/d33/d8c/f96 d6/dc/d7b/fee 0 2024-09-19T06:08:49.258 INFO:tasks.workunit.client.0.smithi037.stdout:7/759: stat d6/dc/df/l1f 0 2024-09-19T06:08:49.264 INFO:tasks.workunit.client.0.smithi037.stdout:3/663: dwrite d0/fa3 [0,4194304] 0 2024-09-19T06:08:49.265 INFO:tasks.workunit.client.0.smithi037.stdout:0/727: dwrite d5/dd5/de9/f1c [0,4194304] 0 2024-09-19T06:08:49.265 INFO:tasks.workunit.client.0.smithi037.stdout:4/758: write d0/d6/d45/dd9/d36/f47 [1313319,24336] 0 2024-09-19T06:08:49.266 INFO:tasks.workunit.client.0.smithi037.stdout:3/664: creat d0/d16/d19/d1d/d5e/fde x:0 0 0 2024-09-19T06:08:49.267 INFO:tasks.workunit.client.0.smithi037.stdout:0/728: mknod d5/d8/d44/d48/dd1/de2/c102 0 2024-09-19T06:08:49.269 INFO:tasks.workunit.client.0.smithi037.stdout:5/697: dwrite d2/f52 [4194304,4194304] 0 2024-09-19T06:08:49.269 INFO:tasks.workunit.client.0.smithi037.stdout:4/759: rename d0/d6/d1b/d20/d4d/fb7 to d0/d6/d1b/d30/dee/ff1 0 2024-09-19T06:08:49.270 INFO:tasks.workunit.client.0.smithi037.stdout:0/729: creat d5/dd5/de9/d8d/de0/dea/f103 x:0 0 0 2024-09-19T06:08:49.270 INFO:tasks.workunit.client.0.smithi037.stdout:0/730: dread - d5/d8/d44/d48/dd1/fe3 zero size 2024-09-19T06:08:49.270 INFO:tasks.workunit.client.0.smithi037.stdout:0/731: fdatasync d5/ff8 0 2024-09-19T06:08:49.274 INFO:tasks.workunit.client.0.smithi037.stdout:3/665: dread d0/d43/d23/d7a/d77/d62/f90 [0,4194304] 0 2024-09-19T06:08:49.274 INFO:tasks.workunit.client.0.smithi037.stdout:3/666: write d0/d43/d23/d7a/fae [418875,34966] 0 2024-09-19T06:08:49.275 INFO:tasks.workunit.client.0.smithi037.stdout:5/698: link d2/d12/d28/d22/l46 d2/d12/d24/d58/le1 0 2024-09-19T06:08:49.275 INFO:tasks.workunit.client.0.smithi037.stdout:5/699: write d2/d12/d28/d22/fbe [4878162,61977] 0 2024-09-19T06:08:49.276 INFO:tasks.workunit.client.0.smithi037.stdout:4/760: mkdir d0/d6/d1b/d30/dee/df2 0 2024-09-19T06:08:49.278 INFO:tasks.workunit.client.0.smithi037.stdout:3/667: write d0/d43/f7f [145260,91094] 0 2024-09-19T06:08:49.278 INFO:tasks.workunit.client.0.smithi037.stdout:0/732: creat d5/d8/d11/d32/f104 x:0 0 0 2024-09-19T06:08:49.278 INFO:tasks.workunit.client.0.smithi037.stdout:0/733: chown d5/d8/d44/da1 369004 1 2024-09-19T06:08:49.278 INFO:tasks.workunit.client.0.smithi037.stdout:3/668: read d0/d16/d19/d1d/d7c/f85 [775286,49352] 0 2024-09-19T06:08:49.279 INFO:tasks.workunit.client.0.smithi037.stdout:4/761: link d0/d8f/ce6 d0/d2/d37/cf3 0 2024-09-19T06:08:49.280 INFO:tasks.workunit.client.0.smithi037.stdout:3/669: unlink d0/d16/d19/f75 0 2024-09-19T06:08:49.282 INFO:tasks.workunit.client.0.smithi037.stdout:3/670: getdents d0/d43/d26 0 2024-09-19T06:08:49.282 INFO:tasks.workunit.client.0.smithi037.stdout:3/671: truncate d0/d43/d23/d7a/d77/d62/f90 1829272 0 2024-09-19T06:08:49.283 INFO:tasks.workunit.client.0.smithi037.stdout:3/672: mkdir d0/d16/ddf 0 2024-09-19T06:08:49.283 INFO:tasks.workunit.client.0.smithi037.stdout:3/673: write d0/d5f/da0/fdb [886693,99567] 0 2024-09-19T06:08:49.285 INFO:tasks.workunit.client.0.smithi037.stdout:6/676: sync 2024-09-19T06:08:49.285 INFO:tasks.workunit.client.0.smithi037.stdout:8/831: sync 2024-09-19T06:08:49.285 INFO:tasks.workunit.client.0.smithi037.stdout:8/832: chown d1/d61/d7e/d8b/d91/d3d/l103 204158461 1 2024-09-19T06:08:49.285 INFO:tasks.workunit.client.0.smithi037.stdout:6/677: truncate d9/dd/d20/d5a/dd2/fd4 16849 0 2024-09-19T06:08:49.286 INFO:tasks.workunit.client.0.smithi037.stdout:6/678: mkdir d9/dd/d1c/d73/ddb 0 2024-09-19T06:08:49.287 INFO:tasks.workunit.client.0.smithi037.stdout:6/679: mknod d9/dd/d1c/d4e/d65/cdc 0 2024-09-19T06:08:49.287 INFO:tasks.workunit.client.0.smithi037.stdout:6/680: chown d9/dd/d1c/d73/f93 415617 1 2024-09-19T06:08:49.287 INFO:tasks.workunit.client.0.smithi037.stdout:6/681: truncate d9/dd/d1c/d4e/d33/fa2 262199 0 2024-09-19T06:08:49.288 INFO:tasks.workunit.client.0.smithi037.stdout:6/682: creat d9/dd/d2b/d42/fdd x:0 0 0 2024-09-19T06:08:49.288 INFO:tasks.workunit.client.0.smithi037.stdout:6/683: mknod d9/d16/dc5/cde 0 2024-09-19T06:08:49.289 INFO:tasks.workunit.client.0.smithi037.stdout:6/684: dread d9/d6e/fae [0,4194304] 0 2024-09-19T06:08:49.291 INFO:tasks.workunit.client.0.smithi037.stdout:6/685: rename d9/dd/d1c/d4e/d33/lb7 to d9/dd/d1c/d4e/d65/ldf 0 2024-09-19T06:08:49.294 INFO:tasks.workunit.client.0.smithi037.stdout:7/760: dwrite d6/d20/d4b/d60/d33/d61/f64 [0,4194304] 0 2024-09-19T06:08:49.294 INFO:tasks.workunit.client.0.smithi037.stdout:5/700: write d2/d12/f27 [3544434,126134] 0 2024-09-19T06:08:49.294 INFO:tasks.workunit.client.0.smithi037.stdout:7/761: chown d6/dc/df/d7e/cb2 18965 1 2024-09-19T06:08:49.296 INFO:tasks.workunit.client.0.smithi037.stdout:0/734: dread d5/d42/fb3 [0,4194304] 0 2024-09-19T06:08:49.297 INFO:tasks.workunit.client.0.smithi037.stdout:6/686: dread d9/dd/d1c/f80 [0,4194304] 0 2024-09-19T06:08:49.297 INFO:tasks.workunit.client.0.smithi037.stdout:6/687: chown d9/dd/d20/d5a/dd2/fda 16409527 1 2024-09-19T06:08:49.297 INFO:tasks.workunit.client.0.smithi037.stdout:5/701: dread d2/f7 [0,4194304] 0 2024-09-19T06:08:49.297 INFO:tasks.workunit.client.0.smithi037.stdout:5/702: fsync d2/d12/d28/d57/fb0 0 2024-09-19T06:08:49.298 INFO:tasks.workunit.client.0.smithi037.stdout:7/762: symlink d6/dc/d22/d59/da8/dd4/de2/lef 0 2024-09-19T06:08:49.298 INFO:tasks.workunit.client.0.smithi037.stdout:7/763: stat d6/dc/d22/f1a 0 2024-09-19T06:08:49.299 INFO:tasks.workunit.client.0.smithi037.stdout:6/688: creat d9/dd/d2b/d42/fe0 x:0 0 0 2024-09-19T06:08:49.300 INFO:tasks.workunit.client.0.smithi037.stdout:5/703: getdents d2/d12 0 2024-09-19T06:08:49.300 INFO:tasks.workunit.client.0.smithi037.stdout:7/764: write d6/d20/d34/f58 [991222,52639] 0 2024-09-19T06:08:49.301 INFO:tasks.workunit.client.0.smithi037.stdout:6/689: creat d9/dd/d20/d5a/d6d/d82/fe1 x:0 0 0 2024-09-19T06:08:49.301 INFO:tasks.workunit.client.0.smithi037.stdout:6/690: write d9/dd/d1c/f47 [4452953,16369] 0 2024-09-19T06:08:49.301 INFO:tasks.workunit.client.0.smithi037.stdout:3/674: dread d0/d16/d19/f28 [4194304,4194304] 0 2024-09-19T06:08:49.302 INFO:tasks.workunit.client.0.smithi037.stdout:7/765: mknod d6/d20/d34/dc0/dcf/cf0 0 2024-09-19T06:08:49.302 INFO:tasks.workunit.client.0.smithi037.stdout:7/766: write d6/dc/d7b/fb6 [731281,65471] 0 2024-09-19T06:08:49.302 INFO:tasks.workunit.client.0.smithi037.stdout:7/767: chown d6/d20/d4b/d60/d33/d61 1045626 1 2024-09-19T06:08:49.302 INFO:tasks.workunit.client.0.smithi037.stdout:6/691: mkdir d9/dd/d1c/d4e/d65/de2 0 2024-09-19T06:08:49.303 INFO:tasks.workunit.client.0.smithi037.stdout:7/768: mknod d6/dc/d22/d59/da8/dc4/cf1 0 2024-09-19T06:08:49.305 INFO:tasks.workunit.client.0.smithi037.stdout:7/769: creat d6/d20/d4b/d60/d33/d9f/ff2 x:0 0 0 2024-09-19T06:08:49.306 INFO:tasks.workunit.client.0.smithi037.stdout:7/770: creat d6/d20/d34/dc0/dcf/ff3 x:0 0 0 2024-09-19T06:08:49.306 INFO:tasks.workunit.client.0.smithi037.stdout:7/771: dread - d6/dc/d22/d59/da8/dc4/fcd zero size 2024-09-19T06:08:49.307 INFO:tasks.workunit.client.0.smithi037.stdout:4/762: dwrite d0/d6/d1b/d20/d48/fda [0,4194304] 0 2024-09-19T06:08:49.307 INFO:tasks.workunit.client.0.smithi037.stdout:0/735: dread d5/f7 [0,4194304] 0 2024-09-19T06:08:49.309 INFO:tasks.workunit.client.0.smithi037.stdout:8/833: dwrite d1/d61/d7e/d8b/d9f/de4/fe7 [0,4194304] 0 2024-09-19T06:08:49.311 INFO:tasks.workunit.client.0.smithi037.stdout:4/763: creat d0/d6/d1b/d30/dee/ff4 x:0 0 0 2024-09-19T06:08:49.322 INFO:tasks.workunit.client.0.smithi037.stdout:5/704: dread d2/d12/d28/d22/d4a/d9f/fcc [0,4194304] 0 2024-09-19T06:08:49.322 INFO:tasks.workunit.client.0.smithi037.stdout:5/705: read - d2/d12/d24/d58/d96/dd7/fdb zero size 2024-09-19T06:08:49.322 INFO:tasks.workunit.client.0.smithi037.stdout:5/706: truncate d2/d12/d24/d58/d7f/fc2 137283 0 2024-09-19T06:08:49.322 INFO:tasks.workunit.client.0.smithi037.stdout:5/707: truncate d2/f80 703856 0 2024-09-19T06:08:49.322 INFO:tasks.workunit.client.0.smithi037.stdout:5/708: chown d2/d12/f5d 26022307 1 2024-09-19T06:08:49.322 INFO:tasks.workunit.client.0.smithi037.stdout:1/599: sync 2024-09-19T06:08:49.322 INFO:tasks.workunit.client.0.smithi037.stdout:9/835: sync 2024-09-19T06:08:49.322 INFO:tasks.workunit.client.0.smithi037.stdout:2/846: sync 2024-09-19T06:08:49.322 INFO:tasks.workunit.client.0.smithi037.stdout:1/600: readlink d2/d12/d1d/l8e 0 2024-09-19T06:08:49.322 INFO:tasks.workunit.client.0.smithi037.stdout:2/847: dread - d1/d6/da3/da8/ff7 zero size 2024-09-19T06:08:49.322 INFO:tasks.workunit.client.0.smithi037.stdout:2/848: fsync d1/da/f2a 0 2024-09-19T06:08:49.324 INFO:tasks.workunit.client.0.smithi037.stdout:1/601: symlink d2/d12/d1e/d63/lcd 0 2024-09-19T06:08:49.326 INFO:tasks.workunit.client.0.smithi037.stdout:2/849: stat d1/da/dc/d21/d7d/dab/cc6 0 2024-09-19T06:08:49.328 INFO:tasks.workunit.client.0.smithi037.stdout:1/602: symlink d2/d12/d15/d34/lce 0 2024-09-19T06:08:49.329 INFO:tasks.workunit.client.0.smithi037.stdout:2/850: mkdir d1/da/dc/d11e 0 2024-09-19T06:08:49.329 INFO:tasks.workunit.client.0.smithi037.stdout:1/603: symlink d2/d12/d1e/dbe/lcf 0 2024-09-19T06:08:49.329 INFO:tasks.workunit.client.0.smithi037.stdout:1/604: fsync d2/d12/d1e/d63/f77 0 2024-09-19T06:08:49.330 INFO:tasks.workunit.client.0.smithi037.stdout:3/675: dread d0/d43/d23/d7a/fa8 [0,4194304] 0 2024-09-19T06:08:49.330 INFO:tasks.workunit.client.0.smithi037.stdout:5/709: dread d2/d12/d7e/fa6 [0,4194304] 0 2024-09-19T06:08:49.331 INFO:tasks.workunit.client.0.smithi037.stdout:2/851: creat d1/da/dc/d21/d7d/d80/f11f x:0 0 0 2024-09-19T06:08:49.332 INFO:tasks.workunit.client.0.smithi037.stdout:5/710: stat d2/d10/l65 0 2024-09-19T06:08:49.332 INFO:tasks.workunit.client.0.smithi037.stdout:5/711: dread - d2/d12/d24/d58/d8e/fd2 zero size 2024-09-19T06:08:49.333 INFO:tasks.workunit.client.0.smithi037.stdout:2/852: mknod d1/d33/d4c/d114/c120 0 2024-09-19T06:08:49.333 INFO:tasks.workunit.client.0.smithi037.stdout:2/853: write d1/da/dc/d21/d55/dbc/f110 [919278,115999] 0 2024-09-19T06:08:49.334 INFO:tasks.workunit.client.0.smithi037.stdout:0/736: write d5/d17/f5f [1100638,76938] 0 2024-09-19T06:08:49.335 INFO:tasks.workunit.client.0.smithi037.stdout:5/712: creat d2/fe2 x:0 0 0 2024-09-19T06:08:49.335 INFO:tasks.workunit.client.0.smithi037.stdout:5/713: fdatasync d2/d12/d24/d58/d8e/f94 0 2024-09-19T06:08:49.335 INFO:tasks.workunit.client.0.smithi037.stdout:5/714: dread - d2/fe2 zero size 2024-09-19T06:08:49.340 INFO:tasks.workunit.client.0.smithi037.stdout:2/854: getdents d1/da/dc/d21/d7d 0 2024-09-19T06:08:49.340 INFO:tasks.workunit.client.0.smithi037.stdout:0/737: mkdir d5/d105 0 2024-09-19T06:08:49.342 INFO:tasks.workunit.client.0.smithi037.stdout:2/855: mknod d1/da/c121 0 2024-09-19T06:08:49.342 INFO:tasks.workunit.client.0.smithi037.stdout:2/856: write d1/da/dd7/f107 [441184,24157] 0 2024-09-19T06:08:49.343 INFO:tasks.workunit.client.0.smithi037.stdout:9/836: dwrite da/dec/d116/d63/d80/dc4/fe0 [0,4194304] 0 2024-09-19T06:08:49.343 INFO:tasks.workunit.client.0.smithi037.stdout:6/692: dwrite d9/d16/f2a [0,4194304] 0 2024-09-19T06:08:49.343 INFO:tasks.workunit.client.0.smithi037.stdout:7/772: write d6/f1d [1112366,110989] 0 2024-09-19T06:08:49.345 INFO:tasks.workunit.client.0.smithi037.stdout:9/837: symlink da/dec/d116/d1b/d23/d6a/d8f/da4/l12d 0 2024-09-19T06:08:49.346 INFO:tasks.workunit.client.0.smithi037.stdout:7/773: mknod d6/d20/d4b/d60/cf4 0 2024-09-19T06:08:49.346 INFO:tasks.workunit.client.0.smithi037.stdout:3/676: write d0/d43/d23/f69 [6711412,77105] 0 2024-09-19T06:08:49.346 INFO:tasks.workunit.client.0.smithi037.stdout:2/857: dread d1/da/dc/f15 [0,4194304] 0 2024-09-19T06:08:49.346 INFO:tasks.workunit.client.0.smithi037.stdout:2/858: chown d1/d6 3753090 1 2024-09-19T06:08:49.347 INFO:tasks.workunit.client.0.smithi037.stdout:9/838: creat da/dec/d116/d1b/d23/d6a/f12e x:0 0 0 2024-09-19T06:08:49.348 INFO:tasks.workunit.client.0.smithi037.stdout:7/774: truncate d6/dc/f77 395530 0 2024-09-19T06:08:49.350 INFO:tasks.workunit.client.0.smithi037.stdout:3/677: creat d0/d43/fe0 x:0 0 0 2024-09-19T06:08:49.350 INFO:tasks.workunit.client.0.smithi037.stdout:3/678: chown d0/d16/d19/f29 6083 1 2024-09-19T06:08:49.351 INFO:tasks.workunit.client.0.smithi037.stdout:2/859: creat d1/da/d6e/d100/f122 x:0 0 0 2024-09-19T06:08:49.353 INFO:tasks.workunit.client.0.smithi037.stdout:9/839: mknod da/dec/d116/d1b/d2f/c12f 0 2024-09-19T06:08:49.353 INFO:tasks.workunit.client.0.smithi037.stdout:9/840: getdents da/dec/d116/d63/d80/dc4/d101 0 2024-09-19T06:08:49.356 INFO:tasks.workunit.client.0.smithi037.stdout:3/679: creat d0/d96/fe1 x:0 0 0 2024-09-19T06:08:49.356 INFO:tasks.workunit.client.0.smithi037.stdout:5/715: dread d2/d12/f26 [0,4194304] 0 2024-09-19T06:08:49.357 INFO:tasks.workunit.client.0.smithi037.stdout:9/841: link da/dec/d116/d1b/d23/de9/ff3 da/dec/d116/d1b/d23/d6a/d8f/f130 0 2024-09-19T06:08:49.358 INFO:tasks.workunit.client.0.smithi037.stdout:8/834: dwrite d1/d61/d7e/d8b/d9f/de4/fe7 [4194304,4194304] 0 2024-09-19T06:08:49.359 INFO:tasks.workunit.client.0.smithi037.stdout:1/605: dwrite d2/d12/d1e/d2d/d6f/fc5 [0,4194304] 0 2024-09-19T06:08:49.361 INFO:tasks.workunit.client.0.smithi037.stdout:9/842: rename da/dec/d116/d1b/d43/d12b to da/dec/d116/d131 0 2024-09-19T06:08:49.367 INFO:tasks.workunit.client.0.smithi037.stdout:1/606: creat d2/d12/fd0 x:0 0 0 2024-09-19T06:08:49.367 INFO:tasks.workunit.client.0.smithi037.stdout:1/607: chown d2/d12/d15/d95 3566 1 2024-09-19T06:08:49.367 INFO:tasks.workunit.client.0.smithi037.stdout:1/608: write d2/d12/d1e/d2a/d8f/da6/fbf [2159971,31643] 0 2024-09-19T06:08:49.367 INFO:tasks.workunit.client.0.smithi037.stdout:1/609: fdatasync d2/d12/d1e/d2a/fb3 0 2024-09-19T06:08:49.369 INFO:tasks.workunit.client.0.smithi037.stdout:8/835: rename d1/d61/d7e/dbc/dc2/d59/da9/cd1 to d1/d61/d7e/dbc/dc2/d59/d5d/dfc/c11c 0 2024-09-19T06:08:49.369 INFO:tasks.workunit.client.0.smithi037.stdout:9/843: mkdir da/dec/d116/d1b/d62/df4/d132 0 2024-09-19T06:08:49.369 INFO:tasks.workunit.client.0.smithi037.stdout:9/844: write da/dec/d116/d1b/d2f/f70 [5345190,61961] 0 2024-09-19T06:08:49.369 INFO:tasks.workunit.client.0.smithi037.stdout:9/845: chown da/d4d/dbb/fe8 2793182 1 2024-09-19T06:08:49.369 INFO:tasks.workunit.client.0.smithi037.stdout:3/680: dread d0/d16/d19/d33/f38 [0,4194304] 0 2024-09-19T06:08:49.371 INFO:tasks.workunit.client.0.smithi037.stdout:1/610: symlink d2/d12/d1d/d6b/ld1 0 2024-09-19T06:08:49.371 INFO:tasks.workunit.client.0.smithi037.stdout:0/738: dwrite d5/f87 [0,4194304] 0 2024-09-19T06:08:49.373 INFO:tasks.workunit.client.0.smithi037.stdout:9/846: rename da/dec/d116/d1b/d23/dbe/ff9 to da/dec/d116/d1b/d43/de4/f133 0 2024-09-19T06:08:49.373 INFO:tasks.workunit.client.0.smithi037.stdout:3/681: symlink d0/d16/le2 0 2024-09-19T06:08:49.373 INFO:tasks.workunit.client.0.smithi037.stdout:3/682: stat d0/d16/d19/d1d/d82/d86 0 2024-09-19T06:08:49.374 INFO:tasks.workunit.client.0.smithi037.stdout:3/683: truncate d0/d5f/d70/f78 82236 0 2024-09-19T06:08:49.378 INFO:tasks.workunit.client.0.smithi037.stdout:2/860: dwrite d1/d16/d62/f11b [0,4194304] 0 2024-09-19T06:08:49.379 INFO:tasks.workunit.client.0.smithi037.stdout:6/693: dwrite d9/d6e/fae [0,4194304] 0 2024-09-19T06:08:49.379 INFO:tasks.workunit.client.0.smithi037.stdout:6/694: write d9/dd/d1c/d4e/d65/f8b [1136301,92793] 0 2024-09-19T06:08:49.380 INFO:tasks.workunit.client.0.smithi037.stdout:6/695: chown d9/dd/d1c/fc2 1853 1 2024-09-19T06:08:49.380 INFO:tasks.workunit.client.0.smithi037.stdout:0/739: rename d5/d8/d44/d48 to d5/d8/d79/d9a/ddb/d106 0 2024-09-19T06:08:49.380 INFO:tasks.workunit.client.0.smithi037.stdout:9/847: creat da/dec/d116/d31/f134 x:0 0 0 2024-09-19T06:08:49.380 INFO:tasks.workunit.client.0.smithi037.stdout:9/848: chown da/d20/fc2 1942279958 1 2024-09-19T06:08:49.383 INFO:tasks.workunit.client.0.smithi037.stdout:6/696: creat d9/dd/d2b/fe3 x:0 0 0 2024-09-19T06:08:49.387 INFO:tasks.workunit.client.0.smithi037.stdout:3/684: rename d0/d5f/fcc to d0/d43/d26/fe3 0 2024-09-19T06:08:49.388 INFO:tasks.workunit.client.0.smithi037.stdout:0/740: symlink d5/d8/d11/d32/l107 0 2024-09-19T06:08:49.388 INFO:tasks.workunit.client.0.smithi037.stdout:0/741: fsync d5/d42/fb3 0 2024-09-19T06:08:49.389 INFO:tasks.workunit.client.0.smithi037.stdout:2/861: rename d1/d16/d4a/f75 to d1/d16/db1/f123 0 2024-09-19T06:08:49.391 INFO:tasks.workunit.client.0.smithi037.stdout:0/742: mknod d5/d8/d44/d61/c108 0 2024-09-19T06:08:49.392 INFO:tasks.workunit.client.0.smithi037.stdout:0/743: write d5/dd5/de9/d8d/f9f [226384,97976] 0 2024-09-19T06:08:49.392 INFO:tasks.workunit.client.0.smithi037.stdout:0/744: read - d5/d8/d44/f71 zero size 2024-09-19T06:08:49.393 INFO:tasks.workunit.client.0.smithi037.stdout:0/745: getdents d5/d8/d22/d89 0 2024-09-19T06:08:49.393 INFO:tasks.workunit.client.0.smithi037.stdout:0/746: chown d5/dd5/de9/d21/d4e 286342541 1 2024-09-19T06:08:49.395 INFO:tasks.workunit.client.0.smithi037.stdout:2/862: symlink d1/da/d95/l124 0 2024-09-19T06:08:49.395 INFO:tasks.workunit.client.0.smithi037.stdout:2/863: write d1/d6/da3/da8/fe5 [537270,31003] 0 2024-09-19T06:08:49.395 INFO:tasks.workunit.client.0.smithi037.stdout:2/864: chown d1/d6/da3/da8/dbe/l11d 0 1 2024-09-19T06:08:49.395 INFO:tasks.workunit.client.0.smithi037.stdout:0/747: truncate d5/d8/fc2 252757 0 2024-09-19T06:08:49.395 INFO:tasks.workunit.client.0.smithi037.stdout:0/748: stat d5/d8/l1b 0 2024-09-19T06:08:49.396 INFO:tasks.workunit.client.0.smithi037.stdout:2/865: mknod d1/d16/db1/c125 0 2024-09-19T06:08:49.398 INFO:tasks.workunit.client.0.smithi037.stdout:1/611: dwrite d2/d12/d15/d34/f52 [4194304,4194304] 0 2024-09-19T06:08:49.398 INFO:tasks.workunit.client.0.smithi037.stdout:0/749: creat d5/d8/d11/f109 x:0 0 0 2024-09-19T06:08:49.398 INFO:tasks.workunit.client.0.smithi037.stdout:0/750: fsync d5/d8/d11/f3e 0 2024-09-19T06:08:49.398 INFO:tasks.workunit.client.0.smithi037.stdout:0/751: stat d5/dd5/de9/d8d/de0/dea/f103 0 2024-09-19T06:08:49.399 INFO:tasks.workunit.client.0.smithi037.stdout:8/836: dwrite d1/d61/d7e/d8b/d91/d3d/d66/f100 [0,4194304] 0 2024-09-19T06:08:49.399 INFO:tasks.workunit.client.0.smithi037.stdout:2/866: rename d1/da/dd7/f107 to d1/d33/d4c/d114/f126 0 2024-09-19T06:08:49.400 INFO:tasks.workunit.client.0.smithi037.stdout:9/849: dread da/dec/d116/d1b/d23/d6a/d8f/fb7 [0,4194304] 0 2024-09-19T06:08:49.400 INFO:tasks.workunit.client.0.smithi037.stdout:9/850: stat da/dec/d116/l124 0 2024-09-19T06:08:49.401 INFO:tasks.workunit.client.0.smithi037.stdout:1/612: creat d2/d12/d15/fd2 x:0 0 0 2024-09-19T06:08:49.403 INFO:tasks.workunit.client.0.smithi037.stdout:0/752: unlink d5/d8/ced 0 2024-09-19T06:08:49.404 INFO:tasks.workunit.client.0.smithi037.stdout:0/753: chown d5/d20/d34 0 1 2024-09-19T06:08:49.406 INFO:tasks.workunit.client.0.smithi037.stdout:8/837: creat d1/d35/d118/f11d x:0 0 0 2024-09-19T06:08:49.407 INFO:tasks.workunit.client.0.smithi037.stdout:2/867: rmdir d1/da/d6e/da0 39 2024-09-19T06:08:49.410 INFO:tasks.workunit.client.0.smithi037.stdout:9/851: mkdir da/d4d/d135 0 2024-09-19T06:08:49.410 INFO:tasks.workunit.client.0.smithi037.stdout:9/852: write da/db3/d10e/f121 [848034,11203] 0 2024-09-19T06:08:49.410 INFO:tasks.workunit.client.0.smithi037.stdout:9/853: write da/dec/d116/d63/f107 [678411,47362] 0 2024-09-19T06:08:49.411 INFO:tasks.workunit.client.0.smithi037.stdout:9/854: stat da/dec/d116/d1b/d23/d6a/f12e 0 2024-09-19T06:08:49.411 INFO:tasks.workunit.client.0.smithi037.stdout:9/855: read - da/dec/d116/d31/f134 zero size 2024-09-19T06:08:49.411 INFO:tasks.workunit.client.0.smithi037.stdout:9/856: write da/dec/d116/d1b/d23/f69 [1452299,89583] 0 2024-09-19T06:08:49.411 INFO:tasks.workunit.client.0.smithi037.stdout:8/838: mknod d1/d61/d7e/dbc/dc0/d113/c11e 0 2024-09-19T06:08:49.412 INFO:tasks.workunit.client.0.smithi037.stdout:3/685: dwrite d0/d16/d19/d33/f9d [4194304,4194304] 0 2024-09-19T06:08:49.412 INFO:tasks.workunit.client.0.smithi037.stdout:3/686: write d0/d43/f7f [1703365,84023] 0 2024-09-19T06:08:49.413 INFO:tasks.workunit.client.0.smithi037.stdout:2/868: unlink d1/da/dc/d21/d55/dbc/db0/f116 0 2024-09-19T06:08:49.414 INFO:tasks.workunit.client.0.smithi037.stdout:8/839: getdents d1/d61/d7e/d8b/d91/d3d/d66 0 2024-09-19T06:08:49.416 INFO:tasks.workunit.client.0.smithi037.stdout:3/687: creat d0/d16/da6/dd4/fe4 x:0 0 0 2024-09-19T06:08:49.417 INFO:tasks.workunit.client.0.smithi037.stdout:2/869: truncate d1/f29 1001108 0 2024-09-19T06:08:49.420 INFO:tasks.workunit.client.0.smithi037.stdout:8/840: dread d1/d61/d7e/d8b/d91/d3d/f14 [0,4194304] 0 2024-09-19T06:08:49.421 INFO:tasks.workunit.client.0.smithi037.stdout:2/870: mkdir d1/da/d127 0 2024-09-19T06:08:49.422 INFO:tasks.workunit.client.0.smithi037.stdout:8/841: link d1/d61/d7e/d8b/d91/d3d/fed d1/d61/d7e/dbc/dc2/d9b/f11f 0 2024-09-19T06:08:49.424 INFO:tasks.workunit.client.0.smithi037.stdout:2/871: creat d1/d33/d4c/f128 x:0 0 0 2024-09-19T06:08:49.426 INFO:tasks.workunit.client.0.smithi037.stdout:8/842: rename d1/dc7/fe0 to d1/d61/d7e/dbc/dc2/d9b/f120 0 2024-09-19T06:08:49.428 INFO:tasks.workunit.client.0.smithi037.stdout:1/613: dwrite d2/d12/d17/f9d [4194304,4194304] 0 2024-09-19T06:08:49.428 INFO:tasks.workunit.client.0.smithi037.stdout:1/614: fdatasync d2/d12/d1e/d75/f88 0 2024-09-19T06:08:49.428 INFO:tasks.workunit.client.0.smithi037.stdout:2/872: creat d1/d6/da3/da8/dbe/df4/f129 x:0 0 0 2024-09-19T06:08:49.430 INFO:tasks.workunit.client.0.smithi037.stdout:8/843: creat d1/d61/d7e/dbc/f121 x:0 0 0 2024-09-19T06:08:49.434 INFO:tasks.workunit.client.0.smithi037.stdout:2/873: rename d1/da/d6e/da0 to d1/da/dc/d21/d51/d12a 0 2024-09-19T06:08:49.435 INFO:tasks.workunit.client.0.smithi037.stdout:8/844: mkdir d1/d61/d7e/d8b/d9f/de4/d122 0 2024-09-19T06:08:49.437 INFO:tasks.workunit.client.0.smithi037.stdout:0/754: dwrite d5/d18/d68/d85/fb7 [0,4194304] 0 2024-09-19T06:08:49.438 INFO:tasks.workunit.client.0.smithi037.stdout:1/615: mkdir d2/d12/d15/dd3 0 2024-09-19T06:08:49.438 INFO:tasks.workunit.client.0.smithi037.stdout:1/616: fsync d2/d12/d1e/d75/f94 0 2024-09-19T06:08:49.438 INFO:tasks.workunit.client.0.smithi037.stdout:1/617: write d2/d12/d15/d34/fc7 [1021806,90195] 0 2024-09-19T06:08:49.439 INFO:tasks.workunit.client.0.smithi037.stdout:2/874: mknod d1/d16/d96/dd0/c12b 0 2024-09-19T06:08:49.443 INFO:tasks.workunit.client.0.smithi037.stdout:0/755: dread d5/d42/f50 [0,4194304] 0 2024-09-19T06:08:49.443 INFO:tasks.workunit.client.0.smithi037.stdout:0/756: chown d5/d8/d11/lb0 6 1 2024-09-19T06:08:49.443 INFO:tasks.workunit.client.0.smithi037.stdout:9/857: dwrite da/dec/d116/d31/f3a [0,4194304] 0 2024-09-19T06:08:49.443 INFO:tasks.workunit.client.0.smithi037.stdout:3/688: dread d0/d43/d23/d7a/d77/f53 [0,4194304] 0 2024-09-19T06:08:49.443 INFO:tasks.workunit.client.0.smithi037.stdout:2/875: rmdir d1/d9e 39 2024-09-19T06:08:49.452 INFO:tasks.workunit.client.0.smithi037.stdout:9/858: symlink da/dec/d116/d1b/d2f/d6f/l136 0 2024-09-19T06:08:49.453 INFO:tasks.workunit.client.0.smithi037.stdout:3/689: creat d0/d16/d19/d1d/d5e/da9/db5/fe5 x:0 0 0 2024-09-19T06:08:49.453 INFO:tasks.workunit.client.0.smithi037.stdout:3/690: fsync d0/fa1 0 2024-09-19T06:08:49.453 INFO:tasks.workunit.client.0.smithi037.stdout:3/691: write d0/d16/d19/fb2 [1055195,40762] 0 2024-09-19T06:08:49.453 INFO:tasks.workunit.client.0.smithi037.stdout:1/618: write d2/d12/d15/f58 [2295276,71599] 0 2024-09-19T06:08:49.454 INFO:tasks.workunit.client.0.smithi037.stdout:1/619: truncate d2/d12/d1e/d2a/fb3 662958 0 2024-09-19T06:08:49.455 INFO:tasks.workunit.client.0.smithi037.stdout:9/859: mkdir da/d20/d11c/ddc/d137 0 2024-09-19T06:08:49.455 INFO:tasks.workunit.client.0.smithi037.stdout:9/860: write da/dec/d116/d1b/d43/f7c [1935270,19469] 0 2024-09-19T06:08:49.455 INFO:tasks.workunit.client.0.smithi037.stdout:8/845: dread d1/f32 [0,4194304] 0 2024-09-19T06:08:49.457 INFO:tasks.workunit.client.0.smithi037.stdout:3/692: mknod d0/d5f/da0/ce6 0 2024-09-19T06:08:49.459 INFO:tasks.workunit.client.0.smithi037.stdout:1/620: mkdir d2/d12/d15/dd3/dd4 0 2024-09-19T06:08:49.461 INFO:tasks.workunit.client.0.smithi037.stdout:9/861: creat da/dec/d116/d1b/d23/d6a/d85/f138 x:0 0 0 2024-09-19T06:08:49.462 INFO:tasks.workunit.client.0.smithi037.stdout:8/846: rename d1/d61/d7e/d8b/d91/dea to d1/d35/d118/d123 0 2024-09-19T06:08:49.463 INFO:tasks.workunit.client.0.smithi037.stdout:3/693: unlink d0/d43/d23/d7a/d77/f41 0 2024-09-19T06:08:49.464 INFO:tasks.workunit.client.0.smithi037.stdout:1/621: rmdir d2/d12/d1e/d63 39 2024-09-19T06:08:49.464 INFO:tasks.workunit.client.0.smithi037.stdout:1/622: write d2/d48/f9b [112752,103096] 0 2024-09-19T06:08:49.465 INFO:tasks.workunit.client.0.smithi037.stdout:9/862: mkdir da/dec/d116/d1b/d23/d6a/d8f/da4/d139 0 2024-09-19T06:08:49.465 INFO:tasks.workunit.client.0.smithi037.stdout:9/863: write da/dec/d116/d1b/d23/f69 [2478352,67334] 0 2024-09-19T06:08:49.466 INFO:tasks.workunit.client.0.smithi037.stdout:8/847: rename d1/d61/d7e/d8b/f109 to d1/d61/d7e/dbc/dc2/df4/f124 0 2024-09-19T06:08:49.467 INFO:tasks.workunit.client.0.smithi037.stdout:3/694: getdents d0/d43/d23/d7a/d77/d62 0 2024-09-19T06:08:49.468 INFO:tasks.workunit.client.0.smithi037.stdout:1/623: creat d2/d12/d1d/fd5 x:0 0 0 2024-09-19T06:08:49.470 INFO:tasks.workunit.client.0.smithi037.stdout:9/864: rename da/lb to da/dec/d116/d1b/d23/d6a/d8f/da4/l13a 0 2024-09-19T06:08:49.471 INFO:tasks.workunit.client.0.smithi037.stdout:0/757: dwrite d5/ff8 [0,4194304] 0 2024-09-19T06:08:49.471 INFO:tasks.workunit.client.0.smithi037.stdout:2/876: dwrite d1/da/dc/d21/d7d/dab/fc9 [0,4194304] 0 2024-09-19T06:08:49.471 INFO:tasks.workunit.client.0.smithi037.stdout:3/695: creat d0/d43/fe7 x:0 0 0 2024-09-19T06:08:49.473 INFO:tasks.workunit.client.0.smithi037.stdout:0/758: read d5/d8/d22/d89/d96/fc9 [181497,34928] 0 2024-09-19T06:08:49.474 INFO:tasks.workunit.client.0.smithi037.stdout:0/759: write d5/d8/d11/f109 [240706,102390] 0 2024-09-19T06:08:49.474 INFO:tasks.workunit.client.0.smithi037.stdout:0/760: read - d5/d17/d6e/fff zero size 2024-09-19T06:08:49.474 INFO:tasks.workunit.client.0.smithi037.stdout:0/761: chown d5/d8/d44/f71 100 1 2024-09-19T06:08:49.475 INFO:tasks.workunit.client.0.smithi037.stdout:8/848: rename d1/d61/d7e/dbc/dc2/d59/da9 to d1/d61/dd5/d125 0 2024-09-19T06:08:49.478 INFO:tasks.workunit.client.0.smithi037.stdout:2/877: dread - d1/da/d95/ffc zero size 2024-09-19T06:08:49.480 INFO:tasks.workunit.client.0.smithi037.stdout:0/762: mkdir d5/d105/d10a 0 2024-09-19T06:08:49.480 INFO:tasks.workunit.client.0.smithi037.stdout:1/624: dread d2/d12/d1e/d2d/f4c [0,4194304] 0 2024-09-19T06:08:49.481 INFO:tasks.workunit.client.0.smithi037.stdout:8/849: creat d1/d35/d118/d123/f126 x:0 0 0 2024-09-19T06:08:49.483 INFO:tasks.workunit.client.0.smithi037.stdout:2/878: rename d1/da/dc/d21/l113 to d1/da/d127/l12c 0 2024-09-19T06:08:49.487 INFO:tasks.workunit.client.0.smithi037.stdout:3/696: read d0/d16/d19/f28 [4504846,58650] 0 2024-09-19T06:08:49.488 INFO:tasks.workunit.client.0.smithi037.stdout:9/865: dread da/dec/d116/d63/d80/dc4/fe0 [0,4194304] 0 2024-09-19T06:08:49.490 INFO:tasks.workunit.client.0.smithi037.stdout:1/625: creat d2/d12/d1e/d2a/d97/fd6 x:0 0 0 2024-09-19T06:08:49.493 INFO:tasks.workunit.client.0.smithi037.stdout:8/850: rename d1/d61/dd5/d125/l110 to d1/dc7/l127 0 2024-09-19T06:08:49.495 INFO:tasks.workunit.client.0.smithi037.stdout:1/626: dread d2/d12/d1d/f45 [0,4194304] 0 2024-09-19T06:08:49.497 INFO:tasks.workunit.client.0.smithi037.stdout:3/697: creat d0/d16/d19/fe8 x:0 0 0 2024-09-19T06:08:49.498 INFO:tasks.workunit.client.0.smithi037.stdout:8/851: rename d1/d61/d7e/d8b/d91/d3d/c13 to d1/d61/d7e/dbc/dc2/df4/c128 0 2024-09-19T06:08:49.498 INFO:tasks.workunit.client.0.smithi037.stdout:0/763: dread d5/d8/d44/f56 [0,4194304] 0 2024-09-19T06:08:49.499 INFO:tasks.workunit.client.0.smithi037.stdout:1/627: symlink d2/d12/d17/ld7 0 2024-09-19T06:08:49.499 INFO:tasks.workunit.client.0.smithi037.stdout:1/628: readlink d2/d12/d15/d34/l5e 0 2024-09-19T06:08:49.499 INFO:tasks.workunit.client.0.smithi037.stdout:1/629: write d2/f3a [427479,75771] 0 2024-09-19T06:08:49.499 INFO:tasks.workunit.client.0.smithi037.stdout:1/630: dread - d2/d12/d1e/d75/f84 zero size 2024-09-19T06:08:49.499 INFO:tasks.workunit.client.0.smithi037.stdout:1/631: write d2/f3 [183518,16888] 0 2024-09-19T06:08:49.500 INFO:tasks.workunit.client.0.smithi037.stdout:0/764: rmdir d5/d8/d44/da1 39 2024-09-19T06:08:49.500 INFO:tasks.workunit.client.0.smithi037.stdout:0/765: truncate d5/d42/f8b 1219710 0 2024-09-19T06:08:49.500 INFO:tasks.workunit.client.0.smithi037.stdout:0/766: read - d5/d18/fbc zero size 2024-09-19T06:08:49.500 INFO:tasks.workunit.client.0.smithi037.stdout:0/767: write d5/d8/d79/d9a/fc7 [770974,27033] 0 2024-09-19T06:08:49.501 INFO:tasks.workunit.client.0.smithi037.stdout:1/632: truncate d2/d12/d1d/f4f 2565774 0 2024-09-19T06:08:49.502 INFO:tasks.workunit.client.0.smithi037.stdout:0/768: truncate d5/d18/d68/d85/dab/dba/fc1 35611 0 2024-09-19T06:08:49.503 INFO:tasks.workunit.client.0.smithi037.stdout:8/852: dread d1/d61/d68/ff1 [0,4194304] 0 2024-09-19T06:08:49.503 INFO:tasks.workunit.client.0.smithi037.stdout:8/853: fdatasync d1/d61/d7e/d8b/f98 0 2024-09-19T06:08:49.506 INFO:tasks.workunit.client.0.smithi037.stdout:0/769: link d5/d8/f66 d5/dd5/de9/d21/d4e/f10b 0 2024-09-19T06:08:49.507 INFO:tasks.workunit.client.0.smithi037.stdout:7/775: sync 2024-09-19T06:08:49.507 INFO:tasks.workunit.client.0.smithi037.stdout:4/764: sync 2024-09-19T06:08:49.508 INFO:tasks.workunit.client.0.smithi037.stdout:5/716: sync 2024-09-19T06:08:49.509 INFO:tasks.workunit.client.0.smithi037.stdout:3/698: dread d0/d43/f4c [0,4194304] 0 2024-09-19T06:08:49.509 INFO:tasks.workunit.client.0.smithi037.stdout:4/765: creat d0/d6/d1b/d20/d4d/d64/db0/ff5 x:0 0 0 2024-09-19T06:08:49.510 INFO:tasks.workunit.client.0.smithi037.stdout:3/699: symlink d0/d16/d19/d1d/d5e/d61/dcb/le9 0 2024-09-19T06:08:49.512 INFO:tasks.workunit.client.0.smithi037.stdout:4/766: creat d0/d2/d37/d46/de5/d6f/da9/dba/ff6 x:0 0 0 2024-09-19T06:08:49.512 INFO:tasks.workunit.client.0.smithi037.stdout:9/866: dwrite da/dec/d116/d1b/d23/de9/f83 [0,4194304] 0 2024-09-19T06:08:49.515 INFO:tasks.workunit.client.0.smithi037.stdout:0/770: dread d5/dd5/de9/d21/d4e/fb5 [0,4194304] 0 2024-09-19T06:08:49.515 INFO:tasks.workunit.client.0.smithi037.stdout:0/771: truncate d5/fd6 551992 0 2024-09-19T06:08:49.525 INFO:tasks.workunit.client.0.smithi037.stdout:7/776: write d6/d20/d71/f79 [85192,66124] 0 2024-09-19T06:08:49.526 INFO:tasks.workunit.client.0.smithi037.stdout:7/777: fdatasync d6/d20/d34/d7d/f90 0 2024-09-19T06:08:49.527 INFO:tasks.workunit.client.0.smithi037.stdout:0/772: symlink d5/d18/d68/l10c 0 2024-09-19T06:08:49.528 INFO:tasks.workunit.client.0.smithi037.stdout:7/778: unlink d6/dc/df/cb3 0 2024-09-19T06:08:49.530 INFO:tasks.workunit.client.0.smithi037.stdout:0/773: truncate d5/d8/d11/f55 2046323 0 2024-09-19T06:08:49.530 INFO:tasks.workunit.client.0.smithi037.stdout:0/774: write d5/d8/d11/d32/f43 [8422635,7671] 0 2024-09-19T06:08:49.530 INFO:tasks.workunit.client.0.smithi037.stdout:0/775: truncate d5/d8/d22/d89/d96/fd4 64252 0 2024-09-19T06:08:49.530 INFO:tasks.workunit.client.0.smithi037.stdout:0/776: chown d5/d8/d22/d89/de7/ff2 1559 1 2024-09-19T06:08:49.530 INFO:tasks.workunit.client.0.smithi037.stdout:0/777: fsync d5/d20/d34/f74 0 2024-09-19T06:08:49.530 INFO:tasks.workunit.client.0.smithi037.stdout:0/778: fsync d5/d18/fbc 0 2024-09-19T06:08:49.531 INFO:tasks.workunit.client.0.smithi037.stdout:1/633: dwrite d2/d12/d15/d95/fc3 [0,4194304] 0 2024-09-19T06:08:49.532 INFO:tasks.workunit.client.0.smithi037.stdout:7/779: creat d6/dc/d22/ff5 x:0 0 0 2024-09-19T06:08:49.532 INFO:tasks.workunit.client.0.smithi037.stdout:7/780: fdatasync d6/d20/d34/d97/fa0 0 2024-09-19T06:08:49.532 INFO:tasks.workunit.client.0.smithi037.stdout:7/781: dread - d6/f3d zero size 2024-09-19T06:08:49.532 INFO:tasks.workunit.client.0.smithi037.stdout:7/782: chown d6/d20/f6c 867165 1 2024-09-19T06:08:49.533 INFO:tasks.workunit.client.0.smithi037.stdout:0/779: creat d5/dd5/de9/d8d/f10d x:0 0 0 2024-09-19T06:08:49.533 INFO:tasks.workunit.client.0.smithi037.stdout:0/780: dread - d5/dd5/de9/d8d/fdf zero size 2024-09-19T06:08:49.533 INFO:tasks.workunit.client.0.smithi037.stdout:0/781: stat d5/d18/d68/d85/dab/dba/fc1 0 2024-09-19T06:08:49.538 INFO:tasks.workunit.client.0.smithi037.stdout:8/854: dwrite d1/d8f/f106 [0,4194304] 0 2024-09-19T06:08:49.543 INFO:tasks.workunit.client.0.smithi037.stdout:3/700: dwrite d0/f25 [0,4194304] 0 2024-09-19T06:08:49.545 INFO:tasks.workunit.client.0.smithi037.stdout:2/879: dwrite d1/f29 [0,4194304] 0 2024-09-19T06:08:49.547 INFO:tasks.workunit.client.0.smithi037.stdout:3/701: creat d0/d16/d19/d33/d87/dbd/fea x:0 0 0 2024-09-19T06:08:49.547 INFO:tasks.workunit.client.0.smithi037.stdout:1/634: dread d2/d12/d17/f18 [0,4194304] 0 2024-09-19T06:08:49.547 INFO:tasks.workunit.client.0.smithi037.stdout:1/635: fsync d2/d12/d1e/d2a/d2e/f7e 0 2024-09-19T06:08:49.548 INFO:tasks.workunit.client.0.smithi037.stdout:8/855: dread d1/f52 [0,4194304] 0 2024-09-19T06:08:49.553 INFO:tasks.workunit.client.0.smithi037.stdout:9/867: dwrite da/dec/d116/d1b/f3d [0,4194304] 0 2024-09-19T06:08:49.557 INFO:tasks.workunit.client.0.smithi037.stdout:2/880: mkdir d1/da/dc/d21/d7d/d80/dc7/d12d 0 2024-09-19T06:08:49.557 INFO:tasks.workunit.client.0.smithi037.stdout:2/881: write d1/da/f63 [4687182,100588] 0 2024-09-19T06:08:49.557 INFO:tasks.workunit.client.0.smithi037.stdout:2/882: fdatasync d1/d9e/d118/f11a 0 2024-09-19T06:08:49.557 INFO:tasks.workunit.client.0.smithi037.stdout:1/636: mknod d2/d12/d15/dd3/dd4/cd8 0 2024-09-19T06:08:49.557 INFO:tasks.workunit.client.0.smithi037.stdout:6/697: sync 2024-09-19T06:08:49.557 INFO:tasks.workunit.client.0.smithi037.stdout:4/767: dwrite d0/f16 [0,4194304] 0 2024-09-19T06:08:49.558 INFO:tasks.workunit.client.0.smithi037.stdout:4/768: write d0/d6/d1b/d20/d77/fad [431582,27947] 0 2024-09-19T06:08:49.558 INFO:tasks.workunit.client.0.smithi037.stdout:8/856: symlink d1/d61/d7b/l129 0 2024-09-19T06:08:49.561 INFO:tasks.workunit.client.0.smithi037.stdout:2/883: mkdir d1/da/d6e/d12e 0 2024-09-19T06:08:49.561 INFO:tasks.workunit.client.0.smithi037.stdout:2/884: stat d1/da/dc/d21/d51/d12a 0 2024-09-19T06:08:49.562 INFO:tasks.workunit.client.0.smithi037.stdout:7/783: dwrite d6/f92 [4194304,4194304] 0 2024-09-19T06:08:49.562 INFO:tasks.workunit.client.0.smithi037.stdout:7/784: write d6/dc/df/f13 [5296337,56242] 0 2024-09-19T06:08:49.564 INFO:tasks.workunit.client.0.smithi037.stdout:6/698: mkdir d9/dd/d20/d5a/dd2/de4 0 2024-09-19T06:08:49.569 INFO:tasks.workunit.client.0.smithi037.stdout:3/702: dwrite d0/f5a [0,4194304] 0 2024-09-19T06:08:49.569 INFO:tasks.workunit.client.0.smithi037.stdout:3/703: write d0/d43/d23/d7a/d77/f2b [2110329,29058] 0 2024-09-19T06:08:49.572 INFO:tasks.workunit.client.0.smithi037.stdout:1/637: symlink d2/d12/d1e/d2d/d6f/ld9 0 2024-09-19T06:08:49.572 INFO:tasks.workunit.client.0.smithi037.stdout:4/769: symlink d0/d6/d1b/d20/d4d/lf7 0 2024-09-19T06:08:49.572 INFO:tasks.workunit.client.0.smithi037.stdout:8/857: creat d1/d61/f12a x:0 0 0 2024-09-19T06:08:49.572 INFO:tasks.workunit.client.0.smithi037.stdout:7/785: truncate d6/d21/f52 572017 0 2024-09-19T06:08:49.573 INFO:tasks.workunit.client.0.smithi037.stdout:8/858: creat d1/d61/dd5/d125/f12b x:0 0 0 2024-09-19T06:08:49.574 INFO:tasks.workunit.client.0.smithi037.stdout:7/786: getdents d6/dc/d22/d59/da8/dc4 0 2024-09-19T06:08:49.582 INFO:tasks.workunit.client.0.smithi037.stdout:4/770: dread d0/f44 [0,4194304] 0 2024-09-19T06:08:49.593 INFO:tasks.workunit.client.0.smithi037.stdout:6/699: dwrite d9/dd/f52 [0,4194304] 0 2024-09-19T06:08:49.596 INFO:tasks.workunit.client.0.smithi037.stdout:3/704: dwrite d0/d16/f30 [0,4194304] 0 2024-09-19T06:08:49.596 INFO:tasks.workunit.client.0.smithi037.stdout:3/705: write d0/d43/fe7 [371036,95185] 0 2024-09-19T06:08:49.596 INFO:tasks.workunit.client.0.smithi037.stdout:6/700: unlink d9/dd/l4f 0 2024-09-19T06:08:49.598 INFO:tasks.workunit.client.0.smithi037.stdout:3/706: unlink d0/d43/l8f 0 2024-09-19T06:08:49.598 INFO:tasks.workunit.client.0.smithi037.stdout:3/707: write d0/ff [248076,95721] 0 2024-09-19T06:08:49.598 INFO:tasks.workunit.client.0.smithi037.stdout:3/708: stat d0/d16/f88 0 2024-09-19T06:08:49.599 INFO:tasks.workunit.client.0.smithi037.stdout:6/701: mknod d9/dd/d20/d5a/d6d/d82/da9/ce5 0 2024-09-19T06:08:49.599 INFO:tasks.workunit.client.0.smithi037.stdout:6/702: stat d9/dd/d20/d5a/d6d/d82/da9 0 2024-09-19T06:08:49.599 INFO:tasks.workunit.client.0.smithi037.stdout:2/885: dwrite d1/da/fa5 [0,4194304] 0 2024-09-19T06:08:49.601 INFO:tasks.workunit.client.0.smithi037.stdout:6/703: getdents d9/dd/d1c 0 2024-09-19T06:08:49.601 INFO:tasks.workunit.client.0.smithi037.stdout:6/704: fsync d9/dd/d2b/f61 0 2024-09-19T06:08:49.601 INFO:tasks.workunit.client.0.smithi037.stdout:6/705: truncate d9/d9c/fcd 718546 0 2024-09-19T06:08:49.601 INFO:tasks.workunit.client.0.smithi037.stdout:6/706: fsync d9/dd/d1c/f2e 0 2024-09-19T06:08:49.602 INFO:tasks.workunit.client.0.smithi037.stdout:6/707: creat d9/dd/d1c/d4e/d65/db0/fe6 x:0 0 0 2024-09-19T06:08:49.607 INFO:tasks.workunit.client.0.smithi037.stdout:4/771: dread d0/d6/d1b/d20/d48/da7/fb5 [0,4194304] 0 2024-09-19T06:08:49.613 INFO:tasks.workunit.client.0.smithi037.stdout:8/859: dwrite d1/d61/d68/fcb [0,4194304] 0 2024-09-19T06:08:49.615 INFO:tasks.workunit.client.0.smithi037.stdout:4/772: dread d0/d2/d37/d46/de5/d6f/fbb [0,4194304] 0 2024-09-19T06:08:49.615 INFO:tasks.workunit.client.0.smithi037.stdout:8/860: symlink d1/d35/d118/d123/l12c 0 2024-09-19T06:08:49.615 INFO:tasks.workunit.client.0.smithi037.stdout:1/638: dwrite d2/d12/d17/f2b [4194304,4194304] 0 2024-09-19T06:08:49.617 INFO:tasks.workunit.client.0.smithi037.stdout:4/773: mknod d0/d2/d37/d46/de5/d86/cf8 0 2024-09-19T06:08:49.617 INFO:tasks.workunit.client.0.smithi037.stdout:4/774: stat d0/d6/d1b/d30/d70 0 2024-09-19T06:08:49.619 INFO:tasks.workunit.client.0.smithi037.stdout:6/708: dread d9/f18 [0,4194304] 0 2024-09-19T06:08:49.619 INFO:tasks.workunit.client.0.smithi037.stdout:6/709: readlink d9/d6e/lc8 0 2024-09-19T06:08:49.619 INFO:tasks.workunit.client.0.smithi037.stdout:4/775: link d0/d2/f2b d0/d6/d1b/d20/d4d/ff9 0 2024-09-19T06:08:49.619 INFO:tasks.workunit.client.0.smithi037.stdout:4/776: dread - d0/d2/d37/d46/de5/fc5 zero size 2024-09-19T06:08:49.620 INFO:tasks.workunit.client.0.smithi037.stdout:4/777: rmdir d0/d2/d37/d46/db1 39 2024-09-19T06:08:49.620 INFO:tasks.workunit.client.0.smithi037.stdout:4/778: getdents d0/d2/d37/d46 0 2024-09-19T06:08:49.621 INFO:tasks.workunit.client.0.smithi037.stdout:7/787: dwrite d6/dc/f94 [0,4194304] 0 2024-09-19T06:08:49.622 INFO:tasks.workunit.client.0.smithi037.stdout:4/779: creat d0/d2/d37/d46/de5/ffa x:0 0 0 2024-09-19T06:08:49.622 INFO:tasks.workunit.client.0.smithi037.stdout:4/780: stat d0/d6/d1b/d5d/fdb 0 2024-09-19T06:08:49.626 INFO:tasks.workunit.client.0.smithi037.stdout:7/788: creat d6/d20/d34/ff6 x:0 0 0 2024-09-19T06:08:49.628 INFO:tasks.workunit.client.0.smithi037.stdout:7/789: link d6/dc/d22/d59/da8/dc4/fdb d6/d21/d68/dc7/ff7 0 2024-09-19T06:08:49.629 INFO:tasks.workunit.client.0.smithi037.stdout:3/709: dwrite d0/d43/d23/d7a/d77/d51/fb9 [0,4194304] 0 2024-09-19T06:08:49.629 INFO:tasks.workunit.client.0.smithi037.stdout:3/710: fdatasync d0/d16/f22 0 2024-09-19T06:08:49.630 INFO:tasks.workunit.client.0.smithi037.stdout:7/790: symlink d6/dc/d22/lf8 0 2024-09-19T06:08:49.630 INFO:tasks.workunit.client.0.smithi037.stdout:1/639: dread d2/f6 [0,4194304] 0 2024-09-19T06:08:49.632 INFO:tasks.workunit.client.0.smithi037.stdout:3/711: symlink d0/d43/leb 0 2024-09-19T06:08:49.633 INFO:tasks.workunit.client.0.smithi037.stdout:7/791: creat d6/dc/ff9 x:0 0 0 2024-09-19T06:08:49.636 INFO:tasks.workunit.client.0.smithi037.stdout:7/792: mkdir d6/d20/d34/dc0/dcf/dfa 0 2024-09-19T06:08:49.648 INFO:tasks.workunit.client.0.smithi037.stdout:3/712: dread d0/d16/d19/fb2 [0,4194304] 0 2024-09-19T06:08:49.649 INFO:tasks.workunit.client.0.smithi037.stdout:6/710: dwrite d9/dd/f52 [4194304,4194304] 0 2024-09-19T06:08:49.649 INFO:tasks.workunit.client.0.smithi037.stdout:3/713: creat d0/d16/d19/d33/fec x:0 0 0 2024-09-19T06:08:49.649 INFO:tasks.workunit.client.0.smithi037.stdout:8/861: dwrite d1/d61/d7e/dbc/dc2/daa/fca [0,4194304] 0 2024-09-19T06:08:49.651 INFO:tasks.workunit.client.0.smithi037.stdout:6/711: symlink d9/dd/d1c/d4e/d33/le7 0 2024-09-19T06:08:49.651 INFO:tasks.workunit.client.0.smithi037.stdout:6/712: chown d9/fa8 452194 1 2024-09-19T06:08:49.651 INFO:tasks.workunit.client.0.smithi037.stdout:1/640: dread d2/f8 [0,4194304] 0 2024-09-19T06:08:49.652 INFO:tasks.workunit.client.0.smithi037.stdout:8/862: unlink d1/d61/d7e/dbc/dc2/d59/l65 0 2024-09-19T06:08:49.653 INFO:tasks.workunit.client.0.smithi037.stdout:6/713: link d9/dd/d2b/d79/f53 d9/dd/d20/d5a/fe8 0 2024-09-19T06:08:49.654 INFO:tasks.workunit.client.0.smithi037.stdout:6/714: readlink d9/dd/d20/l94 0 2024-09-19T06:08:49.654 INFO:tasks.workunit.client.0.smithi037.stdout:6/715: stat d9/d16/l1e 0 2024-09-19T06:08:49.655 INFO:tasks.workunit.client.0.smithi037.stdout:1/641: rename d2/d12/d1e/d2a/d8f/da6/fbf to d2/d12/fda 0 2024-09-19T06:08:49.655 INFO:tasks.workunit.client.0.smithi037.stdout:1/642: readlink d2/d12/d1e/d2a/l4a 0 2024-09-19T06:08:49.655 INFO:tasks.workunit.client.0.smithi037.stdout:1/643: chown d2/d12/d1d/l20 455284198 1 2024-09-19T06:08:49.656 INFO:tasks.workunit.client.0.smithi037.stdout:8/863: unlink d1/d61/d7e/dbc/dc2/fc1 0 2024-09-19T06:08:49.656 INFO:tasks.workunit.client.0.smithi037.stdout:4/781: dwrite d0/f24 [0,4194304] 0 2024-09-19T06:08:49.657 INFO:tasks.workunit.client.0.smithi037.stdout:4/782: chown d0/d6/d1b/d20/d4d/d64/de7 1720386576 1 2024-09-19T06:08:49.657 INFO:tasks.workunit.client.0.smithi037.stdout:6/716: creat d9/d9c/fe9 x:0 0 0 2024-09-19T06:08:49.657 INFO:tasks.workunit.client.0.smithi037.stdout:6/717: chown d9/le 21808 1 2024-09-19T06:08:49.658 INFO:tasks.workunit.client.0.smithi037.stdout:1/644: getdents d2/d12/d1e/d2d 0 2024-09-19T06:08:49.658 INFO:tasks.workunit.client.0.smithi037.stdout:1/645: write d2/d12/d15/f58 [867341,43866] 0 2024-09-19T06:08:49.658 INFO:tasks.workunit.client.0.smithi037.stdout:1/646: fsync d2/d12/d1e/f4e 0 2024-09-19T06:08:49.659 INFO:tasks.workunit.client.0.smithi037.stdout:6/718: mknod d9/d6e/cea 0 2024-09-19T06:08:49.676 INFO:tasks.workunit.client.0.smithi037.stdout:8/864: write d1/d61/d7e/dbc/dc2/daa/fca [1841432,111295] 0 2024-09-19T06:08:49.678 INFO:tasks.workunit.client.0.smithi037.stdout:6/719: dread d9/f24 [4194304,4194304] 0 2024-09-19T06:08:49.678 INFO:tasks.workunit.client.0.smithi037.stdout:6/720: write d9/dd/d20/f48 [722904,5226] 0 2024-09-19T06:08:49.678 INFO:tasks.workunit.client.0.smithi037.stdout:3/714: dwrite d0/d43/f4c [0,4194304] 0 2024-09-19T06:08:49.680 INFO:tasks.workunit.client.0.smithi037.stdout:6/721: creat d9/d9c/feb x:0 0 0 2024-09-19T06:08:49.681 INFO:tasks.workunit.client.0.smithi037.stdout:3/715: mknod d0/d16/d19/d1d/d5e/d61/dcb/ced 0 2024-09-19T06:08:49.682 INFO:tasks.workunit.client.0.smithi037.stdout:6/722: creat d9/dd/d2b/d42/fec x:0 0 0 2024-09-19T06:08:49.683 INFO:tasks.workunit.client.0.smithi037.stdout:3/716: mknod d0/d16/d19/d1d/d82/d86/cee 0 2024-09-19T06:08:49.683 INFO:tasks.workunit.client.0.smithi037.stdout:1/647: dwrite d2/fa [0,4194304] 0 2024-09-19T06:08:49.684 INFO:tasks.workunit.client.0.smithi037.stdout:6/723: symlink d9/dd/d1c/d4e/d65/de2/led 0 2024-09-19T06:08:49.684 INFO:tasks.workunit.client.0.smithi037.stdout:6/724: write d9/dd/d2b/d42/fdd [757388,22397] 0 2024-09-19T06:08:49.684 INFO:tasks.workunit.client.0.smithi037.stdout:6/725: truncate d9/d16/f2a 4550136 0 2024-09-19T06:08:49.685 INFO:tasks.workunit.client.0.smithi037.stdout:3/717: mknod d0/d16/da6/dd5/cef 0 2024-09-19T06:08:49.685 INFO:tasks.workunit.client.0.smithi037.stdout:3/718: fsync d0/fa1 0 2024-09-19T06:08:49.686 INFO:tasks.workunit.client.0.smithi037.stdout:6/726: creat d9/d9c/fee x:0 0 0 2024-09-19T06:08:49.691 INFO:tasks.workunit.client.0.smithi037.stdout:6/727: dread d9/d16/f8a [0,4194304] 0 2024-09-19T06:08:49.696 INFO:tasks.workunit.client.0.smithi037.stdout:8/865: dwrite d1/d61/d7e/dbc/dd0/f102 [0,4194304] 0 2024-09-19T06:08:49.696 INFO:tasks.workunit.client.0.smithi037.stdout:8/866: chown d1/d61/d7e/d8b/d91 252728 1 2024-09-19T06:08:49.711 INFO:tasks.workunit.client.0.smithi037.stdout:4/783: dwrite d0/d6/d45/dd9/d36/fc6 [0,4194304] 0 2024-09-19T06:08:49.711 INFO:tasks.workunit.client.0.smithi037.stdout:1/648: dwrite d2/d12/d1d/d6b/fb2 [0,4194304] 0 2024-09-19T06:08:49.711 INFO:tasks.workunit.client.0.smithi037.stdout:1/649: readlink d2/d12/d1d/l20 0 2024-09-19T06:08:49.715 INFO:tasks.workunit.client.0.smithi037.stdout:4/784: write d0/d2/d37/d46/de5/d6f/d8e/fbd [202638,66287] 0 2024-09-19T06:08:49.715 INFO:tasks.workunit.client.0.smithi037.stdout:1/650: getdents d2/d12/d1e/d2a 0 2024-09-19T06:08:49.724 INFO:tasks.workunit.client.0.smithi037.stdout:6/728: write d9/dd/d2b/d79/f70 [3731675,106524] 0 2024-09-19T06:08:49.724 INFO:tasks.workunit.client.0.smithi037.stdout:3/719: dwrite d0/d16/d19/f9c [0,4194304] 0 2024-09-19T06:08:49.725 INFO:tasks.workunit.client.0.smithi037.stdout:4/785: dread d0/d6/d1b/d20/d4d/ff9 [0,4194304] 0 2024-09-19T06:08:49.728 INFO:tasks.workunit.client.0.smithi037.stdout:3/720: mkdir d0/d5f/da0/df0 0 2024-09-19T06:08:49.729 INFO:tasks.workunit.client.0.smithi037.stdout:4/786: write d0/d2/f2c [868122,19298] 0 2024-09-19T06:08:49.731 INFO:tasks.workunit.client.0.smithi037.stdout:4/787: mknod d0/d6/d45/dd9/d36/cfb 0 2024-09-19T06:08:49.733 INFO:tasks.workunit.client.0.smithi037.stdout:3/721: dread d0/d43/fe7 [0,4194304] 0 2024-09-19T06:08:49.733 INFO:tasks.workunit.client.0.smithi037.stdout:3/722: chown d0/d5f/da0/fc1 24 1 2024-09-19T06:08:49.734 INFO:tasks.workunit.client.0.smithi037.stdout:3/723: chown d0/d16/da6/cbb 427856 1 2024-09-19T06:08:49.737 INFO:tasks.workunit.client.0.smithi037.stdout:5/717: sync 2024-09-19T06:08:49.738 INFO:tasks.workunit.client.0.smithi037.stdout:6/729: dread d9/dd/d1c/f41 [0,4194304] 0 2024-09-19T06:08:49.739 INFO:tasks.workunit.client.0.smithi037.stdout:1/651: dwrite d2/d12/f13 [0,4194304] 0 2024-09-19T06:08:49.739 INFO:tasks.workunit.client.0.smithi037.stdout:1/652: readlink d2/d12/d1e/d2a/l7a 0 2024-09-19T06:08:49.739 INFO:tasks.workunit.client.0.smithi037.stdout:1/653: chown d2/f38 32503511 1 2024-09-19T06:08:49.739 INFO:tasks.workunit.client.0.smithi037.stdout:5/718: rmdir d2/d12/d28/d22/d87/da8 39 2024-09-19T06:08:49.739 INFO:tasks.workunit.client.0.smithi037.stdout:5/719: getdents d2/d12/d24/d97/dbc 0 2024-09-19T06:08:49.739 INFO:tasks.workunit.client.0.smithi037.stdout:5/720: chown d2/d12/d28/d22/d87/fab 1054452047 1 2024-09-19T06:08:49.739 INFO:tasks.workunit.client.0.smithi037.stdout:1/654: write d2/f3 [761612,84803] 0 2024-09-19T06:08:49.739 INFO:tasks.workunit.client.0.smithi037.stdout:1/655: fdatasync d2/d12/f25 0 2024-09-19T06:08:49.741 INFO:tasks.workunit.client.0.smithi037.stdout:6/730: rename d9/dd/d1c/d4e/d33/f97 to d9/dd/d20/d5a/d6d/d82/d9f/da4/fef 0 2024-09-19T06:08:49.741 INFO:tasks.workunit.client.0.smithi037.stdout:6/731: chown d9/dd/d1c/d73/ld0 8 1 2024-09-19T06:08:49.741 INFO:tasks.workunit.client.0.smithi037.stdout:6/732: fdatasync d9/dd/f52 0 2024-09-19T06:08:49.743 INFO:tasks.workunit.client.0.smithi037.stdout:1/656: creat d2/d12/d17/fdb x:0 0 0 2024-09-19T06:08:49.743 INFO:tasks.workunit.client.0.smithi037.stdout:1/657: write d2/d12/d1e/d2a/d2e/f7f [669601,38471] 0 2024-09-19T06:08:49.743 INFO:tasks.workunit.client.0.smithi037.stdout:5/721: write d2/d12/d28/d22/fbe [4595398,114637] 0 2024-09-19T06:08:49.743 INFO:tasks.workunit.client.0.smithi037.stdout:5/722: dread - d2/fe2 zero size 2024-09-19T06:08:49.744 INFO:tasks.workunit.client.0.smithi037.stdout:6/733: link d9/dd/d1c/f2e d9/d78/ff0 0 2024-09-19T06:08:49.744 INFO:tasks.workunit.client.0.smithi037.stdout:6/734: chown d9/dd/d1c/f47 7 1 2024-09-19T06:08:49.744 INFO:tasks.workunit.client.0.smithi037.stdout:6/735: chown d9/d16/c9d 2276 1 2024-09-19T06:08:49.744 INFO:tasks.workunit.client.0.smithi037.stdout:6/736: chown d9/dd/d1c/f2e 482077 1 2024-09-19T06:08:49.745 INFO:tasks.workunit.client.0.smithi037.stdout:1/658: mknod d2/d12/d15/d34/cdc 0 2024-09-19T06:08:49.746 INFO:tasks.workunit.client.0.smithi037.stdout:3/724: dread d0/d16/d19/f28 [4194304,4194304] 0 2024-09-19T06:08:49.747 INFO:tasks.workunit.client.0.smithi037.stdout:5/723: mkdir d2/d12/d7e/de3 0 2024-09-19T06:08:49.748 INFO:tasks.workunit.client.0.smithi037.stdout:6/737: mknod d9/dd/d2b/d79/dd3/cf1 0 2024-09-19T06:08:49.748 INFO:tasks.workunit.client.0.smithi037.stdout:6/738: chown l6 957 1 2024-09-19T06:08:49.749 INFO:tasks.workunit.client.0.smithi037.stdout:1/659: creat d2/d12/d1e/dbe/fdd x:0 0 0 2024-09-19T06:08:49.751 INFO:tasks.workunit.client.0.smithi037.stdout:3/725: link d0/d16/f30 d0/d16/d19/d1d/dc7/ff1 0 2024-09-19T06:08:49.753 INFO:tasks.workunit.client.0.smithi037.stdout:5/724: rename d2/d5c/f7b to d2/d12/d7e/fe4 0 2024-09-19T06:08:49.753 INFO:tasks.workunit.client.0.smithi037.stdout:5/725: read d2/d12/d24/f95 [6716162,123014] 0 2024-09-19T06:08:49.753 INFO:tasks.workunit.client.0.smithi037.stdout:5/726: fdatasync d2/d10/f21 0 2024-09-19T06:08:49.754 INFO:tasks.workunit.client.0.smithi037.stdout:6/739: symlink d9/dd/d1c/d4e/d65/db0/lf2 0 2024-09-19T06:08:49.755 INFO:tasks.workunit.client.0.smithi037.stdout:5/727: symlink d2/d12/d28/le5 0 2024-09-19T06:08:49.756 INFO:tasks.workunit.client.0.smithi037.stdout:4/788: dwrite d0/d2/d37/d46/fcf [0,4194304] 0 2024-09-19T06:08:49.757 INFO:tasks.workunit.client.0.smithi037.stdout:6/740: symlink d9/dd/d2b/d79/lf3 0 2024-09-19T06:08:49.757 INFO:tasks.workunit.client.0.smithi037.stdout:6/741: fsync d9/d9c/feb 0 2024-09-19T06:08:49.757 INFO:tasks.workunit.client.0.smithi037.stdout:5/728: creat d2/d12/d28/d22/fe6 x:0 0 0 2024-09-19T06:08:49.760 INFO:tasks.workunit.client.0.smithi037.stdout:6/742: creat d9/dd/d2b/ff4 x:0 0 0 2024-09-19T06:08:49.760 INFO:tasks.workunit.client.0.smithi037.stdout:6/743: read - d9/dd/d20/d5a/d6d/fac zero size 2024-09-19T06:08:49.763 INFO:tasks.workunit.client.0.smithi037.stdout:6/744: dread d9/d6e/fa5 [0,4194304] 0 2024-09-19T06:08:49.768 INFO:tasks.workunit.client.0.smithi037.stdout:4/789: write d0/f7a [914144,67908] 0 2024-09-19T06:08:49.774 INFO:tasks.workunit.client.0.smithi037.stdout:1/660: dwrite d2/d12/fd0 [0,4194304] 0 2024-09-19T06:08:49.775 INFO:tasks.workunit.client.0.smithi037.stdout:1/661: truncate d2/d12/d1e/d2a/d2e/f7f 728622 0 2024-09-19T06:08:49.777 INFO:tasks.workunit.client.0.smithi037.stdout:1/662: creat d2/fde x:0 0 0 2024-09-19T06:08:49.779 INFO:tasks.workunit.client.0.smithi037.stdout:1/663: link d2/d12/d15/d34/faf d2/d12/d15/d5c/fdf 0 2024-09-19T06:08:49.779 INFO:tasks.workunit.client.0.smithi037.stdout:1/664: stat d2/d73/fcb 0 2024-09-19T06:08:49.779 INFO:tasks.workunit.client.0.smithi037.stdout:1/665: chown d2/d12/d1e/d63/lcd 149418 1 2024-09-19T06:08:49.780 INFO:tasks.workunit.client.0.smithi037.stdout:3/726: dwrite d0/d43/d23/d7a/d77/d45/d55/f63 [0,4194304] 0 2024-09-19T06:08:49.782 INFO:tasks.workunit.client.0.smithi037.stdout:3/727: mknod d0/d43/d37/cf2 0 2024-09-19T06:08:49.784 INFO:tasks.workunit.client.0.smithi037.stdout:3/728: mkdir d0/d16/d19/df3 0 2024-09-19T06:08:49.784 INFO:tasks.workunit.client.0.smithi037.stdout:3/729: write d0/d16/d19/d1d/d82/d86/fdc [814092,122008] 0 2024-09-19T06:08:49.785 INFO:tasks.workunit.client.0.smithi037.stdout:3/730: mkdir d0/d16/d19/d1d/d82/d86/df4 0 2024-09-19T06:08:49.785 INFO:tasks.workunit.client.0.smithi037.stdout:4/790: write d0/d6/d1b/d20/d48/fda [2338704,98000] 0 2024-09-19T06:08:49.786 INFO:tasks.workunit.client.0.smithi037.stdout:3/731: getdents d0/d43/d23/d7a/d77/d45/d55 0 2024-09-19T06:08:49.788 INFO:tasks.workunit.client.0.smithi037.stdout:4/791: creat d0/d6/d1b/d30/dee/df2/ffc x:0 0 0 2024-09-19T06:08:49.789 INFO:tasks.workunit.client.0.smithi037.stdout:6/745: dwrite d9/d16/fc6 [0,4194304] 0 2024-09-19T06:08:49.790 INFO:tasks.workunit.client.0.smithi037.stdout:3/732: rename d0/d43/d37/f8c to d0/d43/d23/d7a/ff5 0 2024-09-19T06:08:49.792 INFO:tasks.workunit.client.0.smithi037.stdout:6/746: rename d9/fbc to d9/dd/d20/d5a/d6d/d82/da9/ff5 0 2024-09-19T06:08:49.793 INFO:tasks.workunit.client.0.smithi037.stdout:1/666: dread d2/d12/d15/d95/fc3 [0,4194304] 0 2024-09-19T06:08:49.793 INFO:tasks.workunit.client.0.smithi037.stdout:3/733: dread d0/d43/d23/f72 [0,4194304] 0 2024-09-19T06:08:49.793 INFO:tasks.workunit.client.0.smithi037.stdout:3/734: fsync d0/d16/f22 0 2024-09-19T06:08:49.794 INFO:tasks.workunit.client.0.smithi037.stdout:1/667: mkdir d2/d12/d1e/d75/d89/de0 0 2024-09-19T06:08:49.796 INFO:tasks.workunit.client.0.smithi037.stdout:3/735: getdents d0 0 2024-09-19T06:08:49.796 INFO:tasks.workunit.client.0.smithi037.stdout:6/747: write d9/d16/f26 [4801520,51635] 0 2024-09-19T06:08:49.796 INFO:tasks.workunit.client.0.smithi037.stdout:6/748: stat d9/dd/d1c/d73/f86 0 2024-09-19T06:08:49.797 INFO:tasks.workunit.client.0.smithi037.stdout:3/736: creat d0/d5f/ff6 x:0 0 0 2024-09-19T06:08:49.798 INFO:tasks.workunit.client.0.smithi037.stdout:6/749: mkdir d9/dd/d20/d5a/d6d/df6 0 2024-09-19T06:08:49.798 INFO:tasks.workunit.client.0.smithi037.stdout:3/737: symlink d0/d16/d19/d1d/d82/d86/df4/lf7 0 2024-09-19T06:08:49.799 INFO:tasks.workunit.client.0.smithi037.stdout:6/750: rmdir d9/dd/d20/d5a/d6d/d82/da9 39 2024-09-19T06:08:49.799 INFO:tasks.workunit.client.0.smithi037.stdout:6/751: chown d9/dd/d1c/f80 230851663 1 2024-09-19T06:08:49.800 INFO:tasks.workunit.client.0.smithi037.stdout:6/752: unlink d9/dd/d1c/f80 0 2024-09-19T06:08:49.805 INFO:tasks.workunit.client.0.smithi037.stdout:4/792: dread d0/d6/d1b/f55 [0,4194304] 0 2024-09-19T06:08:49.809 INFO:tasks.workunit.client.0.smithi037.stdout:1/668: write d2/d12/d15/d95/fc3 [1666594,17868] 0 2024-09-19T06:08:49.833 INFO:tasks.workunit.client.0.smithi037.stdout:6/753: dwrite d9/dd/d2b/d79/f63 [0,4194304] 0 2024-09-19T06:08:49.833 INFO:tasks.workunit.client.0.smithi037.stdout:6/754: fdatasync d9/dd/f22 0 2024-09-19T06:08:49.833 INFO:tasks.workunit.client.0.smithi037.stdout:6/755: write d9/dd/d20/d5a/d6d/d82/da9/ff5 [651114,103515] 0 2024-09-19T06:08:49.833 INFO:tasks.workunit.client.0.smithi037.stdout:6/756: readlink d9/dd/d20/l40 0 2024-09-19T06:08:49.833 INFO:tasks.workunit.client.0.smithi037.stdout:6/757: stat d9/dd/d1c/c46 0 2024-09-19T06:08:49.833 INFO:tasks.workunit.client.0.smithi037.stdout:6/758: chown d9/d78 15 1 2024-09-19T06:08:49.834 INFO:tasks.workunit.client.0.smithi037.stdout:6/759: creat d9/dd/d20/d5a/d6d/d82/d9f/ff7 x:0 0 0 2024-09-19T06:08:49.834 INFO:tasks.workunit.client.0.smithi037.stdout:6/760: stat d9/dd/d1c/d4e/f36 0 2024-09-19T06:08:49.834 INFO:tasks.workunit.client.0.smithi037.stdout:6/761: readlink d9/dd/d1c/d4e/d65/db0/lce 0 2024-09-19T06:08:49.834 INFO:tasks.workunit.client.0.smithi037.stdout:6/762: write d9/dd/d2b/f50 [1203855,65755] 0 2024-09-19T06:08:49.835 INFO:tasks.workunit.client.0.smithi037.stdout:1/669: dwrite d2/d12/d15/d34/f52 [8388608,4194304] 0 2024-09-19T06:08:49.841 INFO:tasks.workunit.client.0.smithi037.stdout:6/763: write d9/dd/d20/f27 [217183,18243] 0 2024-09-19T06:08:49.841 INFO:tasks.workunit.client.0.smithi037.stdout:1/670: link d2/d48/f81 d2/d12/d15/dd3/fe1 0 2024-09-19T06:08:49.841 INFO:tasks.workunit.client.0.smithi037.stdout:1/671: read - d2/d12/d17/fdb zero size 2024-09-19T06:08:49.844 INFO:tasks.workunit.client.0.smithi037.stdout:6/764: unlink d9/dd/d1c/fc2 0 2024-09-19T06:08:49.845 INFO:tasks.workunit.client.0.smithi037.stdout:6/765: creat d9/dd/d20/d5a/d6d/d82/da9/ff8 x:0 0 0 2024-09-19T06:08:49.846 INFO:tasks.workunit.client.0.smithi037.stdout:6/766: creat d9/dd/d2b/d79/ff9 x:0 0 0 2024-09-19T06:08:49.847 INFO:tasks.workunit.client.0.smithi037.stdout:6/767: truncate d9/d6e/fae 153634 0 2024-09-19T06:08:49.863 INFO:tasks.workunit.client.0.smithi037.stdout:1/672: dwrite d2/d12/d1e/d2d/f85 [0,4194304] 0 2024-09-19T06:08:49.865 INFO:tasks.workunit.client.0.smithi037.stdout:1/673: symlink d2/d12/d1d/d47/le2 0 2024-09-19T06:08:49.866 INFO:tasks.workunit.client.0.smithi037.stdout:1/674: chown d2/d12/d1e/d2a/lbc 3196 1 2024-09-19T06:08:49.866 INFO:tasks.workunit.client.0.smithi037.stdout:1/675: dread - d2/d73/fcb zero size 2024-09-19T06:08:49.866 INFO:tasks.workunit.client.0.smithi037.stdout:1/676: symlink d2/d12/d1e/dbe/le3 0 2024-09-19T06:08:49.867 INFO:tasks.workunit.client.0.smithi037.stdout:1/677: read d2/d12/d1e/d63/f93 [131814,88054] 0 2024-09-19T06:08:49.867 INFO:tasks.workunit.client.0.smithi037.stdout:1/678: fdatasync d2/d48/f9b 0 2024-09-19T06:08:49.868 INFO:tasks.workunit.client.0.smithi037.stdout:1/679: creat d2/d12/d1e/d2d/d87/fe4 x:0 0 0 2024-09-19T06:08:49.869 INFO:tasks.workunit.client.0.smithi037.stdout:1/680: mkdir d2/d12/d1e/d75/d89/de5 0 2024-09-19T06:08:49.869 INFO:tasks.workunit.client.0.smithi037.stdout:1/681: fdatasync d2/d12/d15/d5c/fdf 0 2024-09-19T06:08:49.870 INFO:tasks.workunit.client.0.smithi037.stdout:6/768: dwrite d9/d16/f2a [0,4194304] 0 2024-09-19T06:08:49.870 INFO:tasks.workunit.client.0.smithi037.stdout:6/769: read - d9/dd/d20/d5a/d6d/d82/d9f/ff7 zero size 2024-09-19T06:08:49.870 INFO:tasks.workunit.client.0.smithi037.stdout:6/770: write d9/dd/d20/d5a/d6d/d82/d9f/da4/fbe [863230,13385] 0 2024-09-19T06:08:49.871 INFO:tasks.workunit.client.0.smithi037.stdout:6/771: mknod d9/dd/d2b/cfa 0 2024-09-19T06:08:49.883 INFO:tasks.workunit.client.0.smithi037.stdout:1/682: read d2/d12/d15/f27 [1796581,3668] 0 2024-09-19T06:08:49.892 INFO:tasks.workunit.client.0.smithi037.stdout:6/772: dwrite d9/dd/d2b/d42/fec [0,4194304] 0 2024-09-19T06:08:49.895 INFO:tasks.workunit.client.0.smithi037.stdout:6/773: creat d9/d16/dc5/ffb x:0 0 0 2024-09-19T06:08:49.897 INFO:tasks.workunit.client.0.smithi037.stdout:1/683: dread d2/d12/d17/f2b [4194304,4194304] 0 2024-09-19T06:08:49.897 INFO:tasks.workunit.client.0.smithi037.stdout:1/684: dread - d2/d12/d1e/d2a/f59 zero size 2024-09-19T06:08:49.897 INFO:tasks.workunit.client.0.smithi037.stdout:1/685: chown d2/d12/d15/f58 0 1 2024-09-19T06:08:49.899 INFO:tasks.workunit.client.0.smithi037.stdout:6/774: rename d9/dd/d20/d5a/d6d/d82/d9f/da4/f96 to d9/dd/d20/d5a/dd2/de4/ffc 0 2024-09-19T06:08:49.901 INFO:tasks.workunit.client.0.smithi037.stdout:1/686: rename d2/d12/d1e/d63/c9a to d2/d12/d1e/d2d/ce6 0 2024-09-19T06:08:49.901 INFO:tasks.workunit.client.0.smithi037.stdout:1/687: chown d2/d12/d15/dd3/dd4 0 1 2024-09-19T06:08:49.901 INFO:tasks.workunit.client.0.smithi037.stdout:6/775: getdents d9/dd/d1c/d4e 0 2024-09-19T06:08:49.901 INFO:tasks.workunit.client.0.smithi037.stdout:6/776: chown d9/d6e/cea 3 1 2024-09-19T06:08:49.903 INFO:tasks.workunit.client.0.smithi037.stdout:1/688: creat d2/d12/d1d/d6b/fe7 x:0 0 0 2024-09-19T06:08:49.903 INFO:tasks.workunit.client.0.smithi037.stdout:1/689: read d2/d12/f25 [1462556,108476] 0 2024-09-19T06:08:49.905 INFO:tasks.workunit.client.0.smithi037.stdout:1/690: unlink d2/d12/d1e/d2d/f3c 0 2024-09-19T06:08:49.905 INFO:tasks.workunit.client.0.smithi037.stdout:1/691: getdents d2/d12/d15/d95 0 2024-09-19T06:08:49.907 INFO:tasks.workunit.client.0.smithi037.stdout:9/868: sync 2024-09-19T06:08:49.907 INFO:tasks.workunit.client.0.smithi037.stdout:0/782: sync 2024-09-19T06:08:49.907 INFO:tasks.workunit.client.0.smithi037.stdout:0/783: truncate d5/dd5/de9/d21/f72 5635442 0 2024-09-19T06:08:49.907 INFO:tasks.workunit.client.0.smithi037.stdout:0/784: fsync d5/d8/d22/d89/d96/fd4 0 2024-09-19T06:08:49.907 INFO:tasks.workunit.client.0.smithi037.stdout:1/692: creat d2/d12/d1e/fe8 x:0 0 0 2024-09-19T06:08:49.909 INFO:tasks.workunit.client.0.smithi037.stdout:9/869: rename da/dec/d116/d131/f39 to da/dec/d116/d131/f13b 0 2024-09-19T06:08:49.909 INFO:tasks.workunit.client.0.smithi037.stdout:9/870: dread - da/dec/d116/d1b/d23/de9/f104 zero size 2024-09-19T06:08:49.910 INFO:tasks.workunit.client.0.smithi037.stdout:0/785: unlink d5/dd5/de9/l36 0 2024-09-19T06:08:49.911 INFO:tasks.workunit.client.0.smithi037.stdout:9/871: creat da/d4d/f13c x:0 0 0 2024-09-19T06:08:49.913 INFO:tasks.workunit.client.0.smithi037.stdout:0/786: dread d5/d42/f50 [0,4194304] 0 2024-09-19T06:08:49.913 INFO:tasks.workunit.client.0.smithi037.stdout:0/787: chown d5/dd5/de9/d21/d4e/c64 170 1 2024-09-19T06:08:49.914 INFO:tasks.workunit.client.0.smithi037.stdout:0/788: creat d5/d8/d11/d32/f10e x:0 0 0 2024-09-19T06:08:49.916 INFO:tasks.workunit.client.0.smithi037.stdout:0/789: mkdir d5/d8/d44/d10f 0 2024-09-19T06:08:49.916 INFO:tasks.workunit.client.0.smithi037.stdout:1/693: fsync d2/d12/d1d/d6b/fe7 0 2024-09-19T06:08:49.924 INFO:tasks.workunit.client.0.smithi037.stdout:6/777: dwrite d9/dd/d2b/ff4 [0,4194304] 0 2024-09-19T06:08:49.926 INFO:tasks.workunit.client.0.smithi037.stdout:6/778: fdatasync d9/dd/d20/d5a/d6d/d82/d9f/da4/f91 0 2024-09-19T06:08:49.927 INFO:tasks.workunit.client.0.smithi037.stdout:6/779: creat d9/dd/d1c/d4e/d65/ffd x:0 0 0 2024-09-19T06:08:49.929 INFO:tasks.workunit.client.0.smithi037.stdout:9/872: dread da/dec/d116/d1b/f1f [0,4194304] 0 2024-09-19T06:08:49.930 INFO:tasks.workunit.client.0.smithi037.stdout:1/694: dread d2/d12/d15/f27 [0,4194304] 0 2024-09-19T06:08:49.931 INFO:tasks.workunit.client.0.smithi037.stdout:9/873: rename da/dec/d116/d131/f13b to da/d20/f13d 0 2024-09-19T06:08:49.932 INFO:tasks.workunit.client.0.smithi037.stdout:1/695: rename d2/d12/d1d/c78 to d2/d12/d1d/d6b/d8b/ce9 0 2024-09-19T06:08:49.933 INFO:tasks.workunit.client.0.smithi037.stdout:9/874: creat da/dec/d116/d1b/d23/d6a/f13e x:0 0 0 2024-09-19T06:08:49.933 INFO:tasks.workunit.client.0.smithi037.stdout:9/875: dread - da/dec/d116/d1b/d23/d6a/f12e zero size 2024-09-19T06:08:49.933 INFO:tasks.workunit.client.0.smithi037.stdout:9/876: write da/d4d/dbb/fe8 [163428,20884] 0 2024-09-19T06:08:49.933 INFO:tasks.workunit.client.0.smithi037.stdout:9/877: chown da/dec/d116/d1b/l4a 4465356 1 2024-09-19T06:08:49.933 INFO:tasks.workunit.client.0.smithi037.stdout:9/878: chown da/dec/d116/d1b/d2f/dcc/f117 988075692 1 2024-09-19T06:08:49.934 INFO:tasks.workunit.client.0.smithi037.stdout:1/696: unlink d2/d12/d15/d34/f82 0 2024-09-19T06:08:49.934 INFO:tasks.workunit.client.0.smithi037.stdout:0/790: write d5/dd5/de9/d21/d4e/f10b [1089464,54753] 0 2024-09-19T06:08:49.934 INFO:tasks.workunit.client.0.smithi037.stdout:9/879: symlink da/d4d/dbb/l13f 0 2024-09-19T06:08:49.934 INFO:tasks.workunit.client.0.smithi037.stdout:9/880: chown da/dec/d116/c42 26 1 2024-09-19T06:08:49.936 INFO:tasks.workunit.client.0.smithi037.stdout:1/697: unlink d2/d12/d1e/d75/d89/lc0 0 2024-09-19T06:08:49.936 INFO:tasks.workunit.client.0.smithi037.stdout:1/698: symlink d2/d12/d15/dd3/dd4/lea 0 2024-09-19T06:08:49.939 INFO:tasks.workunit.client.0.smithi037.stdout:6/780: write d9/dd/d2b/d79/f63 [3142273,32137] 0 2024-09-19T06:08:49.941 INFO:tasks.workunit.client.0.smithi037.stdout:6/781: mknod d9/dd/d1c/d73/cfe 0 2024-09-19T06:08:49.941 INFO:tasks.workunit.client.0.smithi037.stdout:6/782: truncate d9/d6e/f9a 1528354 0 2024-09-19T06:08:49.942 INFO:tasks.workunit.client.0.smithi037.stdout:6/783: link d9/dd/d20/f48 d9/dd/d2b/d79/fff 0 2024-09-19T06:08:49.942 INFO:tasks.workunit.client.0.smithi037.stdout:9/881: dread da/dec/d116/d131/f4e [0,4194304] 0 2024-09-19T06:08:49.942 INFO:tasks.workunit.client.0.smithi037.stdout:9/882: rmdir da/dec/d116/d63/d80 39 2024-09-19T06:08:49.943 INFO:tasks.workunit.client.0.smithi037.stdout:9/883: symlink da/dec/d116/d1b/l140 0 2024-09-19T06:08:49.944 INFO:tasks.workunit.client.0.smithi037.stdout:9/884: chown da/dec/d116/d1b/d2f/d6d/l96 10237407 1 2024-09-19T06:08:49.948 INFO:tasks.workunit.client.0.smithi037.stdout:6/784: dread d9/dd/d1c/d4e/d65/f8b [0,4194304] 0 2024-09-19T06:08:49.949 INFO:tasks.workunit.client.0.smithi037.stdout:6/785: symlink d9/dd/d20/d5a/d6d/d82/d9f/l100 0 2024-09-19T06:08:49.949 INFO:tasks.workunit.client.0.smithi037.stdout:6/786: chown d9/l17 255051 1 2024-09-19T06:08:49.951 INFO:tasks.workunit.client.0.smithi037.stdout:9/885: dread da/dec/d116/d1b/d23/f69 [0,4194304] 0 2024-09-19T06:08:49.958 INFO:tasks.workunit.client.0.smithi037.stdout:1/699: dread d2/f4 [4194304,4194304] 0 2024-09-19T06:08:49.958 INFO:tasks.workunit.client.0.smithi037.stdout:0/791: dwrite d5/d8/d79/d9a/ddb/d106/f5a [0,4194304] 0 2024-09-19T06:08:49.958 INFO:tasks.workunit.client.0.smithi037.stdout:1/700: chown d2/d12/f25 46 1 2024-09-19T06:08:49.970 INFO:tasks.workunit.client.0.smithi037.stdout:2/886: sync 2024-09-19T06:08:49.970 INFO:tasks.workunit.client.0.smithi037.stdout:2/887: write d1/da/dc/d21/d7d/dab/f56 [2176793,106475] 0 2024-09-19T06:08:49.970 INFO:tasks.workunit.client.0.smithi037.stdout:1/701: write d2/d12/d15/d34/f46 [3124465,99947] 0 2024-09-19T06:08:49.971 INFO:tasks.workunit.client.0.smithi037.stdout:1/702: mknod d2/d48/ceb 0 2024-09-19T06:08:49.971 INFO:tasks.workunit.client.0.smithi037.stdout:1/703: chown d2/d12/d1e/d2a/d8f/da6/fba 723731 1 2024-09-19T06:08:49.973 INFO:tasks.workunit.client.0.smithi037.stdout:6/787: dwrite d9/dd/d20/d5a/d6d/fac [0,4194304] 0 2024-09-19T06:08:49.977 INFO:tasks.workunit.client.0.smithi037.stdout:6/788: unlink d9/dd/d1c/d4e/d65/ccb 0 2024-09-19T06:08:49.977 INFO:tasks.workunit.client.0.smithi037.stdout:9/886: dwrite da/dec/d116/d1b/d23/f73 [0,4194304] 0 2024-09-19T06:08:49.977 INFO:tasks.workunit.client.0.smithi037.stdout:9/887: write da/dec/d116/d1b/d2f/df8/f11f [45330,107994] 0 2024-09-19T06:08:49.980 INFO:tasks.workunit.client.0.smithi037.stdout:6/789: creat d9/dd/d1c/d4e/f101 x:0 0 0 2024-09-19T06:08:49.980 INFO:tasks.workunit.client.0.smithi037.stdout:6/790: fdatasync d9/dd/d20/d5a/d6d/d82/f84 0 2024-09-19T06:08:49.981 INFO:tasks.workunit.client.0.smithi037.stdout:9/888: creat da/dec/d116/d1b/d23/d6a/d8f/da4/f141 x:0 0 0 2024-09-19T06:08:49.982 INFO:tasks.workunit.client.0.smithi037.stdout:6/791: creat d9/dd/d20/d5a/d6d/f102 x:0 0 0 2024-09-19T06:08:49.984 INFO:tasks.workunit.client.0.smithi037.stdout:9/889: getdents da/dec/d116/d1b/d2f/d6f 0 2024-09-19T06:08:49.985 INFO:tasks.workunit.client.0.smithi037.stdout:6/792: symlink d9/dd/d1c/d4e/d65/de2/l103 0 2024-09-19T06:08:49.985 INFO:tasks.workunit.client.0.smithi037.stdout:6/793: write d9/dd/d1c/d4e/fcc [201400,106516] 0 2024-09-19T06:08:49.985 INFO:tasks.workunit.client.0.smithi037.stdout:6/794: readlink d9/dd/d20/lbb 0 2024-09-19T06:08:49.986 INFO:tasks.workunit.client.0.smithi037.stdout:1/704: dread d2/d12/d1e/d2a/d2e/f7f [0,4194304] 0 2024-09-19T06:08:49.986 INFO:tasks.workunit.client.0.smithi037.stdout:1/705: chown d2/d12/d1d/d47/le2 32915792 1 2024-09-19T06:08:49.986 INFO:tasks.workunit.client.0.smithi037.stdout:9/890: link da/dec/d116/d131/f78 da/dec/d116/d1b/d23/d6a/d82/f142 0 2024-09-19T06:08:49.986 INFO:tasks.workunit.client.0.smithi037.stdout:3/738: sync 2024-09-19T06:08:49.986 INFO:tasks.workunit.client.0.smithi037.stdout:8/867: sync 2024-09-19T06:08:49.987 INFO:tasks.workunit.client.0.smithi037.stdout:6/795: link d9/dd/d2b/ff4 d9/dd/d20/d5a/d6d/f104 0 2024-09-19T06:08:49.987 INFO:tasks.workunit.client.0.smithi037.stdout:6/796: fsync d9/dd/d1c/d4e/d33/f88 0 2024-09-19T06:08:49.988 INFO:tasks.workunit.client.0.smithi037.stdout:1/706: symlink d2/d12/d1e/d2a/lec 0 2024-09-19T06:08:49.988 INFO:tasks.workunit.client.0.smithi037.stdout:7/793: sync 2024-09-19T06:08:49.988 INFO:tasks.workunit.client.0.smithi037.stdout:5/729: sync 2024-09-19T06:08:49.988 INFO:tasks.workunit.client.0.smithi037.stdout:7/794: stat d6/dc/d22/f4c 0 2024-09-19T06:08:49.988 INFO:tasks.workunit.client.0.smithi037.stdout:5/730: truncate d2/d12/d28/d22/d4a/d9f/fb9 398204 0 2024-09-19T06:08:49.989 INFO:tasks.workunit.client.0.smithi037.stdout:9/891: creat da/dec/d116/d1b/d23/f143 x:0 0 0 2024-09-19T06:08:49.989 INFO:tasks.workunit.client.0.smithi037.stdout:4/793: sync 2024-09-19T06:08:49.990 INFO:tasks.workunit.client.0.smithi037.stdout:3/739: unlink d0/d5f/c97 0 2024-09-19T06:08:49.990 INFO:tasks.workunit.client.0.smithi037.stdout:7/795: dread d6/d20/d34/d7d/fce [0,4194304] 0 2024-09-19T06:08:49.991 INFO:tasks.workunit.client.0.smithi037.stdout:8/868: symlink d1/d61/d68/da3/l12d 0 2024-09-19T06:08:49.992 INFO:tasks.workunit.client.0.smithi037.stdout:6/797: getdents d9/dd/d2b/d42/dad 0 2024-09-19T06:08:49.992 INFO:tasks.workunit.client.0.smithi037.stdout:6/798: chown d9/dd/d20/d5a/d6d/fb1 16313 1 2024-09-19T06:08:49.993 INFO:tasks.workunit.client.0.smithi037.stdout:6/799: fdatasync d9/d78/fd1 0 2024-09-19T06:08:49.993 INFO:tasks.workunit.client.0.smithi037.stdout:1/707: creat d2/d12/d15/d34/d90/fed x:0 0 0 2024-09-19T06:08:49.994 INFO:tasks.workunit.client.0.smithi037.stdout:5/731: symlink d2/d12/d7e/ddf/le7 0 2024-09-19T06:08:49.994 INFO:tasks.workunit.client.0.smithi037.stdout:5/732: write d2/d10/da1/dac/fd6 [842332,130188] 0 2024-09-19T06:08:49.994 INFO:tasks.workunit.client.0.smithi037.stdout:5/733: fsync d2/d12/d24/f51 0 2024-09-19T06:08:49.994 INFO:tasks.workunit.client.0.smithi037.stdout:4/794: getdents d0/d8f 0 2024-09-19T06:08:49.994 INFO:tasks.workunit.client.0.smithi037.stdout:4/795: stat d0/d6/d1b/d20/d4d 0 2024-09-19T06:08:49.995 INFO:tasks.workunit.client.0.smithi037.stdout:7/796: mknod d6/d20/d4b/d60/cfb 0 2024-09-19T06:08:49.997 INFO:tasks.workunit.client.0.smithi037.stdout:6/800: unlink d9/dd/d1c/d4e/d65/db0/lb6 0 2024-09-19T06:08:49.997 INFO:tasks.workunit.client.0.smithi037.stdout:2/888: dwrite d1/d16/d4a/f8d [0,4194304] 0 2024-09-19T06:08:49.997 INFO:tasks.workunit.client.0.smithi037.stdout:2/889: write d1/d16/f1c [2084642,68981] 0 2024-09-19T06:08:49.997 INFO:tasks.workunit.client.0.smithi037.stdout:2/890: read d1/d6/f12 [2488460,74234] 0 2024-09-19T06:08:49.997 INFO:tasks.workunit.client.0.smithi037.stdout:5/734: mkdir d2/d12/d28/d22/d4a/d9f/de8 0 2024-09-19T06:08:49.998 INFO:tasks.workunit.client.0.smithi037.stdout:7/797: mknod d6/d20/d34/d49/cfc 0 2024-09-19T06:08:49.998 INFO:tasks.workunit.client.0.smithi037.stdout:7/798: chown d6/d20/d34/ff6 12446595 1 2024-09-19T06:08:49.998 INFO:tasks.workunit.client.0.smithi037.stdout:6/801: stat d9/dd/la7 0 2024-09-19T06:08:49.999 INFO:tasks.workunit.client.0.smithi037.stdout:2/891: rename d1/da/dc/d21/c5c to d1/da/d6e/d12e/c12f 0 2024-09-19T06:08:50.000 INFO:tasks.workunit.client.0.smithi037.stdout:5/735: creat d2/d12/fe9 x:0 0 0 2024-09-19T06:08:50.001 INFO:tasks.workunit.client.0.smithi037.stdout:7/799: link d6/dc/d22/d59/fe7 d6/dc/df/d7e/d99/ffd 0 2024-09-19T06:08:50.019 INFO:tasks.workunit.client.0.smithi037.stdout:1/708: dread d2/d12/d1d/d6b/fb0 [0,4194304] 0 2024-09-19T06:08:50.020 INFO:tasks.workunit.client.0.smithi037.stdout:9/892: read da/dec/d116/f50 [3292466,50583] 0 2024-09-19T06:08:50.021 INFO:tasks.workunit.client.0.smithi037.stdout:1/709: symlink d2/d12/d1d/lee 0 2024-09-19T06:08:50.021 INFO:tasks.workunit.client.0.smithi037.stdout:1/710: write d2/d12/d15/d34/f7c [237538,68556] 0 2024-09-19T06:08:50.022 INFO:tasks.workunit.client.0.smithi037.stdout:9/893: mknod da/dec/d116/d1b/d23/d6a/d8f/c144 0 2024-09-19T06:08:50.022 INFO:tasks.workunit.client.0.smithi037.stdout:9/894: dread - da/dec/d116/d1b/d23/d6a/d8f/f99 zero size 2024-09-19T06:08:50.023 INFO:tasks.workunit.client.0.smithi037.stdout:9/895: write da/d4d/dbb/fe8 [1128853,65510] 0 2024-09-19T06:08:50.023 INFO:tasks.workunit.client.0.smithi037.stdout:9/896: stat da/dec/d116/d1b/d2f/d6f/ffb 0 2024-09-19T06:08:50.025 INFO:tasks.workunit.client.0.smithi037.stdout:9/897: creat da/f145 x:0 0 0 2024-09-19T06:08:50.026 INFO:tasks.workunit.client.0.smithi037.stdout:9/898: chown da/dec/d116/d131/f78 161716952 1 2024-09-19T06:08:50.032 INFO:tasks.workunit.client.0.smithi037.stdout:6/802: dwrite d9/dd/d20/d5a/d6d/fb1 [0,4194304] 0 2024-09-19T06:08:50.036 INFO:tasks.workunit.client.0.smithi037.stdout:5/736: dwrite d2/d12/d28/d57/fb0 [8388608,4194304] 0 2024-09-19T06:08:50.036 INFO:tasks.workunit.client.0.smithi037.stdout:5/737: write d2/d12/d24/d58/d7f/fc2 [1059058,66712] 0 2024-09-19T06:08:50.037 INFO:tasks.workunit.client.0.smithi037.stdout:8/869: dread d1/d61/d7b/f99 [0,4194304] 0 2024-09-19T06:08:50.037 INFO:tasks.workunit.client.0.smithi037.stdout:3/740: dwrite d0/d16/d19/d1d/d7c/f85 [0,4194304] 0 2024-09-19T06:08:50.037 INFO:tasks.workunit.client.0.smithi037.stdout:2/892: dread d1/d16/f37 [0,4194304] 0 2024-09-19T06:08:50.037 INFO:tasks.workunit.client.0.smithi037.stdout:3/741: write d0/d16/d19/d1d/d5e/da9/db5/fe5 [760280,109395] 0 2024-09-19T06:08:50.040 INFO:tasks.workunit.client.0.smithi037.stdout:1/711: dread d2/d12/d1e/d2d/d6f/fc5 [0,4194304] 0 2024-09-19T06:08:50.044 INFO:tasks.workunit.client.0.smithi037.stdout:5/738: symlink d2/d12/d7e/ddf/lea 0 2024-09-19T06:08:50.044 INFO:tasks.workunit.client.0.smithi037.stdout:5/739: readlink d2/d12/d28/d22/d53/l6b 0 2024-09-19T06:08:50.046 INFO:tasks.workunit.client.0.smithi037.stdout:4/796: read d0/d2/d37/f5e [2788868,21929] 0 2024-09-19T06:08:50.046 INFO:tasks.workunit.client.0.smithi037.stdout:8/870: creat d1/d61/f12e x:0 0 0 2024-09-19T06:08:50.048 INFO:tasks.workunit.client.0.smithi037.stdout:2/893: getdents d1/da/dd7 0 2024-09-19T06:08:50.049 INFO:tasks.workunit.client.0.smithi037.stdout:3/742: truncate d0/d43/d23/d7a/fa8 3905325 0 2024-09-19T06:08:50.051 INFO:tasks.workunit.client.0.smithi037.stdout:1/712: rename d2/d12/d15/d34/faf to d2/d12/d1e/d2a/fef 0 2024-09-19T06:08:50.054 INFO:tasks.workunit.client.0.smithi037.stdout:5/740: unlink d2/d5c/c71 0 2024-09-19T06:08:50.055 INFO:tasks.workunit.client.0.smithi037.stdout:8/871: write d1/d6a/f7a [492504,11083] 0 2024-09-19T06:08:50.055 INFO:tasks.workunit.client.0.smithi037.stdout:8/872: write d1/d35/f73 [1710833,46558] 0 2024-09-19T06:08:50.055 INFO:tasks.workunit.client.0.smithi037.stdout:9/899: dwrite da/dec/d116/d1b/f4c [0,4194304] 0 2024-09-19T06:08:50.056 INFO:tasks.workunit.client.0.smithi037.stdout:2/894: mknod d1/d6/da3/d104/c130 0 2024-09-19T06:08:50.064 INFO:tasks.workunit.client.0.smithi037.stdout:9/900: creat da/d20/d11c/ddc/f146 x:0 0 0 2024-09-19T06:08:50.065 INFO:tasks.workunit.client.0.smithi037.stdout:9/901: getdents da/dec/d116/d1b/d43/de4 0 2024-09-19T06:08:50.069 INFO:tasks.workunit.client.0.smithi037.stdout:6/803: dwrite d9/dd/d20/d5a/dd2/de4/ffc [0,4194304] 0 2024-09-19T06:08:50.069 INFO:tasks.workunit.client.0.smithi037.stdout:6/804: fsync d9/dd/d1c/f41 0 2024-09-19T06:08:50.069 INFO:tasks.workunit.client.0.smithi037.stdout:6/805: write d9/dd/d2b/d79/f53 [3097540,44776] 0 2024-09-19T06:08:50.071 INFO:tasks.workunit.client.0.smithi037.stdout:2/895: write d1/da/d95/dce/f101 [401748,126668] 0 2024-09-19T06:08:50.072 INFO:tasks.workunit.client.0.smithi037.stdout:9/902: truncate da/f9a 3852579 0 2024-09-19T06:08:50.075 INFO:tasks.workunit.client.0.smithi037.stdout:2/896: rmdir d1/da/dc/d21/d7d/d80/dc7/d12d 0 2024-09-19T06:08:50.080 INFO:tasks.workunit.client.0.smithi037.stdout:2/897: symlink d1/l131 0 2024-09-19T06:08:50.088 INFO:tasks.workunit.client.0.smithi037.stdout:4/797: dwrite d0/d6/d45/dd9/d36/f4e [0,4194304] 0 2024-09-19T06:08:50.089 INFO:tasks.workunit.client.0.smithi037.stdout:3/743: dwrite d0/d16/d19/f3b [0,4194304] 0 2024-09-19T06:08:50.089 INFO:tasks.workunit.client.0.smithi037.stdout:3/744: read - d0/d43/d26/f5d zero size 2024-09-19T06:08:50.089 INFO:tasks.workunit.client.0.smithi037.stdout:3/745: chown d0/d43/d23/l6b 123225115 1 2024-09-19T06:08:50.089 INFO:tasks.workunit.client.0.smithi037.stdout:1/713: dwrite d2/d12/d1e/f4e [0,4194304] 0 2024-09-19T06:08:50.089 INFO:tasks.workunit.client.0.smithi037.stdout:1/714: dread - d2/d12/d1e/d2a/d8f/fa1 zero size 2024-09-19T06:08:50.089 INFO:tasks.workunit.client.0.smithi037.stdout:1/715: fsync d2/d12/d15/d5c/fdf 0 2024-09-19T06:08:50.091 INFO:tasks.workunit.client.0.smithi037.stdout:8/873: dwrite d1/d61/d7e/dbc/dc2/fd3 [4194304,4194304] 0 2024-09-19T06:08:50.091 INFO:tasks.workunit.client.0.smithi037.stdout:8/874: chown d1/d61/d7e/d8b/d91/fcf 1 1 2024-09-19T06:08:50.091 INFO:tasks.workunit.client.0.smithi037.stdout:8/875: stat d1/d35/d118/d123/l12c 0 2024-09-19T06:08:50.092 INFO:tasks.workunit.client.0.smithi037.stdout:1/716: link d2/d12/d17/l43 d2/d12/d1e/d75/d89/lf0 0 2024-09-19T06:08:50.096 INFO:tasks.workunit.client.0.smithi037.stdout:6/806: dwrite d9/dd/d2b/fa3 [0,4194304] 0 2024-09-19T06:08:50.097 INFO:tasks.workunit.client.0.smithi037.stdout:6/807: dread - d9/dd/d1c/d4e/f36 zero size 2024-09-19T06:08:50.097 INFO:tasks.workunit.client.0.smithi037.stdout:8/876: mkdir d1/d61/d7e/dbc/dc2/d59/d114/d12f 0 2024-09-19T06:08:50.100 INFO:tasks.workunit.client.0.smithi037.stdout:6/808: mknod d9/dd/d2b/d79/c105 0 2024-09-19T06:08:50.100 INFO:tasks.workunit.client.0.smithi037.stdout:8/877: mknod d1/d6a/c130 0 2024-09-19T06:08:50.101 INFO:tasks.workunit.client.0.smithi037.stdout:5/741: dread d2/d12/d24/d58/d7f/fc2 [0,4194304] 0 2024-09-19T06:08:50.102 INFO:tasks.workunit.client.0.smithi037.stdout:8/878: read d1/f6c [531908,51970] 0 2024-09-19T06:08:50.102 INFO:tasks.workunit.client.0.smithi037.stdout:6/809: read d9/dd/d20/d5a/d6d/f72 [35456,9013] 0 2024-09-19T06:08:50.104 INFO:tasks.workunit.client.0.smithi037.stdout:5/742: truncate d2/d12/f27 1041118 0 2024-09-19T06:08:50.105 INFO:tasks.workunit.client.0.smithi037.stdout:8/879: creat d1/d61/d7e/dbc/dc0/d113/f131 x:0 0 0 2024-09-19T06:08:50.107 INFO:tasks.workunit.client.0.smithi037.stdout:6/810: rename d9/dd/d2b/d42/fe0 to d9/dd/d2b/f106 0 2024-09-19T06:08:50.108 INFO:tasks.workunit.client.0.smithi037.stdout:2/898: dwrite d1/da/dc/d21/d51/f9c [0,4194304] 0 2024-09-19T06:08:50.109 INFO:tasks.workunit.client.0.smithi037.stdout:6/811: dread d9/d16/f8a [0,4194304] 0 2024-09-19T06:08:50.110 INFO:tasks.workunit.client.0.smithi037.stdout:4/798: dread d0/d6/d1b/d20/d4d/d64/f96 [0,4194304] 0 2024-09-19T06:08:50.110 INFO:tasks.workunit.client.0.smithi037.stdout:5/743: mknod d2/d12/ceb 0 2024-09-19T06:08:50.110 INFO:tasks.workunit.client.0.smithi037.stdout:8/880: creat d1/d61/d7e/d8b/d91/deb/f132 x:0 0 0 2024-09-19T06:08:50.113 INFO:tasks.workunit.client.0.smithi037.stdout:2/899: mkdir d1/da/dc/d21/d51/d132 0 2024-09-19T06:08:50.113 INFO:tasks.workunit.client.0.smithi037.stdout:2/900: write d1/da/dc/d21/d55/dbc/db0/de0/ffe [471708,33748] 0 2024-09-19T06:08:50.113 INFO:tasks.workunit.client.0.smithi037.stdout:5/744: chown d2/d12/d28/d22/d53/cc9 100 1 2024-09-19T06:08:50.114 INFO:tasks.workunit.client.0.smithi037.stdout:6/812: dread d9/d6e/fae [0,4194304] 0 2024-09-19T06:08:50.117 INFO:tasks.workunit.client.0.smithi037.stdout:6/813: mknod d9/dd/d1c/d73/c107 0 2024-09-19T06:08:50.117 INFO:tasks.workunit.client.0.smithi037.stdout:6/814: write d9/dd/d20/d5a/d6d/d82/d9f/fca [486828,42939] 0 2024-09-19T06:08:50.117 INFO:tasks.workunit.client.0.smithi037.stdout:6/815: dread - d9/d9c/fee zero size 2024-09-19T06:08:50.119 INFO:tasks.workunit.client.0.smithi037.stdout:3/746: dwrite d0/d16/d19/d1d/d7c/f91 [0,4194304] 0 2024-09-19T06:08:50.120 INFO:tasks.workunit.client.0.smithi037.stdout:6/816: link d9/dd/d20/d5a/d6d/f102 d9/d16/dcf/f108 0 2024-09-19T06:08:50.120 INFO:tasks.workunit.client.0.smithi037.stdout:6/817: truncate d9/dd/d20/d5a/d6d/d82/d9f/da4/f91 1381050 0 2024-09-19T06:08:50.129 INFO:tasks.workunit.client.0.smithi037.stdout:8/881: truncate d1/d61/d7e/dbc/dc2/fd3 3790430 0 2024-09-19T06:08:50.130 INFO:tasks.workunit.client.0.smithi037.stdout:1/717: dwrite d2/d12/d1d/f1f [0,4194304] 0 2024-09-19T06:08:50.137 INFO:tasks.workunit.client.0.smithi037.stdout:2/901: write d1/da/dc/d21/d55/dbc/fc8 [1389340,127976] 0 2024-09-19T06:08:50.140 INFO:tasks.workunit.client.0.smithi037.stdout:4/799: dwrite d0/d2/d37/d46/fdd [0,4194304] 0 2024-09-19T06:08:50.140 INFO:tasks.workunit.client.0.smithi037.stdout:4/800: write d0/d6/d1b/f3f [3511409,118485] 0 2024-09-19T06:08:50.149 INFO:tasks.workunit.client.0.smithi037.stdout:8/882: dread d1/d35/f73 [0,4194304] 0 2024-09-19T06:08:50.152 INFO:tasks.workunit.client.0.smithi037.stdout:8/883: mkdir d1/d61/d7e/dbc/d133 0 2024-09-19T06:08:50.152 INFO:tasks.workunit.client.0.smithi037.stdout:8/884: truncate d1/dc8/ffb 712289 0 2024-09-19T06:08:50.152 INFO:tasks.workunit.client.0.smithi037.stdout:8/885: dread - d1/d61/d7e/dbc/dc2/d59/daf/f11b zero size 2024-09-19T06:08:50.158 INFO:tasks.workunit.client.0.smithi037.stdout:4/801: dread d0/d6/d45/dd9/d36/f47 [0,4194304] 0 2024-09-19T06:08:50.162 INFO:tasks.workunit.client.0.smithi037.stdout:1/718: dwrite d2/f8 [0,4194304] 0 2024-09-19T06:08:50.165 INFO:tasks.workunit.client.0.smithi037.stdout:2/902: dread d1/d16/f37 [0,4194304] 0 2024-09-19T06:08:50.165 INFO:tasks.workunit.client.0.smithi037.stdout:3/747: dwrite d0/d43/d23/d7a/fa8 [0,4194304] 0 2024-09-19T06:08:50.171 INFO:tasks.workunit.client.0.smithi037.stdout:5/745: write d2/d12/d28/d57/f73 [2354139,53589] 0 2024-09-19T06:08:50.172 INFO:tasks.workunit.client.0.smithi037.stdout:6/818: dwrite d9/dd/d20/d5a/d6d/d82/d9f/da4/fbe [0,4194304] 0 2024-09-19T06:08:50.173 INFO:tasks.workunit.client.0.smithi037.stdout:4/802: dread d0/d6/d1b/f55 [0,4194304] 0 2024-09-19T06:08:50.173 INFO:tasks.workunit.client.0.smithi037.stdout:4/803: write d0/d6/d1b/d20/d4d/d64/db0/ff5 [207926,59144] 0 2024-09-19T06:08:50.173 INFO:tasks.workunit.client.0.smithi037.stdout:4/804: readlink d0/d6/d1b/d20/d4d/d64/lb6 0 2024-09-19T06:08:50.173 INFO:tasks.workunit.client.0.smithi037.stdout:4/805: chown d0/d6/d1b/d20/cca 201 1 2024-09-19T06:08:50.174 INFO:tasks.workunit.client.0.smithi037.stdout:4/806: chown d0/f27 332589 1 2024-09-19T06:08:50.174 INFO:tasks.workunit.client.0.smithi037.stdout:2/903: link d1/d6/da3/da8/dbe/cd2 d1/da/d6e/d12e/c133 0 2024-09-19T06:08:50.177 INFO:tasks.workunit.client.0.smithi037.stdout:6/819: symlink d9/dd/d2b/d79/dd3/l109 0 2024-09-19T06:08:50.177 INFO:tasks.workunit.client.0.smithi037.stdout:6/820: truncate d9/d16/dc5/ffb 656168 0 2024-09-19T06:08:50.177 INFO:tasks.workunit.client.0.smithi037.stdout:4/807: rmdir d0/d2/d37/d46/de5/d86 39 2024-09-19T06:08:50.178 INFO:tasks.workunit.client.0.smithi037.stdout:2/904: mknod d1/d16/d4a/c134 0 2024-09-19T06:08:50.179 INFO:tasks.workunit.client.0.smithi037.stdout:4/808: link d0/d2/d37/d46/de5/f6c d0/d2/d37/d46/de5/d6f/d8e/ffd 0 2024-09-19T06:08:50.183 INFO:tasks.workunit.client.0.smithi037.stdout:8/886: dwrite d1/d61/d7e/dbc/dc2/d59/daf/fb3 [0,4194304] 0 2024-09-19T06:08:50.183 INFO:tasks.workunit.client.0.smithi037.stdout:8/887: read d1/d61/d7e/dbc/dc2/d9b/f120 [1062968,78291] 0 2024-09-19T06:08:50.186 INFO:tasks.workunit.client.0.smithi037.stdout:8/888: dread d1/d61/d7e/dbc/dc2/d59/d5d/f75 [0,4194304] 0 2024-09-19T06:08:50.193 INFO:tasks.workunit.client.0.smithi037.stdout:2/905: rename d1/d16/d96/c9a to d1/d9e/d118/c135 0 2024-09-19T06:08:50.195 INFO:tasks.workunit.client.0.smithi037.stdout:6/821: read d9/dd/d2b/ff4 [424881,17446] 0 2024-09-19T06:08:50.195 INFO:tasks.workunit.client.0.smithi037.stdout:5/746: write d2/fd [589369,39538] 0 2024-09-19T06:08:50.205 INFO:tasks.workunit.client.0.smithi037.stdout:4/809: dwrite d0/d2/d37/f5e [0,4194304] 0 2024-09-19T06:08:50.205 INFO:tasks.workunit.client.0.smithi037.stdout:4/810: write d0/d6/d1b/d20/f62 [1146719,3756] 0 2024-09-19T06:08:50.205 INFO:tasks.workunit.client.0.smithi037.stdout:4/811: stat d0/d2/d37/d46/de5/d86 0 2024-09-19T06:08:50.205 INFO:tasks.workunit.client.0.smithi037.stdout:3/748: dwrite d0/d43/d23/f69 [4194304,4194304] 0 2024-09-19T06:08:50.205 INFO:tasks.workunit.client.0.smithi037.stdout:3/749: dread - d0/d5f/ff6 zero size 2024-09-19T06:08:50.205 INFO:tasks.workunit.client.0.smithi037.stdout:3/750: fdatasync d0/d16/d19/d1d/f3d 0 2024-09-19T06:08:50.205 INFO:tasks.workunit.client.0.smithi037.stdout:3/751: chown d0/d16/da6/cbb 111563275 1 2024-09-19T06:08:50.208 INFO:tasks.workunit.client.0.smithi037.stdout:6/822: creat d9/dd/d1c/d73/f10a x:0 0 0 2024-09-19T06:08:50.208 INFO:tasks.workunit.client.0.smithi037.stdout:6/823: stat d9/d6e/f8f 0 2024-09-19T06:08:50.212 INFO:tasks.workunit.client.0.smithi037.stdout:4/812: link d0/d6/d1b/d5d/l81 d0/d6/lfe 0 2024-09-19T06:08:50.212 INFO:tasks.workunit.client.0.smithi037.stdout:4/813: chown d0/d6/d1b/d20/d48/fa6 0 1 2024-09-19T06:08:50.212 INFO:tasks.workunit.client.0.smithi037.stdout:4/814: read - d0/d6/fe2 zero size 2024-09-19T06:08:50.213 INFO:tasks.workunit.client.0.smithi037.stdout:6/824: mknod d9/dd/d1c/d73/ddb/c10b 0 2024-09-19T06:08:50.224 INFO:tasks.workunit.client.0.smithi037.stdout:5/747: dwrite d2/d10/f21 [0,4194304] 0 2024-09-19T06:08:50.227 INFO:tasks.workunit.client.0.smithi037.stdout:5/748: write d2/d12/d28/d22/d35/dae/fc3 [5061768,33092] 0 2024-09-19T06:08:50.231 INFO:tasks.workunit.client.0.smithi037.stdout:5/749: link d2/d12/d24/f70 d2/d12/d28/d22/d4a/d9f/fec 0 2024-09-19T06:08:50.231 INFO:tasks.workunit.client.0.smithi037.stdout:5/750: fsync d2/d12/d28/d22/d4a/fcd 0 2024-09-19T06:08:50.240 INFO:tasks.workunit.client.0.smithi037.stdout:6/825: dwrite d9/dd/d20/d5a/d6d/d82/da9/ff5 [0,4194304] 0 2024-09-19T06:08:50.253 INFO:tasks.workunit.client.0.smithi037.stdout:5/751: dwrite d2/d10/da1/dac/fd6 [0,4194304] 0 2024-09-19T06:08:50.256 INFO:tasks.workunit.client.0.smithi037.stdout:6/826: read d9/dd/d2b/f7c [3170401,56399] 0 2024-09-19T06:08:50.256 INFO:tasks.workunit.client.0.smithi037.stdout:6/827: write d9/dd/d1c/d73/f86 [311173,61774] 0 2024-09-19T06:08:50.259 INFO:tasks.workunit.client.0.smithi037.stdout:6/828: write d9/dd/d20/d5a/d6d/d82/d9f/fb8 [199893,39243] 0 2024-09-19T06:08:50.268 INFO:tasks.workunit.client.0.smithi037.stdout:6/829: dread d9/dd/d2b/d79/f63 [0,4194304] 0 2024-09-19T06:08:50.284 INFO:tasks.workunit.client.0.smithi037.stdout:2/906: dwrite d1/da/dc/d21/d55/dbc/db0/fc0 [0,4194304] 0 2024-09-19T06:08:50.284 INFO:tasks.workunit.client.0.smithi037.stdout:2/907: chown d1/d9e/fdc 787001046 1 2024-09-19T06:08:50.284 INFO:tasks.workunit.client.0.smithi037.stdout:2/908: chown d1/d16/l44 1623795 1 2024-09-19T06:08:50.291 INFO:tasks.workunit.client.0.smithi037.stdout:2/909: creat d1/da/dc/d11e/f136 x:0 0 0 2024-09-19T06:08:50.292 INFO:tasks.workunit.client.0.smithi037.stdout:2/910: rmdir d1/d6/da3/da8/dbe 39 2024-09-19T06:08:50.296 INFO:tasks.workunit.client.0.smithi037.stdout:4/815: dread d0/d6/f67 [4194304,4194304] 0 2024-09-19T06:08:50.296 INFO:tasks.workunit.client.0.smithi037.stdout:4/816: write d0/d6/d1b/d20/d48/fda [2950473,27808] 0 2024-09-19T06:08:50.297 INFO:tasks.workunit.client.0.smithi037.stdout:6/830: rmdir d9/dd/d1c/d4e/d33 39 2024-09-19T06:08:50.299 INFO:tasks.workunit.client.0.smithi037.stdout:6/831: unlink d9/dd/d1c/d4e/d33/fa2 0 2024-09-19T06:08:50.300 INFO:tasks.workunit.client.0.smithi037.stdout:4/817: dread d0/d6/d1b/d20/d77/fad [0,4194304] 0 2024-09-19T06:08:50.301 INFO:tasks.workunit.client.0.smithi037.stdout:4/818: creat d0/d2/d37/d46/de5/de1/fff x:0 0 0 2024-09-19T06:08:50.303 INFO:tasks.workunit.client.0.smithi037.stdout:4/819: link d0/d6/d1b/d20/d4d/d65/fcd d0/d6/d1b/d20/d48/da7/f100 0 2024-09-19T06:08:50.314 INFO:tasks.workunit.client.0.smithi037.stdout:6/832: rmdir d9/d6e 39 2024-09-19T06:08:50.314 INFO:tasks.workunit.client.0.smithi037.stdout:6/833: chown d9/dd/d1c/f2e 30 1 2024-09-19T06:08:50.317 INFO:tasks.workunit.client.0.smithi037.stdout:6/834: rename d9/dd/d20 to d9/d6e/d10c 0 2024-09-19T06:08:50.318 INFO:tasks.workunit.client.0.smithi037.stdout:6/835: creat d9/dd/f10d x:0 0 0 2024-09-19T06:08:50.319 INFO:tasks.workunit.client.0.smithi037.stdout:4/820: dread d0/d6/d1b/d20/d4d/d64/f99 [0,4194304] 0 2024-09-19T06:08:50.320 INFO:tasks.workunit.client.0.smithi037.stdout:4/821: truncate d0/d6/d45/dd9/d36/f63 3384034 0 2024-09-19T06:08:50.332 INFO:tasks.workunit.client.0.smithi037.stdout:8/889: mkdir d1/d61/d7e/d134 0 2024-09-19T06:08:50.334 INFO:tasks.workunit.client.0.smithi037.stdout:8/890: truncate d1/d61/d7e/dbc/dc2/fd3 3568815 0 2024-09-19T06:08:50.334 INFO:tasks.workunit.client.0.smithi037.stdout:8/891: write d1/d61/d7e/dbc/dc2/d59/d5d/f105 [797,26723] 0 2024-09-19T06:08:50.334 INFO:tasks.workunit.client.0.smithi037.stdout:8/892: fdatasync d1/d61/d7e/dbc/dc2/daa/fca 0 2024-09-19T06:08:50.334 INFO:tasks.workunit.client.0.smithi037.stdout:8/893: mknod d1/d61/d7e/d8b/d9f/c135 0 2024-09-19T06:08:50.336 INFO:tasks.workunit.client.0.smithi037.stdout:8/894: rename d1/d61/d7e/dbc/dc2 to d1/d6a/d136 0 2024-09-19T06:08:50.345 INFO:tasks.workunit.client.0.smithi037.stdout:0/792: sync 2024-09-19T06:08:50.345 INFO:tasks.workunit.client.0.smithi037.stdout:7/800: sync 2024-09-19T06:08:50.346 INFO:tasks.workunit.client.0.smithi037.stdout:5/752: dwrite d2/d5c/f60 [0,4194304] 0 2024-09-19T06:08:50.347 INFO:tasks.workunit.client.0.smithi037.stdout:0/793: truncate d5/d8/d22/d89/de7/ff2 2493665 0 2024-09-19T06:08:50.347 INFO:tasks.workunit.client.0.smithi037.stdout:4/822: dwrite d0/d6/d1b/d20/f95 [0,4194304] 0 2024-09-19T06:08:50.347 INFO:tasks.workunit.client.0.smithi037.stdout:4/823: readlink d0/d6/l87 0 2024-09-19T06:08:50.347 INFO:tasks.workunit.client.0.smithi037.stdout:4/824: truncate d0/d6/d1b/d20/d4d/d65/fec 1376902 0 2024-09-19T06:08:50.348 INFO:tasks.workunit.client.0.smithi037.stdout:8/895: write d1/d61/d7e/d8b/f98 [112083,59152] 0 2024-09-19T06:08:50.349 INFO:tasks.workunit.client.0.smithi037.stdout:0/794: read d5/d8/d11/f3e [319524,105528] 0 2024-09-19T06:08:50.349 INFO:tasks.workunit.client.0.smithi037.stdout:5/753: link d2/d10/l8c d2/d12/d24/d97/dbc/led 0 2024-09-19T06:08:50.350 INFO:tasks.workunit.client.0.smithi037.stdout:4/825: rmdir d0/d6/d1b 39 2024-09-19T06:08:50.351 INFO:tasks.workunit.client.0.smithi037.stdout:8/896: link d1/d61/dd5/c11a d1/dc8/c137 0 2024-09-19T06:08:50.351 INFO:tasks.workunit.client.0.smithi037.stdout:8/897: stat d1/d61/d7e/d8b/d91/l47 0 2024-09-19T06:08:50.352 INFO:tasks.workunit.client.0.smithi037.stdout:0/795: mknod d5/d8/d79/d9a/c110 0 2024-09-19T06:08:50.352 INFO:tasks.workunit.client.0.smithi037.stdout:0/796: dread - d5/d8/f70 zero size 2024-09-19T06:08:50.353 INFO:tasks.workunit.client.0.smithi037.stdout:5/754: truncate d2/d12/d24/d58/d7f/fc2 316441 0 2024-09-19T06:08:50.354 INFO:tasks.workunit.client.0.smithi037.stdout:4/826: mkdir d0/d6/d1b/d20/d101 0 2024-09-19T06:08:50.354 INFO:tasks.workunit.client.0.smithi037.stdout:4/827: write d0/d2/d37/f90 [219346,95622] 0 2024-09-19T06:08:50.355 INFO:tasks.workunit.client.0.smithi037.stdout:5/755: symlink d2/d12/d7e/lee 0 2024-09-19T06:08:50.356 INFO:tasks.workunit.client.0.smithi037.stdout:4/828: rmdir d0/d6/d1b/d20/d4d/d65 39 2024-09-19T06:08:50.357 INFO:tasks.workunit.client.0.smithi037.stdout:4/829: creat d0/d2/d37/d46/de5/f102 x:0 0 0 2024-09-19T06:08:50.360 INFO:tasks.workunit.client.0.smithi037.stdout:4/830: dread d0/d6/d1b/d20/d4d/d64/db0/ff5 [0,4194304] 0 2024-09-19T06:08:50.360 INFO:tasks.workunit.client.0.smithi037.stdout:4/831: chown d0/d2/d37/d46/de5/de1 1076722 1 2024-09-19T06:08:50.361 INFO:tasks.workunit.client.0.smithi037.stdout:4/832: mkdir d0/d6/d103 0 2024-09-19T06:08:50.370 INFO:tasks.workunit.client.0.smithi037.stdout:0/797: dread d5/d20/faa [0,4194304] 0 2024-09-19T06:08:50.372 INFO:tasks.workunit.client.0.smithi037.stdout:0/798: mkdir d5/d18/d68/d85/d111 0 2024-09-19T06:08:50.372 INFO:tasks.workunit.client.0.smithi037.stdout:0/799: fsync d5/d17/fad 0 2024-09-19T06:08:50.379 INFO:tasks.workunit.client.0.smithi037.stdout:8/898: dwrite d1/d6a/d136/d59/f9e [4194304,4194304] 0 2024-09-19T06:08:50.379 INFO:tasks.workunit.client.0.smithi037.stdout:8/899: rename d1/d61/d7e/dbc to d1/d61/d7e/dbc/dc0/d113/d138 22 2024-09-19T06:08:50.379 INFO:tasks.workunit.client.0.smithi037.stdout:8/900: chown d1/d61/l93 2 1 2024-09-19T06:08:50.379 INFO:tasks.workunit.client.0.smithi037.stdout:8/901: write d1/d61/d7e/d8b/d91/deb/f132 [907388,31385] 0 2024-09-19T06:08:50.381 INFO:tasks.workunit.client.0.smithi037.stdout:7/801: dwrite d6/f3a [0,4194304] 0 2024-09-19T06:08:50.381 INFO:tasks.workunit.client.0.smithi037.stdout:8/902: rename d1/d6a/d136/fe9 to d1/d61/d7e/d8b/d91/d3d/f139 0 2024-09-19T06:08:50.383 INFO:tasks.workunit.client.0.smithi037.stdout:8/903: symlink d1/d61/d7e/dbc/dc0/df5/l13a 0 2024-09-19T06:08:50.384 INFO:tasks.workunit.client.0.smithi037.stdout:8/904: chown d1/d61/d7e/dbc/f121 20 1 2024-09-19T06:08:50.385 INFO:tasks.workunit.client.0.smithi037.stdout:8/905: mkdir d1/d61/d7e/d8b/d91/d3d/d13b 0 2024-09-19T06:08:50.385 INFO:tasks.workunit.client.0.smithi037.stdout:8/906: write d1/d6a/d136/d59/d5d/f7c [4065560,20551] 0 2024-09-19T06:08:50.385 INFO:tasks.workunit.client.0.smithi037.stdout:8/907: read d1/dc7/ff3 [563625,101708] 0 2024-09-19T06:08:50.385 INFO:tasks.workunit.client.0.smithi037.stdout:7/802: write d6/d21/f52 [313572,9975] 0 2024-09-19T06:08:50.387 INFO:tasks.workunit.client.0.smithi037.stdout:8/908: link d1/d61/l92 d1/d61/d7e/d8b/d91/l13c 0 2024-09-19T06:08:50.391 INFO:tasks.workunit.client.0.smithi037.stdout:7/803: write d6/dc/f77 [182080,112489] 0 2024-09-19T06:08:50.391 INFO:tasks.workunit.client.0.smithi037.stdout:7/804: write d6/dc/d22/d59/da8/dc4/fdb [244823,18468] 0 2024-09-19T06:08:50.393 INFO:tasks.workunit.client.0.smithi037.stdout:7/805: rename d6/d20/d34/d7d/f9e to d6/d20/d4b/d60/d33/d8c/ffe 0 2024-09-19T06:08:50.393 INFO:tasks.workunit.client.0.smithi037.stdout:7/806: dread - d6/d20/d34/ff6 zero size 2024-09-19T06:08:50.394 INFO:tasks.workunit.client.0.smithi037.stdout:7/807: creat d6/dc/daf/de6/fff x:0 0 0 2024-09-19T06:08:50.395 INFO:tasks.workunit.client.0.smithi037.stdout:7/808: rename d6/d20/d71/dbb to d6/d20/d34/d49/d100 0 2024-09-19T06:08:50.396 INFO:tasks.workunit.client.0.smithi037.stdout:7/809: symlink d6/d20/d34/d97/l101 0 2024-09-19T06:08:50.398 INFO:tasks.workunit.client.0.smithi037.stdout:5/756: dwrite d2/f7a [0,4194304] 0 2024-09-19T06:08:50.398 INFO:tasks.workunit.client.0.smithi037.stdout:0/800: dwrite d5/d8/d79/d9a/ddb/d106/daf/fd2 [0,4194304] 0 2024-09-19T06:08:50.399 INFO:tasks.workunit.client.0.smithi037.stdout:5/757: creat d2/d12/d28/d22/d53/fef x:0 0 0 2024-09-19T06:08:50.400 INFO:tasks.workunit.client.0.smithi037.stdout:0/801: rmdir d5/d17 39 2024-09-19T06:08:50.402 INFO:tasks.workunit.client.0.smithi037.stdout:4/833: dwrite d0/d6/d1b/d20/d4d/d64/f99 [0,4194304] 0 2024-09-19T06:08:50.402 INFO:tasks.workunit.client.0.smithi037.stdout:4/834: write d0/d6/d1b/d20/d4d/d65/f7b [1718277,37723] 0 2024-09-19T06:08:50.402 INFO:tasks.workunit.client.0.smithi037.stdout:4/835: truncate d0/d6/d1b/d30/dee/ff4 141810 0 2024-09-19T06:08:50.403 INFO:tasks.workunit.client.0.smithi037.stdout:5/758: rename d2/d12/d7e/lee to d2/d5c/dda/lf0 0 2024-09-19T06:08:50.403 INFO:tasks.workunit.client.0.smithi037.stdout:5/759: read - d2/d12/d28/d22/d4a/d9f/fa2 zero size 2024-09-19T06:08:50.403 INFO:tasks.workunit.client.0.smithi037.stdout:0/802: creat d5/d8/d22/d89/d96/dc5/f112 x:0 0 0 2024-09-19T06:08:50.404 INFO:tasks.workunit.client.0.smithi037.stdout:0/803: stat d5/d8/d44/d10f 0 2024-09-19T06:08:50.407 INFO:tasks.workunit.client.0.smithi037.stdout:0/804: rename d5/d42/lc4 to d5/d8/d44/d61/l113 0 2024-09-19T06:08:50.409 INFO:tasks.workunit.client.0.smithi037.stdout:0/805: mkdir d5/d8/d22/d89/d96/dae/d114 0 2024-09-19T06:08:50.409 INFO:tasks.workunit.client.0.smithi037.stdout:0/806: dread - d5/d8/d44/f71 zero size 2024-09-19T06:08:50.409 INFO:tasks.workunit.client.0.smithi037.stdout:0/807: truncate d5/fd6 1117656 0 2024-09-19T06:08:50.409 INFO:tasks.workunit.client.0.smithi037.stdout:0/808: chown d5/d8/d11/f16 0 1 2024-09-19T06:08:50.411 INFO:tasks.workunit.client.0.smithi037.stdout:0/809: creat d5/d18/d68/d85/d111/f115 x:0 0 0 2024-09-19T06:08:50.411 INFO:tasks.workunit.client.0.smithi037.stdout:0/810: fdatasync d5/dd5/de9/d21/f29 0 2024-09-19T06:08:50.411 INFO:tasks.workunit.client.0.smithi037.stdout:0/811: chown d5/dd5/de9/d8d/f10d 406 1 2024-09-19T06:08:50.411 INFO:tasks.workunit.client.0.smithi037.stdout:0/812: write d5/d17/fa5 [1179603,14531] 0 2024-09-19T06:08:50.413 INFO:tasks.workunit.client.0.smithi037.stdout:0/813: rename d5/dd5/de9/d21/d4e/fa8 to d5/d8/d22/d89/da9/f116 0 2024-09-19T06:08:50.413 INFO:tasks.workunit.client.0.smithi037.stdout:0/814: chown d5/d8/d44/d10f 652623 1 2024-09-19T06:08:50.413 INFO:tasks.workunit.client.0.smithi037.stdout:0/815: write d5/d8/d22/d89/de7/ff2 [2560266,124606] 0 2024-09-19T06:08:50.413 INFO:tasks.workunit.client.0.smithi037.stdout:0/816: write d5/d8/d11/f78 [1985865,128662] 0 2024-09-19T06:08:50.414 INFO:tasks.workunit.client.0.smithi037.stdout:0/817: creat d5/d18/d68/d85/dab/dba/f117 x:0 0 0 2024-09-19T06:08:50.417 INFO:tasks.workunit.client.0.smithi037.stdout:0/818: rename d5/d20/d34 to d5/dd5/de9/d21/d118 0 2024-09-19T06:08:50.417 INFO:tasks.workunit.client.0.smithi037.stdout:0/819: fsync d5/f7 0 2024-09-19T06:08:50.419 INFO:tasks.workunit.client.0.smithi037.stdout:0/820: getdents d5/dd5/de9 0 2024-09-19T06:08:50.419 INFO:tasks.workunit.client.0.smithi037.stdout:8/909: dwrite d1/d6a/d136/daa/fca [4194304,4194304] 0 2024-09-19T06:08:50.420 INFO:tasks.workunit.client.0.smithi037.stdout:0/821: rmdir d5/dd5/de9 39 2024-09-19T06:08:50.422 INFO:tasks.workunit.client.0.smithi037.stdout:0/822: creat d5/d18/d68/d85/dab/f119 x:0 0 0 2024-09-19T06:08:50.422 INFO:tasks.workunit.client.0.smithi037.stdout:0/823: readlink d5/d17/l7e 0 2024-09-19T06:08:50.422 INFO:tasks.workunit.client.0.smithi037.stdout:0/824: chown d5/dd5/de9/d21/d118/f74 221925245 1 2024-09-19T06:08:50.424 INFO:tasks.workunit.client.0.smithi037.stdout:0/825: rename d5/d8/d44/l5c to d5/dd5/de9/d21/d118/l11a 0 2024-09-19T06:08:50.424 INFO:tasks.workunit.client.0.smithi037.stdout:7/810: dwrite d6/d20/d34/f9a [0,4194304] 0 2024-09-19T06:08:50.425 INFO:tasks.workunit.client.0.smithi037.stdout:0/826: creat d5/dd5/de9/d21/f11b x:0 0 0 2024-09-19T06:08:50.428 INFO:tasks.workunit.client.0.smithi037.stdout:0/827: creat d5/d8/d79/f11c x:0 0 0 2024-09-19T06:08:50.429 INFO:tasks.workunit.client.0.smithi037.stdout:0/828: dread - d5/d18/d68/d85/dab/dba/f117 zero size 2024-09-19T06:08:50.429 INFO:tasks.workunit.client.0.smithi037.stdout:0/829: creat d5/f11d x:0 0 0 2024-09-19T06:08:50.430 INFO:tasks.workunit.client.0.smithi037.stdout:0/830: mknod d5/d8/d22/d89/d96/c11e 0 2024-09-19T06:08:50.431 INFO:tasks.workunit.client.0.smithi037.stdout:5/760: write d2/d12/d28/d22/f3c [2887277,102020] 0 2024-09-19T06:08:50.431 INFO:tasks.workunit.client.0.smithi037.stdout:4/836: dwrite d0/d6/d1b/f5f [0,4194304] 0 2024-09-19T06:08:50.431 INFO:tasks.workunit.client.0.smithi037.stdout:5/761: chown d2/d12/d24/d58/d96/l9b 166828 1 2024-09-19T06:08:50.431 INFO:tasks.workunit.client.0.smithi037.stdout:4/837: fsync d0/d2/d37/d46/de5/f84 0 2024-09-19T06:08:50.432 INFO:tasks.workunit.client.0.smithi037.stdout:0/831: unlink d5/dd5/de9/d21/c9e 0 2024-09-19T06:08:50.434 INFO:tasks.workunit.client.0.smithi037.stdout:5/762: write d2/d12/d28/d22/fc1 [990744,96125] 0 2024-09-19T06:08:50.434 INFO:tasks.workunit.client.0.smithi037.stdout:5/763: chown d2/d12/d24/d58/d8e/fd2 3 1 2024-09-19T06:08:50.434 INFO:tasks.workunit.client.0.smithi037.stdout:5/764: chown d2/d10/f21 1020 1 2024-09-19T06:08:50.435 INFO:tasks.workunit.client.0.smithi037.stdout:4/838: mkdir d0/d2/d37/d46/de5/de1/d104 0 2024-09-19T06:08:50.435 INFO:tasks.workunit.client.0.smithi037.stdout:4/839: fdatasync d0/d6/d1b/d20/d4d/d65/faf 0 2024-09-19T06:08:50.436 INFO:tasks.workunit.client.0.smithi037.stdout:0/832: mkdir d5/d8/d22/d89/d96/dc5/d11f 0 2024-09-19T06:08:50.436 INFO:tasks.workunit.client.0.smithi037.stdout:0/833: fdatasync d5/d42/f50 0 2024-09-19T06:08:50.438 INFO:tasks.workunit.client.0.smithi037.stdout:5/765: rename d2/d12/d28/le5 to d2/d5c/lf1 0 2024-09-19T06:08:50.439 INFO:tasks.workunit.client.0.smithi037.stdout:4/840: creat d0/d2/d37/d46/de5/d6f/da9/f105 x:0 0 0 2024-09-19T06:08:50.444 INFO:tasks.workunit.client.0.smithi037.stdout:8/910: dwrite d1/d61/d7e/ff9 [0,4194304] 0 2024-09-19T06:08:50.444 INFO:tasks.workunit.client.0.smithi037.stdout:8/911: chown d1/dc8/l10b 35 1 2024-09-19T06:08:50.444 INFO:tasks.workunit.client.0.smithi037.stdout:8/912: chown d1/d61/d7e/d8b/d91/l47 0 1 2024-09-19T06:08:50.444 INFO:tasks.workunit.client.0.smithi037.stdout:8/913: fdatasync d1/d35/fb4 0 2024-09-19T06:08:50.445 INFO:tasks.workunit.client.0.smithi037.stdout:8/914: creat d1/d61/dd5/f13d x:0 0 0 2024-09-19T06:08:50.445 INFO:tasks.workunit.client.0.smithi037.stdout:8/915: dread - d1/d61/dd5/d125/f12b zero size 2024-09-19T06:08:50.446 INFO:tasks.workunit.client.0.smithi037.stdout:8/916: link d1/d61/d7e/d8b/d91/fcf d1/d61/d7e/f13e 0 2024-09-19T06:08:50.446 INFO:tasks.workunit.client.0.smithi037.stdout:8/917: fdatasync d1/d6a/d136/d9b/f120 0 2024-09-19T06:08:50.446 INFO:tasks.workunit.client.0.smithi037.stdout:8/918: dread - d1/d6a/d136/d59/daf/f11b zero size 2024-09-19T06:08:50.447 INFO:tasks.workunit.client.0.smithi037.stdout:8/919: getdents d1/dc8 0 2024-09-19T06:08:50.448 INFO:tasks.workunit.client.0.smithi037.stdout:7/811: dwrite d6/dc/ff9 [0,4194304] 0 2024-09-19T06:08:50.451 INFO:tasks.workunit.client.0.smithi037.stdout:7/812: creat d6/d20/d4b/d60/d33/d8c/f102 x:0 0 0 2024-09-19T06:08:50.452 INFO:tasks.workunit.client.0.smithi037.stdout:7/813: creat d6/dc/d22/d59/da8/dc4/f103 x:0 0 0 2024-09-19T06:08:50.453 INFO:tasks.workunit.client.0.smithi037.stdout:7/814: creat d6/d20/d71/de1/f104 x:0 0 0 2024-09-19T06:08:50.454 INFO:tasks.workunit.client.0.smithi037.stdout:7/815: mkdir d6/d20/d34/dc0/dcf/d105 0 2024-09-19T06:08:50.456 INFO:tasks.workunit.client.0.smithi037.stdout:7/816: rename d6/dc/df/c56 to d6/dc/df/c106 0 2024-09-19T06:08:50.457 INFO:tasks.workunit.client.0.smithi037.stdout:5/766: dread d2/d12/d24/f95 [0,4194304] 0 2024-09-19T06:08:50.458 INFO:tasks.workunit.client.0.smithi037.stdout:5/767: chown d2/d12/d24/d58/d96/dd7/cc8 83057 1 2024-09-19T06:08:50.458 INFO:tasks.workunit.client.0.smithi037.stdout:5/768: write d2/d12/d24/d58/d8e/f94 [5234537,89762] 0 2024-09-19T06:08:50.458 INFO:tasks.workunit.client.0.smithi037.stdout:7/817: unlink d6/dc/f77 0 2024-09-19T06:08:50.458 INFO:tasks.workunit.client.0.smithi037.stdout:7/818: write d6/f2b [6101775,97723] 0 2024-09-19T06:08:50.458 INFO:tasks.workunit.client.0.smithi037.stdout:7/819: readlink d6/dc/df/d7e/ld2 0 2024-09-19T06:08:50.458 INFO:tasks.workunit.client.0.smithi037.stdout:7/820: read - d6/d20/d34/dc0/fd8 zero size 2024-09-19T06:08:50.460 INFO:tasks.workunit.client.0.smithi037.stdout:7/821: link d6/dc/d22/f36 d6/dc/daf/f107 0 2024-09-19T06:08:50.463 INFO:tasks.workunit.client.0.smithi037.stdout:7/822: creat d6/d20/d4b/f108 x:0 0 0 2024-09-19T06:08:50.463 INFO:tasks.workunit.client.0.smithi037.stdout:7/823: dread - d6/d20/d4b/d60/d33/fab zero size 2024-09-19T06:08:50.463 INFO:tasks.workunit.client.0.smithi037.stdout:7/824: write d6/dc/d22/f3b [964190,129278] 0 2024-09-19T06:08:50.465 INFO:tasks.workunit.client.0.smithi037.stdout:0/834: write d5/d17/f58 [2100918,99462] 0 2024-09-19T06:08:50.466 INFO:tasks.workunit.client.0.smithi037.stdout:0/835: fdatasync d5/d8/d22/d89/da9/f116 0 2024-09-19T06:08:50.467 INFO:tasks.workunit.client.0.smithi037.stdout:0/836: symlink d5/d8/d22/d89/d96/dc5/d11f/l120 0 2024-09-19T06:08:50.467 INFO:tasks.workunit.client.0.smithi037.stdout:4/841: dwrite d0/d6/d45/dd9/d36/f47 [0,4194304] 0 2024-09-19T06:08:50.472 INFO:tasks.workunit.client.0.smithi037.stdout:4/842: creat d0/d6/d1b/d30/dee/f106 x:0 0 0 2024-09-19T06:08:50.472 INFO:tasks.workunit.client.0.smithi037.stdout:4/843: write d0/d6/d1b/d30/f32 [454255,9763] 0 2024-09-19T06:08:50.478 INFO:tasks.workunit.client.0.smithi037.stdout:8/920: dwrite d1/d35/d118/d123/f126 [0,4194304] 0 2024-09-19T06:08:50.489 INFO:tasks.workunit.client.0.smithi037.stdout:0/837: dwrite d5/fa3 [0,4194304] 0 2024-09-19T06:08:50.489 INFO:tasks.workunit.client.0.smithi037.stdout:0/838: write d5/d8/d44/d61/fcf [2087458,44509] 0 2024-09-19T06:08:50.492 INFO:tasks.workunit.client.0.smithi037.stdout:4/844: dread d0/d2/f57 [0,4194304] 0 2024-09-19T06:08:50.492 INFO:tasks.workunit.client.0.smithi037.stdout:0/839: mkdir d5/dd5/de9/d21/d4e/d121 0 2024-09-19T06:08:50.493 INFO:tasks.workunit.client.0.smithi037.stdout:0/840: dread - d5/d18/f86 zero size 2024-09-19T06:08:50.494 INFO:tasks.workunit.client.0.smithi037.stdout:0/841: symlink d5/dd5/de9/d21/d4e/d121/l122 0 2024-09-19T06:08:50.494 INFO:tasks.workunit.client.0.smithi037.stdout:0/842: chown d5/d8/d22/d89/d96/fd4 387670 1 2024-09-19T06:08:50.503 INFO:tasks.workunit.client.0.smithi037.stdout:8/921: dwrite d1/d35/f56 [4194304,4194304] 0 2024-09-19T06:08:50.503 INFO:tasks.workunit.client.0.smithi037.stdout:1/719: sync 2024-09-19T06:08:50.503 INFO:tasks.workunit.client.0.smithi037.stdout:9/903: sync 2024-09-19T06:08:50.505 INFO:tasks.workunit.client.0.smithi037.stdout:1/720: unlink d2/d12/fda 0 2024-09-19T06:08:50.505 INFO:tasks.workunit.client.0.smithi037.stdout:1/721: read d2/d12/d1d/f30 [2905621,10333] 0 2024-09-19T06:08:50.506 INFO:tasks.workunit.client.0.smithi037.stdout:1/722: getdents d2/d12/d1e/d75 0 2024-09-19T06:08:50.509 INFO:tasks.workunit.client.0.smithi037.stdout:4/845: dread d0/d2/d37/d46/fdd [0,4194304] 0 2024-09-19T06:08:50.509 INFO:tasks.workunit.client.0.smithi037.stdout:4/846: fsync d0/d2/d37/f49 0 2024-09-19T06:08:50.511 INFO:tasks.workunit.client.0.smithi037.stdout:4/847: rmdir d0/d6/d1b/d30/d80 39 2024-09-19T06:08:50.515 INFO:tasks.workunit.client.0.smithi037.stdout:0/843: dread d5/dd5/de9/d21/d118/f74 [0,4194304] 0 2024-09-19T06:08:50.518 INFO:tasks.workunit.client.0.smithi037.stdout:0/844: link d5/dd5/de9/la2 d5/d18/d68/d85/dab/l123 0 2024-09-19T06:08:50.522 INFO:tasks.workunit.client.0.smithi037.stdout:0/845: rename d5/d8/d44/da1 to d5/d8/d79/d9a/ddb/d106/dd1/d124 0 2024-09-19T06:08:50.524 INFO:tasks.workunit.client.0.smithi037.stdout:0/846: dread d5/d20/f57 [0,4194304] 0 2024-09-19T06:08:50.524 INFO:tasks.workunit.client.0.smithi037.stdout:0/847: readlink d5/d20/l2e 0 2024-09-19T06:08:50.526 INFO:tasks.workunit.client.0.smithi037.stdout:0/848: rename d5/d8/d22 to d5/d8/d44/d10f/d125 0 2024-09-19T06:08:50.526 INFO:tasks.workunit.client.0.smithi037.stdout:0/849: getdents d5/d8/d79/d9a/ddb/d106/dd1/d124 0 2024-09-19T06:08:50.527 INFO:tasks.workunit.client.0.smithi037.stdout:1/723: read d2/d12/d1e/f67 [1343018,553] 0 2024-09-19T06:08:50.527 INFO:tasks.workunit.client.0.smithi037.stdout:9/904: dwrite da/dec/d116/d1b/d2f/d6d/d92/fe2 [4194304,4194304] 0 2024-09-19T06:08:50.528 INFO:tasks.workunit.client.0.smithi037.stdout:1/724: symlink d2/d12/d1e/dbe/lf1 0 2024-09-19T06:08:50.528 INFO:tasks.workunit.client.0.smithi037.stdout:1/725: write d2/d12/d1e/f67 [3646895,121267] 0 2024-09-19T06:08:50.530 INFO:tasks.workunit.client.0.smithi037.stdout:9/905: rename da/dec/d116/d31/l72 to da/dec/d116/d1b/d62/l147 0 2024-09-19T06:08:50.531 INFO:tasks.workunit.client.0.smithi037.stdout:1/726: link d2/d12/d1e/dbe/lcf d2/d12/d15/d34/lf2 0 2024-09-19T06:08:50.531 INFO:tasks.workunit.client.0.smithi037.stdout:1/727: write d2/d12/d1e/f67 [2265061,73041] 0 2024-09-19T06:08:50.532 INFO:tasks.workunit.client.0.smithi037.stdout:9/906: creat da/dec/d116/d1b/d2f/d6d/db4/f148 x:0 0 0 2024-09-19T06:08:50.532 INFO:tasks.workunit.client.0.smithi037.stdout:4/848: read d0/d6/f67 [5487848,7208] 0 2024-09-19T06:08:50.533 INFO:tasks.workunit.client.0.smithi037.stdout:1/728: mknod d2/d12/d1e/d75/d89/de0/cf3 0 2024-09-19T06:08:50.533 INFO:tasks.workunit.client.0.smithi037.stdout:1/729: dread - d2/d12/d1e/d2d/d87/fe4 zero size 2024-09-19T06:08:50.534 INFO:tasks.workunit.client.0.smithi037.stdout:1/730: mkdir d2/d12/d1d/d6b/d8b/df4 0 2024-09-19T06:08:50.545 INFO:tasks.workunit.client.0.smithi037.stdout:9/907: dread da/dec/d116/d1b/d2f/dcc/de7/f105 [0,4194304] 0 2024-09-19T06:08:50.546 INFO:tasks.workunit.client.0.smithi037.stdout:9/908: write da/d4d/dbb/f108 [1127358,15312] 0 2024-09-19T06:08:50.546 INFO:tasks.workunit.client.0.smithi037.stdout:9/909: dread - da/d57/f9d zero size 2024-09-19T06:08:50.546 INFO:tasks.workunit.client.0.smithi037.stdout:9/910: getdents da/dec/d116/d1b/d23/d6a/d8f/da4/d100 0 2024-09-19T06:08:50.547 INFO:tasks.workunit.client.0.smithi037.stdout:4/849: read d0/f53 [2531885,38315] 0 2024-09-19T06:08:50.548 INFO:tasks.workunit.client.0.smithi037.stdout:1/731: write d2/d12/f44 [4307272,8307] 0 2024-09-19T06:08:50.548 INFO:tasks.workunit.client.0.smithi037.stdout:9/911: mkdir da/dec/d116/d1b/d2f/d6d/d149 0 2024-09-19T06:08:50.548 INFO:tasks.workunit.client.0.smithi037.stdout:9/912: dread - da/d4d/f13c zero size 2024-09-19T06:08:50.550 INFO:tasks.workunit.client.0.smithi037.stdout:9/913: link da/dec/d116/d1b/d2f/d6d/db4/fd2 da/dec/d116/d1b/d43/de4/f14a 0 2024-09-19T06:08:50.551 INFO:tasks.workunit.client.0.smithi037.stdout:4/850: symlink d0/l107 0 2024-09-19T06:08:50.552 INFO:tasks.workunit.client.0.smithi037.stdout:9/914: mkdir da/dec/d116/d1b/d14b 0 2024-09-19T06:08:50.554 INFO:tasks.workunit.client.0.smithi037.stdout:4/851: unlink d0/d6/d1b/d30/dee/df2/ffc 0 2024-09-19T06:08:50.557 INFO:tasks.workunit.client.0.smithi037.stdout:4/852: creat d0/d2/d37/d46/de5/de1/d104/f108 x:0 0 0 2024-09-19T06:08:50.558 INFO:tasks.workunit.client.0.smithi037.stdout:9/915: unlink da/dec/d116/d1b/d2f/d6d/cc8 0 2024-09-19T06:08:50.558 INFO:tasks.workunit.client.0.smithi037.stdout:9/916: write da/d4d/f13c [484825,74829] 0 2024-09-19T06:08:50.558 INFO:tasks.workunit.client.0.smithi037.stdout:9/917: truncate da/dec/d116/d1b/d2f/dcc/f117 4848548 0 2024-09-19T06:08:50.559 INFO:tasks.workunit.client.0.smithi037.stdout:4/853: link d0/d2/d37/d46/de5/d6f/d8e/la3 d0/d6/d1b/d20/d4d/d64/de7/l109 0 2024-09-19T06:08:50.570 INFO:tasks.workunit.client.0.smithi037.stdout:9/918: write da/dec/d116/d1b/d2f/d6f/ffb [22627,114021] 0 2024-09-19T06:08:50.574 INFO:tasks.workunit.client.0.smithi037.stdout:1/732: dwrite d2/d12/d1e/d2a/f59 [0,4194304] 0 2024-09-19T06:08:50.579 INFO:tasks.workunit.client.0.smithi037.stdout:9/919: dread da/dec/d116/d1b/d43/f46 [0,4194304] 0 2024-09-19T06:08:50.601 INFO:tasks.workunit.client.0.smithi037.stdout:1/733: dwrite d2/d12/d1e/d2a/d2e/f7f [0,4194304] 0 2024-09-19T06:08:50.601 INFO:tasks.workunit.client.0.smithi037.stdout:1/734: chown d2/d12/d1e/f67 4633 1 2024-09-19T06:08:50.601 INFO:tasks.workunit.client.0.smithi037.stdout:1/735: readlink d2/d12/d15/d34/l5e 0 2024-09-19T06:08:50.603 INFO:tasks.workunit.client.0.smithi037.stdout:9/920: dwrite da/dec/d116/d1b/d2f/d6f/ff2 [0,4194304] 0 2024-09-19T06:08:50.603 INFO:tasks.workunit.client.0.smithi037.stdout:1/736: creat d2/d12/d1e/d2a/ff5 x:0 0 0 2024-09-19T06:08:50.604 INFO:tasks.workunit.client.0.smithi037.stdout:9/921: mkdir da/dec/d116/d1b/d23/d6a/d8f/da4/d14c 0 2024-09-19T06:08:50.605 INFO:tasks.workunit.client.0.smithi037.stdout:9/922: creat da/db3/d10e/f14d x:0 0 0 2024-09-19T06:08:50.622 INFO:tasks.workunit.client.0.smithi037.stdout:1/737: dwrite d2/fa [4194304,4194304] 0 2024-09-19T06:08:50.622 INFO:tasks.workunit.client.0.smithi037.stdout:1/738: dread - d2/d12/d15/d34/d90/fed zero size 2024-09-19T06:08:50.624 INFO:tasks.workunit.client.0.smithi037.stdout:1/739: rename d2/d12/d1d/f49 to d2/d12/d15/d34/ff6 0 2024-09-19T06:08:50.634 INFO:tasks.workunit.client.0.smithi037.stdout:4/854: dwrite d0/d2/d37/d46/fdd [0,4194304] 0 2024-09-19T06:08:50.637 INFO:tasks.workunit.client.0.smithi037.stdout:1/740: dread d2/f8 [0,4194304] 0 2024-09-19T06:08:50.638 INFO:tasks.workunit.client.0.smithi037.stdout:4/855: getdents d0/d2/d37/d46/db1 0 2024-09-19T06:08:50.640 INFO:tasks.workunit.client.0.smithi037.stdout:1/741: dread d2/d12/d15/d34/f7c [0,4194304] 0 2024-09-19T06:08:50.640 INFO:tasks.workunit.client.0.smithi037.stdout:4/856: creat d0/d6/d1b/d20/d4d/f10a x:0 0 0 2024-09-19T06:08:50.642 INFO:tasks.workunit.client.0.smithi037.stdout:4/857: symlink d0/d6/d1b/d20/d4d/d64/db0/l10b 0 2024-09-19T06:08:50.643 INFO:tasks.workunit.client.0.smithi037.stdout:1/742: symlink d2/d12/d15/lf7 0 2024-09-19T06:08:50.644 INFO:tasks.workunit.client.0.smithi037.stdout:1/743: mknod d2/d73/cf8 0 2024-09-19T06:08:50.646 INFO:tasks.workunit.client.0.smithi037.stdout:1/744: mkdir d2/d12/d1e/d2a/d2e/df9 0 2024-09-19T06:08:50.646 INFO:tasks.workunit.client.0.smithi037.stdout:1/745: write d2/d12/d1d/d47/f72 [456135,64746] 0 2024-09-19T06:08:50.646 INFO:tasks.workunit.client.0.smithi037.stdout:1/746: chown d2/d12/d17/f2b 1 1 2024-09-19T06:08:50.646 INFO:tasks.workunit.client.0.smithi037.stdout:1/747: stat d2/d12/d1e/dbe/le3 0 2024-09-19T06:08:50.646 INFO:tasks.workunit.client.0.smithi037.stdout:3/752: sync 2024-09-19T06:08:50.649 INFO:tasks.workunit.client.0.smithi037.stdout:3/753: rename d0/d16/d19/d1d/d82/d86/df4 to d0/d43/d23/d7a/d77/dc3/df8 0 2024-09-19T06:08:50.649 INFO:tasks.workunit.client.0.smithi037.stdout:3/754: chown d0/d5f/da0/cbc 1690686 1 2024-09-19T06:08:50.650 INFO:tasks.workunit.client.0.smithi037.stdout:3/755: creat d0/d16/d19/d1d/d7c/ff9 x:0 0 0 2024-09-19T06:08:50.651 INFO:tasks.workunit.client.0.smithi037.stdout:3/756: fsync d0/d16/d19/d1d/d5e/da9/db5/fe5 0 2024-09-19T06:08:50.651 INFO:tasks.workunit.client.0.smithi037.stdout:3/757: rmdir d0/d16/d19/d1d/d7c 39 2024-09-19T06:08:50.653 INFO:tasks.workunit.client.0.smithi037.stdout:3/758: symlink d0/d16/d19/d1d/d5e/da9/db5/lfa 0 2024-09-19T06:08:50.653 INFO:tasks.workunit.client.0.smithi037.stdout:3/759: chown d0/d43/d23/d7a/d77 42939 1 2024-09-19T06:08:50.654 INFO:tasks.workunit.client.0.smithi037.stdout:4/858: dread d0/f41 [0,4194304] 0 2024-09-19T06:08:50.654 INFO:tasks.workunit.client.0.smithi037.stdout:4/859: chown d0/d2/d37/d46/fbe 11298 1 2024-09-19T06:08:50.654 INFO:tasks.workunit.client.0.smithi037.stdout:3/760: rmdir d0/d16/d19/df3 0 2024-09-19T06:08:50.656 INFO:tasks.workunit.client.0.smithi037.stdout:4/860: creat d0/d6/d1b/d20/d4d/d64/db0/f10c x:0 0 0 2024-09-19T06:08:50.657 INFO:tasks.workunit.client.0.smithi037.stdout:3/761: mkdir d0/d43/d23/d7a/d77/dc3/dfb 0 2024-09-19T06:08:50.658 INFO:tasks.workunit.client.0.smithi037.stdout:3/762: mkdir d0/d16/d19/d1d/dc7/dfc 0 2024-09-19T06:08:50.659 INFO:tasks.workunit.client.0.smithi037.stdout:3/763: mknod d0/d16/d19/d33/d87/dbd/cfd 0 2024-09-19T06:08:50.668 INFO:tasks.workunit.client.0.smithi037.stdout:1/748: dwrite d2/d12/d15/d34/f52 [8388608,4194304] 0 2024-09-19T06:08:50.672 INFO:tasks.workunit.client.0.smithi037.stdout:4/861: dread d0/d6/f67 [0,4194304] 0 2024-09-19T06:08:50.672 INFO:tasks.workunit.client.0.smithi037.stdout:4/862: readlink d0/d2/d37/d46/de5/ld4 0 2024-09-19T06:08:50.675 INFO:tasks.workunit.client.0.smithi037.stdout:4/863: truncate d0/d2/d37/d46/de5/d86/f8a 205080 0 2024-09-19T06:08:50.677 INFO:tasks.workunit.client.0.smithi037.stdout:4/864: rename d0/d2/d37/d46/de5/d6f/d8e/fbd to d0/d6/d1b/d30/d70/f10d 0 2024-09-19T06:08:50.678 INFO:tasks.workunit.client.0.smithi037.stdout:4/865: rmdir d0/d2/d37/d46 39 2024-09-19T06:08:50.678 INFO:tasks.workunit.client.0.smithi037.stdout:4/866: chown d0/d6/d1b/d20/d4d/lf7 16327358 1 2024-09-19T06:08:50.679 INFO:tasks.workunit.client.0.smithi037.stdout:4/867: fsync d0/d2/d37/d46/fbe 0 2024-09-19T06:08:50.679 INFO:tasks.workunit.client.0.smithi037.stdout:4/868: write d0/d2/f2c [848263,68110] 0 2024-09-19T06:08:50.681 INFO:tasks.workunit.client.0.smithi037.stdout:4/869: rename d0/d2/d37/d46/de5/ld4 to d0/d2/d37/d46/de5/d6f/d8e/l10e 0 2024-09-19T06:08:50.698 INFO:tasks.workunit.client.0.smithi037.stdout:1/749: dwrite d2/d12/d1e/d75/f84 [0,4194304] 0 2024-09-19T06:08:50.702 INFO:tasks.workunit.client.0.smithi037.stdout:1/750: symlink d2/d12/d1e/d2a/d2e/lfa 0 2024-09-19T06:08:50.705 INFO:tasks.workunit.client.0.smithi037.stdout:3/764: dwrite d0/d43/d23/d7a/d77/f3e [0,4194304] 0 2024-09-19T06:08:50.705 INFO:tasks.workunit.client.0.smithi037.stdout:1/751: mkdir d2/d12/d1d/d6b/d8b/dfb 0 2024-09-19T06:08:50.712 INFO:tasks.workunit.client.0.smithi037.stdout:3/765: mknod d0/d16/d19/d1d/d5e/d61/dc4/cfe 0 2024-09-19T06:08:50.712 INFO:tasks.workunit.client.0.smithi037.stdout:1/752: creat d2/d12/d15/dd3/dd4/ffc x:0 0 0 2024-09-19T06:08:50.714 INFO:tasks.workunit.client.0.smithi037.stdout:3/766: unlink d0/d43/d23/d7a/d77/f84 0 2024-09-19T06:08:50.720 INFO:tasks.workunit.client.0.smithi037.stdout:3/767: dread d0/d43/f7f [0,4194304] 0 2024-09-19T06:08:50.722 INFO:tasks.workunit.client.0.smithi037.stdout:4/870: dwrite d0/d6/d1b/d20/f62 [0,4194304] 0 2024-09-19T06:08:50.727 INFO:tasks.workunit.client.0.smithi037.stdout:4/871: mkdir d0/d6/d1b/d20/d4d/d65/d10f 0 2024-09-19T06:08:50.727 INFO:tasks.workunit.client.0.smithi037.stdout:4/872: write d0/d6/d1b/d30/d70/f10d [307102,20958] 0 2024-09-19T06:08:50.729 INFO:tasks.workunit.client.0.smithi037.stdout:4/873: creat d0/d2/d37/d46/de5/de1/f110 x:0 0 0 2024-09-19T06:08:50.730 INFO:tasks.workunit.client.0.smithi037.stdout:4/874: mkdir d0/d6/d1b/d5d/d111 0 2024-09-19T06:08:50.730 INFO:tasks.workunit.client.0.smithi037.stdout:4/875: chown d0/d6/f67 1382198 1 2024-09-19T06:08:50.731 INFO:tasks.workunit.client.0.smithi037.stdout:4/876: creat d0/d8f/f112 x:0 0 0 2024-09-19T06:08:50.732 INFO:tasks.workunit.client.0.smithi037.stdout:1/753: dwrite d2/d12/d15/d95/fc3 [4194304,4194304] 0 2024-09-19T06:08:50.734 INFO:tasks.workunit.client.0.smithi037.stdout:1/754: symlink d2/d73/lfd 0 2024-09-19T06:08:50.749 INFO:tasks.workunit.client.0.smithi037.stdout:3/768: dwrite d0/d16/d19/fe8 [0,4194304] 0 2024-09-19T06:08:50.749 INFO:tasks.workunit.client.0.smithi037.stdout:3/769: chown d0/d16/d19/d1d/d82/cc9 26 1 2024-09-19T06:08:50.750 INFO:tasks.workunit.client.0.smithi037.stdout:3/770: creat d0/fff x:0 0 0 2024-09-19T06:08:50.752 INFO:tasks.workunit.client.0.smithi037.stdout:3/771: mkdir d0/d16/d19/d1d/d100 0 2024-09-19T06:08:50.752 INFO:tasks.workunit.client.0.smithi037.stdout:4/877: dwrite d0/f7a [0,4194304] 0 2024-09-19T06:08:50.752 INFO:tasks.workunit.client.0.smithi037.stdout:4/878: fsync d0/d6/d1b/d20/d77/fce 0 2024-09-19T06:08:50.775 INFO:tasks.workunit.client.0.smithi037.stdout:4/879: dwrite d0/f27 [0,4194304] 0 2024-09-19T06:08:50.776 INFO:tasks.workunit.client.0.smithi037.stdout:2/911: sync 2024-09-19T06:08:50.776 INFO:tasks.workunit.client.0.smithi037.stdout:6/836: sync 2024-09-19T06:08:50.776 INFO:tasks.workunit.client.0.smithi037.stdout:3/772: dwrite d0/d43/d26/fe3 [0,4194304] 0 2024-09-19T06:08:50.777 INFO:tasks.workunit.client.0.smithi037.stdout:4/880: rename d0/d2/d37/d46 to d0/d6/d45/d113 0 2024-09-19T06:08:50.777 INFO:tasks.workunit.client.0.smithi037.stdout:4/881: getdents d0/d6/d45/d113/db1 0 2024-09-19T06:08:50.778 INFO:tasks.workunit.client.0.smithi037.stdout:4/882: chown d0/d6/d1b/d20/d4d/d64/db0/f10c 292830174 1 2024-09-19T06:08:50.778 INFO:tasks.workunit.client.0.smithi037.stdout:4/883: chown d0/d2/d37/f49 4 1 2024-09-19T06:08:50.778 INFO:tasks.workunit.client.0.smithi037.stdout:6/837: unlink d9/dd/d1c/f3e 0 2024-09-19T06:08:50.779 INFO:tasks.workunit.client.0.smithi037.stdout:3/773: mkdir d0/d16/d19/d1d/d5e/d101 0 2024-09-19T06:08:50.779 INFO:tasks.workunit.client.0.smithi037.stdout:4/884: rmdir d0/d6/d45/d113/de5/d6f 39 2024-09-19T06:08:50.781 INFO:tasks.workunit.client.0.smithi037.stdout:6/838: creat d9/d16/f10e x:0 0 0 2024-09-19T06:08:50.782 INFO:tasks.workunit.client.0.smithi037.stdout:4/885: link d0/d6/d1b/d20/f62 d0/d6/d1b/d20/d48/f114 0 2024-09-19T06:08:50.784 INFO:tasks.workunit.client.0.smithi037.stdout:6/839: creat d9/d6e/d10c/d5a/dd2/f10f x:0 0 0 2024-09-19T06:08:50.784 INFO:tasks.workunit.client.0.smithi037.stdout:6/840: read d9/f18 [23766,95429] 0 2024-09-19T06:08:50.785 INFO:tasks.workunit.client.0.smithi037.stdout:4/886: mknod d0/d6/d45/d113/db1/c115 0 2024-09-19T06:08:50.785 INFO:tasks.workunit.client.0.smithi037.stdout:4/887: write d0/f7c [2123127,113674] 0 2024-09-19T06:08:50.786 INFO:tasks.workunit.client.0.smithi037.stdout:6/841: creat d9/dd/d2b/d79/f110 x:0 0 0 2024-09-19T06:08:50.786 INFO:tasks.workunit.client.0.smithi037.stdout:6/842: read - d9/d6e/d10c/d5a/dd2/f10f zero size 2024-09-19T06:08:50.786 INFO:tasks.workunit.client.0.smithi037.stdout:6/843: truncate d9/dd/d1c/d73/f86 1352593 0 2024-09-19T06:08:50.787 INFO:tasks.workunit.client.0.smithi037.stdout:4/888: mkdir d0/d6/d1b/d20/d4d/d64/db0/dc4/d116 0 2024-09-19T06:08:50.788 INFO:tasks.workunit.client.0.smithi037.stdout:6/844: symlink d9/dd/d1c/d4e/d65/l111 0 2024-09-19T06:08:50.790 INFO:tasks.workunit.client.0.smithi037.stdout:4/889: rmdir d0/d6/d45/d113/de5 39 2024-09-19T06:08:50.790 INFO:tasks.workunit.client.0.smithi037.stdout:4/890: write d0/d2/d37/f90 [354861,21732] 0 2024-09-19T06:08:50.790 INFO:tasks.workunit.client.0.smithi037.stdout:4/891: dread - d0/d6/fe2 zero size 2024-09-19T06:08:50.790 INFO:tasks.workunit.client.0.smithi037.stdout:4/892: read - d0/d6/d45/d113/de5/de1/d104/f108 zero size 2024-09-19T06:08:50.791 INFO:tasks.workunit.client.0.smithi037.stdout:6/845: rename d9/dd/d1c/d73/c107 to d9/d6e/d10c/d5a/d6d/df6/c112 0 2024-09-19T06:08:50.792 INFO:tasks.workunit.client.0.smithi037.stdout:4/893: creat d0/d6/d45/d113/de5/f117 x:0 0 0 2024-09-19T06:08:50.794 INFO:tasks.workunit.client.0.smithi037.stdout:4/894: unlink d0/d6/d1b/d20/d77/lab 0 2024-09-19T06:08:50.794 INFO:tasks.workunit.client.0.smithi037.stdout:4/895: chown d0/d6/d45/c89 4958 1 2024-09-19T06:08:50.795 INFO:tasks.workunit.client.0.smithi037.stdout:2/912: dwrite d1/da/d6e/fc2 [0,4194304] 0 2024-09-19T06:08:50.797 INFO:tasks.workunit.client.0.smithi037.stdout:4/896: unlink d0/d2/f2c 0 2024-09-19T06:08:50.797 INFO:tasks.workunit.client.0.smithi037.stdout:4/897: chown d0/d6/d1b/d30/d80/l94 20652 1 2024-09-19T06:08:50.797 INFO:tasks.workunit.client.0.smithi037.stdout:4/898: chown d0/d6/d1b/d20/d4d/d65/l66 13 1 2024-09-19T06:08:50.797 INFO:tasks.workunit.client.0.smithi037.stdout:4/899: write d0/d6/d1b/d20/d4d/d64/db0/f10c [186500,456] 0 2024-09-19T06:08:50.797 INFO:tasks.workunit.client.0.smithi037.stdout:4/900: readlink d0/d2/l13 0 2024-09-19T06:08:50.798 INFO:tasks.workunit.client.0.smithi037.stdout:4/901: creat d0/d6/d1b/d30/dee/f118 x:0 0 0 2024-09-19T06:08:50.798 INFO:tasks.workunit.client.0.smithi037.stdout:4/902: getdents d0/d8f/dd0 0 2024-09-19T06:08:50.799 INFO:tasks.workunit.client.0.smithi037.stdout:4/903: symlink d0/d6/d1b/d30/d70/l119 0 2024-09-19T06:08:50.810 INFO:tasks.workunit.client.0.smithi037.stdout:6/846: dread d9/dd/f52 [0,4194304] 0 2024-09-19T06:08:50.812 INFO:tasks.workunit.client.0.smithi037.stdout:6/847: unlink d9/d6e/d10c/d5a/d6d/f102 0 2024-09-19T06:08:50.814 INFO:tasks.workunit.client.0.smithi037.stdout:6/848: unlink d9/d6e/d10c/l4d 0 2024-09-19T06:08:50.815 INFO:tasks.workunit.client.0.smithi037.stdout:6/849: unlink d9/dd/d2b/d79/f63 0 2024-09-19T06:08:50.815 INFO:tasks.workunit.client.0.smithi037.stdout:6/850: symlink d9/d6e/d10c/d5a/dd2/de4/l113 0 2024-09-19T06:08:50.820 INFO:tasks.workunit.client.0.smithi037.stdout:4/904: dwrite d0/d6/d45/d113/de5/f102 [0,4194304] 0 2024-09-19T06:08:50.821 INFO:tasks.workunit.client.0.smithi037.stdout:4/905: symlink d0/d6/d45/d113/de5/d6f/d8e/l11a 0 2024-09-19T06:08:50.822 INFO:tasks.workunit.client.0.smithi037.stdout:4/906: write d0/d6/d1b/d20/d4d/d64/f76 [104035,36006] 0 2024-09-19T06:08:50.823 INFO:tasks.workunit.client.0.smithi037.stdout:4/907: rename d0/d6/d45/d113/de5/f8c to d0/d6/d103/f11b 0 2024-09-19T06:08:50.823 INFO:tasks.workunit.client.0.smithi037.stdout:4/908: fsync d0/d6/d1b/d20/d48/da7/fb5 0 2024-09-19T06:08:50.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:08:50 smithi037 ceph-mon[31211]: pgmap v429: 129 pgs: 129 active+clean; 1.3 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 146 MiB/s rd, 183 MiB/s wr, 259 op/s 2024-09-19T06:08:50.824 INFO:tasks.workunit.client.0.smithi037.stdout:2/913: dwrite d1/da/dc/d21/d7d/d80/fff [0,4194304] 0 2024-09-19T06:08:50.824 INFO:tasks.workunit.client.0.smithi037.stdout:2/914: stat d1/da/dc/d21/d55/dbc/cae 0 2024-09-19T06:08:50.824 INFO:tasks.workunit.client.0.smithi037.stdout:4/909: mknod d0/d6/d45/d113/de5/de1/c11c 0 2024-09-19T06:08:50.825 INFO:tasks.workunit.client.0.smithi037.stdout:4/910: write d0/d6/d45/d113/db1/fe4 [4976283,114818] 0 2024-09-19T06:08:50.828 INFO:tasks.workunit.client.0.smithi037.stdout:4/911: creat d0/d6/d45/d113/de5/de1/f11d x:0 0 0 2024-09-19T06:08:50.832 INFO:tasks.workunit.client.0.smithi037.stdout:4/912: creat d0/d6/d1b/d30/dc0/f11e x:0 0 0 2024-09-19T06:08:50.832 INFO:tasks.workunit.client.0.smithi037.stdout:4/913: truncate d0/d6/d45/d113/de5/de1/d104/f108 365529 0 2024-09-19T06:08:50.833 INFO:tasks.workunit.client.0.smithi037.stdout:6/851: dread d9/d6e/d10c/d5a/d6d/fac [0,4194304] 0 2024-09-19T06:08:50.834 INFO:tasks.workunit.client.0.smithi037.stdout:4/914: creat d0/d6/d45/d113/de5/f11f x:0 0 0 2024-09-19T06:08:50.834 INFO:tasks.workunit.client.0.smithi037.stdout:4/915: write d0/d8f/fea [2642154,70639] 0 2024-09-19T06:08:50.835 INFO:tasks.workunit.client.0.smithi037.stdout:6/852: truncate d9/d6e/d10c/d5a/d6d/f72 154798 0 2024-09-19T06:08:50.835 INFO:tasks.workunit.client.0.smithi037.stdout:6/853: chown d9/dd/d1c/d4e/d65/db0/lce 70959 1 2024-09-19T06:08:50.837 INFO:tasks.workunit.client.0.smithi037.stdout:4/916: link d0/f41 d0/d6/d45/d113/de5/de1/d104/f120 0 2024-09-19T06:08:50.837 INFO:tasks.workunit.client.0.smithi037.stdout:4/917: chown d0/d6/d1b/d20/d4d/lf7 496 1 2024-09-19T06:08:50.847 INFO:tasks.workunit.client.0.smithi037.stdout:6/854: dread d9/d6e/d10c/d5a/d6d/f104 [0,4194304] 0 2024-09-19T06:08:50.847 INFO:tasks.workunit.client.0.smithi037.stdout:6/855: write d9/d9c/fcd [1149636,83817] 0 2024-09-19T06:08:50.847 INFO:tasks.workunit.client.0.smithi037.stdout:6/856: stat d9/dd/d1c/d73/ld0 0 2024-09-19T06:08:50.847 INFO:tasks.workunit.client.0.smithi037.stdout:6/857: chown d9/d16/c9d 344 1 2024-09-19T06:08:50.848 INFO:tasks.workunit.client.0.smithi037.stdout:6/858: mknod d9/dd/d2b/c114 0 2024-09-19T06:08:50.848 INFO:tasks.workunit.client.0.smithi037.stdout:6/859: chown d9/dd/la7 24823735 1 2024-09-19T06:08:50.850 INFO:tasks.workunit.client.0.smithi037.stdout:4/918: read d0/d6/d45/d113/fdd [3577107,41042] 0 2024-09-19T06:08:50.851 INFO:tasks.workunit.client.0.smithi037.stdout:6/860: getdents d9/dd/d2b 0 2024-09-19T06:08:50.852 INFO:tasks.workunit.client.0.smithi037.stdout:4/919: link d0/d6/d1b/d20/d77/ca8 d0/d6/d1b/d30/d80/c121 0 2024-09-19T06:08:50.852 INFO:tasks.workunit.client.0.smithi037.stdout:4/920: chown d0/d6/d1b/d20/d4d/le8 231050 1 2024-09-19T06:08:50.853 INFO:tasks.workunit.client.0.smithi037.stdout:4/921: mkdir d0/d6/d1b/d20/d122 0 2024-09-19T06:08:50.853 INFO:tasks.workunit.client.0.smithi037.stdout:4/922: fsync d0/f7c 0 2024-09-19T06:08:50.870 INFO:tasks.workunit.client.0.smithi037.stdout:4/923: write d0/d6/d45/d113/f9c [2557053,84943] 0 2024-09-19T06:08:50.870 INFO:tasks.workunit.client.0.smithi037.stdout:4/924: write d0/d6/d1b/d20/d48/f114 [1194047,59809] 0 2024-09-19T06:08:50.870 INFO:tasks.workunit.client.0.smithi037.stdout:4/925: chown d0/d6/d1b/d20/d4d/f10a 96007874 1 2024-09-19T06:08:50.871 INFO:tasks.workunit.client.0.smithi037.stdout:4/926: rmdir d0/d6/d45/d113 39 2024-09-19T06:08:50.872 INFO:tasks.workunit.client.0.smithi037.stdout:4/927: creat d0/d6/d1b/d20/d48/f123 x:0 0 0 2024-09-19T06:08:50.873 INFO:tasks.workunit.client.0.smithi037.stdout:4/928: mknod d0/d6/d45/d113/de5/d6f/d8e/c124 0 2024-09-19T06:08:50.873 INFO:tasks.workunit.client.0.smithi037.stdout:4/929: write d0/d6/d45/d113/de5/de1/f110 [29171,68797] 0 2024-09-19T06:08:50.875 INFO:tasks.workunit.client.0.smithi037.stdout:4/930: dread d0/d6/d1b/d20/d48/f9b [0,4194304] 0 2024-09-19T06:08:50.876 INFO:tasks.workunit.client.0.smithi037.stdout:6/861: dwrite d9/d6e/d10c/d5a/d6d/d82/d9f/da4/fef [0,4194304] 0 2024-09-19T06:08:50.877 INFO:tasks.workunit.client.0.smithi037.stdout:6/862: write d9/d78/ff0 [8972464,114242] 0 2024-09-19T06:08:50.877 INFO:tasks.workunit.client.0.smithi037.stdout:6/863: fdatasync d9/d6e/d10c/d5a/d6d/fb1 0 2024-09-19T06:08:50.877 INFO:tasks.workunit.client.0.smithi037.stdout:4/931: symlink d0/d6/d1b/d30/dee/l125 0 2024-09-19T06:08:50.877 INFO:tasks.workunit.client.0.smithi037.stdout:4/932: dread d0/d6/d45/d113/de5/de1/d104/f108 [0,4194304] 0 2024-09-19T06:08:50.877 INFO:tasks.workunit.client.0.smithi037.stdout:4/933: readlink d0/l85 0 2024-09-19T06:08:50.882 INFO:tasks.workunit.client.0.smithi037.stdout:6/864: unlink d9/dd/d2b/f106 0 2024-09-19T06:08:50.883 INFO:tasks.workunit.client.0.smithi037.stdout:4/934: mkdir d0/d6/d45/dd9/d36/d126 0 2024-09-19T06:08:50.883 INFO:tasks.workunit.client.0.smithi037.stdout:4/935: fsync d0/d6/d45/d113/de5/fc5 0 2024-09-19T06:08:50.883 INFO:tasks.workunit.client.0.smithi037.stdout:4/936: truncate d0/d6/d1b/d30/dee/ff4 1100070 0 2024-09-19T06:08:50.884 INFO:tasks.workunit.client.0.smithi037.stdout:6/865: rename d9/d16/f2a to d9/d6e/d10c/d5a/d6d/d82/f115 0 2024-09-19T06:08:50.885 INFO:tasks.workunit.client.0.smithi037.stdout:4/937: mknod d0/d6/d45/d113/db1/c127 0 2024-09-19T06:08:50.886 INFO:tasks.workunit.client.0.smithi037.stdout:6/866: creat d9/d9c/f116 x:0 0 0 2024-09-19T06:08:50.887 INFO:tasks.workunit.client.0.smithi037.stdout:4/938: mkdir d0/d6/d45/d128 0 2024-09-19T06:08:50.888 INFO:tasks.workunit.client.0.smithi037.stdout:6/867: creat d9/d6e/d10c/d5a/d6d/f117 x:0 0 0 2024-09-19T06:08:50.890 INFO:tasks.workunit.client.0.smithi037.stdout:5/769: sync 2024-09-19T06:08:50.900 INFO:tasks.workunit.client.0.smithi037.stdout:5/770: dread d2/d12/d28/d22/d53/f8a [0,4194304] 0 2024-09-19T06:08:50.900 INFO:tasks.workunit.client.0.smithi037.stdout:5/771: chown d2/d12/fe9 177935 1 2024-09-19T06:08:50.901 INFO:tasks.workunit.client.0.smithi037.stdout:5/772: mknod d2/d12/d28/d22/d4a/d9e/cf2 0 2024-09-19T06:08:50.901 INFO:tasks.workunit.client.0.smithi037.stdout:5/773: chown d2/d12/d24/d58/d96/dd7 455 1 2024-09-19T06:08:50.902 INFO:tasks.workunit.client.0.smithi037.stdout:4/939: dread d0/d6/d45/dd9/d36/f47 [0,4194304] 0 2024-09-19T06:08:50.902 INFO:tasks.workunit.client.0.smithi037.stdout:5/774: mkdir d2/d12/d28/d57/df3 0 2024-09-19T06:08:50.902 INFO:tasks.workunit.client.0.smithi037.stdout:4/940: symlink d0/d2/d37/d92/l129 0 2024-09-19T06:08:50.903 INFO:tasks.workunit.client.0.smithi037.stdout:4/941: symlink d0/d6/d1b/d30/dee/l12a 0 2024-09-19T06:08:50.903 INFO:tasks.workunit.client.0.smithi037.stdout:4/942: chown d0/d6/d45/d113/de5/ffa 4 1 2024-09-19T06:08:50.904 INFO:tasks.workunit.client.0.smithi037.stdout:4/943: creat d0/d6/d45/d113/de5/d6f/d8e/f12b x:0 0 0 2024-09-19T06:08:50.907 INFO:tasks.workunit.client.0.smithi037.stdout:5/775: dread d2/d12/d28/d22/fc1 [0,4194304] 0 2024-09-19T06:08:50.907 INFO:tasks.workunit.client.0.smithi037.stdout:5/776: write d2/d12/d28/d22/d35/dae/fc3 [5544634,67610] 0 2024-09-19T06:08:50.908 INFO:tasks.workunit.client.0.smithi037.stdout:5/777: symlink d2/d12/d24/d97/dbc/lf4 0 2024-09-19T06:08:50.908 INFO:tasks.workunit.client.0.smithi037.stdout:5/778: truncate d2/d12/d24/d58/d8e/fd2 675001 0 2024-09-19T06:08:50.915 INFO:tasks.workunit.client.0.smithi037.stdout:6/868: dwrite d9/dd/d2b/d42/fdd [0,4194304] 0 2024-09-19T06:08:50.915 INFO:tasks.workunit.client.0.smithi037.stdout:6/869: chown d9/d6e/d10c/d5a/d6d/d82 10 1 2024-09-19T06:08:50.922 INFO:tasks.workunit.client.0.smithi037.stdout:5/779: read d2/d10/daf/fb4 [1603014,35465] 0 2024-09-19T06:08:50.923 INFO:tasks.workunit.client.0.smithi037.stdout:4/944: read d0/f7a [3094459,100256] 0 2024-09-19T06:08:50.924 INFO:tasks.workunit.client.0.smithi037.stdout:4/945: getdents d0/d8f 0 2024-09-19T06:08:50.932 INFO:tasks.workunit.client.0.smithi037.stdout:6/870: write d9/d6e/d10c/d5a/d6d/d82/fa6 [4321483,30813] 0 2024-09-19T06:08:50.934 INFO:tasks.workunit.client.0.smithi037.stdout:6/871: mkdir d9/d6e/d10c/d5a/dd2/d118 0 2024-09-19T06:08:50.934 INFO:tasks.workunit.client.0.smithi037.stdout:5/780: dread d2/d12/d28/d22/d53/f7d [0,4194304] 0 2024-09-19T06:08:50.935 INFO:tasks.workunit.client.0.smithi037.stdout:6/872: rmdir d9/d6e/d10c/d5a/dd2 39 2024-09-19T06:08:50.935 INFO:tasks.workunit.client.0.smithi037.stdout:6/873: stat d9/d9c/f116 0 2024-09-19T06:08:50.935 INFO:tasks.workunit.client.0.smithi037.stdout:5/781: mknod d2/d12/d28/d22/d4a/d9f/cf5 0 2024-09-19T06:08:50.935 INFO:tasks.workunit.client.0.smithi037.stdout:5/782: write d2/d10/f4e [1522895,33502] 0 2024-09-19T06:08:50.936 INFO:tasks.workunit.client.0.smithi037.stdout:6/874: getdents d9/dd/d2b 0 2024-09-19T06:08:50.937 INFO:tasks.workunit.client.0.smithi037.stdout:6/875: mkdir d9/dd/d1c/d119 0 2024-09-19T06:08:50.937 INFO:tasks.workunit.client.0.smithi037.stdout:6/876: write d9/d6e/d10c/d5a/d6d/f72 [1156842,121285] 0 2024-09-19T06:08:50.938 INFO:tasks.workunit.client.0.smithi037.stdout:5/783: creat d2/d12/d28/d22/d87/ff6 x:0 0 0 2024-09-19T06:08:50.938 INFO:tasks.workunit.client.0.smithi037.stdout:5/784: chown d2/d12/d28/d22/d87/fab 23 1 2024-09-19T06:08:50.938 INFO:tasks.workunit.client.0.smithi037.stdout:5/785: chown d2/d12/d7e/de3 25893 1 2024-09-19T06:08:50.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:08:50 smithi099 ceph-mon[35300]: pgmap v429: 129 pgs: 129 active+clean; 1.3 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 146 MiB/s rd, 183 MiB/s wr, 259 op/s 2024-09-19T06:08:50.939 INFO:tasks.workunit.client.0.smithi037.stdout:6/877: unlink d9/d6e/d10c/d5a/d6d/d82/d9f/da4/fbe 0 2024-09-19T06:08:50.940 INFO:tasks.workunit.client.0.smithi037.stdout:6/878: write d9/dd/d1c/d4e/d33/f88 [2662896,120055] 0 2024-09-19T06:08:50.941 INFO:tasks.workunit.client.0.smithi037.stdout:5/786: rename d2/d12/d28/d22/d87/da8/cc5 to d2/d12/d24/d97/dbc/cf7 0 2024-09-19T06:08:50.941 INFO:tasks.workunit.client.0.smithi037.stdout:6/879: stat d9/d16/l5d 0 2024-09-19T06:08:50.942 INFO:tasks.workunit.client.0.smithi037.stdout:5/787: creat d2/d12/d24/d58/d96/ff8 x:0 0 0 2024-09-19T06:08:50.949 INFO:tasks.workunit.client.0.smithi037.stdout:4/946: dwrite d0/d6/d45/d113/de5/f117 [0,4194304] 0 2024-09-19T06:08:50.951 INFO:tasks.workunit.client.0.smithi037.stdout:4/947: symlink d0/d6/d103/l12c 0 2024-09-19T06:08:50.955 INFO:tasks.workunit.client.0.smithi037.stdout:6/880: write d9/d16/f4a [1253425,76776] 0 2024-09-19T06:08:50.956 INFO:tasks.workunit.client.0.smithi037.stdout:6/881: mkdir d9/dd/d2b/d11a 0 2024-09-19T06:08:50.957 INFO:tasks.workunit.client.0.smithi037.stdout:6/882: rmdir d9/d6e/d10c/d5a/dd2/de4 39 2024-09-19T06:08:50.957 INFO:tasks.workunit.client.0.smithi037.stdout:6/883: fsync d9/dd/d1c/d73/fa1 0 2024-09-19T06:08:50.958 INFO:tasks.workunit.client.0.smithi037.stdout:6/884: unlink d9/dd/d1c/c46 0 2024-09-19T06:08:50.959 INFO:tasks.workunit.client.0.smithi037.stdout:6/885: link d9/d6e/d10c/d5a/d6d/d82/d9f/fb8 d9/d6e/d10c/d5a/d6d/df6/f11b 0 2024-09-19T06:08:50.959 INFO:tasks.workunit.client.0.smithi037.stdout:6/886: fsync d9/d6e/d10c/d5a/d6d/d82/d9f/da4/fef 0 2024-09-19T06:08:50.969 INFO:tasks.workunit.client.0.smithi037.stdout:4/948: dread d0/d6/d45/d113/de5/f117 [0,4194304] 0 2024-09-19T06:08:50.969 INFO:tasks.workunit.client.0.smithi037.stdout:5/788: dwrite d2/d12/d28/d22/d4a/d9f/fec [0,4194304] 0 2024-09-19T06:08:50.971 INFO:tasks.workunit.client.0.smithi037.stdout:5/789: mkdir d2/d5c/dda/df9 0 2024-09-19T06:08:50.973 INFO:tasks.workunit.client.0.smithi037.stdout:5/790: symlink d2/d12/d28/d22/d4a/d9e/lfa 0 2024-09-19T06:08:50.973 INFO:tasks.workunit.client.0.smithi037.stdout:5/791: write d2/d12/d28/d22/d53/fef [701240,106796] 0 2024-09-19T06:08:50.977 INFO:tasks.workunit.client.0.smithi037.stdout:5/792: rmdir d2/d5c/dda/df9 0 2024-09-19T06:08:50.980 INFO:tasks.workunit.client.0.smithi037.stdout:5/793: rename d2/d12/d28/d22/d35/dae to d2/d12/d24/d58/d96/dd7/dfb 0 2024-09-19T06:08:50.980 INFO:tasks.workunit.client.0.smithi037.stdout:5/794: fsync d2/d12/d24/f51 0 2024-09-19T06:08:50.992 INFO:tasks.workunit.client.0.smithi037.stdout:4/949: write d0/d8f/fd3 [780191,2520] 0 2024-09-19T06:08:50.992 INFO:tasks.workunit.client.0.smithi037.stdout:4/950: fdatasync d0/f53 0 2024-09-19T06:08:50.992 INFO:tasks.workunit.client.0.smithi037.stdout:6/887: dwrite d9/dd/d1c/d4e/d65/f8b [0,4194304] 0 2024-09-19T06:08:50.992 INFO:tasks.workunit.client.0.smithi037.stdout:6/888: write d9/dd/d1c/d4e/d65/db0/fe6 [825871,130722] 0 2024-09-19T06:08:50.998 INFO:tasks.workunit.client.0.smithi037.stdout:4/951: rename d0/d2/d37/d92/l129 to d0/d6/d45/d113/de5/l12d 0 2024-09-19T06:08:50.998 INFO:tasks.workunit.client.0.smithi037.stdout:4/952: chown d0/d6/d1b/d20/d4d/d64/db0 3245467 1 2024-09-19T06:08:50.998 INFO:tasks.workunit.client.0.smithi037.stdout:4/953: write d0/f44 [1627533,51744] 0 2024-09-19T06:08:50.998 INFO:tasks.workunit.client.0.smithi037.stdout:4/954: stat d0/d6/d1b/d20/d48 0 2024-09-19T06:08:50.998 INFO:tasks.workunit.client.0.smithi037.stdout:6/889: creat d9/d6e/d10c/d5a/dd2/d118/f11c x:0 0 0 2024-09-19T06:08:50.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:08:50 smithi117 ceph-mon[35050]: pgmap v429: 129 pgs: 129 active+clean; 1.3 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 146 MiB/s rd, 183 MiB/s wr, 259 op/s 2024-09-19T06:08:50.999 INFO:tasks.workunit.client.0.smithi037.stdout:4/955: creat d0/d6/d1b/d30/f12e x:0 0 0 2024-09-19T06:08:51.000 INFO:tasks.workunit.client.0.smithi037.stdout:5/795: dwrite d2/d10/f1f [0,4194304] 0 2024-09-19T06:08:51.001 INFO:tasks.workunit.client.0.smithi037.stdout:6/890: creat d9/d6e/d10c/f11d x:0 0 0 2024-09-19T06:08:51.001 INFO:tasks.workunit.client.0.smithi037.stdout:6/891: chown d9/dd/caa 3945 1 2024-09-19T06:08:51.003 INFO:tasks.workunit.client.0.smithi037.stdout:4/956: unlink d0/d6/d1b/d30/d70/f10d 0 2024-09-19T06:08:51.005 INFO:tasks.workunit.client.0.smithi037.stdout:5/796: link d2/d12/d28/l1d d2/d12/d24/d58/d96/dd7/lfc 0 2024-09-19T06:08:51.007 INFO:tasks.workunit.client.0.smithi037.stdout:6/892: truncate d9/dd/d1c/d4e/f34 2203558 0 2024-09-19T06:08:51.009 INFO:tasks.workunit.client.0.smithi037.stdout:5/797: rename d2/d12/c92 to d2/d12/d24/d58/d7f/cfd 0 2024-09-19T06:08:51.009 INFO:tasks.workunit.client.0.smithi037.stdout:5/798: fsync d2/d12/d28/d22/d4a/d9e/fb1 0 2024-09-19T06:08:51.009 INFO:tasks.workunit.client.0.smithi037.stdout:5/799: write d2/d12/d24/d58/d8e/fd2 [1415990,51590] 0 2024-09-19T06:08:51.009 INFO:tasks.workunit.client.0.smithi037.stdout:5/800: chown d2/d5c/dda/lf0 15014 1 2024-09-19T06:08:51.010 INFO:tasks.workunit.client.0.smithi037.stdout:6/893: getdents d9 0 2024-09-19T06:08:51.011 INFO:tasks.workunit.client.0.smithi037.stdout:5/801: dread d2/d12/d24/d58/d7f/fc2 [0,4194304] 0 2024-09-19T06:08:51.012 INFO:tasks.workunit.client.0.smithi037.stdout:6/894: mknod d9/dd/d1c/d73/c11e 0 2024-09-19T06:08:51.012 INFO:tasks.workunit.client.0.smithi037.stdout:6/895: fdatasync d9/d6e/f8f 0 2024-09-19T06:08:51.014 INFO:tasks.workunit.client.0.smithi037.stdout:5/802: mkdir d2/d12/d28/d22/d87/da8/dfe 0 2024-09-19T06:08:51.015 INFO:tasks.workunit.client.0.smithi037.stdout:6/896: symlink d9/dd/d1c/d73/ddb/l11f 0 2024-09-19T06:08:51.016 INFO:tasks.workunit.client.0.smithi037.stdout:5/803: mknod d2/d12/d28/d57/cff 0 2024-09-19T06:08:51.017 INFO:tasks.workunit.client.0.smithi037.stdout:5/804: chown d2/d12/d28/d22/d35 0 1 2024-09-19T06:08:51.017 INFO:tasks.workunit.client.0.smithi037.stdout:6/897: symlink d9/dd/d2b/d79/dd3/l120 0 2024-09-19T06:08:51.018 INFO:tasks.workunit.client.0.smithi037.stdout:5/805: symlink d2/d12/d28/d22/d4a/d9f/de8/l100 0 2024-09-19T06:08:51.021 INFO:tasks.workunit.client.0.smithi037.stdout:6/898: rename d9/d6e/f8f to d9/d6e/d10c/d5a/d6d/f121 0 2024-09-19T06:08:51.021 INFO:tasks.workunit.client.0.smithi037.stdout:6/899: write d9/d9c/feb [570115,37580] 0 2024-09-19T06:08:51.022 INFO:tasks.workunit.client.0.smithi037.stdout:4/957: dwrite d0/d6/d45/d113/de5/d86/f9e [0,4194304] 0 2024-09-19T06:08:51.022 INFO:tasks.workunit.client.0.smithi037.stdout:4/958: truncate d0/d6/d1b/d20/d77/fad 1075993 0 2024-09-19T06:08:51.022 INFO:tasks.workunit.client.0.smithi037.stdout:5/806: creat d2/d12/d24/d58/d96/dd7/f101 x:0 0 0 2024-09-19T06:08:51.023 INFO:tasks.workunit.client.0.smithi037.stdout:6/900: link d9/dd/d1c/d4e/d65/db0/lf2 d9/dd/d2b/d42/dad/l122 0 2024-09-19T06:08:51.026 INFO:tasks.workunit.client.0.smithi037.stdout:8/922: sync 2024-09-19T06:08:51.026 INFO:tasks.workunit.client.0.smithi037.stdout:7/825: sync 2024-09-19T06:08:51.026 INFO:tasks.workunit.client.0.smithi037.stdout:0/850: sync 2024-09-19T06:08:51.026 INFO:tasks.workunit.client.0.smithi037.stdout:9/923: sync 2024-09-19T06:08:51.026 INFO:tasks.workunit.client.0.smithi037.stdout:9/924: fsync da/f9a 0 2024-09-19T06:08:51.026 INFO:tasks.workunit.client.0.smithi037.stdout:9/925: dread - da/dec/d116/d1b/d62/fa8 zero size 2024-09-19T06:08:51.026 INFO:tasks.workunit.client.0.smithi037.stdout:9/926: stat da/dec/d116/c14 0 2024-09-19T06:08:51.029 INFO:tasks.workunit.client.0.smithi037.stdout:4/959: symlink d0/d6/d45/d113/de5/de1/d104/l12f 0 2024-09-19T06:08:51.030 INFO:tasks.workunit.client.0.smithi037.stdout:5/807: mkdir d2/d12/d24/d58/dbf/d102 0 2024-09-19T06:08:51.031 INFO:tasks.workunit.client.0.smithi037.stdout:6/901: mkdir d9/dd/d2b/d42/d123 0 2024-09-19T06:08:51.033 INFO:tasks.workunit.client.0.smithi037.stdout:8/923: mkdir d1/d61/d7e/dbc/dc0/df5/d13f 0 2024-09-19T06:08:51.034 INFO:tasks.workunit.client.0.smithi037.stdout:0/851: creat d5/d42/f126 x:0 0 0 2024-09-19T06:08:51.036 INFO:tasks.workunit.client.0.smithi037.stdout:7/826: creat d6/d20/d4b/d60/d33/d61/f109 x:0 0 0 2024-09-19T06:08:51.036 INFO:tasks.workunit.client.0.smithi037.stdout:7/827: read - d6/d20/d34/d7d/fe5 zero size 2024-09-19T06:08:51.036 INFO:tasks.workunit.client.0.smithi037.stdout:7/828: fsync d6/dc/f94 0 2024-09-19T06:08:51.036 INFO:tasks.workunit.client.0.smithi037.stdout:7/829: fdatasync d6/f3d 0 2024-09-19T06:08:51.036 INFO:tasks.workunit.client.0.smithi037.stdout:7/830: chown d6/dc/df/f13 26 1 2024-09-19T06:08:51.037 INFO:tasks.workunit.client.0.smithi037.stdout:9/927: mknod da/dec/d116/d1b/d23/d6a/d82/dde/c14e 0 2024-09-19T06:08:51.038 INFO:tasks.workunit.client.0.smithi037.stdout:6/902: mknod d9/d78/c124 0 2024-09-19T06:08:51.039 INFO:tasks.workunit.client.0.smithi037.stdout:8/924: creat d1/d35/d118/d123/f140 x:0 0 0 2024-09-19T06:08:51.039 INFO:tasks.workunit.client.0.smithi037.stdout:8/925: chown d1/dc8/ff6 4022 1 2024-09-19T06:08:51.041 INFO:tasks.workunit.client.0.smithi037.stdout:9/928: rmdir da/dec/d116/d1b/d2f/dcc/de7 39 2024-09-19T06:08:51.041 INFO:tasks.workunit.client.0.smithi037.stdout:9/929: write da/dec/d116/f50 [841405,45559] 0 2024-09-19T06:08:51.041 INFO:tasks.workunit.client.0.smithi037.stdout:7/831: dread d6/dc/fa6 [0,4194304] 0 2024-09-19T06:08:51.041 INFO:tasks.workunit.client.0.smithi037.stdout:8/926: getdents d1/d6a/d136/d9b 0 2024-09-19T06:08:51.046 INFO:tasks.workunit.client.0.smithi037.stdout:0/852: write d5/d20/faa [205161,25634] 0 2024-09-19T06:08:51.048 INFO:tasks.workunit.client.0.smithi037.stdout:3/774: sync 2024-09-19T06:08:51.048 INFO:tasks.workunit.client.0.smithi037.stdout:2/915: sync 2024-09-19T06:08:51.048 INFO:tasks.workunit.client.0.smithi037.stdout:1/755: sync 2024-09-19T06:08:51.048 INFO:tasks.workunit.client.0.smithi037.stdout:7/832: mknod d6/d20/d34/dc0/dcf/dec/c10a 0 2024-09-19T06:08:51.049 INFO:tasks.workunit.client.0.smithi037.stdout:7/833: fdatasync d6/d20/d4b/d60/d33/d61/f109 0 2024-09-19T06:08:51.049 INFO:tasks.workunit.client.0.smithi037.stdout:5/808: dread d2/f7a [0,4194304] 0 2024-09-19T06:08:51.050 INFO:tasks.workunit.client.0.smithi037.stdout:3/775: rename d0/d16/l6e to d0/d43/l102 0 2024-09-19T06:08:51.051 INFO:tasks.workunit.client.0.smithi037.stdout:3/776: write d0/d43/f94 [275562,79990] 0 2024-09-19T06:08:51.051 INFO:tasks.workunit.client.0.smithi037.stdout:3/777: chown d0/d16/f88 810716265 1 2024-09-19T06:08:51.051 INFO:tasks.workunit.client.0.smithi037.stdout:2/916: symlink d1/da/d127/l137 0 2024-09-19T06:08:51.052 INFO:tasks.workunit.client.0.smithi037.stdout:7/834: creat d6/f10b x:0 0 0 2024-09-19T06:08:51.052 INFO:tasks.workunit.client.0.smithi037.stdout:7/835: truncate d6/d20/d4b/fd3 357600 0 2024-09-19T06:08:51.053 INFO:tasks.workunit.client.0.smithi037.stdout:3/778: creat d0/d16/d19/d1d/dd1/f103 x:0 0 0 2024-09-19T06:08:51.054 INFO:tasks.workunit.client.0.smithi037.stdout:3/779: chown d0/cd 2 1 2024-09-19T06:08:51.055 INFO:tasks.workunit.client.0.smithi037.stdout:7/836: symlink d6/d20/d34/dc0/dcf/l10c 0 2024-09-19T06:08:51.056 INFO:tasks.workunit.client.0.smithi037.stdout:2/917: symlink d1/da/d95/l138 0 2024-09-19T06:08:51.058 INFO:tasks.workunit.client.0.smithi037.stdout:4/960: dwrite d0/f44 [0,4194304] 0 2024-09-19T06:08:51.060 INFO:tasks.workunit.client.0.smithi037.stdout:2/918: mkdir d1/da/d95/d139 0 2024-09-19T06:08:51.060 INFO:tasks.workunit.client.0.smithi037.stdout:2/919: write d1/da/dc/f45 [1648664,14413] 0 2024-09-19T06:08:51.060 INFO:tasks.workunit.client.0.smithi037.stdout:9/930: read da/dec/d116/d1b/d23/de9/fa6 [3818691,103687] 0 2024-09-19T06:08:51.060 INFO:tasks.workunit.client.0.smithi037.stdout:4/961: mknod d0/d2/d37/d92/c130 0 2024-09-19T06:08:51.061 INFO:tasks.workunit.client.0.smithi037.stdout:4/962: symlink d0/d6/d1b/d20/d4d/d65/d10f/l131 0 2024-09-19T06:08:51.063 INFO:tasks.workunit.client.0.smithi037.stdout:4/963: mkdir d0/d6/d1b/d30/d132 0 2024-09-19T06:08:51.063 INFO:tasks.workunit.client.0.smithi037.stdout:1/756: dread d2/d12/d15/f36 [0,4194304] 0 2024-09-19T06:08:51.063 INFO:tasks.workunit.client.0.smithi037.stdout:1/757: getdents d2/d12/d1e/d2a/d2e/df9 0 2024-09-19T06:08:51.064 INFO:tasks.workunit.client.0.smithi037.stdout:9/931: dread da/dec/d116/d131/f4e [0,4194304] 0 2024-09-19T06:08:51.065 INFO:tasks.workunit.client.0.smithi037.stdout:9/932: getdents da/dec/d116/d131 0 2024-09-19T06:08:51.069 INFO:tasks.workunit.client.0.smithi037.stdout:0/853: dread d5/dd5/de9/f90 [0,4194304] 0 2024-09-19T06:08:51.074 INFO:tasks.workunit.client.0.smithi037.stdout:8/927: dwrite d1/d61/d7b/fe2 [0,4194304] 0 2024-09-19T06:08:51.074 INFO:tasks.workunit.client.0.smithi037.stdout:2/920: dread d1/da/dc/d21/d7d/d80/fff [0,4194304] 0 2024-09-19T06:08:51.075 INFO:tasks.workunit.client.0.smithi037.stdout:2/921: truncate d1/d16/d96/fd3 479131 0 2024-09-19T06:08:51.075 INFO:tasks.workunit.client.0.smithi037.stdout:9/933: mkdir da/d4d/dbb/d14f 0 2024-09-19T06:08:51.078 INFO:tasks.workunit.client.0.smithi037.stdout:8/928: creat d1/d61/d7e/d8b/d9f/de4/d122/f141 x:0 0 0 2024-09-19T06:08:51.078 INFO:tasks.workunit.client.0.smithi037.stdout:4/964: dread d0/f53 [0,4194304] 0 2024-09-19T06:08:51.078 INFO:tasks.workunit.client.0.smithi037.stdout:2/922: mkdir d1/da/dc/d21/d55/dbc/db0/de0/d13a 0 2024-09-19T06:08:51.079 INFO:tasks.workunit.client.0.smithi037.stdout:8/929: creat d1/d61/d7e/d8b/d9f/de4/d122/f142 x:0 0 0 2024-09-19T06:08:51.080 INFO:tasks.workunit.client.0.smithi037.stdout:8/930: fsync d1/d61/d7e/d8b/d91/d3d/f22 0 2024-09-19T06:08:51.080 INFO:tasks.workunit.client.0.smithi037.stdout:8/931: chown d1/d6a/d136/d59/c80 5 1 2024-09-19T06:08:51.081 INFO:tasks.workunit.client.0.smithi037.stdout:4/965: creat d0/d6/d45/dd9/d36/d126/f133 x:0 0 0 2024-09-19T06:08:51.082 INFO:tasks.workunit.client.0.smithi037.stdout:4/966: mknod d0/d6/d45/d113/de5/d6f/da9/dba/c134 0 2024-09-19T06:08:51.082 INFO:tasks.workunit.client.0.smithi037.stdout:4/967: chown d0/d6/d45/d113/de5/fac 4434362 1 2024-09-19T06:08:51.083 INFO:tasks.workunit.client.0.smithi037.stdout:4/968: fdatasync d0/d6/d1b/f78 0 2024-09-19T06:08:51.083 INFO:tasks.workunit.client.0.smithi037.stdout:4/969: chown d0/d6/d45/dd9/d36/f63 80 1 2024-09-19T06:08:51.083 INFO:tasks.workunit.client.0.smithi037.stdout:4/970: write d0/d6/d1b/d20/fd6 [612753,55074] 0 2024-09-19T06:08:51.083 INFO:tasks.workunit.client.0.smithi037.stdout:4/971: fsync d0/d6/d1b/d20/d77/fce 0 2024-09-19T06:08:51.084 INFO:tasks.workunit.client.0.smithi037.stdout:0/854: dread d5/d20/f7c [0,4194304] 0 2024-09-19T06:08:51.085 INFO:tasks.workunit.client.0.smithi037.stdout:0/855: chown d5/d8/d79/d9a/ddb/f100 368786 1 2024-09-19T06:08:51.086 INFO:tasks.workunit.client.0.smithi037.stdout:4/972: symlink d0/d6/d1b/d20/d4d/d64/de7/l135 0 2024-09-19T06:08:51.086 INFO:tasks.workunit.client.0.smithi037.stdout:4/973: write d0/d6/d1b/d20/d4d/d64/db0/dc4/fc8 [4832344,62817] 0 2024-09-19T06:08:51.088 INFO:tasks.workunit.client.0.smithi037.stdout:4/974: creat d0/d6/d1b/d20/d77/f136 x:0 0 0 2024-09-19T06:08:51.090 INFO:tasks.workunit.client.0.smithi037.stdout:9/934: dread da/dec/d116/d1b/d43/f46 [0,4194304] 0 2024-09-19T06:08:51.090 INFO:tasks.workunit.client.0.smithi037.stdout:4/975: mkdir d0/d6/d1b/d30/d80/d137 0 2024-09-19T06:08:51.091 INFO:tasks.workunit.client.0.smithi037.stdout:3/780: dwrite d0/d16/d19/d33/fec [0,4194304] 0 2024-09-19T06:08:51.091 INFO:tasks.workunit.client.0.smithi037.stdout:3/781: chown d0/d5f/da0/fb1 3 1 2024-09-19T06:08:51.092 INFO:tasks.workunit.client.0.smithi037.stdout:4/976: symlink d0/d6/d45/d128/l138 0 2024-09-19T06:08:51.092 INFO:tasks.workunit.client.0.smithi037.stdout:4/977: dread - d0/d6/d45/d113/de5/d6f/d8e/f12b zero size 2024-09-19T06:08:51.097 INFO:tasks.workunit.client.0.smithi037.stdout:3/782: creat d0/d16/d19/d33/d87/dbd/f104 x:0 0 0 2024-09-19T06:08:51.099 INFO:tasks.workunit.client.0.smithi037.stdout:1/758: dwrite d2/d12/d1e/d2a/d8f/fa1 [0,4194304] 0 2024-09-19T06:08:51.101 INFO:tasks.workunit.client.0.smithi037.stdout:1/759: dread d2/d73/f7b [0,4194304] 0 2024-09-19T06:08:51.101 INFO:tasks.workunit.client.0.smithi037.stdout:7/837: dwrite d6/d20/f3c [0,4194304] 0 2024-09-19T06:08:51.105 INFO:tasks.workunit.client.0.smithi037.stdout:7/838: dread d6/d20/d4b/d60/f8b [0,4194304] 0 2024-09-19T06:08:51.105 INFO:tasks.workunit.client.0.smithi037.stdout:7/839: dread - d6/d20/d4b/d60/fe8 zero size 2024-09-19T06:08:51.105 INFO:tasks.workunit.client.0.smithi037.stdout:9/935: dread da/dec/d116/f50 [0,4194304] 0 2024-09-19T06:08:51.106 INFO:tasks.workunit.client.0.smithi037.stdout:7/840: symlink d6/d20/d34/dc0/dcf/d105/l10d 0 2024-09-19T06:08:51.107 INFO:tasks.workunit.client.0.smithi037.stdout:7/841: mknod d6/d20/d34/d49/d100/c10e 0 2024-09-19T06:08:51.107 INFO:tasks.workunit.client.0.smithi037.stdout:7/842: rename d6/d20/d34/dc0/dcf to d6/d20/d34/dc0/dcf/d10f 22 2024-09-19T06:08:51.107 INFO:tasks.workunit.client.0.smithi037.stdout:7/843: chown d6/dc/ld1 8784332 1 2024-09-19T06:08:51.108 INFO:tasks.workunit.client.0.smithi037.stdout:7/844: symlink d6/l110 0 2024-09-19T06:08:51.108 INFO:tasks.workunit.client.0.smithi037.stdout:7/845: fdatasync d6/dc/df/fae 0 2024-09-19T06:08:51.108 INFO:tasks.workunit.client.0.smithi037.stdout:7/846: chown d6/dc/daf 0 1 2024-09-19T06:08:51.108 INFO:tasks.workunit.client.0.smithi037.stdout:7/847: chown d6/dc/df/c106 2596 1 2024-09-19T06:08:51.109 INFO:tasks.workunit.client.0.smithi037.stdout:7/848: mkdir d6/d20/d4b/d60/d33/d8c/d111 0 2024-09-19T06:08:51.109 INFO:tasks.workunit.client.0.smithi037.stdout:7/849: truncate d6/dc/f25 5030748 0 2024-09-19T06:08:51.110 INFO:tasks.workunit.client.0.smithi037.stdout:7/850: creat d6/d20/d4b/d60/d33/d8c/f112 x:0 0 0 2024-09-19T06:08:51.110 INFO:tasks.workunit.client.0.smithi037.stdout:7/851: chown d6/l43 1375 1 2024-09-19T06:08:51.112 INFO:tasks.workunit.client.0.smithi037.stdout:7/852: link d6/l43 d6/dc/df/d7e/l113 0 2024-09-19T06:08:51.113 INFO:tasks.workunit.client.0.smithi037.stdout:7/853: getdents d6/d20/d4b/d60/d33/d9f 0 2024-09-19T06:08:51.113 INFO:tasks.workunit.client.0.smithi037.stdout:7/854: readlink d6/dc/df/l1f 0 2024-09-19T06:08:51.117 INFO:tasks.workunit.client.0.smithi037.stdout:1/760: dread d2/d12/d1d/f4f [0,4194304] 0 2024-09-19T06:08:51.117 INFO:tasks.workunit.client.0.smithi037.stdout:1/761: chown d2/d12/d15/d34/d90/fed 3757816 1 2024-09-19T06:08:51.117 INFO:tasks.workunit.client.0.smithi037.stdout:1/762: write d2/d12/d15/d34/f7c [739904,72383] 0 2024-09-19T06:08:51.119 INFO:tasks.workunit.client.0.smithi037.stdout:1/763: link d2/d12/d1d/d47/f72 d2/d12/d1e/d2a/ffe 0 2024-09-19T06:08:51.120 INFO:tasks.workunit.client.0.smithi037.stdout:1/764: stat d2/d12/d1e/d2a/d2e/l6c 0 2024-09-19T06:08:51.120 INFO:tasks.workunit.client.0.smithi037.stdout:9/936: dread da/dec/d116/d1b/d43/f66 [0,4194304] 0 2024-09-19T06:08:51.120 INFO:tasks.workunit.client.0.smithi037.stdout:9/937: chown da/dec/d116/d1b/d23/d6a/d82/dde 10 1 2024-09-19T06:08:51.120 INFO:tasks.workunit.client.0.smithi037.stdout:1/765: creat d2/d12/d1e/d2d/d6f/fff x:0 0 0 2024-09-19T06:08:51.121 INFO:tasks.workunit.client.0.smithi037.stdout:3/783: dwrite d0/d16/d19/f1c [0,4194304] 0 2024-09-19T06:08:51.121 INFO:tasks.workunit.client.0.smithi037.stdout:9/938: creat da/dec/d116/d1b/d2f/dcc/de7/f150 x:0 0 0 2024-09-19T06:08:51.122 INFO:tasks.workunit.client.0.smithi037.stdout:9/939: truncate da/d20/fc2 3063459 0 2024-09-19T06:08:51.123 INFO:tasks.workunit.client.0.smithi037.stdout:9/940: getdents da/dec/d116/d1b/d23/d3f 0 2024-09-19T06:08:51.134 INFO:tasks.workunit.client.0.smithi037.stdout:3/784: dread d0/d16/d19/d33/f9d [0,4194304] 0 2024-09-19T06:08:51.134 INFO:tasks.workunit.client.0.smithi037.stdout:3/785: getdents d0/d43/d23/d7a/d77/d45/d55 0 2024-09-19T06:08:51.134 INFO:tasks.workunit.client.0.smithi037.stdout:3/786: truncate d0/f9 2681476 0 2024-09-19T06:08:51.135 INFO:tasks.workunit.client.0.smithi037.stdout:3/787: dread d0/d16/da6/fbf [0,4194304] 0 2024-09-19T06:08:51.135 INFO:tasks.workunit.client.0.smithi037.stdout:3/788: dread - d0/fff zero size 2024-09-19T06:08:51.135 INFO:tasks.workunit.client.0.smithi037.stdout:3/789: chown d0/d16/d19/f2e 3318 1 2024-09-19T06:08:51.135 INFO:tasks.workunit.client.0.smithi037.stdout:9/941: dread da/dec/d116/d131/fcb [0,4194304] 0 2024-09-19T06:08:51.136 INFO:tasks.workunit.client.0.smithi037.stdout:3/790: creat d0/d96/f105 x:0 0 0 2024-09-19T06:08:51.136 INFO:tasks.workunit.client.0.smithi037.stdout:3/791: mkdir d0/d16/d19/d1d/dd1/d106 0 2024-09-19T06:08:51.138 INFO:tasks.workunit.client.0.smithi037.stdout:3/792: unlink d0/d43/fe7 0 2024-09-19T06:08:51.138 INFO:tasks.workunit.client.0.smithi037.stdout:3/793: write d0/d16/da6/dd4/fe4 [367290,91301] 0 2024-09-19T06:08:51.138 INFO:tasks.workunit.client.0.smithi037.stdout:3/794: truncate d0/d16/d19/d1d/d82/d86/faf 1305149 0 2024-09-19T06:08:51.139 INFO:tasks.workunit.client.0.smithi037.stdout:3/795: rename d0/d16/f71 to d0/d43/d23/d7a/d77/db8/f107 0 2024-09-19T06:08:51.141 INFO:tasks.workunit.client.0.smithi037.stdout:3/796: unlink d0/d16/d19/fb2 0 2024-09-19T06:08:51.141 INFO:tasks.workunit.client.0.smithi037.stdout:3/797: readlink d0/d16/d19/d1d/d5e/da9/ld8 0 2024-09-19T06:08:51.141 INFO:tasks.workunit.client.0.smithi037.stdout:3/798: mknod d0/d96/c108 0 2024-09-19T06:08:51.142 INFO:tasks.workunit.client.0.smithi037.stdout:3/799: truncate d0/d43/fa4 31146 0 2024-09-19T06:08:51.143 INFO:tasks.workunit.client.0.smithi037.stdout:3/800: unlink d0/d16/f22 0 2024-09-19T06:08:51.147 INFO:tasks.workunit.client.0.smithi037.stdout:3/801: dread d0/d43/d23/f8d [0,4194304] 0 2024-09-19T06:08:51.147 INFO:tasks.workunit.client.0.smithi037.stdout:3/802: readlink d0/d43/d23/d7a/d77/dc3/df8/lf7 0 2024-09-19T06:08:51.171 INFO:tasks.workunit.client.0.smithi037.stdout:8/932: dwrite d1/d6a/fa7 [0,4194304] 0 2024-09-19T06:08:51.172 INFO:tasks.workunit.client.0.smithi037.stdout:8/933: chown d1/d6a/d136/d9b/f120 3669406 1 2024-09-19T06:08:51.174 INFO:tasks.workunit.client.0.smithi037.stdout:8/934: rename d1/d61/d7e/d8b/d91/d3d/d66/fbb to d1/d35/d118/d123/f143 0 2024-09-19T06:08:51.174 INFO:tasks.workunit.client.0.smithi037.stdout:8/935: fsync d1/d61/f77 0 2024-09-19T06:08:51.181 INFO:tasks.workunit.client.0.smithi037.stdout:8/936: mkdir d1/d61/d7e/dbc/dd0/d144 0 2024-09-19T06:08:51.183 INFO:tasks.workunit.client.0.smithi037.stdout:8/937: mkdir d1/d6a/d136/d59/d5d/dfc/d145 0 2024-09-19T06:08:51.183 INFO:tasks.workunit.client.0.smithi037.stdout:8/938: write d1/d61/d7e/d8b/d91/deb/f132 [1303021,68946] 0 2024-09-19T06:08:51.184 INFO:tasks.workunit.client.0.smithi037.stdout:8/939: symlink d1/d61/d7e/d134/l146 0 2024-09-19T06:08:51.185 INFO:tasks.workunit.client.0.smithi037.stdout:8/940: creat d1/d8f/da1/f147 x:0 0 0 2024-09-19T06:08:51.186 INFO:tasks.workunit.client.0.smithi037.stdout:8/941: unlink d1/d6a/d136/l10a 0 2024-09-19T06:08:51.196 INFO:tasks.workunit.client.0.smithi037.stdout:8/942: dread d1/d6a/d136/d59/d5d/f81 [0,4194304] 0 2024-09-19T06:08:51.201 INFO:tasks.workunit.client.0.smithi037.stdout:8/943: dread d1/f10 [0,4194304] 0 2024-09-19T06:08:51.203 INFO:tasks.workunit.client.0.smithi037.stdout:8/944: symlink d1/d6a/d136/d59/d5d/dfc/l148 0 2024-09-19T06:08:51.203 INFO:tasks.workunit.client.0.smithi037.stdout:8/945: write d1/dc7/ff3 [604109,112616] 0 2024-09-19T06:08:51.203 INFO:tasks.workunit.client.0.smithi037.stdout:8/946: chown d1/d35/d118/d123/f140 2352654 1 2024-09-19T06:08:51.217 INFO:tasks.workunit.client.0.smithi037.stdout:7/855: dwrite d6/d20/d34/f58 [0,4194304] 0 2024-09-19T06:08:51.217 INFO:tasks.workunit.client.0.smithi037.stdout:8/947: write d1/d61/d7e/d8b/d91/d3d/f39 [35736,121904] 0 2024-09-19T06:08:51.217 INFO:tasks.workunit.client.0.smithi037.stdout:3/803: dwrite d0/d16/d19/d1d/d5e/fde [0,4194304] 0 2024-09-19T06:08:51.219 INFO:tasks.workunit.client.0.smithi037.stdout:7/856: mknod d6/d20/d4b/d60/d33/d8c/d111/c114 0 2024-09-19T06:08:51.219 INFO:tasks.workunit.client.0.smithi037.stdout:7/857: truncate d6/dc/d22/d59/da8/dc4/f103 590583 0 2024-09-19T06:08:51.219 INFO:tasks.workunit.client.0.smithi037.stdout:7/858: chown l3 1781 1 2024-09-19T06:08:51.219 INFO:tasks.workunit.client.0.smithi037.stdout:8/948: mknod d1/d61/d7e/d8b/d91/d3d/c149 0 2024-09-19T06:08:51.224 INFO:tasks.workunit.client.0.smithi037.stdout:3/804: mknod d0/d43/d23/d7a/d77/dc3/dfb/c109 0 2024-09-19T06:08:51.225 INFO:tasks.workunit.client.0.smithi037.stdout:7/859: rename d6/d20/d4b/d60/d33/d61/f109 to d6/dad/f115 0 2024-09-19T06:08:51.226 INFO:tasks.workunit.client.0.smithi037.stdout:1/766: write d2/d12/d17/f9d [615156,58334] 0 2024-09-19T06:08:51.226 INFO:tasks.workunit.client.0.smithi037.stdout:8/949: creat d1/d61/d7e/d8b/d91/d3d/f14a x:0 0 0 2024-09-19T06:08:51.227 INFO:tasks.workunit.client.0.smithi037.stdout:7/860: link d6/d20/d4b/d60/c2e d6/dc/df/d7e/c116 0 2024-09-19T06:08:51.228 INFO:tasks.workunit.client.0.smithi037.stdout:1/767: truncate d2/d12/d1e/d2a/f60 2472842 0 2024-09-19T06:08:51.228 INFO:tasks.workunit.client.0.smithi037.stdout:1/768: chown d2/d12/d1e/d63/cc1 982603702 1 2024-09-19T06:08:51.229 INFO:tasks.workunit.client.0.smithi037.stdout:1/769: write d2/d73/f7b [121896,102039] 0 2024-09-19T06:08:51.229 INFO:tasks.workunit.client.0.smithi037.stdout:1/770: truncate d2/d12/d15/d5c/fca 175182 0 2024-09-19T06:08:51.230 INFO:tasks.workunit.client.0.smithi037.stdout:8/950: link d1/d6a/d136/l70 d1/d35/d118/l14b 0 2024-09-19T06:08:51.230 INFO:tasks.workunit.client.0.smithi037.stdout:8/951: read d1/d6a/d136/d59/d5d/f7c [451616,130728] 0 2024-09-19T06:08:51.230 INFO:tasks.workunit.client.0.smithi037.stdout:8/952: chown d1/d35/d118/f11d 3120576 1 2024-09-19T06:08:51.231 INFO:tasks.workunit.client.0.smithi037.stdout:7/861: creat d6/d20/d4b/f117 x:0 0 0 2024-09-19T06:08:51.231 INFO:tasks.workunit.client.0.smithi037.stdout:1/771: getdents d2/d73 0 2024-09-19T06:08:51.232 INFO:tasks.workunit.client.0.smithi037.stdout:8/953: mknod d1/d61/d7e/dbc/dc0/d113/c14c 0 2024-09-19T06:08:51.233 INFO:tasks.workunit.client.0.smithi037.stdout:1/772: mknod d2/d12/d1e/d2d/c100 0 2024-09-19T06:08:51.234 INFO:tasks.workunit.client.0.smithi037.stdout:8/954: truncate d1/d61/d7e/d8b/d9f/de4/fe7 4127910 0 2024-09-19T06:08:51.236 INFO:tasks.workunit.client.0.smithi037.stdout:1/773: truncate d2/d12/d1e/d2a/f65 2586058 0 2024-09-19T06:08:51.236 INFO:tasks.workunit.client.0.smithi037.stdout:8/955: rename d1/d61/d7e/d8b/d91/d3d/c25 to d1/d61/d7e/d8b/d9f/c14d 0 2024-09-19T06:08:51.243 INFO:tasks.workunit.client.0.smithi037.stdout:1/774: rename d2/d12/d1d/d6b/fb0 to d2/d12/d15/d34/f101 0 2024-09-19T06:08:51.243 INFO:tasks.workunit.client.0.smithi037.stdout:1/775: chown d2/d12/d1d/d6b/ld1 2 1 2024-09-19T06:08:51.243 INFO:tasks.workunit.client.0.smithi037.stdout:1/776: chown d2/d12/d1e/d2d/f4c 672268 1 2024-09-19T06:08:51.246 INFO:tasks.workunit.client.0.smithi037.stdout:7/862: dread d6/dc/f16 [0,4194304] 0 2024-09-19T06:08:51.246 INFO:tasks.workunit.client.0.smithi037.stdout:3/805: dwrite d0/d43/d23/d7a/d77/f5c [0,4194304] 0 2024-09-19T06:08:51.246 INFO:tasks.workunit.client.0.smithi037.stdout:3/806: chown d0/l44 273215 1 2024-09-19T06:08:51.248 INFO:tasks.workunit.client.0.smithi037.stdout:3/807: dread d0/d5f/d70/f78 [0,4194304] 0 2024-09-19T06:08:51.250 INFO:tasks.workunit.client.0.smithi037.stdout:3/808: symlink d0/d16/l10a 0 2024-09-19T06:08:51.252 INFO:tasks.workunit.client.0.smithi037.stdout:6/903: sync 2024-09-19T06:08:51.252 INFO:tasks.workunit.client.0.smithi037.stdout:6/904: readlink d9/dd/d2b/d79/lf3 0 2024-09-19T06:08:51.259 INFO:tasks.workunit.client.0.smithi037.stdout:8/956: dwrite d1/d6a/d136/d59/d5d/f60 [0,4194304] 0 2024-09-19T06:08:51.261 INFO:tasks.workunit.client.0.smithi037.stdout:1/777: read d2/d48/f62 [3754951,119137] 0 2024-09-19T06:08:51.266 INFO:tasks.workunit.client.0.smithi037.stdout:3/809: write d0/d43/d23/f2a [368331,87701] 0 2024-09-19T06:08:51.291 INFO:tasks.workunit.client.0.smithi037.stdout:1/778: write d2/d12/d1d/f1f [3078446,39631] 0 2024-09-19T06:08:51.291 INFO:tasks.workunit.client.0.smithi037.stdout:6/905: dwrite d9/d6e/d10c/d5a/d6d/d82/fe1 [0,4194304] 0 2024-09-19T06:08:51.291 INFO:tasks.workunit.client.0.smithi037.stdout:1/779: fsync d2/d12/d15/d34/f101 0 2024-09-19T06:08:51.291 INFO:tasks.workunit.client.0.smithi037.stdout:8/957: dwrite d1/d61/d7e/d8b/d9f/de4/d122/f142 [0,4194304] 0 2024-09-19T06:08:51.291 INFO:tasks.workunit.client.0.smithi037.stdout:8/958: dread - d1/d8f/da1/f147 zero size 2024-09-19T06:08:51.293 INFO:tasks.workunit.client.0.smithi037.stdout:6/906: mkdir d9/dd/d2b/d79/d125 0 2024-09-19T06:08:51.293 INFO:tasks.workunit.client.0.smithi037.stdout:6/907: dread - d9/dd/d1c/d4e/d65/ffd zero size 2024-09-19T06:08:51.294 INFO:tasks.workunit.client.0.smithi037.stdout:6/908: getdents d9/d16/dc5 0 2024-09-19T06:08:51.295 INFO:tasks.workunit.client.0.smithi037.stdout:6/909: mkdir d9/d6e/d10c/d5a/dd2/d118/d126 0 2024-09-19T06:08:51.297 INFO:tasks.workunit.client.0.smithi037.stdout:6/910: creat d9/d6e/d10c/d5a/d6d/d82/da9/f127 x:0 0 0 2024-09-19T06:08:51.297 INFO:tasks.workunit.client.0.smithi037.stdout:6/911: symlink d9/dd/d1c/l128 0 2024-09-19T06:08:51.298 INFO:tasks.workunit.client.0.smithi037.stdout:3/810: dwrite d0/d16/d19/fe8 [0,4194304] 0 2024-09-19T06:08:51.311 INFO:tasks.workunit.client.0.smithi037.stdout:1/780: write d2/d12/d1e/d75/f88 [1780865,89715] 0 2024-09-19T06:08:51.311 INFO:tasks.workunit.client.0.smithi037.stdout:1/781: chown d2/d12/d1e/d2d/d6f/dac 4 1 2024-09-19T06:08:51.312 INFO:tasks.workunit.client.0.smithi037.stdout:1/782: truncate d2/d12/d15/dd3/dd4/ffc 524647 0 2024-09-19T06:08:51.315 INFO:tasks.workunit.client.0.smithi037.stdout:8/959: dwrite d1/d61/d68/fcb [0,4194304] 0 2024-09-19T06:08:51.316 INFO:tasks.workunit.client.0.smithi037.stdout:8/960: chown d1/d6a/d136/d59/daf/l112 2585 1 2024-09-19T06:08:51.317 INFO:tasks.workunit.client.0.smithi037.stdout:1/783: dread d2/d12/d1e/d63/f93 [0,4194304] 0 2024-09-19T06:08:51.317 INFO:tasks.workunit.client.0.smithi037.stdout:1/784: fsync d2/d12/d1d/d6b/fe7 0 2024-09-19T06:08:51.318 INFO:tasks.workunit.client.0.smithi037.stdout:1/785: rmdir d2/d12/d15/d34 39 2024-09-19T06:08:51.319 INFO:tasks.workunit.client.0.smithi037.stdout:1/786: mkdir d2/d12/d1e/d63/d9e/d102 0 2024-09-19T06:08:51.321 INFO:tasks.workunit.client.0.smithi037.stdout:1/787: symlink d2/d12/d1e/d2a/d2e/df9/l103 0 2024-09-19T06:08:51.323 INFO:tasks.workunit.client.0.smithi037.stdout:6/912: dwrite d9/d78/fd1 [0,4194304] 0 2024-09-19T06:08:51.325 INFO:tasks.workunit.client.0.smithi037.stdout:2/923: sync 2024-09-19T06:08:51.325 INFO:tasks.workunit.client.0.smithi037.stdout:0/856: sync 2024-09-19T06:08:51.326 INFO:tasks.workunit.client.0.smithi037.stdout:2/924: fdatasync d1/da/d95/f97 0 2024-09-19T06:08:51.327 INFO:tasks.workunit.client.0.smithi037.stdout:5/809: sync 2024-09-19T06:08:51.328 INFO:tasks.workunit.client.0.smithi037.stdout:0/857: symlink d5/l127 0 2024-09-19T06:08:51.329 INFO:tasks.workunit.client.0.smithi037.stdout:6/913: write d9/dd/d1c/d4e/d65/db0/fe6 [45993,69200] 0 2024-09-19T06:08:51.329 INFO:tasks.workunit.client.0.smithi037.stdout:0/858: mkdir d5/dd5/de5/d128 0 2024-09-19T06:08:51.332 INFO:tasks.workunit.client.0.smithi037.stdout:6/914: unlink d9/dd/d1c/f2e 0 2024-09-19T06:08:51.332 INFO:tasks.workunit.client.0.smithi037.stdout:6/915: write d9/d6e/d10c/d5a/dd2/d118/f11c [139880,58219] 0 2024-09-19T06:08:51.333 INFO:tasks.workunit.client.0.smithi037.stdout:0/859: mknod d5/d105/d10a/c129 0 2024-09-19T06:08:51.334 INFO:tasks.workunit.client.0.smithi037.stdout:6/916: rmdir d9/d6e/d10c/d5a/d6d/d82 39 2024-09-19T06:08:51.335 INFO:tasks.workunit.client.0.smithi037.stdout:2/925: read d1/da/dc/d21/d51/f52 [656537,102751] 0 2024-09-19T06:08:51.335 INFO:tasks.workunit.client.0.smithi037.stdout:2/926: chown d1/d16/d96/f9b 162856437 1 2024-09-19T06:08:51.335 INFO:tasks.workunit.client.0.smithi037.stdout:0/860: mknod d5/d20/c12a 0 2024-09-19T06:08:51.337 INFO:tasks.workunit.client.0.smithi037.stdout:0/861: truncate d5/d17/f58 2839803 0 2024-09-19T06:08:51.337 INFO:tasks.workunit.client.0.smithi037.stdout:1/788: dread d2/d12/d1e/d2a/f65 [0,4194304] 0 2024-09-19T06:08:51.337 INFO:tasks.workunit.client.0.smithi037.stdout:1/789: chown d2/d12/d15/c4d 125 1 2024-09-19T06:08:51.337 INFO:tasks.workunit.client.0.smithi037.stdout:1/790: write d2/d12/d1e/d2a/d2e/f7e [982748,100552] 0 2024-09-19T06:08:51.337 INFO:tasks.workunit.client.0.smithi037.stdout:1/791: chown d2/d12/d1e/d2a/c79 8358446 1 2024-09-19T06:08:51.337 INFO:tasks.workunit.client.0.smithi037.stdout:1/792: fdatasync d2/d12/d15/f58 0 2024-09-19T06:08:51.338 INFO:tasks.workunit.client.0.smithi037.stdout:1/793: read d2/d12/d15/dd3/dd4/ffc [45538,101124] 0 2024-09-19T06:08:51.338 INFO:tasks.workunit.client.0.smithi037.stdout:0/862: creat d5/d20/f12b x:0 0 0 2024-09-19T06:08:51.340 INFO:tasks.workunit.client.0.smithi037.stdout:0/863: symlink d5/d8/d44/d10f/d125/d89/d96/dae/l12c 0 2024-09-19T06:08:51.345 INFO:tasks.workunit.client.0.smithi037.stdout:0/864: mknod d5/d18/d68/d85/dab/c12d 0 2024-09-19T06:08:51.347 INFO:tasks.workunit.client.0.smithi037.stdout:0/865: creat d5/d8/d44/d61/f12e x:0 0 0 2024-09-19T06:08:51.348 INFO:tasks.workunit.client.0.smithi037.stdout:8/961: dread d1/d61/d7e/d8b/d9f/de4/d122/f142 [0,4194304] 0 2024-09-19T06:08:51.348 INFO:tasks.workunit.client.0.smithi037.stdout:8/962: stat d1/d6a/d136/d59/d5d/dfc/d145 0 2024-09-19T06:08:51.351 INFO:tasks.workunit.client.0.smithi037.stdout:1/794: dread d2/d12/d1e/f67 [0,4194304] 0 2024-09-19T06:08:51.352 INFO:tasks.workunit.client.0.smithi037.stdout:1/795: readlink d2/d12/d1d/l20 0 2024-09-19T06:08:51.353 INFO:tasks.workunit.client.0.smithi037.stdout:5/810: dwrite d2/d12/d28/d22/d53/fef [0,4194304] 0 2024-09-19T06:08:51.361 INFO:tasks.workunit.client.0.smithi037.stdout:1/796: mkdir d2/d73/d104 0 2024-09-19T06:08:51.361 INFO:tasks.workunit.client.0.smithi037.stdout:1/797: stat d2/d12/d1e/d63/cc1 0 2024-09-19T06:08:51.362 INFO:tasks.workunit.client.0.smithi037.stdout:5/811: truncate d2/d12/d28/d22/fbe 5548924 0 2024-09-19T06:08:51.364 INFO:tasks.workunit.client.0.smithi037.stdout:1/798: link d2/d73/fcc d2/d12/d1e/d75/d89/de5/f105 0 2024-09-19T06:08:51.364 INFO:tasks.workunit.client.0.smithi037.stdout:1/799: readlink d2/d12/d15/dd3/dd4/lea 0 2024-09-19T06:08:51.364 INFO:tasks.workunit.client.0.smithi037.stdout:1/800: fdatasync d2/d12/d1e/d63/f77 0 2024-09-19T06:08:51.364 INFO:tasks.workunit.client.0.smithi037.stdout:1/801: write d2/f9 [8512753,49927] 0 2024-09-19T06:08:51.365 INFO:tasks.workunit.client.0.smithi037.stdout:5/812: chown d2/d12/d28/d22/c39 5 1 2024-09-19T06:08:51.366 INFO:tasks.workunit.client.0.smithi037.stdout:0/866: dread d5/d8/d79/d9a/ddb/d106/daf/fd2 [0,4194304] 0 2024-09-19T06:08:51.366 INFO:tasks.workunit.client.0.smithi037.stdout:2/927: dwrite d1/da/d95/fac [0,4194304] 0 2024-09-19T06:08:51.368 INFO:tasks.workunit.client.0.smithi037.stdout:5/813: mknod d2/d12/d28/d22/d4a/d9f/de8/c103 0 2024-09-19T06:08:51.370 INFO:tasks.workunit.client.0.smithi037.stdout:2/928: link d1/l8c d1/da/dc/d21/d7d/l13b 0 2024-09-19T06:08:51.370 INFO:tasks.workunit.client.0.smithi037.stdout:2/929: chown d1/d6/f24 310 1 2024-09-19T06:08:51.370 INFO:tasks.workunit.client.0.smithi037.stdout:2/930: write d1/da/dd7/f117 [535841,37775] 0 2024-09-19T06:08:51.370 INFO:tasks.workunit.client.0.smithi037.stdout:2/931: dread - d1/d16/d62/f10b zero size 2024-09-19T06:08:51.370 INFO:tasks.workunit.client.0.smithi037.stdout:2/932: dread - d1/fe8 zero size 2024-09-19T06:08:51.371 INFO:tasks.workunit.client.0.smithi037.stdout:2/933: fsync d1/d6/da3/da8/fe5 0 2024-09-19T06:08:51.371 INFO:tasks.workunit.client.0.smithi037.stdout:2/934: dread - d1/d16/f91 zero size 2024-09-19T06:08:51.372 INFO:tasks.workunit.client.0.smithi037.stdout:5/814: stat d2/d12/d24/d97/dbc/led 0 2024-09-19T06:08:51.375 INFO:tasks.workunit.client.0.smithi037.stdout:8/963: dwrite d1/d6a/d136/d9b/fce [4194304,4194304] 0 2024-09-19T06:08:51.378 INFO:tasks.workunit.client.0.smithi037.stdout:8/964: mkdir d1/d61/d7e/dbc/d133/d14e 0 2024-09-19T06:08:51.380 INFO:tasks.workunit.client.0.smithi037.stdout:8/965: truncate d1/d6a/d136/d59/daf/fb3 3640403 0 2024-09-19T06:08:51.380 INFO:tasks.workunit.client.0.smithi037.stdout:8/966: stat d1/d61/d7e/d8b/d9f/c135 0 2024-09-19T06:08:51.382 INFO:tasks.workunit.client.0.smithi037.stdout:8/967: unlink d1/d61/d7e/l88 0 2024-09-19T06:08:51.383 INFO:tasks.workunit.client.0.smithi037.stdout:8/968: rename d1/d61/d7e/dbc/dc0 to d1/d61/d7e/dbc/dc0/df5/d13f/d14f 22 2024-09-19T06:08:51.388 INFO:tasks.workunit.client.0.smithi037.stdout:1/802: dwrite d2/f28 [0,4194304] 0 2024-09-19T06:08:51.391 INFO:tasks.workunit.client.0.smithi037.stdout:1/803: symlink d2/l106 0 2024-09-19T06:08:51.391 INFO:tasks.workunit.client.0.smithi037.stdout:2/935: read d1/d16/f3d [4109488,56153] 0 2024-09-19T06:08:51.392 INFO:tasks.workunit.client.0.smithi037.stdout:2/936: fdatasync d1/d33/d4c/fbf 0 2024-09-19T06:08:51.392 INFO:tasks.workunit.client.0.smithi037.stdout:1/804: rename d2/d12/d1e/d2a/ffe to d2/d12/d1e/d75/d89/de0/f107 0 2024-09-19T06:08:51.393 INFO:tasks.workunit.client.0.smithi037.stdout:1/805: chown d2/d12/f25 133593 1 2024-09-19T06:08:51.394 INFO:tasks.workunit.client.0.smithi037.stdout:1/806: creat d2/d12/d1e/d2d/f108 x:0 0 0 2024-09-19T06:08:51.394 INFO:tasks.workunit.client.0.smithi037.stdout:1/807: getdents d2/d12/d1e/d75/d89/de5 0 2024-09-19T06:08:51.400 INFO:tasks.workunit.client.0.smithi037.stdout:0/867: dwrite d5/d8/f6c [4194304,4194304] 0 2024-09-19T06:08:51.401 INFO:tasks.workunit.client.0.smithi037.stdout:5/815: dwrite d2/d12/d24/d58/d8e/fd2 [0,4194304] 0 2024-09-19T06:08:51.411 INFO:tasks.workunit.client.0.smithi037.stdout:5/816: rename d2/d10/daf/fcf to d2/d12/d7e/f104 0 2024-09-19T06:08:51.411 INFO:tasks.workunit.client.0.smithi037.stdout:5/817: chown d2/d12/d28/d22/d4a/d9f/fb9 152289 1 2024-09-19T06:08:51.411 INFO:tasks.workunit.client.0.smithi037.stdout:5/818: chown d2/d12/d24/d58/d7f/fa5 391 1 2024-09-19T06:08:51.418 INFO:tasks.workunit.client.0.smithi037.stdout:2/937: dwrite d1/da/dc/d21/d7d/d80/f11f [0,4194304] 0 2024-09-19T06:08:51.418 INFO:tasks.workunit.client.0.smithi037.stdout:2/938: fsync d1/da/d95/dce/fcf 0 2024-09-19T06:08:51.418 INFO:tasks.workunit.client.0.smithi037.stdout:2/939: chown d1/d16/db1/le1 0 1 2024-09-19T06:08:51.418 INFO:tasks.workunit.client.0.smithi037.stdout:2/940: dread - d1/da/dc/d11e/f136 zero size 2024-09-19T06:08:51.420 INFO:tasks.workunit.client.0.smithi037.stdout:8/969: dwrite d1/d61/d7e/d8b/d91/d3d/f16 [0,4194304] 0 2024-09-19T06:08:51.420 INFO:tasks.workunit.client.0.smithi037.stdout:8/970: write d1/d35/f95 [4610013,11074] 0 2024-09-19T06:08:51.420 INFO:tasks.workunit.client.0.smithi037.stdout:8/971: stat d1/d61/f12a 0 2024-09-19T06:08:51.420 INFO:tasks.workunit.client.0.smithi037.stdout:2/941: creat d1/da/dc/d21/d55/dbc/db0/f13c x:0 0 0 2024-09-19T06:08:51.422 INFO:tasks.workunit.client.0.smithi037.stdout:8/972: creat d1/d61/d7e/dbc/dc0/f150 x:0 0 0 2024-09-19T06:08:51.428 INFO:tasks.workunit.client.0.smithi037.stdout:5/819: write d2/d12/d28/d22/d4a/d9f/f69 [2798666,86870] 0 2024-09-19T06:08:51.430 INFO:tasks.workunit.client.0.smithi037.stdout:2/942: getdents d1/da/dc/d21/d51/d12a 0 2024-09-19T06:08:51.431 INFO:tasks.workunit.client.0.smithi037.stdout:0/868: dwrite d5/d8/d44/d10f/d125/f46 [0,4194304] 0 2024-09-19T06:08:51.431 INFO:tasks.workunit.client.0.smithi037.stdout:5/820: rmdir d2/d10/daf 39 2024-09-19T06:08:51.431 INFO:tasks.workunit.client.0.smithi037.stdout:5/821: write d2/d12/d28/d57/fbd [913087,40983] 0 2024-09-19T06:08:51.434 INFO:tasks.workunit.client.0.smithi037.stdout:2/943: mkdir d1/d6/da3/da8/dbe/df4/d13d 0 2024-09-19T06:08:51.436 INFO:tasks.workunit.client.0.smithi037.stdout:0/869: creat d5/d18/d68/d85/d111/f12f x:0 0 0 2024-09-19T06:08:51.437 INFO:tasks.workunit.client.0.smithi037.stdout:5/822: unlink d2/d12/d24/d97/dbc/cf7 0 2024-09-19T06:08:51.438 INFO:tasks.workunit.client.0.smithi037.stdout:0/870: symlink d5/d18/l130 0 2024-09-19T06:08:51.439 INFO:tasks.workunit.client.0.smithi037.stdout:0/871: chown d5/d18/fbc 1012 1 2024-09-19T06:08:51.439 INFO:tasks.workunit.client.0.smithi037.stdout:0/872: write d5/d8/d11/d32/f10e [343796,87336] 0 2024-09-19T06:08:51.446 INFO:tasks.workunit.client.0.smithi037.stdout:8/973: dwrite d1/d35/f56 [4194304,4194304] 0 2024-09-19T06:08:51.448 INFO:tasks.workunit.client.0.smithi037.stdout:8/974: creat d1/d61/d7e/d8b/d91/f151 x:0 0 0 2024-09-19T06:08:51.458 INFO:tasks.workunit.client.0.smithi037.stdout:8/975: dread d1/d61/d7e/d8b/f98 [0,4194304] 0 2024-09-19T06:08:51.460 INFO:tasks.workunit.client.0.smithi037.stdout:8/976: symlink d1/d6a/d136/d59/l152 0 2024-09-19T06:08:51.467 INFO:tasks.workunit.client.0.smithi037.stdout:8/977: dread d1/dc7/ff3 [0,4194304] 0 2024-09-19T06:08:51.468 INFO:tasks.workunit.client.0.smithi037.stdout:8/978: fsync d1/d35/d118/d123/f117 0 2024-09-19T06:08:51.468 INFO:tasks.workunit.client.0.smithi037.stdout:2/944: dwrite d1/d6/fe [0,4194304] 0 2024-09-19T06:08:51.469 INFO:tasks.workunit.client.0.smithi037.stdout:0/873: dwrite d5/d42/f50 [0,4194304] 0 2024-09-19T06:08:51.469 INFO:tasks.workunit.client.0.smithi037.stdout:5/823: dwrite d2/d12/d24/d97/f9c [0,4194304] 0 2024-09-19T06:08:51.470 INFO:tasks.workunit.client.0.smithi037.stdout:7/863: sync 2024-09-19T06:08:51.470 INFO:tasks.workunit.client.0.smithi037.stdout:7/864: write d6/f12 [1333721,55477] 0 2024-09-19T06:08:51.470 INFO:tasks.workunit.client.0.smithi037.stdout:9/942: sync 2024-09-19T06:08:51.470 INFO:tasks.workunit.client.0.smithi037.stdout:9/943: read - da/dec/d116/d63/fc1 zero size 2024-09-19T06:08:51.470 INFO:tasks.workunit.client.0.smithi037.stdout:4/978: sync 2024-09-19T06:08:51.471 INFO:tasks.workunit.client.0.smithi037.stdout:8/979: stat d1/l3a 0 2024-09-19T06:08:51.480 INFO:tasks.workunit.client.0.smithi037.stdout:0/874: mknod d5/d8/d79/c131 0 2024-09-19T06:08:51.481 INFO:tasks.workunit.client.0.smithi037.stdout:4/979: mkdir d0/d2/d139 0 2024-09-19T06:08:51.481 INFO:tasks.workunit.client.0.smithi037.stdout:4/980: dread - d0/d6/fe2 zero size 2024-09-19T06:08:51.483 INFO:tasks.workunit.client.0.smithi037.stdout:9/944: rename da/dec/d116/d1b/d23/d6a/d82/f142 to da/d20/f151 0 2024-09-19T06:08:51.485 INFO:tasks.workunit.client.0.smithi037.stdout:5/824: dread d2/d12/d28/d22/d4a/d9f/fec [0,4194304] 0 2024-09-19T06:08:51.485 INFO:tasks.workunit.client.0.smithi037.stdout:5/825: stat d2/d5c/laa 0 2024-09-19T06:08:51.485 INFO:tasks.workunit.client.0.smithi037.stdout:5/826: readlink d2/d5c/l88 0 2024-09-19T06:08:51.487 INFO:tasks.workunit.client.0.smithi037.stdout:5/827: getdents d2/d12/d24/d58/d8e 0 2024-09-19T06:08:51.487 INFO:tasks.workunit.client.0.smithi037.stdout:5/828: fdatasync d2/d12/d28/d57/f91 0 2024-09-19T06:08:51.505 INFO:tasks.workunit.client.0.smithi037.stdout:9/945: dread da/dec/d116/d1b/d2f/dcc/f117 [0,4194304] 0 2024-09-19T06:08:51.506 INFO:tasks.workunit.client.0.smithi037.stdout:9/946: fsync da/dec/d116/d1b/d23/de9/ff5 0 2024-09-19T06:08:51.506 INFO:tasks.workunit.client.0.smithi037.stdout:8/980: dwrite d1/f1e [0,4194304] 0 2024-09-19T06:08:51.509 INFO:tasks.workunit.client.0.smithi037.stdout:9/947: write da/dec/d116/d1b/d2f/f91 [123979,64519] 0 2024-09-19T06:08:51.509 INFO:tasks.workunit.client.0.smithi037.stdout:9/948: truncate da/dec/d116/d1b/f21 10047745 0 2024-09-19T06:08:51.509 INFO:tasks.workunit.client.0.smithi037.stdout:8/981: creat d1/d61/d7e/d8b/d9f/f153 x:0 0 0 2024-09-19T06:08:51.509 INFO:tasks.workunit.client.0.smithi037.stdout:8/982: dread - d1/d61/d68/da3/fe6 zero size 2024-09-19T06:08:51.511 INFO:tasks.workunit.client.0.smithi037.stdout:9/949: creat da/dec/d116/d63/dd3/dff/f152 x:0 0 0 2024-09-19T06:08:51.511 INFO:tasks.workunit.client.0.smithi037.stdout:8/983: symlink d1/dc7/l154 0 2024-09-19T06:08:51.512 INFO:tasks.workunit.client.0.smithi037.stdout:8/984: write d1/f97 [1449450,43473] 0 2024-09-19T06:08:51.512 INFO:tasks.workunit.client.0.smithi037.stdout:8/985: readlink d1/d35/d118/l14b 0 2024-09-19T06:08:51.513 INFO:tasks.workunit.client.0.smithi037.stdout:9/950: creat da/dec/d116/d63/d80/dc4/d11e/f153 x:0 0 0 2024-09-19T06:08:51.513 INFO:tasks.workunit.client.0.smithi037.stdout:9/951: truncate da/dec/d116/d1b/d2f/df8/f11f 390465 0 2024-09-19T06:08:51.514 INFO:tasks.workunit.client.0.smithi037.stdout:8/986: rmdir d1/d61/d7e/dbc/dc0/df5/d13f 0 2024-09-19T06:08:51.515 INFO:tasks.workunit.client.0.smithi037.stdout:8/987: mkdir d1/d61/d7e/d8b/d9f/de4/d155 0 2024-09-19T06:08:51.515 INFO:tasks.workunit.client.0.smithi037.stdout:2/945: dwrite d1/da/dc/d21/d51/f52 [0,4194304] 0 2024-09-19T06:08:51.515 INFO:tasks.workunit.client.0.smithi037.stdout:0/875: write d5/dd5/de9/f45 [2685446,69565] 0 2024-09-19T06:08:51.515 INFO:tasks.workunit.client.0.smithi037.stdout:7/865: dwrite d6/dc/df/f8f [0,4194304] 0 2024-09-19T06:08:51.517 INFO:tasks.workunit.client.0.smithi037.stdout:8/988: link d1/dc7/l154 d1/d61/d7e/d8b/l156 0 2024-09-19T06:08:51.517 INFO:tasks.workunit.client.0.smithi037.stdout:8/989: dread - d1/d61/d7e/d8b/d91/d3d/d66/f107 zero size 2024-09-19T06:08:51.517 INFO:tasks.workunit.client.0.smithi037.stdout:8/990: readlink d1/d61/d7e/d8b/d91/l13c 0 2024-09-19T06:08:51.517 INFO:tasks.workunit.client.0.smithi037.stdout:8/991: write d1/d6a/d136/d9b/f11f [389164,24328] 0 2024-09-19T06:08:51.517 INFO:tasks.workunit.client.0.smithi037.stdout:8/992: chown d1/d61/d7e/dbc/dc0/d113/c11e 22447333 1 2024-09-19T06:08:51.518 INFO:tasks.workunit.client.0.smithi037.stdout:7/866: dread d6/dc/d7b/fee [0,4194304] 0 2024-09-19T06:08:51.518 INFO:tasks.workunit.client.0.smithi037.stdout:7/867: dread - d6/d20/d34/dc0/dcf/ff3 zero size 2024-09-19T06:08:51.518 INFO:tasks.workunit.client.0.smithi037.stdout:2/946: rename d1/da/dc/d21/d51/d12a/cd6 to d1/da/d6e/c13e 0 2024-09-19T06:08:51.522 INFO:tasks.workunit.client.0.smithi037.stdout:8/993: mkdir d1/d61/d7e/d8b/d9f/de4/d157 0 2024-09-19T06:08:51.522 INFO:tasks.workunit.client.0.smithi037.stdout:8/994: chown d1/d61/d7e/d8b/d91/d3d/c51 0 1 2024-09-19T06:08:51.522 INFO:tasks.workunit.client.0.smithi037.stdout:4/981: dwrite d0/d8f/fd3 [0,4194304] 0 2024-09-19T06:08:51.522 INFO:tasks.workunit.client.0.smithi037.stdout:4/982: write d0/d6/d1b/d20/d4d/d64/f76 [323876,63953] 0 2024-09-19T06:08:51.523 INFO:tasks.workunit.client.0.smithi037.stdout:5/829: dwrite d2/d12/f5d [0,4194304] 0 2024-09-19T06:08:51.523 INFO:tasks.workunit.client.0.smithi037.stdout:5/830: chown d2/d12/d28/d22/d4a/d9e/fb1 53 1 2024-09-19T06:08:51.524 INFO:tasks.workunit.client.0.smithi037.stdout:7/868: symlink d6/dc/d22/d59/da8/dd4/de2/l118 0 2024-09-19T06:08:51.524 INFO:tasks.workunit.client.0.smithi037.stdout:7/869: stat d6/dc/df/d7e/ld2 0 2024-09-19T06:08:51.524 INFO:tasks.workunit.client.0.smithi037.stdout:7/870: write d6/dc/daf/de6/fff [196413,46662] 0 2024-09-19T06:08:51.526 INFO:tasks.workunit.client.0.smithi037.stdout:9/952: dread da/dec/d116/d1b/d2f/f70 [0,4194304] 0 2024-09-19T06:08:51.527 INFO:tasks.workunit.client.0.smithi037.stdout:0/876: rename d5/d18/fbc to d5/dd5/de9/d8d/de0/dea/f132 0 2024-09-19T06:08:51.527 INFO:tasks.workunit.client.0.smithi037.stdout:8/995: creat d1/d61/d7e/d8b/d9f/de4/f158 x:0 0 0 2024-09-19T06:08:51.531 INFO:tasks.workunit.client.0.smithi037.stdout:4/983: truncate d0/d6/d1b/d30/f32 307492 0 2024-09-19T06:08:51.541 INFO:tasks.workunit.client.0.smithi037.stdout:5/831: link d2/d12/d28/d22/d4a/d9f/fcc d2/d12/f105 0 2024-09-19T06:08:51.541 INFO:tasks.workunit.client.0.smithi037.stdout:7/871: creat d6/db0/f119 x:0 0 0 2024-09-19T06:08:51.544 INFO:tasks.workunit.client.0.smithi037.stdout:2/947: dread d1/da/dc/d21/d7d/d80/fff [0,4194304] 0 2024-09-19T06:08:51.544 INFO:tasks.workunit.client.0.smithi037.stdout:2/948: read - d1/d6/da3/da8/ff7 zero size 2024-09-19T06:08:51.545 INFO:tasks.workunit.client.0.smithi037.stdout:5/832: unlink d2/d12/d28/d22/d35/fbb 0 2024-09-19T06:08:51.546 INFO:tasks.workunit.client.0.smithi037.stdout:7/872: chown d6/d20/d34/l6a 10 1 2024-09-19T06:08:51.548 INFO:tasks.workunit.client.0.smithi037.stdout:9/953: mkdir da/dec/d116/d63/d80/d154 0 2024-09-19T06:08:51.550 INFO:tasks.workunit.client.0.smithi037.stdout:2/949: mkdir d1/d6/da3/da8/dbe/d13f 0 2024-09-19T06:08:51.550 INFO:tasks.workunit.client.0.smithi037.stdout:2/950: dread - d1/da/d6e/d100/f122 zero size 2024-09-19T06:08:51.551 INFO:tasks.workunit.client.0.smithi037.stdout:5/833: creat d2/d12/d24/d58/d96/f106 x:0 0 0 2024-09-19T06:08:51.551 INFO:tasks.workunit.client.0.smithi037.stdout:5/834: chown d2/d5c/f60 1141 1 2024-09-19T06:08:51.552 INFO:tasks.workunit.client.0.smithi037.stdout:6/917: sync 2024-09-19T06:08:51.553 INFO:tasks.workunit.client.0.smithi037.stdout:1/808: sync 2024-09-19T06:08:51.553 INFO:tasks.workunit.client.0.smithi037.stdout:3/811: sync 2024-09-19T06:08:51.553 INFO:tasks.workunit.client.0.smithi037.stdout:1/809: truncate d2/d12/d1d/fd5 1044924 0 2024-09-19T06:08:51.553 INFO:tasks.workunit.client.0.smithi037.stdout:0/877: dwrite d5/d18/d68/d85/dab/dba/fc1 [0,4194304] 0 2024-09-19T06:08:51.553 INFO:tasks.workunit.client.0.smithi037.stdout:0/878: write d5/d17/f58 [3855630,85839] 0 2024-09-19T06:08:51.553 INFO:tasks.workunit.client.0.smithi037.stdout:0/879: truncate d5/f9c 733744 0 2024-09-19T06:08:51.554 INFO:tasks.workunit.client.0.smithi037.stdout:3/812: rmdir d0/d16/da6/dd5 39 2024-09-19T06:08:51.555 INFO:tasks.workunit.client.0.smithi037.stdout:1/810: getdents d2/d12/d1e/d2a/d8f/da6 0 2024-09-19T06:08:51.560 INFO:tasks.workunit.client.0.smithi037.stdout:3/813: creat d0/f10b x:0 0 0 2024-09-19T06:08:51.562 INFO:tasks.workunit.client.0.smithi037.stdout:1/811: symlink d2/d12/d15/dd3/dd4/l109 0 2024-09-19T06:08:51.562 INFO:tasks.workunit.client.0.smithi037.stdout:1/812: chown d2/d12/d1e/d75 8057012 1 2024-09-19T06:08:51.562 INFO:tasks.workunit.client.0.smithi037.stdout:1/813: chown d2/d12/d15/d34/cdc 2032583 1 2024-09-19T06:08:51.563 INFO:tasks.workunit.client.0.smithi037.stdout:8/996: dwrite d1/d6a/d136/d59/daf/f11b [0,4194304] 0 2024-09-19T06:08:51.565 INFO:tasks.workunit.client.0.smithi037.stdout:3/814: creat d0/d16/da6/f10c x:0 0 0 2024-09-19T06:08:51.565 INFO:tasks.workunit.client.0.smithi037.stdout:4/984: dwrite d0/d6/d45/dd9/d36/fc6 [0,4194304] 0 2024-09-19T06:08:51.569 INFO:tasks.workunit.client.0.smithi037.stdout:8/997: link d1/d61/d7e/d8b/d9f/de4/ffd d1/d61/d7e/d8b/d91/d3d/d13b/f159 0 2024-09-19T06:08:51.569 INFO:tasks.workunit.client.0.smithi037.stdout:8/998: fdatasync d1/d61/d7e/fef 0 2024-09-19T06:08:51.570 INFO:tasks.workunit.client.0.smithi037.stdout:3/815: rename d0/d43/d23/d7a/d77/d51/fdd to d0/d16/d19/d1d/dd1/d106/f10d 0 2024-09-19T06:08:51.575 INFO:tasks.workunit.client.0.smithi037.stdout:8/999: creat d1/d6a/d136/d59/d5d/dfc/d145/f15a x:0 0 0 2024-09-19T06:08:51.576 INFO:tasks.workunit.client.0.smithi037.stdout:3/816: rename d0/d96/f105 to d0/d16/da6/dd4/f10e 0 2024-09-19T06:08:51.582 INFO:tasks.workunit.client.0.smithi037.stdout:3/817: dread d0/d43/d23/d7a/d77/d51/f76 [0,4194304] 0 2024-09-19T06:08:51.582 INFO:tasks.workunit.client.0.smithi037.stdout:3/818: chown d0/d16/d19/d1d/d82/d86/cee 8065819 1 2024-09-19T06:08:51.582 INFO:tasks.workunit.client.0.smithi037.stdout:3/819: write d0/d43/d23/d7a/d77/d45/d55/f63 [4859659,9201] 0 2024-09-19T06:08:51.585 INFO:tasks.workunit.client.0.smithi037.stdout:1/814: dread d2/fb [0,4194304] 0 2024-09-19T06:08:51.587 INFO:tasks.workunit.client.0.smithi037.stdout:0/880: dwrite d5/f7 [0,4194304] 0 2024-09-19T06:08:51.587 INFO:tasks.workunit.client.0.smithi037.stdout:0/881: chown d5/d8/d11/d32/l107 55112459 1 2024-09-19T06:08:51.587 INFO:tasks.workunit.client.0.smithi037.stdout:3/820: write d0/fc [9495,32534] 0 2024-09-19T06:08:51.588 INFO:tasks.workunit.client.0.smithi037.stdout:1/815: rename d2/d12/d15/d34/f7c to d2/d48/f10a 0 2024-09-19T06:08:51.589 INFO:tasks.workunit.client.0.smithi037.stdout:2/951: dwrite d1/d33/d4c/fbf [0,4194304] 0 2024-09-19T06:08:51.591 INFO:tasks.workunit.client.0.smithi037.stdout:9/954: dwrite da/dec/d116/d1b/d2f/d6d/d92/fe2 [0,4194304] 0 2024-09-19T06:08:51.591 INFO:tasks.workunit.client.0.smithi037.stdout:7/873: dwrite d6/d21/f5f [0,4194304] 0 2024-09-19T06:08:51.591 INFO:tasks.workunit.client.0.smithi037.stdout:3/821: rename d0/d16/d19/d1d/d82/d86/f9f to d0/d16/d19/d33/d87/dbd/f10f 0 2024-09-19T06:08:51.591 INFO:tasks.workunit.client.0.smithi037.stdout:3/822: read - d0/d43/d23/d7a/d77/fd6 zero size 2024-09-19T06:08:51.594 INFO:tasks.workunit.client.0.smithi037.stdout:1/816: link d2/d12/d1d/d47/f68 d2/d12/d1d/d6b/d8b/df4/f10b 0 2024-09-19T06:08:51.595 INFO:tasks.workunit.client.0.smithi037.stdout:7/874: truncate d6/dc/d22/f3b 1436337 0 2024-09-19T06:08:51.603 INFO:tasks.workunit.client.0.smithi037.stdout:3/823: read d0/d5f/da0/fc1 [242374,119869] 0 2024-09-19T06:08:51.604 INFO:tasks.workunit.client.0.smithi037.stdout:4/985: dwrite d0/d6/d45/d113/de5/d86/f9e [0,4194304] 0 2024-09-19T06:08:51.604 INFO:tasks.workunit.client.0.smithi037.stdout:1/817: symlink d2/d12/d17/l10c 0 2024-09-19T06:08:51.606 INFO:tasks.workunit.client.0.smithi037.stdout:7/875: creat d6/dc/d22/f11a x:0 0 0 2024-09-19T06:08:51.606 INFO:tasks.workunit.client.0.smithi037.stdout:7/876: truncate d6/d20/d34/ff6 13387 0 2024-09-19T06:08:51.608 INFO:tasks.workunit.client.0.smithi037.stdout:2/952: rename d1/d16/f1c to d1/d6/f140 0 2024-09-19T06:08:51.608 INFO:tasks.workunit.client.0.smithi037.stdout:2/953: read - d1/d6/da3/da8/dbe/fc4 zero size 2024-09-19T06:08:51.608 INFO:tasks.workunit.client.0.smithi037.stdout:3/824: rmdir d0/d16/d19/d33 39 2024-09-19T06:08:51.610 INFO:tasks.workunit.client.0.smithi037.stdout:7/877: creat d6/d20/d4b/d60/d33/d61/f11b x:0 0 0 2024-09-19T06:08:51.613 INFO:tasks.workunit.client.0.smithi037.stdout:9/955: read da/dec/d116/d1b/d23/d6a/d82/fd7 [2867309,51350] 0 2024-09-19T06:08:51.613 INFO:tasks.workunit.client.0.smithi037.stdout:2/954: rename d1/d6/da3/da8/dbe to d1/d9e/d141 0 2024-09-19T06:08:51.613 INFO:tasks.workunit.client.0.smithi037.stdout:7/878: creat d6/d20/d4b/d60/d33/d55/d6d/f11c x:0 0 0 2024-09-19T06:08:51.613 INFO:tasks.workunit.client.0.smithi037.stdout:7/879: read - d6/dc/df/f95 zero size 2024-09-19T06:08:51.614 INFO:tasks.workunit.client.0.smithi037.stdout:9/956: mknod da/dec/d116/d1b/d23/d6a/d8f/da4/d100/c155 0 2024-09-19T06:08:51.616 INFO:tasks.workunit.client.0.smithi037.stdout:7/880: getdents d6 0 2024-09-19T06:08:51.617 INFO:tasks.workunit.client.0.smithi037.stdout:0/882: dwrite d5/d8/d11/f109 [0,4194304] 0 2024-09-19T06:08:51.618 INFO:tasks.workunit.client.0.smithi037.stdout:9/957: creat da/dec/d116/d31/f156 x:0 0 0 2024-09-19T06:08:51.618 INFO:tasks.workunit.client.0.smithi037.stdout:9/958: stat da/c2c 0 2024-09-19T06:08:51.619 INFO:tasks.workunit.client.0.smithi037.stdout:7/881: truncate d6/dc/f25 4162017 0 2024-09-19T06:08:51.619 INFO:tasks.workunit.client.0.smithi037.stdout:7/882: fsync d6/dc/fe 0 2024-09-19T06:08:51.623 INFO:tasks.workunit.client.0.smithi037.stdout:2/955: write d1/da/f2a [1164902,1435] 0 2024-09-19T06:08:51.624 INFO:tasks.workunit.client.0.smithi037.stdout:9/959: symlink da/d20/d11c/l157 0 2024-09-19T06:08:51.626 INFO:tasks.workunit.client.0.smithi037.stdout:7/883: symlink d6/d20/d4b/d60/d33/d9f/l11d 0 2024-09-19T06:08:51.626 INFO:tasks.workunit.client.0.smithi037.stdout:7/884: dread - d6/dc/d22/ff5 zero size 2024-09-19T06:08:51.627 INFO:tasks.workunit.client.0.smithi037.stdout:9/960: mknod da/dec/d116/d1b/d23/d6a/d85/c158 0 2024-09-19T06:08:51.631 INFO:tasks.workunit.client.0.smithi037.stdout:1/818: dwrite d2/d12/d1d/f4f [0,4194304] 0 2024-09-19T06:08:51.633 INFO:tasks.workunit.client.0.smithi037.stdout:1/819: rename d2/d12/d1e/d2a/la2 to d2/d48/l10d 0 2024-09-19T06:08:51.635 INFO:tasks.workunit.client.0.smithi037.stdout:3/825: write d0/d16/d19/f28 [381596,4835] 0 2024-09-19T06:08:51.635 INFO:tasks.workunit.client.0.smithi037.stdout:3/826: readlink d0/d43/leb 0 2024-09-19T06:08:51.635 INFO:tasks.workunit.client.0.smithi037.stdout:4/986: dwrite d0/d6/d1b/d20/d4d/d64/f76 [0,4194304] 0 2024-09-19T06:08:51.635 INFO:tasks.workunit.client.0.smithi037.stdout:1/820: symlink d2/d12/d1e/d2a/d97/l10e 0 2024-09-19T06:08:51.635 INFO:tasks.workunit.client.0.smithi037.stdout:9/961: dread da/d20/f11a [0,4194304] 0 2024-09-19T06:08:51.638 INFO:tasks.workunit.client.0.smithi037.stdout:4/987: mknod d0/d6/d1b/d20/d77/c13a 0 2024-09-19T06:08:51.641 INFO:tasks.workunit.client.0.smithi037.stdout:1/821: rmdir d2/d73/d104 0 2024-09-19T06:08:51.643 INFO:tasks.workunit.client.0.smithi037.stdout:1/822: symlink d2/d12/d1e/d75/d89/de5/l10f 0 2024-09-19T06:08:51.644 INFO:tasks.workunit.client.0.smithi037.stdout:9/962: mkdir da/dec/d116/d1b/d2f/d6d/d159 0 2024-09-19T06:08:51.648 INFO:tasks.workunit.client.0.smithi037.stdout:9/963: rename da/dec/d116/d1b/d23/dbe to da/dec/d116/d1b/d43/d15a 0 2024-09-19T06:08:51.648 INFO:tasks.workunit.client.0.smithi037.stdout:9/964: chown da/dec/d116/d1b/d23/de9/cda 2825746 1 2024-09-19T06:08:51.648 INFO:tasks.workunit.client.0.smithi037.stdout:9/965: dread - da/d57/f9d zero size 2024-09-19T06:08:51.650 INFO:tasks.workunit.client.0.smithi037.stdout:7/885: dwrite d6/d20/d4b/d60/d33/d8c/f112 [0,4194304] 0 2024-09-19T06:08:51.650 INFO:tasks.workunit.client.0.smithi037.stdout:7/886: dread - d6/d20/d4b/d60/d33/d9f/ff2 zero size 2024-09-19T06:08:51.650 INFO:tasks.workunit.client.0.smithi037.stdout:7/887: chown d6/dc/df 32513 1 2024-09-19T06:08:51.650 INFO:tasks.workunit.client.0.smithi037.stdout:2/956: dread d1/d6/fe [0,4194304] 0 2024-09-19T06:08:51.653 INFO:tasks.workunit.client.0.smithi037.stdout:7/888: creat d6/d20/f11e x:0 0 0 2024-09-19T06:08:51.653 INFO:tasks.workunit.client.0.smithi037.stdout:2/957: dread d1/da/dc/d21/d55/dbc/db0/de0/ffe [0,4194304] 0 2024-09-19T06:08:51.653 INFO:tasks.workunit.client.0.smithi037.stdout:2/958: chown d1/d16/f37 6882798 1 2024-09-19T06:08:51.653 INFO:tasks.workunit.client.0.smithi037.stdout:7/889: write d6/db0/f119 [944197,105309] 0 2024-09-19T06:08:51.654 INFO:tasks.workunit.client.0.smithi037.stdout:2/959: getdents d1/da/dc/d21/d51/d12a 0 2024-09-19T06:08:51.656 INFO:tasks.workunit.client.0.smithi037.stdout:2/960: mkdir d1/d6/da3/d142 0 2024-09-19T06:08:51.659 INFO:tasks.workunit.client.0.smithi037.stdout:2/961: creat d1/da/dc/d21/d7d/dab/f143 x:0 0 0 2024-09-19T06:08:51.660 INFO:tasks.workunit.client.0.smithi037.stdout:0/883: dwrite d5/d8/f76 [0,4194304] 0 2024-09-19T06:08:51.661 INFO:tasks.workunit.client.0.smithi037.stdout:0/884: fsync d5/d8/d79/d9a/ddb/d106/f5a 0 2024-09-19T06:08:51.661 INFO:tasks.workunit.client.0.smithi037.stdout:3/827: dread d0/d43/d23/d7a/d77/f2b [0,4194304] 0 2024-09-19T06:08:51.661 INFO:tasks.workunit.client.0.smithi037.stdout:3/828: fdatasync d0/f7d 0 2024-09-19T06:08:51.661 INFO:tasks.workunit.client.0.smithi037.stdout:3/829: fdatasync d0/d16/d19/d1d/f3d 0 2024-09-19T06:08:51.661 INFO:tasks.workunit.client.0.smithi037.stdout:3/830: truncate d0/d16/da6/f10c 396225 0 2024-09-19T06:08:51.663 INFO:tasks.workunit.client.0.smithi037.stdout:2/962: rename d1/da/dc/d21/d7d/d80 to d1/da/dd7/d144 0 2024-09-19T06:08:51.664 INFO:tasks.workunit.client.0.smithi037.stdout:0/885: symlink d5/d18/d68/l133 0 2024-09-19T06:08:51.666 INFO:tasks.workunit.client.0.smithi037.stdout:3/831: unlink d0/d16/d19/d1d/d5e/f83 0 2024-09-19T06:08:51.668 INFO:tasks.workunit.client.0.smithi037.stdout:0/886: rename d5/d8/d44/d10f/d125/d89/d96/dc5/d11f to d5/d8/d79/d9a/ddb/d106/dd1/de2/d134 0 2024-09-19T06:08:51.668 INFO:tasks.workunit.client.0.smithi037.stdout:0/887: dread - d5/d8/f70 zero size 2024-09-19T06:08:51.669 INFO:tasks.workunit.client.0.smithi037.stdout:3/832: mkdir d0/d43/d23/d7a/d77/dc3/dfb/d110 0 2024-09-19T06:08:51.669 INFO:tasks.workunit.client.0.smithi037.stdout:3/833: stat d0/d43/d23/d7a/d77/d45/l95 0 2024-09-19T06:08:51.669 INFO:tasks.workunit.client.0.smithi037.stdout:0/888: creat d5/d8/d44/d10f/f135 x:0 0 0 2024-09-19T06:08:51.669 INFO:tasks.workunit.client.0.smithi037.stdout:0/889: fdatasync d5/d8/d11/f78 0 2024-09-19T06:08:51.670 INFO:tasks.workunit.client.0.smithi037.stdout:0/890: fsync d5/d8/f70 0 2024-09-19T06:08:51.670 INFO:tasks.workunit.client.0.smithi037.stdout:3/834: link d0/d43/d26/f36 d0/d43/d23/f111 0 2024-09-19T06:08:51.671 INFO:tasks.workunit.client.0.smithi037.stdout:9/966: write da/dec/d116/d1b/d43/f46 [983254,63381] 0 2024-09-19T06:08:51.671 INFO:tasks.workunit.client.0.smithi037.stdout:9/967: chown da/db3/ldb 1036770808 1 2024-09-19T06:08:51.671 INFO:tasks.workunit.client.0.smithi037.stdout:1/823: write d2/d12/d1e/d2a/f60 [2199891,67977] 0 2024-09-19T06:08:51.671 INFO:tasks.workunit.client.0.smithi037.stdout:4/988: dwrite d0/d6/d45/d113/de5/de1/fff [0,4194304] 0 2024-09-19T06:08:51.671 INFO:tasks.workunit.client.0.smithi037.stdout:3/835: creat d0/d5f/f112 x:0 0 0 2024-09-19T06:08:51.671 INFO:tasks.workunit.client.0.smithi037.stdout:3/836: chown d0/d16/d19/d1d/d7c/f85 8 1 2024-09-19T06:08:51.671 INFO:tasks.workunit.client.0.smithi037.stdout:3/837: getdents d0/d16/d19/d1d/d100 0 2024-09-19T06:08:51.672 INFO:tasks.workunit.client.0.smithi037.stdout:9/968: symlink da/dec/d116/d1b/d62/df4/d132/l15b 0 2024-09-19T06:08:51.673 INFO:tasks.workunit.client.0.smithi037.stdout:4/989: mknod d0/d6/d1b/d30/dee/df2/c13b 0 2024-09-19T06:08:51.674 INFO:tasks.workunit.client.0.smithi037.stdout:1/824: symlink d2/d12/d1e/d2d/d6f/dac/l110 0 2024-09-19T06:08:51.674 INFO:tasks.workunit.client.0.smithi037.stdout:1/825: read d2/d12/d1e/f67 [3368358,65364] 0 2024-09-19T06:08:51.675 INFO:tasks.workunit.client.0.smithi037.stdout:3/838: mknod d0/d43/d23/d7a/d77/d45/c113 0 2024-09-19T06:08:51.678 INFO:tasks.workunit.client.0.smithi037.stdout:1/826: symlink d2/d12/d15/d95/l111 0 2024-09-19T06:08:51.681 INFO:tasks.workunit.client.0.smithi037.stdout:0/891: dread d5/d8/d44/d10f/d125/d89/f8a [4194304,4194304] 0 2024-09-19T06:08:51.681 INFO:tasks.workunit.client.0.smithi037.stdout:0/892: stat d5/d8/d79/d9a/lfe 0 2024-09-19T06:08:51.683 INFO:tasks.workunit.client.0.smithi037.stdout:9/969: dread da/dec/d116/d131/f78 [0,4194304] 0 2024-09-19T06:08:51.683 INFO:tasks.workunit.client.0.smithi037.stdout:0/893: mknod d5/dd5/de9/d8d/de0/c136 0 2024-09-19T06:08:51.685 INFO:tasks.workunit.client.0.smithi037.stdout:2/963: dwrite d1/da/dc/d21/d7d/dab/f56 [0,4194304] 0 2024-09-19T06:08:51.689 INFO:tasks.workunit.client.0.smithi037.stdout:4/990: dread d0/d6/d1b/d20/d4d/d64/fd1 [0,4194304] 0 2024-09-19T06:08:51.689 INFO:tasks.workunit.client.0.smithi037.stdout:4/991: fsync d0/d6/d1b/d20/d4d/d64/db0/f10c 0 2024-09-19T06:08:51.693 INFO:tasks.workunit.client.0.smithi037.stdout:2/964: rename d1/da/f2a to d1/da/dc/d11e/f145 0 2024-09-19T06:08:51.696 INFO:tasks.workunit.client.0.smithi037.stdout:4/992: rename d0/d6/d1b/d5d/d111 to d0/d6/d45/d113/de5/d6f/da9/dba/d13c 0 2024-09-19T06:08:51.697 INFO:tasks.workunit.client.0.smithi037.stdout:2/965: mknod d1/d16/c146 0 2024-09-19T06:08:51.697 INFO:tasks.workunit.client.0.smithi037.stdout:4/993: truncate d0/d6/d45/d113/de5/ffa 211012 0 2024-09-19T06:08:51.697 INFO:tasks.workunit.client.0.smithi037.stdout:4/994: fsync d0/d6/d1b/d20/fd6 0 2024-09-19T06:08:51.698 INFO:tasks.workunit.client.0.smithi037.stdout:2/966: creat d1/da/dc/d21/d51/f147 x:0 0 0 2024-09-19T06:08:51.699 INFO:tasks.workunit.client.0.smithi037.stdout:4/995: symlink d0/d6/d1b/d20/d4d/d64/db0/dc4/d116/l13d 0 2024-09-19T06:08:51.700 INFO:tasks.workunit.client.0.smithi037.stdout:2/967: getdents d1/d9e/d141 0 2024-09-19T06:08:51.701 INFO:tasks.workunit.client.0.smithi037.stdout:3/839: dwrite d0/d16/f30 [4194304,4194304] 0 2024-09-19T06:08:51.701 INFO:tasks.workunit.client.0.smithi037.stdout:4/996: creat d0/d6/d1b/d20/d4d/d64/db0/f13e x:0 0 0 2024-09-19T06:08:51.702 INFO:tasks.workunit.client.0.smithi037.stdout:3/840: creat d0/d16/d19/d33/d87/f114 x:0 0 0 2024-09-19T06:08:51.703 INFO:tasks.workunit.client.0.smithi037.stdout:4/997: creat d0/d6/d1b/d30/d80/f13f x:0 0 0 2024-09-19T06:08:51.704 INFO:tasks.workunit.client.0.smithi037.stdout:4/998: truncate d0/d6/d1b/f55 1719906 0 2024-09-19T06:08:51.704 INFO:tasks.workunit.client.0.smithi037.stdout:4/999: write d0/d2/d37/f90 [978572,17290] 0 2024-09-19T06:08:51.708 INFO:tasks.workunit.client.0.smithi037.stdout:0/894: dwrite d5/d8/d44/d61/f12e [0,4194304] 0 2024-09-19T06:08:51.708 INFO:tasks.workunit.client.0.smithi037.stdout:0/895: chown d5/d8/d79/fb9 30968 1 2024-09-19T06:08:51.712 INFO:tasks.workunit.client.0.smithi037.stdout:0/896: rename d5/d8/d44/d10f/d125/d89/d96/dae/l12c to d5/dd5/de9/d21/d4e/d121/l137 0 2024-09-19T06:08:51.713 INFO:tasks.workunit.client.0.smithi037.stdout:0/897: unlink d5/d8/d79/d9a/lfe 0 2024-09-19T06:08:51.714 INFO:tasks.workunit.client.0.smithi037.stdout:1/827: dwrite d2/d48/f6d [0,4194304] 0 2024-09-19T06:08:51.714 INFO:tasks.workunit.client.0.smithi037.stdout:9/970: dread da/d4d/f68 [0,4194304] 0 2024-09-19T06:08:51.715 INFO:tasks.workunit.client.0.smithi037.stdout:0/898: getdents d5/d42 0 2024-09-19T06:08:51.727 INFO:tasks.workunit.client.0.smithi037.stdout:9/971: dread da/dec/d116/d1b/d2f/fa2 [0,4194304] 0 2024-09-19T06:08:51.727 INFO:tasks.workunit.client.0.smithi037.stdout:9/972: dread - da/d57/f9d zero size 2024-09-19T06:08:51.727 INFO:tasks.workunit.client.0.smithi037.stdout:9/973: read - da/f145 zero size 2024-09-19T06:08:51.727 INFO:tasks.workunit.client.0.smithi037.stdout:3/841: dwrite d0/d43/d37/fa7 [0,4194304] 0 2024-09-19T06:08:51.731 INFO:tasks.workunit.client.0.smithi037.stdout:9/974: mkdir da/dec/d116/d63/dd3/dff/d15c 0 2024-09-19T06:08:51.732 INFO:tasks.workunit.client.0.smithi037.stdout:1/828: dread d2/d12/d1e/d2a/d8f/fc6 [0,4194304] 0 2024-09-19T06:08:51.733 INFO:tasks.workunit.client.0.smithi037.stdout:2/968: dwrite d1/da/dc/d11e/f136 [0,4194304] 0 2024-09-19T06:08:51.733 INFO:tasks.workunit.client.0.smithi037.stdout:2/969: write d1/da/d6e/d100/f122 [591218,52478] 0 2024-09-19T06:08:51.734 INFO:tasks.workunit.client.0.smithi037.stdout:2/970: creat d1/d33/d4c/f148 x:0 0 0 2024-09-19T06:08:51.735 INFO:tasks.workunit.client.0.smithi037.stdout:2/971: creat d1/d16/d4a/f149 x:0 0 0 2024-09-19T06:08:51.735 INFO:tasks.workunit.client.0.smithi037.stdout:2/972: write d1/d16/d96/fd3 [1439774,62249] 0 2024-09-19T06:08:51.737 INFO:tasks.workunit.client.0.smithi037.stdout:2/973: rmdir d1/da/d95/d139 0 2024-09-19T06:08:51.737 INFO:tasks.workunit.client.0.smithi037.stdout:2/974: fsync d1/da/dc/f18 0 2024-09-19T06:08:51.737 INFO:tasks.workunit.client.0.smithi037.stdout:2/975: fsync d1/d6/f12 0 2024-09-19T06:08:51.737 INFO:tasks.workunit.client.0.smithi037.stdout:2/976: read - d1/d33/d4c/f10f zero size 2024-09-19T06:08:51.738 INFO:tasks.workunit.client.0.smithi037.stdout:2/977: rename d1/d6/da3 to d1/da/dc/d21/d14a 0 2024-09-19T06:08:51.738 INFO:tasks.workunit.client.0.smithi037.stdout:2/978: write d1/d16/f40 [671124,16357] 0 2024-09-19T06:08:51.745 INFO:tasks.workunit.client.0.smithi037.stdout:1/829: dread d2/d12/d1e/d75/f94 [0,4194304] 0 2024-09-19T06:08:51.747 INFO:tasks.workunit.client.0.smithi037.stdout:1/830: symlink d2/d12/d1d/d6b/d8b/dfb/l112 0 2024-09-19T06:08:51.747 INFO:tasks.workunit.client.0.smithi037.stdout:1/831: mknod d2/d12/d1d/d6b/c113 0 2024-09-19T06:08:51.747 INFO:tasks.workunit.client.0.smithi037.stdout:3/842: dwrite d0/d43/d23/f69 [8388608,4194304] 0 2024-09-19T06:08:51.748 INFO:tasks.workunit.client.0.smithi037.stdout:1/832: rmdir d2 39 2024-09-19T06:08:51.748 INFO:tasks.workunit.client.0.smithi037.stdout:1/833: fdatasync d2/d12/d15/dd3/dd4/ffc 0 2024-09-19T06:08:51.749 INFO:tasks.workunit.client.0.smithi037.stdout:3/843: mknod d0/d43/d23/d7a/d77/dc3/dfb/d110/c115 0 2024-09-19T06:08:51.749 INFO:tasks.workunit.client.0.smithi037.stdout:3/844: rmdir d0/d16/d19/d33/d87/dbd 39 2024-09-19T06:08:51.750 INFO:tasks.workunit.client.0.smithi037.stdout:3/845: creat d0/d16/d19/d1d/d5e/d61/f116 x:0 0 0 2024-09-19T06:08:51.750 INFO:tasks.workunit.client.0.smithi037.stdout:3/846: write d0/d43/d23/f111 [110045,96606] 0 2024-09-19T06:08:51.751 INFO:tasks.workunit.client.0.smithi037.stdout:3/847: getdents d0/d5f 0 2024-09-19T06:08:51.751 INFO:tasks.workunit.client.0.smithi037.stdout:3/848: truncate d0/d16/f30 6783679 0 2024-09-19T06:08:51.752 INFO:tasks.workunit.client.0.smithi037.stdout:2/979: dread d1/da/dc/d21/d51/f52 [0,4194304] 0 2024-09-19T06:08:51.753 INFO:tasks.workunit.client.0.smithi037.stdout:2/980: mkdir d1/d16/d62/d14b 0 2024-09-19T06:08:51.754 INFO:tasks.workunit.client.0.smithi037.stdout:2/981: rmdir d1/d16/d62 39 2024-09-19T06:08:51.755 INFO:tasks.workunit.client.0.smithi037.stdout:2/982: unlink d1/da/d6e/c13e 0 2024-09-19T06:08:51.757 INFO:tasks.workunit.client.0.smithi037.stdout:2/983: unlink d1/da/dc/cf3 0 2024-09-19T06:08:51.758 INFO:tasks.workunit.client.0.smithi037.stdout:2/984: mknod d1/d9e/d141/df4/c14c 0 2024-09-19T06:08:51.758 INFO:tasks.workunit.client.0.smithi037.stdout:2/985: chown d1/d6/fe 659254243 1 2024-09-19T06:08:51.760 INFO:tasks.workunit.client.0.smithi037.stdout:2/986: mknod d1/d33/c14d 0 2024-09-19T06:08:51.760 INFO:tasks.workunit.client.0.smithi037.stdout:2/987: fsync d1/da/dc/d11e/f145 0 2024-09-19T06:08:51.763 INFO:tasks.workunit.client.0.smithi037.stdout:1/834: dread d2/d12/f44 [0,4194304] 0 2024-09-19T06:08:51.763 INFO:tasks.workunit.client.0.smithi037.stdout:1/835: dread - d2/d12/d1e/d2a/fef zero size 2024-09-19T06:08:51.766 INFO:tasks.workunit.client.0.smithi037.stdout:3/849: dread d0/d16/d19/fe8 [0,4194304] 0 2024-09-19T06:08:51.766 INFO:tasks.workunit.client.0.smithi037.stdout:3/850: readlink d0/d16/d19/d1d/dc7/ld9 0 2024-09-19T06:08:51.766 INFO:tasks.workunit.client.0.smithi037.stdout:3/851: chown d0/d43/d23/d7a/d77/d62/l66 11 1 2024-09-19T06:08:51.770 INFO:tasks.workunit.client.0.smithi037.stdout:1/836: link d2/d12/d1e/dbe/le3 d2/d12/d1e/d63/l114 0 2024-09-19T06:08:51.771 INFO:tasks.workunit.client.0.smithi037.stdout:1/837: mknod d2/d12/d15/d34/d90/c115 0 2024-09-19T06:08:51.771 INFO:tasks.workunit.client.0.smithi037.stdout:1/838: read d2/d12/d1e/d2d/f4c [4130223,4301] 0 2024-09-19T06:08:51.771 INFO:tasks.workunit.client.0.smithi037.stdout:1/839: chown d2/d73/fcc 0 1 2024-09-19T06:08:51.771 INFO:tasks.workunit.client.0.smithi037.stdout:1/840: truncate d2/d12/d15/d34/d90/fed 139372 0 2024-09-19T06:08:51.772 INFO:tasks.workunit.client.0.smithi037.stdout:6/918: sync 2024-09-19T06:08:51.772 INFO:tasks.workunit.client.0.smithi037.stdout:5/835: sync 2024-09-19T06:08:51.773 INFO:tasks.workunit.client.0.smithi037.stdout:6/919: unlink d9/dd/d2b/d42/fdd 0 2024-09-19T06:08:51.775 INFO:tasks.workunit.client.0.smithi037.stdout:2/988: dread d1/da/dc/d21/d55/f66 [0,4194304] 0 2024-09-19T06:08:51.787 INFO:tasks.workunit.client.0.smithi037.stdout:3/852: dread d0/d16/d19/f2e [0,4194304] 0 2024-09-19T06:08:51.788 INFO:tasks.workunit.client.0.smithi037.stdout:1/841: dread d2/f9 [0,4194304] 0 2024-09-19T06:08:51.789 INFO:tasks.workunit.client.0.smithi037.stdout:1/842: dread d2/d12/d1d/fd5 [0,4194304] 0 2024-09-19T06:08:51.791 INFO:tasks.workunit.client.0.smithi037.stdout:1/843: creat d2/d12/d1e/d2a/d2e/df9/f116 x:0 0 0 2024-09-19T06:08:51.791 INFO:tasks.workunit.client.0.smithi037.stdout:1/844: truncate d2/d12/d1e/d2a/d2e/f7e 1201552 0 2024-09-19T06:08:51.792 INFO:tasks.workunit.client.0.smithi037.stdout:1/845: truncate d2/d12/d17/f18 1601519 0 2024-09-19T06:08:51.793 INFO:tasks.workunit.client.0.smithi037.stdout:1/846: unlink d2/d12/d1d/d6b/c113 0 2024-09-19T06:08:51.793 INFO:tasks.workunit.client.0.smithi037.stdout:2/989: dread d1/da/dc/d21/d51/f52 [0,4194304] 0 2024-09-19T06:08:51.793 INFO:tasks.workunit.client.0.smithi037.stdout:5/836: dread d2/d12/d28/d22/d53/f7d [0,4194304] 0 2024-09-19T06:08:51.795 INFO:tasks.workunit.client.0.smithi037.stdout:1/847: unlink d2/d12/d1e/d63/d9e/cc2 0 2024-09-19T06:08:51.796 INFO:tasks.workunit.client.0.smithi037.stdout:5/837: unlink d2/d12/d24/d58/d96/ff8 0 2024-09-19T06:08:51.797 INFO:tasks.workunit.client.0.smithi037.stdout:5/838: creat d2/d12/d28/d22/d53/f107 x:0 0 0 2024-09-19T06:08:51.798 INFO:tasks.workunit.client.0.smithi037.stdout:5/839: creat d2/d12/d28/d22/d87/f108 x:0 0 0 2024-09-19T06:08:51.800 INFO:tasks.workunit.client.0.smithi037.stdout:5/840: link d2/d12/d24/d58/d7f/l98 d2/d12/d28/l109 0 2024-09-19T06:08:51.802 INFO:tasks.workunit.client.0.smithi037.stdout:5/841: mkdir d2/d12/d28/d22/d87/da8/dfe/d10a 0 2024-09-19T06:08:51.802 INFO:tasks.workunit.client.0.smithi037.stdout:5/842: chown d2/d12/d24/d58 0 1 2024-09-19T06:08:51.804 INFO:tasks.workunit.client.0.smithi037.stdout:5/843: mknod d2/d12/d28/d22/d53/c10b 0 2024-09-19T06:08:51.804 INFO:tasks.workunit.client.0.smithi037.stdout:5/844: getdents d2/d12/d7e/ddf 0 2024-09-19T06:08:51.805 INFO:tasks.workunit.client.0.smithi037.stdout:5/845: creat d2/d12/d24/d58/d96/f10c x:0 0 0 2024-09-19T06:08:51.810 INFO:tasks.workunit.client.0.smithi037.stdout:2/990: read d1/da/dc/d11e/f136 [1917803,105539] 0 2024-09-19T06:08:51.811 INFO:tasks.workunit.client.0.smithi037.stdout:3/853: dwrite d0/d16/fc6 [0,4194304] 0 2024-09-19T06:08:51.823 INFO:tasks.workunit.client.0.smithi037.stdout:3/854: dread d0/d43/d26/fe3 [0,4194304] 0 2024-09-19T06:08:51.825 INFO:tasks.workunit.client.0.smithi037.stdout:3/855: creat d0/d16/d19/d1d/d5e/d61/dc4/f117 x:0 0 0 2024-09-19T06:08:51.829 INFO:tasks.workunit.client.0.smithi037.stdout:3/856: dread d0/d5f/da0/fc1 [0,4194304] 0 2024-09-19T06:08:51.829 INFO:tasks.workunit.client.0.smithi037.stdout:1/848: dwrite d2/d12/d1e/d2a/d2e/fae [0,4194304] 0 2024-09-19T06:08:51.829 INFO:tasks.workunit.client.0.smithi037.stdout:5/846: dread d2/d12/d28/d22/d53/fef [0,4194304] 0 2024-09-19T06:08:51.830 INFO:tasks.workunit.client.0.smithi037.stdout:1/849: rename d2/d12/d1e/d2a/fef to d2/d12/d1d/d6b/d8b/dfb/f117 0 2024-09-19T06:08:51.831 INFO:tasks.workunit.client.0.smithi037.stdout:1/850: mknod d2/d12/d1e/d2a/c118 0 2024-09-19T06:08:51.831 INFO:tasks.workunit.client.0.smithi037.stdout:1/851: write d2/d12/d15/d34/f46 [4490456,71263] 0 2024-09-19T06:08:51.832 INFO:tasks.workunit.client.0.smithi037.stdout:2/991: dwrite d1/da/dc/d11e/f145 [0,4194304] 0 2024-09-19T06:08:51.833 INFO:tasks.workunit.client.0.smithi037.stdout:2/992: mkdir d1/d9e/d141/d14e 0 2024-09-19T06:08:51.834 INFO:tasks.workunit.client.0.smithi037.stdout:2/993: mknod d1/d33/c14f 0 2024-09-19T06:08:51.846 INFO:tasks.workunit.client.0.smithi037.stdout:3/857: read d0/d43/d37/fa7 [468193,123136] 0 2024-09-19T06:08:51.853 INFO:tasks.workunit.client.0.smithi037.stdout:5/847: write d2/d10/da1/dac/fd6 [3503487,13409] 0 2024-09-19T06:08:51.853 INFO:tasks.workunit.client.0.smithi037.stdout:5/848: fdatasync d2/d12/d28/d22/d87/ff6 0 2024-09-19T06:08:51.854 INFO:tasks.workunit.client.0.smithi037.stdout:5/849: getdents d2/d12/d7e 0 2024-09-19T06:08:51.855 INFO:tasks.workunit.client.0.smithi037.stdout:2/994: dwrite d1/da/dc/f18 [0,4194304] 0 2024-09-19T06:08:51.870 INFO:tasks.workunit.client.0.smithi037.stdout:3/858: dwrite d0/d43/d26/fb3 [0,4194304] 0 2024-09-19T06:08:51.876 INFO:tasks.workunit.client.0.smithi037.stdout:5/850: dwrite d2/d12/d7e/fe4 [0,4194304] 0 2024-09-19T06:08:51.877 INFO:tasks.workunit.client.0.smithi037.stdout:5/851: creat d2/d12/d24/d58/d96/dd7/f10d x:0 0 0 2024-09-19T06:08:51.883 INFO:tasks.workunit.client.0.smithi037.stdout:3/859: write d0/d16/d19/f9c [1368046,101273] 0 2024-09-19T06:08:51.883 INFO:tasks.workunit.client.0.smithi037.stdout:3/860: stat d0/d16/d19/d1d/d5e/da9/cb4 0 2024-09-19T06:08:51.883 INFO:tasks.workunit.client.0.smithi037.stdout:3/861: fdatasync d0/d43/f5b 0 2024-09-19T06:08:51.890 INFO:tasks.workunit.client.0.smithi037.stdout:5/852: write d2/d12/d24/f70 [1868791,113862] 0 2024-09-19T06:08:51.893 INFO:tasks.workunit.client.0.smithi037.stdout:7/890: sync 2024-09-19T06:08:51.894 INFO:tasks.workunit.client.0.smithi037.stdout:7/891: rename d6/d21/l28 to d6/d20/d4b/d60/d33/l11f 0 2024-09-19T06:08:51.894 INFO:tasks.workunit.client.0.smithi037.stdout:7/892: chown d6/dc/df/d7e/cb2 125566 1 2024-09-19T06:08:51.896 INFO:tasks.workunit.client.0.smithi037.stdout:3/862: dread d0/d5f/fc0 [0,4194304] 0 2024-09-19T06:08:51.905 INFO:tasks.workunit.client.0.smithi037.stdout:5/853: dread d2/d12/d7e/fe4 [0,4194304] 0 2024-09-19T06:08:51.906 INFO:tasks.workunit.client.0.smithi037.stdout:5/854: mkdir d2/d12/d24/d97/dbc/d10e 0 2024-09-19T06:08:51.907 INFO:tasks.workunit.client.0.smithi037.stdout:5/855: write d2/fe2 [848355,55741] 0 2024-09-19T06:08:51.908 INFO:tasks.workunit.client.0.smithi037.stdout:3/863: dread d0/d16/d19/f42 [0,4194304] 0 2024-09-19T06:08:51.909 INFO:tasks.workunit.client.0.smithi037.stdout:5/856: creat d2/d12/d24/f10f x:0 0 0 2024-09-19T06:08:51.910 INFO:tasks.workunit.client.0.smithi037.stdout:3/864: creat d0/d43/d37/f118 x:0 0 0 2024-09-19T06:08:51.910 INFO:tasks.workunit.client.0.smithi037.stdout:3/865: stat d0/d16/f30 0 2024-09-19T06:08:51.912 INFO:tasks.workunit.client.0.smithi037.stdout:3/866: rename d0/d43/d23/f2a to d0/d43/d23/d7a/d77/db8/f119 0 2024-09-19T06:08:51.912 INFO:tasks.workunit.client.0.smithi037.stdout:3/867: chown d0/d43/d23/d7a/d77/dc3/dfb/d110 1571 1 2024-09-19T06:08:51.912 INFO:tasks.workunit.client.0.smithi037.stdout:3/868: dread - d0/d16/d19/d1d/d5e/d61/dc4/fc5 zero size 2024-09-19T06:08:51.913 INFO:tasks.workunit.client.0.smithi037.stdout:3/869: getdents d0/d16/d19/d1d/dd1/d106 0 2024-09-19T06:08:51.913 INFO:tasks.workunit.client.0.smithi037.stdout:3/870: rmdir d0/d16/d19/d1d/dd1 39 2024-09-19T06:08:51.914 INFO:tasks.workunit.client.0.smithi037.stdout:7/893: dwrite d6/f2b [0,4194304] 0 2024-09-19T06:08:51.929 INFO:tasks.workunit.client.0.smithi037.stdout:5/857: dwrite d2/d12/d28/d57/f91 [0,4194304] 0 2024-09-19T06:08:51.931 INFO:tasks.workunit.client.0.smithi037.stdout:7/894: read d6/d20/d4b/d60/d33/d8c/f112 [1816967,83555] 0 2024-09-19T06:08:51.932 INFO:tasks.workunit.client.0.smithi037.stdout:7/895: symlink d6/d20/d4b/l120 0 2024-09-19T06:08:51.932 INFO:tasks.workunit.client.0.smithi037.stdout:7/896: write d6/dc/d22/d59/da8/dc4/fcd [513223,117345] 0 2024-09-19T06:08:51.933 INFO:tasks.workunit.client.0.smithi037.stdout:7/897: creat d6/d21/d68/f121 x:0 0 0 2024-09-19T06:08:51.933 INFO:tasks.workunit.client.0.smithi037.stdout:7/898: write d6/dc/d22/f4c [293680,126308] 0 2024-09-19T06:08:51.933 INFO:tasks.workunit.client.0.smithi037.stdout:7/899: chown d6/dc 0 1 2024-09-19T06:08:51.933 INFO:tasks.workunit.client.0.smithi037.stdout:7/900: write d6/d20/d34/f93 [2650228,83958] 0 2024-09-19T06:08:51.936 INFO:tasks.workunit.client.0.smithi037.stdout:3/871: write d0/d43/d23/d7a/d77/d51/fb9 [4163987,23219] 0 2024-09-19T06:08:51.937 INFO:tasks.workunit.client.0.smithi037.stdout:3/872: rename d0/l13 to d0/d96/l11a 0 2024-09-19T06:08:51.938 INFO:tasks.workunit.client.0.smithi037.stdout:3/873: link d0/d43/f7f d0/f11b 0 2024-09-19T06:08:51.940 INFO:tasks.workunit.client.0.smithi037.stdout:3/874: link d0/d16/d19/f9c d0/d43/d23/d7a/d77/dc3/df8/f11c 0 2024-09-19T06:08:51.952 INFO:tasks.workunit.client.0.smithi037.stdout:7/901: dread d6/d20/d4b/d60/f31 [4194304,4194304] 0 2024-09-19T06:08:51.952 INFO:tasks.workunit.client.0.smithi037.stdout:5/858: dwrite d2/d12/d24/d58/d7f/fc2 [0,4194304] 0 2024-09-19T06:08:51.954 INFO:tasks.workunit.client.0.smithi037.stdout:7/902: creat d6/d21/f122 x:0 0 0 2024-09-19T06:08:51.955 INFO:tasks.workunit.client.0.smithi037.stdout:5/859: creat d2/d10/da1/dac/f110 x:0 0 0 2024-09-19T06:08:51.955 INFO:tasks.workunit.client.0.smithi037.stdout:5/860: dread - d2/d12/fe9 zero size 2024-09-19T06:08:51.957 INFO:tasks.workunit.client.0.smithi037.stdout:7/903: creat d6/dc/daf/f123 x:0 0 0 2024-09-19T06:08:51.958 INFO:tasks.workunit.client.0.smithi037.stdout:5/861: mknod d2/d5c/c111 0 2024-09-19T06:08:51.958 INFO:tasks.workunit.client.0.smithi037.stdout:5/862: fdatasync d2/d12/d24/f10f 0 2024-09-19T06:08:51.959 INFO:tasks.workunit.client.0.smithi037.stdout:5/863: creat d2/d12/d24/d97/f112 x:0 0 0 2024-09-19T06:08:51.960 INFO:tasks.workunit.client.0.smithi037.stdout:5/864: link d2/d12/d7e/ddf/le7 d2/d12/d28/d22/d87/l113 0 2024-09-19T06:08:51.961 INFO:tasks.workunit.client.0.smithi037.stdout:3/875: dwrite d0/f10b [0,4194304] 0 2024-09-19T06:08:51.961 INFO:tasks.workunit.client.0.smithi037.stdout:5/865: rmdir d2/d12/d28/d22/d4a/d9f/de8 39 2024-09-19T06:08:51.961 INFO:tasks.workunit.client.0.smithi037.stdout:5/866: write d2/d12/d24/d58/d96/f10c [494180,46303] 0 2024-09-19T06:08:51.967 INFO:tasks.workunit.client.0.smithi037.stdout:3/876: creat d0/d43/d26/f11d x:0 0 0 2024-09-19T06:08:51.968 INFO:tasks.workunit.client.0.smithi037.stdout:5/867: unlink d2/d10/da1/dac/fd6 0 2024-09-19T06:08:51.969 INFO:tasks.workunit.client.0.smithi037.stdout:5/868: creat d2/d5c/dda/f114 x:0 0 0 2024-09-19T06:08:51.969 INFO:tasks.workunit.client.0.smithi037.stdout:5/869: fsync d2/f80 0 2024-09-19T06:08:51.970 INFO:tasks.workunit.client.0.smithi037.stdout:7/904: dread d6/f92 [4194304,4194304] 0 2024-09-19T06:08:51.974 INFO:tasks.workunit.client.0.smithi037.stdout:7/905: creat d6/d20/f124 x:0 0 0 2024-09-19T06:08:51.974 INFO:tasks.workunit.client.0.smithi037.stdout:7/906: chown d6/d21/c4a 129533 1 2024-09-19T06:08:51.974 INFO:tasks.workunit.client.0.smithi037.stdout:7/907: write d6/dc/df/d7e/d99/ffd [554843,5812] 0 2024-09-19T06:08:51.975 INFO:tasks.workunit.client.0.smithi037.stdout:7/908: truncate d6/d20/d34/f9a 2078008 0 2024-09-19T06:08:51.976 INFO:tasks.workunit.client.0.smithi037.stdout:7/909: symlink d6/d20/d34/dc0/dcf/dfa/l125 0 2024-09-19T06:08:51.976 INFO:tasks.workunit.client.0.smithi037.stdout:0/899: sync 2024-09-19T06:08:51.978 INFO:tasks.workunit.client.0.smithi037.stdout:6/920: sync 2024-09-19T06:08:51.978 INFO:tasks.workunit.client.0.smithi037.stdout:2/995: sync 2024-09-19T06:08:51.978 INFO:tasks.workunit.client.0.smithi037.stdout:9/975: sync 2024-09-19T06:08:51.978 INFO:tasks.workunit.client.0.smithi037.stdout:1/852: sync 2024-09-19T06:08:51.978 INFO:tasks.workunit.client.0.smithi037.stdout:9/976: truncate da/dec/d116/d1b/d62/f84 1177191 0 2024-09-19T06:08:51.979 INFO:tasks.workunit.client.0.smithi037.stdout:1/853: rename d2/d12/d1d/f4f to d2/d12/d1e/f119 0 2024-09-19T06:08:51.979 INFO:tasks.workunit.client.0.smithi037.stdout:1/854: write d2/d12/d15/f58 [4643590,110469] 0 2024-09-19T06:08:51.981 INFO:tasks.workunit.client.0.smithi037.stdout:1/855: link d2/d12/d15/d34/f46 d2/d12/d1e/d75/d89/de0/f11a 0 2024-09-19T06:08:51.981 INFO:tasks.workunit.client.0.smithi037.stdout:1/856: read - d2/d12/d1e/dbe/fdd zero size 2024-09-19T06:08:51.981 INFO:tasks.workunit.client.0.smithi037.stdout:3/877: read d0/d16/d19/d33/f38 [985162,65066] 0 2024-09-19T06:08:51.984 INFO:tasks.workunit.client.0.smithi037.stdout:1/857: symlink d2/d12/d1e/d2a/d8f/da6/l11b 0 2024-09-19T06:08:51.987 INFO:tasks.workunit.client.0.smithi037.stdout:3/878: rename d0/f5a to d0/d43/d23/d7a/d77/f11e 0 2024-09-19T06:08:51.991 INFO:tasks.workunit.client.0.smithi037.stdout:5/870: dread d2/d12/d7e/fe4 [0,4194304] 0 2024-09-19T06:08:51.992 INFO:tasks.workunit.client.0.smithi037.stdout:5/871: mknod d2/d12/d28/d57/c115 0 2024-09-19T06:08:52.011 INFO:tasks.workunit.client.0.smithi037.stdout:6/921: write d9/dd/d2b/fa3 [1020934,64126] 0 2024-09-19T06:08:52.011 INFO:tasks.workunit.client.0.smithi037.stdout:6/922: write d9/dd/d2b/d79/f70 [4086806,11108] 0 2024-09-19T06:08:52.013 INFO:tasks.workunit.client.0.smithi037.stdout:0/900: dwrite d5/d8/d79/d9a/ddb/d106/dd1/fe3 [0,4194304] 0 2024-09-19T06:08:52.013 INFO:tasks.workunit.client.0.smithi037.stdout:0/901: chown d5/dd5/de9/d21/d118/c101 29990403 1 2024-09-19T06:08:52.014 INFO:tasks.workunit.client.0.smithi037.stdout:0/902: dread - d5/d8/d44/d10f/d125/d89/de7/ff5 zero size 2024-09-19T06:08:52.014 INFO:tasks.workunit.client.0.smithi037.stdout:9/977: dwrite da/d20/f118 [0,4194304] 0 2024-09-19T06:08:52.015 INFO:tasks.workunit.client.0.smithi037.stdout:5/872: dread d2/d10/f21 [0,4194304] 0 2024-09-19T06:08:52.016 INFO:tasks.workunit.client.0.smithi037.stdout:0/903: symlink d5/d18/d68/d85/dab/dba/l138 0 2024-09-19T06:08:52.016 INFO:tasks.workunit.client.0.smithi037.stdout:2/996: write d1/d16/d4a/f8d [24820,6215] 0 2024-09-19T06:08:52.016 INFO:tasks.workunit.client.0.smithi037.stdout:9/978: rmdir da/dec/d116/d1b/d62/df4 39 2024-09-19T06:08:52.019 INFO:tasks.workunit.client.0.smithi037.stdout:7/910: dwrite d6/dc/d22/d59/fe7 [0,4194304] 0 2024-09-19T06:08:52.026 INFO:tasks.workunit.client.0.smithi037.stdout:3/879: dwrite d0/ff [0,4194304] 0 2024-09-19T06:08:52.026 INFO:tasks.workunit.client.0.smithi037.stdout:3/880: stat d0/d16/d19/d33/c49 0 2024-09-19T06:08:52.028 INFO:tasks.workunit.client.0.smithi037.stdout:3/881: unlink d0/d43/d23/d7a/d77/d51/f76 0 2024-09-19T06:08:52.030 INFO:tasks.workunit.client.0.smithi037.stdout:3/882: getdents d0/d16/d19/d1d/d5e/d61/dc4 0 2024-09-19T06:08:52.030 INFO:tasks.workunit.client.0.smithi037.stdout:2/997: dread d1/da/dd7/d144/fff [0,4194304] 0 2024-09-19T06:08:52.030 INFO:tasks.workunit.client.0.smithi037.stdout:1/858: dwrite d2/d12/d1d/d47/fbd [0,4194304] 0 2024-09-19T06:08:52.031 INFO:tasks.workunit.client.0.smithi037.stdout:2/998: write d1/d33/d4c/f128 [163616,34900] 0 2024-09-19T06:08:52.032 INFO:tasks.workunit.client.0.smithi037.stdout:6/923: dread d9/dd/f32 [0,4194304] 0 2024-09-19T06:08:52.032 INFO:tasks.workunit.client.0.smithi037.stdout:3/883: mknod d0/d43/d23/d7a/d77/db8/c11f 0 2024-09-19T06:08:52.035 INFO:tasks.workunit.client.0.smithi037.stdout:9/979: write da/dec/d116/d63/f9b [4125653,7945] 0 2024-09-19T06:08:52.036 INFO:tasks.workunit.client.0.smithi037.stdout:2/999: symlink d1/da/dc/d21/d55/dbc/l150 0 2024-09-19T06:08:52.037 INFO:tasks.workunit.client.0.smithi037.stdout:6/924: getdents d9/d6e/d10c/d5a 0 2024-09-19T06:08:52.037 INFO:tasks.workunit.client.0.smithi037.stdout:6/925: chown d9/dd/d1c/d4e/f36 1814 1 2024-09-19T06:08:52.037 INFO:tasks.workunit.client.0.smithi037.stdout:3/884: mknod d0/d16/ddf/c120 0 2024-09-19T06:08:52.038 INFO:tasks.workunit.client.0.smithi037.stdout:6/926: getdents d9/d6e/d10c/d5a/d6d/d82 0 2024-09-19T06:08:52.042 INFO:tasks.workunit.client.0.smithi037.stdout:3/885: unlink d0/d43/f4c 0 2024-09-19T06:08:52.042 INFO:tasks.workunit.client.0.smithi037.stdout:3/886: truncate d0/d16/d19/d1d/dd1/f103 99980 0 2024-09-19T06:08:52.042 INFO:tasks.workunit.client.0.smithi037.stdout:3/887: fdatasync d0/d16/fc6 0 2024-09-19T06:08:52.042 INFO:tasks.workunit.client.0.smithi037.stdout:3/888: chown d0/d43/d23/d7a/d77/d51/fcf 496529 1 2024-09-19T06:08:52.043 INFO:tasks.workunit.client.0.smithi037.stdout:6/927: rename d9/d16/f8a to d9/dd/d1c/d119/f129 0 2024-09-19T06:08:52.043 INFO:tasks.workunit.client.0.smithi037.stdout:6/928: read d9/dd/d2b/d79/f70 [2018210,3436] 0 2024-09-19T06:08:52.044 INFO:tasks.workunit.client.0.smithi037.stdout:3/889: unlink d0/c2f 0 2024-09-19T06:08:52.045 INFO:tasks.workunit.client.0.smithi037.stdout:7/911: write d6/f92 [3640956,17010] 0 2024-09-19T06:08:52.045 INFO:tasks.workunit.client.0.smithi037.stdout:3/890: unlink d0/d43/d23/f69 0 2024-09-19T06:08:52.046 INFO:tasks.workunit.client.0.smithi037.stdout:7/912: truncate d6/d21/f52 517791 0 2024-09-19T06:08:52.046 INFO:tasks.workunit.client.0.smithi037.stdout:3/891: mkdir d0/d43/d23/d7a/d77/db8/d121 0 2024-09-19T06:08:52.047 INFO:tasks.workunit.client.0.smithi037.stdout:7/913: truncate d6/d20/d4b/d60/f62 3613291 0 2024-09-19T06:08:52.047 INFO:tasks.workunit.client.0.smithi037.stdout:7/914: stat d6/dc/d22/cbd 0 2024-09-19T06:08:52.048 INFO:tasks.workunit.client.0.smithi037.stdout:3/892: symlink d0/d43/d23/d7a/d77/db8/l122 0 2024-09-19T06:08:52.050 INFO:tasks.workunit.client.0.smithi037.stdout:7/915: rmdir d6/d21/da4 0 2024-09-19T06:08:52.054 INFO:tasks.workunit.client.0.smithi037.stdout:0/904: dwrite d5/f7 [4194304,4194304] 0 2024-09-19T06:08:52.060 INFO:tasks.workunit.client.0.smithi037.stdout:5/873: dwrite d2/d12/d24/f95 [4194304,4194304] 0 2024-09-19T06:08:52.062 INFO:tasks.workunit.client.0.smithi037.stdout:1/859: dwrite d2/d12/d15/fd2 [0,4194304] 0 2024-09-19T06:08:52.064 INFO:tasks.workunit.client.0.smithi037.stdout:5/874: creat d2/d12/d7e/ddf/f116 x:0 0 0 2024-09-19T06:08:52.064 INFO:tasks.workunit.client.0.smithi037.stdout:5/875: fsync d2/f80 0 2024-09-19T06:08:52.064 INFO:tasks.workunit.client.0.smithi037.stdout:5/876: write d2/d12/d7e/fa6 [1149119,130741] 0 2024-09-19T06:08:52.064 INFO:tasks.workunit.client.0.smithi037.stdout:5/877: chown d2/d12/d28/d22/d4a/d9f/cf5 170284519 1 2024-09-19T06:08:52.064 INFO:tasks.workunit.client.0.smithi037.stdout:3/893: dread d0/d16/d19/d1d/d7c/f85 [0,4194304] 0 2024-09-19T06:08:52.065 INFO:tasks.workunit.client.0.smithi037.stdout:3/894: fsync d0/d43/d23/d7a/d77/d62/f90 0 2024-09-19T06:08:52.065 INFO:tasks.workunit.client.0.smithi037.stdout:5/878: truncate d2/d12/d24/d58/d96/dd7/dfb/fc3 2362075 0 2024-09-19T06:08:52.065 INFO:tasks.workunit.client.0.smithi037.stdout:5/879: stat d2/d12/d28/d22/d53/fef 0 2024-09-19T06:08:52.066 INFO:tasks.workunit.client.0.smithi037.stdout:3/895: mknod d0/d16/da6/dd4/c123 0 2024-09-19T06:08:52.066 INFO:tasks.workunit.client.0.smithi037.stdout:5/880: mknod d2/d10/da1/c117 0 2024-09-19T06:08:52.067 INFO:tasks.workunit.client.0.smithi037.stdout:5/881: mknod d2/d12/d7e/c118 0 2024-09-19T06:08:52.068 INFO:tasks.workunit.client.0.smithi037.stdout:5/882: symlink d2/d12/d28/d22/d87/da8/dfe/l119 0 2024-09-19T06:08:52.078 INFO:tasks.workunit.client.0.smithi037.stdout:9/980: dwrite da/d20/f11a [0,4194304] 0 2024-09-19T06:08:52.086 INFO:tasks.workunit.client.0.smithi037.stdout:7/916: read d6/d20/d4b/d60/f62 [1843191,25976] 0 2024-09-19T06:08:52.086 INFO:tasks.workunit.client.0.smithi037.stdout:6/929: dwrite d9/d6e/d10c/d5a/dd2/de4/ffc [0,4194304] 0 2024-09-19T06:08:52.086 INFO:tasks.workunit.client.0.smithi037.stdout:1/860: dread d2/fa [4194304,4194304] 0 2024-09-19T06:08:52.088 INFO:tasks.workunit.client.0.smithi037.stdout:7/917: symlink d6/dc/dc6/l126 0 2024-09-19T06:08:52.088 INFO:tasks.workunit.client.0.smithi037.stdout:7/918: write d6/d20/d4b/d60/d33/d55/d6d/f11c [83667,104714] 0 2024-09-19T06:08:52.090 INFO:tasks.workunit.client.0.smithi037.stdout:6/930: getdents d9/dd/d1c/d4e/d65/db0 0 2024-09-19T06:08:52.091 INFO:tasks.workunit.client.0.smithi037.stdout:0/905: dwrite d5/d17/d6e/ff3 [0,4194304] 0 2024-09-19T06:08:52.091 INFO:tasks.workunit.client.0.smithi037.stdout:0/906: getdents d5/dd5/de9 0 2024-09-19T06:08:52.091 INFO:tasks.workunit.client.0.smithi037.stdout:0/907: chown d5/dd5/de9/d21/f72 8396 1 2024-09-19T06:08:52.092 INFO:tasks.workunit.client.0.smithi037.stdout:0/908: chown d5/d8/d79/de1 64713902 1 2024-09-19T06:08:52.097 INFO:tasks.workunit.client.0.smithi037.stdout:6/931: mkdir d9/d6e/d10c/d5a/d12a 0 2024-09-19T06:08:52.097 INFO:tasks.workunit.client.0.smithi037.stdout:7/919: creat d6/dc/f127 x:0 0 0 2024-09-19T06:08:52.098 INFO:tasks.workunit.client.0.smithi037.stdout:7/920: getdents d6/d21/d68 0 2024-09-19T06:08:52.098 INFO:tasks.workunit.client.0.smithi037.stdout:7/921: readlink d6/dc/dc6/l126 0 2024-09-19T06:08:52.098 INFO:tasks.workunit.client.0.smithi037.stdout:7/922: stat d6/d20/d34/d97/l101 0 2024-09-19T06:08:52.098 INFO:tasks.workunit.client.0.smithi037.stdout:7/923: chown d6/d20/d34/dc0/dcf/dec/c10a 14104264 1 2024-09-19T06:08:52.099 INFO:tasks.workunit.client.0.smithi037.stdout:6/932: symlink d9/d6e/d10c/d5a/d6d/d82/l12b 0 2024-09-19T06:08:52.099 INFO:tasks.workunit.client.0.smithi037.stdout:6/933: dread - d9/dd/d1c/d4e/f101 zero size 2024-09-19T06:08:52.099 INFO:tasks.workunit.client.0.smithi037.stdout:3/896: dread d0/d16/f88 [0,4194304] 0 2024-09-19T06:08:52.099 INFO:tasks.workunit.client.0.smithi037.stdout:3/897: write d0/d5f/d70/fba [375341,99782] 0 2024-09-19T06:08:52.099 INFO:tasks.workunit.client.0.smithi037.stdout:3/898: dread - d0/d16/d19/fad zero size 2024-09-19T06:08:52.100 INFO:tasks.workunit.client.0.smithi037.stdout:7/924: creat d6/dc/d7b/f128 x:0 0 0 2024-09-19T06:08:52.100 INFO:tasks.workunit.client.0.smithi037.stdout:7/925: fsync d6/dc/d22/d59/da8/dc4/fdb 0 2024-09-19T06:08:52.100 INFO:tasks.workunit.client.0.smithi037.stdout:6/934: creat d9/d16/dcf/f12c x:0 0 0 2024-09-19T06:08:52.100 INFO:tasks.workunit.client.0.smithi037.stdout:9/981: dwrite da/dec/d116/d1b/d23/de9/fa6 [0,4194304] 0 2024-09-19T06:08:52.102 INFO:tasks.workunit.client.0.smithi037.stdout:3/899: rmdir d0/d43/d23/d7a/d77/dc3/dfb/d110 39 2024-09-19T06:08:52.102 INFO:tasks.workunit.client.0.smithi037.stdout:3/900: chown d0/d16/d19/d1d/d82/cc9 57123 1 2024-09-19T06:08:52.103 INFO:tasks.workunit.client.0.smithi037.stdout:9/982: symlink da/d20/d11c/ddc/d137/l15d 0 2024-09-19T06:08:52.103 INFO:tasks.workunit.client.0.smithi037.stdout:9/983: dread - da/dec/d116/d1b/d2f/d6d/db4/f148 zero size 2024-09-19T06:08:52.104 INFO:tasks.workunit.client.0.smithi037.stdout:9/984: write da/dec/d116/d1b/d23/de9/ff5 [1083342,93494] 0 2024-09-19T06:08:52.104 INFO:tasks.workunit.client.0.smithi037.stdout:7/926: write d6/dc/df/fae [167836,45803] 0 2024-09-19T06:08:52.104 INFO:tasks.workunit.client.0.smithi037.stdout:7/927: chown d6/d20/d34/d97 488832402 1 2024-09-19T06:08:52.104 INFO:tasks.workunit.client.0.smithi037.stdout:6/935: dread d9/d6e/d10c/d5a/d6d/d82/d9f/fca [0,4194304] 0 2024-09-19T06:08:52.104 INFO:tasks.workunit.client.0.smithi037.stdout:3/901: truncate d0/d16/d19/d33/f9d 1116602 0 2024-09-19T06:08:52.104 INFO:tasks.workunit.client.0.smithi037.stdout:3/902: read d0/d43/d23/f72 [131881,3163] 0 2024-09-19T06:08:52.105 INFO:tasks.workunit.client.0.smithi037.stdout:7/928: truncate d6/d21/f52 49404 0 2024-09-19T06:08:52.106 INFO:tasks.workunit.client.0.smithi037.stdout:3/903: mkdir d0/d16/d19/d1d/d5e/da9/db5/d124 0 2024-09-19T06:08:52.107 INFO:tasks.workunit.client.0.smithi037.stdout:7/929: truncate d6/d20/d4b/f5d 2363559 0 2024-09-19T06:08:52.107 INFO:tasks.workunit.client.0.smithi037.stdout:0/909: dread d5/dd5/de9/d21/d4e/fb5 [0,4194304] 0 2024-09-19T06:08:52.107 INFO:tasks.workunit.client.0.smithi037.stdout:0/910: write d5/d8/d79/f11c [55620,75233] 0 2024-09-19T06:08:52.109 INFO:tasks.workunit.client.0.smithi037.stdout:3/904: mknod d0/d43/d23/d7a/d77/c125 0 2024-09-19T06:08:52.119 INFO:tasks.workunit.client.0.smithi037.stdout:6/936: dread d9/f18 [0,4194304] 0 2024-09-19T06:08:52.119 INFO:tasks.workunit.client.0.smithi037.stdout:1/861: dwrite d2/d12/d15/d34/fc7 [0,4194304] 0 2024-09-19T06:08:52.124 INFO:tasks.workunit.client.0.smithi037.stdout:6/937: rename d9/d6e/d10c/d5a/d6d/d82/d9f/da4/f91 to d9/d6e/d10c/d5a/dd2/de4/f12d 0 2024-09-19T06:08:52.128 INFO:tasks.workunit.client.0.smithi037.stdout:9/985: write da/dec/d116/d1b/d43/de4/f133 [7101765,102397] 0 2024-09-19T06:08:52.128 INFO:tasks.workunit.client.0.smithi037.stdout:1/862: creat d2/d12/d1d/f11c x:0 0 0 2024-09-19T06:08:52.128 INFO:tasks.workunit.client.0.smithi037.stdout:6/938: symlink d9/dd/d1c/d119/l12e 0 2024-09-19T06:08:52.128 INFO:tasks.workunit.client.0.smithi037.stdout:1/863: write d2/d12/d1e/fe8 [415272,77509] 0 2024-09-19T06:08:52.130 INFO:tasks.workunit.client.0.smithi037.stdout:9/986: creat da/dec/d116/d63/d80/dc4/d11e/f15e x:0 0 0 2024-09-19T06:08:52.131 INFO:tasks.workunit.client.0.smithi037.stdout:6/939: getdents d9/d6e/d10c/d5a/d6d/d82/d9f 0 2024-09-19T06:08:52.133 INFO:tasks.workunit.client.0.smithi037.stdout:1/864: rename d2/d48/f9b to d2/d48/f11d 0 2024-09-19T06:08:52.136 INFO:tasks.workunit.client.0.smithi037.stdout:6/940: link d9/d6e/d10c/d5a/d6d/d82/d9f/fb8 d9/dd/d1c/d4e/d65/de2/f12f 0 2024-09-19T06:08:52.139 INFO:tasks.workunit.client.0.smithi037.stdout:6/941: unlink d9/dd/d1c/d4e/f34 0 2024-09-19T06:08:52.139 INFO:tasks.workunit.client.0.smithi037.stdout:6/942: rename d9/d6e/d10c/d5a/d6d to d9/d6e/d10c/d5a/d6d/d130 22 2024-09-19T06:08:52.141 INFO:tasks.workunit.client.0.smithi037.stdout:0/911: dwrite d5/fa3 [0,4194304] 0 2024-09-19T06:08:52.142 INFO:tasks.workunit.client.0.smithi037.stdout:3/905: dwrite d0/d43/f5b [4194304,4194304] 0 2024-09-19T06:08:52.142 INFO:tasks.workunit.client.0.smithi037.stdout:0/912: truncate d5/d8/d11/f109 2519568 0 2024-09-19T06:08:52.143 INFO:tasks.workunit.client.0.smithi037.stdout:3/906: chown d0/d16/f30 32661667 1 2024-09-19T06:08:52.143 INFO:tasks.workunit.client.0.smithi037.stdout:7/930: dwrite d6/dad/fb4 [0,4194304] 0 2024-09-19T06:08:52.144 INFO:tasks.workunit.client.0.smithi037.stdout:3/907: mknod d0/c126 0 2024-09-19T06:08:52.144 INFO:tasks.workunit.client.0.smithi037.stdout:3/908: chown d0/d16/da6/f10c 204480 1 2024-09-19T06:08:52.147 INFO:tasks.workunit.client.0.smithi037.stdout:7/931: mkdir d6/dc/df/d7e/d99/d129 0 2024-09-19T06:08:52.147 INFO:tasks.workunit.client.0.smithi037.stdout:3/909: mknod d0/d16/da6/dd4/c127 0 2024-09-19T06:08:52.147 INFO:tasks.workunit.client.0.smithi037.stdout:7/932: chown d6/dc/f94 977378 1 2024-09-19T06:08:52.147 INFO:tasks.workunit.client.0.smithi037.stdout:3/910: write d0/d16/d19/f1c [5213291,82177] 0 2024-09-19T06:08:52.147 INFO:tasks.workunit.client.0.smithi037.stdout:7/933: write d6/dc/d22/f5c [1632572,95006] 0 2024-09-19T06:08:52.147 INFO:tasks.workunit.client.0.smithi037.stdout:7/934: readlink d6/d20/d34/d97/lda 0 2024-09-19T06:08:52.147 INFO:tasks.workunit.client.0.smithi037.stdout:7/935: chown d6/f3e 265361 1 2024-09-19T06:08:52.148 INFO:tasks.workunit.client.0.smithi037.stdout:7/936: creat d6/d20/d4b/d60/d33/f12a x:0 0 0 2024-09-19T06:08:52.155 INFO:tasks.workunit.client.0.smithi037.stdout:7/937: rename d6/d20/d4b/d60/d33/d61 to d6/dc/d22/d59/da8/dc4/d12b 0 2024-09-19T06:08:52.162 INFO:tasks.workunit.client.0.smithi037.stdout:7/938: mkdir d6/d20/d4b/d60/ddf/d12c 0 2024-09-19T06:08:52.164 INFO:tasks.workunit.client.0.smithi037.stdout:7/939: mknod d6/dc/d22/d59/da8/c12d 0 2024-09-19T06:08:52.167 INFO:tasks.workunit.client.0.smithi037.stdout:9/987: dwrite da/dec/d116/d1b/d2f/d6d/db4/ff0 [0,4194304] 0 2024-09-19T06:08:52.167 INFO:tasks.workunit.client.0.smithi037.stdout:9/988: fdatasync da/fa5 0 2024-09-19T06:08:52.167 INFO:tasks.workunit.client.0.smithi037.stdout:9/989: write da/dec/d116/d1b/d2f/d6f/ff2 [4365779,1423] 0 2024-09-19T06:08:52.168 INFO:tasks.workunit.client.0.smithi037.stdout:1/865: dwrite d2/d12/d1e/d2a/d2e/fae [0,4194304] 0 2024-09-19T06:08:52.168 INFO:tasks.workunit.client.0.smithi037.stdout:6/943: dwrite d9/d6e/d10c/d5a/d6d/f72 [0,4194304] 0 2024-09-19T06:08:52.169 INFO:tasks.workunit.client.0.smithi037.stdout:9/990: mkdir da/dec/d116/d1b/d2f/d15f 0 2024-09-19T06:08:52.172 INFO:tasks.workunit.client.0.smithi037.stdout:6/944: creat d9/dd/d1c/d73/ddb/f131 x:0 0 0 2024-09-19T06:08:52.180 INFO:tasks.workunit.client.0.smithi037.stdout:9/991: unlink da/dec/d116/d1b/d23/d6a/d8f/da4/l13a 0 2024-09-19T06:08:52.181 INFO:tasks.workunit.client.0.smithi037.stdout:6/945: rename d9/dd/d2b/d79/dd3 to d9/dd/d2b/d79/d132 0 2024-09-19T06:08:52.181 INFO:tasks.workunit.client.0.smithi037.stdout:6/946: readlink d9/dd/d1c/d119/l12e 0 2024-09-19T06:08:52.181 INFO:tasks.workunit.client.0.smithi037.stdout:6/947: getdents d9/dd/d2b/d79/d125 0 2024-09-19T06:08:52.182 INFO:tasks.workunit.client.0.smithi037.stdout:9/992: rename da/dec/d116/d1b/d23/d3f/l79 to da/db3/l160 0 2024-09-19T06:08:52.182 INFO:tasks.workunit.client.0.smithi037.stdout:9/993: readlink da/dec/d116/d1b/d2f/d6f/l136 0 2024-09-19T06:08:52.183 INFO:tasks.workunit.client.0.smithi037.stdout:6/948: rmdir d9/d6e/d10c 39 2024-09-19T06:08:52.183 INFO:tasks.workunit.client.0.smithi037.stdout:6/949: write d9/dd/d1c/d4e/f7b [1348033,1528] 0 2024-09-19T06:08:52.183 INFO:tasks.workunit.client.0.smithi037.stdout:6/950: chown d9/dd/d2b/ff4 61424 1 2024-09-19T06:08:52.186 INFO:tasks.workunit.client.0.smithi037.stdout:7/940: dread d6/dc/f14 [0,4194304] 0 2024-09-19T06:08:52.186 INFO:tasks.workunit.client.0.smithi037.stdout:0/913: dwrite d5/d8/d79/d9a/fc7 [0,4194304] 0 2024-09-19T06:08:52.186 INFO:tasks.workunit.client.0.smithi037.stdout:0/914: truncate d5/d8/d11/d32/f5e 1601802 0 2024-09-19T06:08:52.187 INFO:tasks.workunit.client.0.smithi037.stdout:0/915: write d5/d8/fc2 [98344,34070] 0 2024-09-19T06:08:52.189 INFO:tasks.workunit.client.0.smithi037.stdout:1/866: dread d2/d12/fd0 [0,4194304] 0 2024-09-19T06:08:52.189 INFO:tasks.workunit.client.0.smithi037.stdout:1/867: stat d2/d12/d1d/d47/f68 0 2024-09-19T06:08:52.189 INFO:tasks.workunit.client.0.smithi037.stdout:1/868: chown d2/d12/d17 0 1 2024-09-19T06:08:52.189 INFO:tasks.workunit.client.0.smithi037.stdout:0/916: rename d5/d8/d11/d32/f5e to d5/dd5/f139 0 2024-09-19T06:08:52.193 INFO:tasks.workunit.client.0.smithi037.stdout:1/869: mkdir d2/d12/d1e/d2a/d11e 0 2024-09-19T06:08:52.194 INFO:tasks.workunit.client.0.smithi037.stdout:1/870: truncate d2/d12/d1e/d2d/f74 2370084 0 2024-09-19T06:08:52.202 INFO:tasks.workunit.client.0.smithi037.stdout:9/994: read da/d20/f8e [3148823,109660] 0 2024-09-19T06:08:52.203 INFO:tasks.workunit.client.0.smithi037.stdout:9/995: dread - da/dec/d116/d1b/d43/de4/f126 zero size 2024-09-19T06:08:52.206 INFO:tasks.workunit.client.0.smithi037.stdout:6/951: dread d9/d6e/d10c/d5a/dd2/fd4 [0,4194304] 0 2024-09-19T06:08:52.206 INFO:tasks.workunit.client.0.smithi037.stdout:6/952: fsync d9/f19 0 2024-09-19T06:08:52.207 INFO:tasks.workunit.client.0.smithi037.stdout:6/953: rmdir d9/d16/dc5 39 2024-09-19T06:08:52.208 INFO:tasks.workunit.client.0.smithi037.stdout:6/954: truncate d9/dd/d2b/d79/ff9 752880 0 2024-09-19T06:08:52.210 INFO:tasks.workunit.client.0.smithi037.stdout:6/955: rename d9/dd/d1c/d73/ddb/f131 to d9/dd/d1c/d73/ddb/f133 0 2024-09-19T06:08:52.213 INFO:tasks.workunit.client.0.smithi037.stdout:7/941: dwrite d6/d20/d71/f79 [0,4194304] 0 2024-09-19T06:08:52.213 INFO:tasks.workunit.client.0.smithi037.stdout:7/942: write d6/d20/d4b/d60/d33/d8c/ffe [782153,7296] 0 2024-09-19T06:08:52.214 INFO:tasks.workunit.client.0.smithi037.stdout:7/943: symlink d6/dc/d22/d59/da8/dd4/l12e 0 2024-09-19T06:08:52.218 INFO:tasks.workunit.client.0.smithi037.stdout:0/917: dwrite d5/d8/d79/d9a/ddb/d106/f5a [4194304,4194304] 0 2024-09-19T06:08:52.219 INFO:tasks.workunit.client.0.smithi037.stdout:0/918: read d5/fd6 [1055599,42024] 0 2024-09-19T06:08:52.219 INFO:tasks.workunit.client.0.smithi037.stdout:0/919: chown d5/d17/c1d 22 1 2024-09-19T06:08:52.219 INFO:tasks.workunit.client.0.smithi037.stdout:0/920: read - d5/d18/ff1 zero size 2024-09-19T06:08:52.220 INFO:tasks.workunit.client.0.smithi037.stdout:0/921: creat d5/d8/d79/d9a/ddb/d106/dd1/de2/d134/f13a x:0 0 0 2024-09-19T06:08:52.226 INFO:tasks.workunit.client.0.smithi037.stdout:1/871: dwrite d2/f3a [0,4194304] 0 2024-09-19T06:08:52.229 INFO:tasks.workunit.client.0.smithi037.stdout:1/872: link d2/d12/d1e/f67 d2/d12/d1e/d75/d89/de0/f11f 0 2024-09-19T06:08:52.230 INFO:tasks.workunit.client.0.smithi037.stdout:1/873: symlink d2/d12/d1e/d2a/d2e/l120 0 2024-09-19T06:08:52.233 INFO:tasks.workunit.client.0.smithi037.stdout:6/956: dwrite d9/dd/f1b [0,4194304] 0 2024-09-19T06:08:52.234 INFO:tasks.workunit.client.0.smithi037.stdout:6/957: rmdir d9/dd/d2b/d42/dad 39 2024-09-19T06:08:52.234 INFO:tasks.workunit.client.0.smithi037.stdout:6/958: fsync d9/d6e/d10c/d5a/d6d/d82/f92 0 2024-09-19T06:08:52.234 INFO:tasks.workunit.client.0.smithi037.stdout:6/959: stat d9/dd/d1c/d4e/d65/fd7 0 2024-09-19T06:08:52.235 INFO:tasks.workunit.client.0.smithi037.stdout:0/922: write d5/d8/d79/d9a/ddb/d106/daf/fd2 [4158741,64627] 0 2024-09-19T06:08:52.246 INFO:tasks.workunit.client.0.smithi037.stdout:6/960: write d9/d16/fc6 [2558368,12211] 0 2024-09-19T06:08:52.252 INFO:tasks.workunit.client.0.smithi037.stdout:1/874: dwrite d2/d12/d1e/d75/f9c [0,4194304] 0 2024-09-19T06:08:52.252 INFO:tasks.workunit.client.0.smithi037.stdout:1/875: chown d2/d12/d1e/d2a/d2e/l61 116242 1 2024-09-19T06:08:52.261 INFO:tasks.workunit.client.0.smithi037.stdout:0/923: dwrite d5/f11d [0,4194304] 0 2024-09-19T06:08:52.263 INFO:tasks.workunit.client.0.smithi037.stdout:0/924: readlink d5/d18/d68/d85/dab/ld9 0 2024-09-19T06:08:52.264 INFO:tasks.workunit.client.0.smithi037.stdout:0/925: getdents d5/d8/d79/d9a/ddb/d106/dd1 0 2024-09-19T06:08:52.266 INFO:tasks.workunit.client.0.smithi037.stdout:0/926: truncate d5/d8/d79/d9a/ddb/d106/f5a 7856769 0 2024-09-19T06:08:52.267 INFO:tasks.workunit.client.0.smithi037.stdout:6/961: dwrite d9/d6e/d10c/d5a/d6d/f121 [0,4194304] 0 2024-09-19T06:08:52.269 INFO:tasks.workunit.client.0.smithi037.stdout:6/962: creat d9/d6e/d10c/d5a/d6d/d82/f134 x:0 0 0 2024-09-19T06:08:52.271 INFO:tasks.workunit.client.0.smithi037.stdout:6/963: creat d9/dd/d1c/d4e/d65/de2/f135 x:0 0 0 2024-09-19T06:08:52.271 INFO:tasks.workunit.client.0.smithi037.stdout:6/964: fsync d9/d6e/d10c/d5a/d6d/d82/f84 0 2024-09-19T06:08:52.271 INFO:tasks.workunit.client.0.smithi037.stdout:6/965: chown d9/c31 442473345 1 2024-09-19T06:08:52.271 INFO:tasks.workunit.client.0.smithi037.stdout:6/966: creat d9/dd/d2b/d79/f136 x:0 0 0 2024-09-19T06:08:52.280 INFO:tasks.workunit.client.0.smithi037.stdout:3/911: sync 2024-09-19T06:08:52.280 INFO:tasks.workunit.client.0.smithi037.stdout:5/883: sync 2024-09-19T06:08:52.280 INFO:tasks.workunit.client.0.smithi037.stdout:3/912: stat d0/d16/d19/d33/d87/f114 0 2024-09-19T06:08:52.281 INFO:tasks.workunit.client.0.smithi037.stdout:1/876: dwrite d2/d12/d15/f58 [0,4194304] 0 2024-09-19T06:08:52.284 INFO:tasks.workunit.client.0.smithi037.stdout:5/884: rename d2/d12/d24/d58/dbf/fe0 to d2/d12/d28/d22/d4a/d9e/f11a 0 2024-09-19T06:08:52.284 INFO:tasks.workunit.client.0.smithi037.stdout:3/913: write d0/d5f/d70/f78 [488715,77815] 0 2024-09-19T06:08:52.286 INFO:tasks.workunit.client.0.smithi037.stdout:1/877: unlink d2/d12/d1e/d2d/f4c 0 2024-09-19T06:08:52.287 INFO:tasks.workunit.client.0.smithi037.stdout:1/878: fdatasync d2/d12/d1e/d75/f84 0 2024-09-19T06:08:52.287 INFO:tasks.workunit.client.0.smithi037.stdout:1/879: fsync d2/d12/d1e/d2a/d2e/f7f 0 2024-09-19T06:08:52.288 INFO:tasks.workunit.client.0.smithi037.stdout:1/880: creat d2/d12/d1e/d2d/d6f/f121 x:0 0 0 2024-09-19T06:08:52.290 INFO:tasks.workunit.client.0.smithi037.stdout:0/927: dwrite d5/dd5/de9/d8d/ffd [0,4194304] 0 2024-09-19T06:08:52.290 INFO:tasks.workunit.client.0.smithi037.stdout:0/928: write d5/d42/f126 [1029081,41717] 0 2024-09-19T06:08:52.292 INFO:tasks.workunit.client.0.smithi037.stdout:0/929: mkdir d5/d8/d11/d13b 0 2024-09-19T06:08:52.292 INFO:tasks.workunit.client.0.smithi037.stdout:0/930: write d5/dd5/de9/d21/f11b [495679,983] 0 2024-09-19T06:08:52.293 INFO:tasks.workunit.client.0.smithi037.stdout:0/931: rename d5/d8/d11/cda to d5/d8/d79/d9a/c13c 0 2024-09-19T06:08:52.294 INFO:tasks.workunit.client.0.smithi037.stdout:0/932: read d5/d18/d68/d85/dab/feb [3733834,46070] 0 2024-09-19T06:08:52.294 INFO:tasks.workunit.client.0.smithi037.stdout:0/933: fsync d5/d8/d44/d61/fcf 0 2024-09-19T06:08:52.294 INFO:tasks.workunit.client.0.smithi037.stdout:6/967: dwrite d9/d6e/d10c/d5a/d6d/d82/f115 [0,4194304] 0 2024-09-19T06:08:52.296 INFO:tasks.workunit.client.0.smithi037.stdout:0/934: readlink d5/d18/d68/d85/dab/lc6 0 2024-09-19T06:08:52.298 INFO:tasks.workunit.client.0.smithi037.stdout:6/968: link d9/dd/d2b/d79/f53 d9/dd/d1c/d73/ddb/f137 0 2024-09-19T06:08:52.299 INFO:tasks.workunit.client.0.smithi037.stdout:0/935: creat d5/d8/d79/d9a/ddb/f13d x:0 0 0 2024-09-19T06:08:52.299 INFO:tasks.workunit.client.0.smithi037.stdout:0/936: truncate d5/d8/d11/d32/f104 295623 0 2024-09-19T06:08:52.299 INFO:tasks.workunit.client.0.smithi037.stdout:0/937: stat d5/dd5/de9/d21 0 2024-09-19T06:08:52.300 INFO:tasks.workunit.client.0.smithi037.stdout:0/938: readlink d5/d8/d44/d10f/d125/d89/d96/l98 0 2024-09-19T06:08:52.300 INFO:tasks.workunit.client.0.smithi037.stdout:6/969: mkdir d9/dd/d1c/d73/ddb/d138 0 2024-09-19T06:08:52.300 INFO:tasks.workunit.client.0.smithi037.stdout:6/970: write d9/dd/d2b/d79/f70 [54316,89839] 0 2024-09-19T06:08:52.301 INFO:tasks.workunit.client.0.smithi037.stdout:0/939: link d5/f7 d5/d8/d44/d10f/d125/f13e 0 2024-09-19T06:08:52.302 INFO:tasks.workunit.client.0.smithi037.stdout:0/940: chown d5/d17/fad 2 1 2024-09-19T06:08:52.302 INFO:tasks.workunit.client.0.smithi037.stdout:0/941: write d5/d8/d44/d10f/d125/ff6 [890039,119969] 0 2024-09-19T06:08:52.302 INFO:tasks.workunit.client.0.smithi037.stdout:3/914: write d0/d16/d19/f3b [950121,10398] 0 2024-09-19T06:08:52.302 INFO:tasks.workunit.client.0.smithi037.stdout:6/971: mknod d9/d6e/d10c/d5a/dd2/d118/d126/c139 0 2024-09-19T06:08:52.303 INFO:tasks.workunit.client.0.smithi037.stdout:0/942: rename d5/d18/d68/d85/dab to d5/dd5/de9/d8d/de0/d13f 0 2024-09-19T06:08:52.304 INFO:tasks.workunit.client.0.smithi037.stdout:6/972: creat d9/d6e/d10c/f13a x:0 0 0 2024-09-19T06:08:52.305 INFO:tasks.workunit.client.0.smithi037.stdout:6/973: symlink d9/d6e/d10c/dd5/l13b 0 2024-09-19T06:08:52.305 INFO:tasks.workunit.client.0.smithi037.stdout:3/915: dread d0/d43/d23/d7a/d77/d62/f90 [0,4194304] 0 2024-09-19T06:08:52.306 INFO:tasks.workunit.client.0.smithi037.stdout:6/974: mkdir d9/d6e/d13c 0 2024-09-19T06:08:52.306 INFO:tasks.workunit.client.0.smithi037.stdout:3/916: creat d0/d16/d19/d1d/d82/d86/f128 x:0 0 0 2024-09-19T06:08:52.308 INFO:tasks.workunit.client.0.smithi037.stdout:3/917: rename d0/d43/d23/d7a/d77/d45 to d0/d16/d19/d1d/dd1/d129 0 2024-09-19T06:08:52.311 INFO:tasks.workunit.client.0.smithi037.stdout:1/881: dwrite d2/d12/d1e/d2d/d6f/f121 [0,4194304] 0 2024-09-19T06:08:52.311 INFO:tasks.workunit.client.0.smithi037.stdout:1/882: write d2/d12/d1d/d6b/fb2 [4546410,130133] 0 2024-09-19T06:08:52.311 INFO:tasks.workunit.client.0.smithi037.stdout:1/883: truncate d2/f3 1419105 0 2024-09-19T06:08:52.323 INFO:tasks.workunit.client.0.smithi037.stdout:0/943: read d5/d8/d79/d9a/ddb/d106/f5a [3296595,16611] 0 2024-09-19T06:08:52.323 INFO:tasks.workunit.client.0.smithi037.stdout:0/944: truncate d5/dd5/de9/d8d/f10d 233566 0 2024-09-19T06:08:52.323 INFO:tasks.workunit.client.0.smithi037.stdout:0/945: write d5/d18/d68/d85/d111/f12f [154620,20061] 0 2024-09-19T06:08:52.325 INFO:tasks.workunit.client.0.smithi037.stdout:0/946: symlink d5/dd5/de5/d128/l140 0 2024-09-19T06:08:52.325 INFO:tasks.workunit.client.0.smithi037.stdout:0/947: truncate d5/d20/f57 1897978 0 2024-09-19T06:08:52.326 INFO:tasks.workunit.client.0.smithi037.stdout:6/975: read d9/d6e/fb3 [493972,4878] 0 2024-09-19T06:08:52.326 INFO:tasks.workunit.client.0.smithi037.stdout:6/976: read d9/dd/d2b/d79/fff [2262747,38294] 0 2024-09-19T06:08:52.327 INFO:tasks.workunit.client.0.smithi037.stdout:0/948: symlink d5/dd5/de9/d21/l141 0 2024-09-19T06:08:52.328 INFO:tasks.workunit.client.0.smithi037.stdout:7/944: sync 2024-09-19T06:08:52.328 INFO:tasks.workunit.client.0.smithi037.stdout:9/996: sync 2024-09-19T06:08:52.329 INFO:tasks.workunit.client.0.smithi037.stdout:9/997: fdatasync da/dec/d116/d1b/d43/f7c 0 2024-09-19T06:08:52.333 INFO:tasks.workunit.client.0.smithi037.stdout:3/918: write d0/d43/d23/d7a/d77/db8/f107 [1225219,128538] 0 2024-09-19T06:08:52.334 INFO:tasks.workunit.client.0.smithi037.stdout:1/884: dwrite d2/d12/d1e/d75/f84 [0,4194304] 0 2024-09-19T06:08:52.334 INFO:tasks.workunit.client.0.smithi037.stdout:1/885: getdents d2/d12/d15/d95/da0 0 2024-09-19T06:08:52.339 INFO:tasks.workunit.client.0.smithi037.stdout:3/919: truncate d0/d43/d23/d7a/d77/db8/f107 79906 0 2024-09-19T06:08:52.339 INFO:tasks.workunit.client.0.smithi037.stdout:3/920: fdatasync d0/d43/d23/d7a/d77/f5c 0 2024-09-19T06:08:52.342 INFO:tasks.workunit.client.0.smithi037.stdout:7/945: write d6/dc/f2a [2962582,80455] 0 2024-09-19T06:08:52.342 INFO:tasks.workunit.client.0.smithi037.stdout:6/977: dread d9/d6e/d10c/d5a/d6d/d82/d9f/da4/fef [0,4194304] 0 2024-09-19T06:08:52.342 INFO:tasks.workunit.client.0.smithi037.stdout:6/978: chown d9/d6e/d10c/d5a/d6d/d82/d9f/ff7 176410 1 2024-09-19T06:08:52.346 INFO:tasks.workunit.client.0.smithi037.stdout:3/921: mkdir d0/d16/d19/d1d/d12a 0 2024-09-19T06:08:52.346 INFO:tasks.workunit.client.0.smithi037.stdout:3/922: chown d0/d43/d23/d7a/d77/l92 410425 1 2024-09-19T06:08:52.347 INFO:tasks.workunit.client.0.smithi037.stdout:6/979: mkdir d9/d6e/d10c/d5a/d6d/d82/da9/d13d 0 2024-09-19T06:08:52.348 INFO:tasks.workunit.client.0.smithi037.stdout:3/923: mkdir d0/d43/d23/d7a/d77/d12b 0 2024-09-19T06:08:52.349 INFO:tasks.workunit.client.0.smithi037.stdout:6/980: mkdir d9/dd/d1c/d73/ddb/d13e 0 2024-09-19T06:08:52.349 INFO:tasks.workunit.client.0.smithi037.stdout:6/981: read - d9/dd/d1c/d73/f93 zero size 2024-09-19T06:08:52.349 INFO:tasks.workunit.client.0.smithi037.stdout:3/924: mkdir d0/d5f/da0/df0/d12c 0 2024-09-19T06:08:52.350 INFO:tasks.workunit.client.0.smithi037.stdout:9/998: write da/d20/fc2 [1727935,83712] 0 2024-09-19T06:08:52.351 INFO:tasks.workunit.client.0.smithi037.stdout:3/925: unlink d0/d43/f94 0 2024-09-19T06:08:52.352 INFO:tasks.workunit.client.0.smithi037.stdout:9/999: mkdir da/d20/d11c/ddc/d161 0 2024-09-19T06:08:52.352 INFO:tasks.workunit.client.0.smithi037.stdout:3/926: getdents d0/d16/d19/d1d/d5e/d61/dcb 0 2024-09-19T06:08:52.354 INFO:tasks.workunit.client.0.smithi037.stdout:3/927: rename d0/f11b to d0/d16/d19/d1d/dd1/d129/f12d 0 2024-09-19T06:08:52.355 INFO:tasks.workunit.client.0.smithi037.stdout:0/949: dwrite d5/d8/d44/d61/f12e [0,4194304] 0 2024-09-19T06:08:52.357 INFO:tasks.workunit.client.0.smithi037.stdout:0/950: creat d5/d8/d79/de1/f142 x:0 0 0 2024-09-19T06:08:52.367 INFO:tasks.workunit.client.0.smithi037.stdout:6/982: write d9/d6e/d10c/d5a/d6d/d82/d9f/fb5 [485415,122921] 0 2024-09-19T06:08:52.367 INFO:tasks.workunit.client.0.smithi037.stdout:6/983: fdatasync d9/dd/d1c/d73/fa1 0 2024-09-19T06:08:52.371 INFO:tasks.workunit.client.0.smithi037.stdout:7/946: dwrite d6/dc/d22/f11a [0,4194304] 0 2024-09-19T06:08:52.371 INFO:tasks.workunit.client.0.smithi037.stdout:7/947: readlink d6/dc/dc6/l126 0 2024-09-19T06:08:52.372 INFO:tasks.workunit.client.0.smithi037.stdout:6/984: read d9/d6e/d10c/d5a/fe8 [4546430,101432] 0 2024-09-19T06:08:52.372 INFO:tasks.workunit.client.0.smithi037.stdout:1/886: dwrite d2/d12/d1e/d2a/d2e/f7e [0,4194304] 0 2024-09-19T06:08:52.373 INFO:tasks.workunit.client.0.smithi037.stdout:7/948: symlink d6/d20/d34/d7d/l12f 0 2024-09-19T06:08:52.374 INFO:tasks.workunit.client.0.smithi037.stdout:1/887: creat d2/d12/d1d/d6b/d8b/df4/f122 x:0 0 0 2024-09-19T06:08:52.375 INFO:tasks.workunit.client.0.smithi037.stdout:7/949: truncate d6/dc/f47 1538197 0 2024-09-19T06:08:52.375 INFO:tasks.workunit.client.0.smithi037.stdout:1/888: truncate d2/d12/d1e/d2a/f59 1172353 0 2024-09-19T06:08:52.375 INFO:tasks.workunit.client.0.smithi037.stdout:1/889: read d2/fb [1433269,97786] 0 2024-09-19T06:08:52.376 INFO:tasks.workunit.client.0.smithi037.stdout:1/890: stat d2/d12/d1d/d47/db6 0 2024-09-19T06:08:52.376 INFO:tasks.workunit.client.0.smithi037.stdout:7/950: symlink d6/dc/dc6/l130 0 2024-09-19T06:08:52.377 INFO:tasks.workunit.client.0.smithi037.stdout:1/891: link d2/d12/d1d/d6b/d8b/df4/f10b d2/d12/d1d/f123 0 2024-09-19T06:08:52.378 INFO:tasks.workunit.client.0.smithi037.stdout:7/951: rmdir d6/dad 39 2024-09-19T06:08:52.378 INFO:tasks.workunit.client.0.smithi037.stdout:1/892: rmdir d2/d12/d1e/d2a/d8f 39 2024-09-19T06:08:52.378 INFO:tasks.workunit.client.0.smithi037.stdout:1/893: chown d2/d12/d1e/f5d 19 1 2024-09-19T06:08:52.379 INFO:tasks.workunit.client.0.smithi037.stdout:3/928: dwrite d0/d16/d19/d33/d87/dbd/f104 [0,4194304] 0 2024-09-19T06:08:52.380 INFO:tasks.workunit.client.0.smithi037.stdout:3/929: fsync d0/d16/da6/fbf 0 2024-09-19T06:08:52.380 INFO:tasks.workunit.client.0.smithi037.stdout:7/952: unlink d6/dc/df/d7e/f88 0 2024-09-19T06:08:52.380 INFO:tasks.workunit.client.0.smithi037.stdout:7/953: write d6/d20/d34/d97/fa0 [254037,76402] 0 2024-09-19T06:08:52.380 INFO:tasks.workunit.client.0.smithi037.stdout:7/954: readlink d6/d20/d34/d7d/l12f 0 2024-09-19T06:08:52.380 INFO:tasks.workunit.client.0.smithi037.stdout:1/894: mkdir d2/d12/d17/d124 0 2024-09-19T06:08:52.381 INFO:tasks.workunit.client.0.smithi037.stdout:3/930: mkdir d0/d5f/da0/df0/d12c/d12e 0 2024-09-19T06:08:52.383 INFO:tasks.workunit.client.0.smithi037.stdout:3/931: rename d0/d43/d23/d7a/d77/f5c to d0/d43/d23/d7a/d77/dc3/dfb/d110/f12f 0 2024-09-19T06:08:52.383 INFO:tasks.workunit.client.0.smithi037.stdout:0/951: dwrite d5/d8/d44/d10f/d125/ff6 [0,4194304] 0 2024-09-19T06:08:52.383 INFO:tasks.workunit.client.0.smithi037.stdout:0/952: stat d5/dd5/de9/d21/f72 0 2024-09-19T06:08:52.383 INFO:tasks.workunit.client.0.smithi037.stdout:0/953: readlink d5/dd5/de9/d21/d4e/d121/l122 0 2024-09-19T06:08:52.383 INFO:tasks.workunit.client.0.smithi037.stdout:0/954: chown d5/d8/d79/d9a/ddb/d106/dd1 464 1 2024-09-19T06:08:52.385 INFO:tasks.workunit.client.0.smithi037.stdout:3/932: symlink d0/d16/d19/d1d/d5e/d61/dcb/l130 0 2024-09-19T06:08:52.389 INFO:tasks.workunit.client.0.smithi037.stdout:3/933: creat d0/d96/f131 x:0 0 0 2024-09-19T06:08:52.389 INFO:tasks.workunit.client.0.smithi037.stdout:6/985: dread d9/dd/d1c/d4e/d65/f8b [0,4194304] 0 2024-09-19T06:08:52.389 INFO:tasks.workunit.client.0.smithi037.stdout:6/986: chown d9/l75 36 1 2024-09-19T06:08:52.391 INFO:tasks.workunit.client.0.smithi037.stdout:3/934: mknod d0/d16/d19/d1d/d7c/c132 0 2024-09-19T06:08:52.392 INFO:tasks.workunit.client.0.smithi037.stdout:6/987: mkdir d9/d6e/d10c/d13f 0 2024-09-19T06:08:52.393 INFO:tasks.workunit.client.0.smithi037.stdout:3/935: creat d0/d16/d19/d1d/d5e/da9/db5/f133 x:0 0 0 2024-09-19T06:08:52.393 INFO:tasks.workunit.client.0.smithi037.stdout:3/936: getdents d0/d43/d23/d7a/d77/d12b 0 2024-09-19T06:08:52.393 INFO:tasks.workunit.client.0.smithi037.stdout:3/937: dread - d0/d43/d23/d7a/d77/fd6 zero size 2024-09-19T06:08:52.394 INFO:tasks.workunit.client.0.smithi037.stdout:6/988: rename d9/d6e/d10c/d5a/dd2/de4/ffc to d9/d6e/d10c/d5a/f140 0 2024-09-19T06:08:52.396 INFO:tasks.workunit.client.0.smithi037.stdout:3/938: mkdir d0/d16/d19/d1d/dd1/d134 0 2024-09-19T06:08:52.396 INFO:tasks.workunit.client.0.smithi037.stdout:3/939: fdatasync d0/d16/d19/d1d/d5e/da9/db5/fe5 0 2024-09-19T06:08:52.396 INFO:tasks.workunit.client.0.smithi037.stdout:3/940: read d0/d16/d19/f3b [2180352,4415] 0 2024-09-19T06:08:52.396 INFO:tasks.workunit.client.0.smithi037.stdout:3/941: write d0/d16/d19/d1d/d5e/da9/db5/f133 [537976,47776] 0 2024-09-19T06:08:52.398 INFO:tasks.workunit.client.0.smithi037.stdout:6/989: rename d9/dd/d2b/d79 to d9/d6e/d10c/d5a/d6d/d82/d141 0 2024-09-19T06:08:52.398 INFO:tasks.workunit.client.0.smithi037.stdout:6/990: write d9/dd/d1c/d4e/d65/de2/f135 [786983,116102] 0 2024-09-19T06:08:52.399 INFO:tasks.workunit.client.0.smithi037.stdout:3/942: creat d0/d16/ddf/f135 x:0 0 0 2024-09-19T06:08:52.399 INFO:tasks.workunit.client.0.smithi037.stdout:3/943: stat d0/d16/le2 0 2024-09-19T06:08:52.400 INFO:tasks.workunit.client.0.smithi037.stdout:3/944: chown d0/d16/d19/d1d/f3d 17 1 2024-09-19T06:08:52.401 INFO:tasks.workunit.client.0.smithi037.stdout:6/991: rename d9/dd/d2b/d42/d123 to d9/d6e/d10c/d5a/dd2/d118/d126/d142 0 2024-09-19T06:08:52.403 INFO:tasks.workunit.client.0.smithi037.stdout:6/992: creat d9/d6e/d10c/d5a/d6d/d82/d141/f143 x:0 0 0 2024-09-19T06:08:52.403 INFO:tasks.workunit.client.0.smithi037.stdout:6/993: dread - d9/d16/dcf/f12c zero size 2024-09-19T06:08:52.403 INFO:tasks.workunit.client.0.smithi037.stdout:6/994: stat d9/dd/d1c/d73/f93 0 2024-09-19T06:08:52.403 INFO:tasks.workunit.client.0.smithi037.stdout:6/995: dread - d9/d6e/d10c/d5a/d6d/d82/d9f/ff7 zero size 2024-09-19T06:08:52.404 INFO:tasks.workunit.client.0.smithi037.stdout:0/955: dread d5/dd5/de9/f1c [0,4194304] 0 2024-09-19T06:08:52.404 INFO:tasks.workunit.client.0.smithi037.stdout:6/996: creat d9/d6e/d10c/d5a/dd2/d118/d126/f144 x:0 0 0 2024-09-19T06:08:52.406 INFO:tasks.workunit.client.0.smithi037.stdout:0/956: rename d5/d8/d11/d32/f10e to d5/d8/d79/f143 0 2024-09-19T06:08:52.407 INFO:tasks.workunit.client.0.smithi037.stdout:7/955: dwrite d6/d20/f3c [0,4194304] 0 2024-09-19T06:08:52.407 INFO:tasks.workunit.client.0.smithi037.stdout:7/956: stat d6/d20/f11e 0 2024-09-19T06:08:52.407 INFO:tasks.workunit.client.0.smithi037.stdout:1/895: dwrite d2/d12/d1e/d2a/d97/f99 [0,4194304] 0 2024-09-19T06:08:52.408 INFO:tasks.workunit.client.0.smithi037.stdout:6/997: creat d9/dd/d2b/f145 x:0 0 0 2024-09-19T06:08:52.409 INFO:tasks.workunit.client.0.smithi037.stdout:0/957: creat d5/d18/d68/d85/d111/f144 x:0 0 0 2024-09-19T06:08:52.411 INFO:tasks.workunit.client.0.smithi037.stdout:6/998: write d9/dd/d1c/d4e/d33/f88 [2595266,84869] 0 2024-09-19T06:08:52.411 INFO:tasks.workunit.client.0.smithi037.stdout:6/999: chown d9/d6e/d10c/d5a/d6d/f121 1897190607 1 2024-09-19T06:08:52.416 INFO:tasks.workunit.client.0.smithi037.stdout:7/957: mknod d6/d20/d71/c131 0 2024-09-19T06:08:52.419 INFO:tasks.workunit.client.0.smithi037.stdout:0/958: unlink d5/dd5/de9/d21/f4b 0 2024-09-19T06:08:52.420 INFO:tasks.workunit.client.0.smithi037.stdout:1/896: dread d2/d12/d15/d34/f46 [0,4194304] 0 2024-09-19T06:08:52.420 INFO:tasks.workunit.client.0.smithi037.stdout:7/958: mkdir d6/d20/d4b/d60/d33/d8c/d132 0 2024-09-19T06:08:52.421 INFO:tasks.workunit.client.0.smithi037.stdout:0/959: mknod d5/d8/d11/c145 0 2024-09-19T06:08:52.422 INFO:tasks.workunit.client.0.smithi037.stdout:0/960: fdatasync d5/d20/f12b 0 2024-09-19T06:08:52.422 INFO:tasks.workunit.client.0.smithi037.stdout:0/961: fdatasync d5/d17/f5f 0 2024-09-19T06:08:52.422 INFO:tasks.workunit.client.0.smithi037.stdout:1/897: read d2/f3 [171376,90273] 0 2024-09-19T06:08:52.422 INFO:tasks.workunit.client.0.smithi037.stdout:1/898: fsync d2/d12/d1d/f123 0 2024-09-19T06:08:52.423 INFO:tasks.workunit.client.0.smithi037.stdout:7/959: mkdir d6/dc/d22/d59/da8/dc4/d133 0 2024-09-19T06:08:52.423 INFO:tasks.workunit.client.0.smithi037.stdout:7/960: write d6/d20/d4b/d60/d33/fab [944145,49984] 0 2024-09-19T06:08:52.424 INFO:tasks.workunit.client.0.smithi037.stdout:1/899: mkdir d2/d12/d1e/d2d/d6f/d125 0 2024-09-19T06:08:52.424 INFO:tasks.workunit.client.0.smithi037.stdout:3/945: dwrite d0/d5f/fc0 [0,4194304] 0 2024-09-19T06:08:52.425 INFO:tasks.workunit.client.0.smithi037.stdout:7/961: creat d6/dad/f134 x:0 0 0 2024-09-19T06:08:52.425 INFO:tasks.workunit.client.0.smithi037.stdout:7/962: chown d6/dc/c6f 2284740 1 2024-09-19T06:08:52.426 INFO:tasks.workunit.client.0.smithi037.stdout:1/900: creat d2/d12/d1e/d75/f126 x:0 0 0 2024-09-19T06:08:52.428 INFO:tasks.workunit.client.0.smithi037.stdout:5/885: sync 2024-09-19T06:08:52.429 INFO:tasks.workunit.client.0.smithi037.stdout:5/886: creat d2/d12/d7e/f11b x:0 0 0 2024-09-19T06:08:52.430 INFO:tasks.workunit.client.0.smithi037.stdout:5/887: mkdir d2/d5c/d11c 0 2024-09-19T06:08:52.430 INFO:tasks.workunit.client.0.smithi037.stdout:5/888: write d2/d12/d24/f70 [4166622,52090] 0 2024-09-19T06:08:52.430 INFO:tasks.workunit.client.0.smithi037.stdout:5/889: dread - d2/d12/d24/d58/d96/dd7/f10d zero size 2024-09-19T06:08:52.440 INFO:tasks.workunit.client.0.smithi037.stdout:1/901: dread d2/d12/d1e/d2a/f59 [0,4194304] 0 2024-09-19T06:08:52.459 INFO:tasks.workunit.client.0.smithi037.stdout:7/963: dwrite d6/dc/d22/f1a [0,4194304] 0 2024-09-19T06:08:52.463 INFO:tasks.workunit.client.0.smithi037.stdout:5/890: write d2/d12/d24/d58/d7f/fc2 [2522854,63680] 0 2024-09-19T06:08:52.463 INFO:tasks.workunit.client.0.smithi037.stdout:0/962: dwrite d5/d8/d79/d9a/fc7 [0,4194304] 0 2024-09-19T06:08:52.464 INFO:tasks.workunit.client.0.smithi037.stdout:0/963: mkdir d5/dd5/de5/d128/d146 0 2024-09-19T06:08:52.464 INFO:tasks.workunit.client.0.smithi037.stdout:0/964: readlink d5/d8/d44/ld0 0 2024-09-19T06:08:52.465 INFO:tasks.workunit.client.0.smithi037.stdout:0/965: symlink d5/d8/d44/d10f/d125/d89/da9/l147 0 2024-09-19T06:08:52.475 INFO:tasks.workunit.client.0.smithi037.stdout:7/964: dread d6/f3e [0,4194304] 0 2024-09-19T06:08:52.475 INFO:tasks.workunit.client.0.smithi037.stdout:1/902: dwrite d2/d12/d1e/d2a/d2e/f7f [0,4194304] 0 2024-09-19T06:08:52.476 INFO:tasks.workunit.client.0.smithi037.stdout:0/966: write d5/d8/d11/f55 [1402627,100155] 0 2024-09-19T06:08:52.476 INFO:tasks.workunit.client.0.smithi037.stdout:1/903: creat d2/d12/d1e/d2a/d8f/f127 x:0 0 0 2024-09-19T06:08:52.477 INFO:tasks.workunit.client.0.smithi037.stdout:7/965: creat d6/d20/d34/dc0/dcf/d105/f135 x:0 0 0 2024-09-19T06:08:52.480 INFO:tasks.workunit.client.0.smithi037.stdout:0/967: creat d5/d8/d11/d32/f148 x:0 0 0 2024-09-19T06:08:52.481 INFO:tasks.workunit.client.0.smithi037.stdout:1/904: creat d2/d12/d1e/d75/f128 x:0 0 0 2024-09-19T06:08:52.482 INFO:tasks.workunit.client.0.smithi037.stdout:7/966: creat d6/d21/d68/dc7/f136 x:0 0 0 2024-09-19T06:08:52.483 INFO:tasks.workunit.client.0.smithi037.stdout:0/968: creat d5/d8/d44/d10f/d125/f149 x:0 0 0 2024-09-19T06:08:52.483 INFO:tasks.workunit.client.0.smithi037.stdout:0/969: stat d5/f87 0 2024-09-19T06:08:52.484 INFO:tasks.workunit.client.0.smithi037.stdout:1/905: creat d2/d12/d1d/d6b/d8b/f129 x:0 0 0 2024-09-19T06:08:52.485 INFO:tasks.workunit.client.0.smithi037.stdout:7/967: mknod d6/d20/d4b/d60/d33/d9f/c137 0 2024-09-19T06:08:52.486 INFO:tasks.workunit.client.0.smithi037.stdout:1/906: creat d2/d12/f12a x:0 0 0 2024-09-19T06:08:52.487 INFO:tasks.workunit.client.0.smithi037.stdout:1/907: dread - d2/d12/d1e/d2a/d8f/f127 zero size 2024-09-19T06:08:52.487 INFO:tasks.workunit.client.0.smithi037.stdout:1/908: chown d2/d12/d1e/d63/d9e/d102 0 1 2024-09-19T06:08:52.487 INFO:tasks.workunit.client.0.smithi037.stdout:7/968: rmdir d6 39 2024-09-19T06:08:52.487 INFO:tasks.workunit.client.0.smithi037.stdout:7/969: stat d6/d20/d34/d49/c4d 0 2024-09-19T06:08:52.488 INFO:tasks.workunit.client.0.smithi037.stdout:7/970: mkdir d6/d20/d138 0 2024-09-19T06:08:52.489 INFO:tasks.workunit.client.0.smithi037.stdout:7/971: truncate d6/d20/d4b/d60/d33/f6b 2193792 0 2024-09-19T06:08:52.490 INFO:tasks.workunit.client.0.smithi037.stdout:7/972: creat d6/dc/d22/d59/f139 x:0 0 0 2024-09-19T06:08:52.492 INFO:tasks.workunit.client.0.smithi037.stdout:5/891: dwrite d2/d12/d28/d22/d87/fab [0,4194304] 0 2024-09-19T06:08:52.492 INFO:tasks.workunit.client.0.smithi037.stdout:7/973: creat d6/d20/d4b/d60/d33/d55/f13a x:0 0 0 2024-09-19T06:08:52.492 INFO:tasks.workunit.client.0.smithi037.stdout:7/974: chown d6/d20/d34/d49 1599 1 2024-09-19T06:08:52.492 INFO:tasks.workunit.client.0.smithi037.stdout:7/975: chown d6/d20/d34/dc0/dcf/d105/f135 222511896 1 2024-09-19T06:08:52.494 INFO:tasks.workunit.client.0.smithi037.stdout:5/892: creat d2/d5c/dda/f11d x:0 0 0 2024-09-19T06:08:52.511 INFO:tasks.workunit.client.0.smithi037.stdout:7/976: write d6/dc/d22/d59/da8/dc4/d12b/f64 [2770096,61396] 0 2024-09-19T06:08:52.512 INFO:tasks.workunit.client.0.smithi037.stdout:1/909: dread d2/f4 [0,4194304] 0 2024-09-19T06:08:52.512 INFO:tasks.workunit.client.0.smithi037.stdout:7/977: truncate d6/dc/f47 1263007 0 2024-09-19T06:08:52.513 INFO:tasks.workunit.client.0.smithi037.stdout:7/978: readlink d6/d20/d34/dc0/dcf/d105/l10d 0 2024-09-19T06:08:52.513 INFO:tasks.workunit.client.0.smithi037.stdout:0/970: dwrite d5/d8/d79/d9a/ddb/f13d [0,4194304] 0 2024-09-19T06:08:52.513 INFO:tasks.workunit.client.0.smithi037.stdout:1/910: symlink d2/d12/d15/l12b 0 2024-09-19T06:08:52.515 INFO:tasks.workunit.client.0.smithi037.stdout:0/971: mknod d5/d8/d44/c14a 0 2024-09-19T06:08:52.516 INFO:tasks.workunit.client.0.smithi037.stdout:1/911: mknod d2/d12/d15/d95/da0/c12c 0 2024-09-19T06:08:52.517 INFO:tasks.workunit.client.0.smithi037.stdout:5/893: dread d2/d12/d24/f51 [0,4194304] 0 2024-09-19T06:08:52.517 INFO:tasks.workunit.client.0.smithi037.stdout:1/912: symlink d2/d12/d1d/d47/l12d 0 2024-09-19T06:08:52.518 INFO:tasks.workunit.client.0.smithi037.stdout:1/913: rmdir d2/d12/d1e/d2a/d2e 39 2024-09-19T06:08:52.519 INFO:tasks.workunit.client.0.smithi037.stdout:1/914: dread d2/d12/d15/d5c/fca [0,4194304] 0 2024-09-19T06:08:52.523 INFO:tasks.workunit.client.0.smithi037.stdout:5/894: dread d2/d12/d28/f29 [0,4194304] 0 2024-09-19T06:08:52.524 INFO:tasks.workunit.client.0.smithi037.stdout:5/895: chown d2/d12/d28/d22/d35/c66 1 1 2024-09-19T06:08:52.533 INFO:tasks.workunit.client.0.smithi037.stdout:0/972: write d5/d8/d44/d10f/d125/ff6 [1769017,124581] 0 2024-09-19T06:08:52.542 INFO:tasks.workunit.client.0.smithi037.stdout:1/915: dwrite d2/d12/d15/d5c/fca [0,4194304] 0 2024-09-19T06:08:52.552 INFO:tasks.workunit.client.0.smithi037.stdout:0/973: dread d5/fa3 [0,4194304] 0 2024-09-19T06:08:52.553 INFO:tasks.workunit.client.0.smithi037.stdout:0/974: creat d5/dd5/de5/d128/d146/f14b x:0 0 0 2024-09-19T06:08:52.553 INFO:tasks.workunit.client.0.smithi037.stdout:0/975: fsync d5/d8/d44/d10f/d125/f13e 0 2024-09-19T06:08:52.554 INFO:tasks.workunit.client.0.smithi037.stdout:0/976: chown d5/d8/d11/d32 1 1 2024-09-19T06:08:52.554 INFO:tasks.workunit.client.0.smithi037.stdout:5/896: dwrite d2/d12/d28/d22/f8b [0,4194304] 0 2024-09-19T06:08:52.554 INFO:tasks.workunit.client.0.smithi037.stdout:0/977: creat d5/dd5/de9/d8d/f14c x:0 0 0 2024-09-19T06:08:52.556 INFO:tasks.workunit.client.0.smithi037.stdout:5/897: symlink d2/d10/da1/dac/l11e 0 2024-09-19T06:08:52.556 INFO:tasks.workunit.client.0.smithi037.stdout:5/898: stat d2/d12/d28/d22/f3c 0 2024-09-19T06:08:52.556 INFO:tasks.workunit.client.0.smithi037.stdout:5/899: fsync d2/d12/d28/d22/fbe 0 2024-09-19T06:08:52.556 INFO:tasks.workunit.client.0.smithi037.stdout:0/978: rmdir d5/dd5/de9/d8d/de0/dea 39 2024-09-19T06:08:52.558 INFO:tasks.workunit.client.0.smithi037.stdout:1/916: dread d2/f3a [0,4194304] 0 2024-09-19T06:08:52.559 INFO:tasks.workunit.client.0.smithi037.stdout:1/917: rename d2/d12/d1e/d2d/l54 to d2/d12/d1e/d75/d89/l12e 0 2024-09-19T06:08:52.559 INFO:tasks.workunit.client.0.smithi037.stdout:1/918: chown d2/d12/d15/lf7 8750 1 2024-09-19T06:08:52.559 INFO:tasks.workunit.client.0.smithi037.stdout:1/919: write d2/d12/d1e/d2a/d8f/f127 [202549,85241] 0 2024-09-19T06:08:52.560 INFO:tasks.workunit.client.0.smithi037.stdout:1/920: symlink d2/d12/d1e/d75/l12f 0 2024-09-19T06:08:52.560 INFO:tasks.workunit.client.0.smithi037.stdout:1/921: chown d2/d12/d1d/d6b/d8b/df4 355988086 1 2024-09-19T06:08:52.560 INFO:tasks.workunit.client.0.smithi037.stdout:1/922: write d2/d12/d1e/d2a/fb3 [1417997,72220] 0 2024-09-19T06:08:52.560 INFO:tasks.workunit.client.0.smithi037.stdout:1/923: dread - d2/d12/d1d/f11c zero size 2024-09-19T06:08:52.560 INFO:tasks.workunit.client.0.smithi037.stdout:1/924: fdatasync d2/d12/d1e/d2a/d2e/f7e 0 2024-09-19T06:08:52.561 INFO:tasks.workunit.client.0.smithi037.stdout:1/925: unlink d2/d12/d1d/c64 0 2024-09-19T06:08:52.561 INFO:tasks.workunit.client.0.smithi037.stdout:1/926: chown d2/d12/d1e/d2a/d2e/l39 506 1 2024-09-19T06:08:52.569 INFO:tasks.workunit.client.0.smithi037.stdout:0/979: dread d5/d8/d44/d10f/d125/ff6 [0,4194304] 0 2024-09-19T06:08:52.571 INFO:tasks.workunit.client.0.smithi037.stdout:5/900: dread d2/d12/d28/d22/f8b [0,4194304] 0 2024-09-19T06:08:52.571 INFO:tasks.workunit.client.0.smithi037.stdout:5/901: chown d2/d12/d28/d22/d4a/d9f/f69 4 1 2024-09-19T06:08:52.571 INFO:tasks.workunit.client.0.smithi037.stdout:0/980: creat d5/d8/d79/d9a/ddb/d106/f14d x:0 0 0 2024-09-19T06:08:52.571 INFO:tasks.workunit.client.0.smithi037.stdout:5/902: chown d2/d12/d28/d22/cad 501 1 2024-09-19T06:08:52.572 INFO:tasks.workunit.client.0.smithi037.stdout:0/981: mknod d5/d8/d79/d9a/ddb/d106/dd1/c14e 0 2024-09-19T06:08:52.573 INFO:tasks.workunit.client.0.smithi037.stdout:0/982: rename d5/dd5/de9/d21/d4e/lb2 to d5/dd5/de5/d128/d146/l14f 0 2024-09-19T06:08:52.582 INFO:tasks.workunit.client.0.smithi037.stdout:1/927: dread d2/d12/d1e/d2a/d97/f99 [0,4194304] 0 2024-09-19T06:08:52.583 INFO:tasks.workunit.client.0.smithi037.stdout:1/928: truncate d2/f8 3324315 0 2024-09-19T06:08:52.590 INFO:tasks.workunit.client.0.smithi037.stdout:1/929: dread d2/d12/d1e/d75/d89/de5/f105 [0,4194304] 0 2024-09-19T06:08:52.591 INFO:tasks.workunit.client.0.smithi037.stdout:5/903: dwrite d2/d12/d28/d22/fc1 [0,4194304] 0 2024-09-19T06:08:52.620 INFO:tasks.workunit.client.0.smithi037.stdout:5/904: dwrite d2/d12/f5d [0,4194304] 0 2024-09-19T06:08:52.621 INFO:tasks.workunit.client.0.smithi037.stdout:1/930: dwrite d2/f4 [4194304,4194304] 0 2024-09-19T06:08:52.621 INFO:tasks.workunit.client.0.smithi037.stdout:1/931: fsync d2/fde 0 2024-09-19T06:08:52.621 INFO:tasks.workunit.client.0.smithi037.stdout:1/932: chown d2/d12/d1e/d2d/d6f/f70 1411238 1 2024-09-19T06:08:52.621 INFO:tasks.workunit.client.0.smithi037.stdout:5/905: symlink d2/d12/d28/d22/d35/l11f 0 2024-09-19T06:08:52.623 INFO:tasks.workunit.client.0.smithi037.stdout:1/933: unlink d2/d12/d1e/d2a/d97/cb1 0 2024-09-19T06:08:52.624 INFO:tasks.workunit.client.0.smithi037.stdout:5/906: truncate d2/d12/d28/f29 826170 0 2024-09-19T06:08:52.625 INFO:tasks.workunit.client.0.smithi037.stdout:1/934: symlink d2/d12/d1e/d2d/d6f/dac/l130 0 2024-09-19T06:08:52.625 INFO:tasks.workunit.client.0.smithi037.stdout:1/935: readlink d2/d12/d1d/d6b/ld1 0 2024-09-19T06:08:52.626 INFO:tasks.workunit.client.0.smithi037.stdout:5/907: creat d2/d12/d28/d57/df3/f120 x:0 0 0 2024-09-19T06:08:52.626 INFO:tasks.workunit.client.0.smithi037.stdout:5/908: chown d2/d12/d28/d22/d87/da8 12698241 1 2024-09-19T06:08:52.627 INFO:tasks.workunit.client.0.smithi037.stdout:1/936: mkdir d2/d12/d131 0 2024-09-19T06:08:52.628 INFO:tasks.workunit.client.0.smithi037.stdout:5/909: rmdir d2/d5c/dda 39 2024-09-19T06:08:52.633 INFO:tasks.workunit.client.0.smithi037.stdout:1/937: read d2/d12/d1e/d2a/fb3 [501577,34921] 0 2024-09-19T06:08:52.652 INFO:tasks.workunit.client.0.smithi037.stdout:1/938: dwrite d2/d12/fd0 [0,4194304] 0 2024-09-19T06:08:52.652 INFO:tasks.workunit.client.0.smithi037.stdout:1/939: chown d2/d12/d1e/d63/l114 13330 1 2024-09-19T06:08:52.652 INFO:tasks.workunit.client.0.smithi037.stdout:1/940: chown d2/d12/d1e/d75/d89/de0/f11a 3 1 2024-09-19T06:08:52.664 INFO:tasks.workunit.client.0.smithi037.stdout:3/946: sync 2024-09-19T06:08:52.664 INFO:tasks.workunit.client.0.smithi037.stdout:3/947: chown d0/d16/d19/f9c 50917 1 2024-09-19T06:08:52.664 INFO:tasks.workunit.client.0.smithi037.stdout:3/948: dread - d0/d16/d19/d1d/d5e/d61/dc4/f117 zero size 2024-09-19T06:08:52.664 INFO:tasks.workunit.client.0.smithi037.stdout:3/949: write d0/d16/d19/d33/d87/dbd/fea [629281,48288] 0 2024-09-19T06:08:52.665 INFO:tasks.workunit.client.0.smithi037.stdout:1/941: dread d2/d12/d1e/f67 [0,4194304] 0 2024-09-19T06:08:52.665 INFO:tasks.workunit.client.0.smithi037.stdout:1/942: mkdir d2/d12/d15/d5c/d132 0 2024-09-19T06:08:52.671 INFO:tasks.workunit.client.0.smithi037.stdout:1/943: dread d2/d73/fcc [0,4194304] 0 2024-09-19T06:08:52.672 INFO:tasks.workunit.client.0.smithi037.stdout:1/944: rename d2/f8 to d2/d12/d15/d34/f133 0 2024-09-19T06:08:52.674 INFO:tasks.workunit.client.0.smithi037.stdout:1/945: symlink d2/d48/l134 0 2024-09-19T06:08:52.674 INFO:tasks.workunit.client.0.smithi037.stdout:1/946: truncate d2/d12/d15/f58 1600805 0 2024-09-19T06:08:52.676 INFO:tasks.workunit.client.0.smithi037.stdout:1/947: rename d2/d12/d1e/d2d/ce6 to d2/d12/d17/c135 0 2024-09-19T06:08:52.676 INFO:tasks.workunit.client.0.smithi037.stdout:1/948: chown d2/d12/d1d/d6b/d8b/f129 145219 1 2024-09-19T06:08:52.677 INFO:tasks.workunit.client.0.smithi037.stdout:1/949: mkdir d2/d12/d1d/d136 0 2024-09-19T06:08:52.679 INFO:tasks.workunit.client.0.smithi037.stdout:1/950: link d2/d12/d17/c2c d2/d12/d1e/d75/d89/de5/c137 0 2024-09-19T06:08:52.679 INFO:tasks.workunit.client.0.smithi037.stdout:1/951: getdents d2/d12/d1e/d2a/d11e 0 2024-09-19T06:08:52.679 INFO:tasks.workunit.client.0.smithi037.stdout:1/952: chown d2/d12/d17/l10c 531856 1 2024-09-19T06:08:52.687 INFO:tasks.workunit.client.0.smithi037.stdout:3/950: dwrite d0/d43/d23/d7a/d77/dc3/dfb/d110/f12f [0,4194304] 0 2024-09-19T06:08:52.689 INFO:tasks.workunit.client.0.smithi037.stdout:3/951: creat d0/d16/d19/d1d/dd1/f136 x:0 0 0 2024-09-19T06:08:52.703 INFO:tasks.workunit.client.0.smithi037.stdout:1/953: dwrite d2/d12/d15/d5c/fca [4194304,4194304] 0 2024-09-19T06:08:52.704 INFO:tasks.workunit.client.0.smithi037.stdout:1/954: write d2/d12/d15/d34/f46 [1031014,93681] 0 2024-09-19T06:08:52.704 INFO:tasks.workunit.client.0.smithi037.stdout:1/955: write d2/d73/fcb [265270,98479] 0 2024-09-19T06:08:52.706 INFO:tasks.workunit.client.0.smithi037.stdout:1/956: creat d2/d12/d15/d5c/d132/f138 x:0 0 0 2024-09-19T06:08:52.707 INFO:tasks.workunit.client.0.smithi037.stdout:1/957: rmdir d2/d12/d1d 39 2024-09-19T06:08:52.709 INFO:tasks.workunit.client.0.smithi037.stdout:1/958: link d2/d48/l134 d2/d12/d1d/d6b/d8b/df4/l139 0 2024-09-19T06:08:52.710 INFO:tasks.workunit.client.0.smithi037.stdout:1/959: rename d2/d12/d1e/d2a/l5f to d2/d12/d15/dd3/l13a 0 2024-09-19T06:08:52.711 INFO:tasks.workunit.client.0.smithi037.stdout:1/960: creat d2/d12/d1d/d6b/d8b/dfb/f13b x:0 0 0 2024-09-19T06:08:52.712 INFO:tasks.workunit.client.0.smithi037.stdout:1/961: link d2/d12/d1d/d6b/d8b/df4/f10b d2/d12/d1d/d47/f13c 0 2024-09-19T06:08:52.712 INFO:tasks.workunit.client.0.smithi037.stdout:3/952: dwrite d0/d5f/f112 [0,4194304] 0 2024-09-19T06:08:52.713 INFO:tasks.workunit.client.0.smithi037.stdout:3/953: fdatasync d0/d16/d19/d33/d87/dbd/f104 0 2024-09-19T06:08:52.713 INFO:tasks.workunit.client.0.smithi037.stdout:3/954: fsync d0/d43/d23/d7a/d77/f3e 0 2024-09-19T06:08:52.713 INFO:tasks.workunit.client.0.smithi037.stdout:1/962: mkdir d2/d12/d15/d5c/d132/d13d 0 2024-09-19T06:08:52.715 INFO:tasks.workunit.client.0.smithi037.stdout:1/963: mknod d2/d12/d1d/d6b/d8b/c13e 0 2024-09-19T06:08:52.715 INFO:tasks.workunit.client.0.smithi037.stdout:1/964: fsync d2/d12/d1d/f30 0 2024-09-19T06:08:52.725 INFO:tasks.workunit.client.0.smithi037.stdout:3/955: dread d0/d16/d19/d1d/d5e/fde [0,4194304] 0 2024-09-19T06:08:52.726 INFO:tasks.workunit.client.0.smithi037.stdout:3/956: creat d0/d5f/d70/f137 x:0 0 0 2024-09-19T06:08:52.727 INFO:tasks.workunit.client.0.smithi037.stdout:3/957: rename d0/d16/d19/d1d/dd1/d129/d55/l4e to d0/d16/d19/d1d/d5e/d61/dcb/l138 0 2024-09-19T06:08:52.729 INFO:tasks.workunit.client.0.smithi037.stdout:3/958: rename d0/d16/d19/d1d/dd1/d129/l95 to d0/d16/d19/d33/d87/dbd/l139 0 2024-09-19T06:08:52.730 INFO:tasks.workunit.client.0.smithi037.stdout:3/959: rmdir d0/d43/d23 39 2024-09-19T06:08:52.730 INFO:tasks.workunit.client.0.smithi037.stdout:3/960: fdatasync d0/d43/d23/f8d 0 2024-09-19T06:08:52.730 INFO:tasks.workunit.client.0.smithi037.stdout:3/961: getdents d0/d16/ddf 0 2024-09-19T06:08:52.733 INFO:tasks.workunit.client.0.smithi037.stdout:1/965: dwrite d2/d12/d15/f27 [0,4194304] 0 2024-09-19T06:08:52.741 INFO:tasks.workunit.client.0.smithi037.stdout:7/979: sync 2024-09-19T06:08:52.742 INFO:tasks.workunit.client.0.smithi037.stdout:7/980: write d6/dc/f89 [2999002,92615] 0 2024-09-19T06:08:52.747 INFO:tasks.workunit.client.0.smithi037.stdout:7/981: dread d6/d20/d4b/d60/d33/d8c/ffe [0,4194304] 0 2024-09-19T06:08:52.748 INFO:tasks.workunit.client.0.smithi037.stdout:7/982: creat d6/dc/daf/de6/f13b x:0 0 0 2024-09-19T06:08:52.748 INFO:tasks.workunit.client.0.smithi037.stdout:7/983: chown d6/dc/d22 9166526 1 2024-09-19T06:08:52.749 INFO:tasks.workunit.client.0.smithi037.stdout:7/984: creat d6/d20/d34/d7d/f13c x:0 0 0 2024-09-19T06:08:52.749 INFO:tasks.workunit.client.0.smithi037.stdout:7/985: write d6/d20/d34/d7d/f13c [480529,37738] 0 2024-09-19T06:08:52.750 INFO:tasks.workunit.client.0.smithi037.stdout:3/962: dwrite d0/d16/d19/d1d/d5e/f6c [0,4194304] 0 2024-09-19T06:08:52.753 INFO:tasks.workunit.client.0.smithi037.stdout:3/963: creat d0/d16/d19/d1d/d5e/d61/dcb/f13a x:0 0 0 2024-09-19T06:08:52.754 INFO:tasks.workunit.client.0.smithi037.stdout:3/964: mkdir d0/d16/d19/d1d/dd1/d134/d13b 0 2024-09-19T06:08:52.755 INFO:tasks.workunit.client.0.smithi037.stdout:3/965: symlink d0/d16/d19/d1d/d82/l13c 0 2024-09-19T06:08:52.757 INFO:tasks.workunit.client.0.smithi037.stdout:3/966: rmdir d0/d43/d23/d7a/d77/d12b 0 2024-09-19T06:08:52.757 INFO:tasks.workunit.client.0.smithi037.stdout:3/967: mknod d0/d16/ddf/c13d 0 2024-09-19T06:08:52.762 INFO:tasks.workunit.client.0.smithi037.stdout:7/986: write d6/dc/d22/d59/fe7 [3447987,122285] 0 2024-09-19T06:08:52.766 INFO:tasks.workunit.client.0.smithi037.stdout:1/966: dwrite d2/d12/d1e/d75/d89/de5/f105 [0,4194304] 0 2024-09-19T06:08:52.770 INFO:tasks.workunit.client.0.smithi037.stdout:3/968: dread d0/d43/d23/d7a/d77/f53 [0,4194304] 0 2024-09-19T06:08:52.770 INFO:tasks.workunit.client.0.smithi037.stdout:3/969: write d0/d16/d19/d1d/d7c/ff9 [420223,91056] 0 2024-09-19T06:08:52.770 INFO:tasks.workunit.client.0.smithi037.stdout:3/970: fsync d0/d16/d19/d33/d87/f114 0 2024-09-19T06:08:52.771 INFO:tasks.workunit.client.0.smithi037.stdout:1/967: truncate d2/f28 2487368 0 2024-09-19T06:08:52.771 INFO:tasks.workunit.client.0.smithi037.stdout:1/968: chown d2/d12/d1e/d2d/d87 0 1 2024-09-19T06:08:52.771 INFO:tasks.workunit.client.0.smithi037.stdout:1/969: chown d2/f6 6683 1 2024-09-19T06:08:52.771 INFO:tasks.workunit.client.0.smithi037.stdout:3/971: getdents d0/d16/da6/dd5 0 2024-09-19T06:08:52.773 INFO:tasks.workunit.client.0.smithi037.stdout:3/972: symlink d0/d16/d19/d33/d87/dbd/l13e 0 2024-09-19T06:08:52.776 INFO:tasks.workunit.client.0.smithi037.stdout:1/970: dread d2/d12/d1e/d63/f77 [0,4194304] 0 2024-09-19T06:08:52.776 INFO:tasks.workunit.client.0.smithi037.stdout:3/973: rename d0/d43/d23/d7a/d77/dc3/df8 to d0/d16/d19/d1d/dc7/dfc/d13f 0 2024-09-19T06:08:52.778 INFO:tasks.workunit.client.0.smithi037.stdout:1/971: mkdir d2/d12/d1e/dbe/d13f 0 2024-09-19T06:08:52.778 INFO:tasks.workunit.client.0.smithi037.stdout:0/983: sync 2024-09-19T06:08:52.778 INFO:tasks.workunit.client.0.smithi037.stdout:5/910: sync 2024-09-19T06:08:52.781 INFO:tasks.workunit.client.0.smithi037.stdout:5/911: creat d2/d12/d28/d22/d35/f121 x:0 0 0 2024-09-19T06:08:52.788 INFO:tasks.workunit.client.0.smithi037.stdout:7/987: dwrite d6/dad/f134 [0,4194304] 0 2024-09-19T06:08:52.795 INFO:tasks.workunit.client.0.smithi037.stdout:5/912: dread d2/d12/d28/f3f [0,4194304] 0 2024-09-19T06:08:52.796 INFO:tasks.workunit.client.0.smithi037.stdout:5/913: symlink d2/d12/d24/d58/dbf/d102/l122 0 2024-09-19T06:08:52.797 INFO:tasks.workunit.client.0.smithi037.stdout:5/914: mkdir d2/d12/d24/d58/d96/d123 0 2024-09-19T06:08:52.803 INFO:tasks.workunit.client.0.smithi037.stdout:1/972: dwrite d2/d12/d1e/d2a/d8f/fa1 [0,4194304] 0 2024-09-19T06:08:52.803 INFO:tasks.workunit.client.0.smithi037.stdout:1/973: chown d2/d48/f81 2028 1 2024-09-19T06:08:52.803 INFO:tasks.workunit.client.0.smithi037.stdout:1/974: fsync d2/d12/d1e/d2d/f108 0 2024-09-19T06:08:52.805 INFO:tasks.workunit.client.0.smithi037.stdout:1/975: creat d2/d12/d15/d5c/d132/d13d/f140 x:0 0 0 2024-09-19T06:08:52.809 INFO:tasks.workunit.client.0.smithi037.stdout:0/984: write d5/d8/f6c [3777451,45490] 0 2024-09-19T06:08:52.815 INFO:tasks.workunit.client.0.smithi037.stdout:7/988: dwrite d6/d20/d34/ff6 [0,4194304] 0 2024-09-19T06:08:52.815 INFO:tasks.workunit.client.0.smithi037.stdout:7/989: truncate d6/dc/d22/d59/da8/dc4/f103 1374222 0 2024-09-19T06:08:52.817 INFO:tasks.workunit.client.0.smithi037.stdout:7/990: getdents d6/d20/d34/dc0 0 2024-09-19T06:08:52.818 INFO:tasks.workunit.client.0.smithi037.stdout:7/991: creat d6/d20/d4b/d60/d33/d9f/f13d x:0 0 0 2024-09-19T06:08:52.819 INFO:tasks.workunit.client.0.smithi037.stdout:7/992: mkdir d6/d20/d4b/d60/ddf/d13e 0 2024-09-19T06:08:52.820 INFO:tasks.workunit.client.0.smithi037.stdout:5/915: dwrite d2/d12/d28/d22/d53/f107 [0,4194304] 0 2024-09-19T06:08:52.820 INFO:tasks.workunit.client.0.smithi037.stdout:7/993: symlink d6/d20/d34/dc0/dcf/dec/l13f 0 2024-09-19T06:08:52.823 INFO:tasks.workunit.client.0.smithi037.stdout:5/916: mknod d2/d12/d28/d22/d87/da8/dfe/d10a/c124 0 2024-09-19T06:08:52.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:08:52 smithi037 ceph-mon[31211]: pgmap v430: 129 pgs: 129 active+clean; 1.4 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 162 MiB/s rd, 201 MiB/s wr, 271 op/s 2024-09-19T06:08:52.824 INFO:tasks.workunit.client.0.smithi037.stdout:7/994: truncate d6/dad/fb4 3408735 0 2024-09-19T06:08:52.824 INFO:tasks.workunit.client.0.smithi037.stdout:7/995: truncate d6/d20/d4b/d60/fe8 17011 0 2024-09-19T06:08:52.825 INFO:tasks.workunit.client.0.smithi037.stdout:5/917: creat d2/d12/d7e/de3/f125 x:0 0 0 2024-09-19T06:08:52.825 INFO:tasks.workunit.client.0.smithi037.stdout:5/918: stat d2/d12/d24/d58/d96/dd7/dfb/fc3 0 2024-09-19T06:08:52.826 INFO:tasks.workunit.client.0.smithi037.stdout:7/996: creat d6/d20/d4b/ddc/f140 x:0 0 0 2024-09-19T06:08:52.826 INFO:tasks.workunit.client.0.smithi037.stdout:7/997: chown d6/d20/d34/dc0/dcf/d105/f135 27908980 1 2024-09-19T06:08:52.826 INFO:tasks.workunit.client.0.smithi037.stdout:7/998: chown d6/d21/f44 19 1 2024-09-19T06:08:52.826 INFO:tasks.workunit.client.0.smithi037.stdout:7/999: stat d6/d20/d4b/d60/f31 0 2024-09-19T06:08:52.827 INFO:tasks.workunit.client.0.smithi037.stdout:5/919: symlink d2/d10/da1/dac/l126 0 2024-09-19T06:08:52.830 INFO:tasks.workunit.client.0.smithi037.stdout:5/920: write d2/d12/d28/d22/d4a/fcd [260313,70002] 0 2024-09-19T06:08:52.831 INFO:tasks.workunit.client.0.smithi037.stdout:5/921: creat d2/d12/d28/d22/d4a/d9f/f127 x:0 0 0 2024-09-19T06:08:52.832 INFO:tasks.workunit.client.0.smithi037.stdout:5/922: rename d2/d12/d28/d22/d4a/d9e/fb1 to d2/d12/d28/d22/d87/da8/f128 0 2024-09-19T06:08:52.833 INFO:tasks.workunit.client.0.smithi037.stdout:5/923: symlink d2/d12/d24/d58/dbf/d102/l129 0 2024-09-19T06:08:52.834 INFO:tasks.workunit.client.0.smithi037.stdout:5/924: getdents d2/d12/d7e 0 2024-09-19T06:08:52.835 INFO:tasks.workunit.client.0.smithi037.stdout:5/925: mknod d2/d10/daf/c12a 0 2024-09-19T06:08:52.835 INFO:tasks.workunit.client.0.smithi037.stdout:5/926: getdents d2/d12/d24/d58/d96/dd7/dfb 0 2024-09-19T06:08:52.853 INFO:tasks.workunit.client.0.smithi037.stdout:5/927: dwrite d2/d12/d28/d57/f91 [0,4194304] 0 2024-09-19T06:08:52.855 INFO:tasks.workunit.client.0.smithi037.stdout:5/928: mknod d2/d12/d28/d57/df3/c12b 0 2024-09-19T06:08:52.856 INFO:tasks.workunit.client.0.smithi037.stdout:5/929: mknod d2/d12/d28/d22/d35/c12c 0 2024-09-19T06:08:52.862 INFO:tasks.workunit.client.0.smithi037.stdout:5/930: dread d2/d12/d28/d22/d4a/fcd [0,4194304] 0 2024-09-19T06:08:52.864 INFO:tasks.workunit.client.0.smithi037.stdout:5/931: unlink d2/d12/d28/d57/f73 0 2024-09-19T06:08:52.865 INFO:tasks.workunit.client.0.smithi037.stdout:5/932: readlink d2/d12/d28/d22/d53/l84 0 2024-09-19T06:08:52.885 INFO:tasks.workunit.client.0.smithi037.stdout:5/933: dwrite d2/d12/d7e/ddf/f116 [0,4194304] 0 2024-09-19T06:08:52.908 INFO:tasks.workunit.client.0.smithi037.stdout:5/934: dwrite d2/d12/d7e/fe4 [0,4194304] 0 2024-09-19T06:08:52.909 INFO:tasks.workunit.client.0.smithi037.stdout:5/935: mknod d2/d12/d28/d22/d4a/d9f/c12d 0 2024-09-19T06:08:52.909 INFO:tasks.workunit.client.0.smithi037.stdout:5/936: chown d2/d12/d28/d22/d87/da8/fd3 45 1 2024-09-19T06:08:52.910 INFO:tasks.workunit.client.0.smithi037.stdout:5/937: mknod d2/d10/da1/c12e 0 2024-09-19T06:08:52.910 INFO:tasks.workunit.client.0.smithi037.stdout:5/938: chown d2/d10/f4e 2215092 1 2024-09-19T06:08:52.910 INFO:tasks.workunit.client.0.smithi037.stdout:5/939: truncate d2/d5c/dda/f114 687030 0 2024-09-19T06:08:52.922 INFO:tasks.workunit.client.0.smithi037.stdout:5/940: dread d2/d12/d7e/ddf/f116 [0,4194304] 0 2024-09-19T06:08:52.923 INFO:tasks.workunit.client.0.smithi037.stdout:5/941: mkdir d2/d12/d28/d22/d4a/d9f/de8/d12f 0 2024-09-19T06:08:52.924 INFO:tasks.workunit.client.0.smithi037.stdout:5/942: mkdir d2/d12/d24/d58/dbf/d102/d130 0 2024-09-19T06:08:52.925 INFO:tasks.workunit.client.0.smithi037.stdout:5/943: mknod d2/d12/d24/d97/dbc/c131 0 2024-09-19T06:08:52.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:08:52 smithi099 ceph-mon[35300]: pgmap v430: 129 pgs: 129 active+clean; 1.4 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 162 MiB/s rd, 201 MiB/s wr, 271 op/s 2024-09-19T06:08:52.944 INFO:tasks.workunit.client.0.smithi037.stdout:5/944: dwrite d2/d12/d24/f51 [0,4194304] 0 2024-09-19T06:08:52.946 INFO:tasks.workunit.client.0.smithi037.stdout:5/945: creat d2/d12/d28/d22/d87/da8/dfe/d10a/f132 x:0 0 0 2024-09-19T06:08:52.946 INFO:tasks.workunit.client.0.smithi037.stdout:5/946: rmdir d2/d12/d28/d22/d4a/d9f 39 2024-09-19T06:08:52.958 INFO:tasks.workunit.client.0.smithi037.stdout:3/974: sync 2024-09-19T06:08:52.960 INFO:tasks.workunit.client.0.smithi037.stdout:3/975: unlink d0/d16/d19/d1d/d5e/da9/db5/lfa 0 2024-09-19T06:08:52.961 INFO:tasks.workunit.client.0.smithi037.stdout:3/976: creat d0/d16/d19/d1d/f140 x:0 0 0 2024-09-19T06:08:52.962 INFO:tasks.workunit.client.0.smithi037.stdout:3/977: symlink d0/d5f/d70/l141 0 2024-09-19T06:08:52.980 INFO:tasks.workunit.client.0.smithi037.stdout:3/978: dwrite d0/d5f/d70/f137 [0,4194304] 0 2024-09-19T06:08:52.982 INFO:tasks.workunit.client.0.smithi037.stdout:3/979: mknod d0/d16/d19/d1d/d5e/da9/db5/d124/c142 0 2024-09-19T06:08:52.984 INFO:tasks.workunit.client.0.smithi037.stdout:3/980: rename d0/c11 to d0/d5f/d70/c143 0 2024-09-19T06:08:52.984 INFO:tasks.workunit.client.0.smithi037.stdout:3/981: fdatasync d0/d16/fc6 0 2024-09-19T06:08:52.985 INFO:tasks.workunit.client.0.smithi037.stdout:3/982: rename d0/d43/d23/d7a/fae to d0/d16/d19/d1d/d5e/d61/dcb/f144 0 2024-09-19T06:08:52.986 INFO:tasks.workunit.client.0.smithi037.stdout:3/983: dread - d0/d5f/ff6 zero size 2024-09-19T06:08:52.987 INFO:tasks.workunit.client.0.smithi037.stdout:3/984: creat d0/d16/f145 x:0 0 0 2024-09-19T06:08:52.990 INFO:tasks.workunit.client.0.smithi037.stdout:3/985: dread d0/d16/d19/d1d/d5e/d61/dcb/f144 [0,4194304] 0 2024-09-19T06:08:52.990 INFO:tasks.workunit.client.0.smithi037.stdout:3/986: creat d0/d43/d23/d7a/d77/d62/f146 x:0 0 0 2024-09-19T06:08:52.990 INFO:tasks.workunit.client.0.smithi037.stdout:3/987: fsync d0/d5f/f112 0 2024-09-19T06:08:52.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:08:52 smithi117 ceph-mon[35050]: pgmap v430: 129 pgs: 129 active+clean; 1.4 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 162 MiB/s rd, 201 MiB/s wr, 271 op/s 2024-09-19T06:08:53.010 INFO:tasks.workunit.client.0.smithi037.stdout:3/988: dwrite d0/d5f/da0/fb1 [0,4194304] 0 2024-09-19T06:08:53.012 INFO:tasks.workunit.client.0.smithi037.stdout:3/989: link d0/d16/da6/ccd d0/d43/d23/d7a/d77/db8/d121/c147 0 2024-09-19T06:08:53.013 INFO:tasks.workunit.client.0.smithi037.stdout:3/990: chown d0/d16/d19/fad 746 1 2024-09-19T06:08:53.013 INFO:tasks.workunit.client.0.smithi037.stdout:3/991: chown d0/d96/f131 33062797 1 2024-09-19T06:08:53.032 INFO:tasks.workunit.client.0.smithi037.stdout:3/992: dwrite d0/d16/d19/d1d/dd1/f136 [0,4194304] 0 2024-09-19T06:08:53.034 INFO:tasks.workunit.client.0.smithi037.stdout:3/993: mkdir d0/d5f/da0/df0/d12c/d12e/d148 0 2024-09-19T06:08:53.035 INFO:tasks.workunit.client.0.smithi037.stdout:3/994: rmdir d0/d16/d19/d1d/dd1/d134/d13b 0 2024-09-19T06:08:53.040 INFO:tasks.workunit.client.0.smithi037.stdout:1/976: sync 2024-09-19T06:08:53.056 INFO:tasks.workunit.client.0.smithi037.stdout:3/995: dwrite d0/d16/d19/d1d/d5e/da9/db5/f133 [0,4194304] 0 2024-09-19T06:08:53.062 INFO:tasks.workunit.client.0.smithi037.stdout:1/977: dwrite d2/d12/d1e/d2d/d87/fa3 [0,4194304] 0 2024-09-19T06:08:53.065 INFO:tasks.workunit.client.0.smithi037.stdout:0/985: sync 2024-09-19T06:08:53.065 INFO:tasks.workunit.client.0.smithi037.stdout:5/947: sync 2024-09-19T06:08:53.065 INFO:tasks.workunit.client.0.smithi037.stdout:1/978: mknod d2/d12/d1d/d136/c141 0 2024-09-19T06:08:53.066 INFO:tasks.workunit.client.0.smithi037.stdout:0/986: symlink d5/dd5/de9/d8d/l150 0 2024-09-19T06:08:53.067 INFO:tasks.workunit.client.0.smithi037.stdout:5/948: creat d2/d12/d24/f133 x:0 0 0 2024-09-19T06:08:53.068 INFO:tasks.workunit.client.0.smithi037.stdout:0/987: symlink d5/dd5/de5/d128/d146/l151 0 2024-09-19T06:08:53.070 INFO:tasks.workunit.client.0.smithi037.stdout:5/949: rename d2/d12/d24/d97 to d2/d12/d24/d58/d134 0 2024-09-19T06:08:53.072 INFO:tasks.workunit.client.0.smithi037.stdout:0/988: unlink l0 0 2024-09-19T06:08:53.080 INFO:tasks.workunit.client.0.smithi037.stdout:3/996: write d0/fa1 [2976149,71732] 0 2024-09-19T06:08:53.080 INFO:tasks.workunit.client.0.smithi037.stdout:3/997: creat d0/d16/d19/d1d/dc7/dfc/d13f/f149 x:0 0 0 2024-09-19T06:08:53.082 INFO:tasks.workunit.client.0.smithi037.stdout:3/998: truncate d0/d16/fc6 1691178 0 2024-09-19T06:08:53.082 INFO:tasks.workunit.client.0.smithi037.stdout:3/999: read - d0/d16/d19/d33/d87/f114 zero size 2024-09-19T06:08:53.085 INFO:tasks.workunit.client.0.smithi037.stdout:0/989: write d5/f7 [2970885,87313] 0 2024-09-19T06:08:53.086 INFO:tasks.workunit.client.0.smithi037.stdout:0/990: mknod d5/d8/d11/c152 0 2024-09-19T06:08:53.099 INFO:tasks.workunit.client.0.smithi037.stdout:1/979: dwrite d2/d12/d15/d5c/d132/d13d/f140 [0,4194304] 0 2024-09-19T06:08:53.099 INFO:tasks.workunit.client.0.smithi037.stdout:5/950: dread d2/d10/f1e [0,4194304] 0 2024-09-19T06:08:53.100 INFO:tasks.workunit.client.0.smithi037.stdout:0/991: read d5/d8/d11/d32/f43 [2121836,45936] 0 2024-09-19T06:08:53.100 INFO:tasks.workunit.client.0.smithi037.stdout:1/980: symlink d2/d12/d1d/d6b/d8b/df4/l142 0 2024-09-19T06:08:53.101 INFO:tasks.workunit.client.0.smithi037.stdout:0/992: symlink d5/dd5/de9/d8d/de0/dea/l153 0 2024-09-19T06:08:53.102 INFO:tasks.workunit.client.0.smithi037.stdout:0/993: truncate d5/d8/f6c 59215 0 2024-09-19T06:08:53.102 INFO:tasks.workunit.client.0.smithi037.stdout:0/994: truncate d5/d8/d79/d9a/ddb/d106/dd1/de2/d134/f13a 409296 0 2024-09-19T06:08:53.102 INFO:tasks.workunit.client.0.smithi037.stdout:0/995: stat d5/d8/d79/d9a/ddb/d106/dd1/de2/d134/f13a 0 2024-09-19T06:08:53.102 INFO:tasks.workunit.client.0.smithi037.stdout:1/981: read d2/d12/d1e/d2a/d8f/f127 [55656,33217] 0 2024-09-19T06:08:53.104 INFO:tasks.workunit.client.0.smithi037.stdout:1/982: mknod d2/d12/d1d/d47/db6/c143 0 2024-09-19T06:08:53.117 INFO:tasks.workunit.client.0.smithi037.stdout:0/996: dread d5/fa3 [0,4194304] 0 2024-09-19T06:08:53.117 INFO:tasks.workunit.client.0.smithi037.stdout:0/997: write d5/dd5/de9/d8d/f14c [2657,56750] 0 2024-09-19T06:08:53.118 INFO:tasks.workunit.client.0.smithi037.stdout:0/998: creat d5/d18/f154 x:0 0 0 2024-09-19T06:08:53.119 INFO:tasks.workunit.client.0.smithi037.stdout:0/999: creat d5/d42/f155 x:0 0 0 2024-09-19T06:08:53.121 INFO:tasks.workunit.client.0.smithi037.stdout:5/951: dwrite d2/f7 [0,4194304] 0 2024-09-19T06:08:53.121 INFO:tasks.workunit.client.0.smithi037.stdout:5/952: stat d2/d12/d24/d58/d134/dbc/led 0 2024-09-19T06:08:53.123 INFO:tasks.workunit.client.0.smithi037.stdout:5/953: getdents d2/d12/d24/d58/d96/dd7 0 2024-09-19T06:08:53.124 INFO:tasks.workunit.client.0.smithi037.stdout:5/954: creat d2/d12/d24/d58/d96/dd7/dfb/f135 x:0 0 0 2024-09-19T06:08:53.125 INFO:tasks.workunit.client.0.smithi037.stdout:5/955: mkdir d2/d12/d7e/d136 0 2024-09-19T06:08:53.127 INFO:tasks.workunit.client.0.smithi037.stdout:1/983: dwrite d2/f6 [0,4194304] 0 2024-09-19T06:08:53.140 INFO:tasks.workunit.client.0.smithi037.stdout:1/984: dread d2/f9 [0,4194304] 0 2024-09-19T06:08:53.142 INFO:tasks.workunit.client.0.smithi037.stdout:5/956: write d2/d12/d28/f38 [4071838,114572] 0 2024-09-19T06:08:53.144 INFO:tasks.workunit.client.0.smithi037.stdout:5/957: mkdir d2/d12/d24/d58/d96/d137 0 2024-09-19T06:08:53.144 INFO:tasks.workunit.client.0.smithi037.stdout:5/958: write d2/d12/d28/d22/f3c [74292,124313] 0 2024-09-19T06:08:53.146 INFO:tasks.workunit.client.0.smithi037.stdout:5/959: symlink d2/d12/d28/d22/d4a/l138 0 2024-09-19T06:08:53.146 INFO:tasks.workunit.client.0.smithi037.stdout:5/960: write d2/d12/d24/f133 [578312,62703] 0 2024-09-19T06:08:53.146 INFO:tasks.workunit.client.0.smithi037.stdout:5/961: chown d2/d12/d28/d22/d87/f108 119933620 1 2024-09-19T06:08:53.147 INFO:tasks.workunit.client.0.smithi037.stdout:1/985: dread d2/f3a [0,4194304] 0 2024-09-19T06:08:53.149 INFO:tasks.workunit.client.0.smithi037.stdout:1/986: creat d2/d12/d1d/d47/f144 x:0 0 0 2024-09-19T06:08:53.149 INFO:tasks.workunit.client.0.smithi037.stdout:1/987: dread - d2/d12/d1e/d2d/f108 zero size 2024-09-19T06:08:53.149 INFO:tasks.workunit.client.0.smithi037.stdout:1/988: stat d2/d12/d1d/f123 0 2024-09-19T06:08:53.149 INFO:tasks.workunit.client.0.smithi037.stdout:5/962: write d2/fe2 [538441,38453] 0 2024-09-19T06:08:53.149 INFO:tasks.workunit.client.0.smithi037.stdout:1/989: mknod d2/d12/d1e/d2d/c145 0 2024-09-19T06:08:53.150 INFO:tasks.workunit.client.0.smithi037.stdout:5/963: rmdir d2/d12 39 2024-09-19T06:08:53.150 INFO:tasks.workunit.client.0.smithi037.stdout:5/964: fsync d2/d12/d28/f3f 0 2024-09-19T06:08:53.151 INFO:tasks.workunit.client.0.smithi037.stdout:5/965: creat d2/d12/d28/d22/d4a/d9f/de8/f139 x:0 0 0 2024-09-19T06:08:53.151 INFO:tasks.workunit.client.0.smithi037.stdout:5/966: read d2/d5c/dda/f114 [221155,92487] 0 2024-09-19T06:08:53.151 INFO:tasks.workunit.client.0.smithi037.stdout:1/990: mkdir d2/d146 0 2024-09-19T06:08:53.152 INFO:tasks.workunit.client.0.smithi037.stdout:5/967: mknod d2/d12/c13a 0 2024-09-19T06:08:53.153 INFO:tasks.workunit.client.0.smithi037.stdout:5/968: creat d2/d10/da1/dac/f13b x:0 0 0 2024-09-19T06:08:53.165 INFO:tasks.workunit.client.0.smithi037.stdout:1/991: dread d2/f9 [4194304,4194304] 0 2024-09-19T06:08:53.166 INFO:tasks.workunit.client.0.smithi037.stdout:1/992: truncate d2/f3 1134515 0 2024-09-19T06:08:53.167 INFO:tasks.workunit.client.0.smithi037.stdout:1/993: unlink d2/d12/d15/d34/d90/ca9 0 2024-09-19T06:08:53.167 INFO:tasks.workunit.client.0.smithi037.stdout:1/994: write d2/d12/d15/dd3/fe1 [344443,37951] 0 2024-09-19T06:08:53.167 INFO:tasks.workunit.client.0.smithi037.stdout:1/995: truncate d2/d12/d1e/dbe/fdd 656340 0 2024-09-19T06:08:53.168 INFO:tasks.workunit.client.0.smithi037.stdout:1/996: symlink d2/d12/d1e/d75/d89/de0/l147 0 2024-09-19T06:08:53.168 INFO:tasks.workunit.client.0.smithi037.stdout:1/997: write d2/d12/d1e/d2a/d97/fd6 [791460,19486] 0 2024-09-19T06:08:53.169 INFO:tasks.workunit.client.0.smithi037.stdout:1/998: symlink d2/d12/d1e/d75/d89/de5/l148 0 2024-09-19T06:08:53.169 INFO:tasks.workunit.client.0.smithi037.stdout:1/999: write d2/d12/d1e/d2a/ff5 [155860,710] 0 2024-09-19T06:08:53.173 INFO:tasks.workunit.client.0.smithi037.stdout:5/969: dwrite d2/d12/d28/d22/d4a/d9f/fc0 [4194304,4194304] 0 2024-09-19T06:08:53.174 INFO:tasks.workunit.client.0.smithi037.stdout:5/970: chown d2/d12/d24/d58/d96/dd7/dfb/ccb 2619979 1 2024-09-19T06:08:53.174 INFO:tasks.workunit.client.0.smithi037.stdout:5/971: mknod d2/d12/d24/d58/dbf/d102/c13c 0 2024-09-19T06:08:53.174 INFO:tasks.workunit.client.0.smithi037.stdout:5/972: chown d2/d12/d28/l1d 548966 1 2024-09-19T06:08:53.187 INFO:tasks.workunit.client.0.smithi037.stdout:5/973: write d2/f7a [3982301,92652] 0 2024-09-19T06:08:53.187 INFO:tasks.workunit.client.0.smithi037.stdout:5/974: write d2/fa [5228266,86823] 0 2024-09-19T06:08:53.188 INFO:tasks.workunit.client.0.smithi037.stdout:5/975: symlink d2/d12/d24/d58/dbf/d102/l13d 0 2024-09-19T06:08:53.202 INFO:tasks.workunit.client.0.smithi037.stdout:5/976: dread d2/d12/d28/d22/d4a/d9f/fc0 [4194304,4194304] 0 2024-09-19T06:08:53.203 INFO:tasks.workunit.client.0.smithi037.stdout:5/977: rmdir d2/d12/d28/d22/d35 39 2024-09-19T06:08:53.223 INFO:tasks.workunit.client.0.smithi037.stdout:5/978: dwrite d2/d12/d24/f95 [0,4194304] 0 2024-09-19T06:08:53.224 INFO:tasks.workunit.client.0.smithi037.stdout:5/979: getdents d2/d12/d24/d58/d96/d123 0 2024-09-19T06:08:53.237 INFO:tasks.workunit.client.0.smithi037.stdout:5/980: dread d2/d12/d28/f3f [4194304,4194304] 0 2024-09-19T06:08:53.248 INFO:tasks.workunit.client.0.smithi037.stdout:5/981: write d2/d12/d28/d22/d53/f107 [1691776,88936] 0 2024-09-19T06:08:53.250 INFO:tasks.workunit.client.0.smithi037.stdout:5/982: rename d2/d12/d24/d58/dbf/d102/l129 to d2/d12/d24/l13e 0 2024-09-19T06:08:53.250 INFO:tasks.workunit.client.0.smithi037.stdout:5/983: fsync d2/d12/d28/d57/fbd 0 2024-09-19T06:08:53.251 INFO:tasks.workunit.client.0.smithi037.stdout:5/984: creat d2/d12/d7e/ddf/f13f x:0 0 0 2024-09-19T06:08:53.251 INFO:tasks.workunit.client.0.smithi037.stdout:5/985: truncate d2/d12/d24/d58/d96/dd7/fdb 868479 0 2024-09-19T06:08:53.251 INFO:tasks.workunit.client.0.smithi037.stdout:5/986: fdatasync d2/d12/f26 0 2024-09-19T06:08:53.251 INFO:tasks.workunit.client.0.smithi037.stdout:5/987: chown d2/d10/l8c 466 1 2024-09-19T06:08:53.252 INFO:tasks.workunit.client.0.smithi037.stdout:5/988: creat d2/d12/d24/d58/d134/dbc/d10e/f140 x:0 0 0 2024-09-19T06:08:53.253 INFO:tasks.workunit.client.0.smithi037.stdout:5/989: rmdir d2/d12/d7e 39 2024-09-19T06:08:53.254 INFO:tasks.workunit.client.0.smithi037.stdout:5/990: link d2/d12/d24/d58/d96/dd7/cd9 d2/d12/d28/d57/df3/c141 0 2024-09-19T06:08:53.265 INFO:tasks.workunit.client.0.smithi037.stdout:5/991: dread d2/d12/d7e/fe4 [0,4194304] 0 2024-09-19T06:08:53.265 INFO:tasks.workunit.client.0.smithi037.stdout:5/992: write d2/d12/d28/d22/d4a/d9f/fc0 [2418656,82919] 0 2024-09-19T06:08:53.285 INFO:tasks.workunit.client.0.smithi037.stdout:5/993: dwrite d2/d12/d24/d58/d134/f112 [0,4194304] 0 2024-09-19T06:08:53.286 INFO:tasks.workunit.client.0.smithi037.stdout:5/994: mknod d2/d10/da1/c142 0 2024-09-19T06:08:53.298 INFO:tasks.workunit.client.0.smithi037.stdout:5/995: write d2/d12/d7e/ddf/f116 [2231283,14920] 0 2024-09-19T06:08:53.310 INFO:tasks.workunit.client.0.smithi037.stdout:5/996: dread d2/d12/d24/f51 [0,4194304] 0 2024-09-19T06:08:53.312 INFO:tasks.workunit.client.0.smithi037.stdout:5/997: creat d2/d12/d7e/f143 x:0 0 0 2024-09-19T06:08:53.312 INFO:tasks.workunit.client.0.smithi037.stdout:5/998: truncate d2/d12/d24/d58/d96/f106 296074 0 2024-09-19T06:08:53.312 INFO:tasks.workunit.client.0.smithi037.stdout:5/999: mknod d2/d12/d28/d57/c144 0 2024-09-19T06:08:53.315 INFO:tasks.workunit.client.0.smithi037.stderr:+ rm -rf -- ./tmp.eccD1u8hpS 2024-09-19T06:08:54.801 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:08:54 smithi117 ceph-mon[35050]: pgmap v431: 129 pgs: 129 active+clean; 2.0 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 245 MiB/s rd, 297 MiB/s wr, 411 op/s 2024-09-19T06:08:54.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:08:54 smithi037 ceph-mon[31211]: pgmap v431: 129 pgs: 129 active+clean; 2.0 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 245 MiB/s rd, 297 MiB/s wr, 411 op/s 2024-09-19T06:08:54.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:08:54 smithi099 ceph-mon[35300]: pgmap v431: 129 pgs: 129 active+clean; 2.0 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 245 MiB/s rd, 297 MiB/s wr, 411 op/s 2024-09-19T06:08:56.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:08:56 smithi037 ceph-mon[31211]: pgmap v432: 129 pgs: 129 active+clean; 2.1 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 208 MiB/s rd, 251 MiB/s wr, 344 op/s 2024-09-19T06:08:56.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:08:56 smithi099 ceph-mon[35300]: pgmap v432: 129 pgs: 129 active+clean; 2.1 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 208 MiB/s rd, 251 MiB/s wr, 344 op/s 2024-09-19T06:08:57.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:08:56 smithi117 ceph-mon[35050]: pgmap v432: 129 pgs: 129 active+clean; 2.1 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 208 MiB/s rd, 251 MiB/s wr, 344 op/s 2024-09-19T06:08:58.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:08:58 smithi037 ceph-mon[31211]: pgmap v433: 129 pgs: 129 active+clean; 1.9 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 216 MiB/s rd, 256 MiB/s wr, 352 op/s 2024-09-19T06:08:58.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:08:58 smithi099 ceph-mon[35300]: pgmap v433: 129 pgs: 129 active+clean; 1.9 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 216 MiB/s rd, 256 MiB/s wr, 352 op/s 2024-09-19T06:08:58.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:08:58 smithi117 ceph-mon[35050]: pgmap v433: 129 pgs: 129 active+clean; 1.9 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 216 MiB/s rd, 256 MiB/s wr, 352 op/s 2024-09-19T06:09:00.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:09:00 smithi037 ceph-mon[31211]: pgmap v434: 129 pgs: 129 active+clean; 1.6 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 184 MiB/s rd, 210 MiB/s wr, 283 op/s 2024-09-19T06:09:00.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:09:00 smithi099 ceph-mon[35300]: pgmap v434: 129 pgs: 129 active+clean; 1.6 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 184 MiB/s rd, 210 MiB/s wr, 283 op/s 2024-09-19T06:09:00.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:09:00 smithi117 ceph-mon[35050]: pgmap v434: 129 pgs: 129 active+clean; 1.6 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 184 MiB/s rd, 210 MiB/s wr, 283 op/s 2024-09-19T06:09:01.243 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T06:09:01.244 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T06:09:02.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:09:02 smithi037 ceph-mon[31211]: pgmap v435: 129 pgs: 129 active+clean; 1.4 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 137 MiB/s rd, 154 MiB/s wr, 268 op/s 2024-09-19T06:09:02.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:09:02 smithi099 ceph-mon[35300]: pgmap v435: 129 pgs: 129 active+clean; 1.4 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 137 MiB/s rd, 154 MiB/s wr, 268 op/s 2024-09-19T06:09:03.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:09:02 smithi117 ceph-mon[35050]: pgmap v435: 129 pgs: 129 active+clean; 1.4 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 137 MiB/s rd, 154 MiB/s wr, 268 op/s 2024-09-19T06:09:04.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:09:04 smithi037 ceph-mon[31211]: pgmap v436: 129 pgs: 129 active+clean; 420 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 121 MiB/s rd, 136 MiB/s wr, 313 op/s 2024-09-19T06:09:04.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:09:04 smithi099 ceph-mon[35300]: pgmap v436: 129 pgs: 129 active+clean; 420 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 121 MiB/s rd, 136 MiB/s wr, 313 op/s 2024-09-19T06:09:05.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:09:04 smithi117 ceph-mon[35050]: pgmap v436: 129 pgs: 129 active+clean; 420 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 121 MiB/s rd, 136 MiB/s wr, 313 op/s 2024-09-19T06:09:06.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:09:06 smithi037 ceph-mon[31211]: pgmap v437: 129 pgs: 129 active+clean; 300 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 38 MiB/s rd, 39 MiB/s wr, 186 op/s 2024-09-19T06:09:06.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:09:06 smithi099 ceph-mon[35300]: pgmap v437: 129 pgs: 129 active+clean; 300 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 38 MiB/s rd, 39 MiB/s wr, 186 op/s 2024-09-19T06:09:06.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:09:06 smithi117 ceph-mon[35050]: pgmap v437: 129 pgs: 129 active+clean; 300 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 38 MiB/s rd, 39 MiB/s wr, 186 op/s 2024-09-19T06:09:08.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:09:08 smithi037 ceph-mon[31211]: pgmap v438: 129 pgs: 129 active+clean; 210 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 MiB/s rd, 27 MiB/s wr, 224 op/s 2024-09-19T06:09:08.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:09:08 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:09:08.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:09:08 smithi099 ceph-mon[35300]: pgmap v438: 129 pgs: 129 active+clean; 210 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 MiB/s rd, 27 MiB/s wr, 224 op/s 2024-09-19T06:09:08.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:09:08 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:09:08.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:09:08 smithi117 ceph-mon[35050]: pgmap v438: 129 pgs: 129 active+clean; 210 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 MiB/s rd, 27 MiB/s wr, 224 op/s 2024-09-19T06:09:09.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:09:08 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:09:09.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:09:09 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:09.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:09:09 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:09:09.824 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:09:09 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:09:09.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:09:09 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:09.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:09:09 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:09:09.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:09:09 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:09:09.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:09:09 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:10.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:09:09 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:09:10.000 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:09:09 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:09:10.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:09:10 smithi099 ceph-mon[35300]: pgmap v439: 129 pgs: 129 active+clean; 206 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 8.5 MiB/s wr, 276 op/s 2024-09-19T06:09:10.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:09:10 smithi117 ceph-mon[35050]: pgmap v439: 129 pgs: 129 active+clean; 206 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 8.5 MiB/s wr, 276 op/s 2024-09-19T06:09:11.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:09:10 smithi037 ceph-mon[31211]: pgmap v439: 129 pgs: 129 active+clean; 206 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 8.5 MiB/s wr, 276 op/s 2024-09-19T06:09:12.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:09:12 smithi099 ceph-mon[35300]: pgmap v440: 129 pgs: 129 active+clean; 206 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 261 op/s 2024-09-19T06:09:12.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:09:12 smithi117 ceph-mon[35050]: pgmap v440: 129 pgs: 129 active+clean; 206 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 261 op/s 2024-09-19T06:09:13.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:09:12 smithi037 ceph-mon[31211]: pgmap v440: 129 pgs: 129 active+clean; 206 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 261 op/s 2024-09-19T06:09:14.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:09:14 smithi099 ceph-mon[35300]: pgmap v441: 129 pgs: 129 active+clean; 207 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 358 op/s 2024-09-19T06:09:14.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:09:14 smithi117 ceph-mon[35050]: pgmap v441: 129 pgs: 129 active+clean; 207 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 358 op/s 2024-09-19T06:09:15.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:09:14 smithi037 ceph-mon[31211]: pgmap v441: 129 pgs: 129 active+clean; 207 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 358 op/s 2024-09-19T06:09:16.875 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:09:16 smithi037 ceph-mon[31211]: pgmap v442: 129 pgs: 129 active+clean; 208 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 319 op/s 2024-09-19T06:09:16.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:09:16 smithi099 ceph-mon[35300]: pgmap v442: 129 pgs: 129 active+clean; 208 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 319 op/s 2024-09-19T06:09:16.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:09:16 smithi117 ceph-mon[35050]: pgmap v442: 129 pgs: 129 active+clean; 208 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 319 op/s 2024-09-19T06:09:18.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:09:18 smithi099 ceph-mon[35300]: pgmap v443: 129 pgs: 129 active+clean; 204 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 363 op/s 2024-09-19T06:09:18.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:09:18 smithi117 ceph-mon[35050]: pgmap v443: 129 pgs: 129 active+clean; 204 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 363 op/s 2024-09-19T06:09:19.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:09:18 smithi037 ceph-mon[31211]: pgmap v443: 129 pgs: 129 active+clean; 204 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 363 op/s 2024-09-19T06:09:20.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:09:20 smithi099 ceph-mon[35300]: pgmap v444: 129 pgs: 129 active+clean; 206 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 380 op/s 2024-09-19T06:09:20.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:09:20 smithi117 ceph-mon[35050]: pgmap v444: 129 pgs: 129 active+clean; 206 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 380 op/s 2024-09-19T06:09:21.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:09:20 smithi037 ceph-mon[31211]: pgmap v444: 129 pgs: 129 active+clean; 206 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 380 op/s 2024-09-19T06:09:21.157 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 16.6 2024-09-19T06:09:21.158 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:09:21.417 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:09:22.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:09:22 smithi099 ceph-mon[35300]: pgmap v445: 129 pgs: 129 active+clean; 203 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 331 op/s 2024-09-19T06:09:22.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:09:22 smithi117 ceph-mon[35050]: pgmap v445: 129 pgs: 129 active+clean; 203 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 331 op/s 2024-09-19T06:09:23.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:09:22 smithi037 ceph-mon[31211]: pgmap v445: 129 pgs: 129 active+clean; 203 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 331 op/s 2024-09-19T06:09:24.821 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:09:24 smithi037 ceph-mon[31211]: pgmap v446: 129 pgs: 129 active+clean; 155 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 449 op/s 2024-09-19T06:09:24.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:24.796+0000 7f85630b8640 1 -- 172.21.15.37:0/632478870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f855c106f10 msgr2=0x7f855c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:24.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:24.796+0000 7f85630b8640 1 --2- 172.21.15.37:0/632478870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f855c106f10 0x7f855c10ea90 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f8554009ca0 tx=0x7f855402a8c0 comp rx=0 tx=0).stop 2024-09-19T06:09:24.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:24.796+0000 7f85630b8640 1 -- 172.21.15.37:0/632478870 shutdown_connections 2024-09-19T06:09:24.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:24.796+0000 7f85630b8640 1 --2- 172.21.15.37:0/632478870 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f855c102790 0x7f855c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:24.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:24.796+0000 7f85630b8640 1 --2- 172.21.15.37:0/632478870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f855c106f10 0x7f855c10ea90 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:24.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:24.796+0000 7f85630b8640 1 --2- 172.21.15.37:0/632478870 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f855c101de0 0x7f855c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:24.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:24.796+0000 7f85630b8640 1 -- 172.21.15.37:0/632478870 >> 172.21.15.37:0/632478870 conn(0x7f855c0fd8c0 msgr2=0x7f855c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:24.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:24.796+0000 7f85630b8640 1 -- 172.21.15.37:0/632478870 shutdown_connections 2024-09-19T06:09:24.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:24.796+0000 7f85630b8640 1 -- 172.21.15.37:0/632478870 wait complete. 2024-09-19T06:09:24.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:24.796+0000 7f85630b8640 1 Processor -- start 2024-09-19T06:09:24.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:24.796+0000 7f85630b8640 1 -- start start 2024-09-19T06:09:24.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:24.797+0000 7f85630b8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f855c101de0 0x7f855c1983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:24.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:24.797+0000 7f85630b8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f855c102790 0x7f855c198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:24.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:24.797+0000 7f85630b8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f855c106f10 0x7f855c19ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:24.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:24.797+0000 7f85630b8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f855c111f70 con 0x7f855c101de0 2024-09-19T06:09:24.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:24.797+0000 7f85630b8640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f855c111df0 con 0x7f855c106f10 2024-09-19T06:09:24.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:24.797+0000 7f85630b8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f855c1120f0 con 0x7f855c102790 2024-09-19T06:09:24.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:24.797+0000 7f8560e54640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f855c101de0 0x7f855c1983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:24.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:24.797+0000 7f8560e54640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f855c101de0 0x7f855c1983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44050/0 (socket says 172.21.15.37:44050) 2024-09-19T06:09:24.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:24.797+0000 7f8560e54640 1 -- 172.21.15.37:0/3847962814 learned_addr learned my addr 172.21.15.37:0/3847962814 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:09:24.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:24.797+0000 7f855bfff640 1 --2- 172.21.15.37:0/3847962814 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f855c102790 0x7f855c198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:24.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:24.797+0000 7f8561655640 1 --2- 172.21.15.37:0/3847962814 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f855c106f10 0x7f855c19ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:24.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:24.797+0000 7f855bfff640 1 -- 172.21.15.37:0/3847962814 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f855c106f10 msgr2=0x7f855c19ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:24.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:24.797+0000 7f855bfff640 1 --2- 172.21.15.37:0/3847962814 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f855c106f10 0x7f855c19ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:24.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:24.797+0000 7f855bfff640 1 -- 172.21.15.37:0/3847962814 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f855c101de0 msgr2=0x7f855c1983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:24.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:24.797+0000 7f855bfff640 1 --2- 172.21.15.37:0/3847962814 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f855c101de0 0x7f855c1983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:24.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:24.797+0000 7f855bfff640 1 -- 172.21.15.37:0/3847962814 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f855c19d3a0 con 0x7f855c102790 2024-09-19T06:09:24.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:24.797+0000 7f8561655640 1 --2- 172.21.15.37:0/3847962814 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f855c106f10 0x7f855c19ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:09:24.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:24.797+0000 7f8560e54640 1 --2- 172.21.15.37:0/3847962814 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f855c101de0 0x7f855c1983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:09:24.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:24.798+0000 7f855bfff640 1 --2- 172.21.15.37:0/3847962814 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f855c102790 0x7f855c198930 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8550009bc0 tx=0x7f855000b690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:24.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:24.798+0000 7f8559ffb640 1 -- 172.21.15.37:0/3847962814 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f855001e070 con 0x7f855c102790 2024-09-19T06:09:24.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:24.798+0000 7f8559ffb640 1 -- 172.21.15.37:0/3847962814 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f85500198f0 con 0x7f855c102790 2024-09-19T06:09:24.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:24.798+0000 7f85630b8640 1 -- 172.21.15.37:0/3847962814 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f855c19d690 con 0x7f855c102790 2024-09-19T06:09:24.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:24.798+0000 7f8559ffb640 1 -- 172.21.15.37:0/3847962814 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85500187f0 con 0x7f855c102790 2024-09-19T06:09:24.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:24.798+0000 7f85630b8640 1 -- 172.21.15.37:0/3847962814 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f855c074420 con 0x7f855c102790 2024-09-19T06:09:24.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:24.799+0000 7f85630b8640 1 -- 172.21.15.37:0/3847962814 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f855c1021c0 con 0x7f855c102790 2024-09-19T06:09:24.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:24.800+0000 7f8559ffb640 1 -- 172.21.15.37:0/3847962814 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f8550021070 con 0x7f855c102790 2024-09-19T06:09:24.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:24.801+0000 7f8559ffb640 1 --2- 172.21.15.37:0/3847962814 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f85440a3240 0x7f85440a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:24.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:24.801+0000 7f8560e54640 1 --2- 172.21.15.37:0/3847962814 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f85440a3240 0x7f85440a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:24.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:24.801+0000 7f8559ffb640 1 -- 172.21.15.37:0/3847962814 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9121+0+0 (secure 0 0 0) 0x7f85500d3530 con 0x7f855c102790 2024-09-19T06:09:24.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:24.801+0000 7f8560e54640 1 --2- 172.21.15.37:0/3847962814 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f85440a3240 0x7f85440a5700 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f854c005fd0 tx=0x7f854c00b480 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:24.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:24.804+0000 7f8559ffb640 1 -- 172.21.15.37:0/3847962814 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f855009f880 con 0x7f855c102790 2024-09-19T06:09:24.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:09:24 smithi099 ceph-mon[35300]: pgmap v446: 129 pgs: 129 active+clean; 155 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 449 op/s 2024-09-19T06:09:24.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:09:24 smithi117 ceph-mon[35050]: pgmap v446: 129 pgs: 129 active+clean; 155 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 449 op/s 2024-09-19T06:09:25.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:25.110+0000 7f85630b8640 1 -- 172.21.15.37:0/3847962814 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f855c199750 con 0x7f855c102790 2024-09-19T06:09:25.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:25.111+0000 7f8559ffb640 1 -- 172.21.15.37:0/3847962814 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11842 (secure 0 0 0) 0x7f855c199750 con 0x7f855c102790 2024-09-19T06:09:25.114 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T06:09:25.114 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"btime":"2024-09-19T06:04:42:531480+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14514,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2864247978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2864247978},{"type":"v1","addr":"172.21.15.37:6835","nonce":2864247978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14526,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/633000932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":633000932},{"type":"v1","addr":"172.21.15.37:6837","nonce":633000932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14574,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/3753800615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":3753800615},{"type":"v1","addr":"172.21.15.37:6839","nonce":3753800615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/2718998355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":2718998355},{"type":"v1","addr":"172.21.15.37:6841","nonce":2718998355}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6833/866590207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":866590207},{"type":"v1","addr":"172.21.15.99:6833","nonce":866590207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3898668400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3898668400},{"type":"v1","addr":"172.21.15.117:6833","nonce":3898668400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2650673320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2650673320},{"type":"v1","addr":"172.21.15.99:6835","nonce":2650673320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1097471349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1097471349},{"type":"v1","addr":"172.21.15.117:6835","nonce":1097471349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24457,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1001392672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1001392672},{"type":"v1","addr":"172.21.15.117:6837","nonce":1001392672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/23570935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":23570935},{"type":"v1","addr":"172.21.15.99:6837","nonce":23570935}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:04:06.253034+0000","modified":"2024-09-19T06:04:42.196783+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24485},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24478":{"gid":24478,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6839/1269518339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":1269518339},{"type":"v1","addr":"172.21.15.117:6839","nonce":1269518339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.99:6839/3404812329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":3404812329},{"type":"v1","addr":"172.21.15.99:6839","nonce":3404812329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24485,"qdb_cluster":[24485]},"id":1}]} 2024-09-19T06:09:25.114 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 20 2024-09-19T06:09:25.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:25.116+0000 7f85630b8640 1 -- 172.21.15.37:0/3847962814 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f85440a3240 msgr2=0x7f85440a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:25.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:25.116+0000 7f85630b8640 1 --2- 172.21.15.37:0/3847962814 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f85440a3240 0x7f85440a5700 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f854c005fd0 tx=0x7f854c00b480 comp rx=0 tx=0).stop 2024-09-19T06:09:25.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:25.116+0000 7f85630b8640 1 -- 172.21.15.37:0/3847962814 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f855c102790 msgr2=0x7f855c198930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:25.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:25.116+0000 7f85630b8640 1 --2- 172.21.15.37:0/3847962814 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f855c102790 0x7f855c198930 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8550009bc0 tx=0x7f855000b690 comp rx=0 tx=0).stop 2024-09-19T06:09:25.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:25.116+0000 7f85630b8640 1 -- 172.21.15.37:0/3847962814 shutdown_connections 2024-09-19T06:09:25.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:25.116+0000 7f85630b8640 1 --2- 172.21.15.37:0/3847962814 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f85440a3240 0x7f85440a5700 secure :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f854c005fd0 tx=0x7f854c00b480 comp rx=0 tx=0).stop 2024-09-19T06:09:25.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:25.116+0000 7f85630b8640 1 --2- 172.21.15.37:0/3847962814 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f855c106f10 0x7f855c19ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:25.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:25.116+0000 7f85630b8640 1 --2- 172.21.15.37:0/3847962814 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f855c102790 0x7f855c198930 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:25.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:25.116+0000 7f85630b8640 1 --2- 172.21.15.37:0/3847962814 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f855c101de0 0x7f855c1983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:25.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:25.116+0000 7f85630b8640 1 -- 172.21.15.37:0/3847962814 >> 172.21.15.37:0/3847962814 conn(0x7f855c0fd8c0 msgr2=0x7f855c0feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:25.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:25.120+0000 7f85630b8640 1 -- 172.21.15.37:0/3847962814 shutdown_connections 2024-09-19T06:09:25.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:25.121+0000 7f85630b8640 1 -- 172.21.15.37:0/3847962814 wait complete. 2024-09-19T06:09:25.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:09:25 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/3847962814' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:09:25.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:09:25 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/3847962814' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:09:25.957 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24485 quiesce db / --timeout 90 --expiration 136.6 --await-for 45.0' 2024-09-19T06:09:25.957 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24485 quiesce db / --timeout 90 --expiration 136.6 --await-for 45.0 2024-09-19T06:09:25.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:09:25 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/3847962814' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:09:26.304 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:09:26.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.826+0000 7f8ff69b3640 1 -- 172.21.15.37:0/607405367 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ff0102d40 msgr2=0x7f8ff0103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:26.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.826+0000 7f8ff69b3640 1 --2- 172.21.15.37:0/607405367 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ff0102d40 0x7f8ff0103120 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f8fe0009900 tx=0x7f8fe002a480 comp rx=0 tx=0).stop 2024-09-19T06:09:26.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.826+0000 7f8ff69b3640 1 -- 172.21.15.37:0/607405367 shutdown_connections 2024-09-19T06:09:26.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.826+0000 7f8ff69b3640 1 --2- 172.21.15.37:0/607405367 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ff0103660 0x7f8ff010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:26.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.826+0000 7f8ff69b3640 1 --2- 172.21.15.37:0/607405367 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ff010c170 0x7f8ff010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:26.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.826+0000 7f8ff69b3640 1 --2- 172.21.15.37:0/607405367 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ff0102d40 0x7f8ff0103120 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:26.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.826+0000 7f8ff69b3640 1 -- 172.21.15.37:0/607405367 >> 172.21.15.37:0/607405367 conn(0x7f8ff00fc7a0 msgr2=0x7f8ff00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:26.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.826+0000 7f8ff69b3640 1 -- 172.21.15.37:0/607405367 shutdown_connections 2024-09-19T06:09:26.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.826+0000 7f8ff69b3640 1 -- 172.21.15.37:0/607405367 wait complete. 2024-09-19T06:09:26.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.826+0000 7f8ff69b3640 1 Processor -- start 2024-09-19T06:09:26.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.826+0000 7f8ff69b3640 1 -- start start 2024-09-19T06:09:26.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.827+0000 7f8ff69b3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ff0102d40 0x7f8ff01009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:26.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.827+0000 7f8ff69b3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ff0103660 0x7f8ff0100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:26.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.827+0000 7f8ff69b3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ff010c170 0x7f8ff0101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:26.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.827+0000 7f8ff69b3640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff0111f70 con 0x7f8ff010c170 2024-09-19T06:09:26.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.827+0000 7f8ff69b3640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff0111df0 con 0x7f8ff0102d40 2024-09-19T06:09:26.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.827+0000 7f8ff69b3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff01120f0 con 0x7f8ff0103660 2024-09-19T06:09:26.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.827+0000 7f8ff4f50640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ff010c170 0x7f8ff0101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:26.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.827+0000 7f8feffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ff0102d40 0x7f8ff01009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:26.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.827+0000 7f8ff4f50640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ff010c170 0x7f8ff0101420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44068/0 (socket says 172.21.15.37:44068) 2024-09-19T06:09:26.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.827+0000 7f8fef7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ff0103660 0x7f8ff0100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:26.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.827+0000 7f8ff4f50640 1 -- 172.21.15.37:0/3795920159 learned_addr learned my addr 172.21.15.37:0/3795920159 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:09:26.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.827+0000 7f8ff4f50640 1 -- 172.21.15.37:0/3795920159 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ff0103660 msgr2=0x7f8ff0100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:26.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.827+0000 7f8ff4f50640 1 --2- 172.21.15.37:0/3795920159 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ff0103660 0x7f8ff0100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:26.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.827+0000 7f8ff4f50640 1 -- 172.21.15.37:0/3795920159 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ff0102d40 msgr2=0x7f8ff01009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:26.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.827+0000 7f8ff4f50640 1 --2- 172.21.15.37:0/3795920159 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ff0102d40 0x7f8ff01009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:26.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.827+0000 7f8ff4f50640 1 -- 172.21.15.37:0/3795920159 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ff01a6990 con 0x7f8ff010c170 2024-09-19T06:09:26.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.827+0000 7f8feffff640 1 --2- 172.21.15.37:0/3795920159 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ff0102d40 0x7f8ff01009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:09:26.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.828+0000 7f8ff4f50640 1 --2- 172.21.15.37:0/3795920159 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ff010c170 0x7f8ff0101420 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f8fe8009fd0 tx=0x7f8fe800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:26.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.828+0000 7f8fed7fa640 1 -- 172.21.15.37:0/3795920159 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe8017070 con 0x7f8ff010c170 2024-09-19T06:09:26.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.828+0000 7f8fed7fa640 1 -- 172.21.15.37:0/3795920159 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8fe8003e50 con 0x7f8ff010c170 2024-09-19T06:09:26.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.828+0000 7f8ff69b3640 1 -- 172.21.15.37:0/3795920159 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ff01a6c80 con 0x7f8ff010c170 2024-09-19T06:09:26.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.828+0000 7f8fed7fa640 1 -- 172.21.15.37:0/3795920159 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe80106c0 con 0x7f8ff010c170 2024-09-19T06:09:26.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.828+0000 7f8ff69b3640 1 -- 172.21.15.37:0/3795920159 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ff01a7170 con 0x7f8ff010c170 2024-09-19T06:09:26.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.830+0000 7f8fed7fa640 1 -- 172.21.15.37:0/3795920159 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f8fe8003970 con 0x7f8ff010c170 2024-09-19T06:09:26.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.831+0000 7f8ff8d8c740 1 Processor -- start 2024-09-19T06:09:26.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.831+0000 7f8ff8d8c740 1 -- start start 2024-09-19T06:09:26.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.831+0000 7f8ff8d8c740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561d3442e760 0x561d3442eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:26.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.831+0000 7f8ff8d8c740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561d3442f080 0x561d34439400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:26.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.831+0000 7f8ff8d8c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561d34439940 0x561d3443bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:26.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.831+0000 7f8ff8d8c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561d343942a0 con 0x561d34439940 2024-09-19T06:09:26.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.831+0000 7f8ff8d8c740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x561d3433bb10 con 0x561d3442e760 2024-09-19T06:09:26.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.831+0000 7f8ff8d8c740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x561d34390260 con 0x561d3442f080 2024-09-19T06:09:26.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.831+0000 7f8fed7fa640 1 --2- 172.21.15.37:0/3795920159 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f8fd80a3240 0x7f8fd80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:26.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.831+0000 7f8feffff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561d3442f080 0x561d34439400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:26.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.831+0000 7f8feffff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561d3442f080 0x561d34439400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.37:59030/0 (socket says 172.21.15.37:59030) 2024-09-19T06:09:26.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.831+0000 7f8feffff640 1 -- 172.21.15.37:0/3579397993 learned_addr learned my addr 172.21.15.37:0/3579397993 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:09:26.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.831+0000 7f8fef7fe640 1 --2- 172.21.15.37:0/3579397993 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561d3442e760 0x561d3442eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:26.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.831+0000 7f8fef7fe640 1 --2- 172.21.15.37:0/3579397993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561d34439940 0x561d3443bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:26.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.831+0000 7f8fed7fa640 1 -- 172.21.15.37:0/3795920159 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9121+0+0 (secure 0 0 0) 0x7f8fe80cf910 con 0x7f8ff010c170 2024-09-19T06:09:26.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.831+0000 7f8ff4f50640 1 --2- 172.21.15.37:0/3795920159 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f8fd80a3240 0x7f8fd80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:26.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.831+0000 7f8feffff640 1 -- 172.21.15.37:0/3579397993 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561d3442e760 msgr2=0x561d3442eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:26.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.831+0000 7f8feffff640 1 --2- 172.21.15.37:0/3579397993 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561d3442e760 0x561d3442eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:26.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.831+0000 7f8feffff640 1 -- 172.21.15.37:0/3579397993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561d34439940 msgr2=0x561d3443bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:26.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.831+0000 7f8feffff640 1 --2- 172.21.15.37:0/3579397993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561d34439940 0x561d3443bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:26.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.831+0000 7f8feffff640 1 -- 172.21.15.37:0/3579397993 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d34105b90 con 0x561d3442f080 2024-09-19T06:09:26.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.831+0000 7f8fef7fe640 1 --2- 172.21.15.37:0/3579397993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561d34439940 0x561d3443bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:09:26.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.832+0000 7f8feffff640 1 --2- 172.21.15.37:0/3579397993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561d3442f080 0x561d34439400 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8fe0009900 tx=0x7f8fe0005e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32f77d6860b77149 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:26.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.832+0000 7f8fd67fc640 1 -- 172.21.15.37:0/3579397993 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe0035040 con 0x561d3442f080 2024-09-19T06:09:26.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.832+0000 7f8ff4f50640 1 --2- 172.21.15.37:0/3795920159 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f8fd80a3240 0x7f8fd80a5700 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8fe800dfd0 tx=0x7f8fe8004020 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:26.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.832+0000 7f8fd67fc640 1 -- 172.21.15.37:0/3579397993 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8fe00318b0 con 0x561d3442f080 2024-09-19T06:09:26.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.832+0000 7f8fd67fc640 1 -- 172.21.15.37:0/3579397993 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe0004a00 con 0x561d3442f080 2024-09-19T06:09:26.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.833+0000 7f8ff8d8c740 1 -- 172.21.15.37:0/3579397993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561d3442f080 msgr2=0x561d34439400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:26.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.833+0000 7f8ff8d8c740 1 --2- 172.21.15.37:0/3579397993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561d3442f080 0x561d34439400 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8fe0009900 tx=0x7f8fe0005e80 comp rx=0 tx=0).stop 2024-09-19T06:09:26.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.833+0000 7f8ff8d8c740 1 -- 172.21.15.37:0/3579397993 shutdown_connections 2024-09-19T06:09:26.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.833+0000 7f8ff8d8c740 1 --2- 172.21.15.37:0/3579397993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561d34439940 0x561d3443bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:26.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.833+0000 7f8ff8d8c740 1 --2- 172.21.15.37:0/3579397993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561d3442f080 0x561d34439400 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:26.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.833+0000 7f8ff8d8c740 1 --2- 172.21.15.37:0/3579397993 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561d3442e760 0x561d3442eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:26.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.833+0000 7f8ff8d8c740 1 -- 172.21.15.37:0/3579397993 >> 172.21.15.37:0/3579397993 conn(0x561d3442acf0 msgr2=0x561d3442b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:26.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.833+0000 7f8ff8d8c740 1 -- 172.21.15.37:0/3579397993 shutdown_connections 2024-09-19T06:09:26.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.833+0000 7f8ff8d8c740 1 -- 172.21.15.37:0/3579397993 wait complete. 2024-09-19T06:09:26.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.833+0000 7f8ff8d8c740 1 -- start start 2024-09-19T06:09:26.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.833+0000 7f8ff8d8c740 1 Processor -- start 2024-09-19T06:09:26.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.834+0000 7f8ff8d8c740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561d3442e760 0x561d344367f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:26.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.834+0000 7f8ff8d8c740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561d3442f080 0x561d34436d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:26.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.834+0000 7f8ff8d8c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561d34439940 0x561d34437270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:26.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.834+0000 7f8ff8d8c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561d3443c510 con 0x561d34439940 2024-09-19T06:09:26.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.834+0000 7f8ff8d8c740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x561d3431c6e0 con 0x561d3442f080 2024-09-19T06:09:26.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.834+0000 7f8ff8d8c740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x561d3443c690 con 0x561d3442e760 2024-09-19T06:09:26.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.834+0000 7f8ff8d8c740 10 client.0 _ll_register_callbacks cb 0x561d34340a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:09:26.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.834+0000 7f8fef7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561d3442e760 0x561d344367f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:26.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.834+0000 7f8feffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561d3442f080 0x561d34436d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:26.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.834+0000 7f8feffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561d3442f080 0x561d34436d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.37:57190/0 (socket says 172.21.15.37:57190) 2024-09-19T06:09:26.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.834+0000 7f8fef7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561d3442e760 0x561d344367f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.37:59046/0 (socket says 172.21.15.37:59046) 2024-09-19T06:09:26.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.834+0000 7f8feffff640 1 -- 172.21.15.37:0/1498420507 learned_addr learned my addr 172.21.15.37:0/1498420507 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:09:26.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.834+0000 7f8fef7fe640 1 --2- 172.21.15.37:0/1498420507 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561d34439940 0x561d34437270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:26.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.834+0000 7f8feffff640 1 -- 172.21.15.37:0/1498420507 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561d3442e760 msgr2=0x561d344367f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:26.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.834+0000 7f8feffff640 1 --2- 172.21.15.37:0/1498420507 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561d3442e760 0x561d344367f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:26.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.834+0000 7f8feffff640 1 -- 172.21.15.37:0/1498420507 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561d34439940 msgr2=0x561d34437270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:26.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.834+0000 7f8feffff640 1 --2- 172.21.15.37:0/1498420507 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561d34439940 0x561d34437270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:26.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.834+0000 7f8feffff640 1 -- 172.21.15.37:0/1498420507 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d34445a30 con 0x561d3442f080 2024-09-19T06:09:26.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.834+0000 7f8feffff640 1 --2- 172.21.15.37:0/1498420507 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561d3442f080 0x561d34436d30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8fe0004320 tx=0x7f8fe0004350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7c7af8b8e908ea6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:26.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.834+0000 7f8fcf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-09-19T06:09:26.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.835+0000 7f8fcf7fe640 1 -- 172.21.15.37:0/1498420507 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe004e020 con 0x561d3442f080 2024-09-19T06:09:26.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.835+0000 7f8ff8d8c740 1 -- 172.21.15.37:0/1498420507 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8fe00318b0 con 0x561d3442f080 2024-09-19T06:09:26.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.835+0000 7f8fcf7fe640 1 -- 172.21.15.37:0/1498420507 <== mon.2 v2:172.21.15.99:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9121+0+0 (secure 0 0 0) 0x7f8fe0003800 con 0x561d3442f080 2024-09-19T06:09:26.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.835+0000 7f8fcf7fe640 1 -- 172.21.15.37:0/1498420507 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f8fe0059050 con 0x561d3442f080 2024-09-19T06:09:26.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.835+0000 7f8ff8d8c740 10 client.25013 fetch_fsmap learned FSMap version 20 2024-09-19T06:09:26.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.835+0000 7f8ff8d8c740 1 -- 172.21.15.37:0/1498420507 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x561d344483c0 con 0x561d3442f080 2024-09-19T06:09:26.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.835+0000 7f8fcf7fe640 1 -- 172.21.15.37:0/1498420507 <== mon.2 v2:172.21.15.99:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8fe00318b0 con 0x561d3442f080 2024-09-19T06:09:26.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.835+0000 7f8fcf7fe640 1 -- 172.21.15.37:0/1498420507 <== mon.2 v2:172.21.15.99:3300/0 5 ==== fsmap(e 20) ==== 8338+0+0 (secure 0 0 0) 0x7f8fe0046750 con 0x561d3442f080 2024-09-19T06:09:26.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.835+0000 7f8ff8d8c740 10 client.25013 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:09:26.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.835+0000 7f8ff8d8c740 10 client.25013 resolve_mds: validated gid 24485 aka daemon mds.b 2024-09-19T06:09:26.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.835+0000 7f8ff8d8c740 20 client.25013 populate_metadata read hostname 'smithi037' 2024-09-19T06:09:26.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.835+0000 7f8ff8d8c740 1 --2- 172.21.15.37:0/1498420507 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x561d34449710 0x561d3444bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:26.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.835+0000 7f8ff8d8c740 4 client.25013 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:09:26.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.835+0000 7f8ff8d8c740 1 -- 172.21.15.37:0/1498420507 --> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561d343a19d0 con 0x561d34449710 2024-09-19T06:09:26.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.836+0000 7f8fef7fe640 1 --2- 172.21.15.37:0/1498420507 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x561d34449710 0x561d3444bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:26.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.836+0000 7f8fcf7fe640 10 client.25013 ms_handle_connect on v2:172.21.15.99:6838/3404812329 2024-09-19T06:09:26.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.836+0000 7f8fef7fe640 1 --2- 172.21.15.37:0/1498420507 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x561d34449710 0x561d3444bb00 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc4a705285028445 server_cookie=e979162df35db4eb in_seq=0 out_seq=0 2024-09-19T06:09:26.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.837+0000 7f8fcf7fe640 1 -- 172.21.15.37:0/1498420507 <== mds.0 v2:172.21.15.99:6838/3404812329 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561d343a19d0 con 0x561d34449710 2024-09-19T06:09:26.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.837+0000 7f8fcf7fe640 10 client.25013 handle_command_reply: tid=0 2024-09-19T06:09:26.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.837+0000 7f8ff8d8c740 1 client.25013 shutdown 2024-09-19T06:09:26.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.837+0000 7f8ff8d8c740 1 -- 172.21.15.37:0/1498420507 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561d3442f080 msgr2=0x561d34436d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:26.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.837+0000 7f8ff8d8c740 1 --2- 172.21.15.37:0/1498420507 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561d3442f080 0x561d34436d30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8fe0004320 tx=0x7f8fe0004350 comp rx=0 tx=0).stop 2024-09-19T06:09:26.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.837+0000 7f8ff8d8c740 1 -- 172.21.15.37:0/1498420507 shutdown_connections 2024-09-19T06:09:26.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.837+0000 7f8ff8d8c740 1 --2- 172.21.15.37:0/1498420507 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x561d34449710 0x561d3444bb00 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:26.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.837+0000 7f8fcf7fe640 0 client.25013 ms_handle_reset on v2:172.21.15.99:6838/3404812329 2024-09-19T06:09:26.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.837+0000 7f8ff8d8c740 1 --2- 172.21.15.37:0/1498420507 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561d3442f080 0x561d34436d30 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:26.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.837+0000 7f8ff8d8c740 1 --2- 172.21.15.37:0/1498420507 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561d34439940 0x561d34437270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:26.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.837+0000 7f8ff8d8c740 1 --2- 172.21.15.37:0/1498420507 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561d3442e760 0x561d344367f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:26.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.837+0000 7f8ff8d8c740 1 -- 172.21.15.37:0/1498420507 >> 172.21.15.37:0/1498420507 conn(0x561d3442acf0 msgr2=0x561d34429e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:26.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.837+0000 7f8ff8d8c740 1 -- 172.21.15.37:0/1498420507 shutdown_connections 2024-09-19T06:09:26.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.837+0000 7f8ff8d8c740 1 -- 172.21.15.37:0/1498420507 wait complete. 2024-09-19T06:09:26.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.837+0000 7f8ff8d8c740 20 client.25013 trim_cache size 0 max 16384 2024-09-19T06:09:26.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.856+0000 7f8ff8d8c740 1 Processor -- start 2024-09-19T06:09:26.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.856+0000 7f8ff8d8c740 1 -- start start 2024-09-19T06:09:26.858 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:09:26 smithi037 ceph-mon[31211]: pgmap v447: 129 pgs: 129 active+clean; 151 MiB data, 1019 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 350 op/s 2024-09-19T06:09:26.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.856+0000 7f8ff8d8c740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561d3442e760 0x561d344311c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:26.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.856+0000 7f8ff8d8c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561d3442f080 0x561d34429d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:26.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.856+0000 7f8ff8d8c740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561d34439940 0x561d34451130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:26.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.856+0000 7f8ff8d8c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff01aee70 con 0x561d3442f080 2024-09-19T06:09:26.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.856+0000 7f8ff8d8c740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff01b16f0 con 0x561d34439940 2024-09-19T06:09:26.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.856+0000 7f8ff8d8c740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff01af4e0 con 0x561d3442e760 2024-09-19T06:09:26.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.856+0000 7f8feffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561d3442f080 0x561d34429d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:26.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.856+0000 7f8feffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561d3442f080 0x561d34429d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44088/0 (socket says 172.21.15.37:44088) 2024-09-19T06:09:26.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.856+0000 7f8feffff640 1 -- 172.21.15.37:0/3144279838 learned_addr learned my addr 172.21.15.37:0/3144279838 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:09:26.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.856+0000 7f8fef7fe640 1 --2- 172.21.15.37:0/3144279838 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561d34439940 0x561d34451130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:26.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.856+0000 7f8fef7fe640 1 --2- 172.21.15.37:0/3144279838 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561d3442e760 0x561d344311c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:26.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.856+0000 7f8feffff640 1 -- 172.21.15.37:0/3144279838 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561d3442e760 msgr2=0x561d344311c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:26.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.856+0000 7f8feffff640 1 --2- 172.21.15.37:0/3144279838 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561d3442e760 0x561d344311c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:26.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.856+0000 7f8feffff640 1 -- 172.21.15.37:0/3144279838 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561d34439940 msgr2=0x561d34451130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:26.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.856+0000 7f8feffff640 1 --2- 172.21.15.37:0/3144279838 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561d34439940 0x561d34451130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:26.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.856+0000 7f8feffff640 1 -- 172.21.15.37:0/3144279838 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d34426260 con 0x561d3442f080 2024-09-19T06:09:26.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.857+0000 7f8fef7fe640 1 --2- 172.21.15.37:0/3144279838 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561d3442e760 0x561d344311c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:09:26.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.857+0000 7f8feffff640 1 --2- 172.21.15.37:0/3144279838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561d3442f080 0x561d34429d60 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f8fe0046ba0 tx=0x7f8fe0005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a247277f51d3da0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:26.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.857+0000 7f8fd5ffb640 1 -- 172.21.15.37:0/3144279838 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe004e070 con 0x561d3442f080 2024-09-19T06:09:26.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.857+0000 7f8fd5ffb640 1 -- 172.21.15.37:0/3144279838 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8fe0003800 con 0x561d3442f080 2024-09-19T06:09:26.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.857+0000 7f8fd5ffb640 1 -- 172.21.15.37:0/3144279838 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe0035040 con 0x561d3442f080 2024-09-19T06:09:26.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.858+0000 7f8ff8d8c740 1 -- 172.21.15.37:0/3144279838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561d3442f080 msgr2=0x561d34429d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:26.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.858+0000 7f8ff8d8c740 1 --2- 172.21.15.37:0/3144279838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561d3442f080 0x561d34429d60 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f8fe0046ba0 tx=0x7f8fe0005e80 comp rx=0 tx=0).stop 2024-09-19T06:09:26.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.858+0000 7f8ff8d8c740 1 -- 172.21.15.37:0/3144279838 shutdown_connections 2024-09-19T06:09:26.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.858+0000 7f8ff8d8c740 1 --2- 172.21.15.37:0/3144279838 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561d34439940 0x561d34451130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:26.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.858+0000 7f8ff8d8c740 1 --2- 172.21.15.37:0/3144279838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561d3442f080 0x561d34429d60 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:26.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.858+0000 7f8ff8d8c740 1 --2- 172.21.15.37:0/3144279838 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561d3442e760 0x561d344311c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:26.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.858+0000 7f8ff8d8c740 1 -- 172.21.15.37:0/3144279838 >> 172.21.15.37:0/3144279838 conn(0x561d3442acf0 msgr2=0x561d34429650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:26.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.858+0000 7f8ff8d8c740 1 -- 172.21.15.37:0/3144279838 shutdown_connections 2024-09-19T06:09:26.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.858+0000 7f8ff8d8c740 1 -- 172.21.15.37:0/3144279838 wait complete. 2024-09-19T06:09:26.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.858+0000 7f8ff8d8c740 1 -- start start 2024-09-19T06:09:26.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.859+0000 7f8ff8d8c740 1 Processor -- start 2024-09-19T06:09:26.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.859+0000 7f8ff8d8c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561d3442e760 0x561d3443da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:26.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.859+0000 7f8ff8d8c740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561d3442f080 0x561d3443df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:26.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.859+0000 7f8ff8d8c740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561d34439940 0x561d344b3100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:26.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.859+0000 7f8ff8d8c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff01afbb0 con 0x561d3442e760 2024-09-19T06:09:26.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.859+0000 7f8ff8d8c740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff01b1020 con 0x561d3442f080 2024-09-19T06:09:26.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.859+0000 7f8ff8d8c740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff01b0280 con 0x561d34439940 2024-09-19T06:09:26.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.859+0000 7f8ff8d8c740 10 client.0 _ll_register_callbacks cb 0x7f8fe0005d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:09:26.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.859+0000 7f8fef7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561d3442e760 0x561d3443da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:26.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.859+0000 7f8fef7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561d3442e760 0x561d3443da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44090/0 (socket says 172.21.15.37:44090) 2024-09-19T06:09:26.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.859+0000 7f8fef7fe640 1 -- 172.21.15.37:0/1882287676 learned_addr learned my addr 172.21.15.37:0/1882287676 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:09:26.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.859+0000 7f8feffff640 1 --2- 172.21.15.37:0/1882287676 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561d3442f080 0x561d3443df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:26.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.859+0000 7f8fef7fe640 1 --2- 172.21.15.37:0/1882287676 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561d34439940 0x561d344b3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:26.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.859+0000 7f8fef7fe640 1 -- 172.21.15.37:0/1882287676 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561d34439940 msgr2=0x561d344b3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:26.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.859+0000 7f8fef7fe640 1 --2- 172.21.15.37:0/1882287676 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561d34439940 0x561d344b3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:26.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.859+0000 7f8fef7fe640 1 -- 172.21.15.37:0/1882287676 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561d3442f080 msgr2=0x561d3443df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:26.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.859+0000 7f8fef7fe640 1 --2- 172.21.15.37:0/1882287676 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561d3442f080 0x561d3443df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:26.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.859+0000 7f8fef7fe640 1 -- 172.21.15.37:0/1882287676 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d3443e830 con 0x561d3442e760 2024-09-19T06:09:26.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.859+0000 7f8feffff640 1 --2- 172.21.15.37:0/1882287676 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561d3442f080 0x561d3443df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:09:26.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.860+0000 7f8fef7fe640 1 --2- 172.21.15.37:0/1882287676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561d3442e760 0x561d3443da10 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f8fe4009680 tx=0x7f8fe0005490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4638b7cc5273d398 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:26.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.860+0000 7f8fcf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-19T06:09:26.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.860+0000 7f8fcf7fe640 1 -- 172.21.15.37:0/1882287676 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe4005020 con 0x561d3442e760 2024-09-19T06:09:26.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.860+0000 7f8fcf7fe640 1 -- 172.21.15.37:0/1882287676 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9121+0+0 (secure 0 0 0) 0x7f8fe4009040 con 0x561d3442e760 2024-09-19T06:09:26.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.860+0000 7f8ff8d8c740 1 -- 172.21.15.37:0/1882287676 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8fe0003800 con 0x561d3442e760 2024-09-19T06:09:26.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.860+0000 7f8fcf7fe640 1 -- 172.21.15.37:0/1882287676 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f8fe40051c0 con 0x561d3442e760 2024-09-19T06:09:26.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.860+0000 7f8ff8d8c740 10 client.15354 fetch_fsmap learned FSMap version 20 2024-09-19T06:09:26.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.860+0000 7f8ff8d8c740 1 -- 172.21.15.37:0/1882287676 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x561d344b4790 con 0x561d3442e760 2024-09-19T06:09:26.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.860+0000 7f8fcf7fe640 1 -- 172.21.15.37:0/1882287676 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8fe0003800 con 0x561d3442e760 2024-09-19T06:09:26.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.860+0000 7f8fcf7fe640 1 -- 172.21.15.37:0/1882287676 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 20) ==== 8338+0+0 (secure 0 0 0) 0x7f8fe4020040 con 0x561d3442e760 2024-09-19T06:09:26.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.860+0000 7f8ff8d8c740 10 client.15354 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:09:26.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.860+0000 7f8ff8d8c740 10 client.15354 resolve_mds: validated gid 24485 aka daemon mds.b 2024-09-19T06:09:26.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.860+0000 7f8ff8d8c740 20 client.15354 populate_metadata read hostname 'smithi037' 2024-09-19T06:09:26.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.860+0000 7f8ff8d8c740 1 --2- 172.21.15.37:0/1882287676 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x561d34449710 0x561d344b6f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:26.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.861+0000 7f8ff8d8c740 4 client.15354 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 136.6, "await_for": 45.0}] 2024-09-19T06:09:26.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.861+0000 7f8ff8d8c740 1 -- 172.21.15.37:0/1882287676 --> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 136.6, "await_for": 45.0}) -- 0x561d3439bd20 con 0x561d34449710 2024-09-19T06:09:26.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.861+0000 7f8feffff640 1 --2- 172.21.15.37:0/1882287676 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x561d34449710 0x561d344b6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:26.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.861+0000 7f8feffff640 1 --2- 172.21.15.37:0/1882287676 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x561d34449710 0x561d344b6f30 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d858ea7809ba4e9 server_cookie=a1c8c2ae7faa4515 in_seq=0 out_seq=0 2024-09-19T06:09:26.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:26.861+0000 7f8fcf7fe640 10 client.15354 ms_handle_connect on v2:172.21.15.99:6838/3404812329 2024-09-19T06:09:26.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:09:26 smithi099 ceph-mon[35300]: pgmap v447: 129 pgs: 129 active+clean; 151 MiB data, 1019 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 350 op/s 2024-09-19T06:09:26.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:09:26 smithi117 ceph-mon[35050]: pgmap v447: 129 pgs: 129 active+clean; 151 MiB data, 1019 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 350 op/s 2024-09-19T06:09:28.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:09:28 smithi099 ceph-mon[35300]: pgmap v448: 129 pgs: 129 active+clean; 152 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 383 op/s 2024-09-19T06:09:28.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:09:28 smithi117 ceph-mon[35050]: pgmap v448: 129 pgs: 129 active+clean; 152 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 383 op/s 2024-09-19T06:09:29.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:09:28 smithi037 ceph-mon[31211]: pgmap v448: 129 pgs: 129 active+clean; 152 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 383 op/s 2024-09-19T06:09:29.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:29.212+0000 7f8fcf7fe640 1 -- 172.21.15.37:0/1882287676 <== mds.0 v2:172.21.15.99:6838/3404812329 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x561d3439bd20 con 0x561d34449710 2024-09-19T06:09:29.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:29.212+0000 7f8fcf7fe640 10 client.15354 handle_command_reply: tid=0 2024-09-19T06:09:29.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:29.212+0000 7f8ff8d8c740 1 client.15354 shutdown 2024-09-19T06:09:29.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:29.212+0000 7f8ff8d8c740 1 -- 172.21.15.37:0/1882287676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561d3442e760 msgr2=0x561d3443da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:29.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:29.212+0000 7f8ff8d8c740 1 --2- 172.21.15.37:0/1882287676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561d3442e760 0x561d3443da10 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f8fe4009680 tx=0x7f8fe0005490 comp rx=0 tx=0).stop 2024-09-19T06:09:29.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:29.212+0000 7f8ff8d8c740 1 -- 172.21.15.37:0/1882287676 shutdown_connections 2024-09-19T06:09:29.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:29.212+0000 7f8ff8d8c740 1 --2- 172.21.15.37:0/1882287676 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x561d34449710 0x561d344b6f30 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:29.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:29.212+0000 7f8ff8d8c740 1 --2- 172.21.15.37:0/1882287676 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561d3442f080 0x561d3443df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:29.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:29.212+0000 7f8ff8d8c740 1 --2- 172.21.15.37:0/1882287676 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x561d34439940 0x561d344b3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:29.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:29.212+0000 7f8ff8d8c740 1 --2- 172.21.15.37:0/1882287676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561d3442e760 0x561d3443da10 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:29.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:29.212+0000 7f8fcf7fe640 0 client.15354 ms_handle_reset on v2:172.21.15.99:6838/3404812329 2024-09-19T06:09:29.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:29.212+0000 7f8ff8d8c740 1 -- 172.21.15.37:0/1882287676 >> 172.21.15.37:0/1882287676 conn(0x561d3442acf0 msgr2=0x561d34429e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:29.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:29.212+0000 7f8ff8d8c740 1 -- 172.21.15.37:0/1882287676 shutdown_connections 2024-09-19T06:09:29.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:29.212+0000 7f8ff8d8c740 1 -- 172.21.15.37:0/1882287676 wait complete. 2024-09-19T06:09:29.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:29.212+0000 7f8ff8d8c740 20 client.15354 trim_cache size 0 max 16384 2024-09-19T06:09:29.217 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-19T06:09:29.217 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 20, 2024-09-19T06:09:29.217 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 24485, 2024-09-19T06:09:29.217 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 14, 2024-09-19T06:09:29.217 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": { 2024-09-19T06:09:29.217 INFO:teuthology.orchestra.run.smithi037.stdout: "264638b2": { 2024-09-19T06:09:29.217 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 14, 2024-09-19T06:09:29.218 INFO:teuthology.orchestra.run.smithi037.stdout: "age_ref": 0.0, 2024-09-19T06:09:29.218 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-09-19T06:09:29.218 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "QUIESCED", 2024-09-19T06:09:29.218 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-09-19T06:09:29.218 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:29.218 INFO:teuthology.orchestra.run.smithi037.stdout: "timeout": 90.0, 2024-09-19T06:09:29.218 INFO:teuthology.orchestra.run.smithi037.stdout: "expiration": 136.6, 2024-09-19T06:09:29.218 INFO:teuthology.orchestra.run.smithi037.stdout: "members": { 2024-09-19T06:09:29.218 INFO:teuthology.orchestra.run.smithi037.stdout: "file:/": { 2024-09-19T06:09:29.218 INFO:teuthology.orchestra.run.smithi037.stdout: "excluded": false, 2024-09-19T06:09:29.218 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-09-19T06:09:29.218 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "QUIESCED", 2024-09-19T06:09:29.219 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-09-19T06:09:29.219 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:29.219 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:29.219 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:29.219 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:29.219 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:29.219 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-19T06:09:29.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:29.213+0000 7f8ff69b3640 1 -- 172.21.15.37:0/3795920159 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f8fd80a3240 msgr2=0x7f8fd80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:29.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:29.213+0000 7f8ff69b3640 1 --2- 172.21.15.37:0/3795920159 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f8fd80a3240 0x7f8fd80a5700 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8fe800dfd0 tx=0x7f8fe8004020 comp rx=0 tx=0).stop 2024-09-19T06:09:29.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:29.213+0000 7f8ff69b3640 1 -- 172.21.15.37:0/3795920159 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ff010c170 msgr2=0x7f8ff0101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:29.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:29.213+0000 7f8ff69b3640 1 --2- 172.21.15.37:0/3795920159 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ff010c170 0x7f8ff0101420 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f8fe8009fd0 tx=0x7f8fe800b260 comp rx=0 tx=0).stop 2024-09-19T06:09:29.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:29.213+0000 7f8ff69b3640 1 -- 172.21.15.37:0/3795920159 shutdown_connections 2024-09-19T06:09:29.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:29.213+0000 7f8ff69b3640 1 --2- 172.21.15.37:0/3795920159 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f8fd80a3240 0x7f8fd80a5700 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:29.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:29.213+0000 7f8ff69b3640 1 --2- 172.21.15.37:0/3795920159 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ff010c170 0x7f8ff0101420 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:29.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:29.213+0000 7f8ff69b3640 1 --2- 172.21.15.37:0/3795920159 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ff0103660 0x7f8ff0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:29.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:29.213+0000 7f8ff69b3640 1 --2- 172.21.15.37:0/3795920159 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ff0102d40 0x7f8ff01009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:29.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:29.213+0000 7f8ff69b3640 1 -- 172.21.15.37:0/3795920159 >> 172.21.15.37:0/3795920159 conn(0x7f8ff00fc7a0 msgr2=0x7f8ff00fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:29.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:29.213+0000 7f8ff69b3640 1 -- 172.21.15.37:0/3795920159 shutdown_connections 2024-09-19T06:09:29.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:29.213+0000 7f8ff69b3640 1 -- 172.21.15.37:0/3795920159 wait complete. 2024-09-19T06:09:30.071 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '264638b2', quiesce took 8.9 seconds. Will release after: 7.700000000000001 2024-09-19T06:09:30.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:09:30 smithi099 ceph-mon[35300]: pgmap v449: 129 pgs: 129 active+clean; 154 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 389 op/s 2024-09-19T06:09:30.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:09:30 smithi117 ceph-mon[35050]: pgmap v449: 129 pgs: 129 active+clean; 154 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 389 op/s 2024-09-19T06:09:31.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:09:30 smithi037 ceph-mon[31211]: pgmap v449: 129 pgs: 129 active+clean; 154 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 389 op/s 2024-09-19T06:09:32.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:09:32 smithi099 ceph-mon[35300]: pgmap v450: 129 pgs: 129 active+clean; 153 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 335 op/s 2024-09-19T06:09:32.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:09:32 smithi117 ceph-mon[35050]: pgmap v450: 129 pgs: 129 active+clean; 153 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 335 op/s 2024-09-19T06:09:33.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:09:32 smithi037 ceph-mon[31211]: pgmap v450: 129 pgs: 129 active+clean; 153 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 335 op/s 2024-09-19T06:09:34.939 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:09:34 smithi099 ceph-mon[35300]: pgmap v451: 129 pgs: 129 active+clean; 155 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 417 op/s 2024-09-19T06:09:34.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:09:34 smithi117 ceph-mon[35050]: pgmap v451: 129 pgs: 129 active+clean; 155 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 417 op/s 2024-09-19T06:09:35.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:09:34 smithi037 ceph-mon[31211]: pgmap v451: 129 pgs: 129 active+clean; 155 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 417 op/s 2024-09-19T06:09:36.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:09:36 smithi099 ceph-mon[35300]: pgmap v452: 129 pgs: 129 active+clean; 155 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 281 op/s 2024-09-19T06:09:36.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:09:36 smithi117 ceph-mon[35050]: pgmap v452: 129 pgs: 129 active+clean; 155 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 281 op/s 2024-09-19T06:09:37.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:09:36 smithi037 ceph-mon[31211]: pgmap v452: 129 pgs: 129 active+clean; 155 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 281 op/s 2024-09-19T06:09:37.772 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:09:38.044 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:09:38.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:38.521+0000 7fc177d1a640 1 -- 172.21.15.37:0/1860920331 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc170101440 msgr2=0x7fc17010df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:38.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:38.521+0000 7fc177d1a640 1 --2- 172.21.15.37:0/1860920331 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc170101440 0x7fc17010df30 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fc164009900 tx=0x7fc16402a410 comp rx=0 tx=0).stop 2024-09-19T06:09:38.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:38.521+0000 7fc177d1a640 1 -- 172.21.15.37:0/1860920331 shutdown_connections 2024-09-19T06:09:38.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:38.521+0000 7fc177d1a640 1 --2- 172.21.15.37:0/1860920331 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc17010e500 0x7fc170110910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:38.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:38.521+0000 7fc177d1a640 1 --2- 172.21.15.37:0/1860920331 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc170101440 0x7fc17010df30 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:38.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:38.521+0000 7fc177d1a640 1 --2- 172.21.15.37:0/1860920331 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc170100b20 0x7fc170100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:38.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:38.521+0000 7fc177d1a640 1 -- 172.21.15.37:0/1860920331 >> 172.21.15.37:0/1860920331 conn(0x7fc1700fc7d0 msgr2=0x7fc1700febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:38.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:38.521+0000 7fc177d1a640 1 -- 172.21.15.37:0/1860920331 shutdown_connections 2024-09-19T06:09:38.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:38.521+0000 7fc177d1a640 1 -- 172.21.15.37:0/1860920331 wait complete. 2024-09-19T06:09:38.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:38.521+0000 7fc177d1a640 1 Processor -- start 2024-09-19T06:09:38.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:38.521+0000 7fc177d1a640 1 -- start start 2024-09-19T06:09:38.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:38.522+0000 7fc177d1a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc170100b20 0x7fc17019a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:38.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:38.522+0000 7fc177d1a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc170101440 0x7fc17019ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:38.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:38.522+0000 7fc177d1a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc17010e500 0x7fc17019f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:38.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:38.522+0000 7fc177d1a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc170114250 con 0x7fc17010e500 2024-09-19T06:09:38.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:38.522+0000 7fc177d1a640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc1701140d0 con 0x7fc170101440 2024-09-19T06:09:38.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:38.522+0000 7fc177d1a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc1701143d0 con 0x7fc170100b20 2024-09-19T06:09:38.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:38.522+0000 7fc1762b7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc17010e500 0x7fc17019f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:38.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:38.522+0000 7fc1762b7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc17010e500 0x7fc17019f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45802/0 (socket says 172.21.15.37:45802) 2024-09-19T06:09:38.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:38.522+0000 7fc1762b7640 1 -- 172.21.15.37:0/2041103865 learned_addr learned my addr 172.21.15.37:0/2041103865 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:09:38.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:38.522+0000 7fc175ab6640 1 --2- 172.21.15.37:0/2041103865 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc170100b20 0x7fc17019a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:38.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:38.522+0000 7fc1752b5640 1 --2- 172.21.15.37:0/2041103865 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc170101440 0x7fc17019ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:38.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:38.522+0000 7fc1762b7640 1 -- 172.21.15.37:0/2041103865 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc170100b20 msgr2=0x7fc17019a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:38.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:38.522+0000 7fc1762b7640 1 --2- 172.21.15.37:0/2041103865 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc170100b20 0x7fc17019a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:38.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:38.522+0000 7fc1762b7640 1 -- 172.21.15.37:0/2041103865 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc170101440 msgr2=0x7fc17019ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:38.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:38.522+0000 7fc1762b7640 1 --2- 172.21.15.37:0/2041103865 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc170101440 0x7fc17019ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:38.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:38.522+0000 7fc1762b7640 1 -- 172.21.15.37:0/2041103865 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc17019f6e0 con 0x7fc17010e500 2024-09-19T06:09:38.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:38.522+0000 7fc1752b5640 1 --2- 172.21.15.37:0/2041103865 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc170101440 0x7fc17019ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:09:38.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:38.522+0000 7fc1762b7640 1 --2- 172.21.15.37:0/2041103865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc17010e500 0x7fc17019f000 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc16800c970 tx=0x7fc16800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:38.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:38.523+0000 7fc16effd640 1 -- 172.21.15.37:0/2041103865 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc168007bb0 con 0x7fc17010e500 2024-09-19T06:09:38.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:38.523+0000 7fc16effd640 1 -- 172.21.15.37:0/2041103865 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc168007d50 con 0x7fc17010e500 2024-09-19T06:09:38.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:38.523+0000 7fc177d1a640 1 -- 172.21.15.37:0/2041103865 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc17019f9d0 con 0x7fc17010e500 2024-09-19T06:09:38.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:38.523+0000 7fc16effd640 1 -- 172.21.15.37:0/2041103865 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc168018800 con 0x7fc17010e500 2024-09-19T06:09:38.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:38.523+0000 7fc177d1a640 1 -- 172.21.15.37:0/2041103865 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1701a72b0 con 0x7fc17010e500 2024-09-19T06:09:38.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:38.524+0000 7fc177d1a640 1 -- 172.21.15.37:0/2041103865 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc170100f00 con 0x7fc17010e500 2024-09-19T06:09:38.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:38.525+0000 7fc16effd640 1 -- 172.21.15.37:0/2041103865 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fc16800f450 con 0x7fc17010e500 2024-09-19T06:09:38.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:38.526+0000 7fc16effd640 1 --2- 172.21.15.37:0/2041103865 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fc1580a3240 0x7fc1580a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:38.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:38.526+0000 7fc175ab6640 1 --2- 172.21.15.37:0/2041103865 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fc1580a3240 0x7fc1580a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:38.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:38.526+0000 7fc16effd640 1 -- 172.21.15.37:0/2041103865 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9121+0+0 (secure 0 0 0) 0x7fc1680cfd50 con 0x7fc17010e500 2024-09-19T06:09:38.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:38.526+0000 7fc175ab6640 1 --2- 172.21.15.37:0/2041103865 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fc1580a3240 0x7fc1580a5700 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc160005fd0 tx=0x7fc160009680 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:38.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:38.529+0000 7fc16effd640 1 -- 172.21.15.37:0/2041103865 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc168014030 con 0x7fc17010e500 2024-09-19T06:09:38.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:38.742+0000 7fc177d1a640 1 -- 172.21.15.37:0/2041103865 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc170109600 con 0x7fc17010e500 2024-09-19T06:09:38.745 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:09:38 smithi037 ceph-mon[31211]: pgmap v453: 129 pgs: 129 active+clean; 155 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 903 KiB/s rd, 908 KiB/s wr, 248 op/s 2024-09-19T06:09:38.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:38.743+0000 7fc16effd640 1 -- 172.21.15.37:0/2041103865 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11842 (secure 0 0 0) 0x7fc16809c720 con 0x7fc17010e500 2024-09-19T06:09:38.746 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T06:09:38.746 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"btime":"2024-09-19T06:04:42:531480+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14514,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2864247978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2864247978},{"type":"v1","addr":"172.21.15.37:6835","nonce":2864247978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14526,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/633000932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":633000932},{"type":"v1","addr":"172.21.15.37:6837","nonce":633000932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14574,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/3753800615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":3753800615},{"type":"v1","addr":"172.21.15.37:6839","nonce":3753800615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/2718998355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":2718998355},{"type":"v1","addr":"172.21.15.37:6841","nonce":2718998355}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6833/866590207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":866590207},{"type":"v1","addr":"172.21.15.99:6833","nonce":866590207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3898668400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3898668400},{"type":"v1","addr":"172.21.15.117:6833","nonce":3898668400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2650673320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2650673320},{"type":"v1","addr":"172.21.15.99:6835","nonce":2650673320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1097471349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1097471349},{"type":"v1","addr":"172.21.15.117:6835","nonce":1097471349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24457,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1001392672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1001392672},{"type":"v1","addr":"172.21.15.117:6837","nonce":1001392672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/23570935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":23570935},{"type":"v1","addr":"172.21.15.99:6837","nonce":23570935}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:04:06.253034+0000","modified":"2024-09-19T06:04:42.196783+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24485},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24478":{"gid":24478,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6839/1269518339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":1269518339},{"type":"v1","addr":"172.21.15.117:6839","nonce":1269518339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.99:6839/3404812329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":3404812329},{"type":"v1","addr":"172.21.15.99:6839","nonce":3404812329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24485,"qdb_cluster":[24485]},"id":1}]} 2024-09-19T06:09:38.746 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 20 2024-09-19T06:09:38.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:38.745+0000 7fc177d1a640 1 -- 172.21.15.37:0/2041103865 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fc1580a3240 msgr2=0x7fc1580a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:38.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:38.745+0000 7fc177d1a640 1 --2- 172.21.15.37:0/2041103865 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fc1580a3240 0x7fc1580a5700 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc160005fd0 tx=0x7fc160009680 comp rx=0 tx=0).stop 2024-09-19T06:09:38.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:38.745+0000 7fc177d1a640 1 -- 172.21.15.37:0/2041103865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc17010e500 msgr2=0x7fc17019f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:38.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:38.745+0000 7fc177d1a640 1 --2- 172.21.15.37:0/2041103865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc17010e500 0x7fc17019f000 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc16800c970 tx=0x7fc16800ce30 comp rx=0 tx=0).stop 2024-09-19T06:09:38.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:38.746+0000 7fc177d1a640 1 -- 172.21.15.37:0/2041103865 shutdown_connections 2024-09-19T06:09:38.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:38.746+0000 7fc177d1a640 1 --2- 172.21.15.37:0/2041103865 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fc1580a3240 0x7fc1580a5700 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:38.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:38.746+0000 7fc177d1a640 1 --2- 172.21.15.37:0/2041103865 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc170101440 0x7fc17019ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:38.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:38.746+0000 7fc177d1a640 1 --2- 172.21.15.37:0/2041103865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc17010e500 0x7fc17019f000 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:38.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:38.746+0000 7fc177d1a640 1 --2- 172.21.15.37:0/2041103865 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc170100b20 0x7fc17019a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:38.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:38.746+0000 7fc177d1a640 1 -- 172.21.15.37:0/2041103865 >> 172.21.15.37:0/2041103865 conn(0x7fc1700fc7d0 msgr2=0x7fc1700febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:38.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:38.746+0000 7fc177d1a640 1 -- 172.21.15.37:0/2041103865 shutdown_connections 2024-09-19T06:09:38.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:38.746+0000 7fc177d1a640 1 -- 172.21.15.37:0/2041103865 wait complete. 2024-09-19T06:09:38.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:09:38 smithi099 ceph-mon[35300]: pgmap v453: 129 pgs: 129 active+clean; 155 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 903 KiB/s rd, 908 KiB/s wr, 248 op/s 2024-09-19T06:09:38.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:09:38 smithi117 ceph-mon[35050]: pgmap v453: 129 pgs: 129 active+clean; 155 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 903 KiB/s rd, 908 KiB/s wr, 248 op/s 2024-09-19T06:09:39.504 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24485 quiesce db --set-id 264638b2 --release --await' 2024-09-19T06:09:39.504 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24485 quiesce db --set-id 264638b2 --release --await 2024-09-19T06:09:39.767 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:09:39.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:09:39 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/2041103865' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:09:39.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:09:39 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/2041103865' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:09:39.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:09:39 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/2041103865' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:09:40.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.287+0000 7fc7bf060640 1 -- 172.21.15.37:0/2957934443 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7b81027a0 msgr2=0x7fc7b81067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:40.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.287+0000 7fc7bf060640 1 --2- 172.21.15.37:0/2957934443 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7b81027a0 0x7fc7b81067f0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac009900 tx=0x7fc7ac02a410 comp rx=0 tx=0).stop 2024-09-19T06:09:40.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.287+0000 7fc7bf060640 1 -- 172.21.15.37:0/2957934443 shutdown_connections 2024-09-19T06:09:40.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.287+0000 7fc7bf060640 1 --2- 172.21.15.37:0/2957934443 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7b8106f20 0x7fc7b810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:40.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.287+0000 7fc7bf060640 1 --2- 172.21.15.37:0/2957934443 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7b81027a0 0x7fc7b81067f0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:40.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.287+0000 7fc7bf060640 1 --2- 172.21.15.37:0/2957934443 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc7b8101df0 0x7fc7b81021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:40.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.287+0000 7fc7bf060640 1 -- 172.21.15.37:0/2957934443 >> 172.21.15.37:0/2957934443 conn(0x7fc7b80fd8b0 msgr2=0x7fc7b80ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:40.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.287+0000 7fc7bf060640 1 -- 172.21.15.37:0/2957934443 shutdown_connections 2024-09-19T06:09:40.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.287+0000 7fc7bf060640 1 -- 172.21.15.37:0/2957934443 wait complete. 2024-09-19T06:09:40.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.288+0000 7fc7bf060640 1 Processor -- start 2024-09-19T06:09:40.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.288+0000 7fc7bf060640 1 -- start start 2024-09-19T06:09:40.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.288+0000 7fc7bf060640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7b8101df0 0x7fc7b81984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:40.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.288+0000 7fc7bf060640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7b81027a0 0x7fc7b81989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:40.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.288+0000 7fc7bf060640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc7b8106f20 0x7fc7b819cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:40.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.288+0000 7fc7bf060640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b8111fa0 con 0x7fc7b81027a0 2024-09-19T06:09:40.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.288+0000 7fc7bf060640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b8111e20 con 0x7fc7b8106f20 2024-09-19T06:09:40.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.288+0000 7fc7bf060640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b8112120 con 0x7fc7b8101df0 2024-09-19T06:09:40.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.288+0000 7fc7b7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7b81027a0 0x7fc7b81989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:40.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.288+0000 7fc7b7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7b81027a0 0x7fc7b81989e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45812/0 (socket says 172.21.15.37:45812) 2024-09-19T06:09:40.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.288+0000 7fc7b7fff640 1 -- 172.21.15.37:0/2842388972 learned_addr learned my addr 172.21.15.37:0/2842388972 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:09:40.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.288+0000 7fc7bcdfc640 1 --2- 172.21.15.37:0/2842388972 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7b8101df0 0x7fc7b81984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:40.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.289+0000 7fc7bd5fd640 1 --2- 172.21.15.37:0/2842388972 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc7b8106f20 0x7fc7b819cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:40.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.289+0000 7fc7b7fff640 1 -- 172.21.15.37:0/2842388972 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7b8101df0 msgr2=0x7fc7b81984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:40.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.289+0000 7fc7b7fff640 1 --2- 172.21.15.37:0/2842388972 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7b8101df0 0x7fc7b81984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:40.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.289+0000 7fc7b7fff640 1 -- 172.21.15.37:0/2842388972 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc7b8106f20 msgr2=0x7fc7b819cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:40.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.289+0000 7fc7b7fff640 1 --2- 172.21.15.37:0/2842388972 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc7b8106f20 0x7fc7b819cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:40.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.289+0000 7fc7b7fff640 1 -- 172.21.15.37:0/2842388972 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7b819d450 con 0x7fc7b81027a0 2024-09-19T06:09:40.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.289+0000 7fc7b7fff640 1 --2- 172.21.15.37:0/2842388972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7b81027a0 0x7fc7b81989e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac006010 tx=0x7fc7ac0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:40.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.289+0000 7fc7b5ffb640 1 -- 172.21.15.37:0/2842388972 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7ac03f030 con 0x7fc7b81027a0 2024-09-19T06:09:40.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.289+0000 7fc7b5ffb640 1 -- 172.21.15.37:0/2842388972 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7ac003ce0 con 0x7fc7b81027a0 2024-09-19T06:09:40.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.289+0000 7fc7bf060640 1 -- 172.21.15.37:0/2842388972 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7b819d6e0 con 0x7fc7b81027a0 2024-09-19T06:09:40.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.289+0000 7fc7b5ffb640 1 -- 172.21.15.37:0/2842388972 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7ac035070 con 0x7fc7b81027a0 2024-09-19T06:09:40.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.289+0000 7fc7bf060640 1 -- 172.21.15.37:0/2842388972 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7b81a5020 con 0x7fc7b81027a0 2024-09-19T06:09:40.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.292+0000 7fc7b5ffb640 1 -- 172.21.15.37:0/2842388972 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fc7ac042030 con 0x7fc7b81027a0 2024-09-19T06:09:40.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.292+0000 7fc7c1439740 1 Processor -- start 2024-09-19T06:09:40.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.292+0000 7fc7c1439740 1 -- start start 2024-09-19T06:09:40.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.292+0000 7fc7c1439740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a12609c060 0x55a12609c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:40.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.292+0000 7fc7c1439740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a12609c980 0x55a1260a6d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:40.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.292+0000 7fc7c1439740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1260a7240 0x55a1260a9630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:40.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.292+0000 7fc7c1439740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a126001620 con 0x55a12609c980 2024-09-19T06:09:40.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.292+0000 7fc7c1439740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55a125fa8e50 con 0x55a12609c060 2024-09-19T06:09:40.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.292+0000 7fc7c1439740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55a125ffd5e0 con 0x55a1260a7240 2024-09-19T06:09:40.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.292+0000 7fc7b5ffb640 1 --2- 172.21.15.37:0/2842388972 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fc7a00a3240 0x7fc7a00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:40.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.292+0000 7fc7bcdfc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a12609c980 0x55a1260a6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:40.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.292+0000 7fc7bcdfc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a12609c980 0x55a1260a6d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45822/0 (socket says 172.21.15.37:45822) 2024-09-19T06:09:40.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.292+0000 7fc7bcdfc640 1 -- 172.21.15.37:0/1623434452 learned_addr learned my addr 172.21.15.37:0/1623434452 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:09:40.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.293+0000 7fc7bd5fd640 1 --2- 172.21.15.37:0/2842388972 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fc7a00a3240 0x7fc7a00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:40.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.293+0000 7fc7bd5fd640 1 --2- 172.21.15.37:0/1623434452 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a12609c060 0x55a12609c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:40.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.293+0000 7fc7b5ffb640 1 -- 172.21.15.37:0/2842388972 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9121+0+0 (secure 0 0 0) 0x7fc7ac0f0270 con 0x7fc7b81027a0 2024-09-19T06:09:40.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.293+0000 7fc7b7fff640 1 --2- 172.21.15.37:0/1623434452 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1260a7240 0x55a1260a9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:40.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.293+0000 7fc7bcdfc640 1 -- 172.21.15.37:0/1623434452 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1260a7240 msgr2=0x55a1260a9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:40.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.293+0000 7fc7bcdfc640 1 --2- 172.21.15.37:0/1623434452 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1260a7240 0x55a1260a9630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:40.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.293+0000 7fc7bcdfc640 1 -- 172.21.15.37:0/1623434452 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a12609c060 msgr2=0x55a12609c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:40.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.293+0000 7fc7bcdfc640 1 --2- 172.21.15.37:0/1623434452 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a12609c060 0x55a12609c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:40.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.293+0000 7fc7bcdfc640 1 -- 172.21.15.37:0/1623434452 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a125f99d40 con 0x55a12609c980 2024-09-19T06:09:40.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.293+0000 7fc7bd5fd640 1 --2- 172.21.15.37:0/1623434452 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a12609c060 0x55a12609c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:09:40.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.293+0000 7fc7bcdfc640 1 --2- 172.21.15.37:0/1623434452 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a12609c980 0x55a1260a6d00 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fc7a800bd10 tx=0x7fc7a80107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c96d9be5d078dff1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:40.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.293+0000 7fc7bd5fd640 1 --2- 172.21.15.37:0/2842388972 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fc7a00a3240 0x7fc7a00a5700 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc7b00070b0 tx=0x7fc7b0007040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:40.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.293+0000 7fc79effd640 1 -- 172.21.15.37:0/1623434452 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a8004030 con 0x55a12609c980 2024-09-19T06:09:40.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.293+0000 7fc79effd640 1 -- 172.21.15.37:0/1623434452 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7a80041d0 con 0x55a12609c980 2024-09-19T06:09:40.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.293+0000 7fc79effd640 1 -- 172.21.15.37:0/1623434452 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a80117e0 con 0x55a12609c980 2024-09-19T06:09:40.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.294+0000 7fc7c1439740 1 -- 172.21.15.37:0/1623434452 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a12609c980 msgr2=0x55a1260a6d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:40.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.294+0000 7fc7c1439740 1 --2- 172.21.15.37:0/1623434452 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a12609c980 0x55a1260a6d00 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fc7a800bd10 tx=0x7fc7a80107a0 comp rx=0 tx=0).stop 2024-09-19T06:09:40.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.294+0000 7fc7c1439740 1 -- 172.21.15.37:0/1623434452 shutdown_connections 2024-09-19T06:09:40.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.294+0000 7fc7c1439740 1 --2- 172.21.15.37:0/1623434452 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1260a7240 0x55a1260a9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:40.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.294+0000 7fc7c1439740 1 --2- 172.21.15.37:0/1623434452 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a12609c980 0x55a1260a6d00 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:40.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.294+0000 7fc7c1439740 1 --2- 172.21.15.37:0/1623434452 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a12609c060 0x55a12609c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:40.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.294+0000 7fc7c1439740 1 -- 172.21.15.37:0/1623434452 >> 172.21.15.37:0/1623434452 conn(0x55a1260985f0 msgr2=0x55a1260989d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:40.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.294+0000 7fc7c1439740 1 -- 172.21.15.37:0/1623434452 shutdown_connections 2024-09-19T06:09:40.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.294+0000 7fc7c1439740 1 -- 172.21.15.37:0/1623434452 wait complete. 2024-09-19T06:09:40.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.294+0000 7fc7c1439740 1 -- start start 2024-09-19T06:09:40.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.294+0000 7fc7c1439740 1 Processor -- start 2024-09-19T06:09:40.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.295+0000 7fc7c1439740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a12609c060 0x55a1260a4150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:40.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.295+0000 7fc7c1439740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a12609c980 0x55a1260a4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:40.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.295+0000 7fc7c1439740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a1260a7240 0x55a1260a4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:40.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.295+0000 7fc7c1439740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a1260a9e10 con 0x55a12609c060 2024-09-19T06:09:40.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.295+0000 7fc7c1439740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55a125f89f10 con 0x55a1260a7240 2024-09-19T06:09:40.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.295+0000 7fc7c1439740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55a1260a9f90 con 0x55a12609c980 2024-09-19T06:09:40.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.295+0000 7fc7c1439740 10 client.0 _ll_register_callbacks cb 0x55a125faddb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:09:40.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.295+0000 7fc7bcdfc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a12609c060 0x55a1260a4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:40.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.295+0000 7fc7bcdfc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a12609c060 0x55a1260a4150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45824/0 (socket says 172.21.15.37:45824) 2024-09-19T06:09:40.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.295+0000 7fc7bcdfc640 1 -- 172.21.15.37:0/3982119010 learned_addr learned my addr 172.21.15.37:0/3982119010 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:09:40.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.295+0000 7fc7b7fff640 1 --2- 172.21.15.37:0/3982119010 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a12609c980 0x55a1260a4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:40.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.295+0000 7fc7bd5fd640 1 --2- 172.21.15.37:0/3982119010 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a1260a7240 0x55a1260a4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:40.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.295+0000 7fc7bcdfc640 1 -- 172.21.15.37:0/3982119010 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a12609c980 msgr2=0x55a1260a4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:40.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.295+0000 7fc7bcdfc640 1 --2- 172.21.15.37:0/3982119010 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a12609c980 0x55a1260a4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:40.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.295+0000 7fc7bcdfc640 1 -- 172.21.15.37:0/3982119010 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a1260a7240 msgr2=0x55a1260a4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:40.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.295+0000 7fc7bcdfc640 1 --2- 172.21.15.37:0/3982119010 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a1260a7240 0x55a1260a4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:40.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.295+0000 7fc7bcdfc640 1 -- 172.21.15.37:0/3982119010 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a125d10580 con 0x55a12609c060 2024-09-19T06:09:40.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.295+0000 7fc7bd5fd640 1 --2- 172.21.15.37:0/3982119010 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a1260a7240 0x55a1260a4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:09:40.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.296+0000 7fc7bcdfc640 1 --2- 172.21.15.37:0/3982119010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a12609c060 0x55a1260a4150 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fc7a80114a0 tx=0x7fc7a800b970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee0143b4f206f797 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:40.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.296+0000 7fc797fff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-19T06:09:40.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.296+0000 7fc797fff640 1 -- 172.21.15.37:0/3982119010 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a8029060 con 0x55a12609c060 2024-09-19T06:09:40.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.296+0000 7fc797fff640 1 -- 172.21.15.37:0/3982119010 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9121+0+0 (secure 0 0 0) 0x7fc7a80035f0 con 0x55a12609c060 2024-09-19T06:09:40.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.296+0000 7fc7c1439740 1 -- 172.21.15.37:0/3982119010 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7a80041d0 con 0x55a12609c060 2024-09-19T06:09:40.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.296+0000 7fc797fff640 1 -- 172.21.15.37:0/3982119010 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fc7a8030050 con 0x55a12609c060 2024-09-19T06:09:40.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.296+0000 7fc7c1439740 10 client.15372 fetch_fsmap learned FSMap version 20 2024-09-19T06:09:40.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.296+0000 7fc7c1439740 1 -- 172.21.15.37:0/3982119010 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55a125dda960 con 0x55a12609c060 2024-09-19T06:09:40.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.296+0000 7fc797fff640 1 -- 172.21.15.37:0/3982119010 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7a80041d0 con 0x55a12609c060 2024-09-19T06:09:40.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.296+0000 7fc797fff640 1 -- 172.21.15.37:0/3982119010 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 20) ==== 8338+0+0 (secure 0 0 0) 0x7fc7a80046c0 con 0x55a12609c060 2024-09-19T06:09:40.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.296+0000 7fc7c1439740 10 client.15372 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:09:40.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.296+0000 7fc7c1439740 10 client.15372 resolve_mds: validated gid 24485 aka daemon mds.b 2024-09-19T06:09:40.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.297+0000 7fc7c1439740 20 client.15372 populate_metadata read hostname 'smithi037' 2024-09-19T06:09:40.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.297+0000 7fc7c1439740 1 --2- 172.21.15.37:0/3982119010 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x55a1260b6d80 0x55a1260b9170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:40.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.297+0000 7fc7c1439740 4 client.15372 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:09:40.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.297+0000 7fc7c1439740 1 -- 172.21.15.37:0/3982119010 --> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a12600eb90 con 0x55a1260b6d80 2024-09-19T06:09:40.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.297+0000 7fc7b7fff640 1 --2- 172.21.15.37:0/3982119010 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x55a1260b6d80 0x55a1260b9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:40.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.297+0000 7fc7b7fff640 1 --2- 172.21.15.37:0/3982119010 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x55a1260b6d80 0x55a1260b9170 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8a06169103841a2 server_cookie=1dd530d2b79c763f in_seq=0 out_seq=0 2024-09-19T06:09:40.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.297+0000 7fc797fff640 10 client.15372 ms_handle_connect on v2:172.21.15.99:6838/3404812329 2024-09-19T06:09:40.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.298+0000 7fc797fff640 1 -- 172.21.15.37:0/3982119010 <== mds.0 v2:172.21.15.99:6838/3404812329 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a12600eb90 con 0x55a1260b6d80 2024-09-19T06:09:40.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.298+0000 7fc797fff640 10 client.15372 handle_command_reply: tid=0 2024-09-19T06:09:40.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.298+0000 7fc7c1439740 1 client.15372 shutdown 2024-09-19T06:09:40.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.298+0000 7fc7c1439740 1 -- 172.21.15.37:0/3982119010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a12609c060 msgr2=0x55a1260a4150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:40.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.298+0000 7fc7c1439740 1 --2- 172.21.15.37:0/3982119010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a12609c060 0x55a1260a4150 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fc7a80114a0 tx=0x7fc7a800b970 comp rx=0 tx=0).stop 2024-09-19T06:09:40.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.298+0000 7fc7c1439740 1 -- 172.21.15.37:0/3982119010 shutdown_connections 2024-09-19T06:09:40.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.298+0000 7fc7c1439740 1 --2- 172.21.15.37:0/3982119010 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x55a1260b6d80 0x55a1260b9170 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:40.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.298+0000 7fc7c1439740 1 --2- 172.21.15.37:0/3982119010 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a1260a7240 0x55a1260a4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:40.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.298+0000 7fc7c1439740 1 --2- 172.21.15.37:0/3982119010 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a12609c980 0x55a1260a4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:40.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.298+0000 7fc797fff640 0 client.15372 ms_handle_reset on v2:172.21.15.99:6838/3404812329 2024-09-19T06:09:40.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.298+0000 7fc7c1439740 1 --2- 172.21.15.37:0/3982119010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a12609c060 0x55a1260a4150 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:40.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.298+0000 7fc7c1439740 1 -- 172.21.15.37:0/3982119010 >> 172.21.15.37:0/3982119010 conn(0x55a1260985f0 msgr2=0x55a126097750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:40.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.298+0000 7fc7c1439740 1 -- 172.21.15.37:0/3982119010 shutdown_connections 2024-09-19T06:09:40.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.298+0000 7fc7c1439740 1 -- 172.21.15.37:0/3982119010 wait complete. 2024-09-19T06:09:40.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.298+0000 7fc7c1439740 20 client.15372 trim_cache size 0 max 16384 2024-09-19T06:09:40.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.315+0000 7fc7c1439740 1 Processor -- start 2024-09-19T06:09:40.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.315+0000 7fc7c1439740 1 -- start start 2024-09-19T06:09:40.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.315+0000 7fc7c1439740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a12609c060 0x55a1260a6020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:40.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.315+0000 7fc7c1439740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a12609c980 0x55a12609eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:40.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.315+0000 7fc7c1439740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a1260a7240 0x55a1260be710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:40.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.315+0000 7fc7c1439740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b81aaa80 con 0x55a1260a7240 2024-09-19T06:09:40.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.315+0000 7fc7c1439740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b81ad300 con 0x55a12609c980 2024-09-19T06:09:40.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.316+0000 7fc7c1439740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b81ab0f0 con 0x55a12609c060 2024-09-19T06:09:40.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.316+0000 7fc7bd5fd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a1260a7240 0x55a1260be710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:40.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.316+0000 7fc7bd5fd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a1260a7240 0x55a1260be710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45832/0 (socket says 172.21.15.37:45832) 2024-09-19T06:09:40.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.316+0000 7fc7bd5fd640 1 -- 172.21.15.37:0/2456168639 learned_addr learned my addr 172.21.15.37:0/2456168639 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:09:40.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.316+0000 7fc7bcdfc640 1 --2- 172.21.15.37:0/2456168639 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a12609c060 0x55a1260a6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:40.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.316+0000 7fc7b7fff640 1 --2- 172.21.15.37:0/2456168639 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a12609c980 0x55a12609eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:40.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.316+0000 7fc7bd5fd640 1 -- 172.21.15.37:0/2456168639 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a12609c060 msgr2=0x55a1260a6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:40.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.316+0000 7fc7bd5fd640 1 --2- 172.21.15.37:0/2456168639 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a12609c060 0x55a1260a6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:40.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.316+0000 7fc7bd5fd640 1 -- 172.21.15.37:0/2456168639 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a12609c980 msgr2=0x55a12609eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:40.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.316+0000 7fc7bd5fd640 1 --2- 172.21.15.37:0/2456168639 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a12609c980 0x55a12609eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:40.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.316+0000 7fc7bd5fd640 1 -- 172.21.15.37:0/2456168639 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a126098090 con 0x55a1260a7240 2024-09-19T06:09:40.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.316+0000 7fc7bd5fd640 1 --2- 172.21.15.37:0/2456168639 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a1260a7240 0x55a1260be710 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0009e60 tx=0x7fc7b0009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af6cca5c6102955f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:40.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.316+0000 7fc79e7fc640 1 -- 172.21.15.37:0/2456168639 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b0014040 con 0x55a1260a7240 2024-09-19T06:09:40.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.316+0000 7fc79e7fc640 1 -- 172.21.15.37:0/2456168639 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7b002a070 con 0x55a1260a7240 2024-09-19T06:09:40.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.316+0000 7fc79e7fc640 1 -- 172.21.15.37:0/2456168639 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b0023420 con 0x55a1260a7240 2024-09-19T06:09:40.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.317+0000 7fc7c1439740 1 -- 172.21.15.37:0/2456168639 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a1260a7240 msgr2=0x55a1260be710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:40.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.317+0000 7fc7c1439740 1 --2- 172.21.15.37:0/2456168639 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a1260a7240 0x55a1260be710 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0009e60 tx=0x7fc7b0009650 comp rx=0 tx=0).stop 2024-09-19T06:09:40.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.317+0000 7fc7c1439740 1 -- 172.21.15.37:0/2456168639 shutdown_connections 2024-09-19T06:09:40.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.317+0000 7fc7c1439740 1 --2- 172.21.15.37:0/2456168639 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a12609c980 0x55a12609eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:40.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.317+0000 7fc7c1439740 1 --2- 172.21.15.37:0/2456168639 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a1260a7240 0x55a1260be710 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:40.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.317+0000 7fc7c1439740 1 --2- 172.21.15.37:0/2456168639 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a12609c060 0x55a1260a6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:40.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.317+0000 7fc7c1439740 1 -- 172.21.15.37:0/2456168639 >> 172.21.15.37:0/2456168639 conn(0x55a1260985f0 msgr2=0x55a126097750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:40.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.317+0000 7fc7c1439740 1 -- 172.21.15.37:0/2456168639 shutdown_connections 2024-09-19T06:09:40.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.317+0000 7fc7c1439740 1 -- 172.21.15.37:0/2456168639 wait complete. 2024-09-19T06:09:40.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.317+0000 7fc7c1439740 1 -- start start 2024-09-19T06:09:40.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.317+0000 7fc7c1439740 1 Processor -- start 2024-09-19T06:09:40.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.318+0000 7fc7c1439740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a12609c060 0x55a1260abab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:40.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.318+0000 7fc7c1439740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a12609c980 0x55a1260abff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:40.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.318+0000 7fc7c1439740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1260a7240 0x55a1261196a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:40.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.318+0000 7fc7c1439740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b81ab7c0 con 0x55a12609c980 2024-09-19T06:09:40.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.318+0000 7fc7c1439740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b81acc30 con 0x55a12609c060 2024-09-19T06:09:40.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.318+0000 7fc7c1439740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b81abe90 con 0x55a1260a7240 2024-09-19T06:09:40.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.318+0000 7fc7c1439740 10 client.0 _ll_register_callbacks cb 0x7fc7a8005d00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:09:40.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.318+0000 7fc7b7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a12609c980 0x55a1260abff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:40.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.318+0000 7fc7b7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a12609c980 0x55a1260abff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45836/0 (socket says 172.21.15.37:45836) 2024-09-19T06:09:40.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.318+0000 7fc7b7fff640 1 -- 172.21.15.37:0/1700997482 learned_addr learned my addr 172.21.15.37:0/1700997482 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:09:40.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.318+0000 7fc7bcdfc640 1 --2- 172.21.15.37:0/1700997482 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a12609c060 0x55a1260abab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:40.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.318+0000 7fc7bd5fd640 1 --2- 172.21.15.37:0/1700997482 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1260a7240 0x55a1261196a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:40.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.318+0000 7fc7b7fff640 1 -- 172.21.15.37:0/1700997482 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1260a7240 msgr2=0x55a1261196a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:40.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.318+0000 7fc7b7fff640 1 --2- 172.21.15.37:0/1700997482 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1260a7240 0x55a1261196a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:40.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.318+0000 7fc7b7fff640 1 -- 172.21.15.37:0/1700997482 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a12609c060 msgr2=0x55a1260abab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:40.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.318+0000 7fc7b7fff640 1 --2- 172.21.15.37:0/1700997482 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a12609c060 0x55a1260abab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:40.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.318+0000 7fc7b7fff640 1 -- 172.21.15.37:0/1700997482 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a126119d60 con 0x55a12609c980 2024-09-19T06:09:40.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.318+0000 7fc7b7fff640 1 --2- 172.21.15.37:0/1700997482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a12609c980 0x55a1260abff0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac005ab0 tx=0x7fc7ac005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cc59dacd0d0705b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:40.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.318+0000 7fc797fff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-19T06:09:40.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.318+0000 7fc797fff640 1 -- 172.21.15.37:0/1700997482 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7ac0eee60 con 0x55a12609c980 2024-09-19T06:09:40.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.318+0000 7fc797fff640 1 -- 172.21.15.37:0/1700997482 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9121+0+0 (secure 0 0 0) 0x7fc7ac0b8c90 con 0x55a12609c980 2024-09-19T06:09:40.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.318+0000 7fc7c1439740 1 -- 172.21.15.37:0/1700997482 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7b002a070 con 0x55a12609c980 2024-09-19T06:09:40.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.319+0000 7fc797fff640 1 -- 172.21.15.37:0/1700997482 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fc7ac049040 con 0x55a12609c980 2024-09-19T06:09:40.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.319+0000 7fc7c1439740 10 client.15378 fetch_fsmap learned FSMap version 20 2024-09-19T06:09:40.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.319+0000 7fc7c1439740 1 -- 172.21.15.37:0/1700997482 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55a1261222a0 con 0x55a12609c980 2024-09-19T06:09:40.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.319+0000 7fc797fff640 1 -- 172.21.15.37:0/1700997482 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7b002a070 con 0x55a12609c980 2024-09-19T06:09:40.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.319+0000 7fc797fff640 1 -- 172.21.15.37:0/1700997482 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 20) ==== 8338+0+0 (secure 0 0 0) 0x7fc7ac0bb100 con 0x55a12609c980 2024-09-19T06:09:40.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.319+0000 7fc7c1439740 10 client.15378 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:09:40.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.319+0000 7fc7c1439740 10 client.15378 resolve_mds: validated gid 24485 aka daemon mds.b 2024-09-19T06:09:40.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.319+0000 7fc7c1439740 20 client.15378 populate_metadata read hostname 'smithi037' 2024-09-19T06:09:40.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.319+0000 7fc7c1439740 1 --2- 172.21.15.37:0/1700997482 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x55a1261229c0 0x55a126124db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:40.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.319+0000 7fc7c1439740 4 client.15378 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "264638b2", "release": true, "await": true}] 2024-09-19T06:09:40.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.319+0000 7fc7c1439740 1 -- 172.21.15.37:0/1700997482 --> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] -- command(tid 0: {"prefix": "quiesce db", "set_id": "264638b2", "release": true, "await": true}) -- 0x55a1260090a0 con 0x55a1261229c0 2024-09-19T06:09:40.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.319+0000 7fc7bcdfc640 1 --2- 172.21.15.37:0/1700997482 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x55a1261229c0 0x55a126124db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:40.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.320+0000 7fc7bcdfc640 1 --2- 172.21.15.37:0/1700997482 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x55a1261229c0 0x55a126124db0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f09fbe474c90ea1 server_cookie=d43fb0f471f9ae61 in_seq=0 out_seq=0 2024-09-19T06:09:40.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.320+0000 7fc797fff640 10 client.15378 ms_handle_connect on v2:172.21.15.99:6838/3404812329 2024-09-19T06:09:40.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.451+0000 7fc797fff640 1 -- 172.21.15.37:0/1700997482 <== mds.0 v2:172.21.15.99:6838/3404812329 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55a1260090a0 con 0x55a1261229c0 2024-09-19T06:09:40.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.451+0000 7fc797fff640 10 client.15378 handle_command_reply: tid=0 2024-09-19T06:09:40.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.451+0000 7fc7c1439740 1 client.15378 shutdown 2024-09-19T06:09:40.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.451+0000 7fc7c1439740 1 -- 172.21.15.37:0/1700997482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a12609c980 msgr2=0x55a1260abff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:40.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.451+0000 7fc7c1439740 1 --2- 172.21.15.37:0/1700997482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a12609c980 0x55a1260abff0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac005ab0 tx=0x7fc7ac005b50 comp rx=0 tx=0).stop 2024-09-19T06:09:40.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.451+0000 7fc7c1439740 1 -- 172.21.15.37:0/1700997482 shutdown_connections 2024-09-19T06:09:40.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.451+0000 7fc7c1439740 1 --2- 172.21.15.37:0/1700997482 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x55a1261229c0 0x55a126124db0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:40.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.451+0000 7fc7c1439740 1 --2- 172.21.15.37:0/1700997482 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a1260a7240 0x55a1261196a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:40.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.451+0000 7fc7c1439740 1 --2- 172.21.15.37:0/1700997482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a12609c980 0x55a1260abff0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:40.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.451+0000 7fc7c1439740 1 --2- 172.21.15.37:0/1700997482 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a12609c060 0x55a1260abab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:40.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.451+0000 7fc7c1439740 1 -- 172.21.15.37:0/1700997482 >> 172.21.15.37:0/1700997482 conn(0x55a1260985f0 msgr2=0x55a1260b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:40.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.451+0000 7fc797fff640 0 client.15378 ms_handle_reset on v2:172.21.15.99:6838/3404812329 2024-09-19T06:09:40.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.452+0000 7fc7c1439740 1 -- 172.21.15.37:0/1700997482 shutdown_connections 2024-09-19T06:09:40.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.452+0000 7fc7c1439740 1 -- 172.21.15.37:0/1700997482 wait complete. 2024-09-19T06:09:40.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.452+0000 7fc7c1439740 20 client.15378 trim_cache size 0 max 16384 2024-09-19T06:09:40.455 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-19T06:09:40.455 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 20, 2024-09-19T06:09:40.455 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 24485, 2024-09-19T06:09:40.455 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 16, 2024-09-19T06:09:40.455 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": { 2024-09-19T06:09:40.455 INFO:teuthology.orchestra.run.smithi037.stdout: "264638b2": { 2024-09-19T06:09:40.456 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 16, 2024-09-19T06:09:40.456 INFO:teuthology.orchestra.run.smithi037.stdout: "age_ref": 0.0, 2024-09-19T06:09:40.456 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-09-19T06:09:40.456 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RELEASED", 2024-09-19T06:09:40.456 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-09-19T06:09:40.456 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:40.456 INFO:teuthology.orchestra.run.smithi037.stdout: "timeout": 90.0, 2024-09-19T06:09:40.456 INFO:teuthology.orchestra.run.smithi037.stdout: "expiration": 136.6, 2024-09-19T06:09:40.456 INFO:teuthology.orchestra.run.smithi037.stdout: "members": { 2024-09-19T06:09:40.456 INFO:teuthology.orchestra.run.smithi037.stdout: "file:/": { 2024-09-19T06:09:40.456 INFO:teuthology.orchestra.run.smithi037.stdout: "excluded": false, 2024-09-19T06:09:40.457 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-09-19T06:09:40.457 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RELEASED", 2024-09-19T06:09:40.457 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-09-19T06:09:40.457 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:40.457 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:40.457 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:40.457 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:40.457 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:40.457 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-19T06:09:40.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.452+0000 7fc7bf060640 1 -- 172.21.15.37:0/2842388972 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fc7a00a3240 msgr2=0x7fc7a00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:40.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.452+0000 7fc7bf060640 1 --2- 172.21.15.37:0/2842388972 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fc7a00a3240 0x7fc7a00a5700 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc7b00070b0 tx=0x7fc7b0007040 comp rx=0 tx=0).stop 2024-09-19T06:09:40.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.452+0000 7fc7bf060640 1 -- 172.21.15.37:0/2842388972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7b81027a0 msgr2=0x7fc7b81989e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:40.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.452+0000 7fc7bf060640 1 --2- 172.21.15.37:0/2842388972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7b81027a0 0x7fc7b81989e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac006010 tx=0x7fc7ac0042f0 comp rx=0 tx=0).stop 2024-09-19T06:09:40.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.452+0000 7fc7bf060640 1 -- 172.21.15.37:0/2842388972 shutdown_connections 2024-09-19T06:09:40.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.453+0000 7fc7bf060640 1 --2- 172.21.15.37:0/2842388972 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fc7a00a3240 0x7fc7a00a5700 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:40.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.453+0000 7fc7bf060640 1 --2- 172.21.15.37:0/2842388972 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc7b8106f20 0x7fc7b819cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:40.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.453+0000 7fc7bf060640 1 --2- 172.21.15.37:0/2842388972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7b81027a0 0x7fc7b81989e0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:40.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.453+0000 7fc7bf060640 1 --2- 172.21.15.37:0/2842388972 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7b8101df0 0x7fc7b81984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:40.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.453+0000 7fc7bf060640 1 -- 172.21.15.37:0/2842388972 >> 172.21.15.37:0/2842388972 conn(0x7fc7b80fd8b0 msgr2=0x7fc7b80fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:40.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.453+0000 7fc7bf060640 1 -- 172.21.15.37:0/2842388972 shutdown_connections 2024-09-19T06:09:40.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:40.453+0000 7fc7bf060640 1 -- 172.21.15.37:0/2842388972 wait complete. 2024-09-19T06:09:40.909 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:09:40 smithi037 ceph-mon[31211]: pgmap v454: 129 pgs: 129 active+clean; 156 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 746 KiB/s rd, 621 KiB/s wr, 195 op/s 2024-09-19T06:09:40.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:09:40 smithi099 ceph-mon[35300]: pgmap v454: 129 pgs: 129 active+clean; 156 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 746 KiB/s rd, 621 KiB/s wr, 195 op/s 2024-09-19T06:09:40.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:09:40 smithi117 ceph-mon[35050]: pgmap v454: 129 pgs: 129 active+clean; 156 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 746 KiB/s rd, 621 KiB/s wr, 195 op/s 2024-09-19T06:09:41.262 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '264638b2', total seconds elapsed: 20.1 2024-09-19T06:09:42.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:09:42 smithi099 ceph-mon[35300]: pgmap v455: 129 pgs: 129 active+clean; 156 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 389 KiB/s rd, 281 KiB/s wr, 130 op/s 2024-09-19T06:09:42.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:09:42 smithi117 ceph-mon[35050]: pgmap v455: 129 pgs: 129 active+clean; 156 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 389 KiB/s rd, 281 KiB/s wr, 130 op/s 2024-09-19T06:09:43.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:09:42 smithi037 ceph-mon[31211]: pgmap v455: 129 pgs: 129 active+clean; 156 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 389 KiB/s rd, 281 KiB/s wr, 130 op/s 2024-09-19T06:09:44.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:09:44 smithi099 ceph-mon[35300]: pgmap v456: 129 pgs: 129 active+clean; 156 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 419 KiB/s wr, 132 op/s 2024-09-19T06:09:44.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:09:44 smithi117 ceph-mon[35050]: pgmap v456: 129 pgs: 129 active+clean; 156 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 419 KiB/s wr, 132 op/s 2024-09-19T06:09:45.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:09:44 smithi037 ceph-mon[31211]: pgmap v456: 129 pgs: 129 active+clean; 156 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 419 KiB/s wr, 132 op/s 2024-09-19T06:09:46.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:09:46 smithi099 ceph-mon[35300]: pgmap v457: 129 pgs: 129 active+clean; 156 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 147 KiB/s wr, 33 op/s 2024-09-19T06:09:46.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:09:46 smithi117 ceph-mon[35050]: pgmap v457: 129 pgs: 129 active+clean; 156 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 147 KiB/s wr, 33 op/s 2024-09-19T06:09:47.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:09:46 smithi037 ceph-mon[31211]: pgmap v457: 129 pgs: 129 active+clean; 156 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 147 KiB/s wr, 33 op/s 2024-09-19T06:09:48.938 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:09:48 smithi099 ceph-mon[35300]: pgmap v458: 129 pgs: 129 active+clean; 156 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 497 KiB/s wr, 95 op/s 2024-09-19T06:09:48.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:09:48 smithi117 ceph-mon[35050]: pgmap v458: 129 pgs: 129 active+clean; 156 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 497 KiB/s wr, 95 op/s 2024-09-19T06:09:49.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:09:48 smithi037 ceph-mon[31211]: pgmap v458: 129 pgs: 129 active+clean; 156 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 497 KiB/s wr, 95 op/s 2024-09-19T06:09:49.502 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-09-19T06:09:49.503 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-19T06:09:49.813 DEBUG:teuthology.parallel:result is None 2024-09-19T06:09:49.814 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T06:09:49.846 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T06:09:49.847 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-09-19T06:09:49.859 INFO:tasks.quiescer:joining Quiescers 2024-09-19T06:09:49.860 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-09-19T06:09:49.860 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:09:49.999 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:09:49 smithi117 ceph-mon[35050]: pgmap v459: 129 pgs: 129 active+clean; 154 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 800 KiB/s rd, 848 KiB/s wr, 163 op/s 2024-09-19T06:09:50.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:09:49 smithi037 ceph-mon[31211]: pgmap v459: 129 pgs: 129 active+clean; 154 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 800 KiB/s rd, 848 KiB/s wr, 163 op/s 2024-09-19T06:09:50.143 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:09:50.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:09:49 smithi099 ceph-mon[35300]: pgmap v459: 129 pgs: 129 active+clean; 154 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 800 KiB/s rd, 848 KiB/s wr, 163 op/s 2024-09-19T06:09:50.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:50.808+0000 7f186795e640 1 -- 172.21.15.37:0/315888586 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1860100a80 msgr2=0x7f1860100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:50.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:50.808+0000 7f186795e640 1 --2- 172.21.15.37:0/315888586 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1860100a80 0x7f1860100ee0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f1854009930 tx=0x7f185402a420 comp rx=0 tx=0).stop 2024-09-19T06:09:50.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:50.808+0000 7f186795e640 1 -- 172.21.15.37:0/315888586 shutdown_connections 2024-09-19T06:09:50.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:50.808+0000 7f186795e640 1 --2- 172.21.15.37:0/315888586 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1860101420 0x7f186010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:50.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:50.808+0000 7f186795e640 1 --2- 172.21.15.37:0/315888586 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1860100a80 0x7f1860100ee0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:50.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:50.809+0000 7f186795e640 1 --2- 172.21.15.37:0/315888586 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1860106a80 0x7f1860106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:50.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:50.809+0000 7f186795e640 1 -- 172.21.15.37:0/315888586 >> 172.21.15.37:0/315888586 conn(0x7f18600fc7a0 msgr2=0x7f18600febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:50.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:50.809+0000 7f186795e640 1 -- 172.21.15.37:0/315888586 shutdown_connections 2024-09-19T06:09:50.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:50.809+0000 7f186795e640 1 -- 172.21.15.37:0/315888586 wait complete. 2024-09-19T06:09:50.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:50.810+0000 7f186795e640 1 Processor -- start 2024-09-19T06:09:50.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:50.810+0000 7f186795e640 1 -- start start 2024-09-19T06:09:50.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:50.810+0000 7f186795e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1860100a80 0x7f1860199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:50.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:50.810+0000 7f186795e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1860101420 0x7f1860199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:50.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:50.810+0000 7f186795e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1860106a80 0x7f18601a42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:50.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:50.810+0000 7f186795e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1860110e80 con 0x7f1860101420 2024-09-19T06:09:50.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:50.810+0000 7f186795e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f1860110d00 con 0x7f1860106a80 2024-09-19T06:09:50.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:50.810+0000 7f186795e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1860111000 con 0x7f1860100a80 2024-09-19T06:09:50.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:50.810+0000 7f1864ef9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1860101420 0x7f1860199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:50.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:50.810+0000 7f1864ef9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1860101420 0x7f1860199780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43916/0 (socket says 172.21.15.37:43916) 2024-09-19T06:09:50.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:50.810+0000 7f1864ef9640 1 -- 172.21.15.37:0/4019026715 learned_addr learned my addr 172.21.15.37:0/4019026715 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:09:50.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:50.810+0000 7f18656fa640 1 --2- 172.21.15.37:0/4019026715 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1860100a80 0x7f1860199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:50.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:50.810+0000 7f1865efb640 1 --2- 172.21.15.37:0/4019026715 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1860106a80 0x7f18601a42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:50.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:50.811+0000 7f1864ef9640 1 -- 172.21.15.37:0/4019026715 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1860100a80 msgr2=0x7f1860199240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:50.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:50.811+0000 7f1864ef9640 1 --2- 172.21.15.37:0/4019026715 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1860100a80 0x7f1860199240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:50.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:50.811+0000 7f1864ef9640 1 -- 172.21.15.37:0/4019026715 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1860106a80 msgr2=0x7f18601a42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:50.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:50.811+0000 7f1864ef9640 1 --2- 172.21.15.37:0/4019026715 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1860106a80 0x7f18601a42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:50.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:50.811+0000 7f1864ef9640 1 -- 172.21.15.37:0/4019026715 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18601a4800 con 0x7f1860101420 2024-09-19T06:09:50.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:50.811+0000 7f1864ef9640 1 --2- 172.21.15.37:0/4019026715 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1860101420 0x7f1860199780 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f1854009a50 tx=0x7f1854004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:50.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:50.811+0000 7f18527fc640 1 -- 172.21.15.37:0/4019026715 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f185403f030 con 0x7f1860101420 2024-09-19T06:09:50.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:50.811+0000 7f186795e640 1 -- 172.21.15.37:0/4019026715 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1860197030 con 0x7f1860101420 2024-09-19T06:09:50.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:50.811+0000 7f18527fc640 1 -- 172.21.15.37:0/4019026715 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1854003ad0 con 0x7f1860101420 2024-09-19T06:09:50.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:50.811+0000 7f18527fc640 1 -- 172.21.15.37:0/4019026715 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1854035070 con 0x7f1860101420 2024-09-19T06:09:50.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:50.811+0000 7f186795e640 1 -- 172.21.15.37:0/4019026715 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1860197500 con 0x7f1860101420 2024-09-19T06:09:50.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:50.812+0000 7f186795e640 1 -- 172.21.15.37:0/4019026715 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18601021c0 con 0x7f1860101420 2024-09-19T06:09:50.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:50.813+0000 7f18527fc640 1 -- 172.21.15.37:0/4019026715 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f1854042030 con 0x7f1860101420 2024-09-19T06:09:50.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:50.814+0000 7f18527fc640 1 --2- 172.21.15.37:0/4019026715 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f184c0a3240 0x7f184c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:50.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:50.814+0000 7f18656fa640 1 --2- 172.21.15.37:0/4019026715 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f184c0a3240 0x7f184c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:50.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:50.814+0000 7f18527fc640 1 -- 172.21.15.37:0/4019026715 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9121+0+0 (secure 0 0 0) 0x7f18540f08a0 con 0x7f1860101420 2024-09-19T06:09:50.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:50.814+0000 7f18656fa640 1 --2- 172.21.15.37:0/4019026715 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f184c0a3240 0x7f184c0a5700 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f185c00ab60 tx=0x7f185c00a2d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:50.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:50.817+0000 7f18527fc640 1 -- 172.21.15.37:0/4019026715 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f18540bd240 con 0x7f1860101420 2024-09-19T06:09:51.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:51.029+0000 7f186795e640 1 -- 172.21.15.37:0/4019026715 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1860108ff0 con 0x7f1860101420 2024-09-19T06:09:51.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:51.029+0000 7f18527fc640 1 -- 172.21.15.37:0/4019026715 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11842 (secure 0 0 0) 0x7f18540bcb40 con 0x7f1860101420 2024-09-19T06:09:51.032 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T06:09:51.032 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"btime":"2024-09-19T06:04:42:531480+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14514,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2864247978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2864247978},{"type":"v1","addr":"172.21.15.37:6835","nonce":2864247978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14526,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/633000932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":633000932},{"type":"v1","addr":"172.21.15.37:6837","nonce":633000932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14574,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/3753800615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":3753800615},{"type":"v1","addr":"172.21.15.37:6839","nonce":3753800615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/2718998355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":2718998355},{"type":"v1","addr":"172.21.15.37:6841","nonce":2718998355}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6833/866590207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":866590207},{"type":"v1","addr":"172.21.15.99:6833","nonce":866590207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3898668400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3898668400},{"type":"v1","addr":"172.21.15.117:6833","nonce":3898668400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2650673320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2650673320},{"type":"v1","addr":"172.21.15.99:6835","nonce":2650673320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1097471349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1097471349},{"type":"v1","addr":"172.21.15.117:6835","nonce":1097471349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24457,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1001392672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1001392672},{"type":"v1","addr":"172.21.15.117:6837","nonce":1001392672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/23570935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":23570935},{"type":"v1","addr":"172.21.15.99:6837","nonce":23570935}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:04:06.253034+0000","modified":"2024-09-19T06:04:42.196783+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24485},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24478":{"gid":24478,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6839/1269518339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":1269518339},{"type":"v1","addr":"172.21.15.117:6839","nonce":1269518339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.99:6839/3404812329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":3404812329},{"type":"v1","addr":"172.21.15.99:6839","nonce":3404812329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24485,"qdb_cluster":[24485]},"id":1}]} 2024-09-19T06:09:51.032 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 20 2024-09-19T06:09:51.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:51.031+0000 7f186795e640 1 -- 172.21.15.37:0/4019026715 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f184c0a3240 msgr2=0x7f184c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:51.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:51.031+0000 7f186795e640 1 --2- 172.21.15.37:0/4019026715 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f184c0a3240 0x7f184c0a5700 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f185c00ab60 tx=0x7f185c00a2d0 comp rx=0 tx=0).stop 2024-09-19T06:09:51.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:51.031+0000 7f186795e640 1 -- 172.21.15.37:0/4019026715 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1860101420 msgr2=0x7f1860199780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:51.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:51.031+0000 7f186795e640 1 --2- 172.21.15.37:0/4019026715 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1860101420 0x7f1860199780 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f1854009a50 tx=0x7f1854004270 comp rx=0 tx=0).stop 2024-09-19T06:09:51.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:51.031+0000 7f186795e640 1 -- 172.21.15.37:0/4019026715 shutdown_connections 2024-09-19T06:09:51.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:51.031+0000 7f186795e640 1 --2- 172.21.15.37:0/4019026715 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f184c0a3240 0x7f184c0a5700 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:51.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:51.031+0000 7f186795e640 1 --2- 172.21.15.37:0/4019026715 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1860106a80 0x7f18601a42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:51.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:51.031+0000 7f186795e640 1 --2- 172.21.15.37:0/4019026715 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1860101420 0x7f1860199780 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:51.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:51.031+0000 7f186795e640 1 --2- 172.21.15.37:0/4019026715 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1860100a80 0x7f1860199240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:51.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:51.031+0000 7f186795e640 1 -- 172.21.15.37:0/4019026715 >> 172.21.15.37:0/4019026715 conn(0x7f18600fc7a0 msgr2=0x7f18600fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:51.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:51.031+0000 7f186795e640 1 -- 172.21.15.37:0/4019026715 shutdown_connections 2024-09-19T06:09:51.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:51.031+0000 7f186795e640 1 -- 172.21.15.37:0/4019026715 wait complete. 2024-09-19T06:09:52.042 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24485 quiesce db --cancel --all' 2024-09-19T06:09:52.042 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24485 quiesce db --cancel --all 2024-09-19T06:09:52.069 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:09:51 smithi037 ceph-mon[31211]: pgmap v460: 129 pgs: 129 active+clean; 153 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 793 KiB/s rd, 841 KiB/s wr, 176 op/s 2024-09-19T06:09:52.069 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:09:51 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/4019026715' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:09:52.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:09:51 smithi099 ceph-mon[35300]: pgmap v460: 129 pgs: 129 active+clean; 153 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 793 KiB/s rd, 841 KiB/s wr, 176 op/s 2024-09-19T06:09:52.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:09:51 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/4019026715' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:09:52.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:09:51 smithi117 ceph-mon[35050]: pgmap v460: 129 pgs: 129 active+clean; 153 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 793 KiB/s rd, 841 KiB/s wr, 176 op/s 2024-09-19T06:09:52.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:09:51 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/4019026715' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:09:52.306 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:09:52.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.778+0000 7f0c71ac6640 1 -- 172.21.15.37:0/3289397537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c6c1082a0 msgr2=0x7f0c6c10ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:52.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.778+0000 7f0c71ac6640 1 --2- 172.21.15.37:0/3289397537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c6c1082a0 0x7f0c6c10ec40 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f0c64009930 tx=0x7f0c6402a440 comp rx=0 tx=0).stop 2024-09-19T06:09:52.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.778+0000 7f0c71ac6640 1 -- 172.21.15.37:0/3289397537 shutdown_connections 2024-09-19T06:09:52.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.778+0000 7f0c71ac6640 1 --2- 172.21.15.37:0/3289397537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c6c1082a0 0x7f0c6c10ec40 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:52.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.778+0000 7f0c71ac6640 1 --2- 172.21.15.37:0/3289397537 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c6c1036e0 0x7f0c6c107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:52.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.778+0000 7f0c71ac6640 1 --2- 172.21.15.37:0/3289397537 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c6c102d30 0x7f0c6c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:52.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.778+0000 7f0c71ac6640 1 -- 172.21.15.37:0/3289397537 >> 172.21.15.37:0/3289397537 conn(0x7f0c6c0fc7d0 msgr2=0x7f0c6c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:52.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.778+0000 7f0c71ac6640 1 -- 172.21.15.37:0/3289397537 shutdown_connections 2024-09-19T06:09:52.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.778+0000 7f0c71ac6640 1 -- 172.21.15.37:0/3289397537 wait complete. 2024-09-19T06:09:52.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.779+0000 7f0c71ac6640 1 Processor -- start 2024-09-19T06:09:52.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.779+0000 7f0c71ac6640 1 -- start start 2024-09-19T06:09:52.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.779+0000 7f0c71ac6640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c6c102d30 0x7f0c6c19a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:52.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.779+0000 7f0c71ac6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c6c1036e0 0x7f0c6c19aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:52.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.779+0000 7f0c71ac6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c6c1082a0 0x7f0c6c19ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:52.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.779+0000 7f0c71ac6640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0c6c1120a0 con 0x7f0c6c1036e0 2024-09-19T06:09:52.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.779+0000 7f0c71ac6640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f0c6c111f20 con 0x7f0c6c102d30 2024-09-19T06:09:52.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.779+0000 7f0c71ac6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0c6c112220 con 0x7f0c6c1082a0 2024-09-19T06:09:52.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.779+0000 7f0c6affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c6c1036e0 0x7f0c6c19aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:52.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.779+0000 7f0c6affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c6c1036e0 0x7f0c6c19aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43926/0 (socket says 172.21.15.37:43926) 2024-09-19T06:09:52.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.779+0000 7f0c6affd640 1 -- 172.21.15.37:0/3088841486 learned_addr learned my addr 172.21.15.37:0/3088841486 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:09:52.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.779+0000 7f0c6bfff640 1 --2- 172.21.15.37:0/3088841486 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c6c1082a0 0x7f0c6c19ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:52.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.779+0000 7f0c6b7fe640 1 --2- 172.21.15.37:0/3088841486 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c6c102d30 0x7f0c6c19a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:52.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.780+0000 7f0c6affd640 1 -- 172.21.15.37:0/3088841486 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c6c1082a0 msgr2=0x7f0c6c19ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:52.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.780+0000 7f0c6affd640 1 --2- 172.21.15.37:0/3088841486 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c6c1082a0 0x7f0c6c19ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:52.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.780+0000 7f0c6affd640 1 -- 172.21.15.37:0/3088841486 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c6c102d30 msgr2=0x7f0c6c19a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:52.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.780+0000 7f0c6affd640 1 --2- 172.21.15.37:0/3088841486 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c6c102d30 0x7f0c6c19a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:52.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.780+0000 7f0c6affd640 1 -- 172.21.15.37:0/3088841486 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c6c19f610 con 0x7f0c6c1036e0 2024-09-19T06:09:52.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.780+0000 7f0c6b7fe640 1 --2- 172.21.15.37:0/3088841486 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c6c102d30 0x7f0c6c19a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:09:52.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.780+0000 7f0c6affd640 1 --2- 172.21.15.37:0/3088841486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c6c1036e0 0x7f0c6c19aba0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f0c6000c8c0 tx=0x7f0c6000cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:52.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.780+0000 7f0c68ff9640 1 -- 172.21.15.37:0/3088841486 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c60007bb0 con 0x7f0c6c1036e0 2024-09-19T06:09:52.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.780+0000 7f0c71ac6640 1 -- 172.21.15.37:0/3088841486 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c6c19f900 con 0x7f0c6c1036e0 2024-09-19T06:09:52.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.780+0000 7f0c68ff9640 1 -- 172.21.15.37:0/3088841486 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c60007d50 con 0x7f0c6c1036e0 2024-09-19T06:09:52.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.780+0000 7f0c68ff9640 1 -- 172.21.15.37:0/3088841486 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c60018830 con 0x7f0c6c1036e0 2024-09-19T06:09:52.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.780+0000 7f0c71ac6640 1 -- 172.21.15.37:0/3088841486 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c6c1a71e0 con 0x7f0c6c1036e0 2024-09-19T06:09:52.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.782+0000 7f0c68ff9640 1 -- 172.21.15.37:0/3088841486 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f0c60018a10 con 0x7f0c6c1036e0 2024-09-19T06:09:52.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.783+0000 7f0c73e9f740 1 Processor -- start 2024-09-19T06:09:52.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.783+0000 7f0c73e9f740 1 -- start start 2024-09-19T06:09:52.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.783+0000 7f0c73e9f740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e44ca63a00 0x55e44ca63de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:52.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.783+0000 7f0c73e9f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e44ca64320 0x55e44ca6e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:52.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.783+0000 7f0c73e9f740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e44ca6ebe0 0x55e44ca70fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:52.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.783+0000 7f0c73e9f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e44c9c8200 con 0x55e44ca64320 2024-09-19T06:09:52.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.783+0000 7f0c73e9f740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55e44c96edc0 con 0x55e44ca6ebe0 2024-09-19T06:09:52.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.783+0000 7f0c73e9f740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55e44c9c41c0 con 0x55e44ca63a00 2024-09-19T06:09:52.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.783+0000 7f0c6b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e44ca64320 0x55e44ca6e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:52.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.783+0000 7f0c6b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e44ca64320 0x55e44ca6e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43942/0 (socket says 172.21.15.37:43942) 2024-09-19T06:09:52.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.783+0000 7f0c6b7fe640 1 -- 172.21.15.37:0/1738711098 learned_addr learned my addr 172.21.15.37:0/1738711098 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:09:52.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.783+0000 7f0c6bfff640 1 --2- 172.21.15.37:0/1738711098 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e44ca63a00 0x55e44ca63de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:52.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.783+0000 7f0c6affd640 1 --2- 172.21.15.37:0/1738711098 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e44ca6ebe0 0x55e44ca70fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:52.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.783+0000 7f0c68ff9640 1 --2- 172.21.15.37:0/3088841486 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f0c540a3240 0x7f0c540a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:52.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.783+0000 7f0c6b7fe640 1 -- 172.21.15.37:0/1738711098 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e44ca63a00 msgr2=0x55e44ca63de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:52.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.783+0000 7f0c6b7fe640 1 --2- 172.21.15.37:0/1738711098 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e44ca63a00 0x55e44ca63de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:52.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.783+0000 7f0c6b7fe640 1 -- 172.21.15.37:0/1738711098 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e44ca6ebe0 msgr2=0x55e44ca70fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:52.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.783+0000 7f0c6b7fe640 1 --2- 172.21.15.37:0/1738711098 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e44ca6ebe0 0x55e44ca70fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:52.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.783+0000 7f0c6b7fe640 1 -- 172.21.15.37:0/1738711098 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e44c739620 con 0x55e44ca64320 2024-09-19T06:09:52.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.784+0000 7f0c6bfff640 1 --2- 172.21.15.37:0/3088841486 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f0c540a3240 0x7f0c540a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:52.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.784+0000 7f0c68ff9640 1 -- 172.21.15.37:0/3088841486 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9121+0+0 (secure 0 0 0) 0x7f0c600cfd70 con 0x7f0c6c1036e0 2024-09-19T06:09:52.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.784+0000 7f0c6b7fe640 1 --2- 172.21.15.37:0/1738711098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e44ca64320 0x55e44ca6e6a0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c007f70 tx=0x7f0c5c00e7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc95fb72e309ea96 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:52.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.784+0000 7f0c51ffb640 1 -- 172.21.15.37:0/1738711098 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c5c014070 con 0x55e44ca64320 2024-09-19T06:09:52.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.784+0000 7f0c51ffb640 1 -- 172.21.15.37:0/1738711098 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c5c004d20 con 0x55e44ca64320 2024-09-19T06:09:52.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.784+0000 7f0c6bfff640 1 --2- 172.21.15.37:0/3088841486 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f0c540a3240 0x7f0c540a5700 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0c64031550 tx=0x7f0c64009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:52.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.784+0000 7f0c51ffb640 1 -- 172.21.15.37:0/1738711098 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c5c005550 con 0x55e44ca64320 2024-09-19T06:09:52.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.785+0000 7f0c73e9f740 1 -- 172.21.15.37:0/1738711098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e44ca64320 msgr2=0x55e44ca6e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:52.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.785+0000 7f0c73e9f740 1 --2- 172.21.15.37:0/1738711098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e44ca64320 0x55e44ca6e6a0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c007f70 tx=0x7f0c5c00e7e0 comp rx=0 tx=0).stop 2024-09-19T06:09:52.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.785+0000 7f0c73e9f740 1 -- 172.21.15.37:0/1738711098 shutdown_connections 2024-09-19T06:09:52.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.785+0000 7f0c73e9f740 1 --2- 172.21.15.37:0/1738711098 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e44ca6ebe0 0x55e44ca70fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:52.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.785+0000 7f0c73e9f740 1 --2- 172.21.15.37:0/1738711098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e44ca64320 0x55e44ca6e6a0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:52.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.785+0000 7f0c73e9f740 1 --2- 172.21.15.37:0/1738711098 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e44ca63a00 0x55e44ca63de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:52.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.785+0000 7f0c73e9f740 1 -- 172.21.15.37:0/1738711098 >> 172.21.15.37:0/1738711098 conn(0x55e44ca5ff90 msgr2=0x55e44ca60370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:52.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.785+0000 7f0c73e9f740 1 -- 172.21.15.37:0/1738711098 shutdown_connections 2024-09-19T06:09:52.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.785+0000 7f0c73e9f740 1 -- 172.21.15.37:0/1738711098 wait complete. 2024-09-19T06:09:52.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.785+0000 7f0c73e9f740 1 -- start start 2024-09-19T06:09:52.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.785+0000 7f0c73e9f740 1 Processor -- start 2024-09-19T06:09:52.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.785+0000 7f0c73e9f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e44ca63a00 0x55e44ca6e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:52.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.786+0000 7f0c73e9f740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e44ca64320 0x55e44ca6b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:52.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.786+0000 7f0c73e9f740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e44ca6ebe0 0x55e44ca6bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:52.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.786+0000 7f0c73e9f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e44ca717b0 con 0x55e44ca63a00 2024-09-19T06:09:52.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.786+0000 7f0c73e9f740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55e44c962c50 con 0x55e44ca6ebe0 2024-09-19T06:09:52.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.786+0000 7f0c73e9f740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55e44ca71930 con 0x55e44ca64320 2024-09-19T06:09:52.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.786+0000 7f0c73e9f740 10 client.0 _ll_register_callbacks cb 0x55e44c974ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:09:52.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.786+0000 7f0c6b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e44ca63a00 0x55e44ca6e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:52.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.786+0000 7f0c6b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e44ca63a00 0x55e44ca6e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43958/0 (socket says 172.21.15.37:43958) 2024-09-19T06:09:52.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.786+0000 7f0c6b7fe640 1 -- 172.21.15.37:0/3929670631 learned_addr learned my addr 172.21.15.37:0/3929670631 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:09:52.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.786+0000 7f0c6affd640 1 --2- 172.21.15.37:0/3929670631 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e44ca64320 0x55e44ca6b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:52.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.786+0000 7f0c6bfff640 1 --2- 172.21.15.37:0/3929670631 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e44ca6ebe0 0x55e44ca6bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:52.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.786+0000 7f0c6b7fe640 1 -- 172.21.15.37:0/3929670631 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e44ca64320 msgr2=0x55e44ca6b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:52.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.786+0000 7f0c6b7fe640 1 --2- 172.21.15.37:0/3929670631 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e44ca64320 0x55e44ca6b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:52.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.786+0000 7f0c6b7fe640 1 -- 172.21.15.37:0/3929670631 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e44ca6ebe0 msgr2=0x55e44ca6bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:52.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.786+0000 7f0c6b7fe640 1 --2- 172.21.15.37:0/3929670631 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e44ca6ebe0 0x55e44ca6bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:52.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.786+0000 7f0c6b7fe640 1 -- 172.21.15.37:0/3929670631 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e44ca6c5d0 con 0x55e44ca63a00 2024-09-19T06:09:52.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.786+0000 7f0c6b7fe640 1 --2- 172.21.15.37:0/3929670631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e44ca63a00 0x55e44ca6e570 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c000f80 tx=0x7f0c5c010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eec6977aa4fa888 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:52.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.786+0000 7f0c4affd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-19T06:09:52.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.786+0000 7f0c4affd640 1 -- 172.21.15.37:0/3929670631 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c5c014070 con 0x55e44ca63a00 2024-09-19T06:09:52.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.786+0000 7f0c4affd640 1 -- 172.21.15.37:0/3929670631 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9121+0+0 (secure 0 0 0) 0x7f0c5c004a40 con 0x55e44ca63a00 2024-09-19T06:09:52.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.786+0000 7f0c73e9f740 1 -- 172.21.15.37:0/3929670631 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c5c004d20 con 0x55e44ca63a00 2024-09-19T06:09:52.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.786+0000 7f0c4affd640 1 -- 172.21.15.37:0/3929670631 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f0c5c02c050 con 0x55e44ca63a00 2024-09-19T06:09:52.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.786+0000 7f0c73e9f740 10 client.15396 fetch_fsmap learned FSMap version 20 2024-09-19T06:09:52.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.786+0000 7f0c73e9f740 1 -- 172.21.15.37:0/3929670631 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55e44ca7d370 con 0x55e44ca63a00 2024-09-19T06:09:52.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.787+0000 7f0c4affd640 1 -- 172.21.15.37:0/3929670631 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c5c004d20 con 0x55e44ca63a00 2024-09-19T06:09:52.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.787+0000 7f0c4affd640 1 -- 172.21.15.37:0/3929670631 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 20) ==== 8338+0+0 (secure 0 0 0) 0x7f0c5c005650 con 0x55e44ca63a00 2024-09-19T06:09:52.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.787+0000 7f0c73e9f740 10 client.15396 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:09:52.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.787+0000 7f0c73e9f740 10 client.15396 resolve_mds: validated gid 24485 aka daemon mds.b 2024-09-19T06:09:52.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.787+0000 7f0c73e9f740 20 client.15396 populate_metadata read hostname 'smithi037' 2024-09-19T06:09:52.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.787+0000 7f0c73e9f740 1 --2- 172.21.15.37:0/3929670631 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x55e44ca7e830 0x55e44ca80c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:52.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.787+0000 7f0c73e9f740 4 client.15396 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:09:52.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.787+0000 7f0c73e9f740 1 -- 172.21.15.37:0/3929670631 --> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e44c9d5770 con 0x55e44ca7e830 2024-09-19T06:09:52.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.787+0000 7f0c6affd640 1 --2- 172.21.15.37:0/3929670631 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x55e44ca7e830 0x55e44ca80c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:52.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.788+0000 7f0c6affd640 1 --2- 172.21.15.37:0/3929670631 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x55e44ca7e830 0x55e44ca80c20 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4786afc598e22f8e server_cookie=a79f7be11080ab2b in_seq=0 out_seq=0 2024-09-19T06:09:52.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.788+0000 7f0c4affd640 10 client.15396 ms_handle_connect on v2:172.21.15.99:6838/3404812329 2024-09-19T06:09:52.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.788+0000 7f0c4affd640 1 -- 172.21.15.37:0/3929670631 <== mds.0 v2:172.21.15.99:6838/3404812329 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e44c9d5770 con 0x55e44ca7e830 2024-09-19T06:09:52.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.788+0000 7f0c4affd640 10 client.15396 handle_command_reply: tid=0 2024-09-19T06:09:52.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.788+0000 7f0c73e9f740 1 client.15396 shutdown 2024-09-19T06:09:52.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.788+0000 7f0c73e9f740 1 -- 172.21.15.37:0/3929670631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e44ca63a00 msgr2=0x55e44ca6e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:52.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.788+0000 7f0c73e9f740 1 --2- 172.21.15.37:0/3929670631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e44ca63a00 0x55e44ca6e570 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c000f80 tx=0x7f0c5c010d50 comp rx=0 tx=0).stop 2024-09-19T06:09:52.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.789+0000 7f0c73e9f740 1 -- 172.21.15.37:0/3929670631 shutdown_connections 2024-09-19T06:09:52.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.789+0000 7f0c73e9f740 1 --2- 172.21.15.37:0/3929670631 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x55e44ca7e830 0x55e44ca80c20 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:52.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.789+0000 7f0c73e9f740 1 --2- 172.21.15.37:0/3929670631 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e44ca6ebe0 0x55e44ca6bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:52.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.789+0000 7f0c73e9f740 1 --2- 172.21.15.37:0/3929670631 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e44ca64320 0x55e44ca6b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:52.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.789+0000 7f0c73e9f740 1 --2- 172.21.15.37:0/3929670631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e44ca63a00 0x55e44ca6e570 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:52.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.789+0000 7f0c73e9f740 1 -- 172.21.15.37:0/3929670631 >> 172.21.15.37:0/3929670631 conn(0x55e44ca5ff90 msgr2=0x55e44ca5f1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:52.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.789+0000 7f0c4affd640 0 client.15396 ms_handle_reset on v2:172.21.15.99:6838/3404812329 2024-09-19T06:09:52.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.789+0000 7f0c73e9f740 1 -- 172.21.15.37:0/3929670631 shutdown_connections 2024-09-19T06:09:52.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.789+0000 7f0c73e9f740 1 -- 172.21.15.37:0/3929670631 wait complete. 2024-09-19T06:09:52.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.789+0000 7f0c73e9f740 20 client.15396 trim_cache size 0 max 16384 2024-09-19T06:09:52.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.806+0000 7f0c73e9f740 1 Processor -- start 2024-09-19T06:09:52.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.806+0000 7f0c73e9f740 1 -- start start 2024-09-19T06:09:52.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.806+0000 7f0c73e9f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e44ca63a00 0x55e44ca6b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:52.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.806+0000 7f0c73e9f740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e44ca64320 0x55e44ca861c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:52.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.806+0000 7f0c73e9f740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e44ca6ebe0 0x55e44ca86700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:52.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.806+0000 7f0c73e9f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0c6c1aee30 con 0x55e44ca63a00 2024-09-19T06:09:52.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.806+0000 7f0c73e9f740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f0c6c1b16b0 con 0x55e44ca6ebe0 2024-09-19T06:09:52.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.806+0000 7f0c73e9f740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0c6c1af4a0 con 0x55e44ca64320 2024-09-19T06:09:52.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.807+0000 7f0c6b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e44ca63a00 0x55e44ca6b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:52.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.807+0000 7f0c6b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e44ca63a00 0x55e44ca6b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43966/0 (socket says 172.21.15.37:43966) 2024-09-19T06:09:52.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.807+0000 7f0c6b7fe640 1 -- 172.21.15.37:0/2603334198 learned_addr learned my addr 172.21.15.37:0/2603334198 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:09:52.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.807+0000 7f0c6bfff640 1 --2- 172.21.15.37:0/2603334198 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e44ca6ebe0 0x55e44ca86700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:52.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.807+0000 7f0c6affd640 1 --2- 172.21.15.37:0/2603334198 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e44ca64320 0x55e44ca861c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:52.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.807+0000 7f0c6b7fe640 1 -- 172.21.15.37:0/2603334198 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e44ca64320 msgr2=0x55e44ca861c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:52.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.807+0000 7f0c6b7fe640 1 --2- 172.21.15.37:0/2603334198 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e44ca64320 0x55e44ca861c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:52.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.807+0000 7f0c6b7fe640 1 -- 172.21.15.37:0/2603334198 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e44ca6ebe0 msgr2=0x55e44ca86700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:52.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.807+0000 7f0c6b7fe640 1 --2- 172.21.15.37:0/2603334198 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e44ca6ebe0 0x55e44ca86700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:52.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.807+0000 7f0c6b7fe640 1 -- 172.21.15.37:0/2603334198 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e44ca5fdc0 con 0x55e44ca63a00 2024-09-19T06:09:52.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.807+0000 7f0c6b7fe640 1 --2- 172.21.15.37:0/2603334198 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e44ca63a00 0x55e44ca6b100 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c0043f0 tx=0x7f0c5c007c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd208634d017c01a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:52.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.807+0000 7f0c517fa640 1 -- 172.21.15.37:0/2603334198 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c5c014070 con 0x55e44ca63a00 2024-09-19T06:09:52.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.807+0000 7f0c517fa640 1 -- 172.21.15.37:0/2603334198 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c5c003e50 con 0x55e44ca63a00 2024-09-19T06:09:52.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.807+0000 7f0c517fa640 1 -- 172.21.15.37:0/2603334198 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c5c005720 con 0x55e44ca63a00 2024-09-19T06:09:52.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.808+0000 7f0c73e9f740 1 -- 172.21.15.37:0/2603334198 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e44ca63a00 msgr2=0x55e44ca6b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:52.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.808+0000 7f0c73e9f740 1 --2- 172.21.15.37:0/2603334198 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e44ca63a00 0x55e44ca6b100 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c0043f0 tx=0x7f0c5c007c90 comp rx=0 tx=0).stop 2024-09-19T06:09:52.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.808+0000 7f0c73e9f740 1 -- 172.21.15.37:0/2603334198 shutdown_connections 2024-09-19T06:09:52.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.808+0000 7f0c73e9f740 1 --2- 172.21.15.37:0/2603334198 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e44ca6ebe0 0x55e44ca86700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:52.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.808+0000 7f0c73e9f740 1 --2- 172.21.15.37:0/2603334198 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e44ca64320 0x55e44ca861c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:52.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.808+0000 7f0c73e9f740 1 --2- 172.21.15.37:0/2603334198 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e44ca63a00 0x55e44ca6b100 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:52.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.808+0000 7f0c73e9f740 1 -- 172.21.15.37:0/2603334198 >> 172.21.15.37:0/2603334198 conn(0x55e44ca5ff90 msgr2=0x55e44ca66590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:52.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.808+0000 7f0c73e9f740 1 -- 172.21.15.37:0/2603334198 shutdown_connections 2024-09-19T06:09:52.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.808+0000 7f0c73e9f740 1 -- 172.21.15.37:0/2603334198 wait complete. 2024-09-19T06:09:52.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.808+0000 7f0c73e9f740 1 -- start start 2024-09-19T06:09:52.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.809+0000 7f0c73e9f740 1 Processor -- start 2024-09-19T06:09:52.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.809+0000 7f0c73e9f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e44ca63a00 0x55e44ca77110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:52.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.809+0000 7f0c73e9f740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e44ca64320 0x55e44ca72440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:52.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.809+0000 7f0c73e9f740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e44ca6ebe0 0x55e44ca72980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:52.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.809+0000 7f0c73e9f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0c6c1afb70 con 0x55e44ca63a00 2024-09-19T06:09:52.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.809+0000 7f0c73e9f740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f0c6c1b0fe0 con 0x55e44ca6ebe0 2024-09-19T06:09:52.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.809+0000 7f0c73e9f740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0c6c1b0240 con 0x55e44ca64320 2024-09-19T06:09:52.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.809+0000 7f0c73e9f740 10 client.0 _ll_register_callbacks cb 0x7f0c5c0109e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:09:52.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.809+0000 7f0c6b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e44ca63a00 0x55e44ca77110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:52.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.809+0000 7f0c6b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e44ca63a00 0x55e44ca77110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43972/0 (socket says 172.21.15.37:43972) 2024-09-19T06:09:52.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.809+0000 7f0c6b7fe640 1 -- 172.21.15.37:0/2468489251 learned_addr learned my addr 172.21.15.37:0/2468489251 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:09:52.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.809+0000 7f0c6bfff640 1 --2- 172.21.15.37:0/2468489251 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e44ca6ebe0 0x55e44ca72980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:52.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.809+0000 7f0c6affd640 1 --2- 172.21.15.37:0/2468489251 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e44ca64320 0x55e44ca72440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:52.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.810+0000 7f0c6b7fe640 1 -- 172.21.15.37:0/2468489251 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e44ca64320 msgr2=0x55e44ca72440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:52.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.810+0000 7f0c6b7fe640 1 --2- 172.21.15.37:0/2468489251 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e44ca64320 0x55e44ca72440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:52.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.810+0000 7f0c6b7fe640 1 -- 172.21.15.37:0/2468489251 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e44ca6ebe0 msgr2=0x55e44ca72980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:09:52.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.810+0000 7f0c6b7fe640 1 --2- 172.21.15.37:0/2468489251 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e44ca6ebe0 0x55e44ca72980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:52.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.810+0000 7f0c6b7fe640 1 -- 172.21.15.37:0/2468489251 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e44ca72fc0 con 0x55e44ca63a00 2024-09-19T06:09:52.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.810+0000 7f0c6b7fe640 1 --2- 172.21.15.37:0/2468489251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e44ca63a00 0x55e44ca77110 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c010d90 tx=0x7f0c5c007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36825a3cf5dc07d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:52.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.810+0000 7f0c4affd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-09-19T06:09:52.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.810+0000 7f0c4affd640 1 -- 172.21.15.37:0/2468489251 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c5c035070 con 0x55e44ca63a00 2024-09-19T06:09:52.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.810+0000 7f0c4affd640 1 -- 172.21.15.37:0/2468489251 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9121+0+0 (secure 0 0 0) 0x7f0c5c003970 con 0x55e44ca63a00 2024-09-19T06:09:52.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.810+0000 7f0c73e9f740 1 -- 172.21.15.37:0/2468489251 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c5c003e50 con 0x55e44ca63a00 2024-09-19T06:09:52.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.810+0000 7f0c4affd640 1 -- 172.21.15.37:0/2468489251 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f0c5c041050 con 0x55e44ca63a00 2024-09-19T06:09:52.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.810+0000 7f0c73e9f740 10 client.15402 fetch_fsmap learned FSMap version 20 2024-09-19T06:09:52.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.810+0000 7f0c73e9f740 1 -- 172.21.15.37:0/2468489251 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x55e44cae8fc0 con 0x55e44ca63a00 2024-09-19T06:09:52.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.810+0000 7f0c4affd640 1 -- 172.21.15.37:0/2468489251 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c5c003e50 con 0x55e44ca63a00 2024-09-19T06:09:52.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.811+0000 7f0c4affd640 1 -- 172.21.15.37:0/2468489251 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 20) ==== 8338+0+0 (secure 0 0 0) 0x7f0c5c004930 con 0x55e44ca63a00 2024-09-19T06:09:52.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.811+0000 7f0c73e9f740 10 client.15402 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T06:09:52.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.811+0000 7f0c73e9f740 10 client.15402 resolve_mds: validated gid 24485 aka daemon mds.b 2024-09-19T06:09:52.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.811+0000 7f0c73e9f740 20 client.15402 populate_metadata read hostname 'smithi037' 2024-09-19T06:09:52.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.811+0000 7f0c73e9f740 1 --2- 172.21.15.37:0/2468489251 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x55e44cae95e0 0x55e44caeba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:52.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.811+0000 7f0c73e9f740 4 client.15402 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-09-19T06:09:52.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.811+0000 7f0c73e9f740 1 -- 172.21.15.37:0/2468489251 --> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x55e44c9cfc80 con 0x55e44cae95e0 2024-09-19T06:09:52.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.811+0000 7f0c6affd640 1 --2- 172.21.15.37:0/2468489251 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x55e44cae95e0 0x55e44caeba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:52.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.811+0000 7f0c6affd640 1 --2- 172.21.15.37:0/2468489251 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x55e44cae95e0 0x55e44caeba00 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c27a83e568eba72b server_cookie=ecc9065fd062bcc5 in_seq=0 out_seq=0 2024-09-19T06:09:52.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.811+0000 7f0c4affd640 10 client.15402 ms_handle_connect on v2:172.21.15.99:6838/3404812329 2024-09-19T06:09:52.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.812+0000 7f0c4affd640 1 -- 172.21.15.37:0/2468489251 <== mds.0 v2:172.21.15.99:6838/3404812329 1 ==== command_reply(tid 0: 0 ) ==== 8+0+80 (crc 0 0 0) 0x55e44c9cfc80 con 0x55e44cae95e0 2024-09-19T06:09:52.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.812+0000 7f0c4affd640 10 client.15402 handle_command_reply: tid=0 2024-09-19T06:09:52.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.812+0000 7f0c73e9f740 1 client.15402 shutdown 2024-09-19T06:09:52.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.812+0000 7f0c73e9f740 1 -- 172.21.15.37:0/2468489251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e44ca63a00 msgr2=0x55e44ca77110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:52.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.812+0000 7f0c73e9f740 1 --2- 172.21.15.37:0/2468489251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e44ca63a00 0x55e44ca77110 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c010d90 tx=0x7f0c5c007f40 comp rx=0 tx=0).stop 2024-09-19T06:09:52.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.812+0000 7f0c73e9f740 1 -- 172.21.15.37:0/2468489251 shutdown_connections 2024-09-19T06:09:52.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.812+0000 7f0c73e9f740 1 --2- 172.21.15.37:0/2468489251 >> [v2:172.21.15.99:6838/3404812329,v1:172.21.15.99:6839/3404812329] conn(0x55e44cae95e0 0x55e44caeba00 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:52.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.812+0000 7f0c73e9f740 1 --2- 172.21.15.37:0/2468489251 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e44ca6ebe0 0x55e44ca72980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:52.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.812+0000 7f0c73e9f740 1 --2- 172.21.15.37:0/2468489251 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e44ca64320 0x55e44ca72440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:52.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.812+0000 7f0c73e9f740 1 --2- 172.21.15.37:0/2468489251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e44ca63a00 0x55e44ca77110 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:52.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.812+0000 7f0c4affd640 0 client.15402 ms_handle_reset on v2:172.21.15.99:6838/3404812329 2024-09-19T06:09:52.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.812+0000 7f0c73e9f740 1 -- 172.21.15.37:0/2468489251 >> 172.21.15.37:0/2468489251 conn(0x55e44ca5ff90 msgr2=0x55e44ca6d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:52.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.812+0000 7f0c73e9f740 1 -- 172.21.15.37:0/2468489251 shutdown_connections 2024-09-19T06:09:52.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.812+0000 7f0c73e9f740 1 -- 172.21.15.37:0/2468489251 wait complete. 2024-09-19T06:09:52.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.812+0000 7f0c73e9f740 20 client.15402 trim_cache size 0 max 16384 2024-09-19T06:09:52.822 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-19T06:09:52.822 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 20, 2024-09-19T06:09:52.822 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 24485, 2024-09-19T06:09:52.822 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 16, 2024-09-19T06:09:52.823 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": {} 2024-09-19T06:09:52.823 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-19T06:09:52.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.813+0000 7f0c71ac6640 1 -- 172.21.15.37:0/3088841486 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f0c540a3240 msgr2=0x7f0c540a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:52.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.813+0000 7f0c71ac6640 1 --2- 172.21.15.37:0/3088841486 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f0c540a3240 0x7f0c540a5700 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0c64031550 tx=0x7f0c64009260 comp rx=0 tx=0).stop 2024-09-19T06:09:52.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.813+0000 7f0c71ac6640 1 -- 172.21.15.37:0/3088841486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c6c1036e0 msgr2=0x7f0c6c19aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:52.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.813+0000 7f0c71ac6640 1 --2- 172.21.15.37:0/3088841486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c6c1036e0 0x7f0c6c19aba0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f0c6000c8c0 tx=0x7f0c6000cd80 comp rx=0 tx=0).stop 2024-09-19T06:09:52.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.813+0000 7f0c71ac6640 1 -- 172.21.15.37:0/3088841486 shutdown_connections 2024-09-19T06:09:52.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.813+0000 7f0c71ac6640 1 --2- 172.21.15.37:0/3088841486 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f0c540a3240 0x7f0c540a5700 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:52.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.813+0000 7f0c71ac6640 1 --2- 172.21.15.37:0/3088841486 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c6c1082a0 0x7f0c6c19ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:52.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.813+0000 7f0c71ac6640 1 --2- 172.21.15.37:0/3088841486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c6c1036e0 0x7f0c6c19aba0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:52.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.813+0000 7f0c71ac6640 1 --2- 172.21.15.37:0/3088841486 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c6c102d30 0x7f0c6c19a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:52.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.813+0000 7f0c71ac6640 1 -- 172.21.15.37:0/3088841486 >> 172.21.15.37:0/3088841486 conn(0x7f0c6c0fc7d0 msgr2=0x7f0c6c1010f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:52.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.813+0000 7f0c71ac6640 1 -- 172.21.15.37:0/3088841486 shutdown_connections 2024-09-19T06:09:52.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:52.813+0000 7f0c71ac6640 1 -- 172.21.15.37:0/3088841486 wait complete. 2024-09-19T06:09:53.625 INFO:tasks.quiescer:done joining Quiescers 2024-09-19T06:09:53.625 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-19T06:09:53.637 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T06:09:53.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:53.777+0000 7f0eddd2c640 1 -- 172.21.15.37:0/3381619765 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ed8104ec0 msgr2=0x7f0ed81072b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:53.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:53.777+0000 7f0eddd2c640 1 --2- 172.21.15.37:0/3381619765 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ed8104ec0 0x7f0ed81072b0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc009900 tx=0x7f0ecc02a410 comp rx=0 tx=0).stop 2024-09-19T06:09:53.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:53.777+0000 7f0eddd2c640 1 -- 172.21.15.37:0/3381619765 shutdown_connections 2024-09-19T06:09:53.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:53.777+0000 7f0eddd2c640 1 --2- 172.21.15.37:0/3381619765 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ed81077f0 0x7f0ed8109c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:53.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:53.777+0000 7f0eddd2c640 1 --2- 172.21.15.37:0/3381619765 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ed8104ec0 0x7f0ed81072b0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:53.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:53.777+0000 7f0eddd2c640 1 --2- 172.21.15.37:0/3381619765 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ed8102590 0x7f0ed8104980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:53.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:53.777+0000 7f0eddd2c640 1 -- 172.21.15.37:0/3381619765 >> 172.21.15.37:0/3381619765 conn(0x7f0ed80fc170 msgr2=0x7f0ed80fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:53.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:53.777+0000 7f0eddd2c640 1 -- 172.21.15.37:0/3381619765 shutdown_connections 2024-09-19T06:09:53.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:53.777+0000 7f0eddd2c640 1 -- 172.21.15.37:0/3381619765 wait complete. 2024-09-19T06:09:53.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:53.778+0000 7f0eddd2c640 1 Processor -- start 2024-09-19T06:09:53.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:53.778+0000 7f0eddd2c640 1 -- start start 2024-09-19T06:09:53.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:53.778+0000 7f0eddd2c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ed8102590 0x7f0ed8101f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:53.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:53.778+0000 7f0eddd2c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ed8104ec0 0x7f0ed8100540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:53.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:53.778+0000 7f0eddd2c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ed81077f0 0x7f0ed8100a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:53.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:53.778+0000 7f0eddd2c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed810d7d0 con 0x7f0ed8104ec0 2024-09-19T06:09:53.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:53.778+0000 7f0eddd2c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed810d650 con 0x7f0ed81077f0 2024-09-19T06:09:53.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:53.778+0000 7f0eddd2c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed810d950 con 0x7f0ed8102590 2024-09-19T06:09:53.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:53.778+0000 7f0ed6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ed8104ec0 0x7f0ed8100540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:53.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:53.778+0000 7f0ed6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ed8104ec0 0x7f0ed8100540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33952/0 (socket says 172.21.15.37:33952) 2024-09-19T06:09:53.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:53.778+0000 7f0ed6ffd640 1 -- 172.21.15.37:0/1636938752 learned_addr learned my addr 172.21.15.37:0/1636938752 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:09:53.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:53.778+0000 7f0ed77fe640 1 --2- 172.21.15.37:0/1636938752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ed8102590 0x7f0ed8101f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:53.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:53.778+0000 7f0ed7fff640 1 --2- 172.21.15.37:0/1636938752 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ed81077f0 0x7f0ed8100a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:53.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:53.779+0000 7f0ed6ffd640 1 -- 172.21.15.37:0/1636938752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ed8102590 msgr2=0x7f0ed8101f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:53.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:53.779+0000 7f0ed6ffd640 1 --2- 172.21.15.37:0/1636938752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ed8102590 0x7f0ed8101f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:53.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:53.779+0000 7f0ed6ffd640 1 -- 172.21.15.37:0/1636938752 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ed81077f0 msgr2=0x7f0ed8100a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:53.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:53.779+0000 7f0ed6ffd640 1 --2- 172.21.15.37:0/1636938752 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ed81077f0 0x7f0ed8100a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:53.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:53.779+0000 7f0ed6ffd640 1 -- 172.21.15.37:0/1636938752 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ed8101310 con 0x7f0ed8104ec0 2024-09-19T06:09:53.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:53.779+0000 7f0ed7fff640 1 --2- 172.21.15.37:0/1636938752 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ed81077f0 0x7f0ed8100a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:09:53.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:53.779+0000 7f0ed6ffd640 1 --2- 172.21.15.37:0/1636938752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ed8104ec0 0x7f0ed8100540 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc031610 tx=0x7f0ecc0043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:53.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:53.779+0000 7f0ed4ff9640 1 -- 172.21.15.37:0/1636938752 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc03f030 con 0x7f0ed8104ec0 2024-09-19T06:09:53.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:53.779+0000 7f0ed4ff9640 1 -- 172.21.15.37:0/1636938752 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ecc003ce0 con 0x7f0ed8104ec0 2024-09-19T06:09:53.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:53.779+0000 7f0ed4ff9640 1 -- 172.21.15.37:0/1636938752 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc035070 con 0x7f0ed8104ec0 2024-09-19T06:09:53.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:53.779+0000 7f0eddd2c640 1 -- 172.21.15.37:0/1636938752 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ed81a1f70 con 0x7f0ed8104ec0 2024-09-19T06:09:53.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:53.779+0000 7f0eddd2c640 1 -- 172.21.15.37:0/1636938752 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ed81a23d0 con 0x7f0ed8104ec0 2024-09-19T06:09:53.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:53.780+0000 7f0eddd2c640 1 -- 172.21.15.37:0/1636938752 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ed80fdc60 con 0x7f0ed8104ec0 2024-09-19T06:09:53.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:53.781+0000 7f0ed4ff9640 1 -- 172.21.15.37:0/1636938752 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f0ecc042030 con 0x7f0ed8104ec0 2024-09-19T06:09:53.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:53.782+0000 7f0ed4ff9640 1 --2- 172.21.15.37:0/1636938752 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f0ec00a3250 0x7f0ec00a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:53.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:53.782+0000 7f0ed4ff9640 1 -- 172.21.15.37:0/1636938752 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9121+0+0 (secure 0 0 0) 0x7f0ecc0f01e0 con 0x7f0ed8104ec0 2024-09-19T06:09:53.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:53.782+0000 7f0ed77fe640 1 --2- 172.21.15.37:0/1636938752 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f0ec00a3250 0x7f0ec00a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:53.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:53.783+0000 7f0ed77fe640 1 --2- 172.21.15.37:0/1636938752 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f0ec00a3250 0x7f0ec00a5710 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0ec800bbe0 tx=0x7f0ec800b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:53.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:53.786+0000 7f0ed4ff9640 1 -- 172.21.15.37:0/1636938752 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0ecc0bcb80 con 0x7f0ed8104ec0 2024-09-19T06:09:53.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:53.965+0000 7f0eddd2c640 1 -- 172.21.15.37:0/1636938752 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0ed8062ef0 con 0x7f0ed8104ec0 2024-09-19T06:09:53.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:53.966+0000 7f0ed4ff9640 1 -- 172.21.15.37:0/1636938752 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+24772 (secure 0 0 0) 0x7f0ecc0bc480 con 0x7f0ed8104ec0 2024-09-19T06:09:53.969 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T06:09:53.969 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":91,"fsid":"b8c8bdae-764b-11ef-bceb-c7b262605968","created":"2024-09-19T05:56:22.523060+0000","modified":"2024-09-19T06:06:14.642042+0000","last_up_change":"2024-09-19T06:03:12.771014+0000","last_in_change":"2024-09-19T06:02:49.926626+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:59:27.062607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:04:01.918234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:04:04.392543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T06:04:10.877951+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"455bc11d-2b6e-4a0c-90d9-8ab4ef4f9e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1783875173},{"type":"v1","addr":"172.21.15.37:6803","nonce":1783875173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1783875173},{"type":"v1","addr":"172.21.15.37:6805","nonce":1783875173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1783875173},{"type":"v1","addr":"172.21.15.37:6809","nonce":1783875173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1783875173},{"type":"v1","addr":"172.21.15.37:6807","nonce":1783875173}]},"public_addr":"172.21.15.37:6803/1783875173","cluster_addr":"172.21.15.37:6805/1783875173","heartbeat_back_addr":"172.21.15.37:6809/1783875173","heartbeat_front_addr":"172.21.15.37:6807/1783875173","state":["exists","up"]},{"osd":1,"uuid":"3505c162-c342-479d-8ea2-15b7a9d625cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":3414373360},{"type":"v1","addr":"172.21.15.99:6801","nonce":3414373360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":3414373360},{"type":"v1","addr":"172.21.15.99:6803","nonce":3414373360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":3414373360},{"type":"v1","addr":"172.21.15.99:6807","nonce":3414373360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":3414373360},{"type":"v1","addr":"172.21.15.99:6805","nonce":3414373360}]},"public_addr":"172.21.15.99:6801/3414373360","cluster_addr":"172.21.15.99:6803/3414373360","heartbeat_back_addr":"172.21.15.99:6807/3414373360","heartbeat_front_addr":"172.21.15.99:6805/3414373360","state":["exists","up"]},{"osd":2,"uuid":"736ec67f-b5e7-43f0-9303-0c88878ead6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3794943081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3794943081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3794943081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3794943081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3794943081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3794943081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3794943081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3794943081}]},"public_addr":"172.21.15.117:6801/3794943081","cluster_addr":"172.21.15.117:6803/3794943081","heartbeat_back_addr":"172.21.15.117:6807/3794943081","heartbeat_front_addr":"172.21.15.117:6805/3794943081","state":["exists","up"]},{"osd":3,"uuid":"3f784ef7-0cc1-4c86-a03a-b8f13396c835","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2121011955},{"type":"v1","addr":"172.21.15.37:6811","nonce":2121011955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2121011955},{"type":"v1","addr":"172.21.15.37:6813","nonce":2121011955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2121011955},{"type":"v1","addr":"172.21.15.37:6817","nonce":2121011955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2121011955},{"type":"v1","addr":"172.21.15.37:6815","nonce":2121011955}]},"public_addr":"172.21.15.37:6811/2121011955","cluster_addr":"172.21.15.37:6813/2121011955","heartbeat_back_addr":"172.21.15.37:6817/2121011955","heartbeat_front_addr":"172.21.15.37:6815/2121011955","state":["exists","up"]},{"osd":4,"uuid":"d7c16e7f-f599-419b-b4a2-fd6c1cafa0d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":1881025735},{"type":"v1","addr":"172.21.15.99:6809","nonce":1881025735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1881025735},{"type":"v1","addr":"172.21.15.99:6811","nonce":1881025735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1881025735},{"type":"v1","addr":"172.21.15.99:6815","nonce":1881025735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":1881025735},{"type":"v1","addr":"172.21.15.99:6813","nonce":1881025735}]},"public_addr":"172.21.15.99:6809/1881025735","cluster_addr":"172.21.15.99:6811/1881025735","heartbeat_back_addr":"172.21.15.99:6815/1881025735","heartbeat_front_addr":"172.21.15.99:6813/1881025735","state":["exists","up"]},{"osd":5,"uuid":"2f499ab4-3d09-4f96-a709-b4229865c690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1141976511},{"type":"v1","addr":"172.21.15.117:6809","nonce":1141976511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1141976511},{"type":"v1","addr":"172.21.15.117:6811","nonce":1141976511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1141976511},{"type":"v1","addr":"172.21.15.117:6815","nonce":1141976511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1141976511},{"type":"v1","addr":"172.21.15.117:6813","nonce":1141976511}]},"public_addr":"172.21.15.117:6809/1141976511","cluster_addr":"172.21.15.117:6811/1141976511","heartbeat_back_addr":"172.21.15.117:6815/1141976511","heartbeat_front_addr":"172.21.15.117:6813/1141976511","state":["exists","up"]},{"osd":6,"uuid":"10f7fd72-1ae8-4efd-a448-75f4b5054be3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":770433145},{"type":"v1","addr":"172.21.15.37:6819","nonce":770433145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":770433145},{"type":"v1","addr":"172.21.15.37:6821","nonce":770433145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":770433145},{"type":"v1","addr":"172.21.15.37:6825","nonce":770433145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":770433145},{"type":"v1","addr":"172.21.15.37:6823","nonce":770433145}]},"public_addr":"172.21.15.37:6819/770433145","cluster_addr":"172.21.15.37:6821/770433145","heartbeat_back_addr":"172.21.15.37:6825/770433145","heartbeat_front_addr":"172.21.15.37:6823/770433145","state":["exists","up"]},{"osd":7,"uuid":"7199a267-c486-417c-b530-3ff03fc9eb1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1694360992},{"type":"v1","addr":"172.21.15.99:6817","nonce":1694360992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1694360992},{"type":"v1","addr":"172.21.15.99:6819","nonce":1694360992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":1694360992},{"type":"v1","addr":"172.21.15.99:6823","nonce":1694360992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":1694360992},{"type":"v1","addr":"172.21.15.99:6821","nonce":1694360992}]},"public_addr":"172.21.15.99:6817/1694360992","cluster_addr":"172.21.15.99:6819/1694360992","heartbeat_back_addr":"172.21.15.99:6823/1694360992","heartbeat_front_addr":"172.21.15.99:6821/1694360992","state":["exists","up"]},{"osd":8,"uuid":"8d5bb83c-62eb-4ded-8a16-e8d57ab102c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2005866772},{"type":"v1","addr":"172.21.15.117:6817","nonce":2005866772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2005866772},{"type":"v1","addr":"172.21.15.117:6819","nonce":2005866772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2005866772},{"type":"v1","addr":"172.21.15.117:6823","nonce":2005866772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2005866772},{"type":"v1","addr":"172.21.15.117:6821","nonce":2005866772}]},"public_addr":"172.21.15.117:6817/2005866772","cluster_addr":"172.21.15.117:6819/2005866772","heartbeat_back_addr":"172.21.15.117:6823/2005866772","heartbeat_front_addr":"172.21.15.117:6821/2005866772","state":["exists","up"]},{"osd":9,"uuid":"04b6203d-a10c-4a55-8e59-b30012dee02b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1398779376},{"type":"v1","addr":"172.21.15.37:6827","nonce":1398779376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1398779376},{"type":"v1","addr":"172.21.15.37:6829","nonce":1398779376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1398779376},{"type":"v1","addr":"172.21.15.37:6833","nonce":1398779376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1398779376},{"type":"v1","addr":"172.21.15.37:6831","nonce":1398779376}]},"public_addr":"172.21.15.37:6827/1398779376","cluster_addr":"172.21.15.37:6829/1398779376","heartbeat_back_addr":"172.21.15.37:6833/1398779376","heartbeat_front_addr":"172.21.15.37:6831/1398779376","state":["exists","up"]},{"osd":10,"uuid":"bbf8ff4b-29cd-4d56-a30e-ff2de3555f78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2200957302},{"type":"v1","addr":"172.21.15.99:6825","nonce":2200957302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2200957302},{"type":"v1","addr":"172.21.15.99:6827","nonce":2200957302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2200957302},{"type":"v1","addr":"172.21.15.99:6831","nonce":2200957302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2200957302},{"type":"v1","addr":"172.21.15.99:6829","nonce":2200957302}]},"public_addr":"172.21.15.99:6825/2200957302","cluster_addr":"172.21.15.99:6827/2200957302","heartbeat_back_addr":"172.21.15.99:6831/2200957302","heartbeat_front_addr":"172.21.15.99:6829/2200957302","state":["exists","up"]},{"osd":11,"uuid":"041d54f4-a274-47b5-a467-0ce86efd363b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":1354423136},{"type":"v1","addr":"172.21.15.117:6825","nonce":1354423136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":1354423136},{"type":"v1","addr":"172.21.15.117:6827","nonce":1354423136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":1354423136},{"type":"v1","addr":"172.21.15.117:6831","nonce":1354423136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":1354423136},{"type":"v1","addr":"172.21.15.117:6829","nonce":1354423136}]},"public_addr":"172.21.15.117:6825/1354423136","cluster_addr":"172.21.15.117:6827/1354423136","heartbeat_back_addr":"172.21.15.117:6831/1354423136","heartbeat_front_addr":"172.21.15.117:6829/1354423136","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:58:33.697099+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:58:59.641549+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:59:23.811178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:59:49.550214+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:00:15.034610+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:00:39.399651+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:01:05.106379+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:01:30.375956+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:01:54.881549+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:02:21.519316+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:02:46.125918+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:03:11.310862+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.f","mappings":[{"from":9,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6801/133577710":"2024-09-20T05:57:12.560771+0000","172.21.15.37:6800/133577710":"2024-09-20T05:57:12.560771+0000","172.21.15.37:0/2877363162":"2024-09-20T05:57:12.560771+0000","172.21.15.37:0/1053171617":"2024-09-20T05:57:12.560771+0000","172.21.15.37:6800/3277805697":"2024-09-20T05:56:49.335334+0000","172.21.15.37:0/1280697705":"2024-09-20T05:56:49.335334+0000","172.21.15.37:0/1106526058":"2024-09-20T05:57:12.560771+0000","172.21.15.37:0/1978184693":"2024-09-20T05:56:49.335334+0000","172.21.15.37:6801/3277805697":"2024-09-20T05:56:49.335334+0000","172.21.15.37:0/3650338877":"2024-09-20T05:56:49.335334+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:09:53.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:53.968+0000 7f0eddd2c640 1 -- 172.21.15.37:0/1636938752 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f0ec00a3250 msgr2=0x7f0ec00a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:53.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:53.968+0000 7f0eddd2c640 1 --2- 172.21.15.37:0/1636938752 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f0ec00a3250 0x7f0ec00a5710 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0ec800bbe0 tx=0x7f0ec800b390 comp rx=0 tx=0).stop 2024-09-19T06:09:53.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:53.968+0000 7f0eddd2c640 1 -- 172.21.15.37:0/1636938752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ed8104ec0 msgr2=0x7f0ed8100540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:53.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:53.968+0000 7f0eddd2c640 1 --2- 172.21.15.37:0/1636938752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ed8104ec0 0x7f0ed8100540 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc031610 tx=0x7f0ecc0043b0 comp rx=0 tx=0).stop 2024-09-19T06:09:53.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:53.968+0000 7f0eddd2c640 1 -- 172.21.15.37:0/1636938752 shutdown_connections 2024-09-19T06:09:53.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:53.968+0000 7f0eddd2c640 1 --2- 172.21.15.37:0/1636938752 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f0ec00a3250 0x7f0ec00a5710 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:53.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:53.968+0000 7f0eddd2c640 1 --2- 172.21.15.37:0/1636938752 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ed81077f0 0x7f0ed8100a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:53.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:53.968+0000 7f0eddd2c640 1 --2- 172.21.15.37:0/1636938752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ed8104ec0 0x7f0ed8100540 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:53.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:53.968+0000 7f0eddd2c640 1 --2- 172.21.15.37:0/1636938752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ed8102590 0x7f0ed8101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:53.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:53.968+0000 7f0eddd2c640 1 -- 172.21.15.37:0/1636938752 >> 172.21.15.37:0/1636938752 conn(0x7f0ed80fc170 msgr2=0x7f0ed8103030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:53.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:53.968+0000 7f0eddd2c640 1 -- 172.21.15.37:0/1636938752 shutdown_connections 2024-09-19T06:09:53.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:53.968+0000 7f0eddd2c640 1 -- 172.21.15.37:0/1636938752 wait complete. 2024-09-19T06:09:53.980 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:09:53 smithi037 ceph-mon[31211]: pgmap v461: 129 pgs: 129 active+clean; 149 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 250 op/s 2024-09-19T06:09:53.982 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T05:59:27.062607+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-19T06:04:01.918234+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-19T06:04:04.392543+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-19T06:04:10.877951+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-19T06:09:53.983 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T06:09:54.052 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:09:53 smithi117 ceph-mon[35050]: pgmap v461: 129 pgs: 129 active+clean; 149 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 250 op/s 2024-09-19T06:09:54.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.087+0000 7f0ed309b640 1 -- 172.21.15.37:0/1616158968 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ecc102d10 msgr2=0x7f0ecc103190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:54.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.087+0000 7f0ed309b640 1 --2- 172.21.15.37:0/1616158968 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ecc102d10 0x7f0ecc103190 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8009900 tx=0x7f0eb802a410 comp rx=0 tx=0).stop 2024-09-19T06:09:54.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.087+0000 7f0ed309b640 1 -- 172.21.15.37:0/1616158968 shutdown_connections 2024-09-19T06:09:54.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.087+0000 7f0ed309b640 1 --2- 172.21.15.37:0/1616158968 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ecc1036d0 0x7f0ecc109f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:54.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.087+0000 7f0ed309b640 1 --2- 172.21.15.37:0/1616158968 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ecc102d10 0x7f0ecc103190 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:54.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.087+0000 7f0ed309b640 1 --2- 172.21.15.37:0/1616158968 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ecc101b20 0x7f0ecc101f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:54.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.087+0000 7f0ed309b640 1 -- 172.21.15.37:0/1616158968 >> 172.21.15.37:0/1616158968 conn(0x7f0ecc0fd2a0 msgr2=0x7f0ecc0ff6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:54.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.087+0000 7f0ed309b640 1 -- 172.21.15.37:0/1616158968 shutdown_connections 2024-09-19T06:09:54.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.087+0000 7f0ed309b640 1 -- 172.21.15.37:0/1616158968 wait complete. 2024-09-19T06:09:54.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.088+0000 7f0ed309b640 1 Processor -- start 2024-09-19T06:09:54.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.088+0000 7f0ed309b640 1 -- start start 2024-09-19T06:09:54.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.088+0000 7f0ed309b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ecc101b20 0x7f0ecc197e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:54.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.088+0000 7f0ed309b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ecc102d10 0x7f0ecc1983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:54.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.088+0000 7f0ed309b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ecc1036d0 0x7f0ecc19f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:54.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.088+0000 7f0ed309b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0ecc10d7d0 con 0x7f0ecc1036d0 2024-09-19T06:09:54.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.088+0000 7f0ed309b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f0ecc10d650 con 0x7f0ecc102d10 2024-09-19T06:09:54.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.088+0000 7f0ed309b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0ecc10d950 con 0x7f0ecc101b20 2024-09-19T06:09:54.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.088+0000 7f0ed1638640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ecc1036d0 0x7f0ecc19f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:54.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.088+0000 7f0ed1638640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ecc1036d0 0x7f0ecc19f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33964/0 (socket says 172.21.15.37:33964) 2024-09-19T06:09:54.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.088+0000 7f0ed1638640 1 -- 172.21.15.37:0/1003339642 learned_addr learned my addr 172.21.15.37:0/1003339642 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:09:54.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.088+0000 7f0ed0e37640 1 --2- 172.21.15.37:0/1003339642 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ecc101b20 0x7f0ecc197e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:54.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.088+0000 7f0ecbfff640 1 --2- 172.21.15.37:0/1003339642 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ecc102d10 0x7f0ecc1983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:54.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.088+0000 7f0ed1638640 1 -- 172.21.15.37:0/1003339642 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ecc101b20 msgr2=0x7f0ecc197e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:54.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.088+0000 7f0ed1638640 1 --2- 172.21.15.37:0/1003339642 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ecc101b20 0x7f0ecc197e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:54.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.088+0000 7f0ed1638640 1 -- 172.21.15.37:0/1003339642 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ecc102d10 msgr2=0x7f0ecc1983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:54.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.088+0000 7f0ed1638640 1 --2- 172.21.15.37:0/1003339642 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ecc102d10 0x7f0ecc1983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:54.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.088+0000 7f0ed1638640 1 -- 172.21.15.37:0/1003339642 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ecc19faa0 con 0x7f0ecc1036d0 2024-09-19T06:09:54.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.088+0000 7f0ed0e37640 1 --2- 172.21.15.37:0/1003339642 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ecc101b20 0x7f0ecc197e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:09:54.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.088+0000 7f0ed1638640 1 --2- 172.21.15.37:0/1003339642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ecc1036d0 0x7f0ecc19f430 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f0ec400eaa0 tx=0x7f0ec400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:54.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.089+0000 7f0ec9ffb640 1 -- 172.21.15.37:0/1003339642 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec400cdb0 con 0x7f0ecc1036d0 2024-09-19T06:09:54.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.089+0000 7f0ec9ffb640 1 -- 172.21.15.37:0/1003339642 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ec4005020 con 0x7f0ecc1036d0 2024-09-19T06:09:54.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.089+0000 7f0ed309b640 1 -- 172.21.15.37:0/1003339642 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ecc19fd90 con 0x7f0ecc1036d0 2024-09-19T06:09:54.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.089+0000 7f0ec9ffb640 1 -- 172.21.15.37:0/1003339642 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec40116b0 con 0x7f0ecc1036d0 2024-09-19T06:09:54.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.089+0000 7f0ed309b640 1 -- 172.21.15.37:0/1003339642 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ecc1a0200 con 0x7f0ecc1036d0 2024-09-19T06:09:54.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.090+0000 7f0ed309b640 1 -- 172.21.15.37:0/1003339642 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ecc108fb0 con 0x7f0ecc1036d0 2024-09-19T06:09:54.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.091+0000 7f0ec9ffb640 1 -- 172.21.15.37:0/1003339642 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f0ec4005560 con 0x7f0ecc1036d0 2024-09-19T06:09:54.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.092+0000 7f0ec9ffb640 1 --2- 172.21.15.37:0/1003339642 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f0ebc0a3250 0x7f0ebc0a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:54.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.092+0000 7f0ed0e37640 1 --2- 172.21.15.37:0/1003339642 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f0ebc0a3250 0x7f0ebc0a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:54.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.092+0000 7f0ec9ffb640 1 -- 172.21.15.37:0/1003339642 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9121+0+0 (secure 0 0 0) 0x7f0ec40cfff0 con 0x7f0ecc1036d0 2024-09-19T06:09:54.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.092+0000 7f0ed0e37640 1 --2- 172.21.15.37:0/1003339642 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f0ebc0a3250 0x7f0ebc0a5710 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0ec00058c0 tx=0x7f0ec0005850 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:54.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.096+0000 7f0ec9ffb640 1 -- 172.21.15.37:0/1003339642 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0ec4016030 con 0x7f0ecc1036d0 2024-09-19T06:09:54.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:09:53 smithi099 ceph-mon[35300]: pgmap v461: 129 pgs: 129 active+clean; 149 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 250 op/s 2024-09-19T06:09:54.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.272+0000 7f0ed309b640 1 -- 172.21.15.37:0/1003339642 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0ecc062e90 con 0x7f0ecc1036d0 2024-09-19T06:09:54.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.273+0000 7f0ec9ffb640 1 -- 172.21.15.37:0/1003339642 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) ==== 93+0+10 (secure 0 0 0) 0x7f0ec409c930 con 0x7f0ecc1036d0 2024-09-19T06:09:54.275 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-09-19T06:09:54.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.275+0000 7f0ed309b640 1 -- 172.21.15.37:0/1003339642 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f0ebc0a3250 msgr2=0x7f0ebc0a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:54.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.275+0000 7f0ed309b640 1 --2- 172.21.15.37:0/1003339642 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f0ebc0a3250 0x7f0ebc0a5710 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0ec00058c0 tx=0x7f0ec0005850 comp rx=0 tx=0).stop 2024-09-19T06:09:54.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.275+0000 7f0ed309b640 1 -- 172.21.15.37:0/1003339642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ecc1036d0 msgr2=0x7f0ecc19f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:54.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.275+0000 7f0ed309b640 1 --2- 172.21.15.37:0/1003339642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ecc1036d0 0x7f0ecc19f430 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f0ec400eaa0 tx=0x7f0ec400ef60 comp rx=0 tx=0).stop 2024-09-19T06:09:54.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.275+0000 7f0ed309b640 1 -- 172.21.15.37:0/1003339642 shutdown_connections 2024-09-19T06:09:54.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.275+0000 7f0ed309b640 1 --2- 172.21.15.37:0/1003339642 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f0ebc0a3250 0x7f0ebc0a5710 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:54.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.275+0000 7f0ed309b640 1 --2- 172.21.15.37:0/1003339642 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ecc102d10 0x7f0ecc1983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:54.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.275+0000 7f0ed309b640 1 --2- 172.21.15.37:0/1003339642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ecc1036d0 0x7f0ecc19f430 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:54.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.275+0000 7f0ed309b640 1 --2- 172.21.15.37:0/1003339642 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ecc101b20 0x7f0ecc197e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:54.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.275+0000 7f0ed309b640 1 -- 172.21.15.37:0/1003339642 >> 172.21.15.37:0/1003339642 conn(0x7f0ecc0fd2a0 msgr2=0x7f0ecc106180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:54.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.275+0000 7f0ed309b640 1 -- 172.21.15.37:0/1003339642 shutdown_connections 2024-09-19T06:09:54.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.275+0000 7f0ed309b640 1 -- 172.21.15.37:0/1003339642 wait complete. 2024-09-19T06:09:54.289 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-19T06:09:54.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.393+0000 7fedd1511640 1 -- 172.21.15.37:0/1418133641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedcc104eb0 msgr2=0x7fedcc1072a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:54.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.393+0000 7fedd1511640 1 --2- 172.21.15.37:0/1418133641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedcc104eb0 0x7fedcc1072a0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fedc0009900 tx=0x7fedc002a410 comp rx=0 tx=0).stop 2024-09-19T06:09:54.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.393+0000 7fedd1511640 1 -- 172.21.15.37:0/1418133641 shutdown_connections 2024-09-19T06:09:54.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.393+0000 7fedd1511640 1 --2- 172.21.15.37:0/1418133641 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fedcc1077e0 0x7fedcc109c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:54.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.393+0000 7fedd1511640 1 --2- 172.21.15.37:0/1418133641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedcc104eb0 0x7fedcc1072a0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:54.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.393+0000 7fedd1511640 1 --2- 172.21.15.37:0/1418133641 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fedcc102580 0x7fedcc104970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:54.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.393+0000 7fedd1511640 1 -- 172.21.15.37:0/1418133641 >> 172.21.15.37:0/1418133641 conn(0x7fedcc0fc140 msgr2=0x7fedcc0fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:54.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.393+0000 7fedd1511640 1 -- 172.21.15.37:0/1418133641 shutdown_connections 2024-09-19T06:09:54.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.393+0000 7fedd1511640 1 -- 172.21.15.37:0/1418133641 wait complete. 2024-09-19T06:09:54.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.394+0000 7fedd1511640 1 Processor -- start 2024-09-19T06:09:54.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.394+0000 7fedd1511640 1 -- start start 2024-09-19T06:09:54.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.394+0000 7fedd1511640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fedcc102580 0x7fedcc197e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:54.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.394+0000 7fedd1511640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedcc104eb0 0x7fedcc1983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:54.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.394+0000 7fedd1511640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fedcc1077e0 0x7fedcc19f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:54.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.394+0000 7fedd1511640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fedcc10d810 con 0x7fedcc104eb0 2024-09-19T06:09:54.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.394+0000 7fedd1511640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fedcc10d690 con 0x7fedcc1077e0 2024-09-19T06:09:54.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.394+0000 7fedd1511640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fedcc10d990 con 0x7fedcc102580 2024-09-19T06:09:54.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.395+0000 7fedca7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedcc104eb0 0x7fedcc1983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:54.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.395+0000 7fedca7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedcc104eb0 0x7fedcc1983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33976/0 (socket says 172.21.15.37:33976) 2024-09-19T06:09:54.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.395+0000 7fedca7fc640 1 -- 172.21.15.37:0/2506902319 learned_addr learned my addr 172.21.15.37:0/2506902319 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:09:54.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.395+0000 7fedcaffd640 1 --2- 172.21.15.37:0/2506902319 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fedcc102580 0x7fedcc197e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:54.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.395+0000 7fedcb7fe640 1 --2- 172.21.15.37:0/2506902319 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fedcc1077e0 0x7fedcc19f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:54.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.395+0000 7fedca7fc640 1 -- 172.21.15.37:0/2506902319 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fedcc102580 msgr2=0x7fedcc197e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:54.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.395+0000 7fedca7fc640 1 --2- 172.21.15.37:0/2506902319 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fedcc102580 0x7fedcc197e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:54.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.395+0000 7fedca7fc640 1 -- 172.21.15.37:0/2506902319 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fedcc1077e0 msgr2=0x7fedcc19f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:54.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.395+0000 7fedca7fc640 1 --2- 172.21.15.37:0/2506902319 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fedcc1077e0 0x7fedcc19f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:54.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.395+0000 7fedca7fc640 1 -- 172.21.15.37:0/2506902319 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedcc19fab0 con 0x7fedcc104eb0 2024-09-19T06:09:54.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.395+0000 7fedcb7fe640 1 --2- 172.21.15.37:0/2506902319 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fedcc1077e0 0x7fedcc19f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:09:54.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.395+0000 7fedca7fc640 1 --2- 172.21.15.37:0/2506902319 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedcc104eb0 0x7fedcc1983d0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fedc0031610 tx=0x7fedc00043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:54.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.395+0000 7fedb3fff640 1 -- 172.21.15.37:0/2506902319 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc003f030 con 0x7fedcc104eb0 2024-09-19T06:09:54.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.395+0000 7fedd1511640 1 -- 172.21.15.37:0/2506902319 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedcc19fd40 con 0x7fedcc104eb0 2024-09-19T06:09:54.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.395+0000 7fedb3fff640 1 -- 172.21.15.37:0/2506902319 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fedc0003ce0 con 0x7fedcc104eb0 2024-09-19T06:09:54.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.395+0000 7fedb3fff640 1 -- 172.21.15.37:0/2506902319 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc0035070 con 0x7fedcc104eb0 2024-09-19T06:09:54.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.395+0000 7fedd1511640 1 -- 172.21.15.37:0/2506902319 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedcc1a0250 con 0x7fedcc104eb0 2024-09-19T06:09:54.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.396+0000 7fedd1511640 1 -- 172.21.15.37:0/2506902319 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedcc0fdc30 con 0x7fedcc104eb0 2024-09-19T06:09:54.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.398+0000 7fedb3fff640 1 -- 172.21.15.37:0/2506902319 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fedc0042030 con 0x7fedcc104eb0 2024-09-19T06:09:54.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.398+0000 7fedb3fff640 1 --2- 172.21.15.37:0/2506902319 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fedb40a3250 0x7fedb40a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:54.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.398+0000 7fedcaffd640 1 --2- 172.21.15.37:0/2506902319 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fedb40a3250 0x7fedb40a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:54.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.398+0000 7fedb3fff640 1 -- 172.21.15.37:0/2506902319 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9121+0+0 (secure 0 0 0) 0x7fedc00f0530 con 0x7fedcc104eb0 2024-09-19T06:09:54.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.399+0000 7fedcaffd640 1 --2- 172.21.15.37:0/2506902319 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fedb40a3250 0x7fedb40a5710 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fedbc007ec0 tx=0x7fedbc0075b0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:54.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.402+0000 7fedb3fff640 1 -- 172.21.15.37:0/2506902319 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fedc00bced0 con 0x7fedcc104eb0 2024-09-19T06:09:54.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.579+0000 7fedd1511640 1 -- 172.21.15.37:0/2506902319 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fedcc02da10 con 0x7fedcc104eb0 2024-09-19T06:09:54.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.579+0000 7fedb3fff640 1 -- 172.21.15.37:0/2506902319 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v91) ==== 104+0+11 (secure 0 0 0) 0x7fedc00bc7d0 con 0x7fedcc104eb0 2024-09-19T06:09:54.581 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2024-09-19T06:09:54.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.581+0000 7fedd1511640 1 -- 172.21.15.37:0/2506902319 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fedb40a3250 msgr2=0x7fedb40a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:54.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.581+0000 7fedd1511640 1 --2- 172.21.15.37:0/2506902319 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fedb40a3250 0x7fedb40a5710 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fedbc007ec0 tx=0x7fedbc0075b0 comp rx=0 tx=0).stop 2024-09-19T06:09:54.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.581+0000 7fedd1511640 1 -- 172.21.15.37:0/2506902319 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedcc104eb0 msgr2=0x7fedcc1983d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:54.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.581+0000 7fedd1511640 1 --2- 172.21.15.37:0/2506902319 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedcc104eb0 0x7fedcc1983d0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fedc0031610 tx=0x7fedc00043b0 comp rx=0 tx=0).stop 2024-09-19T06:09:54.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.581+0000 7fedd1511640 1 -- 172.21.15.37:0/2506902319 shutdown_connections 2024-09-19T06:09:54.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.581+0000 7fedd1511640 1 --2- 172.21.15.37:0/2506902319 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fedb40a3250 0x7fedb40a5710 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:54.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.581+0000 7fedd1511640 1 --2- 172.21.15.37:0/2506902319 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fedcc1077e0 0x7fedcc19f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:54.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.581+0000 7fedd1511640 1 --2- 172.21.15.37:0/2506902319 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedcc104eb0 0x7fedcc1983d0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:54.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.581+0000 7fedd1511640 1 --2- 172.21.15.37:0/2506902319 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fedcc102580 0x7fedcc197e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:54.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.581+0000 7fedd1511640 1 -- 172.21.15.37:0/2506902319 >> 172.21.15.37:0/2506902319 conn(0x7fedcc0fc140 msgr2=0x7fedcc102ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:54.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.581+0000 7fedd1511640 1 -- 172.21.15.37:0/2506902319 shutdown_connections 2024-09-19T06:09:54.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.581+0000 7fedd1511640 1 -- 172.21.15.37:0/2506902319 wait complete. 2024-09-19T06:09:54.594 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-19T06:09:54.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.697+0000 7f27984a4640 1 -- 172.21.15.37:0/1233419569 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27901077e0 msgr2=0x7f2790109c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:54.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.697+0000 7f27984a4640 1 --2- 172.21.15.37:0/1233419569 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27901077e0 0x7f2790109c50 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f2788009900 tx=0x7f278802a3f0 comp rx=0 tx=0).stop 2024-09-19T06:09:54.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.697+0000 7f27984a4640 1 -- 172.21.15.37:0/1233419569 shutdown_connections 2024-09-19T06:09:54.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.697+0000 7f27984a4640 1 --2- 172.21.15.37:0/1233419569 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27901077e0 0x7f2790109c50 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:54.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.697+0000 7f27984a4640 1 --2- 172.21.15.37:0/1233419569 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2790104eb0 0x7f27901072a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:54.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.698+0000 7f27984a4640 1 --2- 172.21.15.37:0/1233419569 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2790102580 0x7f2790104970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:54.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.698+0000 7f27984a4640 1 -- 172.21.15.37:0/1233419569 >> 172.21.15.37:0/1233419569 conn(0x7f27900fc140 msgr2=0x7f27900fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:54.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.698+0000 7f27984a4640 1 -- 172.21.15.37:0/1233419569 shutdown_connections 2024-09-19T06:09:54.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.698+0000 7f27984a4640 1 -- 172.21.15.37:0/1233419569 wait complete. 2024-09-19T06:09:54.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.698+0000 7f27984a4640 1 Processor -- start 2024-09-19T06:09:54.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.698+0000 7f27984a4640 1 -- start start 2024-09-19T06:09:54.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.698+0000 7f27984a4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2790102580 0x7f2790101ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:54.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.698+0000 7f27984a4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2790104eb0 0x7f2790100530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:54.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.698+0000 7f27984a4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27901077e0 0x7f2790100a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:54.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.698+0000 7f27984a4640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f279010d7f0 con 0x7f2790102580 2024-09-19T06:09:54.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.698+0000 7f27984a4640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f279010d670 con 0x7f2790104eb0 2024-09-19T06:09:54.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.698+0000 7f27984a4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f279010d970 con 0x7f27901077e0 2024-09-19T06:09:54.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.698+0000 7f2796240640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2790102580 0x7f2790101ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:54.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.698+0000 7f2796240640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2790102580 0x7f2790101ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34006/0 (socket says 172.21.15.37:34006) 2024-09-19T06:09:54.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.698+0000 7f2796240640 1 -- 172.21.15.37:0/649124366 learned_addr learned my addr 172.21.15.37:0/649124366 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:09:54.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.699+0000 7f2795a3f640 1 --2- 172.21.15.37:0/649124366 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2790104eb0 0x7f2790100530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:54.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.699+0000 7f2796a41640 1 --2- 172.21.15.37:0/649124366 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27901077e0 0x7f2790100a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:54.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.699+0000 7f2796240640 1 -- 172.21.15.37:0/649124366 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27901077e0 msgr2=0x7f2790100a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:54.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.699+0000 7f2796240640 1 --2- 172.21.15.37:0/649124366 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27901077e0 0x7f2790100a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:54.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.699+0000 7f2796240640 1 -- 172.21.15.37:0/649124366 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2790104eb0 msgr2=0x7f2790100530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:54.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.699+0000 7f2796240640 1 --2- 172.21.15.37:0/649124366 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2790104eb0 0x7f2790100530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:54.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.699+0000 7f2796240640 1 -- 172.21.15.37:0/649124366 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2790101300 con 0x7f2790102580 2024-09-19T06:09:54.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.699+0000 7f2795a3f640 1 --2- 172.21.15.37:0/649124366 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2790104eb0 0x7f2790100530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:09:54.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.699+0000 7f2796240640 1 --2- 172.21.15.37:0/649124366 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2790102580 0x7f2790101ef0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f278000cce0 tx=0x7f278000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:54.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.699+0000 7f278f7fe640 1 -- 172.21.15.37:0/649124366 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f278000f650 con 0x7f2790102580 2024-09-19T06:09:54.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.699+0000 7f278f7fe640 1 -- 172.21.15.37:0/649124366 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f278000fcd0 con 0x7f2790102580 2024-09-19T06:09:54.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.699+0000 7f27984a4640 1 -- 172.21.15.37:0/649124366 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27901a1e60 con 0x7f2790102580 2024-09-19T06:09:54.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.699+0000 7f278f7fe640 1 -- 172.21.15.37:0/649124366 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2780018c70 con 0x7f2790102580 2024-09-19T06:09:54.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.699+0000 7f27984a4640 1 -- 172.21.15.37:0/649124366 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27901a22c0 con 0x7f2790102580 2024-09-19T06:09:54.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.700+0000 7f27984a4640 1 -- 172.21.15.37:0/649124366 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27900fdc30 con 0x7f2790102580 2024-09-19T06:09:54.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.702+0000 7f278f7fe640 1 -- 172.21.15.37:0/649124366 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f278000f7f0 con 0x7f2790102580 2024-09-19T06:09:54.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.702+0000 7f278f7fe640 1 --2- 172.21.15.37:0/649124366 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f27780a32d0 0x7f27780a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:54.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.702+0000 7f2795a3f640 1 --2- 172.21.15.37:0/649124366 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f27780a32d0 0x7f27780a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:54.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.702+0000 7f278f7fe640 1 -- 172.21.15.37:0/649124366 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9121+0+0 (secure 0 0 0) 0x7f27800d04a0 con 0x7f2790102580 2024-09-19T06:09:54.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.703+0000 7f2795a3f640 1 --2- 172.21.15.37:0/649124366 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f27780a32d0 0x7f27780a5790 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2790101c60 tx=0x7f278400a5c0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:54.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.706+0000 7f278f7fe640 1 -- 172.21.15.37:0/649124366 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2780014030 con 0x7f2790102580 2024-09-19T06:09:54.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.883+0000 7f27984a4640 1 -- 172.21.15.37:0/649124366 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f279002da70 con 0x7f2790102580 2024-09-19T06:09:54.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.884+0000 7f278f7fe640 1 -- 172.21.15.37:0/649124366 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v91) ==== 100+0+11 (secure 0 0 0) 0x7f278009cef0 con 0x7f2790102580 2024-09-19T06:09:54.886 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2024-09-19T06:09:54.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.886+0000 7f27984a4640 1 -- 172.21.15.37:0/649124366 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f27780a32d0 msgr2=0x7f27780a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:54.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.886+0000 7f27984a4640 1 --2- 172.21.15.37:0/649124366 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f27780a32d0 0x7f27780a5790 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2790101c60 tx=0x7f278400a5c0 comp rx=0 tx=0).stop 2024-09-19T06:09:54.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.886+0000 7f27984a4640 1 -- 172.21.15.37:0/649124366 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2790102580 msgr2=0x7f2790101ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:54.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.886+0000 7f27984a4640 1 --2- 172.21.15.37:0/649124366 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2790102580 0x7f2790101ef0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f278000cce0 tx=0x7f278000a620 comp rx=0 tx=0).stop 2024-09-19T06:09:54.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.886+0000 7f27984a4640 1 -- 172.21.15.37:0/649124366 shutdown_connections 2024-09-19T06:09:54.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.886+0000 7f27984a4640 1 --2- 172.21.15.37:0/649124366 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f27780a32d0 0x7f27780a5790 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:54.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.886+0000 7f27984a4640 1 --2- 172.21.15.37:0/649124366 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2790104eb0 0x7f2790100530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:54.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.886+0000 7f27984a4640 1 --2- 172.21.15.37:0/649124366 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27901077e0 0x7f2790100a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:54.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.886+0000 7f27984a4640 1 --2- 172.21.15.37:0/649124366 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2790102580 0x7f2790101ef0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:54.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.886+0000 7f27984a4640 1 -- 172.21.15.37:0/649124366 >> 172.21.15.37:0/649124366 conn(0x7f27900fc140 msgr2=0x7f2790102de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:54.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.886+0000 7f27984a4640 1 -- 172.21.15.37:0/649124366 shutdown_connections 2024-09-19T06:09:54.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:54.886+0000 7f27984a4640 1 -- 172.21.15.37:0/649124366 wait complete. 2024-09-19T06:09:54.898 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:09:54 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/1636938752' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:09:54.898 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:09:54 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/1003339642' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T06:09:54.898 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:09:54 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/2506902319' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T06:09:54.899 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-19T06:09:55.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.004+0000 7f1f5d850640 1 -- 172.21.15.37:0/2700138945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f58104ee0 msgr2=0x7f1f581072d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:55.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.004+0000 7f1f5d850640 1 --2- 172.21.15.37:0/2700138945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f58104ee0 0x7f1f581072d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f1f40009900 tx=0x7f1f4002a410 comp rx=0 tx=0).stop 2024-09-19T06:09:55.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.004+0000 7f1f5d850640 1 -- 172.21.15.37:0/2700138945 shutdown_connections 2024-09-19T06:09:55.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.004+0000 7f1f5d850640 1 --2- 172.21.15.37:0/2700138945 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f58107810 0x7f1f58109c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:55.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.004+0000 7f1f5d850640 1 --2- 172.21.15.37:0/2700138945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f58104ee0 0x7f1f581072d0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:55.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.004+0000 7f1f5d850640 1 --2- 172.21.15.37:0/2700138945 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f581025b0 0x7f1f581049a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:55.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.004+0000 7f1f5d850640 1 -- 172.21.15.37:0/2700138945 >> 172.21.15.37:0/2700138945 conn(0x7f1f580fc1b0 msgr2=0x7f1f580fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:55.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.004+0000 7f1f5d850640 1 -- 172.21.15.37:0/2700138945 shutdown_connections 2024-09-19T06:09:55.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.004+0000 7f1f5d850640 1 -- 172.21.15.37:0/2700138945 wait complete. 2024-09-19T06:09:55.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.005+0000 7f1f5d850640 1 Processor -- start 2024-09-19T06:09:55.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.005+0000 7f1f5d850640 1 -- start start 2024-09-19T06:09:55.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.005+0000 7f1f5d850640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f581025b0 0x7f1f58197f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:55.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.005+0000 7f1f5d850640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f58104ee0 0x7f1f581984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:55.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.005+0000 7f1f5d850640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f58107810 0x7f1f5819f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:55.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.005+0000 7f1f5d850640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5810d840 con 0x7f1f58104ee0 2024-09-19T06:09:55.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.005+0000 7f1f5d850640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5810d6c0 con 0x7f1f581025b0 2024-09-19T06:09:55.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.005+0000 7f1f5d850640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5810d9c0 con 0x7f1f58107810 2024-09-19T06:09:55.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.005+0000 7f1f4ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f58104ee0 0x7f1f581984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:55.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.005+0000 7f1f4ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f58104ee0 0x7f1f581984c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34028/0 (socket says 172.21.15.37:34028) 2024-09-19T06:09:55.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.005+0000 7f1f4ffff640 1 -- 172.21.15.37:0/2044466454 learned_addr learned my addr 172.21.15.37:0/2044466454 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:09:55.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.005+0000 7f1f56ffd640 1 --2- 172.21.15.37:0/2044466454 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f581025b0 0x7f1f58197f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:55.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.005+0000 7f1f577fe640 1 --2- 172.21.15.37:0/2044466454 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f58107810 0x7f1f5819f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:55.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.005+0000 7f1f4ffff640 1 -- 172.21.15.37:0/2044466454 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f58107810 msgr2=0x7f1f5819f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:55.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.005+0000 7f1f4ffff640 1 --2- 172.21.15.37:0/2044466454 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f58107810 0x7f1f5819f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:55.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.005+0000 7f1f4ffff640 1 -- 172.21.15.37:0/2044466454 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f581025b0 msgr2=0x7f1f58197f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:55.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.005+0000 7f1f4ffff640 1 --2- 172.21.15.37:0/2044466454 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f581025b0 0x7f1f58197f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:55.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.005+0000 7f1f4ffff640 1 -- 172.21.15.37:0/2044466454 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f5819fba0 con 0x7f1f58104ee0 2024-09-19T06:09:55.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.005+0000 7f1f577fe640 1 --2- 172.21.15.37:0/2044466454 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f58107810 0x7f1f5819f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:09:55.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.005+0000 7f1f56ffd640 1 --2- 172.21.15.37:0/2044466454 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f581025b0 0x7f1f58197f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:09:55.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.005+0000 7f1f4ffff640 1 --2- 172.21.15.37:0/2044466454 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f58104ee0 0x7f1f581984c0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f1f40006010 tx=0x7f1f40031b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:55.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.006+0000 7f1f5c84e640 1 -- 172.21.15.37:0/2044466454 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f4003f030 con 0x7f1f58104ee0 2024-09-19T06:09:55.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.006+0000 7f1f5c84e640 1 -- 172.21.15.37:0/2044466454 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f400044a0 con 0x7f1f58104ee0 2024-09-19T06:09:55.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.006+0000 7f1f5d850640 1 -- 172.21.15.37:0/2044466454 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f5819fe30 con 0x7f1f58104ee0 2024-09-19T06:09:55.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.006+0000 7f1f5c84e640 1 -- 172.21.15.37:0/2044466454 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f40035070 con 0x7f1f58104ee0 2024-09-19T06:09:55.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.006+0000 7f1f5d850640 1 -- 172.21.15.37:0/2044466454 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f581a0310 con 0x7f1f58104ee0 2024-09-19T06:09:55.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.007+0000 7f1f5d850640 1 -- 172.21.15.37:0/2044466454 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f580fdca0 con 0x7f1f58104ee0 2024-09-19T06:09:55.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.008+0000 7f1f5c84e640 1 -- 172.21.15.37:0/2044466454 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f1f40042030 con 0x7f1f58104ee0 2024-09-19T06:09:55.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.009+0000 7f1f5c84e640 1 --2- 172.21.15.37:0/2044466454 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f1f440a3250 0x7f1f440a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:55.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.009+0000 7f1f5c84e640 1 -- 172.21.15.37:0/2044466454 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9121+0+0 (secure 0 0 0) 0x7f1f400f0480 con 0x7f1f58104ee0 2024-09-19T06:09:55.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.009+0000 7f1f56ffd640 1 --2- 172.21.15.37:0/2044466454 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f1f440a3250 0x7f1f440a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:55.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.009+0000 7f1f56ffd640 1 --2- 172.21.15.37:0/2044466454 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f1f440a3250 0x7f1f440a5710 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1f480058c0 tx=0x7f1f48005850 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:55.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.012+0000 7f1f5c84e640 1 -- 172.21.15.37:0/2044466454 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1f400bce20 con 0x7f1f58104ee0 2024-09-19T06:09:55.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:09:54 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/1636938752' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:09:55.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:09:54 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/1003339642' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T06:09:55.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:09:54 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/2506902319' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T06:09:55.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.187+0000 7f1f5d850640 1 -- 172.21.15.37:0/2044466454 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f1f5802da10 con 0x7f1f58104ee0 2024-09-19T06:09:55.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.187+0000 7f1f5c84e640 1 -- 172.21.15.37:0/2044466454 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v91) ==== 103+0+11 (secure 0 0 0) 0x7f1f400bc720 con 0x7f1f58104ee0 2024-09-19T06:09:55.190 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2024-09-19T06:09:55.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.189+0000 7f1f5d850640 1 -- 172.21.15.37:0/2044466454 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f1f440a3250 msgr2=0x7f1f440a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:55.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.189+0000 7f1f5d850640 1 --2- 172.21.15.37:0/2044466454 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f1f440a3250 0x7f1f440a5710 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1f480058c0 tx=0x7f1f48005850 comp rx=0 tx=0).stop 2024-09-19T06:09:55.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.189+0000 7f1f5d850640 1 -- 172.21.15.37:0/2044466454 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f58104ee0 msgr2=0x7f1f581984c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:55.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.189+0000 7f1f5d850640 1 --2- 172.21.15.37:0/2044466454 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f58104ee0 0x7f1f581984c0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f1f40006010 tx=0x7f1f40031b60 comp rx=0 tx=0).stop 2024-09-19T06:09:55.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.189+0000 7f1f5d850640 1 -- 172.21.15.37:0/2044466454 shutdown_connections 2024-09-19T06:09:55.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.189+0000 7f1f5d850640 1 --2- 172.21.15.37:0/2044466454 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f1f440a3250 0x7f1f440a5710 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:55.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.189+0000 7f1f5d850640 1 --2- 172.21.15.37:0/2044466454 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f58107810 0x7f1f5819f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:55.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.189+0000 7f1f5d850640 1 --2- 172.21.15.37:0/2044466454 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f58104ee0 0x7f1f581984c0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:55.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.189+0000 7f1f5d850640 1 --2- 172.21.15.37:0/2044466454 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f581025b0 0x7f1f58197f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:55.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.189+0000 7f1f5d850640 1 -- 172.21.15.37:0/2044466454 >> 172.21.15.37:0/2044466454 conn(0x7f1f580fc1b0 msgr2=0x7f1f58102fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:55.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.189+0000 7f1f5d850640 1 -- 172.21.15.37:0/2044466454 shutdown_connections 2024-09-19T06:09:55.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.189+0000 7f1f5d850640 1 -- 172.21.15.37:0/2044466454 wait complete. 2024-09-19T06:09:55.203 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-19T06:09:55.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:09:54 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/1636938752' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:09:55.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:09:54 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/1003339642' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T06:09:55.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:09:54 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/2506902319' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T06:09:55.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.305+0000 7f83681bd640 1 -- 172.21.15.37:0/2762780448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8360102e80 msgr2=0x7f8360103300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:55.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.305+0000 7f83681bd640 1 --2- 172.21.15.37:0/2762780448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8360102e80 0x7f8360103300 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f8350009900 tx=0x7f835002a410 comp rx=0 tx=0).stop 2024-09-19T06:09:55.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.305+0000 7f83681bd640 1 -- 172.21.15.37:0/2762780448 shutdown_connections 2024-09-19T06:09:55.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.305+0000 7f83681bd640 1 --2- 172.21.15.37:0/2762780448 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8360103840 0x7f836010a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:55.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.305+0000 7f83681bd640 1 --2- 172.21.15.37:0/2762780448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8360102e80 0x7f8360103300 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:55.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.305+0000 7f83681bd640 1 --2- 172.21.15.37:0/2762780448 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83600ffe10 0x7f8360100210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:55.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.305+0000 7f83681bd640 1 -- 172.21.15.37:0/2762780448 >> 172.21.15.37:0/2762780448 conn(0x7f83600fb910 msgr2=0x7f83600fdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:55.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.305+0000 7f83681bd640 1 -- 172.21.15.37:0/2762780448 shutdown_connections 2024-09-19T06:09:55.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.305+0000 7f83681bd640 1 -- 172.21.15.37:0/2762780448 wait complete. 2024-09-19T06:09:55.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.306+0000 7f83681bd640 1 Processor -- start 2024-09-19T06:09:55.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.306+0000 7f83681bd640 1 -- start start 2024-09-19T06:09:55.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.306+0000 7f83681bd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83600ffe10 0x7f8360197e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:55.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.306+0000 7f83681bd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8360102e80 0x7f8360198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:55.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.306+0000 7f83681bd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8360103840 0x7f836019f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:55.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.306+0000 7f83681bd640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f836010d810 con 0x7f8360103840 2024-09-19T06:09:55.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.306+0000 7f83681bd640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f836010d690 con 0x7f83600ffe10 2024-09-19T06:09:55.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.306+0000 7f83681bd640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f836010d990 con 0x7f8360102e80 2024-09-19T06:09:55.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.306+0000 7f836675a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8360103840 0x7f836019f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:55.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.306+0000 7f836675a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8360103840 0x7f836019f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34040/0 (socket says 172.21.15.37:34040) 2024-09-19T06:09:55.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.306+0000 7f836675a640 1 -- 172.21.15.37:0/715196767 learned_addr learned my addr 172.21.15.37:0/715196767 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:09:55.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.306+0000 7f8365f59640 1 --2- 172.21.15.37:0/715196767 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83600ffe10 0x7f8360197e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:55.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.306+0000 7f8365758640 1 --2- 172.21.15.37:0/715196767 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8360102e80 0x7f8360198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:55.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.306+0000 7f836675a640 1 -- 172.21.15.37:0/715196767 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8360102e80 msgr2=0x7f8360198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:55.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.306+0000 7f836675a640 1 --2- 172.21.15.37:0/715196767 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8360102e80 0x7f8360198370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:55.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.306+0000 7f836675a640 1 -- 172.21.15.37:0/715196767 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83600ffe10 msgr2=0x7f8360197e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:55.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.306+0000 7f836675a640 1 --2- 172.21.15.37:0/715196767 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83600ffe10 0x7f8360197e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:55.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.306+0000 7f836675a640 1 -- 172.21.15.37:0/715196767 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f836019fa50 con 0x7f8360103840 2024-09-19T06:09:55.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.306+0000 7f8365f59640 1 --2- 172.21.15.37:0/715196767 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83600ffe10 0x7f8360197e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:09:55.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.306+0000 7f8365758640 1 --2- 172.21.15.37:0/715196767 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8360102e80 0x7f8360198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:09:55.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.306+0000 7f836675a640 1 --2- 172.21.15.37:0/715196767 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8360103840 0x7f836019f3e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f835800b970 tx=0x7f835800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:55.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.307+0000 7f8356ffd640 1 -- 172.21.15.37:0/715196767 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8358019070 con 0x7f8360103840 2024-09-19T06:09:55.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.307+0000 7f8356ffd640 1 -- 172.21.15.37:0/715196767 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f835800cb40 con 0x7f8360103840 2024-09-19T06:09:55.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.307+0000 7f83681bd640 1 -- 172.21.15.37:0/715196767 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f836019fd40 con 0x7f8360103840 2024-09-19T06:09:55.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.307+0000 7f8356ffd640 1 -- 172.21.15.37:0/715196767 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8358007650 con 0x7f8360103840 2024-09-19T06:09:55.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.307+0000 7f83681bd640 1 -- 172.21.15.37:0/715196767 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83601a02b0 con 0x7f8360103840 2024-09-19T06:09:55.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.308+0000 7f83681bd640 1 -- 172.21.15.37:0/715196767 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8360108fb0 con 0x7f8360103840 2024-09-19T06:09:55.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.309+0000 7f8356ffd640 1 -- 172.21.15.37:0/715196767 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f835801c070 con 0x7f8360103840 2024-09-19T06:09:55.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.310+0000 7f8356ffd640 1 --2- 172.21.15.37:0/715196767 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f834c0a32d0 0x7f834c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:55.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.310+0000 7f8365f59640 1 --2- 172.21.15.37:0/715196767 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f834c0a32d0 0x7f834c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:55.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.310+0000 7f8356ffd640 1 -- 172.21.15.37:0/715196767 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9121+0+0 (secure 0 0 0) 0x7f83580cf240 con 0x7f8360103840 2024-09-19T06:09:55.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.310+0000 7f8365f59640 1 --2- 172.21.15.37:0/715196767 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f834c0a32d0 0x7f834c0a5790 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f836006a180 tx=0x7f835c00a5e0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:55.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.314+0000 7f8356ffd640 1 -- 172.21.15.37:0/715196767 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f835809bbe0 con 0x7f8360103840 2024-09-19T06:09:55.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.541+0000 7f83681bd640 1 -- 172.21.15.37:0/715196767 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f8360062e90 con 0x7f8360103840 2024-09-19T06:09:55.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.549+0000 7f8356ffd640 1 -- 172.21.15.37:0/715196767 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v18) ==== 81+0+742340 (secure 0 0 0) 0x7f835809b4e0 con 0x7f8360103840 2024-09-19T06:09:55.560 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T06:09:55.560 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-19T06:09:55.560 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 18, 2024-09-19T06:09:55.560 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.561 INFO:teuthology.orchestra.run.smithi037.stdout: "active_gid": 14148, 2024-09-19T06:09:55.561 INFO:teuthology.orchestra.run.smithi037.stdout: "active_name": "x", 2024-09-19T06:09:55.561 INFO:teuthology.orchestra.run.smithi037.stdout: "active_addrs": { 2024-09-19T06:09:55.561 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2024-09-19T06:09:55.561 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:55.561 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2024-09-19T06:09:55.561 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.37:6800", 2024-09-19T06:09:55.561 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 3797010169 2024-09-19T06:09:55.561 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.561 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:55.561 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2024-09-19T06:09:55.561 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.37:6801", 2024-09-19T06:09:55.561 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 3797010169 2024-09-19T06:09:55.561 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:55.562 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-09-19T06:09:55.562 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.562 INFO:teuthology.orchestra.run.smithi037.stdout: "active_addr": "172.21.15.37:6801/3797010169", 2024-09-19T06:09:55.562 INFO:teuthology.orchestra.run.smithi037.stdout: "active_change": "2024-09-19T05:57:12.560919+0000", 2024-09-19T06:09:55.562 INFO:teuthology.orchestra.run.smithi037.stdout: "active_mgr_features": 4540701547738038271, 2024-09-19T06:09:55.562 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-09-19T06:09:55.562 INFO:teuthology.orchestra.run.smithi037.stdout: "standbys": [ 2024-09-19T06:09:55.562 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:55.562 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 24109, 2024-09-19T06:09:55.562 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "z", 2024-09-19T06:09:55.562 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_features": 4540701547738038271, 2024-09-19T06:09:55.562 INFO:teuthology.orchestra.run.smithi037.stdout: "available_modules": [ 2024-09-19T06:09:55.562 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:55.563 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "alerts", 2024-09-19T06:09:55.563 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:55.563 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:55.563 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:55.563 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-09-19T06:09:55.563 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-09-19T06:09:55.563 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-19T06:09:55.563 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.563 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.563 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-09-19T06:09:55.563 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.563 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.563 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.563 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T06:09:55.564 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.564 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.564 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.564 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.564 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:55.564 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:55.564 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.564 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.564 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.564 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.564 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.564 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.564 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.565 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:55.565 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:55.565 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:55.565 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:55.565 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:55.565 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:55.565 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.565 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.565 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.565 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.565 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.565 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.565 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:55.566 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:55.566 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.566 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.566 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.566 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.566 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.566 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.566 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.566 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.566 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.566 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.566 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.566 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.566 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:55.567 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:55.567 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.567 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.567 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.567 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:55.567 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.567 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.567 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.567 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:55.567 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:55.567 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:55.567 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:55.567 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:55.567 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:55.568 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.568 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.568 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.568 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.568 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.568 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.568 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:55.568 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:55.568 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.568 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.568 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.568 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.568 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.569 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.569 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.569 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.569 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.569 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.569 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.569 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.569 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_destination": { 2024-09-19T06:09:55.569 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_destination", 2024-09-19T06:09:55.569 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.569 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.569 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.569 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.570 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.570 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.570 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.570 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Email address to send alerts to", 2024-09-19T06:09:55.570 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.570 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.570 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.570 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.570 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_from_name": { 2024-09-19T06:09:55.570 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_from_name", 2024-09-19T06:09:55.570 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.570 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.570 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.570 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "Ceph", 2024-09-19T06:09:55.571 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.571 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.571 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.571 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Email From: name", 2024-09-19T06:09:55.571 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.571 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.571 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.571 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.571 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_host": { 2024-09-19T06:09:55.571 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_host", 2024-09-19T06:09:55.571 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.571 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.571 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.572 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.572 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.572 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.572 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.572 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SMTP server", 2024-09-19T06:09:55.572 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.572 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.572 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.572 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.572 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_password": { 2024-09-19T06:09:55.572 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_password", 2024-09-19T06:09:55.572 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.572 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.572 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.573 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.573 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.573 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.573 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.573 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Password to authenticate with", 2024-09-19T06:09:55.573 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.573 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.573 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.573 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.573 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_port": { 2024-09-19T06:09:55.573 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_port", 2024-09-19T06:09:55.573 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:55.573 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.574 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.574 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "465", 2024-09-19T06:09:55.574 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.574 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.574 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.574 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SMTP port", 2024-09-19T06:09:55.574 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.574 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.574 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.574 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.574 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_sender": { 2024-09-19T06:09:55.574 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_sender", 2024-09-19T06:09:55.574 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.574 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.575 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.575 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.575 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.575 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.575 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.575 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SMTP envelope sender", 2024-09-19T06:09:55.575 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.575 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.575 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.575 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.575 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_ssl": { 2024-09-19T06:09:55.575 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_ssl", 2024-09-19T06:09:55.576 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.576 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.576 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.576 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:55.576 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.576 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.576 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.576 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T06:09:55.576 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.576 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.576 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.576 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.576 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_user": { 2024-09-19T06:09:55.577 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_user", 2024-09-19T06:09:55.577 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.577 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.577 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.577 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.577 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.577 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.577 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.577 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "User to authenticate as", 2024-09-19T06:09:55.577 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.577 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.577 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.577 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:55.577 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:55.578 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.578 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:55.578 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "balancer", 2024-09-19T06:09:55.578 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:55.578 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:55.578 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:55.578 INFO:teuthology.orchestra.run.smithi037.stdout: "active": { 2024-09-19T06:09:55.578 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "active", 2024-09-19T06:09:55.578 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.578 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.578 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.578 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:55.578 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.578 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.579 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.579 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T06:09:55.579 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.579 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.579 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.579 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.579 INFO:teuthology.orchestra.run.smithi037.stdout: "begin_time": { 2024-09-19T06:09:55.579 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "begin_time", 2024-09-19T06:09:55.579 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.579 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.579 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.579 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0000", 2024-09-19T06:09:55.579 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.579 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.580 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.580 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T06:09:55.580 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T06:09:55.580 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.580 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.580 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.580 INFO:teuthology.orchestra.run.smithi037.stdout: "begin_weekday": { 2024-09-19T06:09:55.580 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "begin_weekday", 2024-09-19T06:09:55.580 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-09-19T06:09:55.580 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.580 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.580 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-19T06:09:55.580 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "0", 2024-09-19T06:09:55.581 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "6", 2024-09-19T06:09:55.581 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.581 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T06:09:55.581 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T06:09:55.581 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.581 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.581 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.581 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_compat_max_iterations": { 2024-09-19T06:09:55.581 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crush_compat_max_iterations", 2024-09-19T06:09:55.581 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-09-19T06:09:55.581 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.581 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.581 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "25", 2024-09-19T06:09:55.581 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-09-19T06:09:55.582 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "250", 2024-09-19T06:09:55.582 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.582 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T06:09:55.582 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.582 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.582 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.582 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.582 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_compat_metrics": { 2024-09-19T06:09:55.582 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crush_compat_metrics", 2024-09-19T06:09:55.582 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.582 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.582 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.582 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T06:09:55.582 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.582 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.583 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.583 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T06:09:55.583 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T06:09:55.583 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.583 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.583 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.583 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_compat_step": { 2024-09-19T06:09:55.583 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crush_compat_step", 2024-09-19T06:09:55.583 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-19T06:09:55.583 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.583 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.583 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0.5", 2024-09-19T06:09:55.583 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "0.001", 2024-09-19T06:09:55.583 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "0.999", 2024-09-19T06:09:55.584 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.584 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "aggressiveness of optimization", 2024-09-19T06:09:55.584 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T06:09:55.584 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.584 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.584 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.584 INFO:teuthology.orchestra.run.smithi037.stdout: "end_time": { 2024-09-19T06:09:55.584 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "end_time", 2024-09-19T06:09:55.584 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.584 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.584 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.584 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "2359", 2024-09-19T06:09:55.584 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.585 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.585 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.585 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T06:09:55.585 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T06:09:55.585 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.585 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.585 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.585 INFO:teuthology.orchestra.run.smithi037.stdout: "end_weekday": { 2024-09-19T06:09:55.585 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "end_weekday", 2024-09-19T06:09:55.585 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-09-19T06:09:55.585 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.585 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.585 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-19T06:09:55.585 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "0", 2024-09-19T06:09:55.586 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "6", 2024-09-19T06:09:55.586 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.586 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T06:09:55.586 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T06:09:55.586 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.586 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.586 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.586 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:55.586 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:55.586 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.586 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.586 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.586 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.586 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.587 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.587 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.587 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:55.587 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:55.587 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:55.587 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:55.587 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:55.587 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:55.587 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.587 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.587 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.587 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.587 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.587 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.588 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:55.588 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:55.588 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.588 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.588 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.588 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.588 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.588 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.588 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.588 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.588 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.588 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.589 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.589 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.589 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:55.589 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:55.589 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.589 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.589 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.589 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:55.589 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.589 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.589 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.589 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:55.589 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:55.590 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:55.590 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:55.590 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:55.590 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:55.590 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.590 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.590 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.590 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.590 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.590 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.590 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:55.590 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:55.590 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.590 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.591 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.591 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.591 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.591 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.591 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.591 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.591 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.591 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.591 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.591 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.591 INFO:teuthology.orchestra.run.smithi037.stdout: "min_score": { 2024-09-19T06:09:55.591 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "min_score", 2024-09-19T06:09:55.591 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-19T06:09:55.592 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.592 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.592 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-19T06:09:55.592 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.592 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.592 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.592 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T06:09:55.592 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.592 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.592 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.592 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.592 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": { 2024-09-19T06:09:55.592 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mode", 2024-09-19T06:09:55.592 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.593 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.593 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.593 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "upmap", 2024-09-19T06:09:55.593 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.593 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.593 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.593 INFO:teuthology.orchestra.run.smithi037.stdout: "crush-compat", 2024-09-19T06:09:55.593 INFO:teuthology.orchestra.run.smithi037.stdout: "none", 2024-09-19T06:09:55.593 INFO:teuthology.orchestra.run.smithi037.stdout: "read", 2024-09-19T06:09:55.593 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap", 2024-09-19T06:09:55.593 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap-read" 2024-09-19T06:09:55.593 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.593 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Balancer mode", 2024-09-19T06:09:55.593 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.594 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.594 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.594 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.594 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_ids": { 2024-09-19T06:09:55.594 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pool_ids", 2024-09-19T06:09:55.594 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.594 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.594 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.594 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.594 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.594 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.594 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.594 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T06:09:55.595 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.595 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.595 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.595 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.595 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-09-19T06:09:55.595 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-09-19T06:09:55.595 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-19T06:09:55.595 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.595 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.595 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-09-19T06:09:55.595 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.595 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.595 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.595 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T06:09:55.596 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.596 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.596 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.596 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.596 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap_max_deviation": { 2024-09-19T06:09:55.596 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "upmap_max_deviation", 2024-09-19T06:09:55.596 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:55.596 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.596 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.596 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-09-19T06:09:55.596 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-09-19T06:09:55.596 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.596 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.596 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T06:09:55.597 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T06:09:55.597 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.597 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.597 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.597 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap_max_optimizations": { 2024-09-19T06:09:55.597 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "upmap_max_optimizations", 2024-09-19T06:09:55.597 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-09-19T06:09:55.597 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.597 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.597 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-19T06:09:55.597 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.597 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.597 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.597 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T06:09:55.598 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.598 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.598 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.598 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:55.598 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:55.598 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.598 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:55.598 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephadm", 2024-09-19T06:09:55.598 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:55.598 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:55.598 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:55.598 INFO:teuthology.orchestra.run.smithi037.stdout: "agent_down_multiplier": { 2024-09-19T06:09:55.598 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "agent_down_multiplier", 2024-09-19T06:09:55.598 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-19T06:09:55.598 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.599 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.599 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "3.0", 2024-09-19T06:09:55.599 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.599 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.599 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.599 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T06:09:55.599 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.599 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.599 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.599 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.599 INFO:teuthology.orchestra.run.smithi037.stdout: "agent_refresh_rate": { 2024-09-19T06:09:55.599 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "agent_refresh_rate", 2024-09-19T06:09:55.599 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-19T06:09:55.599 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.600 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.600 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "20", 2024-09-19T06:09:55.600 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.600 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.600 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.600 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T06:09:55.600 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.600 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.600 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.600 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.600 INFO:teuthology.orchestra.run.smithi037.stdout: "agent_starting_port": { 2024-09-19T06:09:55.600 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "agent_starting_port", 2024-09-19T06:09:55.600 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:55.601 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.601 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.601 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "4721", 2024-09-19T06:09:55.601 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.601 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.601 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.601 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T06:09:55.601 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.601 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.601 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.601 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.601 INFO:teuthology.orchestra.run.smithi037.stdout: "allow_ptrace": { 2024-09-19T06:09:55.601 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "allow_ptrace", 2024-09-19T06:09:55.602 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.602 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.602 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.602 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.602 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.602 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.602 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.602 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T06:09:55.602 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T06:09:55.602 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.602 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.602 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.602 INFO:teuthology.orchestra.run.smithi037.stdout: "autotune_interval": { 2024-09-19T06:09:55.602 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "autotune_interval", 2024-09-19T06:09:55.603 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-19T06:09:55.603 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.603 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.603 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-09-19T06:09:55.603 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.603 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.603 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.603 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T06:09:55.603 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.603 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.603 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.603 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.603 INFO:teuthology.orchestra.run.smithi037.stdout: "autotune_memory_target_ratio": { 2024-09-19T06:09:55.603 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T06:09:55.604 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-19T06:09:55.604 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.604 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.604 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0.7", 2024-09-19T06:09:55.604 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.604 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.604 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.604 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T06:09:55.604 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.604 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.604 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.604 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.604 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm_log_destination": { 2024-09-19T06:09:55.605 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephadm_log_destination", 2024-09-19T06:09:55.605 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.605 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.605 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.605 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.605 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.605 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.605 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.605 INFO:teuthology.orchestra.run.smithi037.stdout: "file", 2024-09-19T06:09:55.605 INFO:teuthology.orchestra.run.smithi037.stdout: "file,syslog", 2024-09-19T06:09:55.605 INFO:teuthology.orchestra.run.smithi037.stdout: "syslog" 2024-09-19T06:09:55.605 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.605 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T06:09:55.605 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.606 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.606 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.606 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.606 INFO:teuthology.orchestra.run.smithi037.stdout: "cgroups_split": { 2024-09-19T06:09:55.606 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cgroups_split", 2024-09-19T06:09:55.606 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.606 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.606 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.606 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:55.606 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.606 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.606 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.606 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T06:09:55.607 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.607 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.607 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.607 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.607 INFO:teuthology.orchestra.run.smithi037.stdout: "config_checks_enabled": { 2024-09-19T06:09:55.607 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "config_checks_enabled", 2024-09-19T06:09:55.607 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.607 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.607 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.607 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.608 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.608 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.608 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.608 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T06:09:55.608 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.608 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.608 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.608 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.608 INFO:teuthology.orchestra.run.smithi037.stdout: "config_dashboard": { 2024-09-19T06:09:55.608 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "config_dashboard", 2024-09-19T06:09:55.608 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.608 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.609 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.609 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:55.609 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.609 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.609 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.609 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T06:09:55.609 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.609 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.609 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.609 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.609 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_alertmanager": { 2024-09-19T06:09:55.609 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_alertmanager", 2024-09-19T06:09:55.609 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.609 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.610 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.610 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T06:09:55.610 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.610 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.610 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.610 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-09-19T06:09:55.610 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.610 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.610 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.610 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.610 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_base": { 2024-09-19T06:09:55.610 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_base", 2024-09-19T06:09:55.610 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.610 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.611 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.611 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T06:09:55.611 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.611 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.611 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.611 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Container image name, without the tag", 2024-09-19T06:09:55.611 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.611 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.611 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.611 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.611 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_elasticsearch": { 2024-09-19T06:09:55.611 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_elasticsearch", 2024-09-19T06:09:55.611 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.611 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.612 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.612 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T06:09:55.612 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.612 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.612 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.612 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "elasticsearch container image", 2024-09-19T06:09:55.612 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.612 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.612 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.612 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.612 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_grafana": { 2024-09-19T06:09:55.612 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_grafana", 2024-09-19T06:09:55.612 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.613 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.613 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.613 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T06:09:55.613 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.613 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.613 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.613 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-09-19T06:09:55.613 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.613 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.613 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.613 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.613 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_haproxy": { 2024-09-19T06:09:55.613 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_haproxy", 2024-09-19T06:09:55.613 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.614 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.614 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.614 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T06:09:55.614 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.614 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.614 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.614 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "HAproxy container image", 2024-09-19T06:09:55.614 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.614 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.614 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.614 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.614 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_jaeger_agent": { 2024-09-19T06:09:55.615 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_jaeger_agent", 2024-09-19T06:09:55.615 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.615 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.615 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.615 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T06:09:55.615 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.615 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.615 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.615 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Jaeger agent container image", 2024-09-19T06:09:55.615 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.615 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.615 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.615 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.615 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_jaeger_collector": { 2024-09-19T06:09:55.616 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_jaeger_collector", 2024-09-19T06:09:55.616 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.616 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.616 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.616 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T06:09:55.616 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.616 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.616 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.616 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Jaeger collector container image", 2024-09-19T06:09:55.616 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.616 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.616 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.616 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.616 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_jaeger_query": { 2024-09-19T06:09:55.617 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_jaeger_query", 2024-09-19T06:09:55.617 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.617 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.617 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.617 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T06:09:55.617 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.617 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.617 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.617 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Jaeger query container image", 2024-09-19T06:09:55.617 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.617 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.617 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.617 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.617 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_keepalived": { 2024-09-19T06:09:55.618 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_keepalived", 2024-09-19T06:09:55.618 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.618 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.618 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.618 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T06:09:55.618 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.618 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.618 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.618 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Keepalived container image", 2024-09-19T06:09:55.618 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.618 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.618 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.618 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.618 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_loki": { 2024-09-19T06:09:55.618 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_loki", 2024-09-19T06:09:55.619 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.619 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.619 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.619 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T06:09:55.619 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.619 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.619 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.619 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Loki container image", 2024-09-19T06:09:55.619 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.619 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.619 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.619 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.619 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_node_exporter": { 2024-09-19T06:09:55.619 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_node_exporter", 2024-09-19T06:09:55.620 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.620 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.620 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.620 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T06:09:55.620 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.620 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.620 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.620 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-09-19T06:09:55.620 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.620 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.620 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.620 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.620 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_nvmeof": { 2024-09-19T06:09:55.621 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_nvmeof", 2024-09-19T06:09:55.621 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.621 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.621 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.621 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T06:09:55.621 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.621 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.621 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.621 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Nvme-of container image", 2024-09-19T06:09:55.621 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.621 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.621 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.621 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.622 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_prometheus": { 2024-09-19T06:09:55.622 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_prometheus", 2024-09-19T06:09:55.622 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.622 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.622 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.622 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T06:09:55.622 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.622 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.622 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.622 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-09-19T06:09:55.622 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.622 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.622 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.622 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.623 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_promtail": { 2024-09-19T06:09:55.623 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_promtail", 2024-09-19T06:09:55.623 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.623 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.623 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.623 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T06:09:55.623 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.623 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.623 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.623 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Promtail container image", 2024-09-19T06:09:55.623 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.623 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.623 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.623 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.624 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_samba": { 2024-09-19T06:09:55.624 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_samba", 2024-09-19T06:09:55.624 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.624 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.624 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.624 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T06:09:55.624 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.624 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.624 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.624 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Samba/SMB container image", 2024-09-19T06:09:55.624 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.624 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.624 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.625 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.625 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_snmp_gateway": { 2024-09-19T06:09:55.625 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_snmp_gateway", 2024-09-19T06:09:55.625 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.625 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.625 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.625 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T06:09:55.625 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.625 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.625 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.625 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SNMP Gateway container image", 2024-09-19T06:09:55.625 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.625 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.625 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.626 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.626 INFO:teuthology.orchestra.run.smithi037.stdout: "container_init": { 2024-09-19T06:09:55.626 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_init", 2024-09-19T06:09:55.626 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.626 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.626 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.626 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:55.626 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.626 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.626 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.626 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T06:09:55.627 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.627 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.627 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.627 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.627 INFO:teuthology.orchestra.run.smithi037.stdout: "daemon_cache_timeout": { 2024-09-19T06:09:55.627 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "daemon_cache_timeout", 2024-09-19T06:09:55.627 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-19T06:09:55.627 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.627 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.627 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-09-19T06:09:55.627 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.627 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.627 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.627 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T06:09:55.628 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.628 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.628 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.628 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.628 INFO:teuthology.orchestra.run.smithi037.stdout: "default_cephadm_command_timeout": { 2024-09-19T06:09:55.628 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T06:09:55.628 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:55.628 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.628 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.628 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "900", 2024-09-19T06:09:55.628 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.628 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.628 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.628 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T06:09:55.629 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.629 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.629 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.629 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.629 INFO:teuthology.orchestra.run.smithi037.stdout: "default_registry": { 2024-09-19T06:09:55.629 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "default_registry", 2024-09-19T06:09:55.629 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.629 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.629 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.629 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io", 2024-09-19T06:09:55.629 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.629 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.629 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.629 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T06:09:55.630 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.630 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.630 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.630 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.630 INFO:teuthology.orchestra.run.smithi037.stdout: "device_cache_timeout": { 2024-09-19T06:09:55.630 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "device_cache_timeout", 2024-09-19T06:09:55.630 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-19T06:09:55.630 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.630 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.630 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "1800", 2024-09-19T06:09:55.630 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.630 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.630 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.630 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "seconds to cache device inventory", 2024-09-19T06:09:55.631 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.631 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.631 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.631 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.631 INFO:teuthology.orchestra.run.smithi037.stdout: "device_enhanced_scan": { 2024-09-19T06:09:55.631 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "device_enhanced_scan", 2024-09-19T06:09:55.631 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.631 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.631 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.631 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.631 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.631 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.631 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.631 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T06:09:55.632 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.632 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.632 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.632 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.632 INFO:teuthology.orchestra.run.smithi037.stdout: "facts_cache_timeout": { 2024-09-19T06:09:55.632 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "facts_cache_timeout", 2024-09-19T06:09:55.632 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-19T06:09:55.632 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.633 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.633 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-09-19T06:09:55.633 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.633 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.633 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.633 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "seconds to cache host facts data", 2024-09-19T06:09:55.633 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.633 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.633 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.633 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.633 INFO:teuthology.orchestra.run.smithi037.stdout: "grafana_dashboards_path": { 2024-09-19T06:09:55.633 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "grafana_dashboards_path", 2024-09-19T06:09:55.633 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.634 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.634 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.634 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T06:09:55.634 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.634 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.634 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.634 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T06:09:55.634 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.634 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.634 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.634 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.634 INFO:teuthology.orchestra.run.smithi037.stdout: "host_check_interval": { 2024-09-19T06:09:55.634 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "host_check_interval", 2024-09-19T06:09:55.634 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-19T06:09:55.634 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.635 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.635 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-09-19T06:09:55.635 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.635 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.635 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.635 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to perform a host check", 2024-09-19T06:09:55.635 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.635 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.635 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.635 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.635 INFO:teuthology.orchestra.run.smithi037.stdout: "hw_monitoring": { 2024-09-19T06:09:55.635 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "hw_monitoring", 2024-09-19T06:09:55.635 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.635 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.636 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.636 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.636 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.636 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.636 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.636 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T06:09:55.636 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.636 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.636 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.636 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.636 INFO:teuthology.orchestra.run.smithi037.stdout: "inventory_list_all": { 2024-09-19T06:09:55.636 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "inventory_list_all", 2024-09-19T06:09:55.636 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.636 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.637 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.637 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.637 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.637 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.637 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.637 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T06:09:55.637 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.637 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.637 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.637 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.637 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:55.637 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:55.637 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.637 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.638 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.638 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.638 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.638 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.638 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.638 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:55.638 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:55.638 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:55.638 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:55.638 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:55.638 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:55.638 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.638 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.638 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.639 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.639 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.639 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.639 INFO:teuthology.orchestra.run.smithi037.stdout: "log_refresh_metadata": { 2024-09-19T06:09:55.639 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_refresh_metadata", 2024-09-19T06:09:55.639 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.639 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.639 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.639 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.639 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.639 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.639 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.640 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T06:09:55.640 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.640 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.640 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.640 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.640 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:55.640 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:55.640 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.640 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.640 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.640 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:55.640 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.640 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.640 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.641 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T06:09:55.641 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.641 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.641 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.641 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.641 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:55.641 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:55.641 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.641 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.641 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.641 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:55.641 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.641 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.641 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.642 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:55.642 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:55.642 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:55.642 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:55.642 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:55.642 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:55.642 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.642 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.642 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.642 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.642 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.642 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.642 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:55.642 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:55.643 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.643 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.643 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.643 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.643 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.643 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.643 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.643 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.643 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.643 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.643 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.643 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.643 INFO:teuthology.orchestra.run.smithi037.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T06:09:55.644 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T06:09:55.644 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.644 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.644 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.644 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.644 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.644 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.644 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.644 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T06:09:55.644 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.644 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.644 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.644 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.644 INFO:teuthology.orchestra.run.smithi037.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T06:09:55.645 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T06:09:55.645 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.645 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.645 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.645 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "*", 2024-09-19T06:09:55.645 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.645 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.645 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.645 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T06:09:55.645 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.645 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.645 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.645 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.645 INFO:teuthology.orchestra.run.smithi037.stdout: "max_count_per_host": { 2024-09-19T06:09:55.646 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_count_per_host", 2024-09-19T06:09:55.646 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:55.646 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.646 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.646 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-19T06:09:55.646 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.646 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.646 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.646 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "max number of daemons per service per host", 2024-09-19T06:09:55.646 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.646 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.646 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.646 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.646 INFO:teuthology.orchestra.run.smithi037.stdout: "max_osd_draining_count": { 2024-09-19T06:09:55.647 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_osd_draining_count", 2024-09-19T06:09:55.647 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:55.647 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.647 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.647 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-19T06:09:55.647 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.647 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.647 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.647 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T06:09:55.647 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.647 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.647 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.647 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.647 INFO:teuthology.orchestra.run.smithi037.stdout: "migration_current": { 2024-09-19T06:09:55.648 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "migration_current", 2024-09-19T06:09:55.648 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:55.648 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.648 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.648 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.648 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.648 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.648 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.648 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "internal - do not modify", 2024-09-19T06:09:55.648 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.648 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.648 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.648 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.648 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": { 2024-09-19T06:09:55.649 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mode", 2024-09-19T06:09:55.649 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.649 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.649 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.649 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "root", 2024-09-19T06:09:55.649 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.649 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.649 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.649 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm-package", 2024-09-19T06:09:55.649 INFO:teuthology.orchestra.run.smithi037.stdout: "root" 2024-09-19T06:09:55.649 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.649 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T06:09:55.649 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.649 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.650 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.650 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.650 INFO:teuthology.orchestra.run.smithi037.stdout: "oob_default_addr": { 2024-09-19T06:09:55.650 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "oob_default_addr", 2024-09-19T06:09:55.650 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.650 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.650 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.650 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "169.254.1.1", 2024-09-19T06:09:55.650 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.650 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.650 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.650 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T06:09:55.650 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.650 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.650 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.651 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.651 INFO:teuthology.orchestra.run.smithi037.stdout: "prometheus_alerts_path": { 2024-09-19T06:09:55.651 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "prometheus_alerts_path", 2024-09-19T06:09:55.651 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.651 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.651 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.651 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T06:09:55.651 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.651 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.651 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.651 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T06:09:55.651 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.651 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.651 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.652 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.652 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_insecure": { 2024-09-19T06:09:55.652 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_insecure", 2024-09-19T06:09:55.652 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.652 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.652 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.652 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.652 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.652 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.652 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.652 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T06:09:55.652 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.653 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.653 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.653 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.653 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_password": { 2024-09-19T06:09:55.653 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_password", 2024-09-19T06:09:55.653 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.653 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.653 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.653 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.653 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.653 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.653 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.653 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T06:09:55.653 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.654 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.654 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.654 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.654 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_url": { 2024-09-19T06:09:55.654 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_url", 2024-09-19T06:09:55.654 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.654 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.654 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.654 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.654 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.654 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.654 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.654 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T06:09:55.654 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.655 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.655 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.655 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.655 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_username": { 2024-09-19T06:09:55.655 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_username", 2024-09-19T06:09:55.655 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.655 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.655 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.655 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.655 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.655 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.655 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.655 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T06:09:55.655 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.656 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.656 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.656 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.656 INFO:teuthology.orchestra.run.smithi037.stdout: "secure_monitoring_stack": { 2024-09-19T06:09:55.656 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "secure_monitoring_stack", 2024-09-19T06:09:55.656 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.656 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.656 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.656 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.656 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.656 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.656 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.656 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T06:09:55.656 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.657 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.657 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.657 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.657 INFO:teuthology.orchestra.run.smithi037.stdout: "service_discovery_port": { 2024-09-19T06:09:55.657 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "service_discovery_port", 2024-09-19T06:09:55.657 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:55.657 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.657 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.657 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8765", 2024-09-19T06:09:55.657 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.657 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.657 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.657 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "cephadm service discovery port", 2024-09-19T06:09:55.657 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.658 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.658 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.658 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.658 INFO:teuthology.orchestra.run.smithi037.stdout: "ssh_config_file": { 2024-09-19T06:09:55.658 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssh_config_file", 2024-09-19T06:09:55.658 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.658 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.658 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.658 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.658 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.658 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.658 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.658 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T06:09:55.658 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.659 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.659 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.659 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.659 INFO:teuthology.orchestra.run.smithi037.stdout: "use_agent": { 2024-09-19T06:09:55.659 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "use_agent", 2024-09-19T06:09:55.659 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.659 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.659 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.659 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.659 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.659 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.659 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.659 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T06:09:55.659 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.660 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.660 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.660 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.660 INFO:teuthology.orchestra.run.smithi037.stdout: "use_repo_digest": { 2024-09-19T06:09:55.660 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "use_repo_digest", 2024-09-19T06:09:55.660 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.660 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.660 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.660 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:55.660 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.660 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.660 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.660 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T06:09:55.660 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.661 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.661 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.661 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.661 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_on_failed_host_check": { 2024-09-19T06:09:55.661 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_on_failed_host_check", 2024-09-19T06:09:55.661 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.661 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.661 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.661 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:55.661 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.661 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.661 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.661 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T06:09:55.661 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.662 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.662 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.662 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.662 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_on_stray_daemons": { 2024-09-19T06:09:55.662 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_on_stray_daemons", 2024-09-19T06:09:55.662 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.662 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.662 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.662 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:55.662 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.662 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.662 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.662 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T06:09:55.663 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.663 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.663 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.663 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.663 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_on_stray_hosts": { 2024-09-19T06:09:55.663 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_on_stray_hosts", 2024-09-19T06:09:55.663 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.663 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.663 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.663 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:55.663 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.664 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.664 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.664 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T06:09:55.664 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.664 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.664 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.664 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:55.664 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:55.664 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.664 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:55.664 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crash", 2024-09-19T06:09:55.664 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:55.665 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:55.665 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:55.665 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:55.665 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:55.665 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.665 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.665 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.665 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.665 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.665 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.665 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.666 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:55.666 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:55.666 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:55.666 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:55.666 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:55.666 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:55.666 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.666 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.666 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.666 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.666 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.666 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.666 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:55.666 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:55.667 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.667 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.667 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.667 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.667 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.667 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.667 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.667 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.667 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.667 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.667 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.667 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.667 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:55.668 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:55.668 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.668 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.668 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.668 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:55.668 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.668 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.668 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.668 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:55.668 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:55.668 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:55.668 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:55.668 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:55.668 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:55.669 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.669 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.669 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.669 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.669 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.669 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.669 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:55.669 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:55.669 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.669 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.669 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.669 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.669 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.670 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.670 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.670 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.670 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.670 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.670 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.670 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.670 INFO:teuthology.orchestra.run.smithi037.stdout: "retain_interval": { 2024-09-19T06:09:55.670 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "retain_interval", 2024-09-19T06:09:55.670 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-19T06:09:55.670 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.670 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.670 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "31536000", 2024-09-19T06:09:55.670 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.671 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.671 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.671 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T06:09:55.671 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.671 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.671 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.671 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.671 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_recent_interval": { 2024-09-19T06:09:55.671 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_recent_interval", 2024-09-19T06:09:55.671 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-19T06:09:55.671 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.671 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.671 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "1209600", 2024-09-19T06:09:55.671 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.671 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.672 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.672 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T06:09:55.672 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.672 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.672 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.672 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:55.672 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:55.672 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.672 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:55.672 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "dashboard", 2024-09-19T06:09:55.672 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:55.672 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:55.672 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:55.673 INFO:teuthology.orchestra.run.smithi037.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T06:09:55.673 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T06:09:55.673 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:55.673 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.673 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.673 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-19T06:09:55.673 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.673 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.673 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.673 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.673 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.673 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.673 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.673 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.674 INFO:teuthology.orchestra.run.smithi037.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T06:09:55.674 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T06:09:55.674 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.674 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.674 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.674 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.674 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.674 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.674 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.674 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.674 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.674 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.674 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.675 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.675 INFO:teuthology.orchestra.run.smithi037.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T06:09:55.675 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T06:09:55.675 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.675 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.675 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.675 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:55.675 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.675 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.675 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.675 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.675 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.675 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.675 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.675 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.676 INFO:teuthology.orchestra.run.smithi037.stdout: "AUDIT_API_ENABLED": { 2024-09-19T06:09:55.676 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T06:09:55.676 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.676 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.676 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.676 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.676 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.676 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.676 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.676 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.676 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.676 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.676 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.676 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.677 INFO:teuthology.orchestra.run.smithi037.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T06:09:55.677 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T06:09:55.677 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.677 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.677 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.677 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:55.677 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.677 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.677 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.677 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.677 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.677 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.677 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.677 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.678 INFO:teuthology.orchestra.run.smithi037.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T06:09:55.678 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T06:09:55.678 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.678 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.678 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.678 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:55.678 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.678 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.678 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.678 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.678 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.678 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.678 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.679 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.679 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T06:09:55.679 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T06:09:55.679 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.679 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.679 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.679 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:55.679 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.679 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.679 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.679 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.679 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.679 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.680 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.680 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.680 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T06:09:55.680 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T06:09:55.680 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.680 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.680 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.680 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:55.680 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.680 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.680 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.680 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.680 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.680 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.681 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.681 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.681 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T06:09:55.681 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T06:09:55.681 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.681 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.681 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.681 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:55.681 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.681 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.681 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.681 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.681 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.682 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.682 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.682 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.682 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T06:09:55.682 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T06:09:55.682 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.682 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.682 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.682 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:55.682 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.682 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.682 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.682 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.683 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.683 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.683 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.683 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.683 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T06:09:55.683 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T06:09:55.683 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.683 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.683 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.683 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:55.683 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.683 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.683 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.684 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.684 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.684 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.684 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.684 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.684 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T06:09:55.684 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T06:09:55.684 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.684 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.684 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.684 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:55.684 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.684 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.684 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.685 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.685 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.685 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.685 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.685 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.685 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T06:09:55.685 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T06:09:55.685 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.685 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.685 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.685 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:55.685 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.685 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.685 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.686 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.686 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.686 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.686 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.686 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.686 INFO:teuthology.orchestra.run.smithi037.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T06:09:55.686 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T06:09:55.686 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.686 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.686 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.686 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.686 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.686 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.686 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.687 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.687 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.687 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.687 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.687 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.687 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T06:09:55.687 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T06:09:55.687 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.687 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.687 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.687 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "admin", 2024-09-19T06:09:55.687 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.687 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.688 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.688 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.688 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.688 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.688 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.688 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.688 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T06:09:55.688 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T06:09:55.688 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.688 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.688 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.688 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:55.688 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.688 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.689 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.689 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.689 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.689 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.689 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.689 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.689 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_URL": { 2024-09-19T06:09:55.689 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_URL", 2024-09-19T06:09:55.689 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.689 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.689 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.689 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.689 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.689 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.690 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.690 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.690 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.690 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.690 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.690 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.690 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T06:09:55.690 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T06:09:55.690 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.690 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.690 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.690 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "admin", 2024-09-19T06:09:55.690 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.690 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.691 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.691 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.691 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.691 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.691 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.691 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.691 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T06:09:55.691 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T06:09:55.691 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.691 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.691 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.691 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.691 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.691 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.692 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.692 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.692 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.692 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.692 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.692 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.692 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T06:09:55.692 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T06:09:55.692 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.692 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.692 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.693 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.693 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.693 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.693 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.693 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.693 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.693 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.693 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.693 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.693 INFO:teuthology.orchestra.run.smithi037.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T06:09:55.693 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T06:09:55.693 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.693 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.693 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.694 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:55.694 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.694 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.694 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.694 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.694 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.694 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.694 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.694 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.694 INFO:teuthology.orchestra.run.smithi037.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T06:09:55.694 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T06:09:55.694 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.694 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.694 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.695 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.695 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.695 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.695 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.695 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.695 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.695 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.695 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.695 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.695 INFO:teuthology.orchestra.run.smithi037.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T06:09:55.695 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T06:09:55.695 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.695 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.695 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.696 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.696 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.696 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.696 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.696 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.696 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.696 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.696 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.696 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.696 INFO:teuthology.orchestra.run.smithi037.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T06:09:55.696 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T06:09:55.696 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.696 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.697 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.697 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:55.697 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.697 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.697 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.697 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.697 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.697 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.697 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.697 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.697 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T06:09:55.697 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T06:09:55.697 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.698 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.698 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.698 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.698 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.698 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.698 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.698 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.698 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.698 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.698 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.698 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.698 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T06:09:55.698 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T06:09:55.698 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.699 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.699 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.699 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.699 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.699 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.699 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.699 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.699 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.699 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.699 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.699 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.699 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T06:09:55.700 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T06:09:55.700 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.700 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.700 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.700 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:55.700 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.700 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.700 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.700 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.700 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.700 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.700 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.700 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.700 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T06:09:55.701 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T06:09:55.701 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.701 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.701 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.701 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:55.701 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.701 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.701 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.701 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.701 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.701 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.701 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.701 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.701 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T06:09:55.701 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T06:09:55.702 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.702 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.702 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.702 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.702 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.702 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.702 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.702 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.702 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.702 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.702 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.702 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.702 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T06:09:55.702 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T06:09:55.703 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.703 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.703 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.703 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.703 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.703 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.703 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.703 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.703 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.703 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.703 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.703 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.703 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T06:09:55.703 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T06:09:55.703 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.704 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.704 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.704 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.704 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.704 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.704 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.704 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.704 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.704 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.704 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.704 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.704 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T06:09:55.704 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T06:09:55.704 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.705 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.705 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.705 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:55.705 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.705 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.705 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.705 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.705 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.705 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.705 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.705 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.705 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T06:09:55.706 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T06:09:55.706 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.706 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.706 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.706 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T06:09:55.706 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.706 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.706 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.706 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.706 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.706 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.706 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.706 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.706 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T06:09:55.707 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T06:09:55.707 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:55.707 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.707 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.707 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-19T06:09:55.707 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.707 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.707 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.707 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.707 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.707 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.707 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.707 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.707 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T06:09:55.708 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T06:09:55.708 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:55.708 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.708 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.708 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8", 2024-09-19T06:09:55.708 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.708 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.708 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.708 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.709 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.709 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.709 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.709 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.709 INFO:teuthology.orchestra.run.smithi037.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T06:09:55.709 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T06:09:55.709 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:55.709 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.709 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.709 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "45", 2024-09-19T06:09:55.709 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.709 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.709 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.709 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.710 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.710 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.710 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.710 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.710 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T06:09:55.710 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T06:09:55.710 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.710 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.710 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.710 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.710 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.710 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.710 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.710 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.711 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.711 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.711 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.711 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.711 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T06:09:55.711 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T06:09:55.711 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.711 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.711 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.711 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "admin", 2024-09-19T06:09:55.711 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.711 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.711 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.711 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.712 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.712 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.712 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.712 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.712 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T06:09:55.712 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T06:09:55.712 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.712 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.712 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.712 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.712 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.712 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.712 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.712 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.713 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.713 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.713 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.713 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.713 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T06:09:55.713 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T06:09:55.713 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.713 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.713 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.713 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:55.713 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.713 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.713 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.713 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.714 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.714 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.714 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.714 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.714 INFO:teuthology.orchestra.run.smithi037.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T06:09:55.714 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T06:09:55.714 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:55.714 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.714 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.714 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-19T06:09:55.714 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.714 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.714 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.714 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.715 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.715 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.715 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.715 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.715 INFO:teuthology.orchestra.run.smithi037.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T06:09:55.715 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T06:09:55.715 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:55.715 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.715 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.715 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-19T06:09:55.715 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.715 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.715 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.715 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.715 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.716 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.716 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.716 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.716 INFO:teuthology.orchestra.run.smithi037.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T06:09:55.716 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T06:09:55.716 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:55.716 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.716 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.716 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-09-19T06:09:55.716 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.716 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.716 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.716 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.716 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.717 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.717 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.717 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.717 INFO:teuthology.orchestra.run.smithi037.stdout: "cross_origin_url": { 2024-09-19T06:09:55.717 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cross_origin_url", 2024-09-19T06:09:55.717 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.717 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.717 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.717 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.717 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.717 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.717 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.717 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.718 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.718 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.718 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.718 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.718 INFO:teuthology.orchestra.run.smithi037.stdout: "crt_file": { 2024-09-19T06:09:55.718 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crt_file", 2024-09-19T06:09:55.718 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.718 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.719 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.720 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.720 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.720 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.720 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.720 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.720 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.720 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.720 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.720 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.720 INFO:teuthology.orchestra.run.smithi037.stdout: "debug": { 2024-09-19T06:09:55.720 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "debug", 2024-09-19T06:09:55.720 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.720 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.721 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.721 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.721 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.721 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.721 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.721 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Enable/disable debug options", 2024-09-19T06:09:55.721 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.721 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.721 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.721 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.721 INFO:teuthology.orchestra.run.smithi037.stdout: "jwt_token_ttl": { 2024-09-19T06:09:55.721 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "jwt_token_ttl", 2024-09-19T06:09:55.721 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:55.722 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.722 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.722 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "28800", 2024-09-19T06:09:55.722 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.722 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.722 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.722 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.722 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.722 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.722 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.722 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.722 INFO:teuthology.orchestra.run.smithi037.stdout: "key_file": { 2024-09-19T06:09:55.722 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "key_file", 2024-09-19T06:09:55.722 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.723 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.723 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.723 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.723 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.723 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.723 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.723 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.723 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.723 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.723 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.723 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.723 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:55.723 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:55.723 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.724 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.724 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.724 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.724 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.724 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.724 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.724 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:55.724 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:55.724 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:55.724 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:55.724 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:55.724 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:55.724 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.725 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.725 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.725 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.725 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.725 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.725 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:55.725 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:55.725 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.725 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.725 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.725 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.725 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.725 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.725 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.726 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.726 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.726 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.726 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.726 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.726 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:55.726 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:55.726 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.726 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.726 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.726 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:55.726 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.726 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.726 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.727 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:55.727 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:55.727 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:55.727 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:55.727 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:55.727 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:55.727 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.727 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.727 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.727 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.727 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.727 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.727 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:55.727 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:55.728 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.728 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.728 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.728 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.728 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.728 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.728 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.728 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.728 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.728 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.728 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.728 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.728 INFO:teuthology.orchestra.run.smithi037.stdout: "motd": { 2024-09-19T06:09:55.728 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "motd", 2024-09-19T06:09:55.729 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.729 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.729 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.729 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.729 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.729 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.729 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.729 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "The message of the day", 2024-09-19T06:09:55.729 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.729 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.729 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.729 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.729 INFO:teuthology.orchestra.run.smithi037.stdout: "redirect_resolve_ip_addr": { 2024-09-19T06:09:55.729 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T06:09:55.729 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.730 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.730 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.730 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.730 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.730 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.730 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.730 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.730 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.730 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.730 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.730 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.730 INFO:teuthology.orchestra.run.smithi037.stdout: "server_addr": { 2024-09-19T06:09:55.730 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_addr", 2024-09-19T06:09:55.730 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.731 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.731 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.731 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "::", 2024-09-19T06:09:55.731 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.731 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.731 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.731 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.731 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.731 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.731 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.731 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.731 INFO:teuthology.orchestra.run.smithi037.stdout: "server_port": { 2024-09-19T06:09:55.731 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_port", 2024-09-19T06:09:55.731 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:55.731 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.732 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.732 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8080", 2024-09-19T06:09:55.732 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.732 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.732 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.732 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.732 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.732 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.732 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.732 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.733 INFO:teuthology.orchestra.run.smithi037.stdout: "ssl": { 2024-09-19T06:09:55.733 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssl", 2024-09-19T06:09:55.733 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.733 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.733 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.733 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:55.733 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.733 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.733 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.733 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.733 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.733 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.734 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.734 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.734 INFO:teuthology.orchestra.run.smithi037.stdout: "ssl_server_port": { 2024-09-19T06:09:55.734 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssl_server_port", 2024-09-19T06:09:55.734 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:55.734 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.734 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.734 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8443", 2024-09-19T06:09:55.734 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.734 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.734 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.734 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.734 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.735 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.735 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.735 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.735 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_behaviour": { 2024-09-19T06:09:55.735 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_behaviour", 2024-09-19T06:09:55.735 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.735 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.735 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.735 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "redirect", 2024-09-19T06:09:55.735 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.735 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.735 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.735 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:55.735 INFO:teuthology.orchestra.run.smithi037.stdout: "redirect" 2024-09-19T06:09:55.736 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.736 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.736 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.736 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.736 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.736 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.736 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_error_status_code": { 2024-09-19T06:09:55.736 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_error_status_code", 2024-09-19T06:09:55.736 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:55.736 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.736 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.736 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "500", 2024-09-19T06:09:55.736 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "400", 2024-09-19T06:09:55.736 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "599", 2024-09-19T06:09:55.737 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.737 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.737 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.737 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.737 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.737 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.737 INFO:teuthology.orchestra.run.smithi037.stdout: "url_prefix": { 2024-09-19T06:09:55.737 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "url_prefix", 2024-09-19T06:09:55.737 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.737 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.737 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.737 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.737 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.737 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.738 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.738 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.738 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.738 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.738 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.738 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:55.738 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:55.738 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.738 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:55.738 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "devicehealth", 2024-09-19T06:09:55.738 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:55.738 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:55.738 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:55.738 INFO:teuthology.orchestra.run.smithi037.stdout: "enable_monitoring": { 2024-09-19T06:09:55.739 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enable_monitoring", 2024-09-19T06:09:55.739 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.739 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.739 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.739 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:55.739 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.739 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.739 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.739 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "monitor device health metrics", 2024-09-19T06:09:55.739 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.739 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.739 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.739 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.739 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:55.740 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:55.740 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.740 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.740 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.740 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.740 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.740 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.740 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.740 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:55.740 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:55.740 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:55.740 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:55.741 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:55.741 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:55.741 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.741 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.741 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.741 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.741 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.741 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.741 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:55.741 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:55.741 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.741 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.741 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.742 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.742 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.742 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.742 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.742 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.742 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.742 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.742 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.742 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.742 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:55.742 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:55.742 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.742 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.742 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.743 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:55.743 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.743 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.743 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.743 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:55.743 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:55.743 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:55.743 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:55.743 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:55.743 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:55.743 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.743 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.743 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.743 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.744 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.744 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.744 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:55.744 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:55.744 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.744 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.744 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.744 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.744 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.744 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.744 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.744 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.744 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.744 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.745 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.745 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.745 INFO:teuthology.orchestra.run.smithi037.stdout: "mark_out_threshold": { 2024-09-19T06:09:55.745 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mark_out_threshold", 2024-09-19T06:09:55.745 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-19T06:09:55.745 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.745 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.745 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "2419200", 2024-09-19T06:09:55.745 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.745 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.745 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.745 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T06:09:55.745 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.745 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.745 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.746 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.746 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_name": { 2024-09-19T06:09:55.746 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pool_name", 2024-09-19T06:09:55.746 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.746 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.746 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.746 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "device_health_metrics", 2024-09-19T06:09:55.746 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.746 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.746 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.746 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T06:09:55.746 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.746 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.746 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.747 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.747 INFO:teuthology.orchestra.run.smithi037.stdout: "retention_period": { 2024-09-19T06:09:55.747 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "retention_period", 2024-09-19T06:09:55.747 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-19T06:09:55.747 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.747 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.747 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "15552000", 2024-09-19T06:09:55.747 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.747 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.747 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.747 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how long to retain device health metrics", 2024-09-19T06:09:55.747 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.747 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.747 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.747 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.748 INFO:teuthology.orchestra.run.smithi037.stdout: "scrape_frequency": { 2024-09-19T06:09:55.748 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "scrape_frequency", 2024-09-19T06:09:55.748 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-19T06:09:55.748 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.748 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.748 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "86400", 2024-09-19T06:09:55.748 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.748 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.748 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.748 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T06:09:55.748 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.748 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.749 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.749 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.749 INFO:teuthology.orchestra.run.smithi037.stdout: "self_heal": { 2024-09-19T06:09:55.749 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "self_heal", 2024-09-19T06:09:55.749 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.749 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.749 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.749 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:55.749 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.749 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.749 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.749 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T06:09:55.749 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.749 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.750 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.750 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.750 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-09-19T06:09:55.750 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-09-19T06:09:55.750 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-19T06:09:55.750 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.750 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.750 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-09-19T06:09:55.750 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.750 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.750 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.750 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T06:09:55.750 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.750 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.751 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.751 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.751 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_threshold": { 2024-09-19T06:09:55.751 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_threshold", 2024-09-19T06:09:55.751 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-19T06:09:55.751 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.751 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.751 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "7257600", 2024-09-19T06:09:55.751 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.751 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.751 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.751 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T06:09:55.751 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.752 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.752 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.752 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:55.752 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:55.752 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.752 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:55.752 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "diskprediction_local", 2024-09-19T06:09:55.752 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:55.752 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:55.752 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:55.752 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:55.752 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:55.752 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.753 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.753 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.753 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.753 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.753 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.753 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.753 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:55.753 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:55.753 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:55.753 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:55.753 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:55.753 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:55.753 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.753 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.754 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.754 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.754 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.754 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.754 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:55.754 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:55.754 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.754 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.754 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.754 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.754 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.754 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.754 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.754 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.755 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.755 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.755 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.755 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.755 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:55.755 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:55.755 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.755 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.755 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.755 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:55.755 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.755 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.755 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.755 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:55.755 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:55.756 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:55.756 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:55.756 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:55.756 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:55.756 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.756 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.756 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.756 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.756 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.756 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.756 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:55.756 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:55.756 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.756 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.757 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.757 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.757 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.757 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.757 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.757 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.757 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.757 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.757 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.757 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.757 INFO:teuthology.orchestra.run.smithi037.stdout: "predict_interval": { 2024-09-19T06:09:55.757 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "predict_interval", 2024-09-19T06:09:55.757 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.757 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.758 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.758 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "86400", 2024-09-19T06:09:55.758 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.758 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.758 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.758 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.758 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.758 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.758 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.758 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.758 INFO:teuthology.orchestra.run.smithi037.stdout: "predictor_model": { 2024-09-19T06:09:55.758 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "predictor_model", 2024-09-19T06:09:55.758 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.758 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.759 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.759 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "prophetstor", 2024-09-19T06:09:55.759 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.759 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.759 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.759 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.759 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.759 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.759 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.759 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.759 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-09-19T06:09:55.759 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-09-19T06:09:55.759 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.759 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.759 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.760 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-09-19T06:09:55.760 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.760 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.760 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.760 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.760 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.760 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.760 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.760 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:55.760 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:55.760 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.760 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:55.760 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "influx", 2024-09-19T06:09:55.760 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": false, 2024-09-19T06:09:55.761 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "influxdb python module not found", 2024-09-19T06:09:55.761 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:55.761 INFO:teuthology.orchestra.run.smithi037.stdout: "batch_size": { 2024-09-19T06:09:55.761 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "batch_size", 2024-09-19T06:09:55.761 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:55.761 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.761 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.761 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5000", 2024-09-19T06:09:55.761 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.761 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.761 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.761 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T06:09:55.761 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.761 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.762 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.762 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.762 INFO:teuthology.orchestra.run.smithi037.stdout: "database": { 2024-09-19T06:09:55.762 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "database", 2024-09-19T06:09:55.762 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.762 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.762 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.762 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "ceph", 2024-09-19T06:09:55.762 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.762 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.762 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.762 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T06:09:55.762 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.763 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.763 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.763 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.763 INFO:teuthology.orchestra.run.smithi037.stdout: "hostname": { 2024-09-19T06:09:55.763 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "hostname", 2024-09-19T06:09:55.763 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.763 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.763 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.763 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.763 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.763 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.763 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.763 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "InfluxDB server hostname", 2024-09-19T06:09:55.763 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.764 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.764 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.764 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.764 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-09-19T06:09:55.764 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-09-19T06:09:55.764 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-19T06:09:55.764 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.764 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.764 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "30", 2024-09-19T06:09:55.764 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "5", 2024-09-19T06:09:55.764 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.764 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.764 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T06:09:55.764 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.765 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.765 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.765 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.765 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:55.765 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:55.765 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.765 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.765 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.765 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.765 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.765 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.765 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.765 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:55.765 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:55.766 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:55.766 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:55.766 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:55.766 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:55.766 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.766 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.766 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.766 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.766 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.766 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.766 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:55.766 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:55.766 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.766 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.766 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.767 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.767 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.767 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.767 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.767 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.767 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.767 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.767 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.767 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.767 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:55.767 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:55.767 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.767 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.767 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.768 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:55.768 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.768 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.768 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.768 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:55.768 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:55.768 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:55.768 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:55.768 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:55.768 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:55.768 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.768 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.768 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.768 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.769 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.769 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.769 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:55.769 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:55.769 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.769 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.769 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.769 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.769 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.769 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.769 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.769 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.769 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.769 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.770 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.770 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.770 INFO:teuthology.orchestra.run.smithi037.stdout: "password": { 2024-09-19T06:09:55.770 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "password", 2024-09-19T06:09:55.770 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.770 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.770 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.770 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.770 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.770 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.770 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.770 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "password of InfluxDB server user", 2024-09-19T06:09:55.770 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.770 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.771 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.771 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.771 INFO:teuthology.orchestra.run.smithi037.stdout: "port": { 2024-09-19T06:09:55.771 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "port", 2024-09-19T06:09:55.771 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:55.771 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.771 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.771 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8086", 2024-09-19T06:09:55.771 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.771 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.771 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.771 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "InfluxDB server port", 2024-09-19T06:09:55.771 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.772 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.772 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.772 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.772 INFO:teuthology.orchestra.run.smithi037.stdout: "ssl": { 2024-09-19T06:09:55.772 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssl", 2024-09-19T06:09:55.772 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.772 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.772 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.772 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "false", 2024-09-19T06:09:55.772 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.772 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.772 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.772 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T06:09:55.772 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.772 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.773 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.773 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.773 INFO:teuthology.orchestra.run.smithi037.stdout: "threads": { 2024-09-19T06:09:55.773 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "threads", 2024-09-19T06:09:55.773 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:55.773 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.773 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.773 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-09-19T06:09:55.773 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-09-19T06:09:55.773 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "32", 2024-09-19T06:09:55.773 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.773 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T06:09:55.773 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.773 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.774 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.774 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.774 INFO:teuthology.orchestra.run.smithi037.stdout: "username": { 2024-09-19T06:09:55.774 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "username", 2024-09-19T06:09:55.774 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.774 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.774 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.774 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.774 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.774 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.774 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.774 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "username of InfluxDB server user", 2024-09-19T06:09:55.774 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.774 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.774 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.775 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.775 INFO:teuthology.orchestra.run.smithi037.stdout: "verify_ssl": { 2024-09-19T06:09:55.775 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "verify_ssl", 2024-09-19T06:09:55.775 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.775 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.775 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.775 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "true", 2024-09-19T06:09:55.775 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.775 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.775 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.775 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T06:09:55.775 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.775 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.776 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.776 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:55.776 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:55.776 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.776 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:55.776 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "insights", 2024-09-19T06:09:55.776 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:55.776 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:55.776 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:55.776 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:55.776 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:55.776 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.776 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.777 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.777 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.777 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.777 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.777 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.777 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:55.777 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:55.777 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:55.777 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:55.777 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:55.777 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:55.777 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.777 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.777 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.778 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.778 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.778 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.778 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:55.778 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:55.778 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.778 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.778 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.778 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.778 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.778 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.778 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.778 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.778 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.778 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.779 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.779 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.779 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:55.779 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:55.779 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.779 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.779 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.779 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:55.779 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.779 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.779 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.779 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:55.779 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:55.780 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:55.780 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:55.780 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:55.780 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:55.780 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.780 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.780 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.780 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.780 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.780 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.780 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:55.780 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:55.780 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.780 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.781 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.781 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.781 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.781 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.781 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.781 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.781 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.781 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.781 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.781 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:55.781 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:55.781 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.781 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:55.781 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "iostat", 2024-09-19T06:09:55.782 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:55.782 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:55.782 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:55.782 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:55.782 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:55.782 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.782 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.782 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.782 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.782 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.782 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.782 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.782 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:55.782 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:55.782 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:55.783 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:55.783 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:55.783 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:55.783 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.783 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.783 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.783 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.783 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.783 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.783 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:55.783 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:55.783 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.783 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.783 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.784 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.784 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.784 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.784 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.784 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.784 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.784 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.784 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.784 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.784 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:55.784 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:55.784 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.784 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.784 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.785 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:55.785 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.785 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.785 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.785 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:55.785 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:55.785 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:55.785 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:55.785 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:55.785 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:55.785 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.785 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.785 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.785 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.786 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.786 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.786 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:55.786 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:55.786 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.786 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.786 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.786 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.786 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.786 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.786 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.786 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.786 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.786 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.787 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.787 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:55.787 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:55.787 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.787 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:55.787 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "k8sevents", 2024-09-19T06:09:55.787 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:55.787 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:55.787 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:55.787 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_event_retention_days": { 2024-09-19T06:09:55.787 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ceph_event_retention_days", 2024-09-19T06:09:55.787 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:55.787 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.787 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.787 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "7", 2024-09-19T06:09:55.788 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.788 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.788 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.788 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T06:09:55.788 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.788 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.788 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.788 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.788 INFO:teuthology.orchestra.run.smithi037.stdout: "config_check_secs": { 2024-09-19T06:09:55.788 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "config_check_secs", 2024-09-19T06:09:55.788 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:55.788 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.788 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.788 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-19T06:09:55.789 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "10", 2024-09-19T06:09:55.789 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.789 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.789 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T06:09:55.789 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.789 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.789 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.789 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.789 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:55.789 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:55.789 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.789 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.790 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.790 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.790 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.790 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.790 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.790 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:55.790 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:55.790 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:55.790 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:55.790 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:55.790 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:55.790 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.790 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.790 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.791 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.791 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.791 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.791 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:55.791 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:55.791 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.791 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.791 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.791 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.791 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.791 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.791 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.792 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.792 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.792 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.792 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.792 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.792 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:55.792 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:55.792 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.792 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.792 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.792 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:55.792 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.792 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.793 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.793 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:55.793 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:55.793 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:55.793 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:55.793 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:55.793 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:55.793 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.793 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.793 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.793 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.793 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.793 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.793 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:55.794 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:55.794 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.794 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.794 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.794 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.794 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.794 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.794 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.794 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.794 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.794 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.794 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.794 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:55.795 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:55.795 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.795 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:55.795 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "localpool", 2024-09-19T06:09:55.795 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:55.795 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:55.795 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:55.795 INFO:teuthology.orchestra.run.smithi037.stdout: "failure_domain": { 2024-09-19T06:09:55.795 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "failure_domain", 2024-09-19T06:09:55.795 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.795 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.795 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.795 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "host", 2024-09-19T06:09:55.795 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.796 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.796 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.796 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "failure domain for any created local pool", 2024-09-19T06:09:55.796 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T06:09:55.796 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.796 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.796 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.796 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:55.796 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:55.796 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.796 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.796 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.796 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.797 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.797 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.797 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.797 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:55.797 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:55.797 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:55.797 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:55.797 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:55.797 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:55.797 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.797 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.797 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.797 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.798 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.798 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.798 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:55.798 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:55.798 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.798 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.798 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.798 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.798 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.798 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.798 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.798 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.798 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.798 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.798 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.799 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.799 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:55.799 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:55.799 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.799 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.799 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.799 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:55.799 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.799 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.799 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.799 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:55.799 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:55.799 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:55.800 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:55.800 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:55.800 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:55.800 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.800 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.800 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.800 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.800 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.800 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.800 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:55.800 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:55.800 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.800 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.800 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.801 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.801 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.801 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.801 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.801 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.801 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.801 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.801 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.801 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.801 INFO:teuthology.orchestra.run.smithi037.stdout: "min_size": { 2024-09-19T06:09:55.801 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "min_size", 2024-09-19T06:09:55.801 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:55.801 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.801 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.802 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.802 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.802 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.802 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.802 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "default min_size for any created local pool", 2024-09-19T06:09:55.802 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T06:09:55.802 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.802 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.802 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.802 INFO:teuthology.orchestra.run.smithi037.stdout: "num_rep": { 2024-09-19T06:09:55.802 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "num_rep", 2024-09-19T06:09:55.803 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:55.803 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.803 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.803 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "3", 2024-09-19T06:09:55.803 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.803 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.803 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.803 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "default replica count for any created local pool", 2024-09-19T06:09:55.803 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.803 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.803 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.803 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.804 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num": { 2024-09-19T06:09:55.804 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pg_num", 2024-09-19T06:09:55.804 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:55.804 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.804 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.804 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "128", 2024-09-19T06:09:55.804 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.804 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.804 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.804 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T06:09:55.804 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.804 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.805 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.805 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.805 INFO:teuthology.orchestra.run.smithi037.stdout: "prefix": { 2024-09-19T06:09:55.805 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "prefix", 2024-09-19T06:09:55.805 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.805 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.805 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.805 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.805 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.805 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.805 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.805 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "name prefix for any created local pool", 2024-09-19T06:09:55.805 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.805 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.806 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.806 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.806 INFO:teuthology.orchestra.run.smithi037.stdout: "subtree": { 2024-09-19T06:09:55.806 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "subtree", 2024-09-19T06:09:55.806 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.806 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.806 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.806 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "rack", 2024-09-19T06:09:55.806 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.806 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.806 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.806 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T06:09:55.806 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T06:09:55.806 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.807 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.807 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:55.807 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:55.807 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.807 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:55.807 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mds_autoscaler", 2024-09-19T06:09:55.807 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:55.807 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:55.807 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:55.807 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:55.807 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:55.807 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.807 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.807 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.808 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.808 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.808 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.808 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.808 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:55.808 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:55.808 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:55.808 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:55.808 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:55.809 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:55.809 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.809 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.809 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.809 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.809 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.809 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.809 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:55.809 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:55.809 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.809 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.809 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.809 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.809 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.810 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.810 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.810 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.810 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.810 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.810 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.810 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.810 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:55.810 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:55.810 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.810 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.810 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.810 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:55.810 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.811 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.811 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.811 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:55.811 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:55.811 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:55.811 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:55.811 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:55.811 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:55.811 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.811 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.811 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.811 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.811 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.811 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.812 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:55.812 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:55.812 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.812 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.812 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.812 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.812 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.812 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.812 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.812 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.812 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.812 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.812 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.813 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:55.813 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:55.813 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.813 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:55.813 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mirroring", 2024-09-19T06:09:55.813 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:55.813 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:55.813 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:55.813 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:55.813 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:55.813 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.813 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.813 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.813 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.813 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.814 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.814 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.814 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:55.814 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:55.814 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:55.814 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:55.814 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:55.814 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:55.814 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.814 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.814 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.814 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.814 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.815 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.815 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:55.815 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:55.815 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.815 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.815 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.815 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.815 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.815 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.815 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.815 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.815 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.815 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.815 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.815 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.816 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:55.816 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:55.816 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.816 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.816 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.816 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:55.816 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.816 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.816 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.816 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:55.816 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:55.816 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:55.816 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:55.816 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:55.816 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:55.817 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.817 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.817 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.817 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.817 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.817 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.817 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:55.817 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:55.817 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.817 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.817 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.817 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.818 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.818 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.818 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.818 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.818 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.818 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.818 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.818 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:55.818 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:55.818 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.818 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:55.818 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "nfs", 2024-09-19T06:09:55.818 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:55.818 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:55.819 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:55.819 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:55.819 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:55.819 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.819 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.819 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.819 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.819 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.819 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.819 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.819 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:55.819 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:55.819 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:55.820 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:55.820 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:55.820 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:55.820 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.820 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.820 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.820 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.820 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.820 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.820 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:55.820 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:55.820 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.820 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.820 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.821 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.821 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.821 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.821 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.821 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.821 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.821 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.821 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.821 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.821 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:55.821 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:55.821 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.821 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.822 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.822 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:55.822 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.822 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.822 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.822 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:55.822 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:55.822 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:55.822 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:55.822 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:55.822 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:55.822 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.822 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.822 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.822 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.823 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.823 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.823 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:55.823 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:55.823 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.823 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.823 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.823 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.823 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.823 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.823 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.823 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.823 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.824 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.824 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.824 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:55.824 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:55.824 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.824 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:55.824 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "orchestrator", 2024-09-19T06:09:55.824 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:55.824 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:55.824 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:55.824 INFO:teuthology.orchestra.run.smithi037.stdout: "fail_fs": { 2024-09-19T06:09:55.824 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "fail_fs", 2024-09-19T06:09:55.824 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.825 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.825 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.825 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.825 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.825 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.825 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.825 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T06:09:55.825 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.825 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.825 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.825 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.825 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:55.825 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:55.825 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.826 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.826 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.826 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.826 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.826 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.826 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.826 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:55.826 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:55.826 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:55.826 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:55.826 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:55.826 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:55.826 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.826 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.827 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.827 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.827 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.827 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.827 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:55.827 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:55.827 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.827 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.827 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.827 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.827 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.827 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.827 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.827 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.827 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.828 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.828 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.828 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.828 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:55.828 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:55.828 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.828 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.828 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.828 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:55.828 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.828 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.828 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.828 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:55.828 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:55.829 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:55.829 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:55.829 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:55.829 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:55.829 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.829 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.829 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.829 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.829 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.829 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.829 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:55.829 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:55.829 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.829 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.829 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.830 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.830 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.830 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.830 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.830 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.830 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.830 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.830 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.830 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.830 INFO:teuthology.orchestra.run.smithi037.stdout: "orchestrator": { 2024-09-19T06:09:55.830 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "orchestrator", 2024-09-19T06:09:55.830 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.830 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.830 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.831 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.831 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.831 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.831 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.831 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm", 2024-09-19T06:09:55.831 INFO:teuthology.orchestra.run.smithi037.stdout: "rook", 2024-09-19T06:09:55.831 INFO:teuthology.orchestra.run.smithi037.stdout: "test_orchestrator" 2024-09-19T06:09:55.831 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.831 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Orchestrator backend", 2024-09-19T06:09:55.831 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.831 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.831 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.831 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:55.831 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:55.832 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.832 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:55.832 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "osd_perf_query", 2024-09-19T06:09:55.832 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:55.832 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:55.832 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:55.832 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:55.832 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:55.832 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.832 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.832 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.832 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.833 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.833 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.833 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.833 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:55.833 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:55.833 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:55.833 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:55.833 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:55.833 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:55.833 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.834 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.834 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.834 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.834 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.834 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.834 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:55.834 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:55.834 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.834 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.834 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.834 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.834 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.834 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.834 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.834 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.835 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.835 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.835 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.835 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.835 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:55.835 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:55.835 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.835 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.835 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.835 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:55.835 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.835 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.835 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.836 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:55.836 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:55.836 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:55.836 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:55.836 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:55.836 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:55.836 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.836 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.836 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.836 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.836 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.836 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.836 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:55.836 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:55.837 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.837 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.837 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.837 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.837 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.837 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.837 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.837 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.837 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.837 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.837 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.837 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:55.837 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:55.838 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.838 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:55.838 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "osd_support", 2024-09-19T06:09:55.838 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:55.838 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:55.838 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:55.838 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:55.838 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:55.838 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.838 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.838 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.838 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.838 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.838 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.839 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.839 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:55.839 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:55.839 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:55.839 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:55.839 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:55.839 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:55.839 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.839 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.839 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.839 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.839 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.839 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.839 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:55.840 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:55.840 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.840 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.840 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.840 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.840 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.840 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.840 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.840 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.840 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.840 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.840 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.840 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.841 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:55.841 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:55.841 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.841 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.841 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.841 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:55.841 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.841 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.841 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.841 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:55.841 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:55.841 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:55.841 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:55.841 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:55.842 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:55.842 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.842 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.842 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.842 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.842 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.842 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.842 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:55.842 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:55.842 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.842 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.842 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.842 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.842 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.843 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.843 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.843 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.843 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.843 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.843 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.843 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:55.843 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:55.843 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.843 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:55.843 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pg_autoscaler", 2024-09-19T06:09:55.843 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:55.843 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:55.843 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:55.843 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:55.844 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:55.844 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.844 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.844 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.844 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.844 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.844 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.844 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.844 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:55.844 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:55.844 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:55.844 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:55.844 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:55.845 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:55.845 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.845 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.845 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.845 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.845 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.845 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.845 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:55.845 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:55.845 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.845 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.845 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.845 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.845 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.846 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.846 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.846 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.846 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.846 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.846 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.846 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.846 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:55.846 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:55.846 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.846 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.846 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.846 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:55.847 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.847 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.847 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.847 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:55.847 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:55.847 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:55.847 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:55.847 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:55.847 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:55.847 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.847 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.847 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.847 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.847 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.848 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.848 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:55.848 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:55.848 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.848 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.848 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.848 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.848 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.848 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.848 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.848 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.848 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.848 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.849 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.849 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.849 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-09-19T06:09:55.849 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-09-19T06:09:55.849 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-19T06:09:55.849 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.849 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.849 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-09-19T06:09:55.849 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.849 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.849 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.849 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.849 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.849 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.850 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.850 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.850 INFO:teuthology.orchestra.run.smithi037.stdout: "threshold": { 2024-09-19T06:09:55.850 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "threshold", 2024-09-19T06:09:55.850 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-19T06:09:55.850 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.850 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.850 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "3.0", 2024-09-19T06:09:55.850 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1.0", 2024-09-19T06:09:55.850 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.850 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.850 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "scaling threshold", 2024-09-19T06:09:55.850 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T06:09:55.850 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.851 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.851 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:55.851 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:55.851 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.851 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:55.851 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "progress", 2024-09-19T06:09:55.851 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:55.851 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:55.851 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:55.851 INFO:teuthology.orchestra.run.smithi037.stdout: "allow_pg_recovery_event": { 2024-09-19T06:09:55.851 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "allow_pg_recovery_event", 2024-09-19T06:09:55.851 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.851 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.851 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.852 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.852 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.852 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.852 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.852 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T06:09:55.852 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.852 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.852 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.852 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.852 INFO:teuthology.orchestra.run.smithi037.stdout: "enabled": { 2024-09-19T06:09:55.852 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enabled", 2024-09-19T06:09:55.852 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.852 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.853 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.853 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:55.853 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.853 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.853 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.853 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.853 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.853 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.853 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.853 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.853 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:55.853 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:55.853 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.853 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.854 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.854 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.854 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.854 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.854 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.854 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:55.854 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:55.854 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:55.854 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:55.854 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:55.854 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:55.854 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.854 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.854 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.855 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.855 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.855 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.855 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:55.855 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:55.855 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.855 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.855 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.855 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.855 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.855 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.855 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.855 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.856 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.856 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.856 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.856 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.856 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:55.856 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:55.856 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.856 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.856 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.856 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:55.856 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.856 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.856 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.856 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:55.857 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:55.857 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:55.857 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:55.857 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:55.857 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:55.857 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.857 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.857 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.857 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.857 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.857 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.857 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:55.857 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:55.857 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.858 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.858 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.858 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.858 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.858 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.858 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.858 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.858 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.858 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.858 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.858 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.858 INFO:teuthology.orchestra.run.smithi037.stdout: "max_completed_events": { 2024-09-19T06:09:55.858 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_completed_events", 2024-09-19T06:09:55.858 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:55.859 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.859 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.859 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "50", 2024-09-19T06:09:55.859 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.859 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.859 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.859 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "number of past completed events to remember", 2024-09-19T06:09:55.859 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.859 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.859 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.859 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.859 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-09-19T06:09:55.859 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-09-19T06:09:55.859 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-19T06:09:55.859 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.860 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.860 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-09-19T06:09:55.860 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.860 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.860 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.860 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how long the module is going to sleep", 2024-09-19T06:09:55.860 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.860 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.860 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.860 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:55.860 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:55.860 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.861 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:55.861 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "prometheus", 2024-09-19T06:09:55.861 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:55.861 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:55.861 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:55.861 INFO:teuthology.orchestra.run.smithi037.stdout: "cache": { 2024-09-19T06:09:55.861 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cache", 2024-09-19T06:09:55.861 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.861 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.861 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.861 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:55.861 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.861 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.862 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.862 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.862 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.862 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.862 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.862 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.862 INFO:teuthology.orchestra.run.smithi037.stdout: "exclude_perf_counters": { 2024-09-19T06:09:55.862 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "exclude_perf_counters", 2024-09-19T06:09:55.862 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.862 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.862 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.862 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:55.862 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.862 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.863 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.863 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T06:09:55.863 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T06:09:55.863 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.863 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.863 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.863 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:55.863 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:55.863 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.863 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.863 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.863 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.863 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.863 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.864 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.864 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:55.864 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:55.864 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:55.864 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:55.864 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:55.864 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:55.864 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.864 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.864 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.864 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.864 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.864 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.865 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:55.865 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:55.865 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.865 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.865 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.865 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.865 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.865 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.865 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.865 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.865 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.865 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.865 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.866 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.866 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:55.866 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:55.866 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.866 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.866 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.866 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:55.866 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.866 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.866 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.866 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:55.866 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:55.866 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:55.866 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:55.867 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:55.867 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:55.867 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.867 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.867 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.867 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.867 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.867 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.867 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:55.867 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:55.867 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.867 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.867 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.867 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.868 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.868 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.868 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.868 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.868 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.868 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.868 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.868 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.868 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_stats_pools": { 2024-09-19T06:09:55.868 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rbd_stats_pools", 2024-09-19T06:09:55.868 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.868 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.868 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.868 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.869 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.869 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.869 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.869 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.869 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.869 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.869 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.869 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.869 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T06:09:55.869 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T06:09:55.869 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:55.869 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.869 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.869 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "300", 2024-09-19T06:09:55.870 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.870 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.870 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.870 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.870 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.870 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.870 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.870 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.870 INFO:teuthology.orchestra.run.smithi037.stdout: "scrape_interval": { 2024-09-19T06:09:55.870 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "scrape_interval", 2024-09-19T06:09:55.870 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-19T06:09:55.870 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.870 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.870 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "15.0", 2024-09-19T06:09:55.871 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.871 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.871 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.871 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.871 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.871 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.871 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.871 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.871 INFO:teuthology.orchestra.run.smithi037.stdout: "server_addr": { 2024-09-19T06:09:55.871 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_addr", 2024-09-19T06:09:55.871 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.871 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.871 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.871 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "::", 2024-09-19T06:09:55.871 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.872 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.872 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.872 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T06:09:55.872 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.872 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.872 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.872 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.872 INFO:teuthology.orchestra.run.smithi037.stdout: "server_port": { 2024-09-19T06:09:55.872 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_port", 2024-09-19T06:09:55.872 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:55.872 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.872 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.872 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "9283", 2024-09-19T06:09:55.872 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.872 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.873 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.873 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T06:09:55.873 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.873 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.873 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.873 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.873 INFO:teuthology.orchestra.run.smithi037.stdout: "stale_cache_strategy": { 2024-09-19T06:09:55.873 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "stale_cache_strategy", 2024-09-19T06:09:55.873 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.873 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.873 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.873 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "log", 2024-09-19T06:09:55.874 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.874 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.874 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.874 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.874 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.874 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.874 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.874 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.874 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_behaviour": { 2024-09-19T06:09:55.874 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_behaviour", 2024-09-19T06:09:55.874 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.874 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.874 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.875 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "default", 2024-09-19T06:09:55.875 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.875 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.875 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.875 INFO:teuthology.orchestra.run.smithi037.stdout: "default", 2024-09-19T06:09:55.875 INFO:teuthology.orchestra.run.smithi037.stdout: "error" 2024-09-19T06:09:55.875 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.875 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.875 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.875 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.875 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.875 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.875 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_error_status_code": { 2024-09-19T06:09:55.875 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_error_status_code", 2024-09-19T06:09:55.876 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:55.876 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.876 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.876 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "500", 2024-09-19T06:09:55.876 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "400", 2024-09-19T06:09:55.876 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "599", 2024-09-19T06:09:55.876 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.876 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.876 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.876 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.876 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.876 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:55.876 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:55.876 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.877 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:55.877 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rbd_support", 2024-09-19T06:09:55.877 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:55.877 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:55.877 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:55.877 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:55.877 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:55.877 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.877 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.877 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.877 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.877 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.877 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.877 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.878 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:55.878 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:55.878 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:55.878 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:55.878 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:55.878 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:55.878 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.878 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.878 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.878 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.878 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.878 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.878 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:55.878 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:55.879 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.879 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.879 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.879 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.879 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.879 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.879 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.879 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.879 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.879 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.879 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.879 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.879 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:55.879 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:55.880 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.880 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.880 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.880 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:55.880 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.880 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.880 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.880 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:55.880 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:55.880 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:55.880 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:55.880 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:55.880 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:55.880 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.881 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.881 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.881 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.881 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.881 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.881 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:55.881 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:55.881 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.881 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.881 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.881 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.881 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.881 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.881 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.882 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.882 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.882 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.882 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.882 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.882 INFO:teuthology.orchestra.run.smithi037.stdout: "max_concurrent_snap_create": { 2024-09-19T06:09:55.882 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_concurrent_snap_create", 2024-09-19T06:09:55.882 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:55.882 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.882 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.882 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-19T06:09:55.882 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.882 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.882 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.882 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.883 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.883 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.883 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.883 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.883 INFO:teuthology.orchestra.run.smithi037.stdout: "mirror_snapshot_schedule": { 2024-09-19T06:09:55.883 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T06:09:55.883 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.883 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.883 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.883 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.883 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.883 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.883 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.883 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.884 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.884 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.884 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.884 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.884 INFO:teuthology.orchestra.run.smithi037.stdout: "trash_purge_schedule": { 2024-09-19T06:09:55.884 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "trash_purge_schedule", 2024-09-19T06:09:55.884 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.884 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.884 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.884 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.884 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.884 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.884 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.884 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.885 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.885 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.885 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.885 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:55.885 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:55.885 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.885 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:55.885 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "restful", 2024-09-19T06:09:55.885 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:55.885 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:55.885 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:55.885 INFO:teuthology.orchestra.run.smithi037.stdout: "enable_auth": { 2024-09-19T06:09:55.885 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enable_auth", 2024-09-19T06:09:55.885 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.885 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.886 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.886 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:55.886 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.886 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.886 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.886 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.886 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.886 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.886 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.886 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.886 INFO:teuthology.orchestra.run.smithi037.stdout: "key_file": { 2024-09-19T06:09:55.886 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "key_file", 2024-09-19T06:09:55.886 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.886 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.886 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.887 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.887 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.887 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.887 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.887 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.887 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.887 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.887 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.887 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.888 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:55.888 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:55.888 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.888 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.888 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.888 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.888 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.888 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.888 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.888 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:55.888 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:55.888 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:55.888 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:55.889 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:55.889 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:55.889 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.889 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.889 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.889 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.889 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.889 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.889 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:55.889 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:55.889 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.889 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.889 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.889 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.890 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.890 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.890 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.890 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.890 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.890 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.890 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.890 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.890 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:55.890 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:55.890 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.890 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.890 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.890 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:55.891 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.891 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.891 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.891 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:55.891 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:55.891 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:55.891 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:55.891 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:55.891 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:55.891 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.891 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.891 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.891 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.891 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.892 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.892 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:55.892 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:55.892 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.892 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.892 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.892 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.892 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.892 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.892 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.892 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.892 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.892 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.892 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.893 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.893 INFO:teuthology.orchestra.run.smithi037.stdout: "server_addr": { 2024-09-19T06:09:55.893 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_addr", 2024-09-19T06:09:55.893 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.893 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.893 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.893 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.893 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.893 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.893 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.893 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.893 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.893 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.894 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.894 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.894 INFO:teuthology.orchestra.run.smithi037.stdout: "server_port": { 2024-09-19T06:09:55.894 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_port", 2024-09-19T06:09:55.894 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.894 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.894 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.894 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.894 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.894 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.894 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.894 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.894 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.894 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.895 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.895 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:55.895 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:55.895 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.895 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:55.895 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rgw", 2024-09-19T06:09:55.895 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:55.895 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:55.895 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:55.895 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:55.895 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:55.895 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.895 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.895 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.896 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.896 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.896 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.896 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.896 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:55.896 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:55.896 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:55.896 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:55.896 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:55.896 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:55.896 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.896 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.896 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.896 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.897 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.897 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.897 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:55.897 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:55.897 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.897 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.897 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.897 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.897 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.897 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.897 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.897 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.897 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.897 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.897 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.898 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.898 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:55.898 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:55.898 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.898 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.898 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.898 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:55.898 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.898 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.898 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.898 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:55.898 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:55.898 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:55.898 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:55.899 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:55.899 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:55.899 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.899 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.899 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.899 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.899 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.899 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.899 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:55.899 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:55.899 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.899 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.899 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.899 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.899 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.900 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.900 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.900 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.900 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.900 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.900 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.900 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.900 INFO:teuthology.orchestra.run.smithi037.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T06:09:55.900 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T06:09:55.900 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:55.900 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.900 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.900 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-09-19T06:09:55.900 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.901 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.901 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.901 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T06:09:55.901 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.901 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.901 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.901 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:55.901 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:55.901 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.901 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:55.901 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rook", 2024-09-19T06:09:55.901 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:55.902 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:55.902 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:55.902 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:55.902 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:55.902 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.902 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.902 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.902 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.902 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.902 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.902 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.902 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:55.902 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:55.903 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:55.903 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:55.903 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:55.903 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:55.903 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.903 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.903 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.903 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.903 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.903 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.903 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:55.903 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:55.903 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.904 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.904 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.904 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.904 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.904 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.904 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.904 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.904 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.904 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.904 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.904 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.904 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:55.904 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:55.904 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.905 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.905 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.905 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:55.905 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.905 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.905 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.905 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:55.905 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:55.905 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:55.905 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:55.905 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:55.905 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:55.905 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.905 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.906 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.906 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.906 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.906 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.906 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:55.906 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:55.906 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.906 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.906 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.906 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.906 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.906 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.906 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.907 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.907 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.907 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.907 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.907 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.907 INFO:teuthology.orchestra.run.smithi037.stdout: "storage_class": { 2024-09-19T06:09:55.907 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "storage_class", 2024-09-19T06:09:55.907 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.907 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.907 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.907 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "local", 2024-09-19T06:09:55.907 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.907 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.907 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.908 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T06:09:55.908 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.908 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.908 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.908 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:55.908 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:55.908 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.908 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:55.908 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "selftest", 2024-09-19T06:09:55.908 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:55.908 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:55.908 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:55.909 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:55.909 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:55.909 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.909 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.909 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.909 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.909 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.909 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.909 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.909 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:55.909 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:55.910 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:55.910 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:55.910 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:55.910 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:55.910 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.910 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.910 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.910 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.910 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.910 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.910 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:55.910 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:55.910 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.910 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.911 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.911 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.911 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.911 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.911 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.911 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.911 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.911 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.911 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.911 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.911 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:55.911 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:55.911 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.911 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.912 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.912 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:55.912 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.912 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.912 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.912 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:55.912 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:55.912 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:55.912 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:55.912 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:55.912 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:55.912 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.912 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.912 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.913 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.913 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.913 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.913 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:55.913 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:55.913 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.913 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.913 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.913 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.913 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.913 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.913 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.913 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.913 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.914 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.914 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.914 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.914 INFO:teuthology.orchestra.run.smithi037.stdout: "roption1": { 2024-09-19T06:09:55.914 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "roption1", 2024-09-19T06:09:55.914 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.914 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.914 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.914 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.914 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.914 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.914 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.914 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.914 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.914 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.915 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.915 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.915 INFO:teuthology.orchestra.run.smithi037.stdout: "roption2": { 2024-09-19T06:09:55.915 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "roption2", 2024-09-19T06:09:55.915 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.915 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.915 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.915 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "xyz", 2024-09-19T06:09:55.915 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.915 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.915 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.915 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.915 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.915 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.915 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.916 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.916 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption1": { 2024-09-19T06:09:55.916 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption1", 2024-09-19T06:09:55.916 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.916 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.916 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.916 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.916 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.916 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.916 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.916 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.917 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.917 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.917 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.917 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.917 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption2": { 2024-09-19T06:09:55.917 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption2", 2024-09-19T06:09:55.917 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:55.917 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.917 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.917 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.917 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.917 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.917 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.918 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.918 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.918 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.918 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.918 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.918 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption3": { 2024-09-19T06:09:55.918 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption3", 2024-09-19T06:09:55.918 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-19T06:09:55.918 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.918 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.918 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.918 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.918 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.918 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.918 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.919 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.919 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.919 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.919 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.919 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption4": { 2024-09-19T06:09:55.919 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption4", 2024-09-19T06:09:55.919 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.919 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.919 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.919 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.919 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.919 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.919 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.919 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.920 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.920 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.920 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.920 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.920 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption5": { 2024-09-19T06:09:55.920 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption5", 2024-09-19T06:09:55.920 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.920 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.920 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.920 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.920 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.920 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.920 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.921 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.921 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.921 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.921 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.921 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.921 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption6": { 2024-09-19T06:09:55.921 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption6", 2024-09-19T06:09:55.921 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.921 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.921 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.921 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:55.921 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.921 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.921 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.921 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.922 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.922 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.922 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.922 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.922 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption7": { 2024-09-19T06:09:55.922 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption7", 2024-09-19T06:09:55.922 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:55.922 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.922 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.922 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.922 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-09-19T06:09:55.922 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "42", 2024-09-19T06:09:55.922 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.923 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.923 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.923 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.923 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.923 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.923 INFO:teuthology.orchestra.run.smithi037.stdout: "testkey": { 2024-09-19T06:09:55.923 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "testkey", 2024-09-19T06:09:55.924 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.924 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.924 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.924 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.924 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.924 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.924 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.924 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.924 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.924 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.924 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.924 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.925 INFO:teuthology.orchestra.run.smithi037.stdout: "testlkey": { 2024-09-19T06:09:55.925 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "testlkey", 2024-09-19T06:09:55.925 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.925 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.925 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.925 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.925 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.925 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.925 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.925 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.925 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.925 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.925 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.925 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.925 INFO:teuthology.orchestra.run.smithi037.stdout: "testnewline": { 2024-09-19T06:09:55.926 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "testnewline", 2024-09-19T06:09:55.926 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.926 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.926 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.926 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.926 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.926 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.926 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.926 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.926 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.926 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.926 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.926 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:55.926 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:55.927 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.927 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:55.927 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "snap_schedule", 2024-09-19T06:09:55.927 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:55.927 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:55.927 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:55.927 INFO:teuthology.orchestra.run.smithi037.stdout: "allow_m_granularity": { 2024-09-19T06:09:55.927 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "allow_m_granularity", 2024-09-19T06:09:55.927 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.927 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.927 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.927 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.927 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.927 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.928 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.928 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T06:09:55.928 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.928 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.928 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.928 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.928 INFO:teuthology.orchestra.run.smithi037.stdout: "dump_on_update": { 2024-09-19T06:09:55.928 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "dump_on_update", 2024-09-19T06:09:55.928 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.928 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.928 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.928 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.928 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.928 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.929 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.929 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "dump database to debug log on update", 2024-09-19T06:09:55.929 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.929 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.929 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.929 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.929 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:55.929 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:55.929 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.929 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.929 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.929 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.929 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.929 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.930 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.930 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:55.930 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:55.930 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:55.930 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:55.930 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:55.930 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:55.930 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.930 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.930 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.930 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.930 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.930 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.931 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:55.931 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:55.931 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.931 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.931 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.931 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.931 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.931 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.931 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.931 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.931 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.931 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.931 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.932 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.932 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:55.932 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:55.932 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.932 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.932 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.932 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:55.932 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.932 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.932 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.932 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:55.932 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:55.932 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:55.932 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:55.933 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:55.933 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:55.933 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.933 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.933 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.933 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.933 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.933 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.933 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:55.934 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:55.934 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.934 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.934 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.934 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.934 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.934 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.934 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.934 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.934 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.934 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.934 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.934 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:55.935 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:55.935 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.935 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:55.935 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "stats", 2024-09-19T06:09:55.935 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:55.935 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:55.935 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:55.935 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:55.935 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:55.935 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.935 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.935 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.935 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.935 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.936 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.936 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.936 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:55.936 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:55.936 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:55.936 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:55.936 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:55.936 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:55.936 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.936 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.936 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.936 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.936 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.936 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.937 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:55.937 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:55.937 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.937 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.937 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.937 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.937 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.937 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.937 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.937 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.937 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.937 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.937 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.938 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.938 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:55.938 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:55.938 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.938 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.938 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.938 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:55.938 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.938 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.938 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.938 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:55.938 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:55.938 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:55.938 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:55.939 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:55.939 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:55.939 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.939 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.939 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.939 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.939 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.939 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.939 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:55.939 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:55.939 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.939 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.939 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.939 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.940 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.940 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.940 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.940 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.940 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.940 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.940 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.940 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:55.940 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:55.940 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.940 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:55.940 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "status", 2024-09-19T06:09:55.940 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:55.940 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:55.941 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:55.941 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:55.941 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:55.941 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.941 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.941 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.941 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.941 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.941 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.941 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.941 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:55.941 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:55.941 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:55.941 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:55.942 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:55.942 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:55.942 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.942 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.942 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.942 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.942 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.942 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.942 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:55.942 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:55.942 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.942 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.942 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.942 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.943 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.943 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.943 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.943 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.943 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.943 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.943 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.943 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.943 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:55.943 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:55.943 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.943 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.943 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.943 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:55.944 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.944 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.944 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.944 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:55.944 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:55.944 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:55.944 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:55.944 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:55.944 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:55.944 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.944 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.944 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.944 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.944 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.945 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.945 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:55.945 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:55.945 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.945 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.945 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.945 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.945 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.945 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.945 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.945 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.945 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.945 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.946 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.946 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:55.946 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:55.946 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.946 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:55.946 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "telegraf", 2024-09-19T06:09:55.946 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:55.946 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:55.946 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:55.946 INFO:teuthology.orchestra.run.smithi037.stdout: "address": { 2024-09-19T06:09:55.946 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "address", 2024-09-19T06:09:55.946 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.946 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.947 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.947 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T06:09:55.947 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.947 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.947 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.947 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.947 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.947 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.947 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.947 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.947 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-09-19T06:09:55.947 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-09-19T06:09:55.947 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-19T06:09:55.947 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.948 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.948 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "15", 2024-09-19T06:09:55.948 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.948 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.948 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.948 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.948 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.948 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.948 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.948 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.948 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:55.948 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:55.948 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.949 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.949 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.949 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.949 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.949 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.949 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.949 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:55.949 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:55.949 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:55.949 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:55.949 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:55.949 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:55.949 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.950 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.950 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.950 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.950 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.950 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.950 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:55.950 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:55.950 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.950 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.950 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.950 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.950 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.950 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.950 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.951 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.951 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.951 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.951 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.951 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.951 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:55.951 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:55.951 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.951 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.951 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.951 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:55.951 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.951 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.951 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.952 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:55.952 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:55.952 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:55.952 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:55.952 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:55.952 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:55.952 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.952 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.952 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.952 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.952 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.952 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.952 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:55.952 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:55.953 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.953 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.953 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.953 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.953 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.953 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.953 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.953 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.953 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.953 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.953 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.953 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:55.953 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:55.953 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.954 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:55.954 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "telemetry", 2024-09-19T06:09:55.954 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:55.954 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:55.954 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:55.954 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_basic": { 2024-09-19T06:09:55.954 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_basic", 2024-09-19T06:09:55.954 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.954 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.954 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.954 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:55.954 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.954 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.954 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.955 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T06:09:55.955 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.955 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.955 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.955 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.955 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_crash": { 2024-09-19T06:09:55.955 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_crash", 2024-09-19T06:09:55.955 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.955 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.955 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.955 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:55.955 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.955 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.955 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.956 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T06:09:55.956 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.956 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.956 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.956 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.956 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_device": { 2024-09-19T06:09:55.956 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_device", 2024-09-19T06:09:55.956 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.956 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.956 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.956 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:55.956 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.956 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.956 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.957 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T06:09:55.957 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.957 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.957 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.957 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.957 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_ident": { 2024-09-19T06:09:55.957 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_ident", 2024-09-19T06:09:55.957 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.957 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.957 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.957 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.957 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.957 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.957 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.958 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T06:09:55.958 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.958 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.958 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.958 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.958 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_perf": { 2024-09-19T06:09:55.958 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_perf", 2024-09-19T06:09:55.958 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.958 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.958 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.958 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.958 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.958 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.958 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.958 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T06:09:55.959 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.959 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.959 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.959 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.959 INFO:teuthology.orchestra.run.smithi037.stdout: "contact": { 2024-09-19T06:09:55.959 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "contact", 2024-09-19T06:09:55.959 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.959 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.959 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.959 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.959 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.959 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.960 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.960 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.960 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.960 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.960 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.960 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.960 INFO:teuthology.orchestra.run.smithi037.stdout: "description": { 2024-09-19T06:09:55.960 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "description", 2024-09-19T06:09:55.960 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.960 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.960 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.960 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.960 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.960 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.961 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.961 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.961 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.961 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.961 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.961 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.961 INFO:teuthology.orchestra.run.smithi037.stdout: "device_url": { 2024-09-19T06:09:55.961 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "device_url", 2024-09-19T06:09:55.961 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.961 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.961 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.961 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T06:09:55.961 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.962 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.962 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.962 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.962 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.962 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.962 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.962 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.962 INFO:teuthology.orchestra.run.smithi037.stdout: "enabled": { 2024-09-19T06:09:55.962 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enabled", 2024-09-19T06:09:55.962 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.962 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.962 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.962 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.962 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.963 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.963 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.963 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.963 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.963 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.963 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.963 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.963 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-09-19T06:09:55.963 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-09-19T06:09:55.963 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:55.963 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.963 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.963 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "24", 2024-09-19T06:09:55.963 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "8", 2024-09-19T06:09:55.964 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.964 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.964 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.964 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.964 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.964 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.964 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.964 INFO:teuthology.orchestra.run.smithi037.stdout: "last_opt_revision": { 2024-09-19T06:09:55.964 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "last_opt_revision", 2024-09-19T06:09:55.964 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:55.964 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.964 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.964 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "1", 2024-09-19T06:09:55.964 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.965 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.965 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.965 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.965 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.965 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.965 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.965 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.965 INFO:teuthology.orchestra.run.smithi037.stdout: "leaderboard": { 2024-09-19T06:09:55.965 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "leaderboard", 2024-09-19T06:09:55.965 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.965 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.965 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.966 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.966 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.966 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.966 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.966 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.966 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.966 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.966 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.966 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.966 INFO:teuthology.orchestra.run.smithi037.stdout: "leaderboard_description": { 2024-09-19T06:09:55.966 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "leaderboard_description", 2024-09-19T06:09:55.966 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.966 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.966 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.967 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.967 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.967 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.967 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.967 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.967 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.967 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.967 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.967 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.967 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:55.967 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:55.967 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.967 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.968 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.968 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.968 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.968 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.968 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.968 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:55.968 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:55.968 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:55.968 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:55.968 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:55.968 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:55.968 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.968 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.969 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.969 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.969 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.969 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.969 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:55.969 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:55.969 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.969 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.969 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.969 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.969 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.969 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.970 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.970 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.970 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.970 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.970 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.970 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.970 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:55.970 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:55.970 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.970 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.970 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.970 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:55.970 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.970 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.970 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.971 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:55.971 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:55.971 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:55.971 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:55.971 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:55.971 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:55.971 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.971 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.971 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.971 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.971 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.971 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.971 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:55.971 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:55.972 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.972 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.972 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.972 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.972 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.972 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.972 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.972 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.972 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.972 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.972 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.972 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.972 INFO:teuthology.orchestra.run.smithi037.stdout: "organization": { 2024-09-19T06:09:55.972 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "organization", 2024-09-19T06:09:55.972 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.973 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.973 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.973 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.973 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.973 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.973 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.973 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.973 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.973 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.973 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.973 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.973 INFO:teuthology.orchestra.run.smithi037.stdout: "proxy": { 2024-09-19T06:09:55.973 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "proxy", 2024-09-19T06:09:55.974 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.974 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.974 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.974 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.974 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.974 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.974 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.974 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.974 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.974 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.974 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.974 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.974 INFO:teuthology.orchestra.run.smithi037.stdout: "url": { 2024-09-19T06:09:55.975 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "url", 2024-09-19T06:09:55.975 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.975 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.975 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.975 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T06:09:55.975 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.975 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.975 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.975 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.975 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.975 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.975 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.975 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:55.975 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:55.976 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.976 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:55.976 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "test_orchestrator", 2024-09-19T06:09:55.976 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:55.976 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:55.976 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:55.976 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:55.976 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:55.976 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.976 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.976 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.976 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.976 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.977 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.977 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.977 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:55.977 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:55.977 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:55.977 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:55.977 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:55.977 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:55.977 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.977 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.977 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.977 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.977 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.978 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.978 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:55.978 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:55.978 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.978 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.978 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.978 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.978 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.978 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.978 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.978 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.978 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.978 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.979 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.979 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.979 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:55.979 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:55.979 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.979 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.979 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.979 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:55.979 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.979 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.979 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.979 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:55.979 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:55.979 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:55.980 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:55.980 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:55.980 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:55.980 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.980 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.980 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.980 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.980 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.980 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.980 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:55.980 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:55.980 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.980 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.980 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.981 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.981 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.981 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.981 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.981 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.981 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.981 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.981 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.981 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:55.981 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:55.981 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.981 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:55.981 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "volumes", 2024-09-19T06:09:55.981 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:55.981 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:55.982 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:55.982 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:55.982 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:55.982 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.982 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.982 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.982 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.982 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.982 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.982 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.982 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:55.982 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:55.983 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:55.983 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:55.983 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:55.983 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:55.983 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.983 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.983 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.983 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.983 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.983 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.983 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:55.983 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:55.983 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.984 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.984 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.984 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.984 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.984 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.984 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.984 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.984 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.984 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.984 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.984 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.984 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:55.984 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:55.985 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.985 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.985 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.985 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:55.985 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.985 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.985 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.985 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:55.985 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:55.985 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:55.985 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:55.985 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:55.985 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:55.985 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.985 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.986 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.986 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.986 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.986 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.986 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:55.986 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:55.986 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.986 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.986 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.986 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.986 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.986 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.986 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.986 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.986 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.987 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.987 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.987 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.987 INFO:teuthology.orchestra.run.smithi037.stdout: "max_concurrent_clones": { 2024-09-19T06:09:55.987 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_concurrent_clones", 2024-09-19T06:09:55.987 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:55.987 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.987 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.987 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "4", 2024-09-19T06:09:55.987 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.987 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.987 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.987 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T06:09:55.988 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.988 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.988 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.988 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.988 INFO:teuthology.orchestra.run.smithi037.stdout: "periodic_async_work": { 2024-09-19T06:09:55.988 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "periodic_async_work", 2024-09-19T06:09:55.988 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.988 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.988 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.988 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.988 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.988 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.988 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.989 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Periodically check for async work", 2024-09-19T06:09:55.989 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.989 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.989 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.989 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.989 INFO:teuthology.orchestra.run.smithi037.stdout: "snapshot_clone_delay": { 2024-09-19T06:09:55.989 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "snapshot_clone_delay", 2024-09-19T06:09:55.989 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:55.989 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.989 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.989 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-19T06:09:55.989 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.989 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.989 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.990 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T06:09:55.990 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.990 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.990 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.990 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.990 INFO:teuthology.orchestra.run.smithi037.stdout: "snapshot_clone_no_wait": { 2024-09-19T06:09:55.990 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T06:09:55.990 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.990 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.990 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.990 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:55.990 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.990 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.990 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.991 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T06:09:55.991 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.991 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.991 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.991 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:55.991 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:55.991 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.991 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:55.991 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix", 2024-09-19T06:09:55.991 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:55.991 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:55.991 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:55.991 INFO:teuthology.orchestra.run.smithi037.stdout: "discovery_interval": { 2024-09-19T06:09:55.991 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "discovery_interval", 2024-09-19T06:09:55.992 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-09-19T06:09:55.992 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.992 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.992 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "100", 2024-09-19T06:09:55.992 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.992 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.992 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.992 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.992 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.992 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.992 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.992 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.992 INFO:teuthology.orchestra.run.smithi037.stdout: "identifier": { 2024-09-19T06:09:55.993 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "identifier", 2024-09-19T06:09:55.993 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.993 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.993 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.993 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.993 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.993 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.993 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.993 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.993 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.993 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.993 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.993 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.993 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-09-19T06:09:55.994 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-09-19T06:09:55.994 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-19T06:09:55.994 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.994 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:55.994 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-09-19T06:09:55.994 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.994 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.994 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.994 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.994 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.994 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.994 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.994 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.995 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:55.995 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:55.995 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.995 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.995 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.995 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:55.995 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.995 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.995 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.995 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:55.995 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:55.995 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:55.995 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:55.995 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:55.995 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:55.996 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.996 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.996 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.996 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.996 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.996 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.996 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:55.996 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:55.996 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.996 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.996 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.996 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.996 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.996 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.997 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.997 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.997 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.997 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.997 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.997 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.997 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:55.997 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:55.997 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:55.997 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.997 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.997 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:55.997 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.997 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.998 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:55.998 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:55.998 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:55.998 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:55.998 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:55.998 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:55.998 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:55.998 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:55.998 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.998 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.998 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.998 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.998 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.998 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:55.999 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:55.999 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:55.999 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:55.999 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:55.999 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:55.999 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:55.999 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:55.999 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:55.999 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:55.999 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:55.999 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:55.999 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:55.999 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:55.999 INFO:teuthology.orchestra.run.smithi037.stdout: "zabbix_host": { 2024-09-19T06:09:55.999 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix_host", 2024-09-19T06:09:56.000 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.000 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.000 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.000 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.000 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.000 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.000 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.000 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.000 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.000 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.000 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.000 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.000 INFO:teuthology.orchestra.run.smithi037.stdout: "zabbix_port": { 2024-09-19T06:09:56.000 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix_port", 2024-09-19T06:09:56.000 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.001 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.001 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.001 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10051", 2024-09-19T06:09:56.001 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.001 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.001 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.001 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.001 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.001 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.001 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.001 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.001 INFO:teuthology.orchestra.run.smithi037.stdout: "zabbix_sender": { 2024-09-19T06:09:56.001 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix_sender", 2024-09-19T06:09:56.002 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.002 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.002 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.002 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T06:09:56.002 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.002 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.002 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.002 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.002 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.002 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.002 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.002 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.002 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.002 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.002 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-09-19T06:09:56.003 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.003 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.003 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 24122, 2024-09-19T06:09:56.003 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "y", 2024-09-19T06:09:56.003 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_features": 4540701547738038271, 2024-09-19T06:09:56.003 INFO:teuthology.orchestra.run.smithi037.stdout: "available_modules": [ 2024-09-19T06:09:56.003 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.003 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "alerts", 2024-09-19T06:09:56.003 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:56.003 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:56.003 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:56.003 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-09-19T06:09:56.003 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-09-19T06:09:56.004 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-19T06:09:56.004 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.004 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.004 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-09-19T06:09:56.004 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.004 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.004 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.004 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T06:09:56.004 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.004 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.004 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.004 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.004 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:56.004 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:56.005 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.005 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.005 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.005 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.005 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.005 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.005 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.005 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.005 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.005 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.005 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.005 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.005 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.006 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.006 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.006 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.006 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.006 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.006 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.006 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:56.006 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:56.006 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.006 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.006 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.006 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.006 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.006 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.007 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.007 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.007 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.007 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.007 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.007 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.007 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:56.007 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:56.007 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.007 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.007 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.007 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:56.007 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.007 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.008 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.008 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.008 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.008 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.008 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.008 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.008 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.008 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.008 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.008 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.008 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.008 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.008 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.008 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:56.009 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:56.009 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.009 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.009 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.009 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.009 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.009 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.009 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.009 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.010 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.010 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.010 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.010 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.010 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_destination": { 2024-09-19T06:09:56.010 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_destination", 2024-09-19T06:09:56.010 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.010 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.010 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.010 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.010 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.010 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.010 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.010 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Email address to send alerts to", 2024-09-19T06:09:56.011 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.011 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.011 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.011 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.011 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_from_name": { 2024-09-19T06:09:56.011 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_from_name", 2024-09-19T06:09:56.011 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.011 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.011 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.011 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "Ceph", 2024-09-19T06:09:56.011 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.011 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.012 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.012 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Email From: name", 2024-09-19T06:09:56.012 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.012 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.012 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.012 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.012 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_host": { 2024-09-19T06:09:56.012 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_host", 2024-09-19T06:09:56.012 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.012 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.012 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.012 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.012 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.013 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.013 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.013 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SMTP server", 2024-09-19T06:09:56.013 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.013 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.013 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.013 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.013 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_password": { 2024-09-19T06:09:56.013 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_password", 2024-09-19T06:09:56.013 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.013 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.013 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.013 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.013 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.014 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.014 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.014 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Password to authenticate with", 2024-09-19T06:09:56.014 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.014 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.014 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.014 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.014 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_port": { 2024-09-19T06:09:56.014 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_port", 2024-09-19T06:09:56.014 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.014 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.014 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.014 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "465", 2024-09-19T06:09:56.014 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.014 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.015 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.015 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SMTP port", 2024-09-19T06:09:56.015 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.015 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.015 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.015 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.015 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_sender": { 2024-09-19T06:09:56.015 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_sender", 2024-09-19T06:09:56.015 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.015 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.015 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.015 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.015 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.015 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.015 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.016 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SMTP envelope sender", 2024-09-19T06:09:56.016 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.016 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.016 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.016 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.016 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_ssl": { 2024-09-19T06:09:56.016 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_ssl", 2024-09-19T06:09:56.016 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.016 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.016 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.016 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.017 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.017 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.017 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.017 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T06:09:56.017 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.017 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.017 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.017 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.017 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_user": { 2024-09-19T06:09:56.017 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_user", 2024-09-19T06:09:56.017 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.017 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.017 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.017 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.017 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.018 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.018 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.018 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "User to authenticate as", 2024-09-19T06:09:56.018 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.018 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.018 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.018 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.018 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.018 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.018 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.018 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "balancer", 2024-09-19T06:09:56.018 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:56.018 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:56.019 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:56.019 INFO:teuthology.orchestra.run.smithi037.stdout: "active": { 2024-09-19T06:09:56.019 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "active", 2024-09-19T06:09:56.019 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.019 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.019 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.019 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.019 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.019 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.019 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.019 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T06:09:56.019 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.019 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.019 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.020 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.020 INFO:teuthology.orchestra.run.smithi037.stdout: "begin_time": { 2024-09-19T06:09:56.020 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "begin_time", 2024-09-19T06:09:56.020 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.020 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.020 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.020 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0000", 2024-09-19T06:09:56.020 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.020 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.020 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.020 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T06:09:56.020 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T06:09:56.020 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.021 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.021 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.021 INFO:teuthology.orchestra.run.smithi037.stdout: "begin_weekday": { 2024-09-19T06:09:56.021 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "begin_weekday", 2024-09-19T06:09:56.021 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-09-19T06:09:56.021 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.021 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.021 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-19T06:09:56.021 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "0", 2024-09-19T06:09:56.021 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "6", 2024-09-19T06:09:56.021 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.021 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T06:09:56.021 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T06:09:56.021 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.022 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.022 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.022 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_compat_max_iterations": { 2024-09-19T06:09:56.022 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crush_compat_max_iterations", 2024-09-19T06:09:56.022 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-09-19T06:09:56.022 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.022 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.022 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "25", 2024-09-19T06:09:56.022 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-09-19T06:09:56.022 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "250", 2024-09-19T06:09:56.022 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.022 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T06:09:56.022 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.022 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.023 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.023 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.023 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_compat_metrics": { 2024-09-19T06:09:56.023 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crush_compat_metrics", 2024-09-19T06:09:56.023 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.023 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.023 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.023 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T06:09:56.023 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.023 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.023 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.023 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T06:09:56.023 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T06:09:56.023 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.024 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.024 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.024 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_compat_step": { 2024-09-19T06:09:56.024 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crush_compat_step", 2024-09-19T06:09:56.024 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-19T06:09:56.024 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.024 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.024 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0.5", 2024-09-19T06:09:56.024 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "0.001", 2024-09-19T06:09:56.024 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "0.999", 2024-09-19T06:09:56.024 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.024 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "aggressiveness of optimization", 2024-09-19T06:09:56.024 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T06:09:56.025 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.025 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.025 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.025 INFO:teuthology.orchestra.run.smithi037.stdout: "end_time": { 2024-09-19T06:09:56.025 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "end_time", 2024-09-19T06:09:56.025 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.025 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.025 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.025 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "2359", 2024-09-19T06:09:56.025 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.025 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.025 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.025 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T06:09:56.025 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T06:09:56.026 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.026 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.026 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.026 INFO:teuthology.orchestra.run.smithi037.stdout: "end_weekday": { 2024-09-19T06:09:56.026 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "end_weekday", 2024-09-19T06:09:56.026 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-09-19T06:09:56.026 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.026 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.026 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-19T06:09:56.026 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "0", 2024-09-19T06:09:56.026 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "6", 2024-09-19T06:09:56.026 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.026 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T06:09:56.026 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T06:09:56.027 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.027 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.027 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.027 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:56.027 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:56.027 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.027 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.027 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.027 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.027 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.027 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.027 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.027 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.027 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.028 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.028 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.028 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.028 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.028 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.028 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.028 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.028 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.028 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.028 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.028 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:56.028 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:56.028 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.029 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.029 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.029 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.029 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.029 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.029 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.029 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.029 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.029 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.029 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.029 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.029 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:56.029 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:56.030 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.030 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.030 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.030 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:56.030 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.030 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.030 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.030 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.030 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.030 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.030 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.030 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.030 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.030 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.031 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.031 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.031 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.031 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.031 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.031 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:56.031 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:56.031 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.031 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.031 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.031 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.031 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.031 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.031 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.032 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.032 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.032 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.032 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.032 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.032 INFO:teuthology.orchestra.run.smithi037.stdout: "min_score": { 2024-09-19T06:09:56.032 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "min_score", 2024-09-19T06:09:56.032 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-19T06:09:56.032 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.032 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.032 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-19T06:09:56.032 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.032 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.033 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.033 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T06:09:56.033 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.033 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.033 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.033 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.033 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": { 2024-09-19T06:09:56.033 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mode", 2024-09-19T06:09:56.033 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.034 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.034 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.034 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "upmap", 2024-09-19T06:09:56.034 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.034 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.034 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.034 INFO:teuthology.orchestra.run.smithi037.stdout: "crush-compat", 2024-09-19T06:09:56.034 INFO:teuthology.orchestra.run.smithi037.stdout: "none", 2024-09-19T06:09:56.034 INFO:teuthology.orchestra.run.smithi037.stdout: "read", 2024-09-19T06:09:56.034 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap", 2024-09-19T06:09:56.034 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap-read" 2024-09-19T06:09:56.034 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.035 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Balancer mode", 2024-09-19T06:09:56.035 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.035 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.035 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.035 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.035 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_ids": { 2024-09-19T06:09:56.035 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pool_ids", 2024-09-19T06:09:56.035 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.035 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.035 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.035 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.035 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.035 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.035 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.036 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T06:09:56.036 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.036 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.036 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.036 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.036 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-09-19T06:09:56.036 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-09-19T06:09:56.036 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-19T06:09:56.036 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.036 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.036 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-09-19T06:09:56.036 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.036 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.036 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.037 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T06:09:56.037 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.037 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.037 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.037 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.037 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap_max_deviation": { 2024-09-19T06:09:56.037 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "upmap_max_deviation", 2024-09-19T06:09:56.037 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.037 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.037 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.037 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-09-19T06:09:56.037 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-09-19T06:09:56.037 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.037 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.038 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T06:09:56.038 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T06:09:56.038 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.038 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.038 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.038 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap_max_optimizations": { 2024-09-19T06:09:56.038 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "upmap_max_optimizations", 2024-09-19T06:09:56.038 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-09-19T06:09:56.038 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.038 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.038 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-19T06:09:56.038 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.038 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.038 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.039 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T06:09:56.039 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.039 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.039 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.039 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.039 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.039 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.039 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.039 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephadm", 2024-09-19T06:09:56.039 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:56.039 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:56.039 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:56.039 INFO:teuthology.orchestra.run.smithi037.stdout: "agent_down_multiplier": { 2024-09-19T06:09:56.039 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "agent_down_multiplier", 2024-09-19T06:09:56.040 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-19T06:09:56.040 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.040 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.040 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "3.0", 2024-09-19T06:09:56.040 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.040 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.040 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.040 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T06:09:56.040 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.040 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.040 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.040 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.040 INFO:teuthology.orchestra.run.smithi037.stdout: "agent_refresh_rate": { 2024-09-19T06:09:56.040 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "agent_refresh_rate", 2024-09-19T06:09:56.041 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-19T06:09:56.041 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.041 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.041 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "20", 2024-09-19T06:09:56.041 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.041 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.041 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.041 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T06:09:56.041 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.041 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.041 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.041 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.041 INFO:teuthology.orchestra.run.smithi037.stdout: "agent_starting_port": { 2024-09-19T06:09:56.041 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "agent_starting_port", 2024-09-19T06:09:56.042 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.042 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.042 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.042 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "4721", 2024-09-19T06:09:56.042 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.042 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.042 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.042 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T06:09:56.042 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.042 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.042 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.042 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.043 INFO:teuthology.orchestra.run.smithi037.stdout: "allow_ptrace": { 2024-09-19T06:09:56.043 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "allow_ptrace", 2024-09-19T06:09:56.043 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.043 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.043 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.043 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.043 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.043 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.043 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.043 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T06:09:56.043 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T06:09:56.043 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.043 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.043 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.044 INFO:teuthology.orchestra.run.smithi037.stdout: "autotune_interval": { 2024-09-19T06:09:56.044 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "autotune_interval", 2024-09-19T06:09:56.044 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-19T06:09:56.044 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.044 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.044 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-09-19T06:09:56.044 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.044 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.044 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.044 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T06:09:56.044 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.044 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.044 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.045 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.045 INFO:teuthology.orchestra.run.smithi037.stdout: "autotune_memory_target_ratio": { 2024-09-19T06:09:56.045 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T06:09:56.045 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-19T06:09:56.045 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.045 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.045 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0.7", 2024-09-19T06:09:56.045 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.045 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.045 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.045 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T06:09:56.045 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.045 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.045 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.046 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.046 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm_log_destination": { 2024-09-19T06:09:56.046 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephadm_log_destination", 2024-09-19T06:09:56.046 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.046 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.046 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.046 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.046 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.046 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.046 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.046 INFO:teuthology.orchestra.run.smithi037.stdout: "file", 2024-09-19T06:09:56.046 INFO:teuthology.orchestra.run.smithi037.stdout: "file,syslog", 2024-09-19T06:09:56.046 INFO:teuthology.orchestra.run.smithi037.stdout: "syslog" 2024-09-19T06:09:56.046 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.047 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T06:09:56.047 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.047 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.047 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.047 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.047 INFO:teuthology.orchestra.run.smithi037.stdout: "cgroups_split": { 2024-09-19T06:09:56.047 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cgroups_split", 2024-09-19T06:09:56.047 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.047 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.047 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.047 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.047 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.047 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.048 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.048 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T06:09:56.048 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.048 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.048 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.048 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.048 INFO:teuthology.orchestra.run.smithi037.stdout: "config_checks_enabled": { 2024-09-19T06:09:56.048 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "config_checks_enabled", 2024-09-19T06:09:56.048 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.048 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.048 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.048 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.048 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.049 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.049 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.049 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T06:09:56.049 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.049 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.049 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.049 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.049 INFO:teuthology.orchestra.run.smithi037.stdout: "config_dashboard": { 2024-09-19T06:09:56.049 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "config_dashboard", 2024-09-19T06:09:56.049 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.049 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.049 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.049 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.050 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.050 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.050 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.050 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T06:09:56.050 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.050 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.050 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.050 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.050 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_alertmanager": { 2024-09-19T06:09:56.050 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_alertmanager", 2024-09-19T06:09:56.050 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.050 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.050 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.050 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T06:09:56.051 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.051 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.051 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.051 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-09-19T06:09:56.051 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.051 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.051 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.051 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.051 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_base": { 2024-09-19T06:09:56.051 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_base", 2024-09-19T06:09:56.051 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.051 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.051 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.051 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T06:09:56.052 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.052 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.052 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.052 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Container image name, without the tag", 2024-09-19T06:09:56.052 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.052 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.052 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.052 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.052 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_elasticsearch": { 2024-09-19T06:09:56.052 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_elasticsearch", 2024-09-19T06:09:56.052 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.052 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.053 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.053 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T06:09:56.053 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.053 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.053 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.053 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "elasticsearch container image", 2024-09-19T06:09:56.053 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.053 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.053 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.053 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.053 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_grafana": { 2024-09-19T06:09:56.053 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_grafana", 2024-09-19T06:09:56.053 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.054 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.054 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.054 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T06:09:56.054 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.054 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.054 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.054 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-09-19T06:09:56.054 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.054 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.054 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.054 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.054 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_haproxy": { 2024-09-19T06:09:56.054 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_haproxy", 2024-09-19T06:09:56.054 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.055 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.055 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.055 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T06:09:56.055 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.055 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.055 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.055 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "HAproxy container image", 2024-09-19T06:09:56.055 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.055 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.055 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.055 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.055 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_jaeger_agent": { 2024-09-19T06:09:56.055 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_jaeger_agent", 2024-09-19T06:09:56.056 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.056 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.056 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.056 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T06:09:56.056 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.056 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.056 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.056 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Jaeger agent container image", 2024-09-19T06:09:56.056 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.056 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.056 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.056 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.056 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_jaeger_collector": { 2024-09-19T06:09:56.056 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_jaeger_collector", 2024-09-19T06:09:56.057 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.057 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.057 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.057 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T06:09:56.057 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.057 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.057 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.057 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Jaeger collector container image", 2024-09-19T06:09:56.057 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.057 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.057 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.057 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.057 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_jaeger_query": { 2024-09-19T06:09:56.058 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_jaeger_query", 2024-09-19T06:09:56.058 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.058 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.058 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.058 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T06:09:56.058 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.058 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.058 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.058 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Jaeger query container image", 2024-09-19T06:09:56.058 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.058 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.058 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.058 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.058 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_keepalived": { 2024-09-19T06:09:56.058 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_keepalived", 2024-09-19T06:09:56.059 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.059 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.059 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.059 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T06:09:56.059 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.059 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.059 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.059 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Keepalived container image", 2024-09-19T06:09:56.059 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.059 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.059 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.059 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.059 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_loki": { 2024-09-19T06:09:56.060 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_loki", 2024-09-19T06:09:56.060 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.060 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.060 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.060 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T06:09:56.060 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.060 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.060 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.060 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Loki container image", 2024-09-19T06:09:56.060 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.060 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.060 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.060 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.060 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_node_exporter": { 2024-09-19T06:09:56.061 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_node_exporter", 2024-09-19T06:09:56.061 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.061 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.061 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.061 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T06:09:56.061 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.061 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.061 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.061 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-09-19T06:09:56.061 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.061 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.061 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.061 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.061 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_nvmeof": { 2024-09-19T06:09:56.062 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_nvmeof", 2024-09-19T06:09:56.062 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.062 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.062 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.062 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T06:09:56.062 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.062 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.062 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.062 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Nvme-of container image", 2024-09-19T06:09:56.062 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.062 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.062 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.062 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.062 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_prometheus": { 2024-09-19T06:09:56.062 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_prometheus", 2024-09-19T06:09:56.063 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.063 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.063 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.063 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T06:09:56.063 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.063 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.063 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.063 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-09-19T06:09:56.063 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.063 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.063 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.063 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.063 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_promtail": { 2024-09-19T06:09:56.063 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_promtail", 2024-09-19T06:09:56.064 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.064 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.064 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.064 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T06:09:56.064 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.064 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.064 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.064 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Promtail container image", 2024-09-19T06:09:56.064 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.064 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.064 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.064 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.064 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_samba": { 2024-09-19T06:09:56.064 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_samba", 2024-09-19T06:09:56.065 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.065 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.065 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.065 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T06:09:56.065 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.065 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.065 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.065 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Samba/SMB container image", 2024-09-19T06:09:56.065 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.065 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.065 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.065 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.065 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_snmp_gateway": { 2024-09-19T06:09:56.065 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_snmp_gateway", 2024-09-19T06:09:56.066 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.066 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.066 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.066 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T06:09:56.066 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.066 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.066 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.066 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SNMP Gateway container image", 2024-09-19T06:09:56.066 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.066 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.066 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.066 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.066 INFO:teuthology.orchestra.run.smithi037.stdout: "container_init": { 2024-09-19T06:09:56.066 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_init", 2024-09-19T06:09:56.066 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.067 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.067 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.067 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.067 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.067 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.067 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.067 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T06:09:56.067 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.067 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.067 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.067 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.067 INFO:teuthology.orchestra.run.smithi037.stdout: "daemon_cache_timeout": { 2024-09-19T06:09:56.067 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "daemon_cache_timeout", 2024-09-19T06:09:56.068 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-19T06:09:56.068 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.068 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.068 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-09-19T06:09:56.068 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.068 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.068 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.068 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T06:09:56.068 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.068 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.068 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.068 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.068 INFO:teuthology.orchestra.run.smithi037.stdout: "default_cephadm_command_timeout": { 2024-09-19T06:09:56.068 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T06:09:56.069 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.069 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.069 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.069 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "900", 2024-09-19T06:09:56.069 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.069 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.069 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.069 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T06:09:56.069 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.069 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.069 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.069 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.069 INFO:teuthology.orchestra.run.smithi037.stdout: "default_registry": { 2024-09-19T06:09:56.069 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "default_registry", 2024-09-19T06:09:56.070 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.070 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.070 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.070 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io", 2024-09-19T06:09:56.070 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.070 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.070 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.070 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T06:09:56.070 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.070 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.070 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.070 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.070 INFO:teuthology.orchestra.run.smithi037.stdout: "device_cache_timeout": { 2024-09-19T06:09:56.070 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "device_cache_timeout", 2024-09-19T06:09:56.071 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-19T06:09:56.071 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.071 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.071 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "1800", 2024-09-19T06:09:56.071 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.071 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.071 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.071 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "seconds to cache device inventory", 2024-09-19T06:09:56.071 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.071 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.071 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.071 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.071 INFO:teuthology.orchestra.run.smithi037.stdout: "device_enhanced_scan": { 2024-09-19T06:09:56.071 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "device_enhanced_scan", 2024-09-19T06:09:56.072 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.072 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.072 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.072 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.072 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.072 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.072 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.072 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T06:09:56.072 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.072 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.072 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.072 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.072 INFO:teuthology.orchestra.run.smithi037.stdout: "facts_cache_timeout": { 2024-09-19T06:09:56.072 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "facts_cache_timeout", 2024-09-19T06:09:56.073 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-19T06:09:56.073 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.073 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.073 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-09-19T06:09:56.073 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.073 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.073 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.073 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "seconds to cache host facts data", 2024-09-19T06:09:56.073 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.073 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.073 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.073 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.073 INFO:teuthology.orchestra.run.smithi037.stdout: "grafana_dashboards_path": { 2024-09-19T06:09:56.073 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "grafana_dashboards_path", 2024-09-19T06:09:56.074 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.074 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.074 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.074 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T06:09:56.074 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.074 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.074 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.074 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T06:09:56.074 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.074 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.074 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.074 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.074 INFO:teuthology.orchestra.run.smithi037.stdout: "host_check_interval": { 2024-09-19T06:09:56.074 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "host_check_interval", 2024-09-19T06:09:56.074 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-19T06:09:56.075 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.075 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.075 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-09-19T06:09:56.075 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.075 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.075 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.075 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to perform a host check", 2024-09-19T06:09:56.075 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.075 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.075 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.075 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.075 INFO:teuthology.orchestra.run.smithi037.stdout: "hw_monitoring": { 2024-09-19T06:09:56.075 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "hw_monitoring", 2024-09-19T06:09:56.075 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.076 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.076 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.076 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.076 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.076 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.076 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.076 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T06:09:56.076 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.076 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.076 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.076 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.076 INFO:teuthology.orchestra.run.smithi037.stdout: "inventory_list_all": { 2024-09-19T06:09:56.076 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "inventory_list_all", 2024-09-19T06:09:56.076 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.076 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.077 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.077 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.077 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.077 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.077 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.077 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T06:09:56.077 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.077 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.077 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.077 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.077 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:56.077 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:56.077 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.077 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.078 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.078 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.078 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.078 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.078 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.078 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.078 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.078 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.078 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.078 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.078 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.078 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.078 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.078 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.078 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.079 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.079 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.079 INFO:teuthology.orchestra.run.smithi037.stdout: "log_refresh_metadata": { 2024-09-19T06:09:56.079 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_refresh_metadata", 2024-09-19T06:09:56.079 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.079 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.079 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.079 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.079 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.079 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.079 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.079 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T06:09:56.079 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.080 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.080 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.080 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.080 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:56.080 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:56.080 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.080 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.080 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.080 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.080 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.080 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.080 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.080 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T06:09:56.081 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.081 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.081 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.081 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.081 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:56.081 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:56.081 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.081 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.081 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.081 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:56.081 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.081 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.081 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.081 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.082 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.082 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.082 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.082 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.082 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.082 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.082 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.082 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.082 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.082 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.082 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.082 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:56.082 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:56.082 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.083 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.083 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.083 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.083 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.083 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.083 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.083 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.083 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.083 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.083 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.083 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.083 INFO:teuthology.orchestra.run.smithi037.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T06:09:56.083 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T06:09:56.083 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.084 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.084 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.084 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.084 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.084 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.084 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.084 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T06:09:56.084 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.084 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.084 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.084 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.084 INFO:teuthology.orchestra.run.smithi037.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T06:09:56.084 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T06:09:56.085 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.085 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.085 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.085 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "*", 2024-09-19T06:09:56.085 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.085 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.085 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.085 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T06:09:56.085 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.085 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.085 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.085 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.085 INFO:teuthology.orchestra.run.smithi037.stdout: "max_count_per_host": { 2024-09-19T06:09:56.086 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_count_per_host", 2024-09-19T06:09:56.086 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.086 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.086 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.086 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-19T06:09:56.086 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.086 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.086 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.086 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "max number of daemons per service per host", 2024-09-19T06:09:56.086 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.086 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.086 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.086 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.086 INFO:teuthology.orchestra.run.smithi037.stdout: "max_osd_draining_count": { 2024-09-19T06:09:56.087 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_osd_draining_count", 2024-09-19T06:09:56.087 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.087 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.087 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.087 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-19T06:09:56.087 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.087 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.087 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.087 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T06:09:56.087 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.087 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.087 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.087 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.087 INFO:teuthology.orchestra.run.smithi037.stdout: "migration_current": { 2024-09-19T06:09:56.087 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "migration_current", 2024-09-19T06:09:56.088 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.088 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.088 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.088 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.088 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.088 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.088 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.088 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "internal - do not modify", 2024-09-19T06:09:56.088 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.088 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.088 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.088 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.088 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": { 2024-09-19T06:09:56.088 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mode", 2024-09-19T06:09:56.089 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.089 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.089 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.089 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "root", 2024-09-19T06:09:56.089 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.089 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.089 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.089 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm-package", 2024-09-19T06:09:56.089 INFO:teuthology.orchestra.run.smithi037.stdout: "root" 2024-09-19T06:09:56.089 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.089 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T06:09:56.089 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.089 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.089 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.090 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.090 INFO:teuthology.orchestra.run.smithi037.stdout: "oob_default_addr": { 2024-09-19T06:09:56.090 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "oob_default_addr", 2024-09-19T06:09:56.090 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.090 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.090 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.090 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "169.254.1.1", 2024-09-19T06:09:56.090 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.090 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.090 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.090 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T06:09:56.090 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.090 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.090 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.091 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.091 INFO:teuthology.orchestra.run.smithi037.stdout: "prometheus_alerts_path": { 2024-09-19T06:09:56.091 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "prometheus_alerts_path", 2024-09-19T06:09:56.091 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.091 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.091 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.091 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T06:09:56.091 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.091 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.091 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.091 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T06:09:56.091 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.091 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.091 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.091 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.092 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_insecure": { 2024-09-19T06:09:56.092 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_insecure", 2024-09-19T06:09:56.092 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.092 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.092 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.092 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.092 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.092 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.092 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.092 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T06:09:56.092 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.092 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.092 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.093 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.093 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_password": { 2024-09-19T06:09:56.093 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_password", 2024-09-19T06:09:56.093 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.093 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.093 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.093 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.093 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.093 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.093 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.093 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T06:09:56.093 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.093 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.093 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.094 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.094 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_url": { 2024-09-19T06:09:56.094 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_url", 2024-09-19T06:09:56.094 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.094 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.094 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.094 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.094 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.094 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.094 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.094 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T06:09:56.094 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.094 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.094 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.095 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.095 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_username": { 2024-09-19T06:09:56.095 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_username", 2024-09-19T06:09:56.095 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.095 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.095 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.095 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.095 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.095 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.095 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.095 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T06:09:56.095 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.095 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.095 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.095 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.096 INFO:teuthology.orchestra.run.smithi037.stdout: "secure_monitoring_stack": { 2024-09-19T06:09:56.096 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "secure_monitoring_stack", 2024-09-19T06:09:56.096 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.096 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.096 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.096 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.096 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.096 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.096 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.096 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T06:09:56.096 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.096 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.096 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.096 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.097 INFO:teuthology.orchestra.run.smithi037.stdout: "service_discovery_port": { 2024-09-19T06:09:56.097 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "service_discovery_port", 2024-09-19T06:09:56.097 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.097 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.097 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.097 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8765", 2024-09-19T06:09:56.097 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.097 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.097 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.097 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "cephadm service discovery port", 2024-09-19T06:09:56.097 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.097 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.097 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.097 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.098 INFO:teuthology.orchestra.run.smithi037.stdout: "ssh_config_file": { 2024-09-19T06:09:56.098 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssh_config_file", 2024-09-19T06:09:56.098 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.098 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.098 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.098 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.098 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.098 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.098 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.098 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T06:09:56.098 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.098 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.098 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.098 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.098 INFO:teuthology.orchestra.run.smithi037.stdout: "use_agent": { 2024-09-19T06:09:56.099 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "use_agent", 2024-09-19T06:09:56.099 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.099 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.099 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.099 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.099 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.099 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.099 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.099 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T06:09:56.099 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.099 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.099 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.099 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.099 INFO:teuthology.orchestra.run.smithi037.stdout: "use_repo_digest": { 2024-09-19T06:09:56.099 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "use_repo_digest", 2024-09-19T06:09:56.100 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.100 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.100 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.100 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.100 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.100 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.100 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.100 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T06:09:56.100 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.100 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.100 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.100 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.100 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_on_failed_host_check": { 2024-09-19T06:09:56.100 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_on_failed_host_check", 2024-09-19T06:09:56.101 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.101 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.101 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.101 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.101 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.101 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.101 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.101 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T06:09:56.101 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.101 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.101 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.101 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.101 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_on_stray_daemons": { 2024-09-19T06:09:56.101 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_on_stray_daemons", 2024-09-19T06:09:56.102 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.102 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.102 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.102 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.102 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.102 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.102 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.102 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T06:09:56.102 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.102 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.102 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.102 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.102 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_on_stray_hosts": { 2024-09-19T06:09:56.102 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_on_stray_hosts", 2024-09-19T06:09:56.102 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.103 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.103 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.103 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.103 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.103 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.103 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.103 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T06:09:56.103 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.103 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.103 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.103 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.103 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.103 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.103 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.104 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crash", 2024-09-19T06:09:56.104 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:56.104 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:56.104 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:56.104 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:56.104 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:56.104 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.104 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.104 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.104 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.104 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.104 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.104 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.104 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.105 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.105 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.105 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.105 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.105 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.105 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.105 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.105 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.105 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.105 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.105 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.105 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:56.105 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:56.105 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.106 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.106 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.106 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.106 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.106 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.106 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.106 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.106 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.106 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.106 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.106 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.106 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:56.106 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:56.106 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.107 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.107 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.107 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:56.107 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.107 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.107 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.107 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.107 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.107 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.107 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.107 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.107 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.107 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.108 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.108 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.108 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.108 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.108 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.108 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:56.108 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:56.108 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.108 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.108 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.108 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.108 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.108 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.109 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.109 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.109 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.109 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.109 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.109 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.109 INFO:teuthology.orchestra.run.smithi037.stdout: "retain_interval": { 2024-09-19T06:09:56.109 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "retain_interval", 2024-09-19T06:09:56.109 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-19T06:09:56.109 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.110 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.110 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "31536000", 2024-09-19T06:09:56.110 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.110 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.110 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.110 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T06:09:56.110 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.110 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.110 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.110 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.110 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_recent_interval": { 2024-09-19T06:09:56.110 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_recent_interval", 2024-09-19T06:09:56.111 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-19T06:09:56.111 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.111 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.111 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "1209600", 2024-09-19T06:09:56.111 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.111 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.111 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.111 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T06:09:56.111 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.111 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.111 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.111 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.111 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.111 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.111 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.112 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "dashboard", 2024-09-19T06:09:56.112 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:56.112 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:56.112 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:56.112 INFO:teuthology.orchestra.run.smithi037.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T06:09:56.112 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T06:09:56.112 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.112 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.112 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.112 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-19T06:09:56.112 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.112 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.112 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.112 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.113 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.113 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.113 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.113 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.113 INFO:teuthology.orchestra.run.smithi037.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T06:09:56.113 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T06:09:56.113 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.113 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.113 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.113 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.113 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.113 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.113 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.113 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.114 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.114 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.114 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.114 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.114 INFO:teuthology.orchestra.run.smithi037.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T06:09:56.114 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T06:09:56.114 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.114 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.114 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.114 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.114 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.114 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.114 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.114 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.115 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.115 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.115 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.115 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.115 INFO:teuthology.orchestra.run.smithi037.stdout: "AUDIT_API_ENABLED": { 2024-09-19T06:09:56.115 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T06:09:56.115 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.115 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.115 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.115 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.115 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.115 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.115 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.115 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.116 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.116 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.116 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.116 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.116 INFO:teuthology.orchestra.run.smithi037.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T06:09:56.116 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T06:09:56.116 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.116 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.116 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.116 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.116 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.116 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.116 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.116 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.116 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.117 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.117 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.117 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.117 INFO:teuthology.orchestra.run.smithi037.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T06:09:56.117 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T06:09:56.117 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.117 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.117 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.117 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.117 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.117 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.117 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.117 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.117 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.118 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.118 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.118 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.118 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T06:09:56.118 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T06:09:56.118 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.118 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.118 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.118 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.118 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.118 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.118 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.118 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.118 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.119 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.119 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.119 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.119 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T06:09:56.119 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T06:09:56.119 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.119 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.119 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.119 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.119 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.119 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.119 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.119 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.119 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.120 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.120 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.120 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.120 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T06:09:56.120 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T06:09:56.120 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.120 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.120 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.120 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.120 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.120 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.120 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.120 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.120 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.120 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.121 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.121 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.121 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T06:09:56.121 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T06:09:56.121 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.121 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.121 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.121 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.121 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.121 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.121 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.121 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.121 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.121 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.121 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.122 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.122 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T06:09:56.122 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T06:09:56.122 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.122 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.122 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.122 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.122 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.122 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.122 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.122 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.122 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.122 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.122 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.123 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.123 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T06:09:56.123 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T06:09:56.123 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.123 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.123 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.123 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.123 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.123 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.123 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.123 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.123 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.123 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.123 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.124 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.124 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T06:09:56.124 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T06:09:56.124 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.124 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.124 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.124 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.124 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.124 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.124 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.124 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.124 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.124 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.125 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.125 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.125 INFO:teuthology.orchestra.run.smithi037.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T06:09:56.125 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T06:09:56.125 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.125 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.125 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.125 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.125 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.125 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.125 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.125 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.125 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.125 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.125 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.126 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.126 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T06:09:56.126 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T06:09:56.126 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.126 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.126 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.126 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "admin", 2024-09-19T06:09:56.126 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.126 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.126 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.126 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.126 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.126 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.126 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.126 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.127 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T06:09:56.127 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T06:09:56.127 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.127 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.127 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.127 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.127 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.127 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.127 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.127 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.127 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.127 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.127 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.127 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.128 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_URL": { 2024-09-19T06:09:56.128 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_URL", 2024-09-19T06:09:56.128 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.128 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.128 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.128 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.128 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.128 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.128 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.128 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.128 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.128 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.128 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.129 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.129 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T06:09:56.129 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T06:09:56.129 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.129 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.129 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.129 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "admin", 2024-09-19T06:09:56.129 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.129 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.129 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.129 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.129 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.129 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.129 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.129 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.130 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T06:09:56.130 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T06:09:56.130 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.130 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.130 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.130 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.130 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.130 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.130 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.132 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.132 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.132 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.132 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.132 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.132 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T06:09:56.132 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T06:09:56.132 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.132 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.132 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.132 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.132 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.133 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.133 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.133 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.133 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.133 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.133 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.133 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.133 INFO:teuthology.orchestra.run.smithi037.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T06:09:56.133 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T06:09:56.133 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.133 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.133 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.133 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.133 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.134 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.134 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.134 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.134 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.134 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.134 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.134 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.134 INFO:teuthology.orchestra.run.smithi037.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T06:09:56.134 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T06:09:56.135 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.135 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.135 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.135 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.135 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.135 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.135 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.135 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.135 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.135 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.135 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.135 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.135 INFO:teuthology.orchestra.run.smithi037.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T06:09:56.135 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T06:09:56.136 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.136 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.136 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.136 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.136 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.136 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.136 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.136 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.136 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.136 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.136 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.136 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.136 INFO:teuthology.orchestra.run.smithi037.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T06:09:56.136 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T06:09:56.137 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.137 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.137 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.137 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.137 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.137 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.137 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.137 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.137 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.137 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.137 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.137 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.137 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T06:09:56.138 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T06:09:56.138 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.138 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.138 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.138 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.138 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.138 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.138 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.138 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.138 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.138 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.138 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.138 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.138 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T06:09:56.138 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T06:09:56.139 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.139 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.139 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.139 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.139 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.139 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.139 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.139 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.139 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.139 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.139 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.139 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.139 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T06:09:56.139 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T06:09:56.139 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.139 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.140 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.140 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.140 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.140 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.140 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.140 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.140 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.140 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.140 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.140 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.140 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T06:09:56.140 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T06:09:56.140 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.140 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.141 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.141 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.141 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.141 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.141 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.141 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.141 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.141 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.141 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.141 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.141 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T06:09:56.141 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T06:09:56.141 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.141 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.142 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.142 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.142 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.142 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.142 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.142 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.142 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.142 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.142 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.142 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.142 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T06:09:56.142 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T06:09:56.142 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.142 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.143 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.143 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.143 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.143 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.143 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.143 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.143 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.143 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.143 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.143 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.143 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T06:09:56.143 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T06:09:56.143 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.143 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.143 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.144 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.144 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.144 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.144 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.144 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.144 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.144 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.144 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.144 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.144 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T06:09:56.144 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T06:09:56.144 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.144 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.144 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.145 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.145 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.145 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.145 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.145 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.145 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.145 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.145 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.145 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.145 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T06:09:56.145 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T06:09:56.145 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.146 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.146 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.146 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T06:09:56.146 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.146 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.146 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.146 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.146 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.146 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.146 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.146 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.146 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T06:09:56.146 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T06:09:56.147 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.147 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.147 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.147 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-19T06:09:56.147 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.147 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.147 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.147 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.147 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.147 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.147 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.147 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.147 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T06:09:56.147 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T06:09:56.148 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.148 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.148 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.148 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8", 2024-09-19T06:09:56.148 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.148 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.148 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.148 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.148 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.148 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.148 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.148 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.148 INFO:teuthology.orchestra.run.smithi037.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T06:09:56.148 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T06:09:56.149 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.149 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.149 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.149 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "45", 2024-09-19T06:09:56.149 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.149 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.149 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.149 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.149 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.149 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.149 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.149 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.149 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T06:09:56.150 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T06:09:56.150 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.150 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.150 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.150 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.150 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.150 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.150 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.150 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.150 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.150 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.150 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.150 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.150 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T06:09:56.150 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T06:09:56.151 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.151 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.151 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.151 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "admin", 2024-09-19T06:09:56.151 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.151 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.151 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.151 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.151 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.151 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.151 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.151 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.151 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T06:09:56.151 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T06:09:56.151 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.152 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.152 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.152 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.152 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.152 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.152 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.152 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.152 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.152 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.152 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.152 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.152 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T06:09:56.152 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T06:09:56.153 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.153 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.153 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.153 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.153 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.153 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.153 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.153 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.153 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.153 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.153 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.153 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.153 INFO:teuthology.orchestra.run.smithi037.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T06:09:56.153 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T06:09:56.154 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.154 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.154 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.154 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-19T06:09:56.154 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.154 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.154 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.154 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.154 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.154 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.154 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.154 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.154 INFO:teuthology.orchestra.run.smithi037.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T06:09:56.155 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T06:09:56.155 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.155 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.155 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.155 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-19T06:09:56.155 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.155 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.155 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.155 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.155 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.155 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.155 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.155 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.155 INFO:teuthology.orchestra.run.smithi037.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T06:09:56.155 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T06:09:56.155 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.156 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.156 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.156 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-09-19T06:09:56.156 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.156 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.156 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.156 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.156 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.156 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.156 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.156 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.156 INFO:teuthology.orchestra.run.smithi037.stdout: "cross_origin_url": { 2024-09-19T06:09:56.156 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cross_origin_url", 2024-09-19T06:09:56.156 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.156 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.157 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.157 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.157 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.157 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.157 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.157 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.157 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.157 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.157 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.157 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.157 INFO:teuthology.orchestra.run.smithi037.stdout: "crt_file": { 2024-09-19T06:09:56.157 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crt_file", 2024-09-19T06:09:56.157 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.157 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.157 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.157 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.158 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.158 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.158 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.158 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.158 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.158 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.158 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.158 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.158 INFO:teuthology.orchestra.run.smithi037.stdout: "debug": { 2024-09-19T06:09:56.158 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "debug", 2024-09-19T06:09:56.158 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.158 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.158 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.158 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.158 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.159 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.159 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.159 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Enable/disable debug options", 2024-09-19T06:09:56.159 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.159 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.159 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.159 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.159 INFO:teuthology.orchestra.run.smithi037.stdout: "jwt_token_ttl": { 2024-09-19T06:09:56.159 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "jwt_token_ttl", 2024-09-19T06:09:56.159 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.159 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.159 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.159 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "28800", 2024-09-19T06:09:56.159 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.159 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.160 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.160 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.160 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.160 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.160 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.160 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.160 INFO:teuthology.orchestra.run.smithi037.stdout: "key_file": { 2024-09-19T06:09:56.160 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "key_file", 2024-09-19T06:09:56.160 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.160 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.160 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.160 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.160 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.160 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.160 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.161 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.161 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.161 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.161 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.161 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.161 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:56.161 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:56.161 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.161 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.161 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.161 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.161 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.161 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.161 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.162 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.162 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.162 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.162 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.162 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.162 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.162 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.162 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.162 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.162 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.162 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.162 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.162 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:56.162 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:56.163 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.163 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.163 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.163 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.163 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.163 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.163 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.163 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.163 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.163 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.163 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.163 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.163 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:56.163 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:56.164 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.164 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.164 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.164 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:56.164 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.164 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.164 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.164 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.164 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.164 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.164 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.164 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.164 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.165 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.165 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.165 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.165 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.165 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.165 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.165 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:56.165 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:56.165 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.165 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.165 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.165 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.165 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.166 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.166 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.166 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.166 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.166 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.166 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.166 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.166 INFO:teuthology.orchestra.run.smithi037.stdout: "motd": { 2024-09-19T06:09:56.166 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "motd", 2024-09-19T06:09:56.166 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.166 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.166 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.166 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.166 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.167 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.167 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.167 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "The message of the day", 2024-09-19T06:09:56.167 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.167 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.167 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.167 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.167 INFO:teuthology.orchestra.run.smithi037.stdout: "redirect_resolve_ip_addr": { 2024-09-19T06:09:56.167 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T06:09:56.167 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.167 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.167 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.167 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.168 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.168 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.168 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.168 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.168 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.168 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.168 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.168 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.168 INFO:teuthology.orchestra.run.smithi037.stdout: "server_addr": { 2024-09-19T06:09:56.168 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_addr", 2024-09-19T06:09:56.168 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.168 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.168 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.168 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "::", 2024-09-19T06:09:56.169 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.169 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.169 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.169 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.169 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.169 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.169 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.169 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.169 INFO:teuthology.orchestra.run.smithi037.stdout: "server_port": { 2024-09-19T06:09:56.169 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_port", 2024-09-19T06:09:56.169 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.169 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.169 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.169 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8080", 2024-09-19T06:09:56.169 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.170 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.170 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.170 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.170 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.170 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.170 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.170 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.170 INFO:teuthology.orchestra.run.smithi037.stdout: "ssl": { 2024-09-19T06:09:56.170 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssl", 2024-09-19T06:09:56.170 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.170 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.170 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.170 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.170 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.170 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.170 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.170 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.171 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.171 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.171 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.171 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.171 INFO:teuthology.orchestra.run.smithi037.stdout: "ssl_server_port": { 2024-09-19T06:09:56.171 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssl_server_port", 2024-09-19T06:09:56.171 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.171 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.171 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.171 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8443", 2024-09-19T06:09:56.171 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.171 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.171 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.171 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.171 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.172 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.172 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.172 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.172 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_behaviour": { 2024-09-19T06:09:56.172 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_behaviour", 2024-09-19T06:09:56.172 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.172 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.172 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.172 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "redirect", 2024-09-19T06:09:56.172 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.172 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.172 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.172 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.172 INFO:teuthology.orchestra.run.smithi037.stdout: "redirect" 2024-09-19T06:09:56.172 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.173 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.173 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.173 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.173 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.173 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.173 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_error_status_code": { 2024-09-19T06:09:56.173 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_error_status_code", 2024-09-19T06:09:56.173 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.173 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.173 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.173 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "500", 2024-09-19T06:09:56.173 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "400", 2024-09-19T06:09:56.173 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "599", 2024-09-19T06:09:56.174 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.174 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.174 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.174 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.174 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.174 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.174 INFO:teuthology.orchestra.run.smithi037.stdout: "url_prefix": { 2024-09-19T06:09:56.174 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "url_prefix", 2024-09-19T06:09:56.174 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.174 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.174 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.174 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.174 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.174 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.175 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.175 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.175 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.175 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.175 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.175 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.175 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.175 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.175 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.175 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "devicehealth", 2024-09-19T06:09:56.175 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:56.175 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:56.175 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:56.176 INFO:teuthology.orchestra.run.smithi037.stdout: "enable_monitoring": { 2024-09-19T06:09:56.176 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enable_monitoring", 2024-09-19T06:09:56.176 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.176 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.176 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.176 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.176 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.176 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.176 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.176 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "monitor device health metrics", 2024-09-19T06:09:56.176 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.176 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.176 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.177 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.177 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:56.177 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:56.177 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.177 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.177 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.177 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.177 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.177 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.177 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.177 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.177 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.178 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.178 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.178 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.178 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.178 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.178 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.178 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.178 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.178 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.178 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.178 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:56.178 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:56.178 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.178 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.178 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.179 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.179 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.179 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.179 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.179 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.179 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.179 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.179 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.179 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.179 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:56.179 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:56.179 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.179 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.179 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.180 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:56.180 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.180 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.180 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.180 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.180 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.180 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.180 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.180 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.180 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.180 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.180 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.180 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.180 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.181 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.181 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.181 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:56.181 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:56.181 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.181 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.181 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.181 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.181 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.181 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.181 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.181 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.181 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.181 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.182 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.182 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.182 INFO:teuthology.orchestra.run.smithi037.stdout: "mark_out_threshold": { 2024-09-19T06:09:56.182 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mark_out_threshold", 2024-09-19T06:09:56.182 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-19T06:09:56.182 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.182 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.182 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "2419200", 2024-09-19T06:09:56.182 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.182 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.182 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.182 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T06:09:56.182 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.182 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.183 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.183 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.183 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_name": { 2024-09-19T06:09:56.183 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pool_name", 2024-09-19T06:09:56.183 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.183 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.183 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.183 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "device_health_metrics", 2024-09-19T06:09:56.183 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.183 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.183 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.183 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T06:09:56.183 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.183 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.184 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.184 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.184 INFO:teuthology.orchestra.run.smithi037.stdout: "retention_period": { 2024-09-19T06:09:56.184 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "retention_period", 2024-09-19T06:09:56.184 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-19T06:09:56.184 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.184 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.184 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "15552000", 2024-09-19T06:09:56.184 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.184 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.184 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.184 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how long to retain device health metrics", 2024-09-19T06:09:56.184 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.185 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.185 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.185 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.185 INFO:teuthology.orchestra.run.smithi037.stdout: "scrape_frequency": { 2024-09-19T06:09:56.185 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "scrape_frequency", 2024-09-19T06:09:56.185 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-19T06:09:56.185 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.185 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.185 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "86400", 2024-09-19T06:09:56.185 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.185 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.185 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.185 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T06:09:56.185 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.186 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.186 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.186 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.186 INFO:teuthology.orchestra.run.smithi037.stdout: "self_heal": { 2024-09-19T06:09:56.186 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "self_heal", 2024-09-19T06:09:56.186 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.186 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.186 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.186 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.186 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.186 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.186 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.186 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T06:09:56.186 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.186 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.186 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.187 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.187 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-09-19T06:09:56.187 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-09-19T06:09:56.187 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-19T06:09:56.187 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.187 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.187 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-09-19T06:09:56.187 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.187 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.187 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.187 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T06:09:56.187 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.187 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.187 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.187 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.187 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_threshold": { 2024-09-19T06:09:56.188 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_threshold", 2024-09-19T06:09:56.188 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-19T06:09:56.188 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.188 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.188 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "7257600", 2024-09-19T06:09:56.188 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.188 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.188 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.188 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T06:09:56.188 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.188 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.188 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.188 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.188 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.188 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.189 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.189 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "diskprediction_local", 2024-09-19T06:09:56.189 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:56.189 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:56.189 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:56.189 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:56.189 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:56.189 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.189 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.189 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.189 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.189 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.189 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.189 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.190 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.190 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.190 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.190 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.190 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.190 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.190 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.190 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.190 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.190 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.190 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.190 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.190 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:56.191 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:56.191 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.191 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.191 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.191 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.191 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.191 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.191 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.191 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.191 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.191 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.191 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.191 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.191 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:56.192 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:56.192 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.192 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.192 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.192 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:56.192 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.192 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.192 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.192 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.192 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.192 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.192 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.192 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.193 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.193 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.193 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.193 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.193 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.193 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.193 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.193 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:56.193 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:56.193 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.193 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.193 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.193 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.193 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.194 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.194 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.194 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.194 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.194 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.194 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.194 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.194 INFO:teuthology.orchestra.run.smithi037.stdout: "predict_interval": { 2024-09-19T06:09:56.194 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "predict_interval", 2024-09-19T06:09:56.194 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.194 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.194 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.194 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "86400", 2024-09-19T06:09:56.194 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.194 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.195 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.195 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.195 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.195 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.195 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.195 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.195 INFO:teuthology.orchestra.run.smithi037.stdout: "predictor_model": { 2024-09-19T06:09:56.195 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "predictor_model", 2024-09-19T06:09:56.195 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.195 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.195 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.195 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "prophetstor", 2024-09-19T06:09:56.195 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.195 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.196 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.196 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.196 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.196 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.196 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.196 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.196 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-09-19T06:09:56.196 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-09-19T06:09:56.196 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.196 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.196 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.196 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-09-19T06:09:56.196 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.196 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.197 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.197 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.197 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.197 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.197 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.197 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.197 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.197 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.197 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.197 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "influx", 2024-09-19T06:09:56.197 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": false, 2024-09-19T06:09:56.197 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "influxdb python module not found", 2024-09-19T06:09:56.197 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:56.197 INFO:teuthology.orchestra.run.smithi037.stdout: "batch_size": { 2024-09-19T06:09:56.198 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "batch_size", 2024-09-19T06:09:56.198 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.198 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.198 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.198 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5000", 2024-09-19T06:09:56.198 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.198 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.198 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.198 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T06:09:56.198 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.198 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.198 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.198 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.199 INFO:teuthology.orchestra.run.smithi037.stdout: "database": { 2024-09-19T06:09:56.199 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "database", 2024-09-19T06:09:56.199 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.199 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.199 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.199 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "ceph", 2024-09-19T06:09:56.199 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.199 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.199 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.199 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T06:09:56.199 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.199 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.199 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.199 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.200 INFO:teuthology.orchestra.run.smithi037.stdout: "hostname": { 2024-09-19T06:09:56.200 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "hostname", 2024-09-19T06:09:56.200 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.200 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.200 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.200 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.200 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.200 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.200 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.200 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "InfluxDB server hostname", 2024-09-19T06:09:56.200 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.200 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.200 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.200 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.200 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-09-19T06:09:56.201 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-09-19T06:09:56.201 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-19T06:09:56.201 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.201 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.201 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "30", 2024-09-19T06:09:56.201 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "5", 2024-09-19T06:09:56.201 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.201 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.201 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T06:09:56.201 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.201 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.201 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.201 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.202 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:56.202 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:56.202 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.202 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.202 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.202 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.202 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.202 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.202 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.202 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.202 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.202 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.202 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.203 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.203 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.203 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.203 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.203 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.203 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.203 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.203 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.203 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:56.203 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:56.203 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.203 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.203 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.203 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.204 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.204 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.204 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.204 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.204 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.204 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.204 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.204 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.204 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:56.204 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:56.204 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.204 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.204 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.205 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:56.205 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.205 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.205 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.205 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.205 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.205 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.205 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.205 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.205 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.205 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.205 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.205 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.206 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.206 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.206 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.206 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:56.206 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:56.206 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.206 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.206 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.206 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.206 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.206 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.206 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.206 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.206 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.207 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.207 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.207 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.207 INFO:teuthology.orchestra.run.smithi037.stdout: "password": { 2024-09-19T06:09:56.207 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "password", 2024-09-19T06:09:56.207 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.207 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.207 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.207 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.207 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.207 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.207 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.207 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "password of InfluxDB server user", 2024-09-19T06:09:56.207 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.208 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.208 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.208 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.208 INFO:teuthology.orchestra.run.smithi037.stdout: "port": { 2024-09-19T06:09:56.208 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "port", 2024-09-19T06:09:56.208 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.208 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.208 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.208 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8086", 2024-09-19T06:09:56.208 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.208 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.208 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.208 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "InfluxDB server port", 2024-09-19T06:09:56.209 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.209 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.209 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.209 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.209 INFO:teuthology.orchestra.run.smithi037.stdout: "ssl": { 2024-09-19T06:09:56.209 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssl", 2024-09-19T06:09:56.209 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.209 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.209 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.209 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "false", 2024-09-19T06:09:56.209 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.209 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.209 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.210 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T06:09:56.210 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.210 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.210 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.210 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.210 INFO:teuthology.orchestra.run.smithi037.stdout: "threads": { 2024-09-19T06:09:56.210 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "threads", 2024-09-19T06:09:56.210 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.210 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.210 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.210 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-09-19T06:09:56.210 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-09-19T06:09:56.210 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "32", 2024-09-19T06:09:56.210 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.211 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T06:09:56.211 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.211 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.211 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.211 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.211 INFO:teuthology.orchestra.run.smithi037.stdout: "username": { 2024-09-19T06:09:56.211 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "username", 2024-09-19T06:09:56.211 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.211 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.211 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.211 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.211 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.211 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.211 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.211 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "username of InfluxDB server user", 2024-09-19T06:09:56.212 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.212 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.212 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.212 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.212 INFO:teuthology.orchestra.run.smithi037.stdout: "verify_ssl": { 2024-09-19T06:09:56.212 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "verify_ssl", 2024-09-19T06:09:56.212 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.212 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.212 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.212 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "true", 2024-09-19T06:09:56.212 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.212 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.213 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.213 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T06:09:56.213 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.213 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.213 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.213 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.213 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.213 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.213 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.213 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "insights", 2024-09-19T06:09:56.213 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:56.213 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:56.213 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:56.213 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:56.214 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:56.214 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.214 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.214 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.214 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.214 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.214 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.214 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.214 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.214 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.214 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.214 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.214 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.214 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.215 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.215 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.215 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.215 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.215 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.215 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.215 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:56.215 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:56.215 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.215 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.215 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.215 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.215 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.215 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.216 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.216 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.216 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.216 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.216 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.216 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.216 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:56.216 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:56.216 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.216 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.216 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.216 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:56.216 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.216 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.217 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.217 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.217 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.217 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.217 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.217 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.217 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.217 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.217 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.217 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.217 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.217 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.217 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.217 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:56.218 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:56.218 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.218 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.218 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.218 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.218 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.218 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.218 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.218 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.218 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.218 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.218 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.218 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.218 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.219 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.219 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.219 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "iostat", 2024-09-19T06:09:56.219 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:56.219 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:56.219 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:56.219 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:56.219 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:56.219 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.219 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.219 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.219 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.219 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.219 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.220 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.220 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.220 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.220 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.220 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.220 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.220 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.220 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.220 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.220 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.220 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.220 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.220 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.220 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:56.220 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:56.221 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.221 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.221 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.221 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.221 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.221 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.221 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.221 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.221 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.221 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.221 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.221 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.221 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:56.221 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:56.222 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.222 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.222 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.222 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:56.222 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.222 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.222 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.222 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.222 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.222 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.222 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.222 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.222 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.222 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.223 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.223 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.223 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.223 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.223 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.223 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:56.223 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:56.223 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.223 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.223 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.223 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.223 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.223 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.223 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.223 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.224 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.224 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.224 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.224 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.224 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.224 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.224 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.224 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "k8sevents", 2024-09-19T06:09:56.224 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:56.224 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:56.224 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:56.224 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_event_retention_days": { 2024-09-19T06:09:56.224 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ceph_event_retention_days", 2024-09-19T06:09:56.224 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.225 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.225 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.225 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "7", 2024-09-19T06:09:56.225 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.225 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.225 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.225 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T06:09:56.225 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.225 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.225 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.225 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.225 INFO:teuthology.orchestra.run.smithi037.stdout: "config_check_secs": { 2024-09-19T06:09:56.225 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "config_check_secs", 2024-09-19T06:09:56.225 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.225 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.226 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.226 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-19T06:09:56.226 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "10", 2024-09-19T06:09:56.226 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.226 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.226 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T06:09:56.226 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.226 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.226 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.226 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.226 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:56.226 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:56.226 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.226 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.227 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.227 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.227 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.227 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.227 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.227 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.227 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.227 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.227 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.227 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.227 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.227 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.227 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.227 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.228 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.228 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.228 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.228 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:56.228 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:56.228 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.228 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.228 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.228 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.228 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.228 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.228 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.228 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.229 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.229 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.229 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.229 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.229 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:56.229 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:56.229 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.229 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.229 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.229 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:56.229 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.229 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.229 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.229 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.229 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.230 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.230 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.230 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.230 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.230 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.230 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.230 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.230 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.230 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.230 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.230 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:56.230 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:56.230 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.230 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.231 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.231 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.231 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.231 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.231 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.231 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.231 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.231 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.231 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.231 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.231 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.231 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.231 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.231 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "localpool", 2024-09-19T06:09:56.232 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:56.232 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:56.232 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:56.232 INFO:teuthology.orchestra.run.smithi037.stdout: "failure_domain": { 2024-09-19T06:09:56.232 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "failure_domain", 2024-09-19T06:09:56.232 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.232 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.232 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.232 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "host", 2024-09-19T06:09:56.232 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.232 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.232 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.232 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "failure domain for any created local pool", 2024-09-19T06:09:56.232 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T06:09:56.233 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.233 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.233 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.233 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:56.233 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:56.233 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.233 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.233 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.233 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.233 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.233 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.233 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.233 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.233 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.234 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.234 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.234 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.234 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.234 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.234 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.234 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.234 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.234 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.234 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.235 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:56.235 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:56.235 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.235 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.235 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.235 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.235 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.235 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.235 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.235 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.235 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.235 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.235 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.235 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.236 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:56.236 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:56.236 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.236 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.236 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.236 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:56.236 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.236 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.236 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.236 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.236 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.236 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.236 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.236 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.237 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.237 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.237 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.237 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.237 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.237 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.237 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.237 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:56.237 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:56.237 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.237 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.237 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.237 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.237 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.238 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.238 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.238 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.238 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.238 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.238 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.238 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.238 INFO:teuthology.orchestra.run.smithi037.stdout: "min_size": { 2024-09-19T06:09:56.238 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "min_size", 2024-09-19T06:09:56.238 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.238 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.238 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.238 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.238 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.239 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.239 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.239 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "default min_size for any created local pool", 2024-09-19T06:09:56.239 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T06:09:56.239 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.239 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.239 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.239 INFO:teuthology.orchestra.run.smithi037.stdout: "num_rep": { 2024-09-19T06:09:56.239 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "num_rep", 2024-09-19T06:09:56.239 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.239 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.240 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.240 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "3", 2024-09-19T06:09:56.240 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.240 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.240 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.240 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "default replica count for any created local pool", 2024-09-19T06:09:56.240 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.240 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.240 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.240 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.240 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num": { 2024-09-19T06:09:56.240 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pg_num", 2024-09-19T06:09:56.240 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.241 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.241 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.241 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "128", 2024-09-19T06:09:56.241 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.241 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.241 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.241 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T06:09:56.241 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.241 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.241 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.241 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.241 INFO:teuthology.orchestra.run.smithi037.stdout: "prefix": { 2024-09-19T06:09:56.241 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "prefix", 2024-09-19T06:09:56.242 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.242 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.242 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.242 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.242 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.242 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.242 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.242 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "name prefix for any created local pool", 2024-09-19T06:09:56.242 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.242 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.242 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.242 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.242 INFO:teuthology.orchestra.run.smithi037.stdout: "subtree": { 2024-09-19T06:09:56.243 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "subtree", 2024-09-19T06:09:56.243 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.243 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.243 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.243 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "rack", 2024-09-19T06:09:56.243 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.243 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.243 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.243 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T06:09:56.243 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T06:09:56.243 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.243 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.243 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.243 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.244 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.244 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.244 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mds_autoscaler", 2024-09-19T06:09:56.244 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:56.244 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:56.244 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:56.244 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:56.244 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:56.244 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.244 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.244 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.244 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.244 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.244 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.245 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.245 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.245 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.245 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.245 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.245 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.245 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.245 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.245 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.245 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.245 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.245 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.245 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.245 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:56.246 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:56.246 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.246 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.246 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.246 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.246 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.246 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.246 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.246 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.246 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.246 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.246 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.246 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.247 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:56.247 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:56.247 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.247 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.247 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.247 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:56.247 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.247 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.247 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.247 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.247 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.247 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.247 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.247 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.247 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.248 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.248 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.248 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.248 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.248 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.248 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.248 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:56.248 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:56.248 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.248 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.248 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.248 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.248 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.248 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.249 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.249 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.249 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.249 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.249 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.249 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.249 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.249 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.249 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.249 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mirroring", 2024-09-19T06:09:56.249 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:56.249 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:56.249 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:56.250 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:56.250 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:56.250 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.250 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.250 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.250 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.250 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.250 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.250 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.250 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.250 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.250 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.250 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.250 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.250 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.251 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.251 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.251 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.251 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.251 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.251 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.251 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:56.251 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:56.251 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.251 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.251 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.251 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.251 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.251 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.252 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.252 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.252 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.252 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.252 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.252 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.252 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:56.252 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:56.252 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.252 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.252 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.252 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:56.252 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.253 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.253 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.253 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.253 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.253 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.253 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.253 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.253 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.253 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.253 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.253 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.253 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.253 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.254 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.254 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:56.254 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:56.254 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.254 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.254 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.254 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.254 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.254 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.254 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.254 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.254 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.254 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.255 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.255 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.255 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.255 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.255 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.255 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "nfs", 2024-09-19T06:09:56.255 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:56.255 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:56.255 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:56.255 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:56.255 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:56.255 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.255 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.255 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.256 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.256 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.256 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.256 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.256 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.256 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.256 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.256 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.256 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.256 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.256 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.256 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.256 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.257 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.257 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.257 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.257 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:56.257 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:56.257 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.257 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.257 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.257 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.257 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.257 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.257 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.257 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.257 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.258 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.258 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.258 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.258 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:56.258 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:56.258 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.258 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.258 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.258 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:56.258 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.258 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.258 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.258 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.259 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.259 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.259 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.259 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.259 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.259 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.259 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.259 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.259 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.259 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.259 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.259 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:56.259 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:56.259 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.260 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.260 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.260 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.260 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.260 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.260 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.260 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.260 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.260 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.260 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.260 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.260 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.260 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.261 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.261 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "orchestrator", 2024-09-19T06:09:56.261 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:56.261 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:56.261 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:56.261 INFO:teuthology.orchestra.run.smithi037.stdout: "fail_fs": { 2024-09-19T06:09:56.261 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "fail_fs", 2024-09-19T06:09:56.261 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.261 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.261 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.261 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.261 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.261 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.262 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.262 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T06:09:56.262 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.262 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.262 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.262 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.262 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:56.262 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:56.262 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.262 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.262 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.262 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.262 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.262 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.263 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.263 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.263 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.263 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.263 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.263 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.263 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.263 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.263 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.263 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.263 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.263 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.263 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.263 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:56.263 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:56.264 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.264 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.264 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.264 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.264 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.264 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.264 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.264 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.264 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.264 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.264 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.264 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.264 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:56.265 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:56.265 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.265 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.265 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.265 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:56.265 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.265 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.265 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.265 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.265 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.265 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.265 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.265 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.265 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.266 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.266 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.266 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.266 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.266 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.266 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.266 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:56.266 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:56.266 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.266 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.266 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.266 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.266 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.266 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.266 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.267 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.267 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.267 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.267 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.267 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.267 INFO:teuthology.orchestra.run.smithi037.stdout: "orchestrator": { 2024-09-19T06:09:56.267 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "orchestrator", 2024-09-19T06:09:56.267 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.267 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.267 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.267 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.267 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.267 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.267 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.267 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm", 2024-09-19T06:09:56.268 INFO:teuthology.orchestra.run.smithi037.stdout: "rook", 2024-09-19T06:09:56.268 INFO:teuthology.orchestra.run.smithi037.stdout: "test_orchestrator" 2024-09-19T06:09:56.268 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.268 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Orchestrator backend", 2024-09-19T06:09:56.268 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.268 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.268 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.268 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.268 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.268 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.268 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.268 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "osd_perf_query", 2024-09-19T06:09:56.268 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:56.268 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:56.269 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:56.269 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:56.269 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:56.269 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.269 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.269 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.269 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.269 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.269 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.269 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.269 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.269 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.269 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.270 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.270 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.270 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.270 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.270 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.270 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.270 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.270 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.270 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.270 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:56.270 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:56.270 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.270 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.270 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.270 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.271 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.271 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.271 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.271 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.271 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.271 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.271 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.271 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.271 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:56.271 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:56.271 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.271 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.271 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.271 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:56.272 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.272 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.272 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.272 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.272 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.272 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.272 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.272 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.272 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.272 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.272 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.272 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.272 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.272 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.273 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.273 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:56.273 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:56.273 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.273 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.273 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.273 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.273 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.273 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.273 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.273 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.273 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.273 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.273 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.274 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.274 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.274 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.274 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.274 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "osd_support", 2024-09-19T06:09:56.274 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:56.274 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:56.274 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:56.274 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:56.274 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:56.274 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.274 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.274 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.274 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.275 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.275 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.275 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.275 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.275 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.275 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.275 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.275 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.275 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.275 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.275 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.275 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.275 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.275 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.276 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.276 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:56.276 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:56.276 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.276 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.276 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.276 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.276 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.276 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.276 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.276 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.276 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.276 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.276 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.277 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.277 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:56.277 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:56.277 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.277 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.277 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.277 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:56.277 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.277 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.277 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.277 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.277 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.277 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.277 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.277 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.278 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.278 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.278 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.278 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.278 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.278 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.278 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.278 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:56.278 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:56.278 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.278 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.278 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.278 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.278 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.279 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.279 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.279 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.279 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.279 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.279 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.279 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.279 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.279 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.279 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.279 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pg_autoscaler", 2024-09-19T06:09:56.279 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:56.279 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:56.279 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:56.279 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:56.280 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:56.280 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.280 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.280 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.280 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.280 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.280 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.280 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.280 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.280 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.280 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.280 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.280 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.280 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.281 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.281 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.281 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.281 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.281 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.281 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.281 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:56.281 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:56.281 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.281 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.281 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.281 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.281 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.281 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.281 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.282 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.282 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.282 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.282 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.282 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.282 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:56.282 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:56.282 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.282 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.282 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.282 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:56.282 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.282 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.283 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.283 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.283 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.283 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.283 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.283 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.283 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.283 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.283 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.283 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.283 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.283 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.283 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.283 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:56.284 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:56.284 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.284 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.284 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.284 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.284 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.284 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.284 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.284 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.284 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.284 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.284 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.284 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.284 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-09-19T06:09:56.285 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-09-19T06:09:56.285 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-19T06:09:56.285 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.285 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.285 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-09-19T06:09:56.285 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.285 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.285 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.285 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.285 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.285 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.285 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.285 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.285 INFO:teuthology.orchestra.run.smithi037.stdout: "threshold": { 2024-09-19T06:09:56.286 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "threshold", 2024-09-19T06:09:56.286 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-19T06:09:56.286 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.286 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.286 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "3.0", 2024-09-19T06:09:56.286 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1.0", 2024-09-19T06:09:56.286 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.286 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.286 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "scaling threshold", 2024-09-19T06:09:56.286 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T06:09:56.286 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.286 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.286 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.286 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.286 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.287 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.287 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "progress", 2024-09-19T06:09:56.287 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:56.287 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:56.287 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:56.287 INFO:teuthology.orchestra.run.smithi037.stdout: "allow_pg_recovery_event": { 2024-09-19T06:09:56.287 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "allow_pg_recovery_event", 2024-09-19T06:09:56.287 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.287 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.287 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.287 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.287 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.287 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.287 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.288 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T06:09:56.288 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.288 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.288 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.288 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.288 INFO:teuthology.orchestra.run.smithi037.stdout: "enabled": { 2024-09-19T06:09:56.288 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enabled", 2024-09-19T06:09:56.288 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.288 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.288 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.288 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.288 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.288 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.288 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.289 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.289 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.289 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.289 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.289 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.289 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:56.289 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:56.289 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.289 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.289 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.289 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.289 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.289 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.289 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.290 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.290 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.290 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.290 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.290 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.290 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.290 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.290 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.290 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.290 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.290 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.290 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.290 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:56.290 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:56.291 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.291 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.291 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.291 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.291 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.291 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.291 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.291 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.291 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.291 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.291 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.291 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.291 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:56.292 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:56.292 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.292 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.292 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.292 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:56.292 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.292 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.292 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.292 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.292 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.292 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.292 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.292 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.292 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.293 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.293 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.293 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.293 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.293 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.293 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.293 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:56.293 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:56.293 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.293 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.293 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.293 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.293 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.293 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.294 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.294 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.294 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.294 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.294 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.294 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.294 INFO:teuthology.orchestra.run.smithi037.stdout: "max_completed_events": { 2024-09-19T06:09:56.294 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_completed_events", 2024-09-19T06:09:56.294 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.294 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.294 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.294 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "50", 2024-09-19T06:09:56.294 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.294 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.294 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.295 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "number of past completed events to remember", 2024-09-19T06:09:56.295 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.295 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.295 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.295 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.295 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-09-19T06:09:56.295 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-09-19T06:09:56.295 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-19T06:09:56.295 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.295 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.295 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-09-19T06:09:56.295 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.295 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.296 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.296 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how long the module is going to sleep", 2024-09-19T06:09:56.296 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.296 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.296 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.296 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.296 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.296 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.296 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.296 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "prometheus", 2024-09-19T06:09:56.296 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:56.296 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:56.296 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:56.296 INFO:teuthology.orchestra.run.smithi037.stdout: "cache": { 2024-09-19T06:09:56.297 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cache", 2024-09-19T06:09:56.297 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.297 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.297 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.297 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.297 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.297 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.297 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.297 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.297 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.297 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.297 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.297 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.297 INFO:teuthology.orchestra.run.smithi037.stdout: "exclude_perf_counters": { 2024-09-19T06:09:56.298 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "exclude_perf_counters", 2024-09-19T06:09:56.298 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.298 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.298 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.298 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.298 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.298 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.298 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.298 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T06:09:56.298 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T06:09:56.298 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.298 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.298 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.298 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:56.299 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:56.299 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.299 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.299 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.299 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.299 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.299 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.299 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.299 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.299 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.299 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.299 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.299 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.299 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.300 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.300 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.300 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.300 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.300 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.300 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.300 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:56.300 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:56.300 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.300 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.300 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.300 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.300 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.300 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.301 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.301 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.301 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.301 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.301 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.301 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.301 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:56.301 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:56.301 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.301 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.301 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.301 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:56.301 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.302 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.302 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.302 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.302 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.302 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.302 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.302 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.302 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.302 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.302 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.302 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.302 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.302 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.302 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.303 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:56.303 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:56.303 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.303 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.303 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.303 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.303 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.303 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.303 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.303 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.303 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.303 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.303 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.303 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.304 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_stats_pools": { 2024-09-19T06:09:56.304 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rbd_stats_pools", 2024-09-19T06:09:56.304 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.304 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.304 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.304 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.304 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.304 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.304 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.304 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.304 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.304 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.304 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.304 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.305 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T06:09:56.305 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T06:09:56.305 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.305 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.305 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.305 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "300", 2024-09-19T06:09:56.305 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.305 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.305 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.305 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.305 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.305 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.305 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.305 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.306 INFO:teuthology.orchestra.run.smithi037.stdout: "scrape_interval": { 2024-09-19T06:09:56.306 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "scrape_interval", 2024-09-19T06:09:56.306 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-19T06:09:56.306 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.306 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.306 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "15.0", 2024-09-19T06:09:56.306 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.306 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.306 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.306 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.306 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.306 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.306 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.306 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.307 INFO:teuthology.orchestra.run.smithi037.stdout: "server_addr": { 2024-09-19T06:09:56.307 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_addr", 2024-09-19T06:09:56.307 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.307 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.307 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.307 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "::", 2024-09-19T06:09:56.307 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.307 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.307 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.307 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T06:09:56.307 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.307 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.307 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.307 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.308 INFO:teuthology.orchestra.run.smithi037.stdout: "server_port": { 2024-09-19T06:09:56.308 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_port", 2024-09-19T06:09:56.308 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.308 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.308 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.308 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "9283", 2024-09-19T06:09:56.308 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.308 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.308 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.308 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T06:09:56.308 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.308 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.309 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.309 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.309 INFO:teuthology.orchestra.run.smithi037.stdout: "stale_cache_strategy": { 2024-09-19T06:09:56.309 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "stale_cache_strategy", 2024-09-19T06:09:56.309 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.309 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.309 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.309 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "log", 2024-09-19T06:09:56.309 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.309 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.309 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.309 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.309 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.310 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.310 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.310 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.310 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_behaviour": { 2024-09-19T06:09:56.310 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_behaviour", 2024-09-19T06:09:56.310 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.310 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.310 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.310 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "default", 2024-09-19T06:09:56.310 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.310 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.310 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.310 INFO:teuthology.orchestra.run.smithi037.stdout: "default", 2024-09-19T06:09:56.311 INFO:teuthology.orchestra.run.smithi037.stdout: "error" 2024-09-19T06:09:56.311 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.311 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.311 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.311 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.311 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.311 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.311 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_error_status_code": { 2024-09-19T06:09:56.311 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_error_status_code", 2024-09-19T06:09:56.311 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.311 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.311 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.311 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "500", 2024-09-19T06:09:56.311 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "400", 2024-09-19T06:09:56.312 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "599", 2024-09-19T06:09:56.312 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.312 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.312 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.312 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.312 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.312 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.312 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.312 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.312 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.312 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rbd_support", 2024-09-19T06:09:56.312 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:56.312 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:56.312 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:56.313 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:56.313 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:56.313 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.313 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.313 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.313 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.313 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.313 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.313 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.313 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.313 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.313 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.313 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.313 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.314 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.314 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.314 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.314 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.314 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.314 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.314 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.314 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:56.314 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:56.314 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.314 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.314 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.314 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.314 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.315 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.315 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.315 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.315 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.315 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.315 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.315 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.315 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:56.315 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:56.315 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.315 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.315 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.315 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:56.315 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.316 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.316 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.316 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.316 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.316 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.316 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.316 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.316 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.316 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.316 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.316 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.316 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.316 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.317 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.317 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:56.317 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:56.317 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.317 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.317 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.317 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.317 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.317 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.317 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.317 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.317 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.317 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.317 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.318 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.318 INFO:teuthology.orchestra.run.smithi037.stdout: "max_concurrent_snap_create": { 2024-09-19T06:09:56.318 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_concurrent_snap_create", 2024-09-19T06:09:56.318 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.318 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.318 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.318 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-19T06:09:56.318 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.318 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.318 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.318 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.318 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.318 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.318 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.318 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.319 INFO:teuthology.orchestra.run.smithi037.stdout: "mirror_snapshot_schedule": { 2024-09-19T06:09:56.319 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T06:09:56.319 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.319 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.319 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.319 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.319 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.319 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.319 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.319 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.319 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.319 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.319 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.319 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.320 INFO:teuthology.orchestra.run.smithi037.stdout: "trash_purge_schedule": { 2024-09-19T06:09:56.320 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "trash_purge_schedule", 2024-09-19T06:09:56.320 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.320 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.320 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.320 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.320 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.320 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.320 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.320 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.320 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.320 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.320 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.320 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.320 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.321 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.321 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.321 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "restful", 2024-09-19T06:09:56.321 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:56.321 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:56.321 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:56.321 INFO:teuthology.orchestra.run.smithi037.stdout: "enable_auth": { 2024-09-19T06:09:56.321 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enable_auth", 2024-09-19T06:09:56.321 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.321 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.321 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.321 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.321 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.321 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.322 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.322 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.322 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.322 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.322 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.322 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.322 INFO:teuthology.orchestra.run.smithi037.stdout: "key_file": { 2024-09-19T06:09:56.322 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "key_file", 2024-09-19T06:09:56.322 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.322 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.322 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.322 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.322 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.322 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.323 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.323 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.323 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.323 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.323 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.323 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.323 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:56.323 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:56.323 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.323 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.323 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.323 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.323 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.323 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.323 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.324 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.324 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.324 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.324 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.324 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.324 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.324 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.324 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.324 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.324 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.324 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.324 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.324 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:56.325 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:56.325 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.325 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.325 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.325 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.325 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.325 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.325 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.325 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.325 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.325 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.325 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.325 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.325 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:56.326 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:56.326 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.326 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.326 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.326 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:56.326 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.326 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.326 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.326 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.326 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.326 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.326 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.326 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.326 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.327 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.327 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.327 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.327 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.327 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.327 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.327 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:56.327 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:56.327 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.327 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.327 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.327 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.327 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.327 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.328 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.328 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.328 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.328 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.328 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.328 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.328 INFO:teuthology.orchestra.run.smithi037.stdout: "server_addr": { 2024-09-19T06:09:56.328 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_addr", 2024-09-19T06:09:56.328 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.328 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.328 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.328 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.328 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.328 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.329 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.329 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.329 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.329 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.329 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.329 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.329 INFO:teuthology.orchestra.run.smithi037.stdout: "server_port": { 2024-09-19T06:09:56.329 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_port", 2024-09-19T06:09:56.329 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.329 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.329 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.329 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.329 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.329 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.330 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.330 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.330 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.330 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.330 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.330 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.330 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.330 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.330 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.330 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rgw", 2024-09-19T06:09:56.330 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:56.330 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:56.330 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:56.330 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:56.330 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:56.331 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.331 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.331 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.331 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.331 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.331 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.331 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.331 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.331 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.331 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.331 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.331 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.331 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.331 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.332 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.332 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.332 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.332 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.332 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.332 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:56.332 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:56.332 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.332 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.332 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.332 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.332 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.332 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.332 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.332 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.333 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.333 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.333 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.333 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.333 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:56.333 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:56.333 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.333 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.333 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.333 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:56.333 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.333 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.333 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.333 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.334 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.334 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.334 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.334 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.334 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.334 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.334 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.334 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.334 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.334 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.336 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.336 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:56.336 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:56.336 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.336 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.336 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.336 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.336 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.336 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.336 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.337 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.337 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.337 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.337 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.337 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.337 INFO:teuthology.orchestra.run.smithi037.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T06:09:56.337 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T06:09:56.337 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.337 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.337 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.337 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-09-19T06:09:56.337 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.337 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.337 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.338 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T06:09:56.338 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.338 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.338 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.338 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.338 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.338 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.338 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.338 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rook", 2024-09-19T06:09:56.338 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:56.338 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:56.338 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:56.339 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:56.339 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:56.339 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.339 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.339 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.339 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.339 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.339 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.339 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.339 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.339 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.339 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.339 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.340 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.340 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.340 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.340 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.340 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.340 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.340 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.340 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.340 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:56.340 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:56.340 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.340 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.341 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.341 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.341 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.341 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.341 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.341 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.341 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.341 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.341 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.341 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.341 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:56.341 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:56.341 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.342 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.342 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.342 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:56.342 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.342 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.342 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.342 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.342 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.342 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.342 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.342 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.342 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.342 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.342 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.342 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.342 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.343 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.343 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.343 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:56.343 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:56.343 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.343 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.343 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.343 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.343 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.343 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.343 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.343 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.343 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.344 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.344 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.344 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.344 INFO:teuthology.orchestra.run.smithi037.stdout: "storage_class": { 2024-09-19T06:09:56.344 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "storage_class", 2024-09-19T06:09:56.344 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.344 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.344 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.344 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "local", 2024-09-19T06:09:56.344 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.344 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.344 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.344 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T06:09:56.344 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.345 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.345 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.345 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.345 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.345 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.345 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.345 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "selftest", 2024-09-19T06:09:56.345 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:56.345 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:56.345 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:56.345 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:56.345 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:56.345 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.346 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.346 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.346 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.346 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.346 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.346 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.346 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.346 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.346 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.346 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.346 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.346 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.346 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.347 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.347 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.347 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.347 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.347 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.347 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:56.347 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:56.347 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.347 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.347 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.347 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.347 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.347 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.347 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.347 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.348 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.348 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.348 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.348 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.348 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:56.348 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:56.348 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.348 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.348 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.348 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:56.348 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.348 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.348 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.349 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.349 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.349 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.349 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.349 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.349 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.349 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.349 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.349 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.349 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.349 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.349 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.349 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:56.350 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:56.350 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.350 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.350 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.350 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.350 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.350 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.350 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.350 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.350 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.350 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.350 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.350 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.350 INFO:teuthology.orchestra.run.smithi037.stdout: "roption1": { 2024-09-19T06:09:56.351 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "roption1", 2024-09-19T06:09:56.351 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.351 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.351 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.351 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.351 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.351 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.351 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.351 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.351 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.351 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.351 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.351 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.351 INFO:teuthology.orchestra.run.smithi037.stdout: "roption2": { 2024-09-19T06:09:56.352 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "roption2", 2024-09-19T06:09:56.352 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.352 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.352 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.352 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "xyz", 2024-09-19T06:09:56.352 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.352 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.352 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.352 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.352 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.352 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.352 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.352 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.353 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption1": { 2024-09-19T06:09:56.353 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption1", 2024-09-19T06:09:56.353 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.353 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.353 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.353 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.353 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.353 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.353 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.353 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.353 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.353 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.353 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.354 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.354 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption2": { 2024-09-19T06:09:56.354 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption2", 2024-09-19T06:09:56.354 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.354 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.354 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.354 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.354 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.354 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.354 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.354 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.354 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.354 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.354 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.355 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.355 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption3": { 2024-09-19T06:09:56.355 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption3", 2024-09-19T06:09:56.355 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-19T06:09:56.355 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.355 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.355 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.355 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.355 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.355 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.355 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.355 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.355 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.356 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.356 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.356 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption4": { 2024-09-19T06:09:56.356 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption4", 2024-09-19T06:09:56.356 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.356 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.356 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.356 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.356 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.356 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.356 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.356 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.356 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.357 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.357 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.357 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.357 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption5": { 2024-09-19T06:09:56.357 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption5", 2024-09-19T06:09:56.357 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.357 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.357 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.357 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.357 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.357 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.357 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.357 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.357 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.358 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.358 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.358 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.358 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption6": { 2024-09-19T06:09:56.358 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption6", 2024-09-19T06:09:56.358 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.358 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.358 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.358 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.358 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.358 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.358 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.358 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.358 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.359 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.359 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.359 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.359 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption7": { 2024-09-19T06:09:56.359 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption7", 2024-09-19T06:09:56.359 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.359 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.359 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.359 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.359 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-09-19T06:09:56.359 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "42", 2024-09-19T06:09:56.359 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.359 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.360 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.360 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.360 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.360 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.360 INFO:teuthology.orchestra.run.smithi037.stdout: "testkey": { 2024-09-19T06:09:56.360 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "testkey", 2024-09-19T06:09:56.360 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.360 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.360 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.360 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.360 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.360 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.360 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.361 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.361 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.361 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.361 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.361 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.361 INFO:teuthology.orchestra.run.smithi037.stdout: "testlkey": { 2024-09-19T06:09:56.361 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "testlkey", 2024-09-19T06:09:56.361 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.361 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.361 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.361 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.361 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.361 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.361 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.361 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.362 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.362 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.362 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.362 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.362 INFO:teuthology.orchestra.run.smithi037.stdout: "testnewline": { 2024-09-19T06:09:56.362 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "testnewline", 2024-09-19T06:09:56.362 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.362 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.362 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.362 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.362 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.362 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.362 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.362 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.362 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.362 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.363 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.363 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.363 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.363 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.363 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.363 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "snap_schedule", 2024-09-19T06:09:56.363 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:56.363 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:56.363 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:56.363 INFO:teuthology.orchestra.run.smithi037.stdout: "allow_m_granularity": { 2024-09-19T06:09:56.363 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "allow_m_granularity", 2024-09-19T06:09:56.363 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.363 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.363 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.363 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.364 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.364 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.364 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.364 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T06:09:56.364 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.364 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.364 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.364 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.364 INFO:teuthology.orchestra.run.smithi037.stdout: "dump_on_update": { 2024-09-19T06:09:56.364 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "dump_on_update", 2024-09-19T06:09:56.364 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.364 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.364 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.365 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.365 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.365 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.365 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.365 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "dump database to debug log on update", 2024-09-19T06:09:56.365 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.365 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.365 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.365 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.365 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:56.365 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:56.365 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.365 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.365 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.365 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.366 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.366 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.366 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.366 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.366 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.366 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.366 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.366 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.366 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.366 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.366 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.366 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.366 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.366 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.366 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.367 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:56.367 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:56.367 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.367 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.367 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.367 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.367 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.367 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.367 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.367 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.367 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.367 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.367 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.367 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.368 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:56.368 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:56.368 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.368 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.368 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.368 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:56.368 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.368 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.368 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.368 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.368 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.368 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.368 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.368 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.369 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.369 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.369 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.369 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.369 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.369 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.369 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.369 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:56.369 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:56.369 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.369 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.369 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.369 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.370 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.370 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.370 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.370 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.370 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.370 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.370 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.370 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.370 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.370 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.370 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.370 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "stats", 2024-09-19T06:09:56.370 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:56.371 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:56.371 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:56.371 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:56.371 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:56.371 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.371 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.371 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.371 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.371 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.371 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.371 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.371 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.371 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.371 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.372 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.372 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.372 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.372 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.372 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.372 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.372 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.372 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.372 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.372 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:56.372 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:56.372 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.372 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.373 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.373 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.373 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.373 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.373 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.373 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.373 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.373 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.373 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.373 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.373 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:56.373 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:56.373 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.373 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.374 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.374 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:56.374 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.374 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.374 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.374 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.374 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.374 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.374 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.374 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.374 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.374 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.374 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.374 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.375 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.375 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.375 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.375 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:56.375 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:56.375 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.375 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.375 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.375 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.375 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.375 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.375 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.375 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.376 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.376 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.376 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.376 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.376 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.376 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.376 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.376 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "status", 2024-09-19T06:09:56.376 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:56.376 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:56.376 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:56.376 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:56.376 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:56.376 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.377 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.377 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.377 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.377 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.377 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.377 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.377 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.377 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.377 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.377 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.377 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.377 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.377 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.378 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.378 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.378 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.378 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.378 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.378 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:56.378 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:56.378 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.378 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.378 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.378 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.378 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.378 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.378 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.378 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.379 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.379 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.379 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.379 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.379 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:56.379 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:56.379 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.379 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.379 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.379 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:56.379 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.379 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.379 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.379 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.380 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.380 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.380 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.380 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.380 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.380 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.380 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.380 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.380 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.380 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.380 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.380 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:56.380 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:56.380 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.381 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.381 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.381 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.381 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.381 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.381 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.381 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.381 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.381 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.381 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.381 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.381 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.381 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.382 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.382 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "telegraf", 2024-09-19T06:09:56.382 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:56.382 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:56.382 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:56.382 INFO:teuthology.orchestra.run.smithi037.stdout: "address": { 2024-09-19T06:09:56.382 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "address", 2024-09-19T06:09:56.382 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.382 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.382 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.382 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T06:09:56.382 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.382 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.382 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.383 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.383 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.383 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.383 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.383 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.383 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-09-19T06:09:56.383 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-09-19T06:09:56.383 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-19T06:09:56.383 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.383 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.383 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "15", 2024-09-19T06:09:56.383 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.384 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.384 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.384 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.384 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.384 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.384 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.384 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.384 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:56.384 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:56.384 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.384 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.384 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.384 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.384 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.385 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.385 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.385 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.385 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.385 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.385 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.385 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.385 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.385 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.385 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.385 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.385 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.385 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.386 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.386 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:56.386 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:56.386 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.386 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.386 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.386 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.386 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.386 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.386 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.386 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.386 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.386 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.386 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.387 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.387 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:56.387 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:56.387 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.387 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.387 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.387 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:56.387 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.387 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.387 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.387 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.387 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.387 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.387 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.387 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.388 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.388 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.388 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.388 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.388 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.388 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.388 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.388 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:56.388 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:56.388 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.388 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.388 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.388 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.389 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.389 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.389 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.389 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.389 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.389 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.389 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.389 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.389 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.389 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.389 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.389 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "telemetry", 2024-09-19T06:09:56.389 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:56.389 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:56.390 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:56.390 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_basic": { 2024-09-19T06:09:56.390 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_basic", 2024-09-19T06:09:56.390 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.390 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.390 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.390 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.390 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.390 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.390 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.390 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T06:09:56.390 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.390 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.390 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.391 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.391 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_crash": { 2024-09-19T06:09:56.391 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_crash", 2024-09-19T06:09:56.391 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.391 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.391 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.391 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.391 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.391 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.391 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.391 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T06:09:56.391 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.391 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.392 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.392 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.392 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_device": { 2024-09-19T06:09:56.392 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_device", 2024-09-19T06:09:56.392 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.392 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.392 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.392 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.392 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.392 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.392 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.392 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T06:09:56.392 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.392 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.393 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.393 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.393 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_ident": { 2024-09-19T06:09:56.393 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_ident", 2024-09-19T06:09:56.393 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.393 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.393 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.393 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.393 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.393 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.393 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.393 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T06:09:56.393 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.393 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.394 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.394 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.394 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_perf": { 2024-09-19T06:09:56.394 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_perf", 2024-09-19T06:09:56.394 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.394 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.394 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.394 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.394 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.394 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.394 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.394 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T06:09:56.394 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.395 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.395 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.395 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.395 INFO:teuthology.orchestra.run.smithi037.stdout: "contact": { 2024-09-19T06:09:56.395 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "contact", 2024-09-19T06:09:56.395 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.395 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.395 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.395 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.395 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.395 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.395 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.395 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.395 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.396 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.396 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.396 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.396 INFO:teuthology.orchestra.run.smithi037.stdout: "description": { 2024-09-19T06:09:56.396 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "description", 2024-09-19T06:09:56.396 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.396 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.396 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.396 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.396 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.396 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.396 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.396 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.396 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.397 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.397 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.397 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.397 INFO:teuthology.orchestra.run.smithi037.stdout: "device_url": { 2024-09-19T06:09:56.397 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "device_url", 2024-09-19T06:09:56.397 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.397 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.397 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.397 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T06:09:56.397 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.397 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.397 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.397 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.397 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.398 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.398 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.398 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.398 INFO:teuthology.orchestra.run.smithi037.stdout: "enabled": { 2024-09-19T06:09:56.398 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enabled", 2024-09-19T06:09:56.398 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.398 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.398 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.398 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.398 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.398 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.398 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.398 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.398 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.399 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.399 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.399 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.399 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-09-19T06:09:56.399 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-09-19T06:09:56.399 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.399 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.399 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.399 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "24", 2024-09-19T06:09:56.399 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "8", 2024-09-19T06:09:56.399 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.399 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.399 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.399 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.400 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.400 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.400 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.400 INFO:teuthology.orchestra.run.smithi037.stdout: "last_opt_revision": { 2024-09-19T06:09:56.400 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "last_opt_revision", 2024-09-19T06:09:56.400 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.400 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.400 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.400 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "1", 2024-09-19T06:09:56.400 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.400 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.400 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.400 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.400 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.401 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.401 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.401 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.401 INFO:teuthology.orchestra.run.smithi037.stdout: "leaderboard": { 2024-09-19T06:09:56.401 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "leaderboard", 2024-09-19T06:09:56.401 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.401 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.401 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.401 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.401 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.401 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.401 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.401 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.401 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.402 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.402 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.402 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.402 INFO:teuthology.orchestra.run.smithi037.stdout: "leaderboard_description": { 2024-09-19T06:09:56.402 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "leaderboard_description", 2024-09-19T06:09:56.402 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.402 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.402 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.402 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.402 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.402 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.402 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.402 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.402 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.402 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.403 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.403 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.403 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:56.403 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:56.403 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.403 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.403 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.403 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.403 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.403 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.403 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.403 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.403 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.403 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.404 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.404 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.404 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.404 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.404 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.404 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.404 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.404 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.404 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.404 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:56.404 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:56.404 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.404 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.404 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.405 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.405 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.405 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.405 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.405 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.405 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.405 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.405 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.405 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.405 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:56.405 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:56.405 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.405 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.405 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.406 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:56.406 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.406 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.406 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.406 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.406 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.406 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.406 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.406 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.406 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.406 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.406 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.406 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.406 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.407 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.407 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.407 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:56.407 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:56.407 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.407 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.407 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.407 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.407 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.407 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.407 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.407 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.407 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.407 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.407 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.408 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.408 INFO:teuthology.orchestra.run.smithi037.stdout: "organization": { 2024-09-19T06:09:56.408 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "organization", 2024-09-19T06:09:56.408 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.408 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.408 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.408 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.408 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.408 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.408 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.408 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.408 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.408 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.409 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.409 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.409 INFO:teuthology.orchestra.run.smithi037.stdout: "proxy": { 2024-09-19T06:09:56.409 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "proxy", 2024-09-19T06:09:56.409 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.409 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.409 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.409 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.409 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.409 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.409 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.409 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.409 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.410 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.410 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.410 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.410 INFO:teuthology.orchestra.run.smithi037.stdout: "url": { 2024-09-19T06:09:56.410 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "url", 2024-09-19T06:09:56.410 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.410 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.410 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.410 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T06:09:56.410 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.410 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.410 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.410 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.410 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.411 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.411 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.411 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.411 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.411 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.411 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.411 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "test_orchestrator", 2024-09-19T06:09:56.411 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:56.411 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:56.411 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:56.411 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:56.411 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:56.411 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.411 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.412 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.412 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.412 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.412 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.412 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.412 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.412 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.412 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.412 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.412 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.412 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.412 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.412 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.413 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.413 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.413 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.413 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.413 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:56.413 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:56.413 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.413 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.413 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.413 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.413 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.413 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.413 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.414 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.414 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.414 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.414 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.414 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.414 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:56.414 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:56.414 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.414 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.414 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.414 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:56.414 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.414 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.414 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.415 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.415 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.415 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.415 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.415 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.415 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.415 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.415 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.415 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.415 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.415 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.415 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.415 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:56.415 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:56.415 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.416 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.416 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.416 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.416 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.416 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.416 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.416 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.416 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.416 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.416 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.416 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.416 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.416 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.416 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.417 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "volumes", 2024-09-19T06:09:56.417 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:56.417 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:56.417 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:56.417 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:56.417 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:56.417 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.417 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.417 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.417 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.417 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.417 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.417 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.417 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.418 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.418 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.418 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.418 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.418 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.418 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.418 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.418 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.418 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.418 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.418 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.418 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:56.418 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:56.418 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.419 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.419 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.419 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.419 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.419 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.419 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.419 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.419 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.419 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.419 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.419 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.419 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:56.419 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:56.419 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.420 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.420 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.420 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:56.420 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.420 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.420 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.420 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.420 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.420 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.420 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.420 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.420 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.420 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.420 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.421 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.421 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.421 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.421 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.421 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:56.421 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:56.421 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.421 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.421 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.421 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.421 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.421 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.421 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.421 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.421 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.422 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.422 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.422 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.422 INFO:teuthology.orchestra.run.smithi037.stdout: "max_concurrent_clones": { 2024-09-19T06:09:56.422 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_concurrent_clones", 2024-09-19T06:09:56.422 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.422 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.422 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.422 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "4", 2024-09-19T06:09:56.422 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.422 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.422 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.422 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T06:09:56.422 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.423 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.423 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.423 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.423 INFO:teuthology.orchestra.run.smithi037.stdout: "periodic_async_work": { 2024-09-19T06:09:56.423 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "periodic_async_work", 2024-09-19T06:09:56.423 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.423 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.423 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.423 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.423 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.423 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.423 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.423 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Periodically check for async work", 2024-09-19T06:09:56.423 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.423 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.424 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.424 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.424 INFO:teuthology.orchestra.run.smithi037.stdout: "snapshot_clone_delay": { 2024-09-19T06:09:56.424 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "snapshot_clone_delay", 2024-09-19T06:09:56.424 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.424 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.424 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.424 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-19T06:09:56.424 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.424 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.424 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.424 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T06:09:56.424 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.424 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.425 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.425 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.425 INFO:teuthology.orchestra.run.smithi037.stdout: "snapshot_clone_no_wait": { 2024-09-19T06:09:56.425 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T06:09:56.425 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.425 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.425 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.425 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.425 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.425 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.425 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.425 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T06:09:56.425 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.426 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.426 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.426 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.426 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.426 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.426 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.426 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix", 2024-09-19T06:09:56.426 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:56.426 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:56.426 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:56.426 INFO:teuthology.orchestra.run.smithi037.stdout: "discovery_interval": { 2024-09-19T06:09:56.426 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "discovery_interval", 2024-09-19T06:09:56.426 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-09-19T06:09:56.426 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.427 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.427 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "100", 2024-09-19T06:09:56.427 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.427 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.427 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.427 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.427 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.427 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.427 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.427 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.427 INFO:teuthology.orchestra.run.smithi037.stdout: "identifier": { 2024-09-19T06:09:56.427 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "identifier", 2024-09-19T06:09:56.427 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.427 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.428 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.428 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.428 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.428 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.428 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.428 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.428 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.428 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.428 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.428 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.428 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-09-19T06:09:56.428 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-09-19T06:09:56.428 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-19T06:09:56.428 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.429 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.429 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-09-19T06:09:56.429 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.429 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.429 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.429 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.429 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.429 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.429 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.429 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.429 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:56.429 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:56.429 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.429 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.430 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.430 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.430 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.430 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.430 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.430 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.430 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.430 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.430 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.430 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.430 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.430 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.430 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.430 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.431 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.431 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.431 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.431 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:56.431 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:56.431 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.431 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.431 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.431 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.431 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.431 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.431 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.431 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.431 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.431 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.432 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.432 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.432 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:56.432 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:56.432 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.432 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.432 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.432 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:56.432 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.432 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.432 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.432 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.432 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.432 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.433 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.433 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.433 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.433 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.433 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.433 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.433 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.433 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.433 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.433 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:56.433 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:56.433 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.433 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.433 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.433 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.434 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.434 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.434 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.434 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.434 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.434 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.434 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.434 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.434 INFO:teuthology.orchestra.run.smithi037.stdout: "zabbix_host": { 2024-09-19T06:09:56.434 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix_host", 2024-09-19T06:09:56.434 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.434 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.434 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.434 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.435 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.435 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.435 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.435 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.435 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.435 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.435 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.435 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.435 INFO:teuthology.orchestra.run.smithi037.stdout: "zabbix_port": { 2024-09-19T06:09:56.435 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix_port", 2024-09-19T06:09:56.435 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.435 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.435 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.436 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10051", 2024-09-19T06:09:56.436 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.436 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.436 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.436 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.436 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.436 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.436 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.436 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.436 INFO:teuthology.orchestra.run.smithi037.stdout: "zabbix_sender": { 2024-09-19T06:09:56.436 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix_sender", 2024-09-19T06:09:56.436 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.437 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.437 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.437 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T06:09:56.437 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.437 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.437 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.437 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.437 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.437 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.437 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.437 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.437 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.437 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.438 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-09-19T06:09:56.438 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.438 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.438 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-09-19T06:09:56.438 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm", 2024-09-19T06:09:56.438 INFO:teuthology.orchestra.run.smithi037.stdout: "dashboard", 2024-09-19T06:09:56.438 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-09-19T06:09:56.438 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-09-19T06:09:56.438 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-09-19T06:09:56.438 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.438 INFO:teuthology.orchestra.run.smithi037.stdout: "available_modules": [ 2024-09-19T06:09:56.438 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.438 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "alerts", 2024-09-19T06:09:56.438 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:56.439 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:56.439 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:56.439 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-09-19T06:09:56.439 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-09-19T06:09:56.439 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-19T06:09:56.439 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.439 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.439 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-09-19T06:09:56.439 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.439 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.439 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.439 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T06:09:56.439 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.439 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.440 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.440 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.440 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:56.440 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:56.440 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.440 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.440 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.440 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.440 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.440 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.440 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.440 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.440 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.441 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.441 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.441 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.441 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.441 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.441 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.441 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.441 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.441 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.441 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.441 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:56.441 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:56.441 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.441 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.442 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.442 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.442 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.442 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.442 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.442 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.442 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.442 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.442 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.442 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.442 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:56.442 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:56.442 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.442 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.443 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.443 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:56.443 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.443 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.443 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.443 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.443 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.443 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.443 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.443 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.443 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.443 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.443 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.443 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.444 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.444 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.444 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.444 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:56.444 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:56.444 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.444 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.444 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.444 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.444 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.444 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.444 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.444 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.444 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.445 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.445 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.445 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.445 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_destination": { 2024-09-19T06:09:56.445 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_destination", 2024-09-19T06:09:56.445 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.445 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.445 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.445 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.445 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.445 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.445 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.445 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Email address to send alerts to", 2024-09-19T06:09:56.446 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.446 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.446 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.446 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.446 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_from_name": { 2024-09-19T06:09:56.446 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_from_name", 2024-09-19T06:09:56.446 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.446 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.446 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.446 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "Ceph", 2024-09-19T06:09:56.446 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.446 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.446 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.446 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Email From: name", 2024-09-19T06:09:56.447 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.447 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.447 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.447 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.447 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_host": { 2024-09-19T06:09:56.447 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_host", 2024-09-19T06:09:56.447 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.447 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.447 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.447 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.447 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.447 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.447 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.447 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SMTP server", 2024-09-19T06:09:56.448 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.448 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.448 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.448 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.448 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_password": { 2024-09-19T06:09:56.448 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_password", 2024-09-19T06:09:56.448 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.448 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.448 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.448 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.448 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.448 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.448 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.448 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Password to authenticate with", 2024-09-19T06:09:56.449 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.449 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.449 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.449 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.449 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_port": { 2024-09-19T06:09:56.449 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_port", 2024-09-19T06:09:56.449 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.449 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.449 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.449 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "465", 2024-09-19T06:09:56.449 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.449 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.449 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.449 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SMTP port", 2024-09-19T06:09:56.450 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.450 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.450 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.450 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.450 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_sender": { 2024-09-19T06:09:56.450 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_sender", 2024-09-19T06:09:56.450 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.450 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.450 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.450 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.450 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.450 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.450 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.450 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SMTP envelope sender", 2024-09-19T06:09:56.451 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.451 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.451 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.451 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.451 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_ssl": { 2024-09-19T06:09:56.451 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_ssl", 2024-09-19T06:09:56.451 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.451 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.451 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.451 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.451 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.451 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.451 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.451 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T06:09:56.451 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.452 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.452 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.452 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.452 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_user": { 2024-09-19T06:09:56.452 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_user", 2024-09-19T06:09:56.452 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.452 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.452 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.452 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.452 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.452 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.452 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.452 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "User to authenticate as", 2024-09-19T06:09:56.452 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.453 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.453 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.453 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.453 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.453 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.453 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.453 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "balancer", 2024-09-19T06:09:56.453 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:56.453 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:56.453 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:56.453 INFO:teuthology.orchestra.run.smithi037.stdout: "active": { 2024-09-19T06:09:56.453 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "active", 2024-09-19T06:09:56.453 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.454 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.454 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.454 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.454 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.454 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.454 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.454 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T06:09:56.454 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.454 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.454 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.454 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.454 INFO:teuthology.orchestra.run.smithi037.stdout: "begin_time": { 2024-09-19T06:09:56.454 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "begin_time", 2024-09-19T06:09:56.454 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.455 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.455 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.455 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0000", 2024-09-19T06:09:56.455 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.455 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.455 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.455 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T06:09:56.455 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T06:09:56.455 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.455 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.455 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.455 INFO:teuthology.orchestra.run.smithi037.stdout: "begin_weekday": { 2024-09-19T06:09:56.455 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "begin_weekday", 2024-09-19T06:09:56.455 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-09-19T06:09:56.456 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.456 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.456 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-19T06:09:56.456 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "0", 2024-09-19T06:09:56.456 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "6", 2024-09-19T06:09:56.456 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.456 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T06:09:56.456 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T06:09:56.456 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.456 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.456 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.456 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_compat_max_iterations": { 2024-09-19T06:09:56.456 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crush_compat_max_iterations", 2024-09-19T06:09:56.457 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-09-19T06:09:56.457 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.457 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.457 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "25", 2024-09-19T06:09:56.457 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-09-19T06:09:56.457 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "250", 2024-09-19T06:09:56.457 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.457 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T06:09:56.457 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.457 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.457 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.457 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.457 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_compat_metrics": { 2024-09-19T06:09:56.457 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crush_compat_metrics", 2024-09-19T06:09:56.458 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.458 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.458 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.458 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T06:09:56.458 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.458 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.458 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.458 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T06:09:56.458 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T06:09:56.458 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.458 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.458 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.458 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_compat_step": { 2024-09-19T06:09:56.459 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crush_compat_step", 2024-09-19T06:09:56.459 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-19T06:09:56.459 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.459 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.459 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0.5", 2024-09-19T06:09:56.459 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "0.001", 2024-09-19T06:09:56.459 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "0.999", 2024-09-19T06:09:56.459 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.459 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "aggressiveness of optimization", 2024-09-19T06:09:56.459 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T06:09:56.459 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.459 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.459 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.459 INFO:teuthology.orchestra.run.smithi037.stdout: "end_time": { 2024-09-19T06:09:56.460 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "end_time", 2024-09-19T06:09:56.460 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.460 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.460 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.460 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "2359", 2024-09-19T06:09:56.460 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.460 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.460 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.460 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T06:09:56.460 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T06:09:56.460 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.460 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.460 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.461 INFO:teuthology.orchestra.run.smithi037.stdout: "end_weekday": { 2024-09-19T06:09:56.461 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "end_weekday", 2024-09-19T06:09:56.461 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-09-19T06:09:56.461 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.461 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.461 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-19T06:09:56.461 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "0", 2024-09-19T06:09:56.461 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "6", 2024-09-19T06:09:56.461 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.461 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T06:09:56.461 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T06:09:56.461 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.461 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.461 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.461 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:56.462 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:56.462 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.462 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.462 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.462 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.462 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.462 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.462 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.462 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.462 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.462 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.462 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.462 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.462 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.463 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.463 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.463 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.463 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.463 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.463 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.463 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:56.463 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:56.463 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.463 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.463 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.463 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.463 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.463 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.464 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.464 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.464 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.464 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.464 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.464 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.464 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:56.464 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:56.464 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.464 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.464 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.464 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:56.464 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.464 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.465 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.465 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.465 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.465 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.465 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.465 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.465 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.465 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.465 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.465 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.465 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.465 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.465 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.465 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:56.466 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:56.466 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.466 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.466 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.466 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.466 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.466 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.466 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.466 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.466 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.466 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.466 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.466 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.466 INFO:teuthology.orchestra.run.smithi037.stdout: "min_score": { 2024-09-19T06:09:56.466 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "min_score", 2024-09-19T06:09:56.467 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-19T06:09:56.467 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.467 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.467 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-19T06:09:56.467 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.467 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.467 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.467 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T06:09:56.467 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.467 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.467 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.467 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.467 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": { 2024-09-19T06:09:56.467 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mode", 2024-09-19T06:09:56.467 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.468 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.468 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.468 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "upmap", 2024-09-19T06:09:56.468 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.468 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.468 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.468 INFO:teuthology.orchestra.run.smithi037.stdout: "crush-compat", 2024-09-19T06:09:56.468 INFO:teuthology.orchestra.run.smithi037.stdout: "none", 2024-09-19T06:09:56.468 INFO:teuthology.orchestra.run.smithi037.stdout: "read", 2024-09-19T06:09:56.468 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap", 2024-09-19T06:09:56.468 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap-read" 2024-09-19T06:09:56.468 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.468 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Balancer mode", 2024-09-19T06:09:56.469 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.469 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.469 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.469 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.469 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_ids": { 2024-09-19T06:09:56.469 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pool_ids", 2024-09-19T06:09:56.469 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.469 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.469 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.469 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.469 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.469 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.469 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.469 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T06:09:56.470 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.470 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.470 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.470 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.470 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-09-19T06:09:56.470 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-09-19T06:09:56.470 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-19T06:09:56.470 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.470 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.470 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-09-19T06:09:56.470 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.470 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.470 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.470 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T06:09:56.471 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.471 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.471 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.471 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.471 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap_max_deviation": { 2024-09-19T06:09:56.471 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "upmap_max_deviation", 2024-09-19T06:09:56.471 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.471 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.471 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.471 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-09-19T06:09:56.471 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-09-19T06:09:56.471 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.471 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.471 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T06:09:56.472 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T06:09:56.472 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.472 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.472 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.472 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap_max_optimizations": { 2024-09-19T06:09:56.472 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "upmap_max_optimizations", 2024-09-19T06:09:56.472 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-09-19T06:09:56.472 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.472 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.472 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-19T06:09:56.472 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.472 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.472 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.472 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T06:09:56.473 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.473 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.473 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.473 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.473 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.473 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.473 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.473 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephadm", 2024-09-19T06:09:56.473 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:56.473 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:56.473 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:56.473 INFO:teuthology.orchestra.run.smithi037.stdout: "agent_down_multiplier": { 2024-09-19T06:09:56.473 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "agent_down_multiplier", 2024-09-19T06:09:56.474 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-19T06:09:56.474 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.474 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.474 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "3.0", 2024-09-19T06:09:56.474 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.474 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.474 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.474 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T06:09:56.474 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.474 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.474 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.474 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.474 INFO:teuthology.orchestra.run.smithi037.stdout: "agent_refresh_rate": { 2024-09-19T06:09:56.474 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "agent_refresh_rate", 2024-09-19T06:09:56.475 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-19T06:09:56.475 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.475 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.475 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "20", 2024-09-19T06:09:56.475 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.475 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.475 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.475 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T06:09:56.475 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.475 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.475 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.475 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.475 INFO:teuthology.orchestra.run.smithi037.stdout: "agent_starting_port": { 2024-09-19T06:09:56.476 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "agent_starting_port", 2024-09-19T06:09:56.476 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.476 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.476 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.476 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "4721", 2024-09-19T06:09:56.476 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.476 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.476 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.476 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T06:09:56.476 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.476 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.476 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.476 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.476 INFO:teuthology.orchestra.run.smithi037.stdout: "allow_ptrace": { 2024-09-19T06:09:56.477 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "allow_ptrace", 2024-09-19T06:09:56.477 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.477 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.477 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.477 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.477 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.477 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.477 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.477 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T06:09:56.477 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T06:09:56.477 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.477 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.477 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.477 INFO:teuthology.orchestra.run.smithi037.stdout: "autotune_interval": { 2024-09-19T06:09:56.477 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "autotune_interval", 2024-09-19T06:09:56.478 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-19T06:09:56.478 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.478 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.478 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-09-19T06:09:56.478 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.478 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.478 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.478 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T06:09:56.478 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.478 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.478 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.478 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.478 INFO:teuthology.orchestra.run.smithi037.stdout: "autotune_memory_target_ratio": { 2024-09-19T06:09:56.478 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T06:09:56.479 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-19T06:09:56.479 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.479 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.479 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0.7", 2024-09-19T06:09:56.479 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.479 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.479 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.479 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T06:09:56.479 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.479 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.479 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.479 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.479 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm_log_destination": { 2024-09-19T06:09:56.479 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephadm_log_destination", 2024-09-19T06:09:56.480 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.480 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.480 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.480 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.480 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.480 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.480 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.480 INFO:teuthology.orchestra.run.smithi037.stdout: "file", 2024-09-19T06:09:56.480 INFO:teuthology.orchestra.run.smithi037.stdout: "file,syslog", 2024-09-19T06:09:56.480 INFO:teuthology.orchestra.run.smithi037.stdout: "syslog" 2024-09-19T06:09:56.480 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.480 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T06:09:56.480 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.480 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.481 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.481 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.481 INFO:teuthology.orchestra.run.smithi037.stdout: "cgroups_split": { 2024-09-19T06:09:56.481 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cgroups_split", 2024-09-19T06:09:56.481 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.481 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.481 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.481 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.481 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.481 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.481 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.481 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T06:09:56.481 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.481 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.482 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.482 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.482 INFO:teuthology.orchestra.run.smithi037.stdout: "config_checks_enabled": { 2024-09-19T06:09:56.482 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "config_checks_enabled", 2024-09-19T06:09:56.482 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.482 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.482 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.482 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.482 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.482 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.482 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.482 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T06:09:56.482 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.482 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.483 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.483 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.483 INFO:teuthology.orchestra.run.smithi037.stdout: "config_dashboard": { 2024-09-19T06:09:56.483 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "config_dashboard", 2024-09-19T06:09:56.483 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.483 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.483 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.483 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.483 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.483 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.483 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.483 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T06:09:56.483 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.484 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.484 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.484 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.484 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_alertmanager": { 2024-09-19T06:09:56.484 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_alertmanager", 2024-09-19T06:09:56.484 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.484 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.484 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.484 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T06:09:56.484 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.484 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.484 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.484 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-09-19T06:09:56.484 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.485 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.485 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.485 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.485 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_base": { 2024-09-19T06:09:56.485 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_base", 2024-09-19T06:09:56.485 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.485 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.485 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.485 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T06:09:56.485 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.485 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.485 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.485 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Container image name, without the tag", 2024-09-19T06:09:56.485 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.486 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.486 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.486 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.486 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_elasticsearch": { 2024-09-19T06:09:56.486 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_elasticsearch", 2024-09-19T06:09:56.486 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.486 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.486 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.486 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T06:09:56.486 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.486 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.486 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.486 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "elasticsearch container image", 2024-09-19T06:09:56.486 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.486 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.487 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.487 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.487 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_grafana": { 2024-09-19T06:09:56.487 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_grafana", 2024-09-19T06:09:56.487 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.487 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.487 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.487 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T06:09:56.487 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.487 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.487 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.487 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-09-19T06:09:56.487 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.487 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.488 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.488 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.488 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_haproxy": { 2024-09-19T06:09:56.488 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_haproxy", 2024-09-19T06:09:56.488 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.488 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.488 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.488 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T06:09:56.488 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.488 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.488 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.488 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "HAproxy container image", 2024-09-19T06:09:56.488 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.489 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.489 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.489 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.489 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_jaeger_agent": { 2024-09-19T06:09:56.489 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_jaeger_agent", 2024-09-19T06:09:56.489 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.489 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.489 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.489 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T06:09:56.489 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.489 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.489 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.489 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Jaeger agent container image", 2024-09-19T06:09:56.490 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.490 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.490 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.490 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.490 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_jaeger_collector": { 2024-09-19T06:09:56.490 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_jaeger_collector", 2024-09-19T06:09:56.490 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.490 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.490 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.490 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T06:09:56.490 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.490 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.490 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.490 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Jaeger collector container image", 2024-09-19T06:09:56.490 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.491 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.491 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.491 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.491 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_jaeger_query": { 2024-09-19T06:09:56.491 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_jaeger_query", 2024-09-19T06:09:56.491 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.491 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.491 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.491 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T06:09:56.491 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.491 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.491 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.491 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Jaeger query container image", 2024-09-19T06:09:56.491 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.491 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.492 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.492 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.492 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_keepalived": { 2024-09-19T06:09:56.492 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_keepalived", 2024-09-19T06:09:56.492 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.492 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.492 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.492 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T06:09:56.492 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.492 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.492 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.492 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Keepalived container image", 2024-09-19T06:09:56.492 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.492 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.492 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.493 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.493 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_loki": { 2024-09-19T06:09:56.493 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_loki", 2024-09-19T06:09:56.493 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.493 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.493 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.493 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T06:09:56.493 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.493 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.493 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.493 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Loki container image", 2024-09-19T06:09:56.493 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.493 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.493 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.494 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.494 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_node_exporter": { 2024-09-19T06:09:56.494 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_node_exporter", 2024-09-19T06:09:56.494 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.494 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.494 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.494 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T06:09:56.494 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.494 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.494 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.494 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-09-19T06:09:56.494 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.494 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.494 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.495 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.495 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_nvmeof": { 2024-09-19T06:09:56.495 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_nvmeof", 2024-09-19T06:09:56.495 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.495 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.495 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.495 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T06:09:56.495 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.495 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.495 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.495 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Nvme-of container image", 2024-09-19T06:09:56.495 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.495 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.495 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.496 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.496 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_prometheus": { 2024-09-19T06:09:56.496 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_prometheus", 2024-09-19T06:09:56.496 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.496 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.496 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.496 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T06:09:56.496 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.496 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.496 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.496 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-09-19T06:09:56.496 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.496 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.496 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.497 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.497 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_promtail": { 2024-09-19T06:09:56.497 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_promtail", 2024-09-19T06:09:56.497 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.497 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.497 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.497 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T06:09:56.497 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.497 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.497 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.497 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Promtail container image", 2024-09-19T06:09:56.497 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.497 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.498 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.498 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.498 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_samba": { 2024-09-19T06:09:56.498 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_samba", 2024-09-19T06:09:56.498 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.498 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.498 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.498 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T06:09:56.498 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.498 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.498 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.498 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Samba/SMB container image", 2024-09-19T06:09:56.498 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.499 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.499 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.499 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.499 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_snmp_gateway": { 2024-09-19T06:09:56.499 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_snmp_gateway", 2024-09-19T06:09:56.499 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.499 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.499 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.499 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T06:09:56.499 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.499 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.499 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.499 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SNMP Gateway container image", 2024-09-19T06:09:56.499 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.500 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.500 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.500 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.500 INFO:teuthology.orchestra.run.smithi037.stdout: "container_init": { 2024-09-19T06:09:56.500 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_init", 2024-09-19T06:09:56.500 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.500 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.500 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.500 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.500 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.500 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.500 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.500 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T06:09:56.500 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.501 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.501 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.501 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.501 INFO:teuthology.orchestra.run.smithi037.stdout: "daemon_cache_timeout": { 2024-09-19T06:09:56.501 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "daemon_cache_timeout", 2024-09-19T06:09:56.501 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-19T06:09:56.501 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.501 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.501 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-09-19T06:09:56.501 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.501 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.501 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.501 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T06:09:56.502 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.502 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.502 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.502 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.502 INFO:teuthology.orchestra.run.smithi037.stdout: "default_cephadm_command_timeout": { 2024-09-19T06:09:56.502 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T06:09:56.502 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.502 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.502 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.502 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "900", 2024-09-19T06:09:56.502 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.502 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.502 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.502 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T06:09:56.503 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.503 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.503 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.503 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.503 INFO:teuthology.orchestra.run.smithi037.stdout: "default_registry": { 2024-09-19T06:09:56.503 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "default_registry", 2024-09-19T06:09:56.503 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.503 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.503 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.503 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io", 2024-09-19T06:09:56.503 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.503 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.503 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.503 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T06:09:56.504 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.504 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.504 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.504 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.504 INFO:teuthology.orchestra.run.smithi037.stdout: "device_cache_timeout": { 2024-09-19T06:09:56.504 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "device_cache_timeout", 2024-09-19T06:09:56.504 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-19T06:09:56.504 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.504 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.504 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "1800", 2024-09-19T06:09:56.504 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.504 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.504 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.504 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "seconds to cache device inventory", 2024-09-19T06:09:56.505 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.505 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.505 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.505 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.505 INFO:teuthology.orchestra.run.smithi037.stdout: "device_enhanced_scan": { 2024-09-19T06:09:56.505 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "device_enhanced_scan", 2024-09-19T06:09:56.505 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.505 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.505 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.505 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.505 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.505 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.505 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.505 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T06:09:56.506 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.506 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.506 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.506 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.506 INFO:teuthology.orchestra.run.smithi037.stdout: "facts_cache_timeout": { 2024-09-19T06:09:56.506 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "facts_cache_timeout", 2024-09-19T06:09:56.506 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-19T06:09:56.506 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.506 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.506 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-09-19T06:09:56.506 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.506 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.506 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.507 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "seconds to cache host facts data", 2024-09-19T06:09:56.507 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.507 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.507 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.507 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.507 INFO:teuthology.orchestra.run.smithi037.stdout: "grafana_dashboards_path": { 2024-09-19T06:09:56.507 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "grafana_dashboards_path", 2024-09-19T06:09:56.507 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.507 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.507 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.507 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T06:09:56.507 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.507 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.507 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.508 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T06:09:56.508 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.508 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.508 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.508 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.508 INFO:teuthology.orchestra.run.smithi037.stdout: "host_check_interval": { 2024-09-19T06:09:56.508 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "host_check_interval", 2024-09-19T06:09:56.508 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-19T06:09:56.508 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.508 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.508 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-09-19T06:09:56.508 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.508 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.509 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.509 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to perform a host check", 2024-09-19T06:09:56.509 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.509 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.509 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.509 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.509 INFO:teuthology.orchestra.run.smithi037.stdout: "hw_monitoring": { 2024-09-19T06:09:56.509 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "hw_monitoring", 2024-09-19T06:09:56.509 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.509 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.509 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.509 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.509 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.509 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.510 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.510 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T06:09:56.510 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.510 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.510 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.510 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.510 INFO:teuthology.orchestra.run.smithi037.stdout: "inventory_list_all": { 2024-09-19T06:09:56.510 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "inventory_list_all", 2024-09-19T06:09:56.510 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.510 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.510 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.510 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.510 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.510 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.511 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.511 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T06:09:56.511 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.511 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.511 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.511 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.511 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:56.511 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:56.511 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.511 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.511 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.511 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.511 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.511 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.512 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.512 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.512 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.512 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.512 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.512 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.512 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.512 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.512 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.512 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.512 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.512 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.512 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.513 INFO:teuthology.orchestra.run.smithi037.stdout: "log_refresh_metadata": { 2024-09-19T06:09:56.513 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_refresh_metadata", 2024-09-19T06:09:56.513 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.513 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.513 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.513 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.513 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.513 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.513 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.513 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T06:09:56.513 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.513 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.513 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.514 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.514 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:56.514 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:56.514 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.514 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.514 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.514 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.514 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.514 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.514 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.514 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T06:09:56.514 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.514 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.514 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.515 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.515 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:56.515 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:56.515 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.515 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.515 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.515 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:56.515 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.515 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.515 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.515 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.515 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.515 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.515 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.516 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.516 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.516 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.516 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.516 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.516 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.516 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.516 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.516 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:56.516 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:56.516 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.516 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.516 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.516 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.517 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.517 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.517 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.517 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.517 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.517 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.517 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.517 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.517 INFO:teuthology.orchestra.run.smithi037.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T06:09:56.517 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T06:09:56.517 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.517 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.517 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.517 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.517 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.518 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.518 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.518 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T06:09:56.518 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.518 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.518 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.518 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.518 INFO:teuthology.orchestra.run.smithi037.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T06:09:56.518 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T06:09:56.518 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.518 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.518 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.518 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "*", 2024-09-19T06:09:56.518 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.518 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.519 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.519 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T06:09:56.519 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.519 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.519 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.519 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.519 INFO:teuthology.orchestra.run.smithi037.stdout: "max_count_per_host": { 2024-09-19T06:09:56.519 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_count_per_host", 2024-09-19T06:09:56.519 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.519 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.519 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.519 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-19T06:09:56.519 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.519 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.520 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.520 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "max number of daemons per service per host", 2024-09-19T06:09:56.520 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.520 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.520 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.520 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.520 INFO:teuthology.orchestra.run.smithi037.stdout: "max_osd_draining_count": { 2024-09-19T06:09:56.520 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_osd_draining_count", 2024-09-19T06:09:56.520 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.520 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.520 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.520 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-19T06:09:56.520 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.520 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.520 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.521 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T06:09:56.521 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.521 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.521 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.521 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.521 INFO:teuthology.orchestra.run.smithi037.stdout: "migration_current": { 2024-09-19T06:09:56.521 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "migration_current", 2024-09-19T06:09:56.521 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.521 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.521 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.521 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.521 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.521 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.521 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.522 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "internal - do not modify", 2024-09-19T06:09:56.522 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.522 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.522 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.522 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.522 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": { 2024-09-19T06:09:56.522 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mode", 2024-09-19T06:09:56.522 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.522 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.522 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.522 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "root", 2024-09-19T06:09:56.522 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.522 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.523 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.523 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm-package", 2024-09-19T06:09:56.523 INFO:teuthology.orchestra.run.smithi037.stdout: "root" 2024-09-19T06:09:56.523 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.523 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T06:09:56.523 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.523 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.523 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.523 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.523 INFO:teuthology.orchestra.run.smithi037.stdout: "oob_default_addr": { 2024-09-19T06:09:56.523 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "oob_default_addr", 2024-09-19T06:09:56.523 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.523 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.524 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.524 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "169.254.1.1", 2024-09-19T06:09:56.524 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.524 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.524 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.524 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T06:09:56.524 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.524 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.524 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.524 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.524 INFO:teuthology.orchestra.run.smithi037.stdout: "prometheus_alerts_path": { 2024-09-19T06:09:56.524 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "prometheus_alerts_path", 2024-09-19T06:09:56.524 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.524 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.525 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.525 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T06:09:56.525 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.525 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.525 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.525 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T06:09:56.525 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.525 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.525 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.525 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.525 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_insecure": { 2024-09-19T06:09:56.525 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_insecure", 2024-09-19T06:09:56.525 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.526 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.526 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.526 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.526 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.526 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.526 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.526 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T06:09:56.526 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.526 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.526 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.526 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.526 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_password": { 2024-09-19T06:09:56.526 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_password", 2024-09-19T06:09:56.526 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.527 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.527 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.527 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.527 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.527 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.527 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.527 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T06:09:56.527 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.527 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.527 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.527 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.527 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_url": { 2024-09-19T06:09:56.527 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_url", 2024-09-19T06:09:56.527 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.528 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.528 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.528 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.528 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.528 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.528 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.528 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T06:09:56.528 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.528 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.528 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.528 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.528 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_username": { 2024-09-19T06:09:56.528 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_username", 2024-09-19T06:09:56.529 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.529 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.529 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.529 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.529 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.529 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.529 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.529 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T06:09:56.529 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.529 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.529 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.529 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.529 INFO:teuthology.orchestra.run.smithi037.stdout: "secure_monitoring_stack": { 2024-09-19T06:09:56.529 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "secure_monitoring_stack", 2024-09-19T06:09:56.530 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.530 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.530 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.530 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.530 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.530 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.530 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.530 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T06:09:56.530 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.530 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.530 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.530 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.530 INFO:teuthology.orchestra.run.smithi037.stdout: "service_discovery_port": { 2024-09-19T06:09:56.530 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "service_discovery_port", 2024-09-19T06:09:56.530 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.531 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.531 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.531 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8765", 2024-09-19T06:09:56.531 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.531 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.531 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.531 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "cephadm service discovery port", 2024-09-19T06:09:56.531 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.531 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.531 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.531 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.531 INFO:teuthology.orchestra.run.smithi037.stdout: "ssh_config_file": { 2024-09-19T06:09:56.531 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssh_config_file", 2024-09-19T06:09:56.531 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.531 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.532 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.532 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.532 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.532 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.532 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.532 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T06:09:56.532 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.532 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.532 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.532 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.532 INFO:teuthology.orchestra.run.smithi037.stdout: "use_agent": { 2024-09-19T06:09:56.532 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "use_agent", 2024-09-19T06:09:56.532 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.532 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.533 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.533 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.533 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.533 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.533 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.533 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T06:09:56.533 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.533 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.533 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.533 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.533 INFO:teuthology.orchestra.run.smithi037.stdout: "use_repo_digest": { 2024-09-19T06:09:56.533 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "use_repo_digest", 2024-09-19T06:09:56.533 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.533 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.534 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.534 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.534 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.534 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.534 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.534 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T06:09:56.534 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.534 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.534 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.534 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.534 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_on_failed_host_check": { 2024-09-19T06:09:56.534 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_on_failed_host_check", 2024-09-19T06:09:56.534 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.535 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.535 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.535 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.535 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.535 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.535 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.535 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T06:09:56.535 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.535 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.535 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.535 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.535 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_on_stray_daemons": { 2024-09-19T06:09:56.535 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_on_stray_daemons", 2024-09-19T06:09:56.535 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.535 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.536 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.536 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.536 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.536 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.536 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.536 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T06:09:56.536 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.536 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.536 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.536 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.536 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_on_stray_hosts": { 2024-09-19T06:09:56.536 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_on_stray_hosts", 2024-09-19T06:09:56.536 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.536 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.537 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.537 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.537 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.537 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.537 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.537 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T06:09:56.537 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.537 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.537 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.537 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.537 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.537 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.537 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.537 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crash", 2024-09-19T06:09:56.538 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:56.538 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:56.538 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:56.538 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:56.538 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:56.538 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.538 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.538 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.538 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.538 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.538 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.538 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.538 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.538 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.539 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.539 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.539 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.539 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.539 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.539 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.539 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.539 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.539 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.539 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.539 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:56.539 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:56.539 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.539 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.539 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.540 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.540 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.540 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.540 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.540 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.540 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.540 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.540 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.540 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.540 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:56.540 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:56.540 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.540 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.541 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.541 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:56.541 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.541 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.541 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.541 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.541 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.541 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.541 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.541 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.541 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.541 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.541 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.541 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.541 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.542 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.542 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.542 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:56.542 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:56.542 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.542 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.542 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.544 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.544 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.544 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.544 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.544 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.544 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.544 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.544 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.544 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.544 INFO:teuthology.orchestra.run.smithi037.stdout: "retain_interval": { 2024-09-19T06:09:56.544 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "retain_interval", 2024-09-19T06:09:56.544 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-19T06:09:56.544 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.545 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.545 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "31536000", 2024-09-19T06:09:56.545 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.545 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.545 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.545 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T06:09:56.545 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.545 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.545 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.545 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.545 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_recent_interval": { 2024-09-19T06:09:56.545 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_recent_interval", 2024-09-19T06:09:56.545 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-19T06:09:56.546 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.546 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.546 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "1209600", 2024-09-19T06:09:56.546 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.546 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.546 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.546 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T06:09:56.546 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.546 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.546 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.546 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.546 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.546 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.547 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.547 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "dashboard", 2024-09-19T06:09:56.547 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:56.547 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:56.547 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:56.547 INFO:teuthology.orchestra.run.smithi037.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T06:09:56.547 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T06:09:56.547 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.547 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.547 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.547 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-19T06:09:56.547 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.547 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.548 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.548 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.548 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.548 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.548 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.548 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.548 INFO:teuthology.orchestra.run.smithi037.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T06:09:56.548 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T06:09:56.548 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.548 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.548 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.548 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.548 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.548 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.548 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.549 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.549 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.549 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.549 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.549 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.549 INFO:teuthology.orchestra.run.smithi037.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T06:09:56.549 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T06:09:56.549 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.549 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.549 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.549 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.549 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.549 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.550 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.550 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.550 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.550 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.550 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.550 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.550 INFO:teuthology.orchestra.run.smithi037.stdout: "AUDIT_API_ENABLED": { 2024-09-19T06:09:56.550 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T06:09:56.550 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.550 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.550 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.550 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.550 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.551 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.551 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.551 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.551 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.551 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.551 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.551 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.551 INFO:teuthology.orchestra.run.smithi037.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T06:09:56.551 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T06:09:56.551 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.551 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.551 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.551 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.551 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.552 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.552 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.552 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.552 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.552 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.552 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.552 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.552 INFO:teuthology.orchestra.run.smithi037.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T06:09:56.552 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T06:09:56.552 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.552 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.552 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.552 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.553 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.553 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.553 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.553 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.553 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.553 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.553 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.553 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.553 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T06:09:56.553 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T06:09:56.553 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.553 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.553 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.554 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.554 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.554 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.554 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.554 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.554 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.554 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.554 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.554 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.554 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T06:09:56.554 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T06:09:56.554 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.554 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.555 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.555 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.555 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.555 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.555 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.555 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.555 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.555 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.555 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.555 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.555 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T06:09:56.555 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T06:09:56.555 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.555 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.556 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.556 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.556 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.556 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.556 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.556 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.556 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.556 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.556 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.556 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.556 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T06:09:56.556 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T06:09:56.556 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.556 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.556 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.557 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.557 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.557 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.557 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.557 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.557 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.557 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.557 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.557 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.557 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T06:09:56.557 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T06:09:56.557 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.557 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.557 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.558 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.558 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.558 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.558 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.558 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.558 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.558 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.558 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.558 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.558 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T06:09:56.558 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T06:09:56.558 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.558 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.558 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.558 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.558 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.559 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.559 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.559 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.559 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.559 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.559 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.559 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.559 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T06:09:56.559 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T06:09:56.559 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.559 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.559 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.559 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.559 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.559 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.559 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.560 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.560 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.560 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.560 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.560 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.560 INFO:teuthology.orchestra.run.smithi037.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T06:09:56.560 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T06:09:56.560 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.560 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.560 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.560 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.560 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.560 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.560 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.560 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.561 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.561 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.561 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.561 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.561 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T06:09:56.561 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T06:09:56.561 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.561 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.561 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.561 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "admin", 2024-09-19T06:09:56.561 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.561 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.561 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.562 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.562 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.562 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.562 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.562 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.562 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T06:09:56.562 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T06:09:56.562 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.562 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.562 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.562 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.562 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.562 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.562 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.562 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.563 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.563 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.563 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.563 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.563 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_URL": { 2024-09-19T06:09:56.563 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_URL", 2024-09-19T06:09:56.563 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.563 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.563 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.563 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.563 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.563 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.563 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.563 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.563 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.564 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.564 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.564 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.564 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T06:09:56.564 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T06:09:56.564 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.564 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.564 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.564 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "admin", 2024-09-19T06:09:56.564 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.564 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.564 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.564 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.565 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.565 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.565 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.565 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.565 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T06:09:56.565 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T06:09:56.565 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.565 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.565 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.565 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.565 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.565 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.565 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.565 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.566 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.566 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.566 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.566 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.566 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T06:09:56.566 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T06:09:56.566 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.566 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.566 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.566 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.566 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.566 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.566 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.567 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.567 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.567 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.567 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.567 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.567 INFO:teuthology.orchestra.run.smithi037.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T06:09:56.567 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T06:09:56.567 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.567 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.567 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.567 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.567 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.567 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.567 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.567 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.568 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.568 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.568 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.568 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.568 INFO:teuthology.orchestra.run.smithi037.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T06:09:56.568 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T06:09:56.568 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.568 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.568 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.568 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.568 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.568 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.568 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.568 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.569 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.569 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.569 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.569 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.569 INFO:teuthology.orchestra.run.smithi037.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T06:09:56.569 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T06:09:56.569 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.569 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.569 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.569 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.569 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.569 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.569 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.569 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.570 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.570 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.570 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.570 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.570 INFO:teuthology.orchestra.run.smithi037.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T06:09:56.570 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T06:09:56.570 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.570 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.570 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.570 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.570 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.570 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.570 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.570 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.570 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.571 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.571 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.571 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.571 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T06:09:56.571 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T06:09:56.571 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.571 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.571 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.571 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.571 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.571 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.571 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.571 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.571 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.572 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.572 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.572 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.572 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T06:09:56.572 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T06:09:56.572 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.572 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.572 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.572 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.572 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.572 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.572 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.572 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.572 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.573 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.573 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.573 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.573 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T06:09:56.573 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T06:09:56.573 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.573 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.573 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.573 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.573 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.573 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.573 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.573 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.573 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.574 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.574 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.574 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.574 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T06:09:56.574 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T06:09:56.574 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.574 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.574 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.574 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.574 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.574 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.574 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.574 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.575 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.575 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.575 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.575 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.575 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T06:09:56.575 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T06:09:56.575 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.575 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.575 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.575 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.575 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.575 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.575 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.575 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.575 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.576 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.576 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.576 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.576 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T06:09:56.576 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T06:09:56.576 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.576 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.576 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.576 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.576 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.576 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.576 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.576 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.577 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.577 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.577 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.577 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.577 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T06:09:56.577 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T06:09:56.577 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.577 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.577 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.577 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.577 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.577 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.577 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.577 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.578 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.578 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.578 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.578 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.578 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T06:09:56.578 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T06:09:56.578 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.578 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.578 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.578 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.578 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.578 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.578 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.578 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.579 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.579 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.579 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.579 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.579 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T06:09:56.579 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T06:09:56.579 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.579 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.579 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.579 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T06:09:56.579 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.579 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.579 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.579 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.580 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.580 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.580 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.580 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.580 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T06:09:56.580 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T06:09:56.580 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.580 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.580 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.580 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-19T06:09:56.580 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.580 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.580 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.580 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.581 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.581 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.581 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.581 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.581 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T06:09:56.581 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T06:09:56.581 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.581 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.581 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.581 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8", 2024-09-19T06:09:56.581 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.581 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.581 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.581 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.582 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.582 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.582 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.582 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.582 INFO:teuthology.orchestra.run.smithi037.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T06:09:56.582 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T06:09:56.582 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.582 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.582 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.582 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "45", 2024-09-19T06:09:56.582 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.582 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.582 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.583 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.583 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.583 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.583 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.583 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.583 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T06:09:56.583 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T06:09:56.583 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.583 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.583 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.583 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.583 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.583 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.583 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.584 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.584 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.584 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.584 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.584 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.584 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T06:09:56.584 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T06:09:56.584 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.584 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.584 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.584 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "admin", 2024-09-19T06:09:56.584 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.584 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.585 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.585 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.585 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.585 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.585 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.585 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.585 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T06:09:56.585 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T06:09:56.585 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.585 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.585 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.585 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.585 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.586 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.586 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.586 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.586 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.586 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.586 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.586 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.586 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T06:09:56.586 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T06:09:56.586 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.586 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.586 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.586 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.586 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.586 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.587 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.587 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.587 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.587 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.587 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.587 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.587 INFO:teuthology.orchestra.run.smithi037.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T06:09:56.587 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T06:09:56.587 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.587 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.587 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.587 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-19T06:09:56.587 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.587 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.588 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.588 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.588 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.588 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.588 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.588 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.588 INFO:teuthology.orchestra.run.smithi037.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T06:09:56.588 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T06:09:56.588 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.588 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.588 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.588 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-19T06:09:56.588 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.589 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.589 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.589 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.589 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.589 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.589 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.589 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.589 INFO:teuthology.orchestra.run.smithi037.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T06:09:56.589 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T06:09:56.589 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.589 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.589 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.589 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-09-19T06:09:56.589 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.590 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.590 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.590 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.590 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.590 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.590 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.590 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.590 INFO:teuthology.orchestra.run.smithi037.stdout: "cross_origin_url": { 2024-09-19T06:09:56.590 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cross_origin_url", 2024-09-19T06:09:56.590 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.590 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.590 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.590 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.591 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.591 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.591 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.591 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.591 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.591 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.591 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.591 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.591 INFO:teuthology.orchestra.run.smithi037.stdout: "crt_file": { 2024-09-19T06:09:56.591 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crt_file", 2024-09-19T06:09:56.591 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.591 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.591 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.591 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.591 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.591 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.592 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.592 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.592 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.592 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.592 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.592 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.592 INFO:teuthology.orchestra.run.smithi037.stdout: "debug": { 2024-09-19T06:09:56.592 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "debug", 2024-09-19T06:09:56.592 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.592 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.592 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.592 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.592 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.592 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.592 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.593 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Enable/disable debug options", 2024-09-19T06:09:56.593 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.593 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.593 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.593 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.593 INFO:teuthology.orchestra.run.smithi037.stdout: "jwt_token_ttl": { 2024-09-19T06:09:56.593 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "jwt_token_ttl", 2024-09-19T06:09:56.593 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.593 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.593 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.593 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "28800", 2024-09-19T06:09:56.593 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.594 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.594 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.594 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.594 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.594 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.594 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.594 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.594 INFO:teuthology.orchestra.run.smithi037.stdout: "key_file": { 2024-09-19T06:09:56.594 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "key_file", 2024-09-19T06:09:56.594 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.594 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.594 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.594 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.594 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.595 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.595 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.595 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.595 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.595 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.595 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.595 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.595 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:56.595 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:56.595 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.595 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.595 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.595 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.596 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.596 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.596 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.596 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.596 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.596 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.596 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.596 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.596 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.596 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.596 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.596 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.596 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.596 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.597 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.597 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:56.597 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:56.597 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.597 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.597 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.597 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.597 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.597 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.597 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.597 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.597 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.597 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.598 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.598 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.598 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:56.598 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:56.598 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.598 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.598 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.598 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:56.598 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.598 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.598 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.598 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.598 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.599 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.599 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.599 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.599 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.599 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.599 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.599 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.599 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.599 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.599 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.599 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:56.599 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:56.599 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.599 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.600 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.600 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.600 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.600 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.600 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.600 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.600 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.600 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.600 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.600 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.600 INFO:teuthology.orchestra.run.smithi037.stdout: "motd": { 2024-09-19T06:09:56.600 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "motd", 2024-09-19T06:09:56.600 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.600 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.601 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.601 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.601 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.601 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.601 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.601 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "The message of the day", 2024-09-19T06:09:56.601 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.601 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.601 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.601 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.601 INFO:teuthology.orchestra.run.smithi037.stdout: "redirect_resolve_ip_addr": { 2024-09-19T06:09:56.601 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T06:09:56.601 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.602 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.602 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.602 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.602 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.602 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.602 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.602 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.602 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.602 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.602 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.602 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.602 INFO:teuthology.orchestra.run.smithi037.stdout: "server_addr": { 2024-09-19T06:09:56.602 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_addr", 2024-09-19T06:09:56.602 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.602 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.603 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.603 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "::", 2024-09-19T06:09:56.603 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.603 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.603 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.603 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.603 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.603 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.603 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.603 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.603 INFO:teuthology.orchestra.run.smithi037.stdout: "server_port": { 2024-09-19T06:09:56.603 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_port", 2024-09-19T06:09:56.603 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.603 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.604 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.604 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8080", 2024-09-19T06:09:56.604 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.604 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.604 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.604 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.604 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.604 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.604 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.604 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.604 INFO:teuthology.orchestra.run.smithi037.stdout: "ssl": { 2024-09-19T06:09:56.604 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssl", 2024-09-19T06:09:56.604 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.604 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.605 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.605 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.605 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.605 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.605 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.605 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.605 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.605 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.605 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.605 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.606 INFO:teuthology.orchestra.run.smithi037.stdout: "ssl_server_port": { 2024-09-19T06:09:56.606 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssl_server_port", 2024-09-19T06:09:56.606 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.606 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.606 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.606 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8443", 2024-09-19T06:09:56.606 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.606 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.606 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.606 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.606 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.606 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.606 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.606 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.607 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_behaviour": { 2024-09-19T06:09:56.607 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_behaviour", 2024-09-19T06:09:56.607 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.607 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.607 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.607 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "redirect", 2024-09-19T06:09:56.607 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.607 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.607 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.607 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.607 INFO:teuthology.orchestra.run.smithi037.stdout: "redirect" 2024-09-19T06:09:56.607 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.607 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.607 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.608 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.608 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.608 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.608 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_error_status_code": { 2024-09-19T06:09:56.608 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_error_status_code", 2024-09-19T06:09:56.608 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.608 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.608 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.608 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "500", 2024-09-19T06:09:56.608 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "400", 2024-09-19T06:09:56.608 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "599", 2024-09-19T06:09:56.608 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.608 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.609 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.609 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.609 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.609 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.609 INFO:teuthology.orchestra.run.smithi037.stdout: "url_prefix": { 2024-09-19T06:09:56.609 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "url_prefix", 2024-09-19T06:09:56.609 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.609 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.609 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.609 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.609 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.609 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.609 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.609 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.610 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.610 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.610 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.610 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.610 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.610 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.610 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.610 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "devicehealth", 2024-09-19T06:09:56.610 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:56.610 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:56.610 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:56.610 INFO:teuthology.orchestra.run.smithi037.stdout: "enable_monitoring": { 2024-09-19T06:09:56.610 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enable_monitoring", 2024-09-19T06:09:56.610 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.611 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.611 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.611 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.611 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.611 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.611 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.611 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "monitor device health metrics", 2024-09-19T06:09:56.611 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.611 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.611 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.611 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.611 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:56.611 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:56.611 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.612 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.612 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.612 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.612 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.612 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.612 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.612 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.612 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.612 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.612 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.612 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.612 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.612 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.613 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.613 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.613 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.613 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.613 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.613 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:56.613 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:56.613 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.613 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.613 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.613 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.613 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.613 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.614 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.614 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.614 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.614 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.614 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.614 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.614 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:56.614 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:56.614 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.614 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.614 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.614 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:56.615 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.615 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.615 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.615 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.615 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.615 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.615 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.615 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.615 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.615 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.615 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.615 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.615 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.615 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.616 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.616 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:56.616 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:56.616 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.616 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.616 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.616 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.616 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.616 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.616 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.616 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.616 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.616 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.616 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.617 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.617 INFO:teuthology.orchestra.run.smithi037.stdout: "mark_out_threshold": { 2024-09-19T06:09:56.617 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mark_out_threshold", 2024-09-19T06:09:56.617 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-19T06:09:56.617 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.617 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.617 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "2419200", 2024-09-19T06:09:56.617 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.617 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.617 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.617 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T06:09:56.617 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.617 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.617 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.618 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.618 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_name": { 2024-09-19T06:09:56.618 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pool_name", 2024-09-19T06:09:56.618 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.618 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.618 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.618 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "device_health_metrics", 2024-09-19T06:09:56.618 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.618 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.618 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.618 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T06:09:56.618 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.618 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.618 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.619 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.619 INFO:teuthology.orchestra.run.smithi037.stdout: "retention_period": { 2024-09-19T06:09:56.619 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "retention_period", 2024-09-19T06:09:56.619 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-19T06:09:56.619 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.619 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.619 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "15552000", 2024-09-19T06:09:56.619 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.619 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.619 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.619 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how long to retain device health metrics", 2024-09-19T06:09:56.619 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.619 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.619 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.620 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.620 INFO:teuthology.orchestra.run.smithi037.stdout: "scrape_frequency": { 2024-09-19T06:09:56.620 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "scrape_frequency", 2024-09-19T06:09:56.620 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-19T06:09:56.620 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.620 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.620 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "86400", 2024-09-19T06:09:56.620 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.620 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.620 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.620 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T06:09:56.620 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.620 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.621 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.621 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.621 INFO:teuthology.orchestra.run.smithi037.stdout: "self_heal": { 2024-09-19T06:09:56.621 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "self_heal", 2024-09-19T06:09:56.621 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.621 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.621 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.621 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.621 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.621 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.621 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.621 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T06:09:56.621 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.622 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.622 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.622 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.622 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-09-19T06:09:56.622 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-09-19T06:09:56.622 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-19T06:09:56.622 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.622 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.622 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-09-19T06:09:56.622 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.622 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.622 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.622 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T06:09:56.622 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.622 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.623 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.623 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.623 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_threshold": { 2024-09-19T06:09:56.623 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_threshold", 2024-09-19T06:09:56.623 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-19T06:09:56.623 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.623 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.623 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "7257600", 2024-09-19T06:09:56.623 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.623 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.623 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.623 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T06:09:56.623 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.623 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.623 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.624 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.624 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.624 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.624 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.624 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "diskprediction_local", 2024-09-19T06:09:56.624 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:56.624 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:56.624 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:56.624 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:56.624 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:56.624 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.624 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.624 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.624 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.625 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.625 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.625 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.625 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.625 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.625 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.625 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.625 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.625 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.625 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.625 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.625 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.625 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.625 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.626 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.626 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:56.626 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:56.626 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.626 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.626 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.626 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.626 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.626 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.626 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.626 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.626 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.626 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.626 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.627 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.627 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:56.627 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:56.627 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.627 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.627 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.627 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:56.627 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.627 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.627 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.628 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.628 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.628 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.628 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.628 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.628 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.628 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.628 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.628 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.628 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.628 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.628 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.628 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:56.628 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:56.629 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.629 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.629 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.629 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.629 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.629 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.629 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.629 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.629 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.629 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.629 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.629 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.629 INFO:teuthology.orchestra.run.smithi037.stdout: "predict_interval": { 2024-09-19T06:09:56.630 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "predict_interval", 2024-09-19T06:09:56.630 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.630 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.630 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.630 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "86400", 2024-09-19T06:09:56.630 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.630 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.630 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.630 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.630 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.630 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.630 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.630 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.631 INFO:teuthology.orchestra.run.smithi037.stdout: "predictor_model": { 2024-09-19T06:09:56.631 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "predictor_model", 2024-09-19T06:09:56.631 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.631 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.631 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.631 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "prophetstor", 2024-09-19T06:09:56.631 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.631 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.631 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.631 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.631 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.631 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.632 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.632 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.632 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-09-19T06:09:56.632 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-09-19T06:09:56.632 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.632 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.632 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.632 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-09-19T06:09:56.632 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.632 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.632 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.632 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.632 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.633 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.633 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.633 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.633 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.633 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.633 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.633 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "influx", 2024-09-19T06:09:56.633 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": false, 2024-09-19T06:09:56.633 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "influxdb python module not found", 2024-09-19T06:09:56.633 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:56.633 INFO:teuthology.orchestra.run.smithi037.stdout: "batch_size": { 2024-09-19T06:09:56.633 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "batch_size", 2024-09-19T06:09:56.634 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.634 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.634 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.634 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5000", 2024-09-19T06:09:56.634 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.634 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.634 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.634 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T06:09:56.634 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.634 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.634 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.634 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.634 INFO:teuthology.orchestra.run.smithi037.stdout: "database": { 2024-09-19T06:09:56.635 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "database", 2024-09-19T06:09:56.635 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.635 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.635 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.635 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "ceph", 2024-09-19T06:09:56.635 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.635 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.635 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.635 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T06:09:56.635 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.635 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.635 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.635 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.636 INFO:teuthology.orchestra.run.smithi037.stdout: "hostname": { 2024-09-19T06:09:56.636 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "hostname", 2024-09-19T06:09:56.636 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.636 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.636 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.636 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.636 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.636 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.636 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.636 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "InfluxDB server hostname", 2024-09-19T06:09:56.636 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.636 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.636 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.637 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.637 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-09-19T06:09:56.637 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-09-19T06:09:56.637 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-19T06:09:56.637 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.637 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.637 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "30", 2024-09-19T06:09:56.637 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "5", 2024-09-19T06:09:56.637 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.637 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.637 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T06:09:56.637 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.637 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.637 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.638 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.638 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:56.638 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:56.638 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.638 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.638 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.638 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.638 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.638 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.638 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.638 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.638 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.638 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.639 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.639 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.639 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.639 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.639 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.639 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.639 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.639 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.639 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.639 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:56.639 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:56.639 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.639 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.639 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.640 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.640 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.640 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.640 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.640 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.640 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.640 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.640 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.640 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.640 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:56.640 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:56.640 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.640 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.641 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.641 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:56.641 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.641 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.641 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.641 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.641 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.641 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.641 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.641 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.641 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.641 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.641 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.641 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.642 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.642 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.642 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.642 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:56.642 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:56.642 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.642 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.642 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.642 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.642 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.642 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.642 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.642 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.642 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.642 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.643 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.643 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.643 INFO:teuthology.orchestra.run.smithi037.stdout: "password": { 2024-09-19T06:09:56.643 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "password", 2024-09-19T06:09:56.643 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.643 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.643 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.643 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.643 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.643 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.643 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.643 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "password of InfluxDB server user", 2024-09-19T06:09:56.643 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.643 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.644 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.644 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.644 INFO:teuthology.orchestra.run.smithi037.stdout: "port": { 2024-09-19T06:09:56.644 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "port", 2024-09-19T06:09:56.644 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.644 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.644 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.644 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8086", 2024-09-19T06:09:56.644 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.644 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.644 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.644 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "InfluxDB server port", 2024-09-19T06:09:56.644 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.645 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.645 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.645 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.645 INFO:teuthology.orchestra.run.smithi037.stdout: "ssl": { 2024-09-19T06:09:56.645 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssl", 2024-09-19T06:09:56.645 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.645 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.645 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.645 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "false", 2024-09-19T06:09:56.645 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.645 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.645 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.645 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T06:09:56.646 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.646 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.646 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.646 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.646 INFO:teuthology.orchestra.run.smithi037.stdout: "threads": { 2024-09-19T06:09:56.646 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "threads", 2024-09-19T06:09:56.646 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.646 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.646 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.646 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-09-19T06:09:56.646 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-09-19T06:09:56.646 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "32", 2024-09-19T06:09:56.646 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.646 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T06:09:56.647 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.647 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.647 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.647 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.647 INFO:teuthology.orchestra.run.smithi037.stdout: "username": { 2024-09-19T06:09:56.647 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "username", 2024-09-19T06:09:56.647 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.647 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.647 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.647 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.647 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.647 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.647 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.648 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "username of InfluxDB server user", 2024-09-19T06:09:56.648 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.648 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.648 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.648 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.648 INFO:teuthology.orchestra.run.smithi037.stdout: "verify_ssl": { 2024-09-19T06:09:56.648 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "verify_ssl", 2024-09-19T06:09:56.648 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.648 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.648 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.648 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "true", 2024-09-19T06:09:56.648 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.648 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.648 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.649 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T06:09:56.649 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.649 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.649 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.649 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.649 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.649 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.649 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.649 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "insights", 2024-09-19T06:09:56.649 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:56.649 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:56.649 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:56.649 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:56.650 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:56.650 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.650 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.650 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.650 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.650 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.650 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.650 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.650 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.650 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.650 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.650 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.650 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.650 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.650 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.651 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.651 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.651 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.651 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.651 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.651 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:56.651 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:56.651 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.651 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.651 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.651 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.651 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.651 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.651 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.651 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.652 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.652 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.652 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.652 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.652 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:56.652 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:56.652 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.652 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.652 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.652 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:56.652 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.652 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.652 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.652 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.652 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.653 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.653 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.653 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.653 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.653 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.653 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.653 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.653 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.653 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.653 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.653 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:56.653 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:56.653 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.653 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.653 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.654 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.654 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.654 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.654 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.654 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.654 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.654 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.654 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.654 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.654 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.654 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.654 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.654 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "iostat", 2024-09-19T06:09:56.655 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:56.655 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:56.655 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:56.655 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:56.655 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:56.655 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.655 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.655 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.655 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.655 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.655 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.655 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.655 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.655 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.655 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.655 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.656 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.656 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.656 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.656 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.656 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.656 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.656 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.656 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.656 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:56.656 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:56.656 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.656 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.656 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.656 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.657 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.657 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.657 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.657 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.657 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.657 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.657 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.657 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.657 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:56.657 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:56.657 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.657 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.657 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.657 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:56.657 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.658 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.658 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.658 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.658 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.658 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.658 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.658 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.658 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.658 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.658 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.658 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.658 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.658 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.658 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.658 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:56.659 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:56.659 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.659 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.659 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.659 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.659 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.659 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.659 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.659 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.659 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.659 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.659 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.659 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.659 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.659 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.659 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.659 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "k8sevents", 2024-09-19T06:09:56.660 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:56.660 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:56.660 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:56.660 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_event_retention_days": { 2024-09-19T06:09:56.660 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ceph_event_retention_days", 2024-09-19T06:09:56.660 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.660 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.660 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.660 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "7", 2024-09-19T06:09:56.660 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.660 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.660 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.660 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T06:09:56.660 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.660 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.661 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.661 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.661 INFO:teuthology.orchestra.run.smithi037.stdout: "config_check_secs": { 2024-09-19T06:09:56.661 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "config_check_secs", 2024-09-19T06:09:56.661 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.661 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.661 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.661 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-19T06:09:56.661 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "10", 2024-09-19T06:09:56.661 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.661 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.661 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T06:09:56.661 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.661 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.662 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.662 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.662 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:56.662 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:56.662 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.662 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.662 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.662 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.662 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.662 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.662 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.662 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.662 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.662 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.662 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.662 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.663 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.663 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.663 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.663 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.663 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.663 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.663 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.663 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:56.663 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:56.663 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.663 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.663 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.663 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.663 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.664 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.664 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.664 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.664 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.664 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.664 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.664 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.664 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:56.664 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:56.664 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.664 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.664 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.664 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:56.664 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.664 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.665 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.665 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.665 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.665 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.665 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.665 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.665 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.665 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.665 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.665 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.665 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.665 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.665 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.665 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:56.666 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:56.666 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.666 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.666 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.666 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.666 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.666 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.666 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.666 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.666 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.666 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.666 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.666 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.666 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.666 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.666 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.667 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "localpool", 2024-09-19T06:09:56.667 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:56.667 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:56.667 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:56.667 INFO:teuthology.orchestra.run.smithi037.stdout: "failure_domain": { 2024-09-19T06:09:56.667 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "failure_domain", 2024-09-19T06:09:56.667 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.667 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.667 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.667 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "host", 2024-09-19T06:09:56.667 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.667 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.667 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.667 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "failure domain for any created local pool", 2024-09-19T06:09:56.668 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T06:09:56.668 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.668 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.668 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.668 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:56.668 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:56.668 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.668 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.668 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.668 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.668 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.668 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.668 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.669 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.669 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.669 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.669 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.669 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.669 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.669 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.669 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.669 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.669 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.669 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.669 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.669 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:56.670 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:56.670 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.670 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.670 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.670 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.670 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.670 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.670 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.670 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.670 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.670 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.670 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.670 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.670 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:56.671 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:56.671 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.671 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.671 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.671 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:56.671 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.671 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.671 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.671 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.671 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.671 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.671 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.671 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.671 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.672 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.672 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.672 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.672 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.672 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.672 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.672 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:56.672 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:56.672 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.672 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.672 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.672 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.672 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.672 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.673 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.673 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.673 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.673 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.673 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.673 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.673 INFO:teuthology.orchestra.run.smithi037.stdout: "min_size": { 2024-09-19T06:09:56.673 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "min_size", 2024-09-19T06:09:56.673 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.673 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.673 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.673 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.673 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.673 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.674 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.674 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "default min_size for any created local pool", 2024-09-19T06:09:56.674 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T06:09:56.674 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.674 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.674 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.674 INFO:teuthology.orchestra.run.smithi037.stdout: "num_rep": { 2024-09-19T06:09:56.674 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "num_rep", 2024-09-19T06:09:56.674 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.674 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.674 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.674 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "3", 2024-09-19T06:09:56.674 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.675 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.675 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.675 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "default replica count for any created local pool", 2024-09-19T06:09:56.675 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.675 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.675 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.675 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.675 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num": { 2024-09-19T06:09:56.675 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pg_num", 2024-09-19T06:09:56.675 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.675 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.675 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.675 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "128", 2024-09-19T06:09:56.675 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.675 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.676 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.676 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T06:09:56.676 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.676 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.676 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.676 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.676 INFO:teuthology.orchestra.run.smithi037.stdout: "prefix": { 2024-09-19T06:09:56.676 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "prefix", 2024-09-19T06:09:56.676 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.676 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.676 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.676 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.676 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.676 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.676 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.677 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "name prefix for any created local pool", 2024-09-19T06:09:56.677 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.677 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.677 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.677 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.677 INFO:teuthology.orchestra.run.smithi037.stdout: "subtree": { 2024-09-19T06:09:56.677 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "subtree", 2024-09-19T06:09:56.677 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.677 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.677 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.677 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "rack", 2024-09-19T06:09:56.677 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.677 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.678 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.678 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T06:09:56.678 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T06:09:56.678 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.678 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.678 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.678 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.678 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.678 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.678 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mds_autoscaler", 2024-09-19T06:09:56.678 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:56.678 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:56.678 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:56.678 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:56.679 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:56.679 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.679 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.679 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.679 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.679 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.679 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.679 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.679 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.679 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.679 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.679 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.679 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.679 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.679 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.680 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.680 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.680 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.680 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.680 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.680 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:56.680 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:56.680 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.680 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.680 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.680 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.680 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.680 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.681 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.681 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.681 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.681 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.681 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.681 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.681 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:56.681 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:56.681 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.681 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.681 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.681 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:56.681 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.681 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.682 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.682 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.682 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.682 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.682 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.682 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.682 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.682 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.682 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.682 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.682 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.682 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.682 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.683 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:56.683 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:56.683 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.683 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.683 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.683 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.683 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.683 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.683 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.683 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.683 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.683 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.683 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.683 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.684 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.684 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.684 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.684 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mirroring", 2024-09-19T06:09:56.684 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:56.684 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:56.684 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:56.684 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:56.684 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:56.684 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.684 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.684 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.684 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.685 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.685 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.685 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.685 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.685 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.685 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.685 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.685 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.685 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.685 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.685 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.685 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.685 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.685 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.686 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.686 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:56.686 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:56.686 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.686 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.686 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.686 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.686 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.686 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.686 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.686 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.686 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.686 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.686 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.687 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.687 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:56.687 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:56.687 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.687 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.687 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.687 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:56.687 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.687 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.687 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.687 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.687 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.687 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.687 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.688 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.688 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.688 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.688 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.688 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.688 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.688 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.688 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.688 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:56.688 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:56.688 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.688 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.688 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.688 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.688 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.689 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.689 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.689 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.689 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.689 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.689 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.689 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.689 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.689 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.689 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.689 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "nfs", 2024-09-19T06:09:56.689 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:56.689 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:56.689 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:56.690 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:56.690 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:56.690 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.690 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.690 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.690 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.690 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.690 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.690 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.690 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.690 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.690 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.690 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.690 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.690 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.691 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.691 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.691 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.691 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.691 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.691 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.691 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:56.691 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:56.691 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.691 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.691 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.691 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.691 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.692 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.692 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.692 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.692 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.692 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.692 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.692 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.692 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:56.692 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:56.692 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.692 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.692 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.692 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:56.693 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.693 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.693 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.693 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.693 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.693 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.693 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.693 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.693 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.693 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.693 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.693 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.693 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.693 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.694 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.694 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:56.694 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:56.694 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.694 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.694 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.694 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.694 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.694 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.694 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.694 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.694 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.694 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.694 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.695 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.695 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.695 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.695 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.695 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "orchestrator", 2024-09-19T06:09:56.695 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:56.695 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:56.695 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:56.695 INFO:teuthology.orchestra.run.smithi037.stdout: "fail_fs": { 2024-09-19T06:09:56.695 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "fail_fs", 2024-09-19T06:09:56.695 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.695 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.695 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.696 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.696 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.696 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.696 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.696 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T06:09:56.696 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.696 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.696 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.696 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.696 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:56.696 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:56.696 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.696 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.697 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.697 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.697 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.697 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.697 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.697 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.697 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.697 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.697 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.697 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.697 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.697 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.697 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.697 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.697 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.698 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.698 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.698 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:56.698 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:56.698 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.698 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.698 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.698 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.698 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.698 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.698 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.698 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.698 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.698 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.699 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.699 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.699 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:56.699 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:56.699 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.699 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.699 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.699 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:56.699 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.699 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.699 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.699 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.699 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.700 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.700 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.700 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.700 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.700 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.700 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.700 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.700 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.700 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.700 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.700 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:56.700 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:56.700 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.701 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.701 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.701 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.701 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.701 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.701 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.701 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.701 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.701 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.701 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.701 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.701 INFO:teuthology.orchestra.run.smithi037.stdout: "orchestrator": { 2024-09-19T06:09:56.701 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "orchestrator", 2024-09-19T06:09:56.702 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.702 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.702 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.702 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.702 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.702 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.702 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.702 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm", 2024-09-19T06:09:56.702 INFO:teuthology.orchestra.run.smithi037.stdout: "rook", 2024-09-19T06:09:56.702 INFO:teuthology.orchestra.run.smithi037.stdout: "test_orchestrator" 2024-09-19T06:09:56.702 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.702 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Orchestrator backend", 2024-09-19T06:09:56.702 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.702 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.702 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.703 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.703 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.703 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.703 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.703 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "osd_perf_query", 2024-09-19T06:09:56.703 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:56.703 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:56.703 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:56.703 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:56.703 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:56.703 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.703 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.703 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.703 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.704 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.704 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.704 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.704 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.704 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.704 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.704 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.704 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.704 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.704 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.704 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.704 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.704 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.704 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.705 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.705 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:56.705 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:56.705 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.705 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.705 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.705 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.705 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.705 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.705 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.705 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.705 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.705 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.706 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.706 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.706 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:56.706 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:56.706 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.706 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.706 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.706 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:56.706 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.706 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.706 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.706 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.706 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.706 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.706 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.706 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.707 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.707 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.707 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.707 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.707 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.707 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.707 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.707 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:56.707 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:56.707 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.707 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.707 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.707 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.707 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.708 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.708 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.708 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.708 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.708 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.708 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.708 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.708 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.708 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.708 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.708 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "osd_support", 2024-09-19T06:09:56.708 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:56.708 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:56.708 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:56.709 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:56.709 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:56.709 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.709 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.709 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.709 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.709 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.709 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.709 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.709 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.709 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.709 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.709 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.709 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.710 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.710 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.710 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.710 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.710 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.710 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.710 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.710 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:56.710 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:56.710 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.710 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.710 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.710 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.710 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.711 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.711 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.711 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.711 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.711 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.711 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.711 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.711 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:56.711 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:56.711 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.711 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.711 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.711 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:56.711 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.711 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.712 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.712 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.712 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.712 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.712 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.712 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.712 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.712 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.712 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.712 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.712 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.712 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.712 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.713 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:56.713 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:56.713 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.713 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.713 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.713 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.713 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.713 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.713 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.713 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.713 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.713 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.714 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.714 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.714 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.714 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.714 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.714 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pg_autoscaler", 2024-09-19T06:09:56.714 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:56.714 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:56.714 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:56.714 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:56.714 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:56.714 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.714 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.714 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.715 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.715 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.715 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.715 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.715 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.715 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.715 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.715 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.715 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.715 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.715 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.715 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.715 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.715 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.715 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.716 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.716 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:56.716 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:56.716 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.716 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.716 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.716 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.716 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.716 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.716 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.716 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.716 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.716 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.716 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.717 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.717 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:56.717 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:56.717 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.717 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.717 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.717 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:56.717 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.717 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.717 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.717 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.717 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.717 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.718 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.718 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.718 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.718 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.718 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.718 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.718 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.718 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.718 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.718 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:56.718 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:56.718 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.718 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.718 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.719 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.719 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.719 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.719 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.719 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.719 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.719 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.719 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.719 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.719 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-09-19T06:09:56.719 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-09-19T06:09:56.719 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-19T06:09:56.719 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.720 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.720 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-09-19T06:09:56.720 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.720 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.720 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.720 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.720 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.720 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.720 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.720 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.720 INFO:teuthology.orchestra.run.smithi037.stdout: "threshold": { 2024-09-19T06:09:56.720 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "threshold", 2024-09-19T06:09:56.720 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-19T06:09:56.721 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.721 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.721 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "3.0", 2024-09-19T06:09:56.721 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1.0", 2024-09-19T06:09:56.721 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.721 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.721 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "scaling threshold", 2024-09-19T06:09:56.721 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T06:09:56.721 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.721 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.721 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.721 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.721 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.721 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.721 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "progress", 2024-09-19T06:09:56.722 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:56.722 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:56.722 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:56.722 INFO:teuthology.orchestra.run.smithi037.stdout: "allow_pg_recovery_event": { 2024-09-19T06:09:56.722 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "allow_pg_recovery_event", 2024-09-19T06:09:56.722 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.722 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.722 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.722 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.722 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.722 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.722 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.722 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T06:09:56.722 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.722 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.723 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.723 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.723 INFO:teuthology.orchestra.run.smithi037.stdout: "enabled": { 2024-09-19T06:09:56.723 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enabled", 2024-09-19T06:09:56.723 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.723 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.723 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.723 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.723 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.723 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.723 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.723 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.723 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.724 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.724 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.724 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.724 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:56.724 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:56.724 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.724 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.724 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.724 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.724 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.724 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.724 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.724 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.724 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.725 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.725 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.725 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.725 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.725 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.725 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.725 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.725 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.725 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.725 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.725 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:56.725 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:56.725 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.725 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.726 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.726 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.726 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.726 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.726 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.726 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.726 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.726 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.726 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.726 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.726 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:56.726 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:56.726 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.726 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.727 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.727 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:56.727 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.727 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.727 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.727 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.727 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.727 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.727 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.727 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.727 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.727 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.727 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.727 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.727 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.728 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.728 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.728 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:56.728 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:56.728 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.728 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.728 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.728 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.728 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.728 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.728 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.728 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.728 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.728 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.729 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.729 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.729 INFO:teuthology.orchestra.run.smithi037.stdout: "max_completed_events": { 2024-09-19T06:09:56.729 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_completed_events", 2024-09-19T06:09:56.729 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.729 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.729 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.729 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "50", 2024-09-19T06:09:56.729 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.729 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.729 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.729 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "number of past completed events to remember", 2024-09-19T06:09:56.729 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.729 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.730 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.730 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.730 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-09-19T06:09:56.730 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-09-19T06:09:56.730 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-19T06:09:56.730 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.730 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.730 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-09-19T06:09:56.730 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.730 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.730 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.730 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how long the module is going to sleep", 2024-09-19T06:09:56.730 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.731 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.731 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.731 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.731 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.731 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.731 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.731 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "prometheus", 2024-09-19T06:09:56.731 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:56.731 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:56.731 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:56.731 INFO:teuthology.orchestra.run.smithi037.stdout: "cache": { 2024-09-19T06:09:56.731 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cache", 2024-09-19T06:09:56.731 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.731 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.731 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.732 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.732 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.732 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.732 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.732 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.732 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.732 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.732 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.732 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.732 INFO:teuthology.orchestra.run.smithi037.stdout: "exclude_perf_counters": { 2024-09-19T06:09:56.732 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "exclude_perf_counters", 2024-09-19T06:09:56.732 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.732 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.733 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.733 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.733 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.733 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.733 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.733 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T06:09:56.733 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T06:09:56.733 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.733 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.733 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.733 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:56.733 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:56.733 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.733 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.734 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.734 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.734 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.734 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.734 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.734 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.734 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.734 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.734 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.734 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.734 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.734 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.734 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.734 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.735 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.735 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.735 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.735 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:56.735 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:56.735 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.735 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.735 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.735 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.735 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.735 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.735 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.735 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.736 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.736 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.736 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.736 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.736 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:56.736 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:56.736 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.736 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.736 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.736 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:56.736 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.736 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.736 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.737 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.737 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.737 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.737 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.737 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.737 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.737 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.737 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.737 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.737 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.737 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.737 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.737 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:56.737 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:56.738 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.738 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.738 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.738 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.738 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.738 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.738 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.738 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.738 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.738 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.738 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.738 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.738 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_stats_pools": { 2024-09-19T06:09:56.738 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rbd_stats_pools", 2024-09-19T06:09:56.739 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.739 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.739 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.739 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.739 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.739 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.739 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.739 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.739 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.739 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.739 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.739 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.739 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T06:09:56.739 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T06:09:56.740 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.740 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.740 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.740 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "300", 2024-09-19T06:09:56.740 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.740 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.740 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.740 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.740 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.740 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.740 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.740 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.740 INFO:teuthology.orchestra.run.smithi037.stdout: "scrape_interval": { 2024-09-19T06:09:56.740 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "scrape_interval", 2024-09-19T06:09:56.741 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-19T06:09:56.741 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.741 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.741 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "15.0", 2024-09-19T06:09:56.741 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.741 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.741 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.741 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.741 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.741 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.741 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.741 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.741 INFO:teuthology.orchestra.run.smithi037.stdout: "server_addr": { 2024-09-19T06:09:56.742 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_addr", 2024-09-19T06:09:56.742 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.742 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.742 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.742 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "::", 2024-09-19T06:09:56.742 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.742 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.742 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.742 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T06:09:56.742 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.742 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.742 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.742 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.742 INFO:teuthology.orchestra.run.smithi037.stdout: "server_port": { 2024-09-19T06:09:56.742 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_port", 2024-09-19T06:09:56.743 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.743 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.743 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.743 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "9283", 2024-09-19T06:09:56.743 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.743 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.743 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.743 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T06:09:56.743 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.743 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.743 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.743 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.743 INFO:teuthology.orchestra.run.smithi037.stdout: "stale_cache_strategy": { 2024-09-19T06:09:56.743 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "stale_cache_strategy", 2024-09-19T06:09:56.744 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.744 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.744 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.744 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "log", 2024-09-19T06:09:56.744 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.744 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.744 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.744 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.744 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.744 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.744 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.744 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.744 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_behaviour": { 2024-09-19T06:09:56.744 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_behaviour", 2024-09-19T06:09:56.745 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.745 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.745 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.745 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "default", 2024-09-19T06:09:56.745 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.745 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.745 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.745 INFO:teuthology.orchestra.run.smithi037.stdout: "default", 2024-09-19T06:09:56.745 INFO:teuthology.orchestra.run.smithi037.stdout: "error" 2024-09-19T06:09:56.745 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.745 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.745 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.745 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.746 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.746 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.746 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_error_status_code": { 2024-09-19T06:09:56.746 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_error_status_code", 2024-09-19T06:09:56.746 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.747 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.748 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.748 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "500", 2024-09-19T06:09:56.748 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "400", 2024-09-19T06:09:56.748 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "599", 2024-09-19T06:09:56.748 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.748 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.748 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.748 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.748 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.748 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.748 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.748 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.749 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.749 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rbd_support", 2024-09-19T06:09:56.749 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:56.749 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:56.749 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:56.749 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:56.749 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:56.749 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.749 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.749 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.749 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.749 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.749 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.749 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.750 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.750 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.750 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.750 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.750 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.750 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.750 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.750 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.750 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.750 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.750 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.750 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.750 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:56.750 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:56.751 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.751 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.751 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.751 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.751 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.751 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.751 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.751 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.751 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.751 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.751 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.751 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.751 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:56.751 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:56.752 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.752 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.752 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.752 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:56.752 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.752 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.752 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.752 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.752 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.752 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.752 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.752 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.752 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.753 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.753 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.753 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.753 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.753 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.753 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.753 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:56.753 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:56.753 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.753 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.753 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.753 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.753 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.754 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.754 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.754 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.754 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.754 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.754 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.754 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.754 INFO:teuthology.orchestra.run.smithi037.stdout: "max_concurrent_snap_create": { 2024-09-19T06:09:56.754 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_concurrent_snap_create", 2024-09-19T06:09:56.754 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.754 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.754 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.754 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-09-19T06:09:56.755 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.755 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.755 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.755 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.755 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.755 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.755 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.755 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.755 INFO:teuthology.orchestra.run.smithi037.stdout: "mirror_snapshot_schedule": { 2024-09-19T06:09:56.755 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T06:09:56.755 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.755 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.755 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.755 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.756 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.756 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.756 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.756 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.756 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.756 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.756 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.756 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.756 INFO:teuthology.orchestra.run.smithi037.stdout: "trash_purge_schedule": { 2024-09-19T06:09:56.756 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "trash_purge_schedule", 2024-09-19T06:09:56.756 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.756 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.756 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.756 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.757 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.757 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.757 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.757 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.757 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.757 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.757 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.757 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.757 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.757 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.757 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.757 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "restful", 2024-09-19T06:09:56.757 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:56.757 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:56.757 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:56.758 INFO:teuthology.orchestra.run.smithi037.stdout: "enable_auth": { 2024-09-19T06:09:56.758 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enable_auth", 2024-09-19T06:09:56.758 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.758 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.758 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.758 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.758 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.758 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.758 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.758 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.758 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.758 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.758 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.758 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.759 INFO:teuthology.orchestra.run.smithi037.stdout: "key_file": { 2024-09-19T06:09:56.759 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "key_file", 2024-09-19T06:09:56.759 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.759 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.759 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.759 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.759 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.759 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.759 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.759 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.759 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.759 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.759 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.759 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.760 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:56.760 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:56.760 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.760 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.760 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.760 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.760 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.760 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.760 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.760 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.760 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.760 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.760 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.760 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.761 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.761 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.761 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.761 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.761 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.761 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.761 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.761 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:56.761 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:56.761 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.761 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.761 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.761 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.761 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.761 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.762 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.762 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.762 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.762 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.762 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.762 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.762 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:56.762 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:56.762 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.762 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.762 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.762 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:56.762 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.762 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.762 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.763 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.763 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.763 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.763 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.763 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.763 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.763 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.763 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.763 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.763 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.763 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.763 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.763 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:56.763 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:56.763 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.764 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.764 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.764 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.764 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.764 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.764 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.764 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.764 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.764 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.764 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.764 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.764 INFO:teuthology.orchestra.run.smithi037.stdout: "server_addr": { 2024-09-19T06:09:56.765 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_addr", 2024-09-19T06:09:56.765 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.765 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.765 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.765 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.765 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.765 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.765 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.765 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.765 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.765 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.765 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.765 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.765 INFO:teuthology.orchestra.run.smithi037.stdout: "server_port": { 2024-09-19T06:09:56.766 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_port", 2024-09-19T06:09:56.766 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.766 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.766 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.766 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.766 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.766 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.766 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.766 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.766 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.766 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.766 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.766 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.767 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.767 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.767 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.767 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rgw", 2024-09-19T06:09:56.767 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:56.767 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:56.767 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:56.767 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:56.767 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:56.767 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.767 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.767 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.767 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.767 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.767 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.768 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.768 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.768 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.768 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.768 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.768 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.768 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.768 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.768 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.768 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.768 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.768 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.768 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.768 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:56.769 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:56.769 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.769 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.769 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.769 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.769 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.769 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.769 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.769 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.769 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.769 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.769 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.769 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.769 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:56.770 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:56.770 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.770 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.770 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.770 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:56.770 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.770 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.770 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.770 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.770 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.770 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.770 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.770 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.770 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.771 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.771 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.771 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.771 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.771 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.771 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.771 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:56.771 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:56.771 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.771 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.771 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.771 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.771 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.771 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.772 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.772 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.772 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.772 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.772 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.772 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.772 INFO:teuthology.orchestra.run.smithi037.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T06:09:56.772 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T06:09:56.772 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.772 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.772 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.772 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-09-19T06:09:56.772 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.772 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.773 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.773 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T06:09:56.773 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.773 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.773 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.773 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.773 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.773 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.773 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.773 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rook", 2024-09-19T06:09:56.773 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:56.773 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:56.773 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:56.773 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:56.774 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:56.774 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.774 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.774 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.774 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.774 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.774 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.774 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.774 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.774 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.774 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.774 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.774 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.774 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.774 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.775 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.775 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.775 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.775 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.775 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.775 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:56.775 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:56.775 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.775 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.775 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.775 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.775 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.775 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.776 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.776 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.776 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.776 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.776 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.776 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.776 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:56.776 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:56.776 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.776 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.776 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.776 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:56.776 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.776 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.777 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.777 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.777 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.777 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.777 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.777 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.777 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.777 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.777 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.777 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.777 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.777 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.777 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.777 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:56.778 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:56.778 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.778 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.778 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.778 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.778 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.778 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.778 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.778 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.778 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.778 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.778 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.778 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.778 INFO:teuthology.orchestra.run.smithi037.stdout: "storage_class": { 2024-09-19T06:09:56.779 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "storage_class", 2024-09-19T06:09:56.779 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.779 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.779 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.779 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "local", 2024-09-19T06:09:56.779 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.779 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.779 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.779 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T06:09:56.779 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.779 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.779 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.779 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.779 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.779 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.780 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.780 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "selftest", 2024-09-19T06:09:56.780 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:56.780 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:56.780 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:56.780 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:56.780 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:56.780 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.780 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.780 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.780 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.780 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.780 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.780 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.781 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.781 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.781 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.781 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.781 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.781 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.781 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.781 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.781 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.781 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.781 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.781 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.781 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:56.781 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:56.782 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.782 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.782 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.782 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.782 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.782 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.782 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.782 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.782 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.782 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.782 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.782 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.782 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:56.782 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:56.783 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.783 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.783 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.783 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:56.783 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.783 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.783 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.783 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.783 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.783 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.783 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.783 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.783 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.784 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.784 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.784 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.784 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.784 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.784 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.784 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:56.784 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:56.784 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.784 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.784 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.784 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.784 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.784 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.785 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.785 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.785 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.785 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.785 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.785 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.785 INFO:teuthology.orchestra.run.smithi037.stdout: "roption1": { 2024-09-19T06:09:56.785 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "roption1", 2024-09-19T06:09:56.785 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.785 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.785 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.785 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.785 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.785 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.786 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.786 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.786 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.786 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.786 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.786 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.786 INFO:teuthology.orchestra.run.smithi037.stdout: "roption2": { 2024-09-19T06:09:56.786 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "roption2", 2024-09-19T06:09:56.786 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.786 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.786 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.786 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "xyz", 2024-09-19T06:09:56.786 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.786 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.786 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.787 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.787 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.787 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.787 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.787 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.787 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption1": { 2024-09-19T06:09:56.787 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption1", 2024-09-19T06:09:56.787 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.787 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.787 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.787 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.787 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.787 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.787 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.788 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.788 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.788 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.788 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.788 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.788 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption2": { 2024-09-19T06:09:56.788 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption2", 2024-09-19T06:09:56.788 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.788 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.788 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.788 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.788 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.788 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.788 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.789 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.789 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.789 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.789 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.789 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.789 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption3": { 2024-09-19T06:09:56.789 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption3", 2024-09-19T06:09:56.789 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-09-19T06:09:56.789 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.789 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.789 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.789 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.789 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.789 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.790 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.790 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.790 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.790 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.790 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.790 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption4": { 2024-09-19T06:09:56.790 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption4", 2024-09-19T06:09:56.790 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.790 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.790 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.790 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.790 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.790 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.791 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.791 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.791 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.791 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.791 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.791 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.791 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption5": { 2024-09-19T06:09:56.791 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption5", 2024-09-19T06:09:56.791 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.791 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.791 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.791 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.791 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.791 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.792 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.792 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.792 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.792 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.792 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.792 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.792 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption6": { 2024-09-19T06:09:56.792 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption6", 2024-09-19T06:09:56.792 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.792 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.792 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.792 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.792 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.792 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.792 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.793 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.793 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.793 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.793 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.793 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.793 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption7": { 2024-09-19T06:09:56.793 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption7", 2024-09-19T06:09:56.793 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.793 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.793 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.793 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.793 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-09-19T06:09:56.793 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "42", 2024-09-19T06:09:56.793 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.794 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.794 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.794 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.794 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.794 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.794 INFO:teuthology.orchestra.run.smithi037.stdout: "testkey": { 2024-09-19T06:09:56.794 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "testkey", 2024-09-19T06:09:56.794 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.794 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.794 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.794 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.794 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.794 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.794 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.795 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.795 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.795 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.795 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.795 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.795 INFO:teuthology.orchestra.run.smithi037.stdout: "testlkey": { 2024-09-19T06:09:56.795 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "testlkey", 2024-09-19T06:09:56.795 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.795 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.795 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.795 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.795 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.795 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.795 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.796 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.796 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.796 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.796 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.796 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.796 INFO:teuthology.orchestra.run.smithi037.stdout: "testnewline": { 2024-09-19T06:09:56.796 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "testnewline", 2024-09-19T06:09:56.796 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.796 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.796 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.796 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.796 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.796 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.797 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.797 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.797 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.797 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.797 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.797 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.797 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.797 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.797 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.797 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "snap_schedule", 2024-09-19T06:09:56.797 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:56.797 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:56.797 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:56.797 INFO:teuthology.orchestra.run.smithi037.stdout: "allow_m_granularity": { 2024-09-19T06:09:56.798 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "allow_m_granularity", 2024-09-19T06:09:56.798 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.798 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.798 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.798 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.798 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.798 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.798 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.798 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T06:09:56.798 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.798 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.798 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.798 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.799 INFO:teuthology.orchestra.run.smithi037.stdout: "dump_on_update": { 2024-09-19T06:09:56.799 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "dump_on_update", 2024-09-19T06:09:56.799 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.799 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.799 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.799 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.799 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.799 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.799 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.799 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "dump database to debug log on update", 2024-09-19T06:09:56.799 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.799 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.799 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.799 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.800 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:56.800 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:56.800 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.800 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.800 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.800 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.800 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.800 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.800 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.800 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.800 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.800 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.800 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.801 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.801 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.801 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.801 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.801 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.801 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.801 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.801 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.801 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:56.801 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:56.801 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.801 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.801 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.801 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.801 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.802 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.802 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.802 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.802 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.802 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.802 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.802 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.802 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:56.802 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:56.802 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.802 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.802 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.802 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:56.802 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.802 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.803 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.803 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.803 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.803 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.803 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.803 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.803 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.803 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.803 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.803 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.803 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.803 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.803 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.803 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:56.803 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:56.804 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.804 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.804 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.804 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.804 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.804 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.804 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.804 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.804 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.804 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.804 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.804 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.804 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.804 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.805 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.805 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "stats", 2024-09-19T06:09:56.805 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:56.805 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:56.805 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:56.805 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:56.805 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:56.805 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.805 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.805 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.805 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.805 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.805 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.806 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.806 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.806 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.806 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.806 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.806 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.806 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.806 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.806 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.806 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.806 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.806 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.806 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.807 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:56.807 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:56.807 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.807 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.807 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.807 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.807 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.807 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.807 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.807 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.807 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.807 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.808 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.808 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.808 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:56.808 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:56.808 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.808 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.808 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.808 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:56.808 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.808 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.808 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.808 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.809 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.809 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.809 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.809 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.809 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.809 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.809 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.809 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.809 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.809 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.809 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.809 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:56.809 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:56.809 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.810 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.810 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.810 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.810 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.810 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.810 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.810 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.810 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.810 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.810 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.810 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.810 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.810 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.811 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.811 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "status", 2024-09-19T06:09:56.811 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:56.811 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:56.811 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:56.811 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:56.811 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:56.811 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.811 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.811 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.811 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.811 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.811 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.811 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.812 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.812 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.812 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.812 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.812 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.812 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.812 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.812 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.812 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.812 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.812 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.812 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.812 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:56.812 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:56.813 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.813 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.813 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.813 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.813 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.813 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.813 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.813 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.813 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.813 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.813 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.813 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.813 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:56.813 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:56.814 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.814 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.814 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.814 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:56.814 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.814 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.814 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.814 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.814 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.814 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.814 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.814 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.814 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.815 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.815 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.815 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.815 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.815 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.815 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.815 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:56.815 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:56.815 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.815 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.815 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.815 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.815 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.815 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.815 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.815 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.815 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.816 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.816 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.816 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.816 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.816 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.816 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.816 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "telegraf", 2024-09-19T06:09:56.816 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:56.816 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:56.816 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:56.816 INFO:teuthology.orchestra.run.smithi037.stdout: "address": { 2024-09-19T06:09:56.816 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "address", 2024-09-19T06:09:56.816 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.816 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.817 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.817 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T06:09:56.817 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.817 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.817 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.817 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.817 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.817 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.817 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.817 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.817 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-09-19T06:09:56.817 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-09-19T06:09:56.817 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-19T06:09:56.817 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.817 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.818 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "15", 2024-09-19T06:09:56.818 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.818 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.818 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.818 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.818 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.818 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.818 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.818 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.818 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:56.818 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:56.818 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.818 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.819 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.819 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.819 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.819 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.819 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.819 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.819 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.819 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.819 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.819 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.819 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.819 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.819 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.819 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.820 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.820 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.820 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.820 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:56.820 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:56.820 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.820 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.820 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.820 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.820 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.820 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.820 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.820 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.821 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.821 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.821 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.821 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.821 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:56.821 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:56.821 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.821 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.821 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.821 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:56.821 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.821 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.821 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.821 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.821 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.822 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.822 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.822 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.822 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.822 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.822 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.822 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.822 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.822 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.822 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.822 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:56.822 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:56.822 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.823 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.823 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.823 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.823 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.823 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.823 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.823 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.823 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.823 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.823 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.823 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.823 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.824 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.824 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.824 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "telemetry", 2024-09-19T06:09:56.824 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:56.824 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:56.824 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:56.824 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_basic": { 2024-09-19T06:09:56.824 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_basic", 2024-09-19T06:09:56.824 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.824 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.824 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.824 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.824 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.824 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.825 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.825 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T06:09:56.825 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.825 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.825 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.825 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.825 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_crash": { 2024-09-19T06:09:56.825 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_crash", 2024-09-19T06:09:56.825 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.825 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.825 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.825 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.825 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.825 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.826 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.826 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T06:09:56.826 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.826 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.826 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.826 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.826 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_device": { 2024-09-19T06:09:56.826 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_device", 2024-09-19T06:09:56.826 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.826 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.826 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.826 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.826 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.826 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.826 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.826 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T06:09:56.827 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.827 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.827 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.827 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.827 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_ident": { 2024-09-19T06:09:56.827 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_ident", 2024-09-19T06:09:56.827 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.827 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.827 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.827 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.827 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.827 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.827 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.827 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T06:09:56.828 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.828 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.828 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.828 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.828 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_perf": { 2024-09-19T06:09:56.828 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_perf", 2024-09-19T06:09:56.828 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.828 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.828 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.828 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.828 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.828 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.828 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.828 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T06:09:56.828 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.829 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.829 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.829 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.829 INFO:teuthology.orchestra.run.smithi037.stdout: "contact": { 2024-09-19T06:09:56.829 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "contact", 2024-09-19T06:09:56.829 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.829 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.829 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.829 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.829 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.829 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.829 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.829 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.829 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.830 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.830 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.830 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.830 INFO:teuthology.orchestra.run.smithi037.stdout: "description": { 2024-09-19T06:09:56.830 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "description", 2024-09-19T06:09:56.830 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.830 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.830 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.830 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.830 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.830 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.830 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.830 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.830 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.830 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.830 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.831 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.831 INFO:teuthology.orchestra.run.smithi037.stdout: "device_url": { 2024-09-19T06:09:56.831 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "device_url", 2024-09-19T06:09:56.831 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.831 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.831 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.831 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T06:09:56.831 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.831 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.831 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.831 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.831 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.831 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.831 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.831 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.832 INFO:teuthology.orchestra.run.smithi037.stdout: "enabled": { 2024-09-19T06:09:56.832 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enabled", 2024-09-19T06:09:56.832 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.832 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.832 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.832 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.832 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.832 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.832 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.832 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.832 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.832 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.832 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.832 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.832 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-09-19T06:09:56.833 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-09-19T06:09:56.833 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.833 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.833 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.833 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "24", 2024-09-19T06:09:56.833 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "8", 2024-09-19T06:09:56.833 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.833 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.833 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.833 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.833 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.833 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.833 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.833 INFO:teuthology.orchestra.run.smithi037.stdout: "last_opt_revision": { 2024-09-19T06:09:56.833 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "last_opt_revision", 2024-09-19T06:09:56.833 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.834 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.834 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.834 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "1", 2024-09-19T06:09:56.834 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.834 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.834 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.834 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.834 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.834 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.834 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.834 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.834 INFO:teuthology.orchestra.run.smithi037.stdout: "leaderboard": { 2024-09-19T06:09:56.834 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "leaderboard", 2024-09-19T06:09:56.834 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.835 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.835 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.835 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.835 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.835 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.835 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.835 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.835 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.835 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.835 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.835 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.835 INFO:teuthology.orchestra.run.smithi037.stdout: "leaderboard_description": { 2024-09-19T06:09:56.835 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "leaderboard_description", 2024-09-19T06:09:56.835 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.835 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.835 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.836 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.836 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.836 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.836 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.836 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.836 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.836 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.836 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.836 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.836 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:56.836 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:56.836 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.836 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.836 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.837 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.837 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.837 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.837 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.837 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.837 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.837 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.837 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.837 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.837 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.837 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.837 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.837 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.837 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.838 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.838 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.838 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:56.838 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:56.838 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.838 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.838 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.838 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.838 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.838 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.838 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.838 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.838 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.838 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.838 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.839 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.839 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:56.839 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:56.839 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.839 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.839 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.839 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:56.839 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.839 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.839 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.839 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.839 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.839 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.839 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.839 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.839 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.840 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.840 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.840 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.840 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.840 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.840 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.840 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:56.840 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:56.840 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.840 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.840 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.840 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.840 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.840 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.841 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.841 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.841 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.841 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.841 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.841 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.841 INFO:teuthology.orchestra.run.smithi037.stdout: "organization": { 2024-09-19T06:09:56.841 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "organization", 2024-09-19T06:09:56.841 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.841 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.841 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.841 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.842 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.842 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.842 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.842 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.842 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.842 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.842 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.842 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.842 INFO:teuthology.orchestra.run.smithi037.stdout: "proxy": { 2024-09-19T06:09:56.842 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "proxy", 2024-09-19T06:09:56.842 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.842 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.842 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.842 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.842 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.843 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.843 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.843 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.843 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.843 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.843 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.843 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.843 INFO:teuthology.orchestra.run.smithi037.stdout: "url": { 2024-09-19T06:09:56.843 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "url", 2024-09-19T06:09:56.843 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.843 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.843 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.843 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T06:09:56.843 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.843 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.844 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.844 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.844 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.844 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.844 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.844 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.844 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.844 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.844 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.844 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "test_orchestrator", 2024-09-19T06:09:56.844 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:56.844 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:56.844 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:56.844 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:56.845 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:56.845 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.845 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.845 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.845 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.845 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.845 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.845 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.845 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.845 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.845 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.845 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.845 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.845 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.846 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.846 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.846 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.846 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.846 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.846 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.846 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:56.846 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:56.846 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.846 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.846 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.846 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.846 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.846 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.846 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.846 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.847 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.847 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.847 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.847 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.847 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:56.847 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:56.847 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.847 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.847 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.847 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:56.847 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.847 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.847 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.847 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.847 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.848 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.848 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.848 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.848 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.848 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.848 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.848 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.848 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.848 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.848 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.848 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:56.848 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:56.848 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.848 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.849 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.849 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.849 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.849 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.849 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.849 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.849 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.849 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.849 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.849 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.849 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.849 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.849 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.850 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "volumes", 2024-09-19T06:09:56.850 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:56.850 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:56.850 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:56.850 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:56.850 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:56.850 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.850 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.850 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.850 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.850 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.850 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.850 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.850 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.851 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.851 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.851 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.851 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.851 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.851 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.851 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.851 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.851 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.851 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.851 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.851 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:56.851 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:56.852 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.852 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.852 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.852 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.852 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.852 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.852 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.852 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.852 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.852 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.852 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.852 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.852 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:56.853 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:56.853 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.853 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.853 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.853 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:56.853 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.853 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.853 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.853 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.853 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.853 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.853 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.853 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.853 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.854 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.854 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.854 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.854 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.854 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.854 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.854 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:56.854 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:56.854 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.854 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.854 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.854 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.854 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.855 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.855 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.855 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.855 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.855 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.855 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.855 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.855 INFO:teuthology.orchestra.run.smithi037.stdout: "max_concurrent_clones": { 2024-09-19T06:09:56.855 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_concurrent_clones", 2024-09-19T06:09:56.855 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.855 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.855 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.855 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "4", 2024-09-19T06:09:56.856 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.856 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.856 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.856 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T06:09:56.856 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.856 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.856 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.856 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.856 INFO:teuthology.orchestra.run.smithi037.stdout: "periodic_async_work": { 2024-09-19T06:09:56.856 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "periodic_async_work", 2024-09-19T06:09:56.856 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.856 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.856 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.857 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.857 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.857 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.857 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.857 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Periodically check for async work", 2024-09-19T06:09:56.857 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.857 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.857 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.857 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.857 INFO:teuthology.orchestra.run.smithi037.stdout: "snapshot_clone_delay": { 2024-09-19T06:09:56.857 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "snapshot_clone_delay", 2024-09-19T06:09:56.857 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.857 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.858 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.858 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-09-19T06:09:56.858 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.858 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.858 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.858 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T06:09:56.858 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.858 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.858 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.858 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.858 INFO:teuthology.orchestra.run.smithi037.stdout: "snapshot_clone_no_wait": { 2024-09-19T06:09:56.858 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T06:09:56.859 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.859 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.859 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.859 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-09-19T06:09:56.859 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.859 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.859 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.859 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T06:09:56.859 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.859 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.859 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.859 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.859 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.859 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.860 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.860 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix", 2024-09-19T06:09:56.860 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-09-19T06:09:56.860 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-09-19T06:09:56.860 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-09-19T06:09:56.860 INFO:teuthology.orchestra.run.smithi037.stdout: "discovery_interval": { 2024-09-19T06:09:56.860 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "discovery_interval", 2024-09-19T06:09:56.860 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-09-19T06:09:56.860 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.860 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.860 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "100", 2024-09-19T06:09:56.861 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.861 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.861 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.861 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.861 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.861 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.861 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.861 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.861 INFO:teuthology.orchestra.run.smithi037.stdout: "identifier": { 2024-09-19T06:09:56.861 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "identifier", 2024-09-19T06:09:56.861 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.861 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.861 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.862 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.862 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.862 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.862 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.862 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.862 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.862 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.862 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.862 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.862 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-09-19T06:09:56.862 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-09-19T06:09:56.862 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-09-19T06:09:56.862 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.863 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.863 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-09-19T06:09:56.863 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.863 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.863 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.863 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.863 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.863 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.863 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.863 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.863 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-09-19T06:09:56.863 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-09-19T06:09:56.863 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.863 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.863 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.864 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.864 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.864 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.864 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.864 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.864 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.864 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.864 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.864 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.864 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.864 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.864 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.864 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.864 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.865 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.865 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.865 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-09-19T06:09:56.865 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-09-19T06:09:56.865 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.865 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.865 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.865 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.865 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.865 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.865 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.865 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.865 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.866 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.866 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.866 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.866 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-09-19T06:09:56.866 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-09-19T06:09:56.866 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.866 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.866 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.866 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-09-19T06:09:56.866 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.866 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.866 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-09-19T06:09:56.866 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-09-19T06:09:56.866 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-09-19T06:09:56.867 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-09-19T06:09:56.867 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-09-19T06:09:56.867 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-09-19T06:09:56.867 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-09-19T06:09:56.867 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.867 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.867 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.867 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.867 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.867 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.867 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-09-19T06:09:56.867 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-09-19T06:09:56.867 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-09-19T06:09:56.867 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.867 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-09-19T06:09:56.868 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-09-19T06:09:56.868 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.868 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.868 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.868 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.868 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.868 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.868 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.868 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.868 INFO:teuthology.orchestra.run.smithi037.stdout: "zabbix_host": { 2024-09-19T06:09:56.868 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix_host", 2024-09-19T06:09:56.868 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.868 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.869 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.869 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-09-19T06:09:56.869 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.869 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.869 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.869 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.869 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.869 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.869 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.869 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.869 INFO:teuthology.orchestra.run.smithi037.stdout: "zabbix_port": { 2024-09-19T06:09:56.869 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix_port", 2024-09-19T06:09:56.869 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-09-19T06:09:56.870 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.870 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.870 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10051", 2024-09-19T06:09:56.870 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.870 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.870 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.870 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.870 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.870 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.870 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.870 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.870 INFO:teuthology.orchestra.run.smithi037.stdout: "zabbix_sender": { 2024-09-19T06:09:56.870 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix_sender", 2024-09-19T06:09:56.870 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-09-19T06:09:56.871 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-09-19T06:09:56.871 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-09-19T06:09:56.871 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T06:09:56.871 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-09-19T06:09:56.871 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-09-19T06:09:56.871 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-09-19T06:09:56.871 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-09-19T06:09:56.871 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-09-19T06:09:56.871 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-09-19T06:09:56.871 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-09-19T06:09:56.871 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.871 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.871 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.871 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.871 INFO:teuthology.orchestra.run.smithi037.stdout: "services": { 2024-09-19T06:09:56.872 INFO:teuthology.orchestra.run.smithi037.stdout: "dashboard": "https://172.21.15.37:8443/" 2024-09-19T06:09:56.872 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.872 INFO:teuthology.orchestra.run.smithi037.stdout: "always_on_modules": { 2024-09-19T06:09:56.872 INFO:teuthology.orchestra.run.smithi037.stdout: "octopus": [ 2024-09-19T06:09:56.872 INFO:teuthology.orchestra.run.smithi037.stdout: "balancer", 2024-09-19T06:09:56.872 INFO:teuthology.orchestra.run.smithi037.stdout: "crash", 2024-09-19T06:09:56.872 INFO:teuthology.orchestra.run.smithi037.stdout: "devicehealth", 2024-09-19T06:09:56.872 INFO:teuthology.orchestra.run.smithi037.stdout: "orchestrator", 2024-09-19T06:09:56.872 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_autoscaler", 2024-09-19T06:09:56.872 INFO:teuthology.orchestra.run.smithi037.stdout: "progress", 2024-09-19T06:09:56.872 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_support", 2024-09-19T06:09:56.872 INFO:teuthology.orchestra.run.smithi037.stdout: "status", 2024-09-19T06:09:56.872 INFO:teuthology.orchestra.run.smithi037.stdout: "telemetry", 2024-09-19T06:09:56.872 INFO:teuthology.orchestra.run.smithi037.stdout: "volumes" 2024-09-19T06:09:56.872 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.873 INFO:teuthology.orchestra.run.smithi037.stdout: "pacific": [ 2024-09-19T06:09:56.873 INFO:teuthology.orchestra.run.smithi037.stdout: "balancer", 2024-09-19T06:09:56.873 INFO:teuthology.orchestra.run.smithi037.stdout: "crash", 2024-09-19T06:09:56.873 INFO:teuthology.orchestra.run.smithi037.stdout: "devicehealth", 2024-09-19T06:09:56.873 INFO:teuthology.orchestra.run.smithi037.stdout: "orchestrator", 2024-09-19T06:09:56.873 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_autoscaler", 2024-09-19T06:09:56.873 INFO:teuthology.orchestra.run.smithi037.stdout: "progress", 2024-09-19T06:09:56.873 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_support", 2024-09-19T06:09:56.873 INFO:teuthology.orchestra.run.smithi037.stdout: "status", 2024-09-19T06:09:56.873 INFO:teuthology.orchestra.run.smithi037.stdout: "telemetry", 2024-09-19T06:09:56.873 INFO:teuthology.orchestra.run.smithi037.stdout: "volumes" 2024-09-19T06:09:56.873 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.873 INFO:teuthology.orchestra.run.smithi037.stdout: "quincy": [ 2024-09-19T06:09:56.873 INFO:teuthology.orchestra.run.smithi037.stdout: "balancer", 2024-09-19T06:09:56.874 INFO:teuthology.orchestra.run.smithi037.stdout: "crash", 2024-09-19T06:09:56.874 INFO:teuthology.orchestra.run.smithi037.stdout: "devicehealth", 2024-09-19T06:09:56.874 INFO:teuthology.orchestra.run.smithi037.stdout: "orchestrator", 2024-09-19T06:09:56.874 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_autoscaler", 2024-09-19T06:09:56.874 INFO:teuthology.orchestra.run.smithi037.stdout: "progress", 2024-09-19T06:09:56.874 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_support", 2024-09-19T06:09:56.874 INFO:teuthology.orchestra.run.smithi037.stdout: "status", 2024-09-19T06:09:56.874 INFO:teuthology.orchestra.run.smithi037.stdout: "telemetry", 2024-09-19T06:09:56.874 INFO:teuthology.orchestra.run.smithi037.stdout: "volumes" 2024-09-19T06:09:56.874 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.874 INFO:teuthology.orchestra.run.smithi037.stdout: "reef": [ 2024-09-19T06:09:56.874 INFO:teuthology.orchestra.run.smithi037.stdout: "balancer", 2024-09-19T06:09:56.874 INFO:teuthology.orchestra.run.smithi037.stdout: "crash", 2024-09-19T06:09:56.874 INFO:teuthology.orchestra.run.smithi037.stdout: "devicehealth", 2024-09-19T06:09:56.875 INFO:teuthology.orchestra.run.smithi037.stdout: "orchestrator", 2024-09-19T06:09:56.875 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_autoscaler", 2024-09-19T06:09:56.875 INFO:teuthology.orchestra.run.smithi037.stdout: "progress", 2024-09-19T06:09:56.875 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_support", 2024-09-19T06:09:56.875 INFO:teuthology.orchestra.run.smithi037.stdout: "status", 2024-09-19T06:09:56.875 INFO:teuthology.orchestra.run.smithi037.stdout: "telemetry", 2024-09-19T06:09:56.875 INFO:teuthology.orchestra.run.smithi037.stdout: "volumes" 2024-09-19T06:09:56.875 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-09-19T06:09:56.875 INFO:teuthology.orchestra.run.smithi037.stdout: "squid": [ 2024-09-19T06:09:56.875 INFO:teuthology.orchestra.run.smithi037.stdout: "balancer", 2024-09-19T06:09:56.875 INFO:teuthology.orchestra.run.smithi037.stdout: "crash", 2024-09-19T06:09:56.875 INFO:teuthology.orchestra.run.smithi037.stdout: "devicehealth", 2024-09-19T06:09:56.875 INFO:teuthology.orchestra.run.smithi037.stdout: "orchestrator", 2024-09-19T06:09:56.875 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_autoscaler", 2024-09-19T06:09:56.876 INFO:teuthology.orchestra.run.smithi037.stdout: "progress", 2024-09-19T06:09:56.876 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_support", 2024-09-19T06:09:56.876 INFO:teuthology.orchestra.run.smithi037.stdout: "status", 2024-09-19T06:09:56.876 INFO:teuthology.orchestra.run.smithi037.stdout: "telemetry", 2024-09-19T06:09:56.876 INFO:teuthology.orchestra.run.smithi037.stdout: "volumes" 2024-09-19T06:09:56.876 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-09-19T06:09:56.876 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.876 INFO:teuthology.orchestra.run.smithi037.stdout: "last_failure_osd_epoch": 3, 2024-09-19T06:09:56.876 INFO:teuthology.orchestra.run.smithi037.stdout: "active_clients": [ 2024-09-19T06:09:56.876 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.876 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "devicehealth", 2024-09-19T06:09:56.876 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2024-09-19T06:09:56.876 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.876 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2024-09-19T06:09:56.876 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.37:0", 2024-09-19T06:09:56.877 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 1417461922 2024-09-19T06:09:56.877 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.877 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-09-19T06:09:56.877 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.877 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.877 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "libcephsqlite", 2024-09-19T06:09:56.877 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2024-09-19T06:09:56.877 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.877 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2024-09-19T06:09:56.877 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.37:0", 2024-09-19T06:09:56.877 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 1246351928 2024-09-19T06:09:56.878 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.878 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-09-19T06:09:56.878 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.878 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.878 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rbd_support", 2024-09-19T06:09:56.878 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2024-09-19T06:09:56.878 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.878 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2024-09-19T06:09:56.878 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.37:0", 2024-09-19T06:09:56.878 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 808418272 2024-09-19T06:09:56.878 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.878 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-09-19T06:09:56.878 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-09-19T06:09:56.878 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.879 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "volumes", 2024-09-19T06:09:56.879 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2024-09-19T06:09:56.879 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-09-19T06:09:56.879 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2024-09-19T06:09:56.879 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.37:0", 2024-09-19T06:09:56.879 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 1366126104 2024-09-19T06:09:56.879 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.879 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-09-19T06:09:56.879 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-09-19T06:09:56.879 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-09-19T06:09:56.879 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-19T06:09:56.880 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:09:55 smithi117 ceph-mon[35050]: pgmap v462: 129 pgs: 129 active+clean; 149 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 973 KiB/s rd, 920 KiB/s wr, 239 op/s 2024-09-19T06:09:56.880 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:09:55 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/649124366' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T06:09:56.881 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:09:55 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/2044466454' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-19T06:09:56.881 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:09:55 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/715196767' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T06:09:56.881 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:09:55 smithi099 ceph-mon[35300]: pgmap v462: 129 pgs: 129 active+clean; 149 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 973 KiB/s rd, 920 KiB/s wr, 239 op/s 2024-09-19T06:09:56.881 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:09:55 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/649124366' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T06:09:56.881 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:09:55 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/2044466454' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-19T06:09:56.881 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:09:55 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/715196767' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T06:09:56.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.554+0000 7f83681bd640 1 -- 172.21.15.37:0/715196767 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f834c0a32d0 msgr2=0x7f834c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:56.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.554+0000 7f83681bd640 1 --2- 172.21.15.37:0/715196767 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f834c0a32d0 0x7f834c0a5790 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f836006a180 tx=0x7f835c00a5e0 comp rx=0 tx=0).stop 2024-09-19T06:09:56.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.554+0000 7f83681bd640 1 -- 172.21.15.37:0/715196767 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8360103840 msgr2=0x7f836019f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:56.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.554+0000 7f83681bd640 1 --2- 172.21.15.37:0/715196767 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8360103840 0x7f836019f3e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f835800b970 tx=0x7f835800be30 comp rx=0 tx=0).stop 2024-09-19T06:09:56.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.554+0000 7f83681bd640 1 -- 172.21.15.37:0/715196767 shutdown_connections 2024-09-19T06:09:56.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.554+0000 7f83681bd640 1 --2- 172.21.15.37:0/715196767 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f834c0a32d0 0x7f834c0a5790 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:56.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.554+0000 7f83681bd640 1 --2- 172.21.15.37:0/715196767 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8360103840 0x7f836019f3e0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:56.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.554+0000 7f83681bd640 1 --2- 172.21.15.37:0/715196767 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8360102e80 0x7f8360198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:56.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.554+0000 7f83681bd640 1 --2- 172.21.15.37:0/715196767 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83600ffe10 0x7f8360197e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:56.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.554+0000 7f83681bd640 1 -- 172.21.15.37:0/715196767 >> 172.21.15.37:0/715196767 conn(0x7f83600fb910 msgr2=0x7f8360106180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:56.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.554+0000 7f83681bd640 1 -- 172.21.15.37:0/715196767 shutdown_connections 2024-09-19T06:09:56.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:55.554+0000 7f83681bd640 1 -- 172.21.15.37:0/715196767 wait complete. 2024-09-19T06:09:56.932 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-19T06:09:56.942 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-19T06:09:56.943 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-19T06:09:56.943 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T06:09:56.943 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:09:55 smithi037 ceph-mon[31211]: pgmap v462: 129 pgs: 129 active+clean; 149 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 973 KiB/s rd, 920 KiB/s wr, 239 op/s 2024-09-19T06:09:56.943 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:09:55 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/649124366' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T06:09:56.943 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:09:55 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/2044466454' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-19T06:09:56.943 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:09:55 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/715196767' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T06:09:56.964 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-19T06:09:56.964 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T06:09:57.025 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-19T06:09:57.332 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:09:57.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:57.844+0000 7f44f7cde640 1 -- 172.21.15.37:0/3121866511 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44f0102df0 msgr2=0x7f44f01031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:57.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:57.844+0000 7f44f7cde640 1 --2- 172.21.15.37:0/3121866511 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44f0102df0 0x7f44f01031d0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f44ec009900 tx=0x7f44ec02a3f0 comp rx=0 tx=0).stop 2024-09-19T06:09:57.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:57.844+0000 7f44f7cde640 1 -- 172.21.15.37:0/3121866511 shutdown_connections 2024-09-19T06:09:57.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:57.844+0000 7f44f7cde640 1 --2- 172.21.15.37:0/3121866511 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44f010c2f0 0x7f44f010e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:57.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:57.844+0000 7f44f7cde640 1 --2- 172.21.15.37:0/3121866511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f44f01037a0 0x7f44f010bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:57.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:57.844+0000 7f44f7cde640 1 --2- 172.21.15.37:0/3121866511 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44f0102df0 0x7f44f01031d0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:57.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:57.844+0000 7f44f7cde640 1 -- 172.21.15.37:0/3121866511 >> 172.21.15.37:0/3121866511 conn(0x7f44f00fc7d0 msgr2=0x7f44f00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:57.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:57.844+0000 7f44f7cde640 1 -- 172.21.15.37:0/3121866511 shutdown_connections 2024-09-19T06:09:57.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:57.844+0000 7f44f7cde640 1 -- 172.21.15.37:0/3121866511 wait complete. 2024-09-19T06:09:57.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:57.845+0000 7f44f7cde640 1 Processor -- start 2024-09-19T06:09:57.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:57.845+0000 7f44f7cde640 1 -- start start 2024-09-19T06:09:57.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:57.845+0000 7f44f7cde640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44f0102df0 0x7f44f0100a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:57.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:57.845+0000 7f44f7cde640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44f01037a0 0x7f44f0100f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:57.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:57.845+0000 7f44f7cde640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f44f010c2f0 0x7f44f01014d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:57.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:57.845+0000 7f44f7cde640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f44f0112110 con 0x7f44f0102df0 2024-09-19T06:09:57.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:57.845+0000 7f44f7cde640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f44f0111f90 con 0x7f44f01037a0 2024-09-19T06:09:57.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:57.845+0000 7f44f7cde640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f44f0112290 con 0x7f44f010c2f0 2024-09-19T06:09:57.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:57.845+0000 7f44f5a7a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44f0102df0 0x7f44f0100a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:57.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:57.845+0000 7f44f5a7a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44f0102df0 0x7f44f0100a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34066/0 (socket says 172.21.15.37:34066) 2024-09-19T06:09:57.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:57.845+0000 7f44f5a7a640 1 -- 172.21.15.37:0/237858727 learned_addr learned my addr 172.21.15.37:0/237858727 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:09:57.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:57.845+0000 7f44f5279640 1 --2- 172.21.15.37:0/237858727 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44f01037a0 0x7f44f0100f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:57.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:57.846+0000 7f44f627b640 1 --2- 172.21.15.37:0/237858727 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f44f010c2f0 0x7f44f01014d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:57.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:57.846+0000 7f44f5a7a640 1 -- 172.21.15.37:0/237858727 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f44f010c2f0 msgr2=0x7f44f01014d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:57.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:57.846+0000 7f44f5a7a640 1 --2- 172.21.15.37:0/237858727 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f44f010c2f0 0x7f44f01014d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:57.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:57.846+0000 7f44f5a7a640 1 -- 172.21.15.37:0/237858727 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44f01037a0 msgr2=0x7f44f0100f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:57.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:57.846+0000 7f44f5a7a640 1 --2- 172.21.15.37:0/237858727 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44f01037a0 0x7f44f0100f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:57.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:57.846+0000 7f44f5a7a640 1 -- 172.21.15.37:0/237858727 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44f01a6af0 con 0x7f44f0102df0 2024-09-19T06:09:57.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:57.846+0000 7f44f627b640 1 --2- 172.21.15.37:0/237858727 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f44f010c2f0 0x7f44f01014d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:09:57.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:57.846+0000 7f44f5a7a640 1 --2- 172.21.15.37:0/237858727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44f0102df0 0x7f44f0100a50 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f44ec006010 tx=0x7f44ec0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:57.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:57.846+0000 7f44e6ffd640 1 -- 172.21.15.37:0/237858727 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44ec03f030 con 0x7f44f0102df0 2024-09-19T06:09:57.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:57.846+0000 7f44e6ffd640 1 -- 172.21.15.37:0/237858727 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f44ec003ce0 con 0x7f44f0102df0 2024-09-19T06:09:57.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:57.846+0000 7f44f7cde640 1 -- 172.21.15.37:0/237858727 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44f01a6d80 con 0x7f44f0102df0 2024-09-19T06:09:57.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:57.846+0000 7f44e6ffd640 1 -- 172.21.15.37:0/237858727 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44ec035070 con 0x7f44f0102df0 2024-09-19T06:09:57.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:57.846+0000 7f44f7cde640 1 -- 172.21.15.37:0/237858727 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44f01a7200 con 0x7f44f0102df0 2024-09-19T06:09:57.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:57.847+0000 7f44f7cde640 1 -- 172.21.15.37:0/237858727 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44f01031d0 con 0x7f44f0102df0 2024-09-19T06:09:57.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:57.848+0000 7f44e6ffd640 1 -- 172.21.15.37:0/237858727 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f44ec042030 con 0x7f44f0102df0 2024-09-19T06:09:57.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:57.849+0000 7f44e6ffd640 1 --2- 172.21.15.37:0/237858727 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f44dc0a3240 0x7f44dc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:57.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:57.849+0000 7f44f5279640 1 --2- 172.21.15.37:0/237858727 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f44dc0a3240 0x7f44dc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:57.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:57.849+0000 7f44e6ffd640 1 -- 172.21.15.37:0/237858727 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9121+0+0 (secure 0 0 0) 0x7f44ec0f01f0 con 0x7f44f0102df0 2024-09-19T06:09:57.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:57.850+0000 7f44f5279640 1 --2- 172.21.15.37:0/237858727 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f44dc0a3240 0x7f44dc0a5700 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f44f01024e0 tx=0x7f44e000b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:57.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:57.854+0000 7f44e6ffd640 1 -- 172.21.15.37:0/237858727 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f44ec0bcc50 con 0x7f44f0102df0 2024-09-19T06:09:58.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:58.041+0000 7f44f7cde640 1 -- 172.21.15.37:0/237858727 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f44f01072c0 con 0x7f44f0102df0 2024-09-19T06:09:58.044 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:09:57 smithi037 ceph-mon[31211]: pgmap v463: 129 pgs: 129 active+clean; 148 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 980 KiB/s rd, 927 KiB/s wr, 231 op/s 2024-09-19T06:09:58.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:58.042+0000 7f44e6ffd640 1 -- 172.21.15.37:0/237858727 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v91) ==== 81+0+590 (secure 0 0 0) 0x7f44ec0bc550 con 0x7f44f0102df0 2024-09-19T06:09:58.044 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6801/133577710 2024-09-20T05:57:12.560771+0000 2024-09-19T06:09:58.045 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6800/133577710 2024-09-20T05:57:12.560771+0000 2024-09-19T06:09:58.045 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/2877363162 2024-09-20T05:57:12.560771+0000 2024-09-19T06:09:58.045 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/1053171617 2024-09-20T05:57:12.560771+0000 2024-09-19T06:09:58.045 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6800/3277805697 2024-09-20T05:56:49.335334+0000 2024-09-19T06:09:58.045 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/1280697705 2024-09-20T05:56:49.335334+0000 2024-09-19T06:09:58.045 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/1106526058 2024-09-20T05:57:12.560771+0000 2024-09-19T06:09:58.045 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/1978184693 2024-09-20T05:56:49.335334+0000 2024-09-19T06:09:58.045 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6801/3277805697 2024-09-20T05:56:49.335334+0000 2024-09-19T06:09:58.045 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/3650338877 2024-09-20T05:56:49.335334+0000 2024-09-19T06:09:58.046 INFO:teuthology.orchestra.run.smithi037.stderr:listed 10 entries 2024-09-19T06:09:58.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:58.044+0000 7f44f7cde640 1 -- 172.21.15.37:0/237858727 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f44dc0a3240 msgr2=0x7f44dc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:58.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:58.044+0000 7f44f7cde640 1 --2- 172.21.15.37:0/237858727 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f44dc0a3240 0x7f44dc0a5700 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f44f01024e0 tx=0x7f44e000b390 comp rx=0 tx=0).stop 2024-09-19T06:09:58.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:58.044+0000 7f44f7cde640 1 -- 172.21.15.37:0/237858727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44f0102df0 msgr2=0x7f44f0100a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:58.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:58.044+0000 7f44f7cde640 1 --2- 172.21.15.37:0/237858727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44f0102df0 0x7f44f0100a50 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f44ec006010 tx=0x7f44ec0042f0 comp rx=0 tx=0).stop 2024-09-19T06:09:58.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:58.044+0000 7f44f7cde640 1 -- 172.21.15.37:0/237858727 shutdown_connections 2024-09-19T06:09:58.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:58.044+0000 7f44f7cde640 1 --2- 172.21.15.37:0/237858727 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f44dc0a3240 0x7f44dc0a5700 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:58.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:58.044+0000 7f44f7cde640 1 --2- 172.21.15.37:0/237858727 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44f01037a0 0x7f44f0100f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:58.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:58.044+0000 7f44f7cde640 1 --2- 172.21.15.37:0/237858727 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f44f010c2f0 0x7f44f01014d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:58.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:58.044+0000 7f44f7cde640 1 --2- 172.21.15.37:0/237858727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44f0102df0 0x7f44f0100a50 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:58.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:58.044+0000 7f44f7cde640 1 -- 172.21.15.37:0/237858727 >> 172.21.15.37:0/237858727 conn(0x7f44f00fc7d0 msgr2=0x7f44f00fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:58.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:58.044+0000 7f44f7cde640 1 -- 172.21.15.37:0/237858727 shutdown_connections 2024-09-19T06:09:58.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:09:58.044+0000 7f44f7cde640 1 -- 172.21.15.37:0/237858727 wait complete. 2024-09-19T06:09:58.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:09:57 smithi099 ceph-mon[35300]: pgmap v463: 129 pgs: 129 active+clean; 148 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 980 KiB/s rd, 927 KiB/s wr, 231 op/s 2024-09-19T06:09:58.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:09:57 smithi117 ceph-mon[35050]: pgmap v463: 129 pgs: 129 active+clean; 148 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 980 KiB/s rd, 927 KiB/s wr, 231 op/s 2024-09-19T06:09:58.853 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-19T06:09:58.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:09:58.853 DEBUG:teuthology.orchestra.run.smithi037:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-19T06:09:58.899 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2024-09-19T06:09:58.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:09:58.899 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-19T06:09:58.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:09:58.958 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2024-09-19T06:09:59.014 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-19T06:09:59.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:09:59.014 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T06:09:59.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:09:58 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/237858727' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T06:09:59.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:09:59.082 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link delete ceph-brx 2024-09-19T06:09:59.183 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-19T06:09:59.194 INFO:tasks.cephadm:Teardown begin 2024-09-19T06:09:59.194 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-19T06:09:59.195 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:09:59.195 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:09:58 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/237858727' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T06:09:59.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:09:58 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/237858727' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T06:09:59.453 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:10:00.028 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:09:59 smithi037 ceph-mon[31211]: pgmap v464: 129 pgs: 129 active+clean; 148 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 577 KiB/s wr, 168 op/s 2024-09-19T06:10:00.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:09:59 smithi099 ceph-mon[35300]: pgmap v464: 129 pgs: 129 active+clean; 148 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 577 KiB/s wr, 168 op/s 2024-09-19T06:10:00.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:09:59 smithi117 ceph-mon[35050]: pgmap v464: 129 pgs: 129 active+clean; 148 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 577 KiB/s wr, 168 op/s 2024-09-19T06:10:00.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:00.241+0000 7f055084e640 1 -- 172.21.15.37:0/4196435088 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f054c101de0 msgr2=0x7f054c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:00.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:00.241+0000 7f055084e640 1 --2- 172.21.15.37:0/4196435088 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f054c101de0 0x7f054c1021c0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f053c009900 tx=0x7f053c02a410 comp rx=0 tx=0).stop 2024-09-19T06:10:00.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:00.242+0000 7f055084e640 1 -- 172.21.15.37:0/4196435088 shutdown_connections 2024-09-19T06:10:00.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:00.242+0000 7f055084e640 1 --2- 172.21.15.37:0/4196435088 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f054c106f10 0x7f054c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:00.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:00.242+0000 7f055084e640 1 --2- 172.21.15.37:0/4196435088 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f054c102790 0x7f054c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:00.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:00.242+0000 7f055084e640 1 --2- 172.21.15.37:0/4196435088 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f054c101de0 0x7f054c1021c0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:00.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:00.242+0000 7f055084e640 1 -- 172.21.15.37:0/4196435088 >> 172.21.15.37:0/4196435088 conn(0x7f054c0fd8c0 msgr2=0x7f054c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:00.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:00.242+0000 7f055084e640 1 -- 172.21.15.37:0/4196435088 shutdown_connections 2024-09-19T06:10:00.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:00.242+0000 7f055084e640 1 -- 172.21.15.37:0/4196435088 wait complete. 2024-09-19T06:10:00.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:00.242+0000 7f055084e640 1 Processor -- start 2024-09-19T06:10:00.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:00.242+0000 7f055084e640 1 -- start start 2024-09-19T06:10:00.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:00.243+0000 7f055084e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f054c101de0 0x7f054c1985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:00.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:00.243+0000 7f055084e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f054c102790 0x7f054c198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:00.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:00.243+0000 7f055084e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f054c106f10 0x7f054c19ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:00.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:00.243+0000 7f055084e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f054c112010 con 0x7f054c106f10 2024-09-19T06:10:00.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:00.243+0000 7f055084e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f054c111e90 con 0x7f054c102790 2024-09-19T06:10:00.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:00.243+0000 7f055084e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f054c112190 con 0x7f054c101de0 2024-09-19T06:10:00.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:00.243+0000 7f054ad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f054c106f10 0x7f054c19ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:00.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:00.243+0000 7f054ad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f054c106f10 0x7f054c19ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34076/0 (socket says 172.21.15.37:34076) 2024-09-19T06:10:00.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:00.243+0000 7f054ad9d640 1 -- 172.21.15.37:0/1764683256 learned_addr learned my addr 172.21.15.37:0/1764683256 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:10:00.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:00.243+0000 7f054a59c640 1 --2- 172.21.15.37:0/1764683256 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f054c101de0 0x7f054c1985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:00.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:00.243+0000 7f054ad9d640 1 -- 172.21.15.37:0/1764683256 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f054c101de0 msgr2=0x7f054c1985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:00.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:00.243+0000 7f054ad9d640 1 --2- 172.21.15.37:0/1764683256 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f054c101de0 0x7f054c1985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:00.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:00.243+0000 7f054ad9d640 1 -- 172.21.15.37:0/1764683256 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f054c102790 msgr2=0x7f054c198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:00.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:00.243+0000 7f0549d9b640 1 --2- 172.21.15.37:0/1764683256 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f054c102790 0x7f054c198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:00.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:00.243+0000 7f054ad9d640 1 --2- 172.21.15.37:0/1764683256 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f054c102790 0x7f054c198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:00.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:00.243+0000 7f054ad9d640 1 -- 172.21.15.37:0/1764683256 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f054c19d560 con 0x7f054c106f10 2024-09-19T06:10:00.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:00.243+0000 7f0549d9b640 1 --2- 172.21.15.37:0/1764683256 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f054c102790 0x7f054c198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:10:00.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:00.243+0000 7f054ad9d640 1 --2- 172.21.15.37:0/1764683256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f054c106f10 0x7f054c19ce80 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f054400b970 tx=0x7f054400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:00.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:00.244+0000 7f053b7fe640 1 -- 172.21.15.37:0/1764683256 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0544019070 con 0x7f054c106f10 2024-09-19T06:10:00.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:00.244+0000 7f053b7fe640 1 -- 172.21.15.37:0/1764683256 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f054400cb40 con 0x7f054c106f10 2024-09-19T06:10:00.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:00.244+0000 7f055084e640 1 -- 172.21.15.37:0/1764683256 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f054c19d850 con 0x7f054c106f10 2024-09-19T06:10:00.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:00.244+0000 7f053b7fe640 1 -- 172.21.15.37:0/1764683256 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0544007650 con 0x7f054c106f10 2024-09-19T06:10:00.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:00.244+0000 7f055084e640 1 -- 172.21.15.37:0/1764683256 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f054c1a5130 con 0x7f054c106f10 2024-09-19T06:10:00.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:00.245+0000 7f055084e640 1 -- 172.21.15.37:0/1764683256 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f054c102240 con 0x7f054c106f10 2024-09-19T06:10:00.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:00.247+0000 7f053b7fe640 1 -- 172.21.15.37:0/1764683256 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f054401c070 con 0x7f054c106f10 2024-09-19T06:10:00.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:00.247+0000 7f053b7fe640 1 --2- 172.21.15.37:0/1764683256 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f05340a3240 0x7f05340a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:00.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:00.247+0000 7f053b7fe640 1 -- 172.21.15.37:0/1764683256 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9121+0+0 (secure 0 0 0) 0x7f05440cf730 con 0x7f054c106f10 2024-09-19T06:10:00.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:00.248+0000 7f054a59c640 1 --2- 172.21.15.37:0/1764683256 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f05340a3240 0x7f05340a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:00.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:00.248+0000 7f054a59c640 1 --2- 172.21.15.37:0/1764683256 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f05340a3240 0x7f05340a5700 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f053c000c00 tx=0x7f053c0058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:00.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:00.251+0000 7f053b7fe640 1 -- 172.21.15.37:0/1764683256 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f054409ba80 con 0x7f054c106f10 2024-09-19T06:10:00.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:00.462+0000 7f055084e640 1 -- 172.21.15.37:0/1764683256 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f054c109b60 con 0x7f054c106f10 2024-09-19T06:10:00.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:00.463+0000 7f053b7fe640 1 -- 172.21.15.37:0/1764683256 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11842 (secure 0 0 0) 0x7f054409fd80 con 0x7f054c106f10 2024-09-19T06:10:00.465 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T06:10:00.466 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"btime":"2024-09-19T06:04:42:531480+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14514,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2864247978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2864247978},{"type":"v1","addr":"172.21.15.37:6835","nonce":2864247978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14526,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/633000932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":633000932},{"type":"v1","addr":"172.21.15.37:6837","nonce":633000932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14574,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/3753800615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":3753800615},{"type":"v1","addr":"172.21.15.37:6839","nonce":3753800615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/2718998355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":2718998355},{"type":"v1","addr":"172.21.15.37:6841","nonce":2718998355}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6833/866590207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":866590207},{"type":"v1","addr":"172.21.15.99:6833","nonce":866590207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3898668400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3898668400},{"type":"v1","addr":"172.21.15.117:6833","nonce":3898668400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2650673320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2650673320},{"type":"v1","addr":"172.21.15.99:6835","nonce":2650673320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1097471349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1097471349},{"type":"v1","addr":"172.21.15.117:6835","nonce":1097471349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24457,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1001392672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1001392672},{"type":"v1","addr":"172.21.15.117:6837","nonce":1001392672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/23570935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":23570935},{"type":"v1","addr":"172.21.15.99:6837","nonce":23570935}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:04:06.253034+0000","modified":"2024-09-19T06:04:42.196783+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24485},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24478":{"gid":24478,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6839/1269518339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":1269518339},{"type":"v1","addr":"172.21.15.117:6839","nonce":1269518339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.99:6839/3404812329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":3404812329},{"type":"v1","addr":"172.21.15.99:6839","nonce":3404812329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24485,"qdb_cluster":[24485]},"id":1}]} 2024-09-19T06:10:00.466 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 20 2024-09-19T06:10:00.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:00.465+0000 7f055084e640 1 -- 172.21.15.37:0/1764683256 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f05340a3240 msgr2=0x7f05340a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:00.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:00.465+0000 7f055084e640 1 --2- 172.21.15.37:0/1764683256 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f05340a3240 0x7f05340a5700 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f053c000c00 tx=0x7f053c0058d0 comp rx=0 tx=0).stop 2024-09-19T06:10:00.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:00.465+0000 7f055084e640 1 -- 172.21.15.37:0/1764683256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f054c106f10 msgr2=0x7f054c19ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:00.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:00.465+0000 7f055084e640 1 --2- 172.21.15.37:0/1764683256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f054c106f10 0x7f054c19ce80 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f054400b970 tx=0x7f054400be30 comp rx=0 tx=0).stop 2024-09-19T06:10:00.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:00.466+0000 7f055084e640 1 -- 172.21.15.37:0/1764683256 shutdown_connections 2024-09-19T06:10:00.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:00.466+0000 7f055084e640 1 --2- 172.21.15.37:0/1764683256 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f05340a3240 0x7f05340a5700 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:00.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:00.466+0000 7f055084e640 1 --2- 172.21.15.37:0/1764683256 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f054c102790 0x7f054c198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:00.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:00.466+0000 7f055084e640 1 --2- 172.21.15.37:0/1764683256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f054c106f10 0x7f054c19ce80 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:00.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:00.466+0000 7f055084e640 1 --2- 172.21.15.37:0/1764683256 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f054c101de0 0x7f054c1985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:00.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:00.466+0000 7f055084e640 1 -- 172.21.15.37:0/1764683256 >> 172.21.15.37:0/1764683256 conn(0x7f054c0fd8c0 msgr2=0x7f054c0fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:00.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:00.466+0000 7f055084e640 1 -- 172.21.15.37:0/1764683256 shutdown_connections 2024-09-19T06:10:00.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:00.466+0000 7f055084e640 1 -- 172.21.15.37:0/1764683256 wait complete. 2024-09-19T06:10:01.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:10:00 smithi037 ceph-mon[31211]: overall HEALTH_OK 2024-09-19T06:10:01.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:10:00 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/1764683256' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:10:01.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:10:00 smithi099 ceph-mon[35300]: overall HEALTH_OK 2024-09-19T06:10:01.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:10:00 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/1764683256' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:10:01.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:10:00 smithi117 ceph-mon[35050]: overall HEALTH_OK 2024-09-19T06:10:01.252 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:10:00 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/1764683256' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:10:01.332 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:10:01.599 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:10:02.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:10:01 smithi037 ceph-mon[31211]: pgmap v465: 129 pgs: 129 active+clean; 148 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 226 KiB/s wr, 100 op/s 2024-09-19T06:10:02.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:02.097+0000 7fd5df6f7640 1 -- 172.21.15.37:0/3205595951 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5d8102ef0 msgr2=0x7fd5d810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:02.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:02.097+0000 7fd5df6f7640 1 --2- 172.21.15.37:0/3205595951 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5d8102ef0 0x7fd5d810da40 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fd5d0009ca0 tx=0x7fd5d002a950 comp rx=0 tx=0).stop 2024-09-19T06:10:02.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:02.097+0000 7fd5df6f7640 1 -- 172.21.15.37:0/3205595951 shutdown_connections 2024-09-19T06:10:02.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:02.097+0000 7fd5df6f7640 1 --2- 172.21.15.37:0/3205595951 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5d8102570 0x7fd5d81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:02.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:02.097+0000 7fd5df6f7640 1 --2- 172.21.15.37:0/3205595951 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5d8102ef0 0x7fd5d810da40 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:02.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:02.097+0000 7fd5df6f7640 1 --2- 172.21.15.37:0/3205595951 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5d8100e20 0x7fd5d8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:02.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:02.097+0000 7fd5df6f7640 1 -- 172.21.15.37:0/3205595951 >> 172.21.15.37:0/3205595951 conn(0x7fd5d80fc7d0 msgr2=0x7fd5d80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:02.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:02.097+0000 7fd5df6f7640 1 -- 172.21.15.37:0/3205595951 shutdown_connections 2024-09-19T06:10:02.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:02.097+0000 7fd5df6f7640 1 -- 172.21.15.37:0/3205595951 wait complete. 2024-09-19T06:10:02.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:02.097+0000 7fd5df6f7640 1 Processor -- start 2024-09-19T06:10:02.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:02.098+0000 7fd5df6f7640 1 -- start start 2024-09-19T06:10:02.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:02.098+0000 7fd5df6f7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5d8100e20 0x7fd5d8197460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:02.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:02.098+0000 7fd5df6f7640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5d8102570 0x7fd5d81979a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:02.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:02.098+0000 7fd5df6f7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5d8102ef0 0x7fd5d819bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:02.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:02.098+0000 7fd5df6f7640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d8110f80 con 0x7fd5d8100e20 2024-09-19T06:10:02.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:02.098+0000 7fd5df6f7640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d8110e00 con 0x7fd5d8102570 2024-09-19T06:10:02.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:02.098+0000 7fd5df6f7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d8111100 con 0x7fd5d8102ef0 2024-09-19T06:10:02.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:02.098+0000 7fd5dd493640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5d8100e20 0x7fd5d8197460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:02.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:02.098+0000 7fd5dd493640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5d8100e20 0x7fd5d8197460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34092/0 (socket says 172.21.15.37:34092) 2024-09-19T06:10:02.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:02.098+0000 7fd5dd493640 1 -- 172.21.15.37:0/2872487804 learned_addr learned my addr 172.21.15.37:0/2872487804 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:10:02.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:02.098+0000 7fd5dcc92640 1 --2- 172.21.15.37:0/2872487804 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5d8102570 0x7fd5d81979a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:02.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:02.098+0000 7fd5ddc94640 1 --2- 172.21.15.37:0/2872487804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5d8102ef0 0x7fd5d819bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:02.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:02.098+0000 7fd5dd493640 1 -- 172.21.15.37:0/2872487804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5d8102ef0 msgr2=0x7fd5d819bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:02.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:02.098+0000 7fd5dd493640 1 --2- 172.21.15.37:0/2872487804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5d8102ef0 0x7fd5d819bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:02.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:02.098+0000 7fd5dd493640 1 -- 172.21.15.37:0/2872487804 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5d8102570 msgr2=0x7fd5d81979a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:02.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:02.098+0000 7fd5dd493640 1 --2- 172.21.15.37:0/2872487804 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5d8102570 0x7fd5d81979a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:02.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:02.098+0000 7fd5dd493640 1 -- 172.21.15.37:0/2872487804 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5d819c410 con 0x7fd5d8100e20 2024-09-19T06:10:02.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:02.098+0000 7fd5dcc92640 1 --2- 172.21.15.37:0/2872487804 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5d8102570 0x7fd5d81979a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:10:02.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:02.098+0000 7fd5dd493640 1 --2- 172.21.15.37:0/2872487804 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5d8100e20 0x7fd5d8197460 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fd5d400c970 tx=0x7fd5d400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:02.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:02.099+0000 7fd5ce7fc640 1 -- 172.21.15.37:0/2872487804 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d4007bb0 con 0x7fd5d8100e20 2024-09-19T06:10:02.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:02.099+0000 7fd5df6f7640 1 -- 172.21.15.37:0/2872487804 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5d819c700 con 0x7fd5d8100e20 2024-09-19T06:10:02.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:02.099+0000 7fd5ce7fc640 1 -- 172.21.15.37:0/2872487804 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd5d4007d50 con 0x7fd5d8100e20 2024-09-19T06:10:02.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:02.099+0000 7fd5ce7fc640 1 -- 172.21.15.37:0/2872487804 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d400f450 con 0x7fd5d8100e20 2024-09-19T06:10:02.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:02.099+0000 7fd5df6f7640 1 -- 172.21.15.37:0/2872487804 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5d8069f70 con 0x7fd5d8100e20 2024-09-19T06:10:02.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:02.100+0000 7fd5df6f7640 1 -- 172.21.15.37:0/2872487804 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5d8101200 con 0x7fd5d8100e20 2024-09-19T06:10:02.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:02.101+0000 7fd5ce7fc640 1 -- 172.21.15.37:0/2872487804 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fd5d4004fc0 con 0x7fd5d8100e20 2024-09-19T06:10:02.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:02.101+0000 7fd5ce7fc640 1 --2- 172.21.15.37:0/2872487804 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fd5c40a3240 0x7fd5c40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:02.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:02.102+0000 7fd5dcc92640 1 --2- 172.21.15.37:0/2872487804 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fd5c40a3240 0x7fd5c40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:02.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:02.102+0000 7fd5ce7fc640 1 -- 172.21.15.37:0/2872487804 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9121+0+0 (secure 0 0 0) 0x7fd5d40cff70 con 0x7fd5d8100e20 2024-09-19T06:10:02.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:02.102+0000 7fd5dcc92640 1 --2- 172.21.15.37:0/2872487804 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fd5c40a3240 0x7fd5c40a5700 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd5c8005fd0 tx=0x7fd5c8005850 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:02.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:02.105+0000 7fd5ce7fc640 1 -- 172.21.15.37:0/2872487804 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd5d4014030 con 0x7fd5d8100e20 2024-09-19T06:10:02.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:10:01 smithi099 ceph-mon[35300]: pgmap v465: 129 pgs: 129 active+clean; 148 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 226 KiB/s wr, 100 op/s 2024-09-19T06:10:02.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:10:01 smithi117 ceph-mon[35050]: pgmap v465: 129 pgs: 129 active+clean; 148 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 226 KiB/s wr, 100 op/s 2024-09-19T06:10:02.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:02.317+0000 7fd5df6f7640 1 -- 172.21.15.37:0/2872487804 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd5d81987c0 con 0x7fd5d8100e20 2024-09-19T06:10:02.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:02.318+0000 7fd5ce7fc640 1 -- 172.21.15.37:0/2872487804 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11842 (secure 0 0 0) 0x7fd5d81987c0 con 0x7fd5d8100e20 2024-09-19T06:10:02.320 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T06:10:02.320 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"btime":"2024-09-19T06:04:42:531480+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14514,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2864247978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2864247978},{"type":"v1","addr":"172.21.15.37:6835","nonce":2864247978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14526,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/633000932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":633000932},{"type":"v1","addr":"172.21.15.37:6837","nonce":633000932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14574,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/3753800615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":3753800615},{"type":"v1","addr":"172.21.15.37:6839","nonce":3753800615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14586,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/2718998355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":2718998355},{"type":"v1","addr":"172.21.15.37:6841","nonce":2718998355}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6833/866590207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":866590207},{"type":"v1","addr":"172.21.15.99:6833","nonce":866590207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3898668400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3898668400},{"type":"v1","addr":"172.21.15.117:6833","nonce":3898668400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2650673320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2650673320},{"type":"v1","addr":"172.21.15.99:6835","nonce":2650673320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1097471349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1097471349},{"type":"v1","addr":"172.21.15.117:6835","nonce":1097471349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24457,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/1001392672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":1001392672},{"type":"v1","addr":"172.21.15.117:6837","nonce":1001392672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24458,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/23570935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":23570935},{"type":"v1","addr":"172.21.15.99:6837","nonce":23570935}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:04:06.253034+0000","modified":"2024-09-19T06:04:42.196783+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24485},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24478":{"gid":24478,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6839/1269518339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":1269518339},{"type":"v1","addr":"172.21.15.117:6839","nonce":1269518339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.99:6839/3404812329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":3404812329},{"type":"v1","addr":"172.21.15.99:6839","nonce":3404812329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24485,"qdb_cluster":[24485]},"id":1}]} 2024-09-19T06:10:02.320 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 20 2024-09-19T06:10:02.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:02.320+0000 7fd5df6f7640 1 -- 172.21.15.37:0/2872487804 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fd5c40a3240 msgr2=0x7fd5c40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:02.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:02.320+0000 7fd5df6f7640 1 --2- 172.21.15.37:0/2872487804 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fd5c40a3240 0x7fd5c40a5700 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd5c8005fd0 tx=0x7fd5c8005850 comp rx=0 tx=0).stop 2024-09-19T06:10:02.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:02.320+0000 7fd5df6f7640 1 -- 172.21.15.37:0/2872487804 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5d8100e20 msgr2=0x7fd5d8197460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:02.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:02.320+0000 7fd5df6f7640 1 --2- 172.21.15.37:0/2872487804 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5d8100e20 0x7fd5d8197460 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fd5d400c970 tx=0x7fd5d400ce30 comp rx=0 tx=0).stop 2024-09-19T06:10:02.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:02.320+0000 7fd5df6f7640 1 -- 172.21.15.37:0/2872487804 shutdown_connections 2024-09-19T06:10:02.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:02.320+0000 7fd5df6f7640 1 --2- 172.21.15.37:0/2872487804 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fd5c40a3240 0x7fd5c40a5700 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:02.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:02.320+0000 7fd5df6f7640 1 --2- 172.21.15.37:0/2872487804 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5d8102570 0x7fd5d81979a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:02.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:02.320+0000 7fd5df6f7640 1 --2- 172.21.15.37:0/2872487804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5d8102ef0 0x7fd5d819bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:02.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:02.320+0000 7fd5df6f7640 1 --2- 172.21.15.37:0/2872487804 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5d8100e20 0x7fd5d8197460 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:02.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:02.320+0000 7fd5df6f7640 1 -- 172.21.15.37:0/2872487804 >> 172.21.15.37:0/2872487804 conn(0x7fd5d80fc7d0 msgr2=0x7fd5d81068d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:02.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:02.320+0000 7fd5df6f7640 1 -- 172.21.15.37:0/2872487804 shutdown_connections 2024-09-19T06:10:02.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:02.320+0000 7fd5df6f7640 1 -- 172.21.15.37:0/2872487804 wait complete. 2024-09-19T06:10:03.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:10:02 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/2872487804' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:10:03.155 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T06:10:03.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:10:02 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/2872487804' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:10:03.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:10:02 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/2872487804' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:10:03.417 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:10:03.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:03.888+0000 7f6a7ab06640 1 -- 172.21.15.37:0/3376517241 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a7410c180 msgr2=0x7f6a7410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:03.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:03.888+0000 7f6a7ab06640 1 --2- 172.21.15.37:0/3376517241 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a7410c180 0x7f6a7410e610 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c009ca0 tx=0x7f6a6c02a950 comp rx=0 tx=0).stop 2024-09-19T06:10:03.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:03.888+0000 7f6a7ab06640 1 -- 172.21.15.37:0/3376517241 shutdown_connections 2024-09-19T06:10:03.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:03.888+0000 7f6a7ab06640 1 --2- 172.21.15.37:0/3376517241 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a74103700 0x7f6a7410bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:03.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:03.888+0000 7f6a7ab06640 1 --2- 172.21.15.37:0/3376517241 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a7410c180 0x7f6a7410e610 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:03.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:03.888+0000 7f6a7ab06640 1 --2- 172.21.15.37:0/3376517241 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a74102de0 0x7f6a741031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:03.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:03.888+0000 7f6a7ab06640 1 -- 172.21.15.37:0/3376517241 >> 172.21.15.37:0/3376517241 conn(0x7f6a740fc7a0 msgr2=0x7f6a740febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:03.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:03.888+0000 7f6a7ab06640 1 -- 172.21.15.37:0/3376517241 shutdown_connections 2024-09-19T06:10:03.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:03.888+0000 7f6a7ab06640 1 -- 172.21.15.37:0/3376517241 wait complete. 2024-09-19T06:10:03.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:03.888+0000 7f6a7ab06640 1 Processor -- start 2024-09-19T06:10:03.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:03.888+0000 7f6a7ab06640 1 -- start start 2024-09-19T06:10:03.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:03.889+0000 7f6a7ab06640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a74102de0 0x7f6a74198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:03.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:03.889+0000 7f6a7ab06640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a74103700 0x7f6a741989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:03.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:03.889+0000 7f6a7ab06640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a7410c180 0x7f6a7419cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:03.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:03.889+0000 7f6a7ab06640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6a74112000 con 0x7f6a74103700 2024-09-19T06:10:03.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:03.889+0000 7f6a7ab06640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f6a74111e80 con 0x7f6a7410c180 2024-09-19T06:10:03.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:03.889+0000 7f6a7ab06640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6a74112180 con 0x7f6a74102de0 2024-09-19T06:10:03.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:03.889+0000 7f6a73fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a74103700 0x7f6a741989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:03.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:03.889+0000 7f6a73fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a74103700 0x7f6a741989a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50488/0 (socket says 172.21.15.37:50488) 2024-09-19T06:10:03.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:03.889+0000 7f6a73fff640 1 -- 172.21.15.37:0/3207594116 learned_addr learned my addr 172.21.15.37:0/3207594116 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:10:03.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:03.889+0000 7f6a790a3640 1 --2- 172.21.15.37:0/3207594116 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a7410c180 0x7f6a7419cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:03.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:03.889+0000 7f6a788a2640 1 --2- 172.21.15.37:0/3207594116 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a74102de0 0x7f6a74198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:03.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:03.889+0000 7f6a73fff640 1 -- 172.21.15.37:0/3207594116 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a74102de0 msgr2=0x7f6a74198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:03.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:03.889+0000 7f6a73fff640 1 --2- 172.21.15.37:0/3207594116 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a74102de0 0x7f6a74198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:03.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:03.889+0000 7f6a73fff640 1 -- 172.21.15.37:0/3207594116 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a7410c180 msgr2=0x7f6a7419cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:03.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:03.889+0000 7f6a73fff640 1 --2- 172.21.15.37:0/3207594116 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a7410c180 0x7f6a7419cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:03.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:03.889+0000 7f6a73fff640 1 -- 172.21.15.37:0/3207594116 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a7419d410 con 0x7f6a74103700 2024-09-19T06:10:03.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:03.889+0000 7f6a790a3640 1 --2- 172.21.15.37:0/3207594116 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a7410c180 0x7f6a7419cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:10:03.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:03.889+0000 7f6a73fff640 1 --2- 172.21.15.37:0/3207594116 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a74103700 0x7f6a741989a0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f6a6800c920 tx=0x7f6a6800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:03.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:03.890+0000 7f6a71ffb640 1 -- 172.21.15.37:0/3207594116 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a68007c70 con 0x7f6a74103700 2024-09-19T06:10:03.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:03.890+0000 7f6a7ab06640 1 -- 172.21.15.37:0/3207594116 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a7419d700 con 0x7f6a74103700 2024-09-19T06:10:03.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:03.890+0000 7f6a71ffb640 1 -- 172.21.15.37:0/3207594116 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a68007e10 con 0x7f6a74103700 2024-09-19T06:10:03.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:03.890+0000 7f6a71ffb640 1 -- 172.21.15.37:0/3207594116 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a68018890 con 0x7f6a74103700 2024-09-19T06:10:03.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:03.890+0000 7f6a7ab06640 1 -- 172.21.15.37:0/3207594116 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a741a4fe0 con 0x7f6a74103700 2024-09-19T06:10:03.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:03.891+0000 7f6a7ab06640 1 -- 172.21.15.37:0/3207594116 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a741031c0 con 0x7f6a74103700 2024-09-19T06:10:03.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:03.892+0000 7f6a71ffb640 1 -- 172.21.15.37:0/3207594116 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f6a68018a70 con 0x7f6a74103700 2024-09-19T06:10:03.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:03.893+0000 7f6a71ffb640 1 --2- 172.21.15.37:0/3207594116 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f6a5c0a3240 0x7f6a5c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:03.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:03.893+0000 7f6a788a2640 1 --2- 172.21.15.37:0/3207594116 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f6a5c0a3240 0x7f6a5c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:03.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:03.893+0000 7f6a71ffb640 1 -- 172.21.15.37:0/3207594116 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9121+0+0 (secure 0 0 0) 0x7f6a680cfe90 con 0x7f6a74103700 2024-09-19T06:10:03.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:03.893+0000 7f6a788a2640 1 --2- 172.21.15.37:0/3207594116 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f6a5c0a3240 0x7f6a5c0a5700 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6a64009890 tx=0x7f6a64008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:03.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:03.897+0000 7f6a71ffb640 1 -- 172.21.15.37:0/3207594116 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6a68014030 con 0x7f6a74103700 2024-09-19T06:10:04.073 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:10:03 smithi037 ceph-mon[31211]: pgmap v466: 129 pgs: 129 active+clean; 148 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 226 KiB/s wr, 85 op/s 2024-09-19T06:10:04.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:04.074+0000 7f6a7ab06640 1 -- 172.21.15.37:0/3207594116 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6a741a5210 con 0x7f6a74103700 2024-09-19T06:10:04.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:04.075+0000 7f6a71ffb640 1 -- 172.21.15.37:0/3207594116 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+24772 (secure 0 0 0) 0x7f6a6800de20 con 0x7f6a74103700 2024-09-19T06:10:04.078 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T06:10:04.078 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":91,"fsid":"b8c8bdae-764b-11ef-bceb-c7b262605968","created":"2024-09-19T05:56:22.523060+0000","modified":"2024-09-19T06:06:14.642042+0000","last_up_change":"2024-09-19T06:03:12.771014+0000","last_in_change":"2024-09-19T06:02:49.926626+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:59:27.062607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:04:01.918234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:04:04.392543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T06:04:10.877951+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"455bc11d-2b6e-4a0c-90d9-8ab4ef4f9e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1783875173},{"type":"v1","addr":"172.21.15.37:6803","nonce":1783875173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1783875173},{"type":"v1","addr":"172.21.15.37:6805","nonce":1783875173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1783875173},{"type":"v1","addr":"172.21.15.37:6809","nonce":1783875173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1783875173},{"type":"v1","addr":"172.21.15.37:6807","nonce":1783875173}]},"public_addr":"172.21.15.37:6803/1783875173","cluster_addr":"172.21.15.37:6805/1783875173","heartbeat_back_addr":"172.21.15.37:6809/1783875173","heartbeat_front_addr":"172.21.15.37:6807/1783875173","state":["exists","up"]},{"osd":1,"uuid":"3505c162-c342-479d-8ea2-15b7a9d625cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":3414373360},{"type":"v1","addr":"172.21.15.99:6801","nonce":3414373360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":3414373360},{"type":"v1","addr":"172.21.15.99:6803","nonce":3414373360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":3414373360},{"type":"v1","addr":"172.21.15.99:6807","nonce":3414373360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":3414373360},{"type":"v1","addr":"172.21.15.99:6805","nonce":3414373360}]},"public_addr":"172.21.15.99:6801/3414373360","cluster_addr":"172.21.15.99:6803/3414373360","heartbeat_back_addr":"172.21.15.99:6807/3414373360","heartbeat_front_addr":"172.21.15.99:6805/3414373360","state":["exists","up"]},{"osd":2,"uuid":"736ec67f-b5e7-43f0-9303-0c88878ead6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3794943081},{"type":"v1","addr":"172.21.15.117:6801","nonce":3794943081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":3794943081},{"type":"v1","addr":"172.21.15.117:6803","nonce":3794943081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":3794943081},{"type":"v1","addr":"172.21.15.117:6807","nonce":3794943081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":3794943081},{"type":"v1","addr":"172.21.15.117:6805","nonce":3794943081}]},"public_addr":"172.21.15.117:6801/3794943081","cluster_addr":"172.21.15.117:6803/3794943081","heartbeat_back_addr":"172.21.15.117:6807/3794943081","heartbeat_front_addr":"172.21.15.117:6805/3794943081","state":["exists","up"]},{"osd":3,"uuid":"3f784ef7-0cc1-4c86-a03a-b8f13396c835","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2121011955},{"type":"v1","addr":"172.21.15.37:6811","nonce":2121011955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2121011955},{"type":"v1","addr":"172.21.15.37:6813","nonce":2121011955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2121011955},{"type":"v1","addr":"172.21.15.37:6817","nonce":2121011955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2121011955},{"type":"v1","addr":"172.21.15.37:6815","nonce":2121011955}]},"public_addr":"172.21.15.37:6811/2121011955","cluster_addr":"172.21.15.37:6813/2121011955","heartbeat_back_addr":"172.21.15.37:6817/2121011955","heartbeat_front_addr":"172.21.15.37:6815/2121011955","state":["exists","up"]},{"osd":4,"uuid":"d7c16e7f-f599-419b-b4a2-fd6c1cafa0d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":1881025735},{"type":"v1","addr":"172.21.15.99:6809","nonce":1881025735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1881025735},{"type":"v1","addr":"172.21.15.99:6811","nonce":1881025735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1881025735},{"type":"v1","addr":"172.21.15.99:6815","nonce":1881025735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":1881025735},{"type":"v1","addr":"172.21.15.99:6813","nonce":1881025735}]},"public_addr":"172.21.15.99:6809/1881025735","cluster_addr":"172.21.15.99:6811/1881025735","heartbeat_back_addr":"172.21.15.99:6815/1881025735","heartbeat_front_addr":"172.21.15.99:6813/1881025735","state":["exists","up"]},{"osd":5,"uuid":"2f499ab4-3d09-4f96-a709-b4229865c690","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1141976511},{"type":"v1","addr":"172.21.15.117:6809","nonce":1141976511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":1141976511},{"type":"v1","addr":"172.21.15.117:6811","nonce":1141976511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":1141976511},{"type":"v1","addr":"172.21.15.117:6815","nonce":1141976511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":1141976511},{"type":"v1","addr":"172.21.15.117:6813","nonce":1141976511}]},"public_addr":"172.21.15.117:6809/1141976511","cluster_addr":"172.21.15.117:6811/1141976511","heartbeat_back_addr":"172.21.15.117:6815/1141976511","heartbeat_front_addr":"172.21.15.117:6813/1141976511","state":["exists","up"]},{"osd":6,"uuid":"10f7fd72-1ae8-4efd-a448-75f4b5054be3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":770433145},{"type":"v1","addr":"172.21.15.37:6819","nonce":770433145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":770433145},{"type":"v1","addr":"172.21.15.37:6821","nonce":770433145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":770433145},{"type":"v1","addr":"172.21.15.37:6825","nonce":770433145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":770433145},{"type":"v1","addr":"172.21.15.37:6823","nonce":770433145}]},"public_addr":"172.21.15.37:6819/770433145","cluster_addr":"172.21.15.37:6821/770433145","heartbeat_back_addr":"172.21.15.37:6825/770433145","heartbeat_front_addr":"172.21.15.37:6823/770433145","state":["exists","up"]},{"osd":7,"uuid":"7199a267-c486-417c-b530-3ff03fc9eb1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1694360992},{"type":"v1","addr":"172.21.15.99:6817","nonce":1694360992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1694360992},{"type":"v1","addr":"172.21.15.99:6819","nonce":1694360992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":1694360992},{"type":"v1","addr":"172.21.15.99:6823","nonce":1694360992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":1694360992},{"type":"v1","addr":"172.21.15.99:6821","nonce":1694360992}]},"public_addr":"172.21.15.99:6817/1694360992","cluster_addr":"172.21.15.99:6819/1694360992","heartbeat_back_addr":"172.21.15.99:6823/1694360992","heartbeat_front_addr":"172.21.15.99:6821/1694360992","state":["exists","up"]},{"osd":8,"uuid":"8d5bb83c-62eb-4ded-8a16-e8d57ab102c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2005866772},{"type":"v1","addr":"172.21.15.117:6817","nonce":2005866772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2005866772},{"type":"v1","addr":"172.21.15.117:6819","nonce":2005866772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2005866772},{"type":"v1","addr":"172.21.15.117:6823","nonce":2005866772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2005866772},{"type":"v1","addr":"172.21.15.117:6821","nonce":2005866772}]},"public_addr":"172.21.15.117:6817/2005866772","cluster_addr":"172.21.15.117:6819/2005866772","heartbeat_back_addr":"172.21.15.117:6823/2005866772","heartbeat_front_addr":"172.21.15.117:6821/2005866772","state":["exists","up"]},{"osd":9,"uuid":"04b6203d-a10c-4a55-8e59-b30012dee02b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1398779376},{"type":"v1","addr":"172.21.15.37:6827","nonce":1398779376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1398779376},{"type":"v1","addr":"172.21.15.37:6829","nonce":1398779376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1398779376},{"type":"v1","addr":"172.21.15.37:6833","nonce":1398779376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1398779376},{"type":"v1","addr":"172.21.15.37:6831","nonce":1398779376}]},"public_addr":"172.21.15.37:6827/1398779376","cluster_addr":"172.21.15.37:6829/1398779376","heartbeat_back_addr":"172.21.15.37:6833/1398779376","heartbeat_front_addr":"172.21.15.37:6831/1398779376","state":["exists","up"]},{"osd":10,"uuid":"bbf8ff4b-29cd-4d56-a30e-ff2de3555f78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2200957302},{"type":"v1","addr":"172.21.15.99:6825","nonce":2200957302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2200957302},{"type":"v1","addr":"172.21.15.99:6827","nonce":2200957302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2200957302},{"type":"v1","addr":"172.21.15.99:6831","nonce":2200957302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2200957302},{"type":"v1","addr":"172.21.15.99:6829","nonce":2200957302}]},"public_addr":"172.21.15.99:6825/2200957302","cluster_addr":"172.21.15.99:6827/2200957302","heartbeat_back_addr":"172.21.15.99:6831/2200957302","heartbeat_front_addr":"172.21.15.99:6829/2200957302","state":["exists","up"]},{"osd":11,"uuid":"041d54f4-a274-47b5-a467-0ce86efd363b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":1354423136},{"type":"v1","addr":"172.21.15.117:6825","nonce":1354423136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":1354423136},{"type":"v1","addr":"172.21.15.117:6827","nonce":1354423136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":1354423136},{"type":"v1","addr":"172.21.15.117:6831","nonce":1354423136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":1354423136},{"type":"v1","addr":"172.21.15.117:6829","nonce":1354423136}]},"public_addr":"172.21.15.117:6825/1354423136","cluster_addr":"172.21.15.117:6827/1354423136","heartbeat_back_addr":"172.21.15.117:6831/1354423136","heartbeat_front_addr":"172.21.15.117:6829/1354423136","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:58:33.697099+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:58:59.641549+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:59:23.811178+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:59:49.550214+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:00:15.034610+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:00:39.399651+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:01:05.106379+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:01:30.375956+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:01:54.881549+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:02:21.519316+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:02:46.125918+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:03:11.310862+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.f","mappings":[{"from":9,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6801/133577710":"2024-09-20T05:57:12.560771+0000","172.21.15.37:6800/133577710":"2024-09-20T05:57:12.560771+0000","172.21.15.37:0/2877363162":"2024-09-20T05:57:12.560771+0000","172.21.15.37:0/1053171617":"2024-09-20T05:57:12.560771+0000","172.21.15.37:6800/3277805697":"2024-09-20T05:56:49.335334+0000","172.21.15.37:0/1280697705":"2024-09-20T05:56:49.335334+0000","172.21.15.37:0/1106526058":"2024-09-20T05:57:12.560771+0000","172.21.15.37:0/1978184693":"2024-09-20T05:56:49.335334+0000","172.21.15.37:6801/3277805697":"2024-09-20T05:56:49.335334+0000","172.21.15.37:0/3650338877":"2024-09-20T05:56:49.335334+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:10:04.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:04.077+0000 7f6a7ab06640 1 -- 172.21.15.37:0/3207594116 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f6a5c0a3240 msgr2=0x7f6a5c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:04.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:04.077+0000 7f6a7ab06640 1 --2- 172.21.15.37:0/3207594116 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f6a5c0a3240 0x7f6a5c0a5700 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6a64009890 tx=0x7f6a64008040 comp rx=0 tx=0).stop 2024-09-19T06:10:04.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:04.077+0000 7f6a7ab06640 1 -- 172.21.15.37:0/3207594116 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a74103700 msgr2=0x7f6a741989a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:04.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:04.077+0000 7f6a7ab06640 1 --2- 172.21.15.37:0/3207594116 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a74103700 0x7f6a741989a0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f6a6800c920 tx=0x7f6a6800cde0 comp rx=0 tx=0).stop 2024-09-19T06:10:04.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:04.078+0000 7f6a7ab06640 1 -- 172.21.15.37:0/3207594116 shutdown_connections 2024-09-19T06:10:04.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:04.078+0000 7f6a7ab06640 1 --2- 172.21.15.37:0/3207594116 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f6a5c0a3240 0x7f6a5c0a5700 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:04.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:04.078+0000 7f6a7ab06640 1 --2- 172.21.15.37:0/3207594116 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a7410c180 0x7f6a7419cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:04.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:04.078+0000 7f6a7ab06640 1 --2- 172.21.15.37:0/3207594116 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a74103700 0x7f6a741989a0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:04.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:04.078+0000 7f6a7ab06640 1 --2- 172.21.15.37:0/3207594116 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a74102de0 0x7f6a74198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:04.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:04.078+0000 7f6a7ab06640 1 -- 172.21.15.37:0/3207594116 >> 172.21.15.37:0/3207594116 conn(0x7f6a740fc7a0 msgr2=0x7f6a740fde10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:04.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:04.078+0000 7f6a7ab06640 1 -- 172.21.15.37:0/3207594116 shutdown_connections 2024-09-19T06:10:04.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:04.078+0000 7f6a7ab06640 1 -- 172.21.15.37:0/3207594116 wait complete. 2024-09-19T06:10:04.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:10:03 smithi099 ceph-mon[35300]: pgmap v466: 129 pgs: 129 active+clean; 148 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 226 KiB/s wr, 85 op/s 2024-09-19T06:10:04.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:10:03 smithi117 ceph-mon[35050]: pgmap v466: 129 pgs: 129 active+clean; 148 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 226 KiB/s wr, 85 op/s 2024-09-19T06:10:04.870 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph fs fail cephfs 2024-09-19T06:10:05.128 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:10:05.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:10:04 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/3207594116' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:10:05.249 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:10:04 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/3207594116' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:10:05.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:10:04 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/3207594116' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:10:05.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:05.634+0000 7fd75209f640 1 -- 172.21.15.37:0/2721957628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd74c10c170 msgr2=0x7fd74c10e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:05.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:05.634+0000 7fd75209f640 1 --2- 172.21.15.37:0/2721957628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd74c10c170 0x7fd74c10e610 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fd744009ca0 tx=0x7fd74402a950 comp rx=0 tx=0).stop 2024-09-19T06:10:05.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:05.634+0000 7fd75209f640 1 -- 172.21.15.37:0/2721957628 shutdown_connections 2024-09-19T06:10:05.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:05.634+0000 7fd75209f640 1 --2- 172.21.15.37:0/2721957628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd74c10c170 0x7fd74c10e610 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:05.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:05.634+0000 7fd75209f640 1 --2- 172.21.15.37:0/2721957628 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd74c103660 0x7fd74c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:05.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:05.634+0000 7fd75209f640 1 --2- 172.21.15.37:0/2721957628 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd74c102d40 0x7fd74c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:05.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:05.634+0000 7fd75209f640 1 -- 172.21.15.37:0/2721957628 >> 172.21.15.37:0/2721957628 conn(0x7fd74c0fc7a0 msgr2=0x7fd74c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:05.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:05.635+0000 7fd75209f640 1 -- 172.21.15.37:0/2721957628 shutdown_connections 2024-09-19T06:10:05.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:05.635+0000 7fd75209f640 1 -- 172.21.15.37:0/2721957628 wait complete. 2024-09-19T06:10:05.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:05.635+0000 7fd75209f640 1 Processor -- start 2024-09-19T06:10:05.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:05.635+0000 7fd75209f640 1 -- start start 2024-09-19T06:10:05.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:05.635+0000 7fd75209f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd74c102d40 0x7fd74c198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:05.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:05.635+0000 7fd75209f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd74c103660 0x7fd74c1989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:05.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:05.635+0000 7fd75209f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd74c10c170 0x7fd74c19cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:05.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:05.635+0000 7fd75209f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd74c111fb0 con 0x7fd74c10c170 2024-09-19T06:10:05.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:05.635+0000 7fd75209f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fd74c111e30 con 0x7fd74c103660 2024-09-19T06:10:05.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:05.635+0000 7fd75209f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd74c112130 con 0x7fd74c102d40 2024-09-19T06:10:05.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:05.635+0000 7fd74bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd74c10c170 0x7fd74c19cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:05.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:05.635+0000 7fd74bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd74c10c170 0x7fd74c19cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50512/0 (socket says 172.21.15.37:50512) 2024-09-19T06:10:05.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:05.635+0000 7fd74bfff640 1 -- 172.21.15.37:0/417706734 learned_addr learned my addr 172.21.15.37:0/417706734 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:10:05.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:05.635+0000 7fd74b7fe640 1 --2- 172.21.15.37:0/417706734 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd74c102d40 0x7fd74c198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:05.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:05.635+0000 7fd74affd640 1 --2- 172.21.15.37:0/417706734 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd74c103660 0x7fd74c1989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:05.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:05.635+0000 7fd74bfff640 1 -- 172.21.15.37:0/417706734 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd74c102d40 msgr2=0x7fd74c198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:05.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:05.635+0000 7fd74bfff640 1 --2- 172.21.15.37:0/417706734 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd74c102d40 0x7fd74c198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:05.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:05.635+0000 7fd74bfff640 1 -- 172.21.15.37:0/417706734 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd74c103660 msgr2=0x7fd74c1989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:05.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:05.635+0000 7fd74bfff640 1 --2- 172.21.15.37:0/417706734 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd74c103660 0x7fd74c1989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:05.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:05.635+0000 7fd74bfff640 1 -- 172.21.15.37:0/417706734 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd74c19d420 con 0x7fd74c10c170 2024-09-19T06:10:05.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:05.635+0000 7fd74affd640 1 --2- 172.21.15.37:0/417706734 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd74c103660 0x7fd74c1989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:10:05.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:05.635+0000 7fd74bfff640 1 --2- 172.21.15.37:0/417706734 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd74c10c170 0x7fd74c19cd40 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fd74402ae70 tx=0x7fd74402f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:05.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:05.635+0000 7fd748ff9640 1 -- 172.21.15.37:0/417706734 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd744034040 con 0x7fd74c10c170 2024-09-19T06:10:05.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:05.635+0000 7fd748ff9640 1 -- 172.21.15.37:0/417706734 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd744030920 con 0x7fd74c10c170 2024-09-19T06:10:05.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:05.635+0000 7fd748ff9640 1 -- 172.21.15.37:0/417706734 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd744045480 con 0x7fd74c10c170 2024-09-19T06:10:05.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:05.635+0000 7fd75209f640 1 -- 172.21.15.37:0/417706734 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd74c19d6b0 con 0x7fd74c10c170 2024-09-19T06:10:05.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:05.637+0000 7fd75209f640 1 -- 172.21.15.37:0/417706734 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd74c1a4ff0 con 0x7fd74c10c170 2024-09-19T06:10:05.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:05.637+0000 7fd75209f640 1 -- 172.21.15.37:0/417706734 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd74c103120 con 0x7fd74c10c170 2024-09-19T06:10:05.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:05.638+0000 7fd748ff9640 1 -- 172.21.15.37:0/417706734 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fd744037020 con 0x7fd74c10c170 2024-09-19T06:10:05.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:05.638+0000 7fd748ff9640 1 --2- 172.21.15.37:0/417706734 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fd7340a3240 0x7fd7340a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:05.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:05.639+0000 7fd74b7fe640 1 --2- 172.21.15.37:0/417706734 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fd7340a3240 0x7fd7340a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:05.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:05.639+0000 7fd748ff9640 1 -- 172.21.15.37:0/417706734 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9121+0+0 (secure 0 0 0) 0x7fd7440f0bf0 con 0x7fd74c10c170 2024-09-19T06:10:05.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:05.639+0000 7fd74b7fe640 1 --2- 172.21.15.37:0/417706734 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fd7340a3240 0x7fd7340a5700 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd73c00bbe0 tx=0x7fd73c00b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:05.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:05.644+0000 7fd748ff9640 1 -- 172.21.15.37:0/417706734 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd7440bd590 con 0x7fd74c10c170 2024-09-19T06:10:05.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:05.856+0000 7fd75209f640 1 -- 172.21.15.37:0/417706734 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fd74c1071e0 con 0x7fd74c10c170 2024-09-19T06:10:05.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:05.858+0000 7fd748ff9640 1 -- 172.21.15.37:0/417706734 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v21) ==== 161+0+0 (secure 0 0 0) 0x7fd7440bce90 con 0x7fd74c10c170 2024-09-19T06:10:05.859 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-19T06:10:05.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:05.861+0000 7fd75209f640 1 -- 172.21.15.37:0/417706734 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fd7340a3240 msgr2=0x7fd7340a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:05.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:05.861+0000 7fd75209f640 1 --2- 172.21.15.37:0/417706734 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fd7340a3240 0x7fd7340a5700 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd73c00bbe0 tx=0x7fd73c00b390 comp rx=0 tx=0).stop 2024-09-19T06:10:05.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:05.861+0000 7fd75209f640 1 -- 172.21.15.37:0/417706734 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd74c10c170 msgr2=0x7fd74c19cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:05.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:05.861+0000 7fd75209f640 1 --2- 172.21.15.37:0/417706734 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd74c10c170 0x7fd74c19cd40 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fd74402ae70 tx=0x7fd74402f5b0 comp rx=0 tx=0).stop 2024-09-19T06:10:05.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:05.861+0000 7fd75209f640 1 -- 172.21.15.37:0/417706734 shutdown_connections 2024-09-19T06:10:05.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:05.861+0000 7fd75209f640 1 --2- 172.21.15.37:0/417706734 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7fd7340a3240 0x7fd7340a5700 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:05.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:05.861+0000 7fd75209f640 1 --2- 172.21.15.37:0/417706734 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd74c103660 0x7fd74c1989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:05.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:05.861+0000 7fd75209f640 1 --2- 172.21.15.37:0/417706734 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd74c10c170 0x7fd74c19cd40 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:05.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:05.861+0000 7fd75209f640 1 --2- 172.21.15.37:0/417706734 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd74c102d40 0x7fd74c198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:05.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:05.861+0000 7fd75209f640 1 -- 172.21.15.37:0/417706734 >> 172.21.15.37:0/417706734 conn(0x7fd74c0fc7a0 msgr2=0x7fd74c0fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:05.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:05.862+0000 7fd75209f640 1 -- 172.21.15.37:0/417706734 shutdown_connections 2024-09-19T06:10:05.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:05.862+0000 7fd75209f640 1 -- 172.21.15.37:0/417706734 wait complete. 2024-09-19T06:10:06.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:10:05 smithi099 ceph-mon[35300]: pgmap v467: 129 pgs: 129 active+clean; 148 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 8.2 KiB/s wr, 12 op/s 2024-09-19T06:10:06.189 INFO:journalctl@ceph.mds.b.smithi099.stdout:Sep 19 06:10:05 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-b[65353]: ignoring --setuser ceph since I am not root 2024-09-19T06:10:06.189 INFO:journalctl@ceph.mds.b.smithi099.stdout:Sep 19 06:10:05 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-b[65353]: ignoring --setgroup ceph since I am not root 2024-09-19T06:10:06.189 INFO:journalctl@ceph.mds.b.smithi099.stdout:Sep 19 06:10:05 smithi099 ceph-mds[65358]: -- 172.21.15.99:0/3600480156 <== mon.2 v2:172.21.15.99:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b5312d5860 con 0x55b5312b3400 2024-09-19T06:10:06.189 INFO:journalctl@ceph.mds.b.smithi099.stdout:Sep 19 06:10:05 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-b[65353]: starting mds.b at 2024-09-19T06:10:06.231 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:10:05 smithi037 ceph-mon[31211]: pgmap v467: 129 pgs: 129 active+clean; 148 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 8.2 KiB/s wr, 12 op/s 2024-09-19T06:10:06.231 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:10:05 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mon-a[31207]: 2024-09-19T06:10:05.857+0000 7fd8e8b29640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T06:10:06.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:10:05 smithi117 ceph-mon[35050]: pgmap v467: 129 pgs: 129 active+clean; 148 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 8.2 KiB/s wr, 12 op/s 2024-09-19T06:10:06.250 INFO:journalctl@ceph.mds.i.smithi117.stdout:Sep 19 06:10:05 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-i[64840]: ignoring --setuser ceph since I am not root 2024-09-19T06:10:06.250 INFO:journalctl@ceph.mds.i.smithi117.stdout:Sep 19 06:10:05 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-i[64840]: ignoring --setgroup ceph since I am not root 2024-09-19T06:10:06.250 INFO:journalctl@ceph.mds.i.smithi117.stdout:Sep 19 06:10:05 smithi117 ceph-mds[64844]: -- 172.21.15.117:0/1345270882 <== mon.1 v2:172.21.15.117:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55deddf01c20 con 0x55deddedf000 2024-09-19T06:10:06.250 INFO:journalctl@ceph.mds.i.smithi117.stdout:Sep 19 06:10:05 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-i[64840]: starting mds.i at 2024-09-19T06:10:06.659 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-19T06:10:06.924 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:10:07.045 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:10:06 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/417706734' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T06:10:07.045 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:10:06 smithi037 ceph-mon[31211]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T06:10:07.045 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:10:06 smithi037 ceph-mon[31211]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T06:10:07.045 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:10:06 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/417706734' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T06:10:07.045 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:10:06 smithi037 ceph-mon[31211]: osdmap e92: 12 total, 12 up, 12 in 2024-09-19T06:10:07.046 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:10:06 smithi037 ceph-mon[31211]: fsmap cephfs:0/1 10 up:standby, 1 failed 2024-09-19T06:10:07.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:10:06 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/417706734' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T06:10:07.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:10:06 smithi099 ceph-mon[35300]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T06:10:07.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:10:06 smithi099 ceph-mon[35300]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T06:10:07.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:10:06 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/417706734' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T06:10:07.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:10:06 smithi099 ceph-mon[35300]: osdmap e92: 12 total, 12 up, 12 in 2024-09-19T06:10:07.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:10:06 smithi099 ceph-mon[35300]: fsmap cephfs:0/1 10 up:standby, 1 failed 2024-09-19T06:10:07.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:10:06 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/417706734' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T06:10:07.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:10:06 smithi117 ceph-mon[35050]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T06:10:07.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:10:06 smithi117 ceph-mon[35050]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T06:10:07.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:10:06 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/417706734' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T06:10:07.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:10:06 smithi117 ceph-mon[35050]: osdmap e92: 12 total, 12 up, 12 in 2024-09-19T06:10:07.251 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:10:06 smithi117 ceph-mon[35050]: fsmap cephfs:0/1 10 up:standby, 1 failed 2024-09-19T06:10:07.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:07.386+0000 7f0d3e86d640 1 -- 172.21.15.37:0/1958285730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d381036e0 msgr2=0x7f0d38107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:07.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:07.386+0000 7f0d3e86d640 1 --2- 172.21.15.37:0/1958285730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d381036e0 0x7f0d38107b90 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f0d20009930 tx=0x7f0d2002a420 comp rx=0 tx=0).stop 2024-09-19T06:10:07.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:07.386+0000 7f0d3e86d640 1 -- 172.21.15.37:0/1958285730 shutdown_connections 2024-09-19T06:10:07.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:07.386+0000 7f0d3e86d640 1 --2- 172.21.15.37:0/1958285730 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d381082a0 0x7f0d3810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:07.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:07.386+0000 7f0d3e86d640 1 --2- 172.21.15.37:0/1958285730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d381036e0 0x7f0d38107b90 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:07.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:07.386+0000 7f0d3e86d640 1 --2- 172.21.15.37:0/1958285730 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d38102d30 0x7f0d38103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:07.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:07.386+0000 7f0d3e86d640 1 -- 172.21.15.37:0/1958285730 >> 172.21.15.37:0/1958285730 conn(0x7f0d380fc7d0 msgr2=0x7f0d380febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:07.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:07.386+0000 7f0d3e86d640 1 -- 172.21.15.37:0/1958285730 shutdown_connections 2024-09-19T06:10:07.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:07.386+0000 7f0d3e86d640 1 -- 172.21.15.37:0/1958285730 wait complete. 2024-09-19T06:10:07.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:07.387+0000 7f0d3e86d640 1 Processor -- start 2024-09-19T06:10:07.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:07.387+0000 7f0d3e86d640 1 -- start start 2024-09-19T06:10:07.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:07.387+0000 7f0d3e86d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d38102d30 0x7f0d38198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:07.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:07.387+0000 7f0d3e86d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d381036e0 0x7f0d38198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:07.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:07.387+0000 7f0d3e86d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d381082a0 0x7f0d3819ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:07.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:07.387+0000 7f0d3e86d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0d38112090 con 0x7f0d38102d30 2024-09-19T06:10:07.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:07.387+0000 7f0d3e86d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f0d38111f10 con 0x7f0d381036e0 2024-09-19T06:10:07.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:07.387+0000 7f0d3e86d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0d38112210 con 0x7f0d381082a0 2024-09-19T06:10:07.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:07.387+0000 7f0d37fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d38102d30 0x7f0d38198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:07.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:07.387+0000 7f0d37fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d38102d30 0x7f0d38198580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50528/0 (socket says 172.21.15.37:50528) 2024-09-19T06:10:07.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:07.387+0000 7f0d37fff640 1 -- 172.21.15.37:0/2980946398 learned_addr learned my addr 172.21.15.37:0/2980946398 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:10:07.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:07.387+0000 7f0d2ffff640 1 --2- 172.21.15.37:0/2980946398 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d381036e0 0x7f0d38198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:07.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:07.387+0000 7f0d3ce0a640 1 --2- 172.21.15.37:0/2980946398 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d381082a0 0x7f0d3819ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:07.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:07.387+0000 7f0d37fff640 1 -- 172.21.15.37:0/2980946398 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d381082a0 msgr2=0x7f0d3819ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:07.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:07.387+0000 7f0d37fff640 1 --2- 172.21.15.37:0/2980946398 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d381082a0 0x7f0d3819ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:07.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:07.387+0000 7f0d37fff640 1 -- 172.21.15.37:0/2980946398 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d381036e0 msgr2=0x7f0d38198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:07.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:07.387+0000 7f0d37fff640 1 --2- 172.21.15.37:0/2980946398 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d381036e0 0x7f0d38198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:07.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:07.388+0000 7f0d37fff640 1 -- 172.21.15.37:0/2980946398 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d3819d530 con 0x7f0d38102d30 2024-09-19T06:10:07.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:07.388+0000 7f0d37fff640 1 --2- 172.21.15.37:0/2980946398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d38102d30 0x7f0d38198580 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f0d2800c890 tx=0x7f0d2800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:07.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:07.388+0000 7f0d35ffb640 1 -- 172.21.15.37:0/2980946398 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d28004220 con 0x7f0d38102d30 2024-09-19T06:10:07.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:07.388+0000 7f0d35ffb640 1 -- 172.21.15.37:0/2980946398 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d280043c0 con 0x7f0d38102d30 2024-09-19T06:10:07.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:07.388+0000 7f0d3e86d640 1 -- 172.21.15.37:0/2980946398 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d3819d820 con 0x7f0d38102d30 2024-09-19T06:10:07.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:07.388+0000 7f0d35ffb640 1 -- 172.21.15.37:0/2980946398 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d280049e0 con 0x7f0d38102d30 2024-09-19T06:10:07.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:07.388+0000 7f0d3e86d640 1 -- 172.21.15.37:0/2980946398 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d381a5100 con 0x7f0d38102d30 2024-09-19T06:10:07.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:07.389+0000 7f0d3e86d640 1 -- 172.21.15.37:0/2980946398 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d38103110 con 0x7f0d38102d30 2024-09-19T06:10:07.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:07.390+0000 7f0d35ffb640 1 -- 172.21.15.37:0/2980946398 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f0d280079b0 con 0x7f0d38102d30 2024-09-19T06:10:07.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:07.391+0000 7f0d35ffb640 1 --2- 172.21.15.37:0/2980946398 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f0d240a3240 0x7f0d240a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:07.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:07.391+0000 7f0d2ffff640 1 --2- 172.21.15.37:0/2980946398 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f0d240a3240 0x7f0d240a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:07.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:07.391+0000 7f0d35ffb640 1 -- 172.21.15.37:0/2980946398 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9207+0+0 (secure 0 0 0) 0x7f0d280cfd40 con 0x7f0d38102d30 2024-09-19T06:10:07.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:07.391+0000 7f0d2ffff640 1 --2- 172.21.15.37:0/2980946398 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f0d240a3240 0x7f0d240a5700 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0d2002a940 tx=0x7f0d20005a40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:07.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:07.395+0000 7f0d35ffb640 1 -- 172.21.15.37:0/2980946398 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0d28014030 con 0x7f0d38102d30 2024-09-19T06:10:07.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:07.606+0000 7f0d3e86d640 1 -- 172.21.15.37:0/2980946398 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f0d3810a300 con 0x7f0d38102d30 2024-09-19T06:10:07.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:07.869+0000 7f0d35ffb640 1 -- 172.21.15.37:0/2980946398 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v23) ==== 104+0+0 (secure 0 0 0) 0x7f0d3810a300 con 0x7f0d38102d30 2024-09-19T06:10:07.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:07.871+0000 7f0d3e86d640 1 -- 172.21.15.37:0/2980946398 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f0d240a3240 msgr2=0x7f0d240a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:07.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:07.871+0000 7f0d3e86d640 1 --2- 172.21.15.37:0/2980946398 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f0d240a3240 0x7f0d240a5700 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0d2002a940 tx=0x7f0d20005a40 comp rx=0 tx=0).stop 2024-09-19T06:10:07.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:07.871+0000 7f0d3e86d640 1 -- 172.21.15.37:0/2980946398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d38102d30 msgr2=0x7f0d38198580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:07.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:07.871+0000 7f0d3e86d640 1 --2- 172.21.15.37:0/2980946398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d38102d30 0x7f0d38198580 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f0d2800c890 tx=0x7f0d2800cd50 comp rx=0 tx=0).stop 2024-09-19T06:10:07.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:07.871+0000 7f0d3e86d640 1 -- 172.21.15.37:0/2980946398 shutdown_connections 2024-09-19T06:10:07.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:07.871+0000 7f0d3e86d640 1 --2- 172.21.15.37:0/2980946398 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f0d240a3240 0x7f0d240a5700 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:07.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:07.871+0000 7f0d3e86d640 1 --2- 172.21.15.37:0/2980946398 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d381036e0 0x7f0d38198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:07.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:07.871+0000 7f0d3e86d640 1 --2- 172.21.15.37:0/2980946398 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d381082a0 0x7f0d3819ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:07.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:07.871+0000 7f0d3e86d640 1 --2- 172.21.15.37:0/2980946398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d38102d30 0x7f0d38198580 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:07.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:07.871+0000 7f0d3e86d640 1 -- 172.21.15.37:0/2980946398 >> 172.21.15.37:0/2980946398 conn(0x7f0d380fc7d0 msgr2=0x7f0d38105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:07.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:07.871+0000 7f0d3e86d640 1 -- 172.21.15.37:0/2980946398 shutdown_connections 2024-09-19T06:10:07.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:07.871+0000 7f0d3e86d640 1 -- 172.21.15.37:0/2980946398 wait complete. 2024-09-19T06:10:08.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:10:07 smithi099 ceph-mon[35300]: pgmap v469: 129 pgs: 129 active+clean; 148 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 409 B/s wr, 3 op/s 2024-09-19T06:10:08.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:10:07 smithi099 ceph-mon[35300]: mds.? [v2:172.21.15.117:6838/3813653022,v1:172.21.15.117:6839/3813653022] up:boot 2024-09-19T06:10:08.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:10:07 smithi099 ceph-mon[35300]: mds.? [v2:172.21.15.99:6838/4288790411,v1:172.21.15.99:6839/4288790411] up:boot 2024-09-19T06:10:08.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:10:07 smithi099 ceph-mon[35300]: fsmap cephfs:0/1 12 up:standby, 1 failed 2024-09-19T06:10:08.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:10:07 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T06:10:08.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:10:07 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T06:10:08.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:10:07 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/2980946398' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T06:10:08.216 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:10:07 smithi037 ceph-mon[31211]: pgmap v469: 129 pgs: 129 active+clean; 148 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 409 B/s wr, 3 op/s 2024-09-19T06:10:08.216 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:10:07 smithi037 ceph-mon[31211]: mds.? [v2:172.21.15.117:6838/3813653022,v1:172.21.15.117:6839/3813653022] up:boot 2024-09-19T06:10:08.216 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:10:07 smithi037 ceph-mon[31211]: mds.? [v2:172.21.15.99:6838/4288790411,v1:172.21.15.99:6839/4288790411] up:boot 2024-09-19T06:10:08.216 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:10:07 smithi037 ceph-mon[31211]: fsmap cephfs:0/1 12 up:standby, 1 failed 2024-09-19T06:10:08.216 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:10:07 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T06:10:08.216 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:10:07 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T06:10:08.216 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:10:07 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/2980946398' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T06:10:08.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:10:07 smithi117 ceph-mon[35050]: pgmap v469: 129 pgs: 129 active+clean; 148 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 409 B/s wr, 3 op/s 2024-09-19T06:10:08.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:10:07 smithi117 ceph-mon[35050]: mds.? [v2:172.21.15.117:6838/3813653022,v1:172.21.15.117:6839/3813653022] up:boot 2024-09-19T06:10:08.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:10:07 smithi117 ceph-mon[35050]: mds.? [v2:172.21.15.99:6838/4288790411,v1:172.21.15.99:6839/4288790411] up:boot 2024-09-19T06:10:08.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:10:07 smithi117 ceph-mon[35050]: fsmap cephfs:0/1 12 up:standby, 1 failed 2024-09-19T06:10:08.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:10:07 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T06:10:08.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:10:07 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T06:10:08.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:10:07 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/2980946398' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T06:10:08.647 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-19T06:10:08.916 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:10:09.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:10:08 smithi099 ceph-mon[35300]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T06:10:09.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:10:08 smithi099 ceph-mon[35300]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T06:10:09.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:10:08 smithi099 ceph-mon[35300]: Cluster is now healthy 2024-09-19T06:10:09.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:10:08 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/2980946398' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T06:10:09.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:10:08 smithi099 ceph-mon[35300]: fsmap 12 up:standby 2024-09-19T06:10:09.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:10:08 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:10:09.192 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:10:08 smithi037 ceph-mon[31211]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T06:10:09.192 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:10:08 smithi037 ceph-mon[31211]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T06:10:09.192 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:10:08 smithi037 ceph-mon[31211]: Cluster is now healthy 2024-09-19T06:10:09.192 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:10:08 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/2980946398' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T06:10:09.192 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:10:08 smithi037 ceph-mon[31211]: fsmap 12 up:standby 2024-09-19T06:10:09.192 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:10:08 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:10:09.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:10:08 smithi117 ceph-mon[35050]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T06:10:09.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:10:08 smithi117 ceph-mon[35050]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T06:10:09.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:10:08 smithi117 ceph-mon[35050]: Cluster is now healthy 2024-09-19T06:10:09.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:10:08 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/2980946398' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T06:10:09.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:10:08 smithi117 ceph-mon[35050]: fsmap 12 up:standby 2024-09-19T06:10:09.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:10:08 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:10:09.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:09.397+0000 7f9e4a86f640 1 -- 172.21.15.37:0/3696459552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e441036e0 msgr2=0x7f9e44107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:09.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:09.397+0000 7f9e4a86f640 1 --2- 172.21.15.37:0/3696459552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e441036e0 0x7f9e44107b90 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f9e38009930 tx=0x7f9e3802a420 comp rx=0 tx=0).stop 2024-09-19T06:10:09.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:09.397+0000 7f9e4a86f640 1 -- 172.21.15.37:0/3696459552 shutdown_connections 2024-09-19T06:10:09.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:09.397+0000 7f9e4a86f640 1 --2- 172.21.15.37:0/3696459552 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9e441082a0 0x7f9e4410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:09.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:09.397+0000 7f9e4a86f640 1 --2- 172.21.15.37:0/3696459552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e441036e0 0x7f9e44107b90 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:09.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:09.397+0000 7f9e4a86f640 1 --2- 172.21.15.37:0/3696459552 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e44102d30 0x7f9e44103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:09.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:09.397+0000 7f9e4a86f640 1 -- 172.21.15.37:0/3696459552 >> 172.21.15.37:0/3696459552 conn(0x7f9e440fc7d0 msgr2=0x7f9e440febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:09.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:09.397+0000 7f9e4a86f640 1 -- 172.21.15.37:0/3696459552 shutdown_connections 2024-09-19T06:10:09.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:09.397+0000 7f9e4a86f640 1 -- 172.21.15.37:0/3696459552 wait complete. 2024-09-19T06:10:09.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:09.398+0000 7f9e4a86f640 1 Processor -- start 2024-09-19T06:10:09.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:09.398+0000 7f9e4a86f640 1 -- start start 2024-09-19T06:10:09.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:09.398+0000 7f9e4a86f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e44102d30 0x7f9e44100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:09.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:09.398+0000 7f9e4a86f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9e441036e0 0x7f9e44100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:09.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:09.398+0000 7f9e4a86f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e441082a0 0x7f9e44101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:09.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:09.398+0000 7f9e4a86f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9e441120b0 con 0x7f9e441082a0 2024-09-19T06:10:09.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:09.398+0000 7f9e4a86f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f9e44111f30 con 0x7f9e441036e0 2024-09-19T06:10:09.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:09.398+0000 7f9e4a86f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9e44112230 con 0x7f9e44102d30 2024-09-19T06:10:09.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:09.398+0000 7f9e48e0c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e441082a0 0x7f9e44101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:09.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:09.398+0000 7f9e48e0c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e441082a0 0x7f9e44101410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50538/0 (socket says 172.21.15.37:50538) 2024-09-19T06:10:09.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:09.398+0000 7f9e48e0c640 1 -- 172.21.15.37:0/3083332006 learned_addr learned my addr 172.21.15.37:0/3083332006 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:10:09.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:09.398+0000 7f9e43fff640 1 --2- 172.21.15.37:0/3083332006 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e44102d30 0x7f9e44100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:09.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:09.398+0000 7f9e437fe640 1 --2- 172.21.15.37:0/3083332006 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9e441036e0 0x7f9e44100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:09.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:09.398+0000 7f9e48e0c640 1 -- 172.21.15.37:0/3083332006 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e44102d30 msgr2=0x7f9e44100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:09.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:09.398+0000 7f9e48e0c640 1 --2- 172.21.15.37:0/3083332006 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e44102d30 0x7f9e44100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:09.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:09.398+0000 7f9e48e0c640 1 -- 172.21.15.37:0/3083332006 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9e441036e0 msgr2=0x7f9e44100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:09.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:09.398+0000 7f9e48e0c640 1 --2- 172.21.15.37:0/3083332006 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9e441036e0 0x7f9e44100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:09.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:09.398+0000 7f9e48e0c640 1 -- 172.21.15.37:0/3083332006 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e441a6af0 con 0x7f9e441082a0 2024-09-19T06:10:09.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:09.399+0000 7f9e48e0c640 1 --2- 172.21.15.37:0/3083332006 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e441082a0 0x7f9e44101410 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c009fd0 tx=0x7f9e3c00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:09.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:09.399+0000 7f9e417fa640 1 -- 172.21.15.37:0/3083332006 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c017070 con 0x7f9e441082a0 2024-09-19T06:10:09.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:09.399+0000 7f9e417fa640 1 -- 172.21.15.37:0/3083332006 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e3c003e50 con 0x7f9e441082a0 2024-09-19T06:10:09.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:09.399+0000 7f9e4a86f640 1 -- 172.21.15.37:0/3083332006 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e441a6de0 con 0x7f9e441082a0 2024-09-19T06:10:09.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:09.399+0000 7f9e417fa640 1 -- 172.21.15.37:0/3083332006 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c0106c0 con 0x7f9e441082a0 2024-09-19T06:10:09.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:09.399+0000 7f9e4a86f640 1 -- 172.21.15.37:0/3083332006 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e441a72a0 con 0x7f9e441082a0 2024-09-19T06:10:09.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:09.400+0000 7f9e4a86f640 1 -- 172.21.15.37:0/3083332006 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e44103110 con 0x7f9e441082a0 2024-09-19T06:10:09.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:09.401+0000 7f9e417fa640 1 -- 172.21.15.37:0/3083332006 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f9e3c003970 con 0x7f9e441082a0 2024-09-19T06:10:09.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:09.402+0000 7f9e417fa640 1 --2- 172.21.15.37:0/3083332006 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f9e2c0a32c0 0x7f9e2c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:09.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:09.402+0000 7f9e43fff640 1 --2- 172.21.15.37:0/3083332006 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f9e2c0a32c0 0x7f9e2c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:09.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:09.402+0000 7f9e417fa640 1 -- 172.21.15.37:0/3083332006 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9207+0+0 (secure 0 0 0) 0x7f9e3c0cf8c0 con 0x7f9e441082a0 2024-09-19T06:10:09.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:09.402+0000 7f9e43fff640 1 --2- 172.21.15.37:0/3083332006 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f9e2c0a32c0 0x7f9e2c0a5780 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9e34005fd0 tx=0x7f9e3400b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:09.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:09.406+0000 7f9e417fa640 1 -- 172.21.15.37:0/3083332006 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9e3c09bbc0 con 0x7f9e441082a0 2024-09-19T06:10:09.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:09.583+0000 7f9e4a86f640 1 -- 172.21.15.37:0/3083332006 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f9e4410a2b0 con 0x7f9e441082a0 2024-09-19T06:10:10.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:10.138+0000 7f9e417fa640 1 -- 172.21.15.37:0/3083332006 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v93) ==== 181+0+0 (secure 0 0 0) 0x7f9e3c09fec0 con 0x7f9e441082a0 2024-09-19T06:10:10.140 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' removed 2024-09-19T06:10:10.140 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:10:09 smithi037 ceph-mon[31211]: pgmap v470: 129 pgs: 129 active+clean; 148 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 409 B/s wr, 3 op/s 2024-09-19T06:10:10.140 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:10:09 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:10:10.140 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:10:09 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:10:10.140 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:10:09 smithi037 ceph-mon[31211]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:10:10.140 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:10:09 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/3083332006' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T06:10:10.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:10.142+0000 7f9e4a86f640 1 -- 172.21.15.37:0/3083332006 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f9e2c0a32c0 msgr2=0x7f9e2c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:10.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:10.142+0000 7f9e4a86f640 1 --2- 172.21.15.37:0/3083332006 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f9e2c0a32c0 0x7f9e2c0a5780 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9e34005fd0 tx=0x7f9e3400b390 comp rx=0 tx=0).stop 2024-09-19T06:10:10.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:10.142+0000 7f9e4a86f640 1 -- 172.21.15.37:0/3083332006 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e441082a0 msgr2=0x7f9e44101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:10.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:10.142+0000 7f9e4a86f640 1 --2- 172.21.15.37:0/3083332006 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e441082a0 0x7f9e44101410 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c009fd0 tx=0x7f9e3c00b260 comp rx=0 tx=0).stop 2024-09-19T06:10:10.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:10.142+0000 7f9e4a86f640 1 -- 172.21.15.37:0/3083332006 shutdown_connections 2024-09-19T06:10:10.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:10.142+0000 7f9e4a86f640 1 --2- 172.21.15.37:0/3083332006 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7f9e2c0a32c0 0x7f9e2c0a5780 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:10.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:10.142+0000 7f9e4a86f640 1 --2- 172.21.15.37:0/3083332006 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9e441036e0 0x7f9e44100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:10.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:10.142+0000 7f9e4a86f640 1 --2- 172.21.15.37:0/3083332006 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e441082a0 0x7f9e44101410 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:10.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:10.142+0000 7f9e4a86f640 1 --2- 172.21.15.37:0/3083332006 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e44102d30 0x7f9e44100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:10.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:10.142+0000 7f9e4a86f640 1 -- 172.21.15.37:0/3083332006 >> 172.21.15.37:0/3083332006 conn(0x7f9e440fc7d0 msgr2=0x7f9e44106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:10.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:10.142+0000 7f9e4a86f640 1 -- 172.21.15.37:0/3083332006 shutdown_connections 2024-09-19T06:10:10.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:10.142+0000 7f9e4a86f640 1 -- 172.21.15.37:0/3083332006 wait complete. 2024-09-19T06:10:10.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:10:09 smithi099 ceph-mon[35300]: pgmap v470: 129 pgs: 129 active+clean; 148 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 409 B/s wr, 3 op/s 2024-09-19T06:10:10.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:10:09 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:10:10.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:10:09 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:10:10.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:10:09 smithi099 ceph-mon[35300]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:10:10.189 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:10:09 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/3083332006' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T06:10:10.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:10:09 smithi117 ceph-mon[35050]: pgmap v470: 129 pgs: 129 active+clean; 148 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 409 B/s wr, 3 op/s 2024-09-19T06:10:10.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:10:09 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:10:10.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:10:09 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:10:10.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:10:09 smithi117 ceph-mon[35050]: from='mgr.14148 172.21.15.37:0/15771928' entity='mgr.x' 2024-09-19T06:10:10.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:10:09 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/3083332006' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T06:10:10.980 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-19T06:10:11.251 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:10:11.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:10:11 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/3083332006' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T06:10:11.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:10:11 smithi037 ceph-mon[31211]: osdmap e93: 12 total, 12 up, 12 in 2024-09-19T06:10:11.438 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:10:11 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/3083332006' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T06:10:11.438 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:10:11 smithi099 ceph-mon[35300]: osdmap e93: 12 total, 12 up, 12 in 2024-09-19T06:10:11.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:10:11 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/3083332006' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T06:10:11.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:10:11 smithi117 ceph-mon[35050]: osdmap e93: 12 total, 12 up, 12 in 2024-09-19T06:10:11.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:11.766+0000 7ff54dde5640 1 -- 172.21.15.37:0/4276073931 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff548101de0 msgr2=0x7ff5481021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:11.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:11.766+0000 7ff54dde5640 1 --2- 172.21.15.37:0/4276073931 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff548101de0 0x7ff5481021c0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7ff538009900 tx=0x7ff53802a410 comp rx=0 tx=0).stop 2024-09-19T06:10:11.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:11.766+0000 7ff54dde5640 1 -- 172.21.15.37:0/4276073931 shutdown_connections 2024-09-19T06:10:11.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:11.766+0000 7ff54dde5640 1 --2- 172.21.15.37:0/4276073931 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff548106f10 0x7ff54810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:11.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:11.766+0000 7ff54dde5640 1 --2- 172.21.15.37:0/4276073931 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff548102790 0x7ff5481067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:11.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:11.766+0000 7ff54dde5640 1 --2- 172.21.15.37:0/4276073931 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff548101de0 0x7ff5481021c0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:11.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:11.766+0000 7ff54dde5640 1 -- 172.21.15.37:0/4276073931 >> 172.21.15.37:0/4276073931 conn(0x7ff5480fd8c0 msgr2=0x7ff5480ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:11.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:11.766+0000 7ff54dde5640 1 -- 172.21.15.37:0/4276073931 shutdown_connections 2024-09-19T06:10:11.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:11.766+0000 7ff54dde5640 1 -- 172.21.15.37:0/4276073931 wait complete. 2024-09-19T06:10:11.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:11.767+0000 7ff54dde5640 1 Processor -- start 2024-09-19T06:10:11.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:11.767+0000 7ff54dde5640 1 -- start start 2024-09-19T06:10:11.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:11.768+0000 7ff54dde5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff548101de0 0x7ff5480744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:11.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:11.768+0000 7ff54dde5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff548102790 0x7ff548074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:11.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:11.768+0000 7ff54dde5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff548106f10 0x7ff548074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:11.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:11.768+0000 7ff54dde5640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff548111fe0 con 0x7ff548102790 2024-09-19T06:10:11.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:11.768+0000 7ff54dde5640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff548111e60 con 0x7ff548106f10 2024-09-19T06:10:11.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:11.768+0000 7ff54dde5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff548112160 con 0x7ff548101de0 2024-09-19T06:10:11.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:11.768+0000 7ff546ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff548102790 0x7ff548074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:11.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:11.768+0000 7ff546ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff548102790 0x7ff548074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50550/0 (socket says 172.21.15.37:50550) 2024-09-19T06:10:11.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:11.768+0000 7ff546ffd640 1 -- 172.21.15.37:0/2782652225 learned_addr learned my addr 172.21.15.37:0/2782652225 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:10:11.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:11.768+0000 7ff5477fe640 1 --2- 172.21.15.37:0/2782652225 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff548101de0 0x7ff5480744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:11.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:11.768+0000 7ff547fff640 1 --2- 172.21.15.37:0/2782652225 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff548106f10 0x7ff548074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:11.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:11.768+0000 7ff546ffd640 1 -- 172.21.15.37:0/2782652225 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff548101de0 msgr2=0x7ff5480744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:11.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:11.768+0000 7ff546ffd640 1 --2- 172.21.15.37:0/2782652225 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff548101de0 0x7ff5480744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:11.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:11.768+0000 7ff546ffd640 1 -- 172.21.15.37:0/2782652225 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff548106f10 msgr2=0x7ff548074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:11.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:11.768+0000 7ff546ffd640 1 --2- 172.21.15.37:0/2782652225 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff548106f10 0x7ff548074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:11.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:11.768+0000 7ff546ffd640 1 -- 172.21.15.37:0/2782652225 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5481a6980 con 0x7ff548102790 2024-09-19T06:10:11.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:11.768+0000 7ff547fff640 1 --2- 172.21.15.37:0/2782652225 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff548106f10 0x7ff548074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:10:11.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:11.768+0000 7ff546ffd640 1 --2- 172.21.15.37:0/2782652225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff548102790 0x7ff548074a30 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7ff53c00b4a0 tx=0x7ff53c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:11.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:11.769+0000 7ff544ff9640 1 -- 172.21.15.37:0/2782652225 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff53c014070 con 0x7ff548102790 2024-09-19T06:10:11.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:11.769+0000 7ff544ff9640 1 -- 172.21.15.37:0/2782652225 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff53c010af0 con 0x7ff548102790 2024-09-19T06:10:11.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:11.769+0000 7ff54dde5640 1 -- 172.21.15.37:0/2782652225 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5481a6c70 con 0x7ff548102790 2024-09-19T06:10:11.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:11.769+0000 7ff544ff9640 1 -- 172.21.15.37:0/2782652225 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff53c017d10 con 0x7ff548102790 2024-09-19T06:10:11.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:11.769+0000 7ff54dde5640 1 -- 172.21.15.37:0/2782652225 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5481a71b0 con 0x7ff548102790 2024-09-19T06:10:11.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:11.770+0000 7ff54dde5640 1 -- 172.21.15.37:0/2782652225 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5481021c0 con 0x7ff548102790 2024-09-19T06:10:11.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:11.771+0000 7ff544ff9640 1 -- 172.21.15.37:0/2782652225 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff53c017070 con 0x7ff548102790 2024-09-19T06:10:11.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:11.772+0000 7ff544ff9640 1 --2- 172.21.15.37:0/2782652225 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7ff5300a32c0 0x7ff5300a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:11.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:11.772+0000 7ff5477fe640 1 --2- 172.21.15.37:0/2782652225 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7ff5300a32c0 0x7ff5300a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:11.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:11.772+0000 7ff544ff9640 1 -- 172.21.15.37:0/2782652225 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8682+0+0 (secure 0 0 0) 0x7ff53c0ceee0 con 0x7ff548102790 2024-09-19T06:10:11.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:11.772+0000 7ff5477fe640 1 --2- 172.21.15.37:0/2782652225 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7ff5300a32c0 0x7ff5300a5780 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff538000c00 tx=0x7ff538005a20 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:11.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:11.776+0000 7ff544ff9640 1 -- 172.21.15.37:0/2782652225 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff53c09ba40 con 0x7ff548102790 2024-09-19T06:10:11.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:11.951+0000 7ff54dde5640 1 -- 172.21.15.37:0/2782652225 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff54810a0f0 con 0x7ff548102790 2024-09-19T06:10:12.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:12.152+0000 7ff544ff9640 1 -- 172.21.15.37:0/2782652225 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v94) ==== 169+0+0 (secure 0 0 0) 0x7ff53c09b340 con 0x7ff548102790 2024-09-19T06:10:12.153 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' removed 2024-09-19T06:10:12.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:12.156+0000 7ff54dde5640 1 -- 172.21.15.37:0/2782652225 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7ff5300a32c0 msgr2=0x7ff5300a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:12.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:12.156+0000 7ff54dde5640 1 --2- 172.21.15.37:0/2782652225 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7ff5300a32c0 0x7ff5300a5780 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff538000c00 tx=0x7ff538005a20 comp rx=0 tx=0).stop 2024-09-19T06:10:12.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:12.156+0000 7ff54dde5640 1 -- 172.21.15.37:0/2782652225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff548102790 msgr2=0x7ff548074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:12.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:12.156+0000 7ff54dde5640 1 --2- 172.21.15.37:0/2782652225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff548102790 0x7ff548074a30 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7ff53c00b4a0 tx=0x7ff53c00b960 comp rx=0 tx=0).stop 2024-09-19T06:10:12.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:12.156+0000 7ff54dde5640 1 -- 172.21.15.37:0/2782652225 shutdown_connections 2024-09-19T06:10:12.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:12.156+0000 7ff54dde5640 1 --2- 172.21.15.37:0/2782652225 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7ff5300a32c0 0x7ff5300a5780 secure :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff538000c00 tx=0x7ff538005a20 comp rx=0 tx=0).stop 2024-09-19T06:10:12.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:12.156+0000 7ff54dde5640 1 --2- 172.21.15.37:0/2782652225 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff548106f10 0x7ff548074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:12.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:12.156+0000 7ff54dde5640 1 --2- 172.21.15.37:0/2782652225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff548102790 0x7ff548074a30 secure :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7ff53c00b4a0 tx=0x7ff53c00b960 comp rx=0 tx=0).stop 2024-09-19T06:10:12.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:12.156+0000 7ff54dde5640 1 --2- 172.21.15.37:0/2782652225 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff548101de0 0x7ff5480744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:12.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:12.156+0000 7ff54dde5640 1 -- 172.21.15.37:0/2782652225 >> 172.21.15.37:0/2782652225 conn(0x7ff5480fd8c0 msgr2=0x7ff5480febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:12.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:12.157+0000 7ff54dde5640 1 -- 172.21.15.37:0/2782652225 shutdown_connections 2024-09-19T06:10:12.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:12.157+0000 7ff54dde5640 1 -- 172.21.15.37:0/2782652225 wait complete. 2024-09-19T06:10:12.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:10:12 smithi037 ceph-mon[31211]: pgmap v472: 97 pgs: 97 active+clean; 577 KiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:10:12.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:10:12 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/2782652225' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T06:10:12.438 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:10:12 smithi099 ceph-mon[35300]: pgmap v472: 97 pgs: 97 active+clean; 577 KiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:10:12.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:10:12 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/2782652225' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T06:10:12.499 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:10:12 smithi117 ceph-mon[35050]: pgmap v472: 97 pgs: 97 active+clean; 577 KiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:10:12.499 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:10:12 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/2782652225' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T06:10:13.095 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-19T06:10:13.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:10:13 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/2782652225' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T06:10:13.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:10:13 smithi037 ceph-mon[31211]: osdmap e94: 12 total, 12 up, 12 in 2024-09-19T06:10:13.356 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:10:13.438 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:10:13 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/2782652225' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T06:10:13.438 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:10:13 smithi099 ceph-mon[35300]: osdmap e94: 12 total, 12 up, 12 in 2024-09-19T06:10:13.499 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:10:13 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/2782652225' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T06:10:13.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:10:13 smithi117 ceph-mon[35050]: osdmap e94: 12 total, 12 up, 12 in 2024-09-19T06:10:13.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:13.849+0000 7f0019135640 1 -- 172.21.15.37:0/1657155561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00141082a0 msgr2=0x7f001410ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:13.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:13.849+0000 7f0019135640 1 --2- 172.21.15.37:0/1657155561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00141082a0 0x7f001410ec40 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f000c009cd0 tx=0x7f000c02a8e0 comp rx=0 tx=0).stop 2024-09-19T06:10:13.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:13.850+0000 7f0019135640 1 -- 172.21.15.37:0/1657155561 shutdown_connections 2024-09-19T06:10:13.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:13.850+0000 7f0019135640 1 --2- 172.21.15.37:0/1657155561 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00141036e0 0x7f0014107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:13.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:13.850+0000 7f0019135640 1 --2- 172.21.15.37:0/1657155561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00141082a0 0x7f001410ec40 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:13.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:13.850+0000 7f0019135640 1 --2- 172.21.15.37:0/1657155561 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0014102d30 0x7f0014103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:13.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:13.850+0000 7f0019135640 1 -- 172.21.15.37:0/1657155561 >> 172.21.15.37:0/1657155561 conn(0x7f00140fc7d0 msgr2=0x7f00140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:13.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:13.850+0000 7f0019135640 1 -- 172.21.15.37:0/1657155561 shutdown_connections 2024-09-19T06:10:13.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:13.850+0000 7f0019135640 1 -- 172.21.15.37:0/1657155561 wait complete. 2024-09-19T06:10:13.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:13.850+0000 7f0019135640 1 Processor -- start 2024-09-19T06:10:13.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:13.851+0000 7f0019135640 1 -- start start 2024-09-19T06:10:13.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:13.851+0000 7f0019135640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0014102d30 0x7f00141985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:13.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:13.851+0000 7f0019135640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00141036e0 0x7f0014198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:13.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:13.851+0000 7f0019135640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00141082a0 0x7f001419ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:13.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:13.851+0000 7f0019135640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0014112100 con 0x7f0014102d30 2024-09-19T06:10:13.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:13.851+0000 7f0019135640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f0014111f80 con 0x7f00141082a0 2024-09-19T06:10:13.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:13.851+0000 7f0019135640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0014112280 con 0x7f00141036e0 2024-09-19T06:10:13.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:13.851+0000 7f0012d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0014102d30 0x7f00141985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:13.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:13.851+0000 7f0012d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0014102d30 0x7f00141985a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51918/0 (socket says 172.21.15.37:51918) 2024-09-19T06:10:13.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:13.851+0000 7f0012d9d640 1 -- 172.21.15.37:0/439536036 learned_addr learned my addr 172.21.15.37:0/439536036 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T06:10:13.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:13.851+0000 7f001359e640 1 --2- 172.21.15.37:0/439536036 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00141082a0 0x7f001419ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:13.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:13.851+0000 7f001259c640 1 --2- 172.21.15.37:0/439536036 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00141036e0 0x7f0014198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:13.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:13.851+0000 7f0012d9d640 1 -- 172.21.15.37:0/439536036 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00141036e0 msgr2=0x7f0014198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:13.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:13.851+0000 7f0012d9d640 1 --2- 172.21.15.37:0/439536036 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00141036e0 0x7f0014198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:13.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:13.851+0000 7f0012d9d640 1 -- 172.21.15.37:0/439536036 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00141082a0 msgr2=0x7f001419ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:13.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:13.851+0000 7f0012d9d640 1 --2- 172.21.15.37:0/439536036 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00141082a0 0x7f001419ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:13.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:13.851+0000 7f0012d9d640 1 -- 172.21.15.37:0/439536036 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f001419d550 con 0x7f0014102d30 2024-09-19T06:10:13.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:13.851+0000 7f001259c640 1 --2- 172.21.15.37:0/439536036 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00141036e0 0x7f0014198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:10:13.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:13.851+0000 7f0012d9d640 1 --2- 172.21.15.37:0/439536036 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0014102d30 0x7f00141985a0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f000400b4a0 tx=0x7f000400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:13.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:13.852+0000 7efffbfff640 1 -- 172.21.15.37:0/439536036 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0004014070 con 0x7f0014102d30 2024-09-19T06:10:13.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:13.852+0000 7efffbfff640 1 -- 172.21.15.37:0/439536036 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0004010af0 con 0x7f0014102d30 2024-09-19T06:10:13.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:13.852+0000 7efffbfff640 1 -- 172.21.15.37:0/439536036 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0004017d10 con 0x7f0014102d30 2024-09-19T06:10:13.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:13.852+0000 7f0019135640 1 -- 172.21.15.37:0/439536036 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f001419d840 con 0x7f0014102d30 2024-09-19T06:10:13.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:13.852+0000 7f0019135640 1 -- 172.21.15.37:0/439536036 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00141a5120 con 0x7f0014102d30 2024-09-19T06:10:13.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:13.853+0000 7f0019135640 1 -- 172.21.15.37:0/439536036 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f001406a850 con 0x7f0014102d30 2024-09-19T06:10:13.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:13.854+0000 7efffbfff640 1 -- 172.21.15.37:0/439536036 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f0004017070 con 0x7f0014102d30 2024-09-19T06:10:13.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:13.854+0000 7efffbfff640 1 --2- 172.21.15.37:0/439536036 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7efffc0a32c0 0x7efffc0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:13.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:13.855+0000 7f001259c640 1 --2- 172.21.15.37:0/439536036 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7efffc0a32c0 0x7efffc0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:13.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:13.855+0000 7efffbfff640 1 -- 172.21.15.37:0/439536036 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8152+0+0 (secure 0 0 0) 0x7f00040ced20 con 0x7f0014102d30 2024-09-19T06:10:13.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:13.855+0000 7f001259c640 1 --2- 172.21.15.37:0/439536036 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7efffc0a32c0 0x7efffc0a5780 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f00140fedf0 tx=0x7f0008005e50 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:13.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:13.859+0000 7efffbfff640 1 -- 172.21.15.37:0/439536036 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f000409ba40 con 0x7f0014102d30 2024-09-19T06:10:14.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:14.034+0000 7f0019135640 1 -- 172.21.15.37:0/439536036 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f00141a52f0 con 0x7f0014102d30 2024-09-19T06:10:14.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:14.159+0000 7efffbfff640 1 -- 172.21.15.37:0/439536036 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v95) ==== 178+0+0 (secure 0 0 0) 0x7f000409b340 con 0x7f0014102d30 2024-09-19T06:10:14.160 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data_ec' removed 2024-09-19T06:10:14.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:14.162+0000 7f0019135640 1 -- 172.21.15.37:0/439536036 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7efffc0a32c0 msgr2=0x7efffc0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:14.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:14.162+0000 7f0019135640 1 --2- 172.21.15.37:0/439536036 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7efffc0a32c0 0x7efffc0a5780 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f00140fedf0 tx=0x7f0008005e50 comp rx=0 tx=0).stop 2024-09-19T06:10:14.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:14.162+0000 7f0019135640 1 -- 172.21.15.37:0/439536036 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0014102d30 msgr2=0x7f00141985a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:14.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:14.163+0000 7f0019135640 1 --2- 172.21.15.37:0/439536036 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0014102d30 0x7f00141985a0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f000400b4a0 tx=0x7f000400b960 comp rx=0 tx=0).stop 2024-09-19T06:10:14.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:14.163+0000 7f0019135640 1 -- 172.21.15.37:0/439536036 shutdown_connections 2024-09-19T06:10:14.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:14.163+0000 7f0019135640 1 --2- 172.21.15.37:0/439536036 >> [v2:172.21.15.37:6800/3797010169,v1:172.21.15.37:6801/3797010169] conn(0x7efffc0a32c0 0x7efffc0a5780 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:14.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:14.163+0000 7f0019135640 1 --2- 172.21.15.37:0/439536036 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00141082a0 0x7f001419ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:14.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:14.163+0000 7f0019135640 1 --2- 172.21.15.37:0/439536036 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00141036e0 0x7f0014198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:14.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:14.163+0000 7f0019135640 1 --2- 172.21.15.37:0/439536036 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0014102d30 0x7f00141985a0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:14.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:14.163+0000 7f0019135640 1 -- 172.21.15.37:0/439536036 >> 172.21.15.37:0/439536036 conn(0x7f00140fc7d0 msgr2=0x7f0014105d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:14.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:14.163+0000 7f0019135640 1 -- 172.21.15.37:0/439536036 shutdown_connections 2024-09-19T06:10:14.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T06:10:14.163+0000 7f0019135640 1 -- 172.21.15.37:0/439536036 wait complete. 2024-09-19T06:10:14.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:10:14 smithi037 ceph-mon[31211]: pgmap v474: 33 pgs: 33 active+clean; 577 KiB data, 876 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:10:14.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:10:14 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/439536036' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T06:10:14.438 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:10:14 smithi099 ceph-mon[35300]: pgmap v474: 33 pgs: 33 active+clean; 577 KiB data, 876 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:10:14.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:10:14 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/439536036' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T06:10:14.499 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:10:14 smithi117 ceph-mon[35050]: pgmap v474: 33 pgs: 33 active+clean; 577 KiB data, 876 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:10:14.500 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:10:14 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/439536036' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T06:10:14.880 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T06:10:14.909 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T06:10:14.942 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T06:10:14.977 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-19T06:10:14.978 DEBUG:teuthology.orchestra.run.smithi037:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T06:10:14.996 DEBUG:teuthology.orchestra.run.smithi099:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T06:10:15.013 DEBUG:teuthology.orchestra.run.smithi117:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T06:10:15.035 INFO:tasks.cephadm:Stopping all daemons... 2024-09-19T06:10:15.035 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-19T06:10:15.035 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@mon.a 2024-09-19T06:10:15.172 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:10:15 smithi037 systemd[1]: Stopping Ceph mon.a for b8c8bdae-764b-11ef-bceb-c7b262605968... 2024-09-19T06:10:15.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:10:15 smithi099 ceph-mon[35300]: from='client.? 172.21.15.37:0/439536036' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T06:10:15.188 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:10:15 smithi099 ceph-mon[35300]: osdmap e95: 12 total, 12 up, 12 in 2024-09-19T06:10:15.249 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:10:15 smithi117 ceph-mon[35050]: from='client.? 172.21.15.37:0/439536036' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T06:10:15.250 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:10:15 smithi117 ceph-mon[35050]: osdmap e95: 12 total, 12 up, 12 in 2024-09-19T06:10:15.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:10:15 smithi037 ceph-mon[31211]: from='client.? 172.21.15.37:0/439536036' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T06:10:15.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:10:15 smithi037 ceph-mon[31211]: osdmap e95: 12 total, 12 up, 12 in 2024-09-19T06:10:15.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:10:15 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mon-a[31207]: 2024-09-19T06:10:15.341+0000 7fd8ee334640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:10:15.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:10:15 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mon-a[31207]: 2024-09-19T06:10:15.341+0000 7fd8ee334640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-19T06:10:15.885 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:10:15 smithi037 podman[87371]: 2024-09-19 06:10:15.617686316 +0000 UTC m=+0.388650183 container died 916a85ee7b219c4087ba3fe080feb879d234175f7ebb5bec4db3c039fc238149 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:10:16.310 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:10:15 smithi037 podman[87371]: 2024-09-19 06:10:15.99110691 +0000 UTC m=+0.762070776 container cleanup 916a85ee7b219c4087ba3fe080feb879d234175f7ebb5bec4db3c039fc238149 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mon-a, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:10:16.311 INFO:journalctl@ceph.mon.a.smithi037.stdout:Sep 19 06:10:15 smithi037 bash[87371]: ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mon-a 2024-09-19T06:10:16.440 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@mon.a.service' 2024-09-19T06:10:16.492 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:10:16.492 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-19T06:10:16.492 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-19T06:10:16.493 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@mon.b 2024-09-19T06:10:16.806 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:10:16 smithi099 systemd[1]: Stopping Ceph mon.b for b8c8bdae-764b-11ef-bceb-c7b262605968... 2024-09-19T06:10:17.133 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:10:16 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mon-b[35296]: 2024-09-19T06:10:16.804+0000 7f5f30166640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:10:17.133 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:10:16 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mon-b[35296]: 2024-09-19T06:10:16.804+0000 7f5f30166640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-19T06:10:17.133 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:10:16 smithi099 podman[67825]: 2024-09-19 06:10:16.845849915 +0000 UTC m=+0.161288524 container died 19e1b3a284758d8cd0b215b11b6586863a495db43c72a5c25acbf8ed2fa831e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mon-b, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-19T06:10:17.438 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:10:17 smithi099 podman[67825]: 2024-09-19 06:10:17.339260163 +0000 UTC m=+0.654698768 container cleanup 19e1b3a284758d8cd0b215b11b6586863a495db43c72a5c25acbf8ed2fa831e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mon-b, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-19T06:10:17.438 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 06:10:17 smithi099 bash[67825]: ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mon-b 2024-09-19T06:10:17.767 DEBUG:teuthology.orchestra.run.smithi099:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@mon.b.service' 2024-09-19T06:10:17.810 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:10:17.811 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-19T06:10:17.811 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-19T06:10:17.811 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@mon.c 2024-09-19T06:10:18.205 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:10:17 smithi117 systemd[1]: Stopping Ceph mon.c for b8c8bdae-764b-11ef-bceb-c7b262605968... 2024-09-19T06:10:18.205 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:10:18 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mon-c[35046]: 2024-09-19T06:10:18.081+0000 7f01ea5e0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:10:18.206 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:10:18 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mon-c[35046]: 2024-09-19T06:10:18.081+0000 7f01ea5e0640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-19T06:10:18.499 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:10:18 smithi117 podman[67532]: 2024-09-19 06:10:18.204638353 +0000 UTC m=+0.200855145 container died c427aab2cd0b16ae97582a7c87ad6c896741552ed0e9cfbcd9155637fb324e4f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mon-c, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:10:18.944 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:10:18 smithi117 podman[67532]: 2024-09-19 06:10:18.707596761 +0000 UTC m=+0.703813544 container cleanup c427aab2cd0b16ae97582a7c87ad6c896741552ed0e9cfbcd9155637fb324e4f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mon-c, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-19T06:10:18.944 INFO:journalctl@ceph.mon.c.smithi117.stdout:Sep 19 06:10:18 smithi117 bash[67532]: ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mon-c 2024-09-19T06:10:19.086 DEBUG:teuthology.orchestra.run.smithi117:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@mon.c.service' 2024-09-19T06:10:19.136 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:10:19.136 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-19T06:10:19.137 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-19T06:10:19.137 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@mgr.x 2024-09-19T06:10:19.465 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 06:10:19 smithi037 systemd[1]: Stopping Ceph mgr.x for b8c8bdae-764b-11ef-bceb-c7b262605968... 2024-09-19T06:10:19.765 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 06:10:19 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x[31439]: 2024-09-19T06:10:19.462+0000 7fafa556e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:10:19.765 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 06:10:19 smithi037 podman[87500]: 2024-09-19 06:10:19.493970435 +0000 UTC m=+0.165210645 container died 404ceebffacfc1838cbb4a1f6f58bdd7e5fb8c4f71759a683e41007baa313b54 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-19T06:10:20.073 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 06:10:19 smithi037 podman[87500]: 2024-09-19 06:10:19.980578282 +0000 UTC m=+0.651818495 container cleanup 404ceebffacfc1838cbb4a1f6f58bdd7e5fb8c4f71759a683e41007baa313b54 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-19T06:10:20.074 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Sep 19 06:10:19 smithi037 bash[87500]: ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-x 2024-09-19T06:10:20.576 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@mgr.x.service' 2024-09-19T06:10:20.615 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:10:20.615 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-19T06:10:20.615 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-19T06:10:20.615 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@mgr.y 2024-09-19T06:10:20.939 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Sep 19 06:10:20 smithi099 systemd[1]: Stopping Ceph mgr.y for b8c8bdae-764b-11ef-bceb-c7b262605968... 2024-09-19T06:10:21.305 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Sep 19 06:10:20 smithi099 podman[67951]: 2024-09-19 06:10:20.940412377 +0000 UTC m=+0.135667853 container died 41de606078ec0c49fd1ac62d379f85ae10941bc15b52c1a32c3fe75e1b25ddb9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-y, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-19T06:10:21.688 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Sep 19 06:10:21 smithi099 podman[67951]: 2024-09-19 06:10:21.395539352 +0000 UTC m=+0.590794827 container cleanup 41de606078ec0c49fd1ac62d379f85ae10941bc15b52c1a32c3fe75e1b25ddb9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-y, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-19T06:10:21.689 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Sep 19 06:10:21 smithi099 bash[67951]: ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-y 2024-09-19T06:10:21.822 DEBUG:teuthology.orchestra.run.smithi099:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@mgr.y.service' 2024-09-19T06:10:21.856 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:10:21.856 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-19T06:10:21.856 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-19T06:10:21.856 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@mgr.z 2024-09-19T06:10:22.176 INFO:journalctl@ceph.mgr.z.smithi117.stdout:Sep 19 06:10:21 smithi117 systemd[1]: Stopping Ceph mgr.z for b8c8bdae-764b-11ef-bceb-c7b262605968... 2024-09-19T06:10:22.473 INFO:journalctl@ceph.mgr.z.smithi117.stdout:Sep 19 06:10:22 smithi117 podman[67658]: 2024-09-19 06:10:22.175196083 +0000 UTC m=+0.128144974 container died adb3e14db55eaeace9cd52dfa61098c5035656ad4f3167c8af37723b14eaeba5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-z, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:10:22.749 INFO:journalctl@ceph.mgr.z.smithi117.stdout:Sep 19 06:10:22 smithi117 podman[67658]: 2024-09-19 06:10:22.555336327 +0000 UTC m=+0.508285219 container cleanup adb3e14db55eaeace9cd52dfa61098c5035656ad4f3167c8af37723b14eaeba5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-z, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-19T06:10:22.749 INFO:journalctl@ceph.mgr.z.smithi117.stdout:Sep 19 06:10:22 smithi117 bash[67658]: ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mgr-z 2024-09-19T06:10:22.977 DEBUG:teuthology.orchestra.run.smithi117:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@mgr.z.service' 2024-09-19T06:10:23.012 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:10:23.012 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-19T06:10:23.012 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-19T06:10:23.012 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@osd.0 2024-09-19T06:10:23.324 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 19 06:10:23 smithi037 systemd[1]: Stopping Ceph osd.0 for b8c8bdae-764b-11ef-bceb-c7b262605968... 2024-09-19T06:10:23.824 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 19 06:10:23 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-0[42785]: 2024-09-19T06:10:23.394+0000 7fe5552cd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:10:23.824 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 19 06:10:23 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-0[42785]: 2024-09-19T06:10:23.394+0000 7fe5552cd640 -1 osd.0 95 *** Got signal Terminated *** 2024-09-19T06:10:23.824 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 19 06:10:23 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-0[42785]: 2024-09-19T06:10:23.394+0000 7fe5552cd640 -1 osd.0 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:10:29.074 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 19 06:10:28 smithi037 podman[87622]: 2024-09-19 06:10:28.725952161 +0000 UTC m=+5.513049041 container died 9b68ffdf327cb8efc8bde0e4300ea461d427beee92f8e63eb34fcbdcd8ccce0c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True) 2024-09-19T06:10:29.574 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 19 06:10:29 smithi037 podman[87622]: 2024-09-19 06:10:29.295984982 +0000 UTC m=+6.083081866 container cleanup 9b68ffdf327cb8efc8bde0e4300ea461d427beee92f8e63eb34fcbdcd8ccce0c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731) 2024-09-19T06:10:29.574 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 19 06:10:29 smithi037 bash[87622]: ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-0 2024-09-19T06:10:29.980 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 19 06:10:29 smithi037 podman[87637]: 2024-09-19 06:10:29.614657473 +0000 UTC m=+0.885028321 container remove 9b68ffdf327cb8efc8bde0e4300ea461d427beee92f8e63eb34fcbdcd8ccce0c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2) 2024-09-19T06:10:30.269 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 19 06:10:29 smithi037 podman[87729]: 2024-09-19 06:10:29.881598005 +0000 UTC m=+0.016432967 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:10:30.269 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 19 06:10:30 smithi037 podman[87729]: 2024-09-19 06:10:30.003901573 +0000 UTC m=+0.138736532 container create b38183ec469177161b0a41626f7fbea18e38c365b465b1ef181455a086c6bddb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-19T06:10:30.269 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 19 06:10:30 smithi037 podman[87729]: 2024-09-19 06:10:30.268183484 +0000 UTC m=+0.403018442 container init b38183ec469177161b0a41626f7fbea18e38c365b465b1ef181455a086c6bddb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-0-deactivate, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:10:30.574 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 19 06:10:30 smithi037 podman[87729]: 2024-09-19 06:10:30.271821539 +0000 UTC m=+0.406656499 container start b38183ec469177161b0a41626f7fbea18e38c365b465b1ef181455a086c6bddb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=) 2024-09-19T06:10:30.574 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 19 06:10:30 smithi037 podman[87729]: 2024-09-19 06:10:30.334903606 +0000 UTC m=+0.469738568 container attach b38183ec469177161b0a41626f7fbea18e38c365b465b1ef181455a086c6bddb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-19T06:10:30.574 INFO:journalctl@ceph.osd.0.smithi037.stdout:Sep 19 06:10:30 smithi037 podman[87729]: 2024-09-19 06:10:30.467716888 +0000 UTC m=+0.602551849 container died b38183ec469177161b0a41626f7fbea18e38c365b465b1ef181455a086c6bddb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-19T06:10:31.181 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@osd.0.service' 2024-09-19T06:10:31.225 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:10:31.226 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-19T06:10:31.226 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-19T06:10:31.226 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@osd.1 2024-09-19T06:10:31.534 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:10:31 smithi099 systemd[1]: Stopping Ceph osd.1 for b8c8bdae-764b-11ef-bceb-c7b262605968... 2024-09-19T06:10:31.938 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:10:31 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-1[39739]: 2024-09-19T06:10:31.532+0000 7fe4f2859640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:10:31.939 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:10:31 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-1[39739]: 2024-09-19T06:10:31.532+0000 7fe4f2859640 -1 osd.1 95 *** Got signal Terminated *** 2024-09-19T06:10:31.939 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:10:31 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-1[39739]: 2024-09-19T06:10:31.532+0000 7fe4f2859640 -1 osd.1 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:10:37.343 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:10:37 smithi099 podman[68089]: 2024-09-19 06:10:37.074845365 +0000 UTC m=+5.665296449 container died 409f7bdf7f9703ad2b8a1ce848d125f9e3758c68a92eb52883d125f3e1234bcc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-1, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-19T06:10:37.688 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:10:37 smithi099 podman[68089]: 2024-09-19 06:10:37.459218158 +0000 UTC m=+6.049669251 container cleanup 409f7bdf7f9703ad2b8a1ce848d125f9e3758c68a92eb52883d125f3e1234bcc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-1, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-19T06:10:37.689 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:10:37 smithi099 bash[68089]: ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-1 2024-09-19T06:10:38.034 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:10:37 smithi099 podman[68105]: 2024-09-19 06:10:37.701122906 +0000 UTC m=+0.621301199 container remove 409f7bdf7f9703ad2b8a1ce848d125f9e3758c68a92eb52883d125f3e1234bcc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-1, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-19T06:10:38.331 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:10:38 smithi099 podman[68192]: 2024-09-19 06:10:37.935751631 +0000 UTC m=+0.015745683 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:10:38.331 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:10:38 smithi099 podman[68192]: 2024-09-19 06:10:38.069033381 +0000 UTC m=+0.149027430 container create d3a2b909a829dd10ade924639a6bca84f6d6d0e407437bd453fdd97bd633ad81 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:10:38.689 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:10:38 smithi099 podman[68192]: 2024-09-19 06:10:38.330142008 +0000 UTC m=+0.410136044 container init d3a2b909a829dd10ade924639a6bca84f6d6d0e407437bd453fdd97bd633ad81 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-1-deactivate, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:10:38.689 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:10:38 smithi099 podman[68192]: 2024-09-19 06:10:38.333665063 +0000 UTC m=+0.413659107 container start d3a2b909a829dd10ade924639a6bca84f6d6d0e407437bd453fdd97bd633ad81 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-1-deactivate, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-19T06:10:38.689 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:10:38 smithi099 podman[68192]: 2024-09-19 06:10:38.421961322 +0000 UTC m=+0.501955370 container attach d3a2b909a829dd10ade924639a6bca84f6d6d0e407437bd453fdd97bd633ad81 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-19T06:10:38.689 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:10:38 smithi099 podman[68192]: 2024-09-19 06:10:38.522867315 +0000 UTC m=+0.602861364 container died d3a2b909a829dd10ade924639a6bca84f6d6d0e407437bd453fdd97bd633ad81 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4) 2024-09-19T06:10:39.184 DEBUG:teuthology.orchestra.run.smithi099:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@osd.1.service' 2024-09-19T06:10:39.224 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:10:39.225 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-19T06:10:39.225 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-19T06:10:39.225 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@osd.2 2024-09-19T06:10:39.535 INFO:journalctl@ceph.osd.2.smithi117.stdout:Sep 19 06:10:39 smithi117 systemd[1]: Stopping Ceph osd.2 for b8c8bdae-764b-11ef-bceb-c7b262605968... 2024-09-19T06:10:40.000 INFO:journalctl@ceph.osd.2.smithi117.stdout:Sep 19 06:10:39 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-2[40027]: 2024-09-19T06:10:39.533+0000 7fe029617640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:10:40.000 INFO:journalctl@ceph.osd.2.smithi117.stdout:Sep 19 06:10:39 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-2[40027]: 2024-09-19T06:10:39.533+0000 7fe029617640 -1 osd.2 95 *** Got signal Terminated *** 2024-09-19T06:10:40.000 INFO:journalctl@ceph.osd.2.smithi117.stdout:Sep 19 06:10:39 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-2[40027]: 2024-09-19T06:10:39.533+0000 7fe029617640 -1 osd.2 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:10:45.326 INFO:journalctl@ceph.osd.2.smithi117.stdout:Sep 19 06:10:45 smithi117 podman[67793]: 2024-09-19 06:10:45.009210927 +0000 UTC m=+5.590738883 container died f49356cbcf32cc37c00a1f47b57d50360d10940f835c31015f3921e01f4c2845 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-19T06:10:45.652 INFO:journalctl@ceph.osd.2.smithi117.stdout:Sep 19 06:10:45 smithi117 podman[67793]: 2024-09-19 06:10:45.424830807 +0000 UTC m=+6.006358753 container cleanup f49356cbcf32cc37c00a1f47b57d50360d10940f835c31015f3921e01f4c2845 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-19T06:10:45.653 INFO:journalctl@ceph.osd.2.smithi117.stdout:Sep 19 06:10:45 smithi117 bash[67793]: ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-2 2024-09-19T06:10:45.999 INFO:journalctl@ceph.osd.2.smithi117.stdout:Sep 19 06:10:45 smithi117 podman[67811]: 2024-09-19 06:10:45.6513127 +0000 UTC m=+0.642943767 container remove f49356cbcf32cc37c00a1f47b57d50360d10940f835c31015f3921e01f4c2845 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:10:46.356 INFO:journalctl@ceph.osd.2.smithi117.stdout:Sep 19 06:10:46 smithi117 podman[67900]: 2024-09-19 06:10:45.993960036 +0000 UTC m=+0.016100832 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:10:46.356 INFO:journalctl@ceph.osd.2.smithi117.stdout:Sep 19 06:10:46 smithi117 podman[67900]: 2024-09-19 06:10:46.110609115 +0000 UTC m=+0.132749903 container create a5b75577c963ccd7ef7896b37808036e5f537b78374e50a9eb9a21ca11486e52 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-19T06:10:46.356 INFO:journalctl@ceph.osd.2.smithi117.stdout:Sep 19 06:10:46 smithi117 podman[67900]: 2024-09-19 06:10:46.355148214 +0000 UTC m=+0.377289001 container init a5b75577c963ccd7ef7896b37808036e5f537b78374e50a9eb9a21ca11486e52 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-19T06:10:46.750 INFO:journalctl@ceph.osd.2.smithi117.stdout:Sep 19 06:10:46 smithi117 podman[67900]: 2024-09-19 06:10:46.358506295 +0000 UTC m=+0.380647083 container start a5b75577c963ccd7ef7896b37808036e5f537b78374e50a9eb9a21ca11486e52 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_CLEAN=True) 2024-09-19T06:10:46.750 INFO:journalctl@ceph.osd.2.smithi117.stdout:Sep 19 06:10:46 smithi117 podman[67900]: 2024-09-19 06:10:46.472118875 +0000 UTC m=+0.494259693 container attach a5b75577c963ccd7ef7896b37808036e5f537b78374e50a9eb9a21ca11486e52 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-19T06:10:46.750 INFO:journalctl@ceph.osd.2.smithi117.stdout:Sep 19 06:10:46 smithi117 podman[67900]: 2024-09-19 06:10:46.54342464 +0000 UTC m=+0.565565428 container died a5b75577c963ccd7ef7896b37808036e5f537b78374e50a9eb9a21ca11486e52 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:10:47.206 DEBUG:teuthology.orchestra.run.smithi117:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@osd.2.service' 2024-09-19T06:10:47.249 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:10:47.249 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-19T06:10:47.249 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-19T06:10:47.250 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@osd.3 2024-09-19T06:10:47.573 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 19 06:10:47 smithi037 systemd[1]: Stopping Ceph osd.3 for b8c8bdae-764b-11ef-bceb-c7b262605968... 2024-09-19T06:10:48.074 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 19 06:10:47 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-3[49369]: 2024-09-19T06:10:47.618+0000 7f6c3ce1e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:10:48.074 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 19 06:10:47 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-3[49369]: 2024-09-19T06:10:47.618+0000 7f6c3ce1e640 -1 osd.3 95 *** Got signal Terminated *** 2024-09-19T06:10:48.074 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 19 06:10:47 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-3[49369]: 2024-09-19T06:10:47.618+0000 7f6c3ce1e640 -1 osd.3 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:10:49.689 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:10:49 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:10:49.317+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:24.169913+0000 front 2024-09-19T06:10:24.169648+0000 (oldest deadline 2024-09-19T06:10:48.869512+0000) 2024-09-19T06:10:49.999 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:10:49 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-5[46498]: 2024-09-19T06:10:49.610+0000 7fdf783ff640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.582977+0000 front 2024-09-19T06:10:25.582942+0000 (oldest deadline 2024-09-19T06:10:49.083132+0000) 2024-09-19T06:10:50.323 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 19 06:10:49 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-3[49369]: 2024-09-19T06:10:49.971+0000 7f6c3542c640 -1 osd.3 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:26.396665+0000 front 2024-09-19T06:10:26.396692+0000 (oldest deadline 2024-09-19T06:10:49.896795+0000) 2024-09-19T06:10:50.688 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:10:50 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:10:50.281+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:24.169913+0000 front 2024-09-19T06:10:24.169648+0000 (oldest deadline 2024-09-19T06:10:48.869512+0000) 2024-09-19T06:10:50.999 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:10:50 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-5[46498]: 2024-09-19T06:10:50.637+0000 7fdf783ff640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.582977+0000 front 2024-09-19T06:10:25.582942+0000 (oldest deadline 2024-09-19T06:10:49.083132+0000) 2024-09-19T06:10:51.324 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 19 06:10:50 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-3[49369]: 2024-09-19T06:10:50.945+0000 7f6c3542c640 -1 osd.3 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:26.396665+0000 front 2024-09-19T06:10:26.396692+0000 (oldest deadline 2024-09-19T06:10:49.896795+0000) 2024-09-19T06:10:51.499 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:10:51 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:10:51.082+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.243477+0000 front 2024-09-19T06:10:25.243671+0000 (oldest deadline 2024-09-19T06:10:50.543575+0000) 2024-09-19T06:10:51.688 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:10:51 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:10:51.241+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:24.169913+0000 front 2024-09-19T06:10:24.169648+0000 (oldest deadline 2024-09-19T06:10:48.869512+0000) 2024-09-19T06:10:51.999 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:10:51 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-5[46498]: 2024-09-19T06:10:51.612+0000 7fdf783ff640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.582977+0000 front 2024-09-19T06:10:25.582942+0000 (oldest deadline 2024-09-19T06:10:49.083132+0000) 2024-09-19T06:10:52.324 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 19 06:10:51 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-3[49369]: 2024-09-19T06:10:51.923+0000 7f6c3542c640 -1 osd.3 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:26.396665+0000 front 2024-09-19T06:10:26.396692+0000 (oldest deadline 2024-09-19T06:10:49.896795+0000) 2024-09-19T06:10:52.499 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:10:52 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:10:52.033+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.243477+0000 front 2024-09-19T06:10:25.243671+0000 (oldest deadline 2024-09-19T06:10:50.543575+0000) 2024-09-19T06:10:52.688 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:10:52 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:10:52.272+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:24.169913+0000 front 2024-09-19T06:10:24.169648+0000 (oldest deadline 2024-09-19T06:10:48.869512+0000) 2024-09-19T06:10:52.995 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:10:52 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-5[46498]: 2024-09-19T06:10:52.583+0000 7fdf783ff640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.582977+0000 front 2024-09-19T06:10:25.582942+0000 (oldest deadline 2024-09-19T06:10:49.083132+0000) 2024-09-19T06:10:53.249 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:10:52 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:10:52.993+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.243477+0000 front 2024-09-19T06:10:25.243671+0000 (oldest deadline 2024-09-19T06:10:50.543575+0000) 2024-09-19T06:10:53.573 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 19 06:10:53 smithi037 podman[87844]: 2024-09-19 06:10:53.121243757 +0000 UTC m=+5.653435800 container died f1fa334c09d9eca55030bf7b5a41e0686a454b90a9e66e875a663f52521e67c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-3, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-19T06:10:53.688 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:10:53 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:10:53.245+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:24.169913+0000 front 2024-09-19T06:10:24.169648+0000 (oldest deadline 2024-09-19T06:10:48.869512+0000) 2024-09-19T06:10:53.887 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 19 06:10:53 smithi037 podman[87844]: 2024-09-19 06:10:53.576296376 +0000 UTC m=+6.108488460 container cleanup f1fa334c09d9eca55030bf7b5a41e0686a454b90a9e66e875a663f52521e67c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-19T06:10:53.887 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 19 06:10:53 smithi037 bash[87844]: ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-3 2024-09-19T06:10:53.999 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:10:53 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-5[46498]: 2024-09-19T06:10:53.577+0000 7fdf783ff640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.582977+0000 front 2024-09-19T06:10:25.582942+0000 (oldest deadline 2024-09-19T06:10:49.083132+0000) 2024-09-19T06:10:54.213 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 19 06:10:53 smithi037 podman[87869]: 2024-09-19 06:10:53.886199373 +0000 UTC m=+0.759016886 container remove f1fa334c09d9eca55030bf7b5a41e0686a454b90a9e66e875a663f52521e67c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-3, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-19T06:10:54.482 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:10:54 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:10:54.384+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:27.553558+0000 front 2024-09-19T06:10:27.553623+0000 (oldest deadline 2024-09-19T06:10:53.453694+0000) 2024-09-19T06:10:54.482 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 19 06:10:54 smithi037 podman[87959]: 2024-09-19 06:10:54.114690483 +0000 UTC m=+0.016625813 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:10:54.482 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 19 06:10:54 smithi037 podman[87959]: 2024-09-19 06:10:54.237232656 +0000 UTC m=+0.139167986 container create dd5fab5ff15f253de2ebbd55097124fb965e51c8873f0ce31d73ed507bef9341 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True) 2024-09-19T06:10:54.483 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 19 06:10:54 smithi037 podman[87959]: 2024-09-19 06:10:54.481459658 +0000 UTC m=+0.383394988 container init dd5fab5ff15f253de2ebbd55097124fb965e51c8873f0ce31d73ed507bef9341 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-19T06:10:54.499 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:10:54 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:10:54.024+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.243477+0000 front 2024-09-19T06:10:25.243671+0000 (oldest deadline 2024-09-19T06:10:50.543575+0000) 2024-09-19T06:10:54.688 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:10:54 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:10:54.211+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:24.169913+0000 front 2024-09-19T06:10:24.169648+0000 (oldest deadline 2024-09-19T06:10:48.869512+0000) 2024-09-19T06:10:54.824 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 19 06:10:54 smithi037 podman[87959]: 2024-09-19 06:10:54.485148764 +0000 UTC m=+0.387084094 container start dd5fab5ff15f253de2ebbd55097124fb965e51c8873f0ce31d73ed507bef9341 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-3-deactivate, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-19T06:10:54.824 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 19 06:10:54 smithi037 podman[87959]: 2024-09-19 06:10:54.581602042 +0000 UTC m=+0.483537386 container attach dd5fab5ff15f253de2ebbd55097124fb965e51c8873f0ce31d73ed507bef9341 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_CLEAN=True) 2024-09-19T06:10:54.824 INFO:journalctl@ceph.osd.3.smithi037.stdout:Sep 19 06:10:54 smithi037 podman[87959]: 2024-09-19 06:10:54.678692034 +0000 UTC m=+0.580627363 container died dd5fab5ff15f253de2ebbd55097124fb965e51c8873f0ce31d73ed507bef9341 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-19T06:10:54.996 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:10:54 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-5[46498]: 2024-09-19T06:10:54.617+0000 7fdf783ff640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.582977+0000 front 2024-09-19T06:10:25.582942+0000 (oldest deadline 2024-09-19T06:10:49.083132+0000) 2024-09-19T06:10:55.249 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:10:54 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:10:54.994+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.243477+0000 front 2024-09-19T06:10:25.243671+0000 (oldest deadline 2024-09-19T06:10:50.543575+0000) 2024-09-19T06:10:55.472 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@osd.3.service' 2024-09-19T06:10:55.519 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:10:55.520 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-19T06:10:55.520 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-19T06:10:55.520 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@osd.4 2024-09-19T06:10:55.548 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:10:55 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:10:55.210+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:24.169913+0000 front 2024-09-19T06:10:24.169648+0000 (oldest deadline 2024-09-19T06:10:48.869512+0000) 2024-09-19T06:10:55.821 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 19 06:10:55 smithi099 systemd[1]: Stopping Ceph osd.4 for b8c8bdae-764b-11ef-bceb-c7b262605968... 2024-09-19T06:10:55.823 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:10:55 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:10:55.425+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:27.553558+0000 front 2024-09-19T06:10:27.553623+0000 (oldest deadline 2024-09-19T06:10:53.453694+0000) 2024-09-19T06:10:55.993 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:10:55 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-5[46498]: 2024-09-19T06:10:55.628+0000 7fdf783ff640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.582977+0000 front 2024-09-19T06:10:25.582942+0000 (oldest deadline 2024-09-19T06:10:49.083132+0000) 2024-09-19T06:10:56.173 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 19 06:10:55 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-4[46526]: 2024-09-19T06:10:55.819+0000 7f7f34088640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:10:56.173 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 19 06:10:55 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-4[46526]: 2024-09-19T06:10:55.819+0000 7f7f34088640 -1 osd.4 95 *** Got signal Terminated *** 2024-09-19T06:10:56.173 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 19 06:10:55 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-4[46526]: 2024-09-19T06:10:55.819+0000 7f7f34088640 -1 osd.4 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:10:56.249 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:10:55 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:10:55.992+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.243477+0000 front 2024-09-19T06:10:25.243671+0000 (oldest deadline 2024-09-19T06:10:50.543575+0000) 2024-09-19T06:10:56.438 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:10:56 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:10:56.171+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:24.169913+0000 front 2024-09-19T06:10:24.169648+0000 (oldest deadline 2024-09-19T06:10:48.869512+0000) 2024-09-19T06:10:56.823 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:10:56 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:10:56.453+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:27.553558+0000 front 2024-09-19T06:10:27.553623+0000 (oldest deadline 2024-09-19T06:10:53.453694+0000) 2024-09-19T06:10:56.946 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:10:56 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-5[46498]: 2024-09-19T06:10:56.663+0000 7fdf783ff640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.582977+0000 front 2024-09-19T06:10:25.582942+0000 (oldest deadline 2024-09-19T06:10:49.083132+0000) 2024-09-19T06:10:57.249 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:10:56 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:10:56.944+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.243477+0000 front 2024-09-19T06:10:25.243671+0000 (oldest deadline 2024-09-19T06:10:50.543575+0000) 2024-09-19T06:10:57.438 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:10:57 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:10:57.157+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:24.169913+0000 front 2024-09-19T06:10:24.169648+0000 (oldest deadline 2024-09-19T06:10:48.869512+0000) 2024-09-19T06:10:57.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:10:57 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:10:57.417+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:27.553558+0000 front 2024-09-19T06:10:27.553623+0000 (oldest deadline 2024-09-19T06:10:53.453694+0000) 2024-09-19T06:10:57.929 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:10:57 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-5[46498]: 2024-09-19T06:10:57.622+0000 7fdf783ff640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.582977+0000 front 2024-09-19T06:10:25.582942+0000 (oldest deadline 2024-09-19T06:10:49.083132+0000) 2024-09-19T06:10:58.249 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:10:57 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:10:57.958+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.243477+0000 front 2024-09-19T06:10:25.243671+0000 (oldest deadline 2024-09-19T06:10:50.543575+0000) 2024-09-19T06:10:58.438 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 19 06:10:58 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-4[46526]: 2024-09-19T06:10:58.272+0000 7f7f3069e640 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:33.994636+0000 front 2024-09-19T06:10:33.994664+0000 (oldest deadline 2024-09-19T06:10:57.494785+0000) 2024-09-19T06:10:58.439 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 06:10:58 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-7[53481]: 2024-09-19T06:10:58.048+0000 7f5c8df65640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.362851+0000 front 2024-09-19T06:10:34.362885+0000 (oldest deadline 2024-09-19T06:10:57.263019+0000) 2024-09-19T06:10:58.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:10:58 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:10:58.180+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:24.169913+0000 front 2024-09-19T06:10:24.169648+0000 (oldest deadline 2024-09-19T06:10:48.869512+0000) 2024-09-19T06:10:58.574 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:10:58 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:10:58.371+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:27.553558+0000 front 2024-09-19T06:10:27.553623+0000 (oldest deadline 2024-09-19T06:10:53.453694+0000) 2024-09-19T06:10:58.574 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:10:58 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:10:58.371+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.554975+0000 front 2024-09-19T06:10:34.554852+0000 (oldest deadline 2024-09-19T06:10:57.454655+0000) 2024-09-19T06:10:58.749 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:10:58 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-5[46498]: 2024-09-19T06:10:58.580+0000 7fdf783ff640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.582977+0000 front 2024-09-19T06:10:25.582942+0000 (oldest deadline 2024-09-19T06:10:49.083132+0000) 2024-09-19T06:10:59.249 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:10:58 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:10:58.933+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.243477+0000 front 2024-09-19T06:10:25.243671+0000 (oldest deadline 2024-09-19T06:10:50.543575+0000) 2024-09-19T06:10:59.438 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 19 06:10:59 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-4[46526]: 2024-09-19T06:10:59.258+0000 7f7f3069e640 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:33.994636+0000 front 2024-09-19T06:10:33.994664+0000 (oldest deadline 2024-09-19T06:10:57.494785+0000) 2024-09-19T06:10:59.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:10:59 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:10:59.205+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:24.169913+0000 front 2024-09-19T06:10:24.169648+0000 (oldest deadline 2024-09-19T06:10:48.869512+0000) 2024-09-19T06:10:59.439 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 06:10:59 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-7[53481]: 2024-09-19T06:10:59.096+0000 7f5c8df65640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.362851+0000 front 2024-09-19T06:10:34.362885+0000 (oldest deadline 2024-09-19T06:10:57.263019+0000) 2024-09-19T06:10:59.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:10:59 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:10:59.340+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:27.553558+0000 front 2024-09-19T06:10:27.553623+0000 (oldest deadline 2024-09-19T06:10:53.453694+0000) 2024-09-19T06:10:59.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:10:59 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:10:59.340+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.554975+0000 front 2024-09-19T06:10:34.554852+0000 (oldest deadline 2024-09-19T06:10:57.454655+0000) 2024-09-19T06:10:59.974 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:10:59 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-5[46498]: 2024-09-19T06:10:59.605+0000 7fdf783ff640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.582977+0000 front 2024-09-19T06:10:25.582942+0000 (oldest deadline 2024-09-19T06:10:49.083132+0000) 2024-09-19T06:10:59.974 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:10:59 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-5[46498]: 2024-09-19T06:10:59.605+0000 7fdf783ff640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.984156+0000 front 2024-09-19T06:10:34.984179+0000 (oldest deadline 2024-09-19T06:10:59.084236+0000) 2024-09-19T06:11:00.249 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:10:59 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:10:59.972+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.243477+0000 front 2024-09-19T06:10:25.243671+0000 (oldest deadline 2024-09-19T06:10:50.543575+0000) 2024-09-19T06:11:00.302 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 06:11:00 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-7[53481]: 2024-09-19T06:11:00.048+0000 7f5c8df65640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.362851+0000 front 2024-09-19T06:10:34.362885+0000 (oldest deadline 2024-09-19T06:10:57.263019+0000) 2024-09-19T06:11:00.302 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:00 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:00.213+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:24.169913+0000 front 2024-09-19T06:10:24.169648+0000 (oldest deadline 2024-09-19T06:10:48.869512+0000) 2024-09-19T06:11:00.302 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:00 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:00.213+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:35.771330+0000 front 2024-09-19T06:10:35.771421+0000 (oldest deadline 2024-09-19T06:10:59.871528+0000) 2024-09-19T06:11:00.688 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 19 06:11:00 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-4[46526]: 2024-09-19T06:11:00.300+0000 7f7f3069e640 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:33.994636+0000 front 2024-09-19T06:10:33.994664+0000 (oldest deadline 2024-09-19T06:10:57.494785+0000) 2024-09-19T06:11:00.824 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 19 06:11:00 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-6[55831]: 2024-09-19T06:11:00.467+0000 7fa03cfce640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.477552+0000 front 2024-09-19T06:10:34.477760+0000 (oldest deadline 2024-09-19T06:10:59.777574+0000) 2024-09-19T06:11:00.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:00 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:00.357+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:27.553558+0000 front 2024-09-19T06:10:27.553623+0000 (oldest deadline 2024-09-19T06:10:53.453694+0000) 2024-09-19T06:11:00.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:00 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:00.357+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.554975+0000 front 2024-09-19T06:10:34.554852+0000 (oldest deadline 2024-09-19T06:10:57.454655+0000) 2024-09-19T06:11:00.973 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:11:00 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-5[46498]: 2024-09-19T06:11:00.590+0000 7fdf783ff640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.582977+0000 front 2024-09-19T06:10:25.582942+0000 (oldest deadline 2024-09-19T06:10:49.083132+0000) 2024-09-19T06:11:00.973 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:11:00 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-5[46498]: 2024-09-19T06:11:00.590+0000 7fdf783ff640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.984156+0000 front 2024-09-19T06:10:34.984179+0000 (oldest deadline 2024-09-19T06:10:59.084236+0000) 2024-09-19T06:11:01.241 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:00 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:00.971+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.243477+0000 front 2024-09-19T06:10:25.243671+0000 (oldest deadline 2024-09-19T06:10:50.543575+0000) 2024-09-19T06:11:01.296 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 06:11:01 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-7[53481]: 2024-09-19T06:11:01.022+0000 7f5c8df65640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.362851+0000 front 2024-09-19T06:10:34.362885+0000 (oldest deadline 2024-09-19T06:10:57.263019+0000) 2024-09-19T06:11:01.296 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:01 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:01.194+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:24.169913+0000 front 2024-09-19T06:10:24.169648+0000 (oldest deadline 2024-09-19T06:10:48.869512+0000) 2024-09-19T06:11:01.296 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:01 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:01.194+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:35.771330+0000 front 2024-09-19T06:10:35.771421+0000 (oldest deadline 2024-09-19T06:10:59.871528+0000) 2024-09-19T06:11:01.562 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 19 06:11:01 smithi099 podman[68295]: 2024-09-19 06:11:01.295278705 +0000 UTC m=+5.584101389 container died b605011ee64fcc0f9f85819c970661ec9311b1d756974969c9e7b9d906226f45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-4, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4) 2024-09-19T06:11:01.824 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 19 06:11:01 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-6[55831]: 2024-09-19T06:11:01.437+0000 7fa03cfce640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.477552+0000 front 2024-09-19T06:10:34.477760+0000 (oldest deadline 2024-09-19T06:10:59.777574+0000) 2024-09-19T06:11:01.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:01 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:01.342+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:27.553558+0000 front 2024-09-19T06:10:27.553623+0000 (oldest deadline 2024-09-19T06:10:53.453694+0000) 2024-09-19T06:11:01.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:01 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:01.342+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.554975+0000 front 2024-09-19T06:10:34.554852+0000 (oldest deadline 2024-09-19T06:10:57.454655+0000) 2024-09-19T06:11:01.929 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 19 06:11:01 smithi099 podman[68295]: 2024-09-19 06:11:01.65248166 +0000 UTC m=+5.941304346 container cleanup b605011ee64fcc0f9f85819c970661ec9311b1d756974969c9e7b9d906226f45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-4, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:11:01.930 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 19 06:11:01 smithi099 bash[68295]: ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-4 2024-09-19T06:11:01.985 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:11:01 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-5[46498]: 2024-09-19T06:11:01.628+0000 7fdf783ff640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.582977+0000 front 2024-09-19T06:10:25.582942+0000 (oldest deadline 2024-09-19T06:10:49.083132+0000) 2024-09-19T06:11:01.985 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:11:01 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-5[46498]: 2024-09-19T06:11:01.628+0000 7fdf783ff640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.984156+0000 front 2024-09-19T06:10:34.984179+0000 (oldest deadline 2024-09-19T06:10:59.084236+0000) 2024-09-19T06:11:02.188 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 19 06:11:01 smithi099 podman[68309]: 2024-09-19 06:11:01.928943161 +0000 UTC m=+0.631036286 container remove b605011ee64fcc0f9f85819c970661ec9311b1d756974969c9e7b9d906226f45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-19T06:11:02.189 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 06:11:02 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-7[53481]: 2024-09-19T06:11:02.051+0000 7f5c8df65640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.362851+0000 front 2024-09-19T06:10:34.362885+0000 (oldest deadline 2024-09-19T06:10:57.263019+0000) 2024-09-19T06:11:02.189 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:02 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:02.148+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:24.169913+0000 front 2024-09-19T06:10:24.169648+0000 (oldest deadline 2024-09-19T06:10:48.869512+0000) 2024-09-19T06:11:02.189 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:02 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:02.148+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:35.771330+0000 front 2024-09-19T06:10:35.771421+0000 (oldest deadline 2024-09-19T06:10:59.871528+0000) 2024-09-19T06:11:02.249 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:01 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:01.983+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.243477+0000 front 2024-09-19T06:10:25.243671+0000 (oldest deadline 2024-09-19T06:10:50.543575+0000) 2024-09-19T06:11:02.559 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 19 06:11:02 smithi099 podman[68400]: 2024-09-19 06:11:02.167764675 +0000 UTC m=+0.015826269 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:11:02.559 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 19 06:11:02 smithi099 podman[68400]: 2024-09-19 06:11:02.288394516 +0000 UTC m=+0.136456153 container create 0290983967e512bfbc95f340d12c92dcb6a9505bd7ecd26266fc1b36de95c7ca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD) 2024-09-19T06:11:02.559 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 19 06:11:02 smithi099 podman[68400]: 2024-09-19 06:11:02.557738588 +0000 UTC m=+0.405800182 container init 0290983967e512bfbc95f340d12c92dcb6a9505bd7ecd26266fc1b36de95c7ca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-19T06:11:02.824 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 19 06:11:02 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-6[55831]: 2024-09-19T06:11:02.477+0000 7fa03cfce640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.477552+0000 front 2024-09-19T06:10:34.477760+0000 (oldest deadline 2024-09-19T06:10:59.777574+0000) 2024-09-19T06:11:02.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:02 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:02.377+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:27.553558+0000 front 2024-09-19T06:10:27.553623+0000 (oldest deadline 2024-09-19T06:10:53.453694+0000) 2024-09-19T06:11:02.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:02 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:02.377+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.554975+0000 front 2024-09-19T06:10:34.554852+0000 (oldest deadline 2024-09-19T06:10:57.454655+0000) 2024-09-19T06:11:02.938 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 19 06:11:02 smithi099 podman[68400]: 2024-09-19 06:11:02.561124991 +0000 UTC m=+0.409186577 container start 0290983967e512bfbc95f340d12c92dcb6a9505bd7ecd26266fc1b36de95c7ca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:11:02.939 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 19 06:11:02 smithi099 podman[68400]: 2024-09-19 06:11:02.657944535 +0000 UTC m=+0.506006137 container attach 0290983967e512bfbc95f340d12c92dcb6a9505bd7ecd26266fc1b36de95c7ca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True) 2024-09-19T06:11:02.939 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 19 06:11:02 smithi099 podman[68400]: 2024-09-19 06:11:02.749862848 +0000 UTC m=+0.597924444 container died 0290983967e512bfbc95f340d12c92dcb6a9505bd7ecd26266fc1b36de95c7ca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-4-deactivate, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-19T06:11:02.999 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:02 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:02.548+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:36.251202+0000 front 2024-09-19T06:10:36.251075+0000 (oldest deadline 2024-09-19T06:11:01.551059+0000) 2024-09-19T06:11:02.999 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:11:02 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-5[46498]: 2024-09-19T06:11:02.598+0000 7fdf783ff640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.582977+0000 front 2024-09-19T06:10:25.582942+0000 (oldest deadline 2024-09-19T06:10:49.083132+0000) 2024-09-19T06:11:02.999 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:11:02 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-5[46498]: 2024-09-19T06:11:02.598+0000 7fdf783ff640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.984156+0000 front 2024-09-19T06:10:34.984179+0000 (oldest deadline 2024-09-19T06:10:59.084236+0000) 2024-09-19T06:11:03.249 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:02 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:02.997+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.243477+0000 front 2024-09-19T06:10:25.243671+0000 (oldest deadline 2024-09-19T06:10:50.543575+0000) 2024-09-19T06:11:03.379 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 06:11:03 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-7[53481]: 2024-09-19T06:11:03.029+0000 7f5c8df65640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.362851+0000 front 2024-09-19T06:10:34.362885+0000 (oldest deadline 2024-09-19T06:10:57.263019+0000) 2024-09-19T06:11:03.379 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:03 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:03.126+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:24.169913+0000 front 2024-09-19T06:10:24.169648+0000 (oldest deadline 2024-09-19T06:10:48.869512+0000) 2024-09-19T06:11:03.380 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:03 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:03.126+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:35.771330+0000 front 2024-09-19T06:10:35.771421+0000 (oldest deadline 2024-09-19T06:10:59.871528+0000) 2024-09-19T06:11:03.409 DEBUG:teuthology.orchestra.run.smithi099:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@osd.4.service' 2024-09-19T06:11:03.488 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:11:03.488 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-19T06:11:03.488 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-19T06:11:03.489 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@osd.5 2024-09-19T06:11:03.803 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:03 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:03.544+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:36.251202+0000 front 2024-09-19T06:10:36.251075+0000 (oldest deadline 2024-09-19T06:11:01.551059+0000) 2024-09-19T06:11:03.804 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:11:03 smithi117 systemd[1]: Stopping Ceph osd.5 for b8c8bdae-764b-11ef-bceb-c7b262605968... 2024-09-19T06:11:03.804 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:11:03 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-5[46498]: 2024-09-19T06:11:03.558+0000 7fdf783ff640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.582977+0000 front 2024-09-19T06:10:25.582942+0000 (oldest deadline 2024-09-19T06:10:49.083132+0000) 2024-09-19T06:11:03.804 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:11:03 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-5[46498]: 2024-09-19T06:11:03.558+0000 7fdf783ff640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.984156+0000 front 2024-09-19T06:10:34.984179+0000 (oldest deadline 2024-09-19T06:10:59.084236+0000) 2024-09-19T06:11:03.804 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:11:03 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-5[46498]: 2024-09-19T06:11:03.802+0000 7fdf7bde9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:11:03.823 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 19 06:11:03 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-6[55831]: 2024-09-19T06:11:03.431+0000 7fa03cfce640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.477552+0000 front 2024-09-19T06:10:34.477760+0000 (oldest deadline 2024-09-19T06:10:59.777574+0000) 2024-09-19T06:11:03.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:03 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:03.411+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:27.553558+0000 front 2024-09-19T06:10:27.553623+0000 (oldest deadline 2024-09-19T06:10:53.453694+0000) 2024-09-19T06:11:03.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:03 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:03.411+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.554975+0000 front 2024-09-19T06:10:34.554852+0000 (oldest deadline 2024-09-19T06:10:57.454655+0000) 2024-09-19T06:11:04.249 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:04 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:04.043+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.243477+0000 front 2024-09-19T06:10:25.243671+0000 (oldest deadline 2024-09-19T06:10:50.543575+0000) 2024-09-19T06:11:04.250 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:11:03 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-5[46498]: 2024-09-19T06:11:03.802+0000 7fdf7bde9640 -1 osd.5 95 *** Got signal Terminated *** 2024-09-19T06:11:04.250 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:11:03 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-5[46498]: 2024-09-19T06:11:03.802+0000 7fdf7bde9640 -1 osd.5 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:11:04.438 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 06:11:03 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-7[53481]: 2024-09-19T06:11:03.980+0000 7f5c8df65640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.362851+0000 front 2024-09-19T06:10:34.362885+0000 (oldest deadline 2024-09-19T06:10:57.263019+0000) 2024-09-19T06:11:04.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:04 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:04.132+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:24.169913+0000 front 2024-09-19T06:10:24.169648+0000 (oldest deadline 2024-09-19T06:10:48.869512+0000) 2024-09-19T06:11:04.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:04 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:04.132+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:35.771330+0000 front 2024-09-19T06:10:35.771421+0000 (oldest deadline 2024-09-19T06:10:59.871528+0000) 2024-09-19T06:11:04.824 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 19 06:11:04 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-6[55831]: 2024-09-19T06:11:04.475+0000 7fa03cfce640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.477552+0000 front 2024-09-19T06:10:34.477760+0000 (oldest deadline 2024-09-19T06:10:59.777574+0000) 2024-09-19T06:11:04.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:04 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:04.441+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:27.553558+0000 front 2024-09-19T06:10:27.553623+0000 (oldest deadline 2024-09-19T06:10:53.453694+0000) 2024-09-19T06:11:04.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:04 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:04.441+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.554975+0000 front 2024-09-19T06:10:34.554852+0000 (oldest deadline 2024-09-19T06:10:57.454655+0000) 2024-09-19T06:11:04.999 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:04 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:04.541+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:36.251202+0000 front 2024-09-19T06:10:36.251075+0000 (oldest deadline 2024-09-19T06:11:01.551059+0000) 2024-09-19T06:11:05.000 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:11:04 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-5[46498]: 2024-09-19T06:11:04.537+0000 7fdf783ff640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.582977+0000 front 2024-09-19T06:10:25.582942+0000 (oldest deadline 2024-09-19T06:10:49.083132+0000) 2024-09-19T06:11:05.000 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:11:04 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-5[46498]: 2024-09-19T06:11:04.537+0000 7fdf783ff640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.984156+0000 front 2024-09-19T06:10:34.984179+0000 (oldest deadline 2024-09-19T06:10:59.084236+0000) 2024-09-19T06:11:05.438 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 06:11:04 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-7[53481]: 2024-09-19T06:11:04.951+0000 7f5c8df65640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.362851+0000 front 2024-09-19T06:10:34.362885+0000 (oldest deadline 2024-09-19T06:10:57.263019+0000) 2024-09-19T06:11:05.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:05 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:05.090+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:24.169913+0000 front 2024-09-19T06:10:24.169648+0000 (oldest deadline 2024-09-19T06:10:48.869512+0000) 2024-09-19T06:11:05.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:05 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:05.090+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:35.771330+0000 front 2024-09-19T06:10:35.771421+0000 (oldest deadline 2024-09-19T06:10:59.871528+0000) 2024-09-19T06:11:05.499 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:05 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:05.037+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.243477+0000 front 2024-09-19T06:10:25.243671+0000 (oldest deadline 2024-09-19T06:10:50.543575+0000) 2024-09-19T06:11:05.824 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 19 06:11:05 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-6[55831]: 2024-09-19T06:11:05.447+0000 7fa03cfce640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.477552+0000 front 2024-09-19T06:10:34.477760+0000 (oldest deadline 2024-09-19T06:10:59.777574+0000) 2024-09-19T06:11:05.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:05 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:05.474+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:27.553558+0000 front 2024-09-19T06:10:27.553623+0000 (oldest deadline 2024-09-19T06:10:53.453694+0000) 2024-09-19T06:11:05.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:05 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:05.474+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.554975+0000 front 2024-09-19T06:10:34.554852+0000 (oldest deadline 2024-09-19T06:10:57.454655+0000) 2024-09-19T06:11:05.999 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:05 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:05.573+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:36.251202+0000 front 2024-09-19T06:10:36.251075+0000 (oldest deadline 2024-09-19T06:11:01.551059+0000) 2024-09-19T06:11:06.000 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:11:05 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-5[46498]: 2024-09-19T06:11:05.500+0000 7fdf783ff640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.582977+0000 front 2024-09-19T06:10:25.582942+0000 (oldest deadline 2024-09-19T06:10:49.083132+0000) 2024-09-19T06:11:06.000 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:11:05 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-5[46498]: 2024-09-19T06:11:05.500+0000 7fdf783ff640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.984156+0000 front 2024-09-19T06:10:34.984179+0000 (oldest deadline 2024-09-19T06:10:59.084236+0000) 2024-09-19T06:11:06.189 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 06:11:05 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-7[53481]: 2024-09-19T06:11:05.905+0000 7f5c8df65640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.362851+0000 front 2024-09-19T06:10:34.362885+0000 (oldest deadline 2024-09-19T06:10:57.263019+0000) 2024-09-19T06:11:06.189 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:06 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:06.072+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:24.169913+0000 front 2024-09-19T06:10:24.169648+0000 (oldest deadline 2024-09-19T06:10:48.869512+0000) 2024-09-19T06:11:06.189 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:06 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:06.072+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:35.771330+0000 front 2024-09-19T06:10:35.771421+0000 (oldest deadline 2024-09-19T06:10:59.871528+0000) 2024-09-19T06:11:06.499 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:06 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:06.085+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.243477+0000 front 2024-09-19T06:10:25.243671+0000 (oldest deadline 2024-09-19T06:10:50.543575+0000) 2024-09-19T06:11:06.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:06 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:06.085+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:40.846622+0000 front 2024-09-19T06:10:40.846471+0000 (oldest deadline 2024-09-19T06:11:05.546652+0000) 2024-09-19T06:11:06.824 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 19 06:11:06 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-6[55831]: 2024-09-19T06:11:06.421+0000 7fa03cfce640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.477552+0000 front 2024-09-19T06:10:34.477760+0000 (oldest deadline 2024-09-19T06:10:59.777574+0000) 2024-09-19T06:11:06.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:06 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:06.502+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:27.553558+0000 front 2024-09-19T06:10:27.553623+0000 (oldest deadline 2024-09-19T06:10:53.453694+0000) 2024-09-19T06:11:06.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:06 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:06.502+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.554975+0000 front 2024-09-19T06:10:34.554852+0000 (oldest deadline 2024-09-19T06:10:57.454655+0000) 2024-09-19T06:11:06.999 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:06 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:06.597+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:36.251202+0000 front 2024-09-19T06:10:36.251075+0000 (oldest deadline 2024-09-19T06:11:01.551059+0000) 2024-09-19T06:11:07.000 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:06 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:06.597+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:43.252151+0000 front 2024-09-19T06:10:43.252231+0000 (oldest deadline 2024-09-19T06:11:06.152401+0000) 2024-09-19T06:11:07.000 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:11:06 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-5[46498]: 2024-09-19T06:11:06.531+0000 7fdf783ff640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.582977+0000 front 2024-09-19T06:10:25.582942+0000 (oldest deadline 2024-09-19T06:10:49.083132+0000) 2024-09-19T06:11:07.000 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:11:06 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-5[46498]: 2024-09-19T06:11:06.531+0000 7fdf783ff640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.984156+0000 front 2024-09-19T06:10:34.984179+0000 (oldest deadline 2024-09-19T06:10:59.084236+0000) 2024-09-19T06:11:07.188 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 06:11:06 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-7[53481]: 2024-09-19T06:11:06.901+0000 7f5c8df65640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.362851+0000 front 2024-09-19T06:10:34.362885+0000 (oldest deadline 2024-09-19T06:10:57.263019+0000) 2024-09-19T06:11:07.189 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 06:11:06 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-7[53481]: 2024-09-19T06:11:06.901+0000 7f5c8df65640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:44.466359+0000 front 2024-09-19T06:10:44.466301+0000 (oldest deadline 2024-09-19T06:11:06.166403+0000) 2024-09-19T06:11:07.189 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:07 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:07.030+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:24.169913+0000 front 2024-09-19T06:10:24.169648+0000 (oldest deadline 2024-09-19T06:10:48.869512+0000) 2024-09-19T06:11:07.189 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:07 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:07.030+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:35.771330+0000 front 2024-09-19T06:10:35.771421+0000 (oldest deadline 2024-09-19T06:10:59.871528+0000) 2024-09-19T06:11:07.489 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:07 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:07.103+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.243477+0000 front 2024-09-19T06:10:25.243671+0000 (oldest deadline 2024-09-19T06:10:50.543575+0000) 2024-09-19T06:11:07.489 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:07 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:07.103+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:40.846622+0000 front 2024-09-19T06:10:40.846471+0000 (oldest deadline 2024-09-19T06:11:05.546652+0000) 2024-09-19T06:11:07.750 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:07 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:07.613+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:36.251202+0000 front 2024-09-19T06:10:36.251075+0000 (oldest deadline 2024-09-19T06:11:01.551059+0000) 2024-09-19T06:11:07.750 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:07 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:07.613+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:43.252151+0000 front 2024-09-19T06:10:43.252231+0000 (oldest deadline 2024-09-19T06:11:06.152401+0000) 2024-09-19T06:11:07.750 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:11:07 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-5[46498]: 2024-09-19T06:11:07.487+0000 7fdf783ff640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.582977+0000 front 2024-09-19T06:10:25.582942+0000 (oldest deadline 2024-09-19T06:10:49.083132+0000) 2024-09-19T06:11:07.750 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:11:07 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-5[46498]: 2024-09-19T06:11:07.487+0000 7fdf783ff640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.984156+0000 front 2024-09-19T06:10:34.984179+0000 (oldest deadline 2024-09-19T06:10:59.084236+0000) 2024-09-19T06:11:07.750 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:11:07 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-5[46498]: 2024-09-19T06:11:07.487+0000 7fdf783ff640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:44.385072+0000 front 2024-09-19T06:10:44.385051+0000 (oldest deadline 2024-09-19T06:11:06.685178+0000) 2024-09-19T06:11:07.824 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 19 06:11:07 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-6[55831]: 2024-09-19T06:11:07.429+0000 7fa03cfce640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.477552+0000 front 2024-09-19T06:10:34.477760+0000 (oldest deadline 2024-09-19T06:10:59.777574+0000) 2024-09-19T06:11:07.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:07 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:07.464+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:27.553558+0000 front 2024-09-19T06:10:27.553623+0000 (oldest deadline 2024-09-19T06:10:53.453694+0000) 2024-09-19T06:11:07.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:07 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:07.464+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.554975+0000 front 2024-09-19T06:10:34.554852+0000 (oldest deadline 2024-09-19T06:10:57.454655+0000) 2024-09-19T06:11:07.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:07 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:07.464+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:42.155865+0000 front 2024-09-19T06:10:42.155832+0000 (oldest deadline 2024-09-19T06:11:07.455632+0000) 2024-09-19T06:11:08.188 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 06:11:07 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-7[53481]: 2024-09-19T06:11:07.877+0000 7f5c8df65640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.362851+0000 front 2024-09-19T06:10:34.362885+0000 (oldest deadline 2024-09-19T06:10:57.263019+0000) 2024-09-19T06:11:08.189 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 06:11:07 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-7[53481]: 2024-09-19T06:11:07.877+0000 7f5c8df65640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:44.466359+0000 front 2024-09-19T06:10:44.466301+0000 (oldest deadline 2024-09-19T06:11:06.166403+0000) 2024-09-19T06:11:08.189 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:08 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:08.035+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:24.169913+0000 front 2024-09-19T06:10:24.169648+0000 (oldest deadline 2024-09-19T06:10:48.869512+0000) 2024-09-19T06:11:08.189 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:08 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:08.035+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:35.771330+0000 front 2024-09-19T06:10:35.771421+0000 (oldest deadline 2024-09-19T06:10:59.871528+0000) 2024-09-19T06:11:08.467 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:08 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:08.081+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.243477+0000 front 2024-09-19T06:10:25.243671+0000 (oldest deadline 2024-09-19T06:10:50.543575+0000) 2024-09-19T06:11:08.467 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:08 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:08.081+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:40.846622+0000 front 2024-09-19T06:10:40.846471+0000 (oldest deadline 2024-09-19T06:11:05.546652+0000) 2024-09-19T06:11:08.749 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:08 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:08.633+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:36.251202+0000 front 2024-09-19T06:10:36.251075+0000 (oldest deadline 2024-09-19T06:11:01.551059+0000) 2024-09-19T06:11:08.750 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:08 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:08.633+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:43.252151+0000 front 2024-09-19T06:10:43.252231+0000 (oldest deadline 2024-09-19T06:11:06.152401+0000) 2024-09-19T06:11:08.750 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:11:08 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-5[46498]: 2024-09-19T06:11:08.465+0000 7fdf783ff640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.582977+0000 front 2024-09-19T06:10:25.582942+0000 (oldest deadline 2024-09-19T06:10:49.083132+0000) 2024-09-19T06:11:08.750 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:11:08 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-5[46498]: 2024-09-19T06:11:08.465+0000 7fdf783ff640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.984156+0000 front 2024-09-19T06:10:34.984179+0000 (oldest deadline 2024-09-19T06:10:59.084236+0000) 2024-09-19T06:11:08.750 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:11:08 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-5[46498]: 2024-09-19T06:11:08.465+0000 7fdf783ff640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:44.385072+0000 front 2024-09-19T06:10:44.385051+0000 (oldest deadline 2024-09-19T06:11:06.685178+0000) 2024-09-19T06:11:08.823 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 19 06:11:08 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-6[55831]: 2024-09-19T06:11:08.422+0000 7fa03cfce640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.477552+0000 front 2024-09-19T06:10:34.477760+0000 (oldest deadline 2024-09-19T06:10:59.777574+0000) 2024-09-19T06:11:08.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:08 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:08.459+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:27.553558+0000 front 2024-09-19T06:10:27.553623+0000 (oldest deadline 2024-09-19T06:10:53.453694+0000) 2024-09-19T06:11:08.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:08 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:08.459+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.554975+0000 front 2024-09-19T06:10:34.554852+0000 (oldest deadline 2024-09-19T06:10:57.454655+0000) 2024-09-19T06:11:08.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:08 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:08.459+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:42.155865+0000 front 2024-09-19T06:10:42.155832+0000 (oldest deadline 2024-09-19T06:11:07.455632+0000) 2024-09-19T06:11:09.188 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 06:11:08 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-7[53481]: 2024-09-19T06:11:08.858+0000 7f5c8df65640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.362851+0000 front 2024-09-19T06:10:34.362885+0000 (oldest deadline 2024-09-19T06:10:57.263019+0000) 2024-09-19T06:11:09.189 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 06:11:08 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-7[53481]: 2024-09-19T06:11:08.858+0000 7f5c8df65640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:44.466359+0000 front 2024-09-19T06:10:44.466301+0000 (oldest deadline 2024-09-19T06:11:06.166403+0000) 2024-09-19T06:11:09.189 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:09 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:09.056+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:24.169913+0000 front 2024-09-19T06:10:24.169648+0000 (oldest deadline 2024-09-19T06:10:48.869512+0000) 2024-09-19T06:11:09.189 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:09 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:09.056+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:35.771330+0000 front 2024-09-19T06:10:35.771421+0000 (oldest deadline 2024-09-19T06:10:59.871528+0000) 2024-09-19T06:11:09.496 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:11:09 smithi117 podman[68029]: 2024-09-19 06:11:09.130693732 +0000 UTC m=+5.437932644 container died 531b4ea4f7fa90391d55e044adb3a50685a8ba6ff3f5b6a415fd74059a1ace99 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:11:09.496 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:09 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:09.127+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.243477+0000 front 2024-09-19T06:10:25.243671+0000 (oldest deadline 2024-09-19T06:10:50.543575+0000) 2024-09-19T06:11:09.497 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:09 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:09.127+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:40.846622+0000 front 2024-09-19T06:10:40.846471+0000 (oldest deadline 2024-09-19T06:11:05.546652+0000) 2024-09-19T06:11:09.749 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:11:09 smithi117 podman[68029]: 2024-09-19 06:11:09.5853699 +0000 UTC m=+5.892608813 container cleanup 531b4ea4f7fa90391d55e044adb3a50685a8ba6ff3f5b6a415fd74059a1ace99 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-5, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0) 2024-09-19T06:11:09.750 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:11:09 smithi117 bash[68029]: ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-5 2024-09-19T06:11:09.750 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:09 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:09.682+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:36.251202+0000 front 2024-09-19T06:10:36.251075+0000 (oldest deadline 2024-09-19T06:11:01.551059+0000) 2024-09-19T06:11:09.750 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:09 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:09.682+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:43.252151+0000 front 2024-09-19T06:10:43.252231+0000 (oldest deadline 2024-09-19T06:11:06.152401+0000) 2024-09-19T06:11:09.824 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 19 06:11:09 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-6[55831]: 2024-09-19T06:11:09.470+0000 7fa03cfce640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.477552+0000 front 2024-09-19T06:10:34.477760+0000 (oldest deadline 2024-09-19T06:10:59.777574+0000) 2024-09-19T06:11:09.824 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 19 06:11:09 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-6[55831]: 2024-09-19T06:11:09.470+0000 7fa03cfce640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:43.878773+0000 front 2024-09-19T06:10:43.878759+0000 (oldest deadline 2024-09-19T06:11:09.178820+0000) 2024-09-19T06:11:09.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:09 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:09.422+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:27.553558+0000 front 2024-09-19T06:10:27.553623+0000 (oldest deadline 2024-09-19T06:10:53.453694+0000) 2024-09-19T06:11:09.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:09 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:09.422+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.554975+0000 front 2024-09-19T06:10:34.554852+0000 (oldest deadline 2024-09-19T06:10:57.454655+0000) 2024-09-19T06:11:09.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:09 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:09.422+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:42.155865+0000 front 2024-09-19T06:10:42.155832+0000 (oldest deadline 2024-09-19T06:11:07.455632+0000) 2024-09-19T06:11:10.172 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:11:09 smithi117 podman[68046]: 2024-09-19 06:11:09.895263087 +0000 UTC m=+0.761100008 container remove 531b4ea4f7fa90391d55e044adb3a50685a8ba6ff3f5b6a415fd74059a1ace99 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-5, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-19T06:11:10.188 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 06:11:09 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-7[53481]: 2024-09-19T06:11:09.864+0000 7f5c8df65640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.362851+0000 front 2024-09-19T06:10:34.362885+0000 (oldest deadline 2024-09-19T06:10:57.263019+0000) 2024-09-19T06:11:10.188 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 06:11:09 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-7[53481]: 2024-09-19T06:11:09.864+0000 7f5c8df65640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:44.466359+0000 front 2024-09-19T06:10:44.466301+0000 (oldest deadline 2024-09-19T06:11:06.166403+0000) 2024-09-19T06:11:10.188 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:10 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:10.036+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:24.169913+0000 front 2024-09-19T06:10:24.169648+0000 (oldest deadline 2024-09-19T06:10:48.869512+0000) 2024-09-19T06:11:10.189 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:10 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:10.036+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:35.771330+0000 front 2024-09-19T06:10:35.771421+0000 (oldest deadline 2024-09-19T06:10:59.871528+0000) 2024-09-19T06:11:10.499 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:11:10 smithi117 podman[68128]: 2024-09-19 06:11:10.254487254 +0000 UTC m=+0.112880390 container create 27f5353ed9edb5607f6a032f51fb4b654b6e6f164f2571b827c54495bf8135da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-2f599a4) 2024-09-19T06:11:10.500 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:11:10 smithi117 podman[68128]: 2024-09-19 06:11:10.157362033 +0000 UTC m=+0.015755174 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:11:10.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:10 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:10.170+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.243477+0000 front 2024-09-19T06:10:25.243671+0000 (oldest deadline 2024-09-19T06:10:50.543575+0000) 2024-09-19T06:11:10.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:10 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:10.170+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:40.846622+0000 front 2024-09-19T06:10:40.846471+0000 (oldest deadline 2024-09-19T06:11:05.546652+0000) 2024-09-19T06:11:10.823 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 19 06:11:10 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-6[55831]: 2024-09-19T06:11:10.511+0000 7fa03cfce640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.477552+0000 front 2024-09-19T06:10:34.477760+0000 (oldest deadline 2024-09-19T06:10:59.777574+0000) 2024-09-19T06:11:10.824 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 19 06:11:10 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-6[55831]: 2024-09-19T06:11:10.511+0000 7fa03cfce640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:43.878773+0000 front 2024-09-19T06:10:43.878759+0000 (oldest deadline 2024-09-19T06:11:09.178820+0000) 2024-09-19T06:11:10.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:10 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:10.439+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:27.553558+0000 front 2024-09-19T06:10:27.553623+0000 (oldest deadline 2024-09-19T06:10:53.453694+0000) 2024-09-19T06:11:10.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:10 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:10.439+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.554975+0000 front 2024-09-19T06:10:34.554852+0000 (oldest deadline 2024-09-19T06:10:57.454655+0000) 2024-09-19T06:11:10.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:10 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:10.439+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:42.155865+0000 front 2024-09-19T06:10:42.155832+0000 (oldest deadline 2024-09-19T06:11:07.455632+0000) 2024-09-19T06:11:10.999 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:10 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:10.687+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:36.251202+0000 front 2024-09-19T06:10:36.251075+0000 (oldest deadline 2024-09-19T06:11:01.551059+0000) 2024-09-19T06:11:11.000 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:10 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:10.687+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:43.252151+0000 front 2024-09-19T06:10:43.252231+0000 (oldest deadline 2024-09-19T06:11:06.152401+0000) 2024-09-19T06:11:11.000 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:11:10 smithi117 podman[68128]: 2024-09-19 06:11:10.507607794 +0000 UTC m=+0.366000942 container init 27f5353ed9edb5607f6a032f51fb4b654b6e6f164f2571b827c54495bf8135da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-19T06:11:11.000 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:11:10 smithi117 podman[68128]: 2024-09-19 06:11:10.511250223 +0000 UTC m=+0.369643358 container start 27f5353ed9edb5607f6a032f51fb4b654b6e6f164f2571b827c54495bf8135da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True) 2024-09-19T06:11:11.000 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:11:10 smithi117 podman[68128]: 2024-09-19 06:11:10.607017036 +0000 UTC m=+0.465410173 container attach 27f5353ed9edb5607f6a032f51fb4b654b6e6f164f2571b827c54495bf8135da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-19T06:11:11.000 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:11:10 smithi117 podman[68128]: 2024-09-19 06:11:10.698122284 +0000 UTC m=+0.556515422 container died 27f5353ed9edb5607f6a032f51fb4b654b6e6f164f2571b827c54495bf8135da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:11:11.189 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 06:11:10 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-7[53481]: 2024-09-19T06:11:10.846+0000 7f5c8df65640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.362851+0000 front 2024-09-19T06:10:34.362885+0000 (oldest deadline 2024-09-19T06:10:57.263019+0000) 2024-09-19T06:11:11.189 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 06:11:10 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-7[53481]: 2024-09-19T06:11:10.846+0000 7f5c8df65640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:44.466359+0000 front 2024-09-19T06:10:44.466301+0000 (oldest deadline 2024-09-19T06:11:06.166403+0000) 2024-09-19T06:11:11.189 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:11 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:11.028+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:24.169913+0000 front 2024-09-19T06:10:24.169648+0000 (oldest deadline 2024-09-19T06:10:48.869512+0000) 2024-09-19T06:11:11.189 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:11 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:11.028+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:35.771330+0000 front 2024-09-19T06:10:35.771421+0000 (oldest deadline 2024-09-19T06:10:59.871528+0000) 2024-09-19T06:11:11.190 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:11 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:11.028+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:39.871942+0000 front 2024-09-19T06:10:39.871906+0000 (oldest deadline 2024-09-19T06:11:10.472425+0000) 2024-09-19T06:11:11.320 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:11 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:11.163+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.243477+0000 front 2024-09-19T06:10:25.243671+0000 (oldest deadline 2024-09-19T06:10:50.543575+0000) 2024-09-19T06:11:11.320 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:11 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:11.163+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:40.846622+0000 front 2024-09-19T06:10:40.846471+0000 (oldest deadline 2024-09-19T06:11:05.546652+0000) 2024-09-19T06:11:11.339 DEBUG:teuthology.orchestra.run.smithi117:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@osd.5.service' 2024-09-19T06:11:11.378 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:11:11.379 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-19T06:11:11.379 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-19T06:11:11.379 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@osd.6 2024-09-19T06:11:11.682 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 19 06:11:11 smithi037 systemd[1]: Stopping Ceph osd.6 for b8c8bdae-764b-11ef-bceb-c7b262605968... 2024-09-19T06:11:11.682 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 19 06:11:11 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-6[55831]: 2024-09-19T06:11:11.545+0000 7fa03cfce640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.477552+0000 front 2024-09-19T06:10:34.477760+0000 (oldest deadline 2024-09-19T06:10:59.777574+0000) 2024-09-19T06:11:11.682 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 19 06:11:11 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-6[55831]: 2024-09-19T06:11:11.545+0000 7fa03cfce640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:43.878773+0000 front 2024-09-19T06:10:43.878759+0000 (oldest deadline 2024-09-19T06:11:09.178820+0000) 2024-09-19T06:11:11.682 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 19 06:11:11 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-6[55831]: 2024-09-19T06:11:11.679+0000 7fa0409b8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:11:11.682 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 19 06:11:11 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-6[55831]: 2024-09-19T06:11:11.679+0000 7fa0409b8640 -1 osd.6 95 *** Got signal Terminated *** 2024-09-19T06:11:11.682 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:11 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:11.444+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:27.553558+0000 front 2024-09-19T06:10:27.553623+0000 (oldest deadline 2024-09-19T06:10:53.453694+0000) 2024-09-19T06:11:11.682 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:11 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:11.444+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.554975+0000 front 2024-09-19T06:10:34.554852+0000 (oldest deadline 2024-09-19T06:10:57.454655+0000) 2024-09-19T06:11:11.683 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:11 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:11.444+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:42.155865+0000 front 2024-09-19T06:10:42.155832+0000 (oldest deadline 2024-09-19T06:11:07.455632+0000) 2024-09-19T06:11:12.000 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:11 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:11.724+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:36.251202+0000 front 2024-09-19T06:10:36.251075+0000 (oldest deadline 2024-09-19T06:11:01.551059+0000) 2024-09-19T06:11:12.000 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:11 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:11.724+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:43.252151+0000 front 2024-09-19T06:10:43.252231+0000 (oldest deadline 2024-09-19T06:11:06.152401+0000) 2024-09-19T06:11:12.073 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 19 06:11:11 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-6[55831]: 2024-09-19T06:11:11.679+0000 7fa0409b8640 -1 osd.6 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:11:12.188 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 06:11:11 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-7[53481]: 2024-09-19T06:11:11.834+0000 7f5c8df65640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.362851+0000 front 2024-09-19T06:10:34.362885+0000 (oldest deadline 2024-09-19T06:10:57.263019+0000) 2024-09-19T06:11:12.189 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 06:11:11 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-7[53481]: 2024-09-19T06:11:11.834+0000 7f5c8df65640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:44.466359+0000 front 2024-09-19T06:10:44.466301+0000 (oldest deadline 2024-09-19T06:11:06.166403+0000) 2024-09-19T06:11:12.189 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:12 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:12.070+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:24.169913+0000 front 2024-09-19T06:10:24.169648+0000 (oldest deadline 2024-09-19T06:10:48.869512+0000) 2024-09-19T06:11:12.189 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:12 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:12.070+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:35.771330+0000 front 2024-09-19T06:10:35.771421+0000 (oldest deadline 2024-09-19T06:10:59.871528+0000) 2024-09-19T06:11:12.189 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:12 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:12.070+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:39.871942+0000 front 2024-09-19T06:10:39.871906+0000 (oldest deadline 2024-09-19T06:11:10.472425+0000) 2024-09-19T06:11:12.499 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:12 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:12.140+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.243477+0000 front 2024-09-19T06:10:25.243671+0000 (oldest deadline 2024-09-19T06:10:50.543575+0000) 2024-09-19T06:11:12.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:12 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:12.140+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:40.846622+0000 front 2024-09-19T06:10:40.846471+0000 (oldest deadline 2024-09-19T06:11:05.546652+0000) 2024-09-19T06:11:12.824 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 19 06:11:12 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-6[55831]: 2024-09-19T06:11:12.559+0000 7fa03cfce640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.477552+0000 front 2024-09-19T06:10:34.477760+0000 (oldest deadline 2024-09-19T06:10:59.777574+0000) 2024-09-19T06:11:12.824 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 19 06:11:12 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-6[55831]: 2024-09-19T06:11:12.559+0000 7fa03cfce640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:43.878773+0000 front 2024-09-19T06:10:43.878759+0000 (oldest deadline 2024-09-19T06:11:09.178820+0000) 2024-09-19T06:11:12.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:12 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:12.459+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:27.553558+0000 front 2024-09-19T06:10:27.553623+0000 (oldest deadline 2024-09-19T06:10:53.453694+0000) 2024-09-19T06:11:12.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:12 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:12.459+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.554975+0000 front 2024-09-19T06:10:34.554852+0000 (oldest deadline 2024-09-19T06:10:57.454655+0000) 2024-09-19T06:11:12.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:12 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:12.459+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:42.155865+0000 front 2024-09-19T06:10:42.155832+0000 (oldest deadline 2024-09-19T06:11:07.455632+0000) 2024-09-19T06:11:12.999 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:12 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:12.711+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:36.251202+0000 front 2024-09-19T06:10:36.251075+0000 (oldest deadline 2024-09-19T06:11:01.551059+0000) 2024-09-19T06:11:13.000 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:12 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:12.711+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:43.252151+0000 front 2024-09-19T06:10:43.252231+0000 (oldest deadline 2024-09-19T06:11:06.152401+0000) 2024-09-19T06:11:13.074 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 06:11:12 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-7[53481]: 2024-09-19T06:11:12.818+0000 7f5c8df65640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.362851+0000 front 2024-09-19T06:10:34.362885+0000 (oldest deadline 2024-09-19T06:10:57.263019+0000) 2024-09-19T06:11:13.074 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 06:11:12 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-7[53481]: 2024-09-19T06:11:12.818+0000 7f5c8df65640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:44.466359+0000 front 2024-09-19T06:10:44.466301+0000 (oldest deadline 2024-09-19T06:11:06.166403+0000) 2024-09-19T06:11:13.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:13 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:13.072+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:24.169913+0000 front 2024-09-19T06:10:24.169648+0000 (oldest deadline 2024-09-19T06:10:48.869512+0000) 2024-09-19T06:11:13.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:13 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:13.072+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:35.771330+0000 front 2024-09-19T06:10:35.771421+0000 (oldest deadline 2024-09-19T06:10:59.871528+0000) 2024-09-19T06:11:13.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:13 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:13.072+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:39.871942+0000 front 2024-09-19T06:10:39.871906+0000 (oldest deadline 2024-09-19T06:11:10.472425+0000) 2024-09-19T06:11:13.499 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:13 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:13.105+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.243477+0000 front 2024-09-19T06:10:25.243671+0000 (oldest deadline 2024-09-19T06:10:50.543575+0000) 2024-09-19T06:11:13.499 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:13 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:13.105+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:40.846622+0000 front 2024-09-19T06:10:40.846471+0000 (oldest deadline 2024-09-19T06:11:05.546652+0000) 2024-09-19T06:11:13.823 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:13 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:13.416+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:27.553558+0000 front 2024-09-19T06:10:27.553623+0000 (oldest deadline 2024-09-19T06:10:53.453694+0000) 2024-09-19T06:11:13.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:13 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:13.416+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.554975+0000 front 2024-09-19T06:10:34.554852+0000 (oldest deadline 2024-09-19T06:10:57.454655+0000) 2024-09-19T06:11:13.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:13 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:13.416+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:42.155865+0000 front 2024-09-19T06:10:42.155832+0000 (oldest deadline 2024-09-19T06:11:07.455632+0000) 2024-09-19T06:11:13.824 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 19 06:11:13 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-6[55831]: 2024-09-19T06:11:13.514+0000 7fa03cfce640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.477552+0000 front 2024-09-19T06:10:34.477760+0000 (oldest deadline 2024-09-19T06:10:59.777574+0000) 2024-09-19T06:11:13.824 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 19 06:11:13 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-6[55831]: 2024-09-19T06:11:13.514+0000 7fa03cfce640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:43.878773+0000 front 2024-09-19T06:10:43.878759+0000 (oldest deadline 2024-09-19T06:11:09.178820+0000) 2024-09-19T06:11:13.999 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:13 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:13.692+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:36.251202+0000 front 2024-09-19T06:10:36.251075+0000 (oldest deadline 2024-09-19T06:11:01.551059+0000) 2024-09-19T06:11:14.000 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:13 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:13.692+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:43.252151+0000 front 2024-09-19T06:10:43.252231+0000 (oldest deadline 2024-09-19T06:11:06.152401+0000) 2024-09-19T06:11:14.081 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 06:11:13 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-7[53481]: 2024-09-19T06:11:13.823+0000 7f5c8df65640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.362851+0000 front 2024-09-19T06:10:34.362885+0000 (oldest deadline 2024-09-19T06:10:57.263019+0000) 2024-09-19T06:11:14.081 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 06:11:13 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-7[53481]: 2024-09-19T06:11:13.823+0000 7f5c8df65640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:44.466359+0000 front 2024-09-19T06:10:44.466301+0000 (oldest deadline 2024-09-19T06:11:06.166403+0000) 2024-09-19T06:11:14.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:14 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:14.079+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:24.169913+0000 front 2024-09-19T06:10:24.169648+0000 (oldest deadline 2024-09-19T06:10:48.869512+0000) 2024-09-19T06:11:14.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:14 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:14.079+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:35.771330+0000 front 2024-09-19T06:10:35.771421+0000 (oldest deadline 2024-09-19T06:10:59.871528+0000) 2024-09-19T06:11:14.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:14 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:14.079+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:39.871942+0000 front 2024-09-19T06:10:39.871906+0000 (oldest deadline 2024-09-19T06:11:10.472425+0000) 2024-09-19T06:11:14.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:14 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:14.079+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:51.573543+0000 front 2024-09-19T06:10:51.573591+0000 (oldest deadline 2024-09-19T06:11:13.873555+0000) 2024-09-19T06:11:14.499 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:14 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:14.084+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.243477+0000 front 2024-09-19T06:10:25.243671+0000 (oldest deadline 2024-09-19T06:10:50.543575+0000) 2024-09-19T06:11:14.499 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:14 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:14.084+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:40.846622+0000 front 2024-09-19T06:10:40.846471+0000 (oldest deadline 2024-09-19T06:11:05.546652+0000) 2024-09-19T06:11:14.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:14 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:14.369+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:27.553558+0000 front 2024-09-19T06:10:27.553623+0000 (oldest deadline 2024-09-19T06:10:53.453694+0000) 2024-09-19T06:11:14.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:14 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:14.369+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.554975+0000 front 2024-09-19T06:10:34.554852+0000 (oldest deadline 2024-09-19T06:10:57.454655+0000) 2024-09-19T06:11:14.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:14 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:14.369+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:42.155865+0000 front 2024-09-19T06:10:42.155832+0000 (oldest deadline 2024-09-19T06:11:07.455632+0000) 2024-09-19T06:11:14.824 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 19 06:11:14 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-6[55831]: 2024-09-19T06:11:14.511+0000 7fa03cfce640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.477552+0000 front 2024-09-19T06:10:34.477760+0000 (oldest deadline 2024-09-19T06:10:59.777574+0000) 2024-09-19T06:11:14.824 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 19 06:11:14 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-6[55831]: 2024-09-19T06:11:14.511+0000 7fa03cfce640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:43.878773+0000 front 2024-09-19T06:10:43.878759+0000 (oldest deadline 2024-09-19T06:11:09.178820+0000) 2024-09-19T06:11:14.824 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 19 06:11:14 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-6[55831]: 2024-09-19T06:11:14.511+0000 7fa03cfce640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:49.179320+0000 front 2024-09-19T06:10:49.179371+0000 (oldest deadline 2024-09-19T06:11:13.879487+0000) 2024-09-19T06:11:15.000 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:14 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:14.654+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:36.251202+0000 front 2024-09-19T06:10:36.251075+0000 (oldest deadline 2024-09-19T06:11:01.551059+0000) 2024-09-19T06:11:15.000 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:14 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:14.654+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:43.252151+0000 front 2024-09-19T06:10:43.252231+0000 (oldest deadline 2024-09-19T06:11:06.152401+0000) 2024-09-19T06:11:15.000 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:14 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:14.654+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:48.453260+0000 front 2024-09-19T06:10:48.453273+0000 (oldest deadline 2024-09-19T06:11:13.753277+0000) 2024-09-19T06:11:15.189 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 06:11:14 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-7[53481]: 2024-09-19T06:11:14.856+0000 7f5c8df65640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.362851+0000 front 2024-09-19T06:10:34.362885+0000 (oldest deadline 2024-09-19T06:10:57.263019+0000) 2024-09-19T06:11:15.189 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 06:11:14 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-7[53481]: 2024-09-19T06:11:14.856+0000 7f5c8df65640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:44.466359+0000 front 2024-09-19T06:10:44.466301+0000 (oldest deadline 2024-09-19T06:11:06.166403+0000) 2024-09-19T06:11:15.189 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 06:11:14 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-7[53481]: 2024-09-19T06:11:14.856+0000 7f5c8df65640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:52.567608+0000 front 2024-09-19T06:10:52.567683+0000 (oldest deadline 2024-09-19T06:11:14.267760+0000) 2024-09-19T06:11:15.189 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:15 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:15.075+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:24.169913+0000 front 2024-09-19T06:10:24.169648+0000 (oldest deadline 2024-09-19T06:10:48.869512+0000) 2024-09-19T06:11:15.189 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:15 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:15.075+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:35.771330+0000 front 2024-09-19T06:10:35.771421+0000 (oldest deadline 2024-09-19T06:10:59.871528+0000) 2024-09-19T06:11:15.189 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:15 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:15.075+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:39.871942+0000 front 2024-09-19T06:10:39.871906+0000 (oldest deadline 2024-09-19T06:11:10.472425+0000) 2024-09-19T06:11:15.189 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:15 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:15.075+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:51.573543+0000 front 2024-09-19T06:10:51.573591+0000 (oldest deadline 2024-09-19T06:11:13.873555+0000) 2024-09-19T06:11:15.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:15 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:15.060+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.243477+0000 front 2024-09-19T06:10:25.243671+0000 (oldest deadline 2024-09-19T06:10:50.543575+0000) 2024-09-19T06:11:15.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:15 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:15.060+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:40.846622+0000 front 2024-09-19T06:10:40.846471+0000 (oldest deadline 2024-09-19T06:11:05.546652+0000) 2024-09-19T06:11:15.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:15 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:15.060+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:50.847827+0000 front 2024-09-19T06:10:50.847888+0000 (oldest deadline 2024-09-19T06:11:14.347890+0000) 2024-09-19T06:11:15.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:15 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:15.337+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:27.553558+0000 front 2024-09-19T06:10:27.553623+0000 (oldest deadline 2024-09-19T06:10:53.453694+0000) 2024-09-19T06:11:15.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:15 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:15.337+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.554975+0000 front 2024-09-19T06:10:34.554852+0000 (oldest deadline 2024-09-19T06:10:57.454655+0000) 2024-09-19T06:11:15.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:15 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:15.337+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:42.155865+0000 front 2024-09-19T06:10:42.155832+0000 (oldest deadline 2024-09-19T06:11:07.455632+0000) 2024-09-19T06:11:15.824 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 19 06:11:15 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-6[55831]: 2024-09-19T06:11:15.482+0000 7fa03cfce640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.477552+0000 front 2024-09-19T06:10:34.477760+0000 (oldest deadline 2024-09-19T06:10:59.777574+0000) 2024-09-19T06:11:15.824 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 19 06:11:15 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-6[55831]: 2024-09-19T06:11:15.482+0000 7fa03cfce640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:43.878773+0000 front 2024-09-19T06:10:43.878759+0000 (oldest deadline 2024-09-19T06:11:09.178820+0000) 2024-09-19T06:11:15.824 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 19 06:11:15 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-6[55831]: 2024-09-19T06:11:15.482+0000 7fa03cfce640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:49.179320+0000 front 2024-09-19T06:10:49.179371+0000 (oldest deadline 2024-09-19T06:11:13.879487+0000) 2024-09-19T06:11:16.000 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:15 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:15.630+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:36.251202+0000 front 2024-09-19T06:10:36.251075+0000 (oldest deadline 2024-09-19T06:11:01.551059+0000) 2024-09-19T06:11:16.000 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:15 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:15.630+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:43.252151+0000 front 2024-09-19T06:10:43.252231+0000 (oldest deadline 2024-09-19T06:11:06.152401+0000) 2024-09-19T06:11:16.000 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:15 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:15.630+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:48.453260+0000 front 2024-09-19T06:10:48.453273+0000 (oldest deadline 2024-09-19T06:11:13.753277+0000) 2024-09-19T06:11:16.189 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 06:11:15 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-7[53481]: 2024-09-19T06:11:15.889+0000 7f5c8df65640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.362851+0000 front 2024-09-19T06:10:34.362885+0000 (oldest deadline 2024-09-19T06:10:57.263019+0000) 2024-09-19T06:11:16.189 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 06:11:15 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-7[53481]: 2024-09-19T06:11:15.889+0000 7f5c8df65640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:44.466359+0000 front 2024-09-19T06:10:44.466301+0000 (oldest deadline 2024-09-19T06:11:06.166403+0000) 2024-09-19T06:11:16.189 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 06:11:15 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-7[53481]: 2024-09-19T06:11:15.889+0000 7f5c8df65640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:52.567608+0000 front 2024-09-19T06:10:52.567683+0000 (oldest deadline 2024-09-19T06:11:14.267760+0000) 2024-09-19T06:11:16.189 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:16 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:16.124+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:24.169913+0000 front 2024-09-19T06:10:24.169648+0000 (oldest deadline 2024-09-19T06:10:48.869512+0000) 2024-09-19T06:11:16.189 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:16 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:16.124+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:35.771330+0000 front 2024-09-19T06:10:35.771421+0000 (oldest deadline 2024-09-19T06:10:59.871528+0000) 2024-09-19T06:11:16.189 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:16 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:16.124+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:39.871942+0000 front 2024-09-19T06:10:39.871906+0000 (oldest deadline 2024-09-19T06:11:10.472425+0000) 2024-09-19T06:11:16.189 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:16 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:16.124+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:51.573543+0000 front 2024-09-19T06:10:51.573591+0000 (oldest deadline 2024-09-19T06:11:13.873555+0000) 2024-09-19T06:11:16.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:16 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:16.094+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.243477+0000 front 2024-09-19T06:10:25.243671+0000 (oldest deadline 2024-09-19T06:10:50.543575+0000) 2024-09-19T06:11:16.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:16 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:16.094+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:40.846622+0000 front 2024-09-19T06:10:40.846471+0000 (oldest deadline 2024-09-19T06:11:05.546652+0000) 2024-09-19T06:11:16.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:16 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:16.094+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:50.847827+0000 front 2024-09-19T06:10:50.847888+0000 (oldest deadline 2024-09-19T06:11:14.347890+0000) 2024-09-19T06:11:16.824 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 19 06:11:16 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-6[55831]: 2024-09-19T06:11:16.531+0000 7fa03cfce640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.477552+0000 front 2024-09-19T06:10:34.477760+0000 (oldest deadline 2024-09-19T06:10:59.777574+0000) 2024-09-19T06:11:16.824 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 19 06:11:16 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-6[55831]: 2024-09-19T06:11:16.531+0000 7fa03cfce640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:43.878773+0000 front 2024-09-19T06:10:43.878759+0000 (oldest deadline 2024-09-19T06:11:09.178820+0000) 2024-09-19T06:11:16.824 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 19 06:11:16 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-6[55831]: 2024-09-19T06:11:16.531+0000 7fa03cfce640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:49.179320+0000 front 2024-09-19T06:10:49.179371+0000 (oldest deadline 2024-09-19T06:11:13.879487+0000) 2024-09-19T06:11:16.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:16 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:16.347+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:27.553558+0000 front 2024-09-19T06:10:27.553623+0000 (oldest deadline 2024-09-19T06:10:53.453694+0000) 2024-09-19T06:11:16.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:16 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:16.347+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.554975+0000 front 2024-09-19T06:10:34.554852+0000 (oldest deadline 2024-09-19T06:10:57.454655+0000) 2024-09-19T06:11:16.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:16 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:16.347+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:42.155865+0000 front 2024-09-19T06:10:42.155832+0000 (oldest deadline 2024-09-19T06:11:07.455632+0000) 2024-09-19T06:11:16.825 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:16 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:16.347+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:51.457204+0000 front 2024-09-19T06:10:51.457233+0000 (oldest deadline 2024-09-19T06:11:15.557366+0000) 2024-09-19T06:11:16.999 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:16 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:16.606+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:36.251202+0000 front 2024-09-19T06:10:36.251075+0000 (oldest deadline 2024-09-19T06:11:01.551059+0000) 2024-09-19T06:11:16.999 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:16 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:16.606+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:43.252151+0000 front 2024-09-19T06:10:43.252231+0000 (oldest deadline 2024-09-19T06:11:06.152401+0000) 2024-09-19T06:11:17.000 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:16 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:16.606+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:48.453260+0000 front 2024-09-19T06:10:48.453273+0000 (oldest deadline 2024-09-19T06:11:13.753277+0000) 2024-09-19T06:11:17.174 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 06:11:16 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-7[53481]: 2024-09-19T06:11:16.920+0000 7f5c8df65640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.362851+0000 front 2024-09-19T06:10:34.362885+0000 (oldest deadline 2024-09-19T06:10:57.263019+0000) 2024-09-19T06:11:17.174 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 06:11:16 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-7[53481]: 2024-09-19T06:11:16.920+0000 7f5c8df65640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:44.466359+0000 front 2024-09-19T06:10:44.466301+0000 (oldest deadline 2024-09-19T06:11:06.166403+0000) 2024-09-19T06:11:17.174 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 06:11:16 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-7[53481]: 2024-09-19T06:11:16.920+0000 7f5c8df65640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:52.567608+0000 front 2024-09-19T06:10:52.567683+0000 (oldest deadline 2024-09-19T06:11:14.267760+0000) 2024-09-19T06:11:17.324 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 19 06:11:17 smithi037 podman[88063]: 2024-09-19 06:11:17.070194466 +0000 UTC m=+5.488975575 container died 031c46ad918103d774e80cee32e1f3fbf7d4b0c01998cecd830978733cc85db6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-6, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=) 2024-09-19T06:11:17.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:17 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:17.171+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:24.169913+0000 front 2024-09-19T06:10:24.169648+0000 (oldest deadline 2024-09-19T06:10:48.869512+0000) 2024-09-19T06:11:17.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:17 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:17.171+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:35.771330+0000 front 2024-09-19T06:10:35.771421+0000 (oldest deadline 2024-09-19T06:10:59.871528+0000) 2024-09-19T06:11:17.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:17 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:17.171+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:39.871942+0000 front 2024-09-19T06:10:39.871906+0000 (oldest deadline 2024-09-19T06:11:10.472425+0000) 2024-09-19T06:11:17.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:17 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:17.171+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:51.573543+0000 front 2024-09-19T06:10:51.573591+0000 (oldest deadline 2024-09-19T06:11:13.873555+0000) 2024-09-19T06:11:17.499 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:17 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:17.067+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.243477+0000 front 2024-09-19T06:10:25.243671+0000 (oldest deadline 2024-09-19T06:10:50.543575+0000) 2024-09-19T06:11:17.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:17 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:17.067+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:40.846622+0000 front 2024-09-19T06:10:40.846471+0000 (oldest deadline 2024-09-19T06:11:05.546652+0000) 2024-09-19T06:11:17.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:17 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:17.067+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:50.847827+0000 front 2024-09-19T06:10:50.847888+0000 (oldest deadline 2024-09-19T06:11:14.347890+0000) 2024-09-19T06:11:17.724 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 19 06:11:17 smithi037 podman[88063]: 2024-09-19 06:11:17.51382254 +0000 UTC m=+5.932603649 container cleanup 031c46ad918103d774e80cee32e1f3fbf7d4b0c01998cecd830978733cc85db6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-6, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-19T06:11:17.725 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 19 06:11:17 smithi037 bash[88063]: ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-6 2024-09-19T06:11:17.725 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:17 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:17.328+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:27.553558+0000 front 2024-09-19T06:10:27.553623+0000 (oldest deadline 2024-09-19T06:10:53.453694+0000) 2024-09-19T06:11:17.725 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:17 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:17.328+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.554975+0000 front 2024-09-19T06:10:34.554852+0000 (oldest deadline 2024-09-19T06:10:57.454655+0000) 2024-09-19T06:11:17.725 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:17 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:17.328+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:42.155865+0000 front 2024-09-19T06:10:42.155832+0000 (oldest deadline 2024-09-19T06:11:07.455632+0000) 2024-09-19T06:11:17.725 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:17 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:17.328+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:51.457204+0000 front 2024-09-19T06:10:51.457233+0000 (oldest deadline 2024-09-19T06:11:15.557366+0000) 2024-09-19T06:11:18.000 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:17 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:17.650+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:36.251202+0000 front 2024-09-19T06:10:36.251075+0000 (oldest deadline 2024-09-19T06:11:01.551059+0000) 2024-09-19T06:11:18.000 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:17 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:17.650+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:43.252151+0000 front 2024-09-19T06:10:43.252231+0000 (oldest deadline 2024-09-19T06:11:06.152401+0000) 2024-09-19T06:11:18.000 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:17 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:17.650+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:48.453260+0000 front 2024-09-19T06:10:48.453273+0000 (oldest deadline 2024-09-19T06:11:13.753277+0000) 2024-09-19T06:11:18.074 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 19 06:11:17 smithi037 podman[88079]: 2024-09-19 06:11:17.723544016 +0000 UTC m=+0.647243306 container remove 031c46ad918103d774e80cee32e1f3fbf7d4b0c01998cecd830978733cc85db6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-6, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:11:18.436 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:18 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:18.343+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:27.553558+0000 front 2024-09-19T06:10:27.553623+0000 (oldest deadline 2024-09-19T06:10:53.453694+0000) 2024-09-19T06:11:18.436 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:18 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:18.343+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.554975+0000 front 2024-09-19T06:10:34.554852+0000 (oldest deadline 2024-09-19T06:10:57.454655+0000) 2024-09-19T06:11:18.436 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:18 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:18.343+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:42.155865+0000 front 2024-09-19T06:10:42.155832+0000 (oldest deadline 2024-09-19T06:11:07.455632+0000) 2024-09-19T06:11:18.436 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:18 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:18.343+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:51.457204+0000 front 2024-09-19T06:10:51.457233+0000 (oldest deadline 2024-09-19T06:11:15.557366+0000) 2024-09-19T06:11:18.437 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 19 06:11:18 smithi037 podman[88166]: 2024-09-19 06:11:18.045030288 +0000 UTC m=+0.017166341 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:11:18.437 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 19 06:11:18 smithi037 podman[88166]: 2024-09-19 06:11:18.166138969 +0000 UTC m=+0.138275009 container create e7c17e68f3b4d55897f0f9fd43c0108eb5f93a0b3d60db64936b15809ff08e87 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-19T06:11:18.437 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 19 06:11:18 smithi037 podman[88166]: 2024-09-19 06:11:18.368638031 +0000 UTC m=+0.340774081 container init e7c17e68f3b4d55897f0f9fd43c0108eb5f93a0b3d60db64936b15809ff08e87 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-6-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4) 2024-09-19T06:11:18.437 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 19 06:11:18 smithi037 podman[88166]: 2024-09-19 06:11:18.372005691 +0000 UTC m=+0.344141732 container start e7c17e68f3b4d55897f0f9fd43c0108eb5f93a0b3d60db64936b15809ff08e87 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-6-deactivate, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-19T06:11:18.437 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 19 06:11:18 smithi037 podman[88166]: 2024-09-19 06:11:18.4352639 +0000 UTC m=+0.407399940 container attach e7c17e68f3b4d55897f0f9fd43c0108eb5f93a0b3d60db64936b15809ff08e87 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-6-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-19T06:11:18.438 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 06:11:17 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-7[53481]: 2024-09-19T06:11:17.968+0000 7f5c8df65640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.362851+0000 front 2024-09-19T06:10:34.362885+0000 (oldest deadline 2024-09-19T06:10:57.263019+0000) 2024-09-19T06:11:18.438 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 06:11:17 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-7[53481]: 2024-09-19T06:11:17.968+0000 7f5c8df65640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:44.466359+0000 front 2024-09-19T06:10:44.466301+0000 (oldest deadline 2024-09-19T06:11:06.166403+0000) 2024-09-19T06:11:18.438 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 06:11:17 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-7[53481]: 2024-09-19T06:11:17.968+0000 7f5c8df65640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:52.567608+0000 front 2024-09-19T06:10:52.567683+0000 (oldest deadline 2024-09-19T06:11:14.267760+0000) 2024-09-19T06:11:18.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:18 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:18.150+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:24.169913+0000 front 2024-09-19T06:10:24.169648+0000 (oldest deadline 2024-09-19T06:10:48.869512+0000) 2024-09-19T06:11:18.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:18 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:18.150+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:35.771330+0000 front 2024-09-19T06:10:35.771421+0000 (oldest deadline 2024-09-19T06:10:59.871528+0000) 2024-09-19T06:11:18.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:18 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:18.150+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:39.871942+0000 front 2024-09-19T06:10:39.871906+0000 (oldest deadline 2024-09-19T06:11:10.472425+0000) 2024-09-19T06:11:18.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:18 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:18.150+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:51.573543+0000 front 2024-09-19T06:10:51.573591+0000 (oldest deadline 2024-09-19T06:11:13.873555+0000) 2024-09-19T06:11:18.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:18 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:18.090+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.243477+0000 front 2024-09-19T06:10:25.243671+0000 (oldest deadline 2024-09-19T06:10:50.543575+0000) 2024-09-19T06:11:18.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:18 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:18.090+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:40.846622+0000 front 2024-09-19T06:10:40.846471+0000 (oldest deadline 2024-09-19T06:11:05.546652+0000) 2024-09-19T06:11:18.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:18 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:18.090+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:50.847827+0000 front 2024-09-19T06:10:50.847888+0000 (oldest deadline 2024-09-19T06:11:14.347890+0000) 2024-09-19T06:11:18.824 INFO:journalctl@ceph.osd.6.smithi037.stdout:Sep 19 06:11:18 smithi037 podman[88166]: 2024-09-19 06:11:18.571971162 +0000 UTC m=+0.544107203 container died e7c17e68f3b4d55897f0f9fd43c0108eb5f93a0b3d60db64936b15809ff08e87 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-19T06:11:18.999 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:18 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:18.610+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:36.251202+0000 front 2024-09-19T06:10:36.251075+0000 (oldest deadline 2024-09-19T06:11:01.551059+0000) 2024-09-19T06:11:18.999 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:18 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:18.610+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:43.252151+0000 front 2024-09-19T06:10:43.252231+0000 (oldest deadline 2024-09-19T06:11:06.152401+0000) 2024-09-19T06:11:19.000 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:18 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:18.610+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:48.453260+0000 front 2024-09-19T06:10:48.453273+0000 (oldest deadline 2024-09-19T06:11:13.753277+0000) 2024-09-19T06:11:19.181 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@osd.6.service' 2024-09-19T06:11:19.188 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 06:11:18 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-7[53481]: 2024-09-19T06:11:18.930+0000 7f5c8df65640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.362851+0000 front 2024-09-19T06:10:34.362885+0000 (oldest deadline 2024-09-19T06:10:57.263019+0000) 2024-09-19T06:11:19.188 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 06:11:18 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-7[53481]: 2024-09-19T06:11:18.930+0000 7f5c8df65640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:44.466359+0000 front 2024-09-19T06:10:44.466301+0000 (oldest deadline 2024-09-19T06:11:06.166403+0000) 2024-09-19T06:11:19.189 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 06:11:18 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-7[53481]: 2024-09-19T06:11:18.930+0000 7f5c8df65640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:52.567608+0000 front 2024-09-19T06:10:52.567683+0000 (oldest deadline 2024-09-19T06:11:14.267760+0000) 2024-09-19T06:11:19.189 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:19 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:19.121+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:24.169913+0000 front 2024-09-19T06:10:24.169648+0000 (oldest deadline 2024-09-19T06:10:48.869512+0000) 2024-09-19T06:11:19.189 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:19 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:19.121+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:35.771330+0000 front 2024-09-19T06:10:35.771421+0000 (oldest deadline 2024-09-19T06:10:59.871528+0000) 2024-09-19T06:11:19.189 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:19 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:19.121+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:39.871942+0000 front 2024-09-19T06:10:39.871906+0000 (oldest deadline 2024-09-19T06:11:10.472425+0000) 2024-09-19T06:11:19.189 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:19 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:19.121+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:51.573543+0000 front 2024-09-19T06:10:51.573591+0000 (oldest deadline 2024-09-19T06:11:13.873555+0000) 2024-09-19T06:11:19.225 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:11:19.226 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-19T06:11:19.226 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-19T06:11:19.226 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@osd.7 2024-09-19T06:11:19.446 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:19 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:19.370+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:27.553558+0000 front 2024-09-19T06:10:27.553623+0000 (oldest deadline 2024-09-19T06:10:53.453694+0000) 2024-09-19T06:11:19.446 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:19 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:19.370+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.554975+0000 front 2024-09-19T06:10:34.554852+0000 (oldest deadline 2024-09-19T06:10:57.454655+0000) 2024-09-19T06:11:19.446 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:19 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:19.370+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:42.155865+0000 front 2024-09-19T06:10:42.155832+0000 (oldest deadline 2024-09-19T06:11:07.455632+0000) 2024-09-19T06:11:19.446 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:19 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:19.370+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:51.457204+0000 front 2024-09-19T06:10:51.457233+0000 (oldest deadline 2024-09-19T06:11:15.557366+0000) 2024-09-19T06:11:19.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:19 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:19.117+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.243477+0000 front 2024-09-19T06:10:25.243671+0000 (oldest deadline 2024-09-19T06:10:50.543575+0000) 2024-09-19T06:11:19.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:19 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:19.117+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:40.846622+0000 front 2024-09-19T06:10:40.846471+0000 (oldest deadline 2024-09-19T06:11:05.546652+0000) 2024-09-19T06:11:19.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:19 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:19.118+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:50.847827+0000 front 2024-09-19T06:10:50.847888+0000 (oldest deadline 2024-09-19T06:11:14.347890+0000) 2024-09-19T06:11:19.540 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 06:11:19 smithi099 systemd[1]: Stopping Ceph osd.7 for b8c8bdae-764b-11ef-bceb-c7b262605968... 2024-09-19T06:11:19.938 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 06:11:19 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-7[53481]: 2024-09-19T06:11:19.537+0000 7f5c95957640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:11:19.938 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 06:11:19 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-7[53481]: 2024-09-19T06:11:19.537+0000 7f5c95957640 -1 osd.7 95 *** Got signal Terminated *** 2024-09-19T06:11:19.939 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 06:11:19 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-7[53481]: 2024-09-19T06:11:19.537+0000 7f5c95957640 -1 osd.7 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:11:20.000 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:19 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:19.634+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:36.251202+0000 front 2024-09-19T06:10:36.251075+0000 (oldest deadline 2024-09-19T06:11:01.551059+0000) 2024-09-19T06:11:20.000 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:19 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:19.634+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:43.252151+0000 front 2024-09-19T06:10:43.252231+0000 (oldest deadline 2024-09-19T06:11:06.152401+0000) 2024-09-19T06:11:20.000 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:19 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:19.634+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:48.453260+0000 front 2024-09-19T06:10:48.453273+0000 (oldest deadline 2024-09-19T06:11:13.753277+0000) 2024-09-19T06:11:20.438 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 06:11:19 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-7[53481]: 2024-09-19T06:11:19.960+0000 7f5c8df65640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.362851+0000 front 2024-09-19T06:10:34.362885+0000 (oldest deadline 2024-09-19T06:10:57.263019+0000) 2024-09-19T06:11:20.439 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 06:11:19 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-7[53481]: 2024-09-19T06:11:19.960+0000 7f5c8df65640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:44.466359+0000 front 2024-09-19T06:10:44.466301+0000 (oldest deadline 2024-09-19T06:11:06.166403+0000) 2024-09-19T06:11:20.439 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 06:11:19 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-7[53481]: 2024-09-19T06:11:19.960+0000 7f5c8df65640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:52.567608+0000 front 2024-09-19T06:10:52.567683+0000 (oldest deadline 2024-09-19T06:11:14.267760+0000) 2024-09-19T06:11:20.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:20 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:20.119+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:24.169913+0000 front 2024-09-19T06:10:24.169648+0000 (oldest deadline 2024-09-19T06:10:48.869512+0000) 2024-09-19T06:11:20.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:20 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:20.119+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:35.771330+0000 front 2024-09-19T06:10:35.771421+0000 (oldest deadline 2024-09-19T06:10:59.871528+0000) 2024-09-19T06:11:20.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:20 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:20.119+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:39.871942+0000 front 2024-09-19T06:10:39.871906+0000 (oldest deadline 2024-09-19T06:11:10.472425+0000) 2024-09-19T06:11:20.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:20 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:20.119+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:51.573543+0000 front 2024-09-19T06:10:51.573591+0000 (oldest deadline 2024-09-19T06:11:13.873555+0000) 2024-09-19T06:11:20.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:20 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:20.073+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.243477+0000 front 2024-09-19T06:10:25.243671+0000 (oldest deadline 2024-09-19T06:10:50.543575+0000) 2024-09-19T06:11:20.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:20 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:20.073+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:40.846622+0000 front 2024-09-19T06:10:40.846471+0000 (oldest deadline 2024-09-19T06:11:05.546652+0000) 2024-09-19T06:11:20.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:20 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:20.073+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:50.847827+0000 front 2024-09-19T06:10:50.847888+0000 (oldest deadline 2024-09-19T06:11:14.347890+0000) 2024-09-19T06:11:20.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:20 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:20.354+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:27.553558+0000 front 2024-09-19T06:10:27.553623+0000 (oldest deadline 2024-09-19T06:10:53.453694+0000) 2024-09-19T06:11:20.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:20 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:20.354+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.554975+0000 front 2024-09-19T06:10:34.554852+0000 (oldest deadline 2024-09-19T06:10:57.454655+0000) 2024-09-19T06:11:20.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:20 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:20.354+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:42.155865+0000 front 2024-09-19T06:10:42.155832+0000 (oldest deadline 2024-09-19T06:11:07.455632+0000) 2024-09-19T06:11:20.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:20 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:20.354+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:51.457204+0000 front 2024-09-19T06:10:51.457233+0000 (oldest deadline 2024-09-19T06:11:15.557366+0000) 2024-09-19T06:11:21.000 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:20 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:20.684+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:36.251202+0000 front 2024-09-19T06:10:36.251075+0000 (oldest deadline 2024-09-19T06:11:01.551059+0000) 2024-09-19T06:11:21.000 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:20 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:20.684+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:43.252151+0000 front 2024-09-19T06:10:43.252231+0000 (oldest deadline 2024-09-19T06:11:06.152401+0000) 2024-09-19T06:11:21.000 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:20 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:20.684+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:48.453260+0000 front 2024-09-19T06:10:48.453273+0000 (oldest deadline 2024-09-19T06:11:13.753277+0000) 2024-09-19T06:11:21.438 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 06:11:20 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-7[53481]: 2024-09-19T06:11:20.975+0000 7f5c8df65640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.362851+0000 front 2024-09-19T06:10:34.362885+0000 (oldest deadline 2024-09-19T06:10:57.263019+0000) 2024-09-19T06:11:21.439 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 06:11:20 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-7[53481]: 2024-09-19T06:11:20.975+0000 7f5c8df65640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:44.466359+0000 front 2024-09-19T06:10:44.466301+0000 (oldest deadline 2024-09-19T06:11:06.166403+0000) 2024-09-19T06:11:21.439 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 06:11:20 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-7[53481]: 2024-09-19T06:11:20.975+0000 7f5c8df65640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:52.567608+0000 front 2024-09-19T06:10:52.567683+0000 (oldest deadline 2024-09-19T06:11:14.267760+0000) 2024-09-19T06:11:21.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:21 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:21.078+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:24.169913+0000 front 2024-09-19T06:10:24.169648+0000 (oldest deadline 2024-09-19T06:10:48.869512+0000) 2024-09-19T06:11:21.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:21 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:21.078+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:35.771330+0000 front 2024-09-19T06:10:35.771421+0000 (oldest deadline 2024-09-19T06:10:59.871528+0000) 2024-09-19T06:11:21.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:21 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:21.078+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:39.871942+0000 front 2024-09-19T06:10:39.871906+0000 (oldest deadline 2024-09-19T06:11:10.472425+0000) 2024-09-19T06:11:21.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:21 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:21.078+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:51.573543+0000 front 2024-09-19T06:10:51.573591+0000 (oldest deadline 2024-09-19T06:11:13.873555+0000) 2024-09-19T06:11:21.499 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:21 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:21.120+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.243477+0000 front 2024-09-19T06:10:25.243671+0000 (oldest deadline 2024-09-19T06:10:50.543575+0000) 2024-09-19T06:11:21.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:21 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:21.120+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:40.846622+0000 front 2024-09-19T06:10:40.846471+0000 (oldest deadline 2024-09-19T06:11:05.546652+0000) 2024-09-19T06:11:21.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:21 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:21.120+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:50.847827+0000 front 2024-09-19T06:10:50.847888+0000 (oldest deadline 2024-09-19T06:11:14.347890+0000) 2024-09-19T06:11:21.823 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:21 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:21.380+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:27.553558+0000 front 2024-09-19T06:10:27.553623+0000 (oldest deadline 2024-09-19T06:10:53.453694+0000) 2024-09-19T06:11:21.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:21 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:21.380+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.554975+0000 front 2024-09-19T06:10:34.554852+0000 (oldest deadline 2024-09-19T06:10:57.454655+0000) 2024-09-19T06:11:21.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:21 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:21.380+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:42.155865+0000 front 2024-09-19T06:10:42.155832+0000 (oldest deadline 2024-09-19T06:11:07.455632+0000) 2024-09-19T06:11:21.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:21 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:21.380+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:51.457204+0000 front 2024-09-19T06:10:51.457233+0000 (oldest deadline 2024-09-19T06:11:15.557366+0000) 2024-09-19T06:11:21.999 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:21 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:21.709+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:36.251202+0000 front 2024-09-19T06:10:36.251075+0000 (oldest deadline 2024-09-19T06:11:01.551059+0000) 2024-09-19T06:11:22.000 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:21 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:21.709+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:43.252151+0000 front 2024-09-19T06:10:43.252231+0000 (oldest deadline 2024-09-19T06:11:06.152401+0000) 2024-09-19T06:11:22.000 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:21 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:21.709+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:48.453260+0000 front 2024-09-19T06:10:48.453273+0000 (oldest deadline 2024-09-19T06:11:13.753277+0000) 2024-09-19T06:11:22.438 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 06:11:22 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-7[53481]: 2024-09-19T06:11:22.021+0000 7f5c8df65640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.362851+0000 front 2024-09-19T06:10:34.362885+0000 (oldest deadline 2024-09-19T06:10:57.263019+0000) 2024-09-19T06:11:22.438 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 06:11:22 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-7[53481]: 2024-09-19T06:11:22.021+0000 7f5c8df65640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:44.466359+0000 front 2024-09-19T06:10:44.466301+0000 (oldest deadline 2024-09-19T06:11:06.166403+0000) 2024-09-19T06:11:22.439 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 06:11:22 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-7[53481]: 2024-09-19T06:11:22.021+0000 7f5c8df65640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:52.567608+0000 front 2024-09-19T06:10:52.567683+0000 (oldest deadline 2024-09-19T06:11:14.267760+0000) 2024-09-19T06:11:22.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:22 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:22.107+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:24.169913+0000 front 2024-09-19T06:10:24.169648+0000 (oldest deadline 2024-09-19T06:10:48.869512+0000) 2024-09-19T06:11:22.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:22 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:22.107+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:35.771330+0000 front 2024-09-19T06:10:35.771421+0000 (oldest deadline 2024-09-19T06:10:59.871528+0000) 2024-09-19T06:11:22.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:22 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:22.107+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:39.871942+0000 front 2024-09-19T06:10:39.871906+0000 (oldest deadline 2024-09-19T06:11:10.472425+0000) 2024-09-19T06:11:22.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:22 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:22.107+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:51.573543+0000 front 2024-09-19T06:10:51.573591+0000 (oldest deadline 2024-09-19T06:11:13.873555+0000) 2024-09-19T06:11:22.499 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:22 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:22.101+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.243477+0000 front 2024-09-19T06:10:25.243671+0000 (oldest deadline 2024-09-19T06:10:50.543575+0000) 2024-09-19T06:11:22.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:22 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:22.101+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:40.846622+0000 front 2024-09-19T06:10:40.846471+0000 (oldest deadline 2024-09-19T06:11:05.546652+0000) 2024-09-19T06:11:22.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:22 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:22.101+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:50.847827+0000 front 2024-09-19T06:10:50.847888+0000 (oldest deadline 2024-09-19T06:11:14.347890+0000) 2024-09-19T06:11:22.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:22 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:22.101+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:10:57.849182+0000 front 2024-09-19T06:10:57.849209+0000 (oldest deadline 2024-09-19T06:11:21.348954+0000) 2024-09-19T06:11:22.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:22 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:22.355+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:27.553558+0000 front 2024-09-19T06:10:27.553623+0000 (oldest deadline 2024-09-19T06:10:53.453694+0000) 2024-09-19T06:11:22.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:22 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:22.355+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.554975+0000 front 2024-09-19T06:10:34.554852+0000 (oldest deadline 2024-09-19T06:10:57.454655+0000) 2024-09-19T06:11:22.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:22 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:22.355+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:42.155865+0000 front 2024-09-19T06:10:42.155832+0000 (oldest deadline 2024-09-19T06:11:07.455632+0000) 2024-09-19T06:11:22.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:22 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:22.355+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:51.457204+0000 front 2024-09-19T06:10:51.457233+0000 (oldest deadline 2024-09-19T06:11:15.557366+0000) 2024-09-19T06:11:22.999 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:22 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:22.698+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:36.251202+0000 front 2024-09-19T06:10:36.251075+0000 (oldest deadline 2024-09-19T06:11:01.551059+0000) 2024-09-19T06:11:23.000 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:22 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:22.698+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:43.252151+0000 front 2024-09-19T06:10:43.252231+0000 (oldest deadline 2024-09-19T06:11:06.152401+0000) 2024-09-19T06:11:23.000 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:22 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:22.698+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:48.453260+0000 front 2024-09-19T06:10:48.453273+0000 (oldest deadline 2024-09-19T06:11:13.753277+0000) 2024-09-19T06:11:23.439 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 06:11:22 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-7[53481]: 2024-09-19T06:11:22.995+0000 7f5c8df65640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.362851+0000 front 2024-09-19T06:10:34.362885+0000 (oldest deadline 2024-09-19T06:10:57.263019+0000) 2024-09-19T06:11:23.439 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 06:11:22 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-7[53481]: 2024-09-19T06:11:22.995+0000 7f5c8df65640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:44.466359+0000 front 2024-09-19T06:10:44.466301+0000 (oldest deadline 2024-09-19T06:11:06.166403+0000) 2024-09-19T06:11:23.439 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 06:11:22 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-7[53481]: 2024-09-19T06:11:22.995+0000 7f5c8df65640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:52.567608+0000 front 2024-09-19T06:10:52.567683+0000 (oldest deadline 2024-09-19T06:11:14.267760+0000) 2024-09-19T06:11:23.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:23 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:23.147+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:24.169913+0000 front 2024-09-19T06:10:24.169648+0000 (oldest deadline 2024-09-19T06:10:48.869512+0000) 2024-09-19T06:11:23.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:23 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:23.147+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:35.771330+0000 front 2024-09-19T06:10:35.771421+0000 (oldest deadline 2024-09-19T06:10:59.871528+0000) 2024-09-19T06:11:23.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:23 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:23.147+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:39.871942+0000 front 2024-09-19T06:10:39.871906+0000 (oldest deadline 2024-09-19T06:11:10.472425+0000) 2024-09-19T06:11:23.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:23 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:23.147+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:51.573543+0000 front 2024-09-19T06:10:51.573591+0000 (oldest deadline 2024-09-19T06:11:13.873555+0000) 2024-09-19T06:11:23.499 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:23 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:23.095+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.243477+0000 front 2024-09-19T06:10:25.243671+0000 (oldest deadline 2024-09-19T06:10:50.543575+0000) 2024-09-19T06:11:23.499 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:23 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:23.095+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:40.846622+0000 front 2024-09-19T06:10:40.846471+0000 (oldest deadline 2024-09-19T06:11:05.546652+0000) 2024-09-19T06:11:23.499 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:23 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:23.095+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:50.847827+0000 front 2024-09-19T06:10:50.847888+0000 (oldest deadline 2024-09-19T06:11:14.347890+0000) 2024-09-19T06:11:23.499 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:23 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:23.095+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:10:57.849182+0000 front 2024-09-19T06:10:57.849209+0000 (oldest deadline 2024-09-19T06:11:21.348954+0000) 2024-09-19T06:11:23.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:23 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:23.350+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:27.553558+0000 front 2024-09-19T06:10:27.553623+0000 (oldest deadline 2024-09-19T06:10:53.453694+0000) 2024-09-19T06:11:23.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:23 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:23.350+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.554975+0000 front 2024-09-19T06:10:34.554852+0000 (oldest deadline 2024-09-19T06:10:57.454655+0000) 2024-09-19T06:11:23.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:23 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:23.350+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:42.155865+0000 front 2024-09-19T06:10:42.155832+0000 (oldest deadline 2024-09-19T06:11:07.455632+0000) 2024-09-19T06:11:23.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:23 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:23.350+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:51.457204+0000 front 2024-09-19T06:10:51.457233+0000 (oldest deadline 2024-09-19T06:11:15.557366+0000) 2024-09-19T06:11:23.999 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:23 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:23.676+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:36.251202+0000 front 2024-09-19T06:10:36.251075+0000 (oldest deadline 2024-09-19T06:11:01.551059+0000) 2024-09-19T06:11:24.000 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:23 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:23.676+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:43.252151+0000 front 2024-09-19T06:10:43.252231+0000 (oldest deadline 2024-09-19T06:11:06.152401+0000) 2024-09-19T06:11:24.000 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:23 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:23.676+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:48.453260+0000 front 2024-09-19T06:10:48.453273+0000 (oldest deadline 2024-09-19T06:11:13.753277+0000) 2024-09-19T06:11:24.438 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 06:11:24 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-7[53481]: 2024-09-19T06:11:24.039+0000 7f5c8df65640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.362851+0000 front 2024-09-19T06:10:34.362885+0000 (oldest deadline 2024-09-19T06:10:57.263019+0000) 2024-09-19T06:11:24.439 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 06:11:24 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-7[53481]: 2024-09-19T06:11:24.039+0000 7f5c8df65640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:44.466359+0000 front 2024-09-19T06:10:44.466301+0000 (oldest deadline 2024-09-19T06:11:06.166403+0000) 2024-09-19T06:11:24.439 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 06:11:24 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-7[53481]: 2024-09-19T06:11:24.039+0000 7f5c8df65640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:52.567608+0000 front 2024-09-19T06:10:52.567683+0000 (oldest deadline 2024-09-19T06:11:14.267760+0000) 2024-09-19T06:11:24.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:24 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:24.169+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:24.169913+0000 front 2024-09-19T06:10:24.169648+0000 (oldest deadline 2024-09-19T06:10:48.869512+0000) 2024-09-19T06:11:24.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:24 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:24.169+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:35.771330+0000 front 2024-09-19T06:10:35.771421+0000 (oldest deadline 2024-09-19T06:10:59.871528+0000) 2024-09-19T06:11:24.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:24 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:24.169+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:39.871942+0000 front 2024-09-19T06:10:39.871906+0000 (oldest deadline 2024-09-19T06:11:10.472425+0000) 2024-09-19T06:11:24.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:24 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:24.169+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:51.573543+0000 front 2024-09-19T06:10:51.573591+0000 (oldest deadline 2024-09-19T06:11:13.873555+0000) 2024-09-19T06:11:24.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:24 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:24.169+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:11:00.175701+0000 front 2024-09-19T06:11:00.175670+0000 (oldest deadline 2024-09-19T06:11:23.675762+0000) 2024-09-19T06:11:24.499 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:24 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:24.109+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.243477+0000 front 2024-09-19T06:10:25.243671+0000 (oldest deadline 2024-09-19T06:10:50.543575+0000) 2024-09-19T06:11:24.499 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:24 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:24.109+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:40.846622+0000 front 2024-09-19T06:10:40.846471+0000 (oldest deadline 2024-09-19T06:11:05.546652+0000) 2024-09-19T06:11:24.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:24 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:24.109+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:50.847827+0000 front 2024-09-19T06:10:50.847888+0000 (oldest deadline 2024-09-19T06:11:14.347890+0000) 2024-09-19T06:11:24.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:24 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:24.109+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:10:57.849182+0000 front 2024-09-19T06:10:57.849209+0000 (oldest deadline 2024-09-19T06:11:21.348954+0000) 2024-09-19T06:11:24.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:24 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:24.395+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:27.553558+0000 front 2024-09-19T06:10:27.553623+0000 (oldest deadline 2024-09-19T06:10:53.453694+0000) 2024-09-19T06:11:24.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:24 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:24.395+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.554975+0000 front 2024-09-19T06:10:34.554852+0000 (oldest deadline 2024-09-19T06:10:57.454655+0000) 2024-09-19T06:11:24.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:24 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:24.395+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:42.155865+0000 front 2024-09-19T06:10:42.155832+0000 (oldest deadline 2024-09-19T06:11:07.455632+0000) 2024-09-19T06:11:24.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:24 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:24.395+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:51.457204+0000 front 2024-09-19T06:10:51.457233+0000 (oldest deadline 2024-09-19T06:11:15.557366+0000) 2024-09-19T06:11:25.000 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:24 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:24.717+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:36.251202+0000 front 2024-09-19T06:10:36.251075+0000 (oldest deadline 2024-09-19T06:11:01.551059+0000) 2024-09-19T06:11:25.000 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:24 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:24.717+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:43.252151+0000 front 2024-09-19T06:10:43.252231+0000 (oldest deadline 2024-09-19T06:11:06.152401+0000) 2024-09-19T06:11:25.000 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:24 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:24.717+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:48.453260+0000 front 2024-09-19T06:10:48.453273+0000 (oldest deadline 2024-09-19T06:11:13.753277+0000) 2024-09-19T06:11:25.000 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:24 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:24.717+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:10:59.554780+0000 front 2024-09-19T06:10:59.554825+0000 (oldest deadline 2024-09-19T06:11:24.155276+0000) 2024-09-19T06:11:25.215 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 06:11:24 smithi099 podman[68502]: 2024-09-19 06:11:24.937682279 +0000 UTC m=+5.513017844 container died bf6fc83735754e8152b4053f881235e8bbeb8833902d6aedcb0a88e8e329754a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731) 2024-09-19T06:11:25.481 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 06:11:25 smithi099 podman[68502]: 2024-09-19 06:11:25.312629652 +0000 UTC m=+5.887965259 container cleanup bf6fc83735754e8152b4053f881235e8bbeb8833902d6aedcb0a88e8e329754a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-7, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-19T06:11:25.481 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 06:11:25 smithi099 bash[68502]: ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-7 2024-09-19T06:11:25.482 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:25 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:25.214+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:24.169913+0000 front 2024-09-19T06:10:24.169648+0000 (oldest deadline 2024-09-19T06:10:48.869512+0000) 2024-09-19T06:11:25.482 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:25 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:25.214+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:35.771330+0000 front 2024-09-19T06:10:35.771421+0000 (oldest deadline 2024-09-19T06:10:59.871528+0000) 2024-09-19T06:11:25.482 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:25 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:25.214+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:39.871942+0000 front 2024-09-19T06:10:39.871906+0000 (oldest deadline 2024-09-19T06:11:10.472425+0000) 2024-09-19T06:11:25.482 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:25 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:25.214+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:51.573543+0000 front 2024-09-19T06:10:51.573591+0000 (oldest deadline 2024-09-19T06:11:13.873555+0000) 2024-09-19T06:11:25.482 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:25 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:25.214+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:11:00.175701+0000 front 2024-09-19T06:11:00.175670+0000 (oldest deadline 2024-09-19T06:11:23.675762+0000) 2024-09-19T06:11:25.499 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:25 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:25.132+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.243477+0000 front 2024-09-19T06:10:25.243671+0000 (oldest deadline 2024-09-19T06:10:50.543575+0000) 2024-09-19T06:11:25.499 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:25 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:25.132+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:40.846622+0000 front 2024-09-19T06:10:40.846471+0000 (oldest deadline 2024-09-19T06:11:05.546652+0000) 2024-09-19T06:11:25.499 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:25 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:25.132+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:50.847827+0000 front 2024-09-19T06:10:50.847888+0000 (oldest deadline 2024-09-19T06:11:14.347890+0000) 2024-09-19T06:11:25.499 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:25 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:25.132+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:10:57.849182+0000 front 2024-09-19T06:10:57.849209+0000 (oldest deadline 2024-09-19T06:11:21.348954+0000) 2024-09-19T06:11:25.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:25 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:25.374+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:27.553558+0000 front 2024-09-19T06:10:27.553623+0000 (oldest deadline 2024-09-19T06:10:53.453694+0000) 2024-09-19T06:11:25.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:25 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:25.374+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.554975+0000 front 2024-09-19T06:10:34.554852+0000 (oldest deadline 2024-09-19T06:10:57.454655+0000) 2024-09-19T06:11:25.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:25 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:25.374+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:42.155865+0000 front 2024-09-19T06:10:42.155832+0000 (oldest deadline 2024-09-19T06:11:07.455632+0000) 2024-09-19T06:11:25.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:25 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:25.374+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:51.457204+0000 front 2024-09-19T06:10:51.457233+0000 (oldest deadline 2024-09-19T06:11:15.557366+0000) 2024-09-19T06:11:25.887 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 06:11:25 smithi099 podman[68518]: 2024-09-19 06:11:25.480494074 +0000 UTC m=+0.544139706 container remove bf6fc83735754e8152b4053f881235e8bbeb8833902d6aedcb0a88e8e329754a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-7, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-19T06:11:25.999 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:25 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:25.708+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:36.251202+0000 front 2024-09-19T06:10:36.251075+0000 (oldest deadline 2024-09-19T06:11:01.551059+0000) 2024-09-19T06:11:26.000 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:25 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:25.708+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:43.252151+0000 front 2024-09-19T06:10:43.252231+0000 (oldest deadline 2024-09-19T06:11:06.152401+0000) 2024-09-19T06:11:26.000 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:25 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:25.708+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:48.453260+0000 front 2024-09-19T06:10:48.453273+0000 (oldest deadline 2024-09-19T06:11:13.753277+0000) 2024-09-19T06:11:26.000 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:25 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:25.708+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:10:59.554780+0000 front 2024-09-19T06:10:59.554825+0000 (oldest deadline 2024-09-19T06:11:24.155276+0000) 2024-09-19T06:11:26.176 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 06:11:25 smithi099 podman[68604]: 2024-09-19 06:11:25.78869299 +0000 UTC m=+0.015921294 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:11:26.176 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 06:11:25 smithi099 podman[68604]: 2024-09-19 06:11:25.906433962 +0000 UTC m=+0.133662259 container create b81e90a4c426509aeaf6b303df5b88179ae24d7028ca1dd5ebaa61515be8c168 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-7-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-19T06:11:26.177 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 06:11:26 smithi099 podman[68604]: 2024-09-19 06:11:26.175669229 +0000 UTC m=+0.402897526 container init b81e90a4c426509aeaf6b303df5b88179ae24d7028ca1dd5ebaa61515be8c168 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-7-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-2f599a4, ceph=True) 2024-09-19T06:11:26.439 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 06:11:26 smithi099 podman[68604]: 2024-09-19 06:11:26.179109444 +0000 UTC m=+0.406337744 container start b81e90a4c426509aeaf6b303df5b88179ae24d7028ca1dd5ebaa61515be8c168 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-19T06:11:26.439 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 06:11:26 smithi099 podman[68604]: 2024-09-19 06:11:26.259529536 +0000 UTC m=+0.486757835 container attach b81e90a4c426509aeaf6b303df5b88179ae24d7028ca1dd5ebaa61515be8c168 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-19T06:11:26.439 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 06:11:26 smithi099 podman[68604]: 2024-09-19 06:11:26.369991843 +0000 UTC m=+0.597220145 container died b81e90a4c426509aeaf6b303df5b88179ae24d7028ca1dd5ebaa61515be8c168 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-7-deactivate, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True) 2024-09-19T06:11:26.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:26 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:26.242+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:24.169913+0000 front 2024-09-19T06:10:24.169648+0000 (oldest deadline 2024-09-19T06:10:48.869512+0000) 2024-09-19T06:11:26.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:26 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:26.242+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:35.771330+0000 front 2024-09-19T06:10:35.771421+0000 (oldest deadline 2024-09-19T06:10:59.871528+0000) 2024-09-19T06:11:26.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:26 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:26.242+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:39.871942+0000 front 2024-09-19T06:10:39.871906+0000 (oldest deadline 2024-09-19T06:11:10.472425+0000) 2024-09-19T06:11:26.440 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:26 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:26.242+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:51.573543+0000 front 2024-09-19T06:10:51.573591+0000 (oldest deadline 2024-09-19T06:11:13.873555+0000) 2024-09-19T06:11:26.440 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:26 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:26.242+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:11:00.175701+0000 front 2024-09-19T06:11:00.175670+0000 (oldest deadline 2024-09-19T06:11:23.675762+0000) 2024-09-19T06:11:26.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:26 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:26.086+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.243477+0000 front 2024-09-19T06:10:25.243671+0000 (oldest deadline 2024-09-19T06:10:50.543575+0000) 2024-09-19T06:11:26.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:26 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:26.086+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:40.846622+0000 front 2024-09-19T06:10:40.846471+0000 (oldest deadline 2024-09-19T06:11:05.546652+0000) 2024-09-19T06:11:26.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:26 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:26.086+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:50.847827+0000 front 2024-09-19T06:10:50.847888+0000 (oldest deadline 2024-09-19T06:11:14.347890+0000) 2024-09-19T06:11:26.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:26 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:26.086+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:10:57.849182+0000 front 2024-09-19T06:10:57.849209+0000 (oldest deadline 2024-09-19T06:11:21.348954+0000) 2024-09-19T06:11:26.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:26 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:26.371+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:27.553558+0000 front 2024-09-19T06:10:27.553623+0000 (oldest deadline 2024-09-19T06:10:53.453694+0000) 2024-09-19T06:11:26.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:26 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:26.371+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.554975+0000 front 2024-09-19T06:10:34.554852+0000 (oldest deadline 2024-09-19T06:10:57.454655+0000) 2024-09-19T06:11:26.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:26 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:26.371+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:42.155865+0000 front 2024-09-19T06:10:42.155832+0000 (oldest deadline 2024-09-19T06:11:07.455632+0000) 2024-09-19T06:11:26.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:26 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:26.371+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:51.457204+0000 front 2024-09-19T06:10:51.457233+0000 (oldest deadline 2024-09-19T06:11:15.557366+0000) 2024-09-19T06:11:26.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:26 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:26.371+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:11:00.258670+0000 front 2024-09-19T06:11:00.258844+0000 (oldest deadline 2024-09-19T06:11:25.558449+0000) 2024-09-19T06:11:26.963 DEBUG:teuthology.orchestra.run.smithi099:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@osd.7.service' 2024-09-19T06:11:26.999 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:26 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:26.726+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:36.251202+0000 front 2024-09-19T06:10:36.251075+0000 (oldest deadline 2024-09-19T06:11:01.551059+0000) 2024-09-19T06:11:26.999 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:26 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:26.726+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:43.252151+0000 front 2024-09-19T06:10:43.252231+0000 (oldest deadline 2024-09-19T06:11:06.152401+0000) 2024-09-19T06:11:27.000 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:26 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:26.726+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:48.453260+0000 front 2024-09-19T06:10:48.453273+0000 (oldest deadline 2024-09-19T06:11:13.753277+0000) 2024-09-19T06:11:27.000 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:26 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:26.726+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:10:59.554780+0000 front 2024-09-19T06:10:59.554825+0000 (oldest deadline 2024-09-19T06:11:24.155276+0000) 2024-09-19T06:11:27.001 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:11:27.002 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-19T06:11:27.002 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-19T06:11:27.002 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@osd.8 2024-09-19T06:11:27.313 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:27 smithi117 systemd[1]: Stopping Ceph osd.8 for b8c8bdae-764b-11ef-bceb-c7b262605968... 2024-09-19T06:11:27.313 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:27 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:27.098+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.243477+0000 front 2024-09-19T06:10:25.243671+0000 (oldest deadline 2024-09-19T06:10:50.543575+0000) 2024-09-19T06:11:27.313 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:27 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:27.098+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:40.846622+0000 front 2024-09-19T06:10:40.846471+0000 (oldest deadline 2024-09-19T06:11:05.546652+0000) 2024-09-19T06:11:27.313 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:27 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:27.098+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:50.847827+0000 front 2024-09-19T06:10:50.847888+0000 (oldest deadline 2024-09-19T06:11:14.347890+0000) 2024-09-19T06:11:27.313 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:27 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:27.098+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:10:57.849182+0000 front 2024-09-19T06:10:57.849209+0000 (oldest deadline 2024-09-19T06:11:21.348954+0000) 2024-09-19T06:11:27.689 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:27 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:27.271+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:24.169913+0000 front 2024-09-19T06:10:24.169648+0000 (oldest deadline 2024-09-19T06:10:48.869512+0000) 2024-09-19T06:11:27.689 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:27 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:27.271+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:35.771330+0000 front 2024-09-19T06:10:35.771421+0000 (oldest deadline 2024-09-19T06:10:59.871528+0000) 2024-09-19T06:11:27.689 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:27 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:27.271+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:39.871942+0000 front 2024-09-19T06:10:39.871906+0000 (oldest deadline 2024-09-19T06:11:10.472425+0000) 2024-09-19T06:11:27.689 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:27 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:27.271+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:51.573543+0000 front 2024-09-19T06:10:51.573591+0000 (oldest deadline 2024-09-19T06:11:13.873555+0000) 2024-09-19T06:11:27.689 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:27 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:27.271+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:11:00.175701+0000 front 2024-09-19T06:11:00.175670+0000 (oldest deadline 2024-09-19T06:11:23.675762+0000) 2024-09-19T06:11:27.749 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:27 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:27.311+0000 7f7924dbe640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:11:27.750 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:27 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:27.311+0000 7f7924dbe640 -1 osd.8 95 *** Got signal Terminated *** 2024-09-19T06:11:27.750 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:27 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:27.311+0000 7f7924dbe640 -1 osd.8 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:11:27.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:27 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:27.355+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:27.553558+0000 front 2024-09-19T06:10:27.553623+0000 (oldest deadline 2024-09-19T06:10:53.453694+0000) 2024-09-19T06:11:27.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:27 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:27.355+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.554975+0000 front 2024-09-19T06:10:34.554852+0000 (oldest deadline 2024-09-19T06:10:57.454655+0000) 2024-09-19T06:11:27.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:27 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:27.355+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:42.155865+0000 front 2024-09-19T06:10:42.155832+0000 (oldest deadline 2024-09-19T06:11:07.455632+0000) 2024-09-19T06:11:27.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:27 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:27.355+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:51.457204+0000 front 2024-09-19T06:10:51.457233+0000 (oldest deadline 2024-09-19T06:11:15.557366+0000) 2024-09-19T06:11:27.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:27 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:27.355+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:11:00.258670+0000 front 2024-09-19T06:11:00.258844+0000 (oldest deadline 2024-09-19T06:11:25.558449+0000) 2024-09-19T06:11:28.110 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:27 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:27.759+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:36.251202+0000 front 2024-09-19T06:10:36.251075+0000 (oldest deadline 2024-09-19T06:11:01.551059+0000) 2024-09-19T06:11:28.110 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:27 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:27.759+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:43.252151+0000 front 2024-09-19T06:10:43.252231+0000 (oldest deadline 2024-09-19T06:11:06.152401+0000) 2024-09-19T06:11:28.110 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:27 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:27.759+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:48.453260+0000 front 2024-09-19T06:10:48.453273+0000 (oldest deadline 2024-09-19T06:11:13.753277+0000) 2024-09-19T06:11:28.110 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:27 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:27.759+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:10:59.554780+0000 front 2024-09-19T06:10:59.554825+0000 (oldest deadline 2024-09-19T06:11:24.155276+0000) 2024-09-19T06:11:28.499 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:28 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:28.108+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.243477+0000 front 2024-09-19T06:10:25.243671+0000 (oldest deadline 2024-09-19T06:10:50.543575+0000) 2024-09-19T06:11:28.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:28 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:28.108+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:40.846622+0000 front 2024-09-19T06:10:40.846471+0000 (oldest deadline 2024-09-19T06:11:05.546652+0000) 2024-09-19T06:11:28.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:28 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:28.108+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:50.847827+0000 front 2024-09-19T06:10:50.847888+0000 (oldest deadline 2024-09-19T06:11:14.347890+0000) 2024-09-19T06:11:28.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:28 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:28.108+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:10:57.849182+0000 front 2024-09-19T06:10:57.849209+0000 (oldest deadline 2024-09-19T06:11:21.348954+0000) 2024-09-19T06:11:28.689 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:28 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:28.277+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:24.169913+0000 front 2024-09-19T06:10:24.169648+0000 (oldest deadline 2024-09-19T06:10:48.869512+0000) 2024-09-19T06:11:28.689 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:28 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:28.277+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:35.771330+0000 front 2024-09-19T06:10:35.771421+0000 (oldest deadline 2024-09-19T06:10:59.871528+0000) 2024-09-19T06:11:28.689 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:28 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:28.277+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:39.871942+0000 front 2024-09-19T06:10:39.871906+0000 (oldest deadline 2024-09-19T06:11:10.472425+0000) 2024-09-19T06:11:28.689 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:28 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:28.277+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:51.573543+0000 front 2024-09-19T06:10:51.573591+0000 (oldest deadline 2024-09-19T06:11:13.873555+0000) 2024-09-19T06:11:28.689 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:28 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:28.277+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:11:00.175701+0000 front 2024-09-19T06:11:00.175670+0000 (oldest deadline 2024-09-19T06:11:23.675762+0000) 2024-09-19T06:11:28.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:28 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:28.381+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:27.553558+0000 front 2024-09-19T06:10:27.553623+0000 (oldest deadline 2024-09-19T06:10:53.453694+0000) 2024-09-19T06:11:28.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:28 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:28.381+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.554975+0000 front 2024-09-19T06:10:34.554852+0000 (oldest deadline 2024-09-19T06:10:57.454655+0000) 2024-09-19T06:11:28.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:28 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:28.381+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:42.155865+0000 front 2024-09-19T06:10:42.155832+0000 (oldest deadline 2024-09-19T06:11:07.455632+0000) 2024-09-19T06:11:28.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:28 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:28.381+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:51.457204+0000 front 2024-09-19T06:10:51.457233+0000 (oldest deadline 2024-09-19T06:11:15.557366+0000) 2024-09-19T06:11:28.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:28 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:28.381+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:11:00.258670+0000 front 2024-09-19T06:11:00.258844+0000 (oldest deadline 2024-09-19T06:11:25.558449+0000) 2024-09-19T06:11:28.999 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:28 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:28.713+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:36.251202+0000 front 2024-09-19T06:10:36.251075+0000 (oldest deadline 2024-09-19T06:11:01.551059+0000) 2024-09-19T06:11:29.000 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:28 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:28.713+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:43.252151+0000 front 2024-09-19T06:10:43.252231+0000 (oldest deadline 2024-09-19T06:11:06.152401+0000) 2024-09-19T06:11:29.000 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:28 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:28.713+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:48.453260+0000 front 2024-09-19T06:10:48.453273+0000 (oldest deadline 2024-09-19T06:11:13.753277+0000) 2024-09-19T06:11:29.000 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:28 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:28.713+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:10:59.554780+0000 front 2024-09-19T06:10:59.554825+0000 (oldest deadline 2024-09-19T06:11:24.155276+0000) 2024-09-19T06:11:29.499 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:29 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:29.076+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.243477+0000 front 2024-09-19T06:10:25.243671+0000 (oldest deadline 2024-09-19T06:10:50.543575+0000) 2024-09-19T06:11:29.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:29 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:29.076+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:40.846622+0000 front 2024-09-19T06:10:40.846471+0000 (oldest deadline 2024-09-19T06:11:05.546652+0000) 2024-09-19T06:11:29.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:29 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:29.076+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:50.847827+0000 front 2024-09-19T06:10:50.847888+0000 (oldest deadline 2024-09-19T06:11:14.347890+0000) 2024-09-19T06:11:29.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:29 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:29.076+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:10:57.849182+0000 front 2024-09-19T06:10:57.849209+0000 (oldest deadline 2024-09-19T06:11:21.348954+0000) 2024-09-19T06:11:29.590 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:29 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:29.241+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:24.169913+0000 front 2024-09-19T06:10:24.169648+0000 (oldest deadline 2024-09-19T06:10:48.869512+0000) 2024-09-19T06:11:29.590 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:29 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:29.241+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:35.771330+0000 front 2024-09-19T06:10:35.771421+0000 (oldest deadline 2024-09-19T06:10:59.871528+0000) 2024-09-19T06:11:29.590 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:29 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:29.241+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:39.871942+0000 front 2024-09-19T06:10:39.871906+0000 (oldest deadline 2024-09-19T06:11:10.472425+0000) 2024-09-19T06:11:29.590 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:29 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:29.241+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:51.573543+0000 front 2024-09-19T06:10:51.573591+0000 (oldest deadline 2024-09-19T06:11:13.873555+0000) 2024-09-19T06:11:29.590 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:29 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:29.241+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:11:00.175701+0000 front 2024-09-19T06:11:00.175670+0000 (oldest deadline 2024-09-19T06:11:23.675762+0000) 2024-09-19T06:11:29.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:29 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:29.404+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:27.553558+0000 front 2024-09-19T06:10:27.553623+0000 (oldest deadline 2024-09-19T06:10:53.453694+0000) 2024-09-19T06:11:29.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:29 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:29.404+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.554975+0000 front 2024-09-19T06:10:34.554852+0000 (oldest deadline 2024-09-19T06:10:57.454655+0000) 2024-09-19T06:11:29.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:29 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:29.404+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:42.155865+0000 front 2024-09-19T06:10:42.155832+0000 (oldest deadline 2024-09-19T06:11:07.455632+0000) 2024-09-19T06:11:29.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:29 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:29.404+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:51.457204+0000 front 2024-09-19T06:10:51.457233+0000 (oldest deadline 2024-09-19T06:11:15.557366+0000) 2024-09-19T06:11:29.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:29 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:29.404+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:11:00.258670+0000 front 2024-09-19T06:11:00.258844+0000 (oldest deadline 2024-09-19T06:11:25.558449+0000) 2024-09-19T06:11:30.069 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:29 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:29.762+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:36.251202+0000 front 2024-09-19T06:10:36.251075+0000 (oldest deadline 2024-09-19T06:11:01.551059+0000) 2024-09-19T06:11:30.069 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:29 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:29.762+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:43.252151+0000 front 2024-09-19T06:10:43.252231+0000 (oldest deadline 2024-09-19T06:11:06.152401+0000) 2024-09-19T06:11:30.069 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:29 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:29.762+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:48.453260+0000 front 2024-09-19T06:10:48.453273+0000 (oldest deadline 2024-09-19T06:11:13.753277+0000) 2024-09-19T06:11:30.069 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:29 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:29.762+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:10:59.554780+0000 front 2024-09-19T06:10:59.554825+0000 (oldest deadline 2024-09-19T06:11:24.155276+0000) 2024-09-19T06:11:30.343 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:30 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:30.067+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.243477+0000 front 2024-09-19T06:10:25.243671+0000 (oldest deadline 2024-09-19T06:10:50.543575+0000) 2024-09-19T06:11:30.343 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:30 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:30.067+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:40.846622+0000 front 2024-09-19T06:10:40.846471+0000 (oldest deadline 2024-09-19T06:11:05.546652+0000) 2024-09-19T06:11:30.343 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:30 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:30.067+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:50.847827+0000 front 2024-09-19T06:10:50.847888+0000 (oldest deadline 2024-09-19T06:11:14.347890+0000) 2024-09-19T06:11:30.343 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:30 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:30.067+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:10:57.849182+0000 front 2024-09-19T06:10:57.849209+0000 (oldest deadline 2024-09-19T06:11:21.348954+0000) 2024-09-19T06:11:30.601 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:30 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:30.242+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:24.169913+0000 front 2024-09-19T06:10:24.169648+0000 (oldest deadline 2024-09-19T06:10:48.869512+0000) 2024-09-19T06:11:30.601 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:30 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:30.242+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:35.771330+0000 front 2024-09-19T06:10:35.771421+0000 (oldest deadline 2024-09-19T06:10:59.871528+0000) 2024-09-19T06:11:30.601 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:30 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:30.242+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:39.871942+0000 front 2024-09-19T06:10:39.871906+0000 (oldest deadline 2024-09-19T06:11:10.472425+0000) 2024-09-19T06:11:30.602 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:30 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:30.242+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:51.573543+0000 front 2024-09-19T06:10:51.573591+0000 (oldest deadline 2024-09-19T06:11:13.873555+0000) 2024-09-19T06:11:30.602 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:30 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:30.242+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:11:00.175701+0000 front 2024-09-19T06:11:00.175670+0000 (oldest deadline 2024-09-19T06:11:23.675762+0000) 2024-09-19T06:11:30.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:30 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:30.449+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:27.553558+0000 front 2024-09-19T06:10:27.553623+0000 (oldest deadline 2024-09-19T06:10:53.453694+0000) 2024-09-19T06:11:30.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:30 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:30.449+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.554975+0000 front 2024-09-19T06:10:34.554852+0000 (oldest deadline 2024-09-19T06:10:57.454655+0000) 2024-09-19T06:11:30.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:30 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:30.449+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:42.155865+0000 front 2024-09-19T06:10:42.155832+0000 (oldest deadline 2024-09-19T06:11:07.455632+0000) 2024-09-19T06:11:30.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:30 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:30.449+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:51.457204+0000 front 2024-09-19T06:10:51.457233+0000 (oldest deadline 2024-09-19T06:11:15.557366+0000) 2024-09-19T06:11:30.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:30 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:30.449+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:11:00.258670+0000 front 2024-09-19T06:11:00.258844+0000 (oldest deadline 2024-09-19T06:11:25.558449+0000) 2024-09-19T06:11:31.115 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:30 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:30.801+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:36.251202+0000 front 2024-09-19T06:10:36.251075+0000 (oldest deadline 2024-09-19T06:11:01.551059+0000) 2024-09-19T06:11:31.116 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:30 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:30.801+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:43.252151+0000 front 2024-09-19T06:10:43.252231+0000 (oldest deadline 2024-09-19T06:11:06.152401+0000) 2024-09-19T06:11:31.116 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:30 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:30.801+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:48.453260+0000 front 2024-09-19T06:10:48.453273+0000 (oldest deadline 2024-09-19T06:11:13.753277+0000) 2024-09-19T06:11:31.116 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:30 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:30.801+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:10:59.554780+0000 front 2024-09-19T06:10:59.554825+0000 (oldest deadline 2024-09-19T06:11:24.155276+0000) 2024-09-19T06:11:31.116 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:30 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:30.801+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.117:6812 osd.5 since back 2024-09-19T06:11:04.155560+0000 front 2024-09-19T06:11:04.155602+0000 (oldest deadline 2024-09-19T06:11:30.055614+0000) 2024-09-19T06:11:31.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:31 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:31.114+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.243477+0000 front 2024-09-19T06:10:25.243671+0000 (oldest deadline 2024-09-19T06:10:50.543575+0000) 2024-09-19T06:11:31.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:31 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:31.114+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:40.846622+0000 front 2024-09-19T06:10:40.846471+0000 (oldest deadline 2024-09-19T06:11:05.546652+0000) 2024-09-19T06:11:31.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:31 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:31.114+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:50.847827+0000 front 2024-09-19T06:10:50.847888+0000 (oldest deadline 2024-09-19T06:11:14.347890+0000) 2024-09-19T06:11:31.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:31 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:31.114+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:10:57.849182+0000 front 2024-09-19T06:10:57.849209+0000 (oldest deadline 2024-09-19T06:11:21.348954+0000) 2024-09-19T06:11:31.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:31 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:31.114+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6812 osd.5 since back 2024-09-19T06:11:06.550320+0000 front 2024-09-19T06:11:06.550371+0000 (oldest deadline 2024-09-19T06:11:30.650457+0000) 2024-09-19T06:11:31.689 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:31 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:31.224+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:24.169913+0000 front 2024-09-19T06:10:24.169648+0000 (oldest deadline 2024-09-19T06:10:48.869512+0000) 2024-09-19T06:11:31.689 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:31 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:31.224+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:35.771330+0000 front 2024-09-19T06:10:35.771421+0000 (oldest deadline 2024-09-19T06:10:59.871528+0000) 2024-09-19T06:11:31.689 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:31 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:31.224+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:39.871942+0000 front 2024-09-19T06:10:39.871906+0000 (oldest deadline 2024-09-19T06:11:10.472425+0000) 2024-09-19T06:11:31.689 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:31 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:31.224+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:51.573543+0000 front 2024-09-19T06:10:51.573591+0000 (oldest deadline 2024-09-19T06:11:13.873555+0000) 2024-09-19T06:11:31.689 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:31 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:31.224+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:11:00.175701+0000 front 2024-09-19T06:11:00.175670+0000 (oldest deadline 2024-09-19T06:11:23.675762+0000) 2024-09-19T06:11:31.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:31 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:31.404+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:27.553558+0000 front 2024-09-19T06:10:27.553623+0000 (oldest deadline 2024-09-19T06:10:53.453694+0000) 2024-09-19T06:11:31.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:31 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:31.404+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.554975+0000 front 2024-09-19T06:10:34.554852+0000 (oldest deadline 2024-09-19T06:10:57.454655+0000) 2024-09-19T06:11:31.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:31 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:31.404+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:42.155865+0000 front 2024-09-19T06:10:42.155832+0000 (oldest deadline 2024-09-19T06:11:07.455632+0000) 2024-09-19T06:11:31.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:31 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:31.404+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:51.457204+0000 front 2024-09-19T06:10:51.457233+0000 (oldest deadline 2024-09-19T06:11:15.557366+0000) 2024-09-19T06:11:31.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:31 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:31.404+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:11:00.258670+0000 front 2024-09-19T06:11:00.258844+0000 (oldest deadline 2024-09-19T06:11:25.558449+0000) 2024-09-19T06:11:31.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:31 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:31.404+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.117:6812 osd.5 since back 2024-09-19T06:11:05.559099+0000 front 2024-09-19T06:11:05.558977+0000 (oldest deadline 2024-09-19T06:11:30.858831+0000) 2024-09-19T06:11:32.146 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:31 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:31.774+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:36.251202+0000 front 2024-09-19T06:10:36.251075+0000 (oldest deadline 2024-09-19T06:11:01.551059+0000) 2024-09-19T06:11:32.146 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:31 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:31.774+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:43.252151+0000 front 2024-09-19T06:10:43.252231+0000 (oldest deadline 2024-09-19T06:11:06.152401+0000) 2024-09-19T06:11:32.146 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:31 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:31.774+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:48.453260+0000 front 2024-09-19T06:10:48.453273+0000 (oldest deadline 2024-09-19T06:11:13.753277+0000) 2024-09-19T06:11:32.147 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:31 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:31.774+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:10:59.554780+0000 front 2024-09-19T06:10:59.554825+0000 (oldest deadline 2024-09-19T06:11:24.155276+0000) 2024-09-19T06:11:32.147 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:31 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8[53007]: 2024-09-19T06:11:31.774+0000 7f79213d4640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.117:6812 osd.5 since back 2024-09-19T06:11:04.155560+0000 front 2024-09-19T06:11:04.155602+0000 (oldest deadline 2024-09-19T06:11:30.055614+0000) 2024-09-19T06:11:32.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:32 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:32.144+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.243477+0000 front 2024-09-19T06:10:25.243671+0000 (oldest deadline 2024-09-19T06:10:50.543575+0000) 2024-09-19T06:11:32.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:32 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:32.144+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:40.846622+0000 front 2024-09-19T06:10:40.846471+0000 (oldest deadline 2024-09-19T06:11:05.546652+0000) 2024-09-19T06:11:32.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:32 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:32.144+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:50.847827+0000 front 2024-09-19T06:10:50.847888+0000 (oldest deadline 2024-09-19T06:11:14.347890+0000) 2024-09-19T06:11:32.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:32 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:32.144+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:10:57.849182+0000 front 2024-09-19T06:10:57.849209+0000 (oldest deadline 2024-09-19T06:11:21.348954+0000) 2024-09-19T06:11:32.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:32 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:32.144+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6812 osd.5 since back 2024-09-19T06:11:06.550320+0000 front 2024-09-19T06:11:06.550371+0000 (oldest deadline 2024-09-19T06:11:30.650457+0000) 2024-09-19T06:11:32.689 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:32 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:32.187+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:24.169913+0000 front 2024-09-19T06:10:24.169648+0000 (oldest deadline 2024-09-19T06:10:48.869512+0000) 2024-09-19T06:11:32.689 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:32 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:32.187+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:35.771330+0000 front 2024-09-19T06:10:35.771421+0000 (oldest deadline 2024-09-19T06:10:59.871528+0000) 2024-09-19T06:11:32.689 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:32 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:32.187+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:39.871942+0000 front 2024-09-19T06:10:39.871906+0000 (oldest deadline 2024-09-19T06:11:10.472425+0000) 2024-09-19T06:11:32.689 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:32 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:32.187+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:51.573543+0000 front 2024-09-19T06:10:51.573591+0000 (oldest deadline 2024-09-19T06:11:13.873555+0000) 2024-09-19T06:11:32.689 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:32 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:32.187+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:11:00.175701+0000 front 2024-09-19T06:11:00.175670+0000 (oldest deadline 2024-09-19T06:11:23.675762+0000) 2024-09-19T06:11:32.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:32 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:32.422+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:27.553558+0000 front 2024-09-19T06:10:27.553623+0000 (oldest deadline 2024-09-19T06:10:53.453694+0000) 2024-09-19T06:11:32.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:32 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:32.422+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.554975+0000 front 2024-09-19T06:10:34.554852+0000 (oldest deadline 2024-09-19T06:10:57.454655+0000) 2024-09-19T06:11:32.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:32 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:32.422+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:42.155865+0000 front 2024-09-19T06:10:42.155832+0000 (oldest deadline 2024-09-19T06:11:07.455632+0000) 2024-09-19T06:11:32.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:32 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:32.422+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:51.457204+0000 front 2024-09-19T06:10:51.457233+0000 (oldest deadline 2024-09-19T06:11:15.557366+0000) 2024-09-19T06:11:32.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:32 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:32.422+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:11:00.258670+0000 front 2024-09-19T06:11:00.258844+0000 (oldest deadline 2024-09-19T06:11:25.558449+0000) 2024-09-19T06:11:32.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:32 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:32.422+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.117:6812 osd.5 since back 2024-09-19T06:11:05.559099+0000 front 2024-09-19T06:11:05.558977+0000 (oldest deadline 2024-09-19T06:11:30.858831+0000) 2024-09-19T06:11:32.947 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:32 smithi117 podman[68230]: 2024-09-19 06:11:32.65348587 +0000 UTC m=+5.463333149 container died bddfe45a26c8b12215ed02120bb01fa08a87bf60ec98c0fdf83cff897eabe938 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:11:33.250 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:33 smithi117 podman[68230]: 2024-09-19 06:11:33.070080199 +0000 UTC m=+5.879927468 container cleanup bddfe45a26c8b12215ed02120bb01fa08a87bf60ec98c0fdf83cff897eabe938 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-19T06:11:33.250 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:33 smithi117 bash[68230]: ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8 2024-09-19T06:11:33.250 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:33 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:33.122+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.243477+0000 front 2024-09-19T06:10:25.243671+0000 (oldest deadline 2024-09-19T06:10:50.543575+0000) 2024-09-19T06:11:33.250 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:33 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:33.122+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:40.846622+0000 front 2024-09-19T06:10:40.846471+0000 (oldest deadline 2024-09-19T06:11:05.546652+0000) 2024-09-19T06:11:33.250 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:33 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:33.122+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:50.847827+0000 front 2024-09-19T06:10:50.847888+0000 (oldest deadline 2024-09-19T06:11:14.347890+0000) 2024-09-19T06:11:33.250 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:33 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:33.122+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:10:57.849182+0000 front 2024-09-19T06:10:57.849209+0000 (oldest deadline 2024-09-19T06:11:21.348954+0000) 2024-09-19T06:11:33.250 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:33 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:33.122+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6812 osd.5 since back 2024-09-19T06:11:06.550320+0000 front 2024-09-19T06:11:06.550371+0000 (oldest deadline 2024-09-19T06:11:30.650457+0000) 2024-09-19T06:11:33.438 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:33 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:33.154+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:24.169913+0000 front 2024-09-19T06:10:24.169648+0000 (oldest deadline 2024-09-19T06:10:48.869512+0000) 2024-09-19T06:11:33.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:33 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:33.154+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:35.771330+0000 front 2024-09-19T06:10:35.771421+0000 (oldest deadline 2024-09-19T06:10:59.871528+0000) 2024-09-19T06:11:33.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:33 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:33.154+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:39.871942+0000 front 2024-09-19T06:10:39.871906+0000 (oldest deadline 2024-09-19T06:11:10.472425+0000) 2024-09-19T06:11:33.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:33 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:33.154+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:51.573543+0000 front 2024-09-19T06:10:51.573591+0000 (oldest deadline 2024-09-19T06:11:13.873555+0000) 2024-09-19T06:11:33.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:33 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:33.154+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:11:00.175701+0000 front 2024-09-19T06:11:00.175670+0000 (oldest deadline 2024-09-19T06:11:23.675762+0000) 2024-09-19T06:11:33.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:33 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:33.154+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.117:6812 osd.5 since back 2024-09-19T06:11:06.576854+0000 front 2024-09-19T06:11:06.576941+0000 (oldest deadline 2024-09-19T06:11:32.476734+0000) 2024-09-19T06:11:33.681 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:33 smithi117 podman[68257]: 2024-09-19 06:11:33.254582423 +0000 UTC m=+0.593805249 container remove bddfe45a26c8b12215ed02120bb01fa08a87bf60ec98c0fdf83cff897eabe938 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.schema-version=1.0) 2024-09-19T06:11:33.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:33 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:33.405+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:27.553558+0000 front 2024-09-19T06:10:27.553623+0000 (oldest deadline 2024-09-19T06:10:53.453694+0000) 2024-09-19T06:11:33.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:33 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:33.405+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.554975+0000 front 2024-09-19T06:10:34.554852+0000 (oldest deadline 2024-09-19T06:10:57.454655+0000) 2024-09-19T06:11:33.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:33 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:33.405+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:42.155865+0000 front 2024-09-19T06:10:42.155832+0000 (oldest deadline 2024-09-19T06:11:07.455632+0000) 2024-09-19T06:11:33.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:33 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:33.405+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:51.457204+0000 front 2024-09-19T06:10:51.457233+0000 (oldest deadline 2024-09-19T06:11:15.557366+0000) 2024-09-19T06:11:33.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:33 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:33.405+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:11:00.258670+0000 front 2024-09-19T06:11:00.258844+0000 (oldest deadline 2024-09-19T06:11:25.558449+0000) 2024-09-19T06:11:33.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:33 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:33.405+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.117:6812 osd.5 since back 2024-09-19T06:11:05.559099+0000 front 2024-09-19T06:11:05.558977+0000 (oldest deadline 2024-09-19T06:11:30.858831+0000) 2024-09-19T06:11:33.999 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:33 smithi117 podman[68347]: 2024-09-19 06:11:33.582865591 +0000 UTC m=+0.015760581 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:11:34.000 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:33 smithi117 podman[68347]: 2024-09-19 06:11:33.680346047 +0000 UTC m=+0.113241027 container create b85669257adc7635ceba7393c5412316f45684df43ea89b20a3420651106e2a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, RELEASE=squid-2f599a4) 2024-09-19T06:11:34.000 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:33 smithi117 podman[68347]: 2024-09-19 06:11:33.899621543 +0000 UTC m=+0.332516520 container init b85669257adc7635ceba7393c5412316f45684df43ea89b20a3420651106e2a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:11:34.000 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:33 smithi117 podman[68347]: 2024-09-19 06:11:33.90277629 +0000 UTC m=+0.335671271 container start b85669257adc7635ceba7393c5412316f45684df43ea89b20a3420651106e2a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-19T06:11:34.378 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:34 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:34.105+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.243477+0000 front 2024-09-19T06:10:25.243671+0000 (oldest deadline 2024-09-19T06:10:50.543575+0000) 2024-09-19T06:11:34.379 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:34 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:34.105+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:40.846622+0000 front 2024-09-19T06:10:40.846471+0000 (oldest deadline 2024-09-19T06:11:05.546652+0000) 2024-09-19T06:11:34.379 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:34 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:34.105+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:50.847827+0000 front 2024-09-19T06:10:50.847888+0000 (oldest deadline 2024-09-19T06:11:14.347890+0000) 2024-09-19T06:11:34.379 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:34 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:34.105+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:10:57.849182+0000 front 2024-09-19T06:10:57.849209+0000 (oldest deadline 2024-09-19T06:11:21.348954+0000) 2024-09-19T06:11:34.379 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:34 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:34.105+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6812 osd.5 since back 2024-09-19T06:11:06.550320+0000 front 2024-09-19T06:11:06.550371+0000 (oldest deadline 2024-09-19T06:11:30.650457+0000) 2024-09-19T06:11:34.379 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:33 smithi117 podman[68347]: 2024-09-19 06:11:33.999328847 +0000 UTC m=+0.432223834 container attach b85669257adc7635ceba7393c5412316f45684df43ea89b20a3420651106e2a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8-deactivate, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-19T06:11:34.379 INFO:journalctl@ceph.osd.8.smithi117.stdout:Sep 19 06:11:34 smithi117 podman[68347]: 2024-09-19 06:11:34.095409498 +0000 UTC m=+0.528304496 container died b85669257adc7635ceba7393c5412316f45684df43ea89b20a3420651106e2a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-8-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-19T06:11:34.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:34 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:34.137+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:24.169913+0000 front 2024-09-19T06:10:24.169648+0000 (oldest deadline 2024-09-19T06:10:48.869512+0000) 2024-09-19T06:11:34.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:34 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:34.137+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:35.771330+0000 front 2024-09-19T06:10:35.771421+0000 (oldest deadline 2024-09-19T06:10:59.871528+0000) 2024-09-19T06:11:34.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:34 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:34.137+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:39.871942+0000 front 2024-09-19T06:10:39.871906+0000 (oldest deadline 2024-09-19T06:11:10.472425+0000) 2024-09-19T06:11:34.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:34 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:34.137+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:51.573543+0000 front 2024-09-19T06:10:51.573591+0000 (oldest deadline 2024-09-19T06:11:13.873555+0000) 2024-09-19T06:11:34.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:34 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:34.137+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:11:00.175701+0000 front 2024-09-19T06:11:00.175670+0000 (oldest deadline 2024-09-19T06:11:23.675762+0000) 2024-09-19T06:11:34.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:34 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:34.137+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.117:6812 osd.5 since back 2024-09-19T06:11:06.576854+0000 front 2024-09-19T06:11:06.576941+0000 (oldest deadline 2024-09-19T06:11:32.476734+0000) 2024-09-19T06:11:34.709 DEBUG:teuthology.orchestra.run.smithi117:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@osd.8.service' 2024-09-19T06:11:34.748 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:11:34.748 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-19T06:11:34.748 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-19T06:11:34.748 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@osd.9 2024-09-19T06:11:34.778 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:34 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:34.400+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:27.553558+0000 front 2024-09-19T06:10:27.553623+0000 (oldest deadline 2024-09-19T06:10:53.453694+0000) 2024-09-19T06:11:34.779 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:34 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:34.400+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.554975+0000 front 2024-09-19T06:10:34.554852+0000 (oldest deadline 2024-09-19T06:10:57.454655+0000) 2024-09-19T06:11:34.779 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:34 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:34.400+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:42.155865+0000 front 2024-09-19T06:10:42.155832+0000 (oldest deadline 2024-09-19T06:11:07.455632+0000) 2024-09-19T06:11:34.779 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:34 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:34.400+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:51.457204+0000 front 2024-09-19T06:10:51.457233+0000 (oldest deadline 2024-09-19T06:11:15.557366+0000) 2024-09-19T06:11:34.779 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:34 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:34.400+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:11:00.258670+0000 front 2024-09-19T06:11:00.258844+0000 (oldest deadline 2024-09-19T06:11:25.558449+0000) 2024-09-19T06:11:34.779 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:34 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:34.400+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.117:6812 osd.5 since back 2024-09-19T06:11:05.559099+0000 front 2024-09-19T06:11:05.558977+0000 (oldest deadline 2024-09-19T06:11:30.858831+0000) 2024-09-19T06:11:35.074 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:34 smithi037 systemd[1]: Stopping Ceph osd.9 for b8c8bdae-764b-11ef-bceb-c7b262605968... 2024-09-19T06:11:35.438 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:35 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:35.134+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:24.169913+0000 front 2024-09-19T06:10:24.169648+0000 (oldest deadline 2024-09-19T06:10:48.869512+0000) 2024-09-19T06:11:35.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:35 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:35.134+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:35.771330+0000 front 2024-09-19T06:10:35.771421+0000 (oldest deadline 2024-09-19T06:10:59.871528+0000) 2024-09-19T06:11:35.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:35 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:35.134+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:39.871942+0000 front 2024-09-19T06:10:39.871906+0000 (oldest deadline 2024-09-19T06:11:10.472425+0000) 2024-09-19T06:11:35.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:35 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:35.134+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:51.573543+0000 front 2024-09-19T06:10:51.573591+0000 (oldest deadline 2024-09-19T06:11:13.873555+0000) 2024-09-19T06:11:35.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:35 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:35.134+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:11:00.175701+0000 front 2024-09-19T06:11:00.175670+0000 (oldest deadline 2024-09-19T06:11:23.675762+0000) 2024-09-19T06:11:35.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:35 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:35.134+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.117:6812 osd.5 since back 2024-09-19T06:11:06.576854+0000 front 2024-09-19T06:11:06.576941+0000 (oldest deadline 2024-09-19T06:11:32.476734+0000) 2024-09-19T06:11:35.499 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:35 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:35.143+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.243477+0000 front 2024-09-19T06:10:25.243671+0000 (oldest deadline 2024-09-19T06:10:50.543575+0000) 2024-09-19T06:11:35.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:35 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:35.143+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:40.846622+0000 front 2024-09-19T06:10:40.846471+0000 (oldest deadline 2024-09-19T06:11:05.546652+0000) 2024-09-19T06:11:35.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:35 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:35.143+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:50.847827+0000 front 2024-09-19T06:10:50.847888+0000 (oldest deadline 2024-09-19T06:11:14.347890+0000) 2024-09-19T06:11:35.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:35 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:35.143+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:10:57.849182+0000 front 2024-09-19T06:10:57.849209+0000 (oldest deadline 2024-09-19T06:11:21.348954+0000) 2024-09-19T06:11:35.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:35 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:35.143+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6812 osd.5 since back 2024-09-19T06:11:06.550320+0000 front 2024-09-19T06:11:06.550371+0000 (oldest deadline 2024-09-19T06:11:30.650457+0000) 2024-09-19T06:11:35.574 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:35 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:35.191+0000 7f5912bb9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:11:35.574 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:35 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:35.191+0000 7f5912bb9640 -1 osd.9 95 *** Got signal Terminated *** 2024-09-19T06:11:35.574 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:35 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:35.191+0000 7f5912bb9640 -1 osd.9 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:11:35.574 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:35 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:35.361+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:27.553558+0000 front 2024-09-19T06:10:27.553623+0000 (oldest deadline 2024-09-19T06:10:53.453694+0000) 2024-09-19T06:11:35.574 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:35 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:35.361+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.554975+0000 front 2024-09-19T06:10:34.554852+0000 (oldest deadline 2024-09-19T06:10:57.454655+0000) 2024-09-19T06:11:35.574 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:35 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:35.361+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:42.155865+0000 front 2024-09-19T06:10:42.155832+0000 (oldest deadline 2024-09-19T06:11:07.455632+0000) 2024-09-19T06:11:35.574 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:35 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:35.361+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:51.457204+0000 front 2024-09-19T06:10:51.457233+0000 (oldest deadline 2024-09-19T06:11:15.557366+0000) 2024-09-19T06:11:35.574 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:35 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:35.361+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:11:00.258670+0000 front 2024-09-19T06:11:00.258844+0000 (oldest deadline 2024-09-19T06:11:25.558449+0000) 2024-09-19T06:11:35.574 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:35 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:35.361+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.117:6812 osd.5 since back 2024-09-19T06:11:05.559099+0000 front 2024-09-19T06:11:05.558977+0000 (oldest deadline 2024-09-19T06:11:30.858831+0000) 2024-09-19T06:11:36.438 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:36 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:36.127+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:24.169913+0000 front 2024-09-19T06:10:24.169648+0000 (oldest deadline 2024-09-19T06:10:48.869512+0000) 2024-09-19T06:11:36.438 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:36 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:36.127+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:35.771330+0000 front 2024-09-19T06:10:35.771421+0000 (oldest deadline 2024-09-19T06:10:59.871528+0000) 2024-09-19T06:11:36.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:36 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:36.127+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:39.871942+0000 front 2024-09-19T06:10:39.871906+0000 (oldest deadline 2024-09-19T06:11:10.472425+0000) 2024-09-19T06:11:36.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:36 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:36.127+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:51.573543+0000 front 2024-09-19T06:10:51.573591+0000 (oldest deadline 2024-09-19T06:11:13.873555+0000) 2024-09-19T06:11:36.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:36 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:36.127+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:11:00.175701+0000 front 2024-09-19T06:11:00.175670+0000 (oldest deadline 2024-09-19T06:11:23.675762+0000) 2024-09-19T06:11:36.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:36 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:36.127+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.117:6812 osd.5 since back 2024-09-19T06:11:06.576854+0000 front 2024-09-19T06:11:06.576941+0000 (oldest deadline 2024-09-19T06:11:32.476734+0000) 2024-09-19T06:11:36.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:36 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:36.131+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.243477+0000 front 2024-09-19T06:10:25.243671+0000 (oldest deadline 2024-09-19T06:10:50.543575+0000) 2024-09-19T06:11:36.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:36 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:36.131+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:40.846622+0000 front 2024-09-19T06:10:40.846471+0000 (oldest deadline 2024-09-19T06:11:05.546652+0000) 2024-09-19T06:11:36.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:36 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:36.131+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:50.847827+0000 front 2024-09-19T06:10:50.847888+0000 (oldest deadline 2024-09-19T06:11:14.347890+0000) 2024-09-19T06:11:36.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:36 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:36.131+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:10:57.849182+0000 front 2024-09-19T06:10:57.849209+0000 (oldest deadline 2024-09-19T06:11:21.348954+0000) 2024-09-19T06:11:36.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:36 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:36.131+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6812 osd.5 since back 2024-09-19T06:11:06.550320+0000 front 2024-09-19T06:11:06.550371+0000 (oldest deadline 2024-09-19T06:11:30.650457+0000) 2024-09-19T06:11:36.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:36 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:36.405+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:27.553558+0000 front 2024-09-19T06:10:27.553623+0000 (oldest deadline 2024-09-19T06:10:53.453694+0000) 2024-09-19T06:11:36.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:36 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:36.405+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.554975+0000 front 2024-09-19T06:10:34.554852+0000 (oldest deadline 2024-09-19T06:10:57.454655+0000) 2024-09-19T06:11:36.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:36 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:36.405+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:42.155865+0000 front 2024-09-19T06:10:42.155832+0000 (oldest deadline 2024-09-19T06:11:07.455632+0000) 2024-09-19T06:11:36.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:36 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:36.405+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:51.457204+0000 front 2024-09-19T06:10:51.457233+0000 (oldest deadline 2024-09-19T06:11:15.557366+0000) 2024-09-19T06:11:36.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:36 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:36.405+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:11:00.258670+0000 front 2024-09-19T06:11:00.258844+0000 (oldest deadline 2024-09-19T06:11:25.558449+0000) 2024-09-19T06:11:36.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:36 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:36.405+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.117:6812 osd.5 since back 2024-09-19T06:11:05.559099+0000 front 2024-09-19T06:11:05.558977+0000 (oldest deadline 2024-09-19T06:11:30.858831+0000) 2024-09-19T06:11:37.438 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:37 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:37.138+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:24.169913+0000 front 2024-09-19T06:10:24.169648+0000 (oldest deadline 2024-09-19T06:10:48.869512+0000) 2024-09-19T06:11:37.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:37 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:37.138+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:35.771330+0000 front 2024-09-19T06:10:35.771421+0000 (oldest deadline 2024-09-19T06:10:59.871528+0000) 2024-09-19T06:11:37.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:37 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:37.138+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:39.871942+0000 front 2024-09-19T06:10:39.871906+0000 (oldest deadline 2024-09-19T06:11:10.472425+0000) 2024-09-19T06:11:37.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:37 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:37.138+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:51.573543+0000 front 2024-09-19T06:10:51.573591+0000 (oldest deadline 2024-09-19T06:11:13.873555+0000) 2024-09-19T06:11:37.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:37 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:37.138+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:11:00.175701+0000 front 2024-09-19T06:11:00.175670+0000 (oldest deadline 2024-09-19T06:11:23.675762+0000) 2024-09-19T06:11:37.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:37 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:37.138+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.117:6812 osd.5 since back 2024-09-19T06:11:06.576854+0000 front 2024-09-19T06:11:06.576941+0000 (oldest deadline 2024-09-19T06:11:32.476734+0000) 2024-09-19T06:11:37.499 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:37 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:37.147+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.243477+0000 front 2024-09-19T06:10:25.243671+0000 (oldest deadline 2024-09-19T06:10:50.543575+0000) 2024-09-19T06:11:37.499 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:37 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:37.147+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:40.846622+0000 front 2024-09-19T06:10:40.846471+0000 (oldest deadline 2024-09-19T06:11:05.546652+0000) 2024-09-19T06:11:37.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:37 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:37.147+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:50.847827+0000 front 2024-09-19T06:10:50.847888+0000 (oldest deadline 2024-09-19T06:11:14.347890+0000) 2024-09-19T06:11:37.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:37 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:37.147+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:10:57.849182+0000 front 2024-09-19T06:10:57.849209+0000 (oldest deadline 2024-09-19T06:11:21.348954+0000) 2024-09-19T06:11:37.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:37 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:37.147+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6812 osd.5 since back 2024-09-19T06:11:06.550320+0000 front 2024-09-19T06:11:06.550371+0000 (oldest deadline 2024-09-19T06:11:30.650457+0000) 2024-09-19T06:11:37.823 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:37 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:37.381+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:27.553558+0000 front 2024-09-19T06:10:27.553623+0000 (oldest deadline 2024-09-19T06:10:53.453694+0000) 2024-09-19T06:11:37.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:37 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:37.382+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.554975+0000 front 2024-09-19T06:10:34.554852+0000 (oldest deadline 2024-09-19T06:10:57.454655+0000) 2024-09-19T06:11:37.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:37 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:37.382+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:42.155865+0000 front 2024-09-19T06:10:42.155832+0000 (oldest deadline 2024-09-19T06:11:07.455632+0000) 2024-09-19T06:11:37.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:37 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:37.382+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:51.457204+0000 front 2024-09-19T06:10:51.457233+0000 (oldest deadline 2024-09-19T06:11:15.557366+0000) 2024-09-19T06:11:37.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:37 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:37.382+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:11:00.258670+0000 front 2024-09-19T06:11:00.258844+0000 (oldest deadline 2024-09-19T06:11:25.558449+0000) 2024-09-19T06:11:37.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:37 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:37.382+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.117:6812 osd.5 since back 2024-09-19T06:11:05.559099+0000 front 2024-09-19T06:11:05.558977+0000 (oldest deadline 2024-09-19T06:11:30.858831+0000) 2024-09-19T06:11:38.440 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:38 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:38.104+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:24.169913+0000 front 2024-09-19T06:10:24.169648+0000 (oldest deadline 2024-09-19T06:10:48.869512+0000) 2024-09-19T06:11:38.440 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:38 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:38.104+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:35.771330+0000 front 2024-09-19T06:10:35.771421+0000 (oldest deadline 2024-09-19T06:10:59.871528+0000) 2024-09-19T06:11:38.440 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:38 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:38.104+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:39.871942+0000 front 2024-09-19T06:10:39.871906+0000 (oldest deadline 2024-09-19T06:11:10.472425+0000) 2024-09-19T06:11:38.440 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:38 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:38.104+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:51.573543+0000 front 2024-09-19T06:10:51.573591+0000 (oldest deadline 2024-09-19T06:11:13.873555+0000) 2024-09-19T06:11:38.441 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:38 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:38.104+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:11:00.175701+0000 front 2024-09-19T06:11:00.175670+0000 (oldest deadline 2024-09-19T06:11:23.675762+0000) 2024-09-19T06:11:38.441 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:38 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:38.104+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.117:6812 osd.5 since back 2024-09-19T06:11:06.576854+0000 front 2024-09-19T06:11:06.576941+0000 (oldest deadline 2024-09-19T06:11:32.476734+0000) 2024-09-19T06:11:38.441 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:38 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:38.104+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-19T06:11:12.477356+0000 front 2024-09-19T06:11:12.477255+0000 (oldest deadline 2024-09-19T06:11:37.177127+0000) 2024-09-19T06:11:38.499 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:38 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:38.131+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.243477+0000 front 2024-09-19T06:10:25.243671+0000 (oldest deadline 2024-09-19T06:10:50.543575+0000) 2024-09-19T06:11:38.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:38 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:38.131+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:40.846622+0000 front 2024-09-19T06:10:40.846471+0000 (oldest deadline 2024-09-19T06:11:05.546652+0000) 2024-09-19T06:11:38.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:38 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:38.131+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:50.847827+0000 front 2024-09-19T06:10:50.847888+0000 (oldest deadline 2024-09-19T06:11:14.347890+0000) 2024-09-19T06:11:38.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:38 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:38.131+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:10:57.849182+0000 front 2024-09-19T06:10:57.849209+0000 (oldest deadline 2024-09-19T06:11:21.348954+0000) 2024-09-19T06:11:38.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:38 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:38.131+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6812 osd.5 since back 2024-09-19T06:11:06.550320+0000 front 2024-09-19T06:11:06.550371+0000 (oldest deadline 2024-09-19T06:11:30.650457+0000) 2024-09-19T06:11:38.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:38 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:38.353+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:27.553558+0000 front 2024-09-19T06:10:27.553623+0000 (oldest deadline 2024-09-19T06:10:53.453694+0000) 2024-09-19T06:11:38.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:38 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:38.353+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.554975+0000 front 2024-09-19T06:10:34.554852+0000 (oldest deadline 2024-09-19T06:10:57.454655+0000) 2024-09-19T06:11:38.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:38 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:38.353+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:42.155865+0000 front 2024-09-19T06:10:42.155832+0000 (oldest deadline 2024-09-19T06:11:07.455632+0000) 2024-09-19T06:11:38.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:38 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:38.353+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:51.457204+0000 front 2024-09-19T06:10:51.457233+0000 (oldest deadline 2024-09-19T06:11:15.557366+0000) 2024-09-19T06:11:38.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:38 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:38.353+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:11:00.258670+0000 front 2024-09-19T06:11:00.258844+0000 (oldest deadline 2024-09-19T06:11:25.558449+0000) 2024-09-19T06:11:38.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:38 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:38.353+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.117:6812 osd.5 since back 2024-09-19T06:11:05.559099+0000 front 2024-09-19T06:11:05.558977+0000 (oldest deadline 2024-09-19T06:11:30.858831+0000) 2024-09-19T06:11:39.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:39 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:39.087+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:24.169913+0000 front 2024-09-19T06:10:24.169648+0000 (oldest deadline 2024-09-19T06:10:48.869512+0000) 2024-09-19T06:11:39.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:39 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:39.087+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:35.771330+0000 front 2024-09-19T06:10:35.771421+0000 (oldest deadline 2024-09-19T06:10:59.871528+0000) 2024-09-19T06:11:39.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:39 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:39.087+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:39.871942+0000 front 2024-09-19T06:10:39.871906+0000 (oldest deadline 2024-09-19T06:11:10.472425+0000) 2024-09-19T06:11:39.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:39 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:39.087+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:51.573543+0000 front 2024-09-19T06:10:51.573591+0000 (oldest deadline 2024-09-19T06:11:13.873555+0000) 2024-09-19T06:11:39.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:39 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:39.087+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:11:00.175701+0000 front 2024-09-19T06:11:00.175670+0000 (oldest deadline 2024-09-19T06:11:23.675762+0000) 2024-09-19T06:11:39.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:39 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:39.087+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.117:6812 osd.5 since back 2024-09-19T06:11:06.576854+0000 front 2024-09-19T06:11:06.576941+0000 (oldest deadline 2024-09-19T06:11:32.476734+0000) 2024-09-19T06:11:39.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:39 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:39.087+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-19T06:11:12.477356+0000 front 2024-09-19T06:11:12.477255+0000 (oldest deadline 2024-09-19T06:11:37.177127+0000) 2024-09-19T06:11:39.499 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:39 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:39.087+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.243477+0000 front 2024-09-19T06:10:25.243671+0000 (oldest deadline 2024-09-19T06:10:50.543575+0000) 2024-09-19T06:11:39.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:39 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:39.087+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:40.846622+0000 front 2024-09-19T06:10:40.846471+0000 (oldest deadline 2024-09-19T06:11:05.546652+0000) 2024-09-19T06:11:39.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:39 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:39.087+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:50.847827+0000 front 2024-09-19T06:10:50.847888+0000 (oldest deadline 2024-09-19T06:11:14.347890+0000) 2024-09-19T06:11:39.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:39 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:39.087+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:10:57.849182+0000 front 2024-09-19T06:10:57.849209+0000 (oldest deadline 2024-09-19T06:11:21.348954+0000) 2024-09-19T06:11:39.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:39 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:39.087+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6812 osd.5 since back 2024-09-19T06:11:06.550320+0000 front 2024-09-19T06:11:06.550371+0000 (oldest deadline 2024-09-19T06:11:30.650457+0000) 2024-09-19T06:11:39.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:39 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:39.398+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:27.553558+0000 front 2024-09-19T06:10:27.553623+0000 (oldest deadline 2024-09-19T06:10:53.453694+0000) 2024-09-19T06:11:39.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:39 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:39.398+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:34.554975+0000 front 2024-09-19T06:10:34.554852+0000 (oldest deadline 2024-09-19T06:10:57.454655+0000) 2024-09-19T06:11:39.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:39 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:39.398+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:42.155865+0000 front 2024-09-19T06:10:42.155832+0000 (oldest deadline 2024-09-19T06:11:07.455632+0000) 2024-09-19T06:11:39.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:39 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:39.398+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:51.457204+0000 front 2024-09-19T06:10:51.457233+0000 (oldest deadline 2024-09-19T06:11:15.557366+0000) 2024-09-19T06:11:39.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:39 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:39.398+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:11:00.258670+0000 front 2024-09-19T06:11:00.258844+0000 (oldest deadline 2024-09-19T06:11:25.558449+0000) 2024-09-19T06:11:39.824 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:39 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9[62642]: 2024-09-19T06:11:39.398+0000 7f590f1cf640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.117:6812 osd.5 since back 2024-09-19T06:11:05.559099+0000 front 2024-09-19T06:11:05.558977+0000 (oldest deadline 2024-09-19T06:11:30.858831+0000) 2024-09-19T06:11:40.438 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:40 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:40.047+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:24.169913+0000 front 2024-09-19T06:10:24.169648+0000 (oldest deadline 2024-09-19T06:10:48.869512+0000) 2024-09-19T06:11:40.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:40 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:40.047+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:35.771330+0000 front 2024-09-19T06:10:35.771421+0000 (oldest deadline 2024-09-19T06:10:59.871528+0000) 2024-09-19T06:11:40.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:40 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:40.047+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:39.871942+0000 front 2024-09-19T06:10:39.871906+0000 (oldest deadline 2024-09-19T06:11:10.472425+0000) 2024-09-19T06:11:40.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:40 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:40.047+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:51.573543+0000 front 2024-09-19T06:10:51.573591+0000 (oldest deadline 2024-09-19T06:11:13.873555+0000) 2024-09-19T06:11:40.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:40 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:40.047+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:11:00.175701+0000 front 2024-09-19T06:11:00.175670+0000 (oldest deadline 2024-09-19T06:11:23.675762+0000) 2024-09-19T06:11:40.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:40 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:40.047+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.117:6812 osd.5 since back 2024-09-19T06:11:06.576854+0000 front 2024-09-19T06:11:06.576941+0000 (oldest deadline 2024-09-19T06:11:32.476734+0000) 2024-09-19T06:11:40.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:40 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:40.047+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-19T06:11:12.477356+0000 front 2024-09-19T06:11:12.477255+0000 (oldest deadline 2024-09-19T06:11:37.177127+0000) 2024-09-19T06:11:40.499 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:40 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:40.125+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.243477+0000 front 2024-09-19T06:10:25.243671+0000 (oldest deadline 2024-09-19T06:10:50.543575+0000) 2024-09-19T06:11:40.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:40 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:40.125+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:40.846622+0000 front 2024-09-19T06:10:40.846471+0000 (oldest deadline 2024-09-19T06:11:05.546652+0000) 2024-09-19T06:11:40.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:40 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:40.125+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:50.847827+0000 front 2024-09-19T06:10:50.847888+0000 (oldest deadline 2024-09-19T06:11:14.347890+0000) 2024-09-19T06:11:40.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:40 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:40.125+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:10:57.849182+0000 front 2024-09-19T06:10:57.849209+0000 (oldest deadline 2024-09-19T06:11:21.348954+0000) 2024-09-19T06:11:40.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:40 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:40.125+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6812 osd.5 since back 2024-09-19T06:11:06.550320+0000 front 2024-09-19T06:11:06.550371+0000 (oldest deadline 2024-09-19T06:11:30.650457+0000) 2024-09-19T06:11:40.818 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:40 smithi037 podman[88279]: 2024-09-19 06:11:40.521268363 +0000 UTC m=+5.563631389 container died edb926ddda6bd43358e785dd5d81afc920f8efbb55494c4a9d0714edc1eecaaf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:11:41.074 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:40 smithi037 podman[88279]: 2024-09-19 06:11:40.974740745 +0000 UTC m=+6.017103804 container cleanup edb926ddda6bd43358e785dd5d81afc920f8efbb55494c4a9d0714edc1eecaaf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:11:41.074 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:40 smithi037 bash[88279]: ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9 2024-09-19T06:11:41.441 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:41 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:41.051+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:24.169913+0000 front 2024-09-19T06:10:24.169648+0000 (oldest deadline 2024-09-19T06:10:48.869512+0000) 2024-09-19T06:11:41.441 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:41 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:41.051+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:35.771330+0000 front 2024-09-19T06:10:35.771421+0000 (oldest deadline 2024-09-19T06:10:59.871528+0000) 2024-09-19T06:11:41.441 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:41 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:41.051+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:39.871942+0000 front 2024-09-19T06:10:39.871906+0000 (oldest deadline 2024-09-19T06:11:10.472425+0000) 2024-09-19T06:11:41.441 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:41 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:41.051+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:51.573543+0000 front 2024-09-19T06:10:51.573591+0000 (oldest deadline 2024-09-19T06:11:13.873555+0000) 2024-09-19T06:11:41.441 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:41 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:41.051+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:11:00.175701+0000 front 2024-09-19T06:11:00.175670+0000 (oldest deadline 2024-09-19T06:11:23.675762+0000) 2024-09-19T06:11:41.441 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:41 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:41.051+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.117:6812 osd.5 since back 2024-09-19T06:11:06.576854+0000 front 2024-09-19T06:11:06.576941+0000 (oldest deadline 2024-09-19T06:11:32.476734+0000) 2024-09-19T06:11:41.441 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:41 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:41.051+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-19T06:11:12.477356+0000 front 2024-09-19T06:11:12.477255+0000 (oldest deadline 2024-09-19T06:11:37.177127+0000) 2024-09-19T06:11:41.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:41 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:41.152+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.243477+0000 front 2024-09-19T06:10:25.243671+0000 (oldest deadline 2024-09-19T06:10:50.543575+0000) 2024-09-19T06:11:41.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:41 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:41.152+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:40.846622+0000 front 2024-09-19T06:10:40.846471+0000 (oldest deadline 2024-09-19T06:11:05.546652+0000) 2024-09-19T06:11:41.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:41 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:41.152+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:50.847827+0000 front 2024-09-19T06:10:50.847888+0000 (oldest deadline 2024-09-19T06:11:14.347890+0000) 2024-09-19T06:11:41.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:41 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:41.152+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:10:57.849182+0000 front 2024-09-19T06:10:57.849209+0000 (oldest deadline 2024-09-19T06:11:21.348954+0000) 2024-09-19T06:11:41.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:41 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:41.152+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6812 osd.5 since back 2024-09-19T06:11:06.550320+0000 front 2024-09-19T06:11:06.550371+0000 (oldest deadline 2024-09-19T06:11:30.650457+0000) 2024-09-19T06:11:41.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:41 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:41.152+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-19T06:11:16.452033+0000 front 2024-09-19T06:11:16.452015+0000 (oldest deadline 2024-09-19T06:11:40.551790+0000) 2024-09-19T06:11:41.573 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:41 smithi037 podman[88296]: 2024-09-19 06:11:41.242705472 +0000 UTC m=+0.719863441 container remove edb926ddda6bd43358e785dd5d81afc920f8efbb55494c4a9d0714edc1eecaaf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-19T06:11:41.857 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:41 smithi037 podman[88388]: 2024-09-19 06:11:41.507609754 +0000 UTC m=+0.016651107 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:11:41.857 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:41 smithi037 podman[88388]: 2024-09-19 06:11:41.618415574 +0000 UTC m=+0.127456969 container create ad34c76e1da5bd01587bc792dc30978d013365d6b078020489138084124d7060 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:11:42.324 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:41 smithi037 podman[88388]: 2024-09-19 06:11:41.953836623 +0000 UTC m=+0.462877984 container init ad34c76e1da5bd01587bc792dc30978d013365d6b078020489138084124d7060 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9-deactivate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4) 2024-09-19T06:11:42.324 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:41 smithi037 podman[88388]: 2024-09-19 06:11:41.957196193 +0000 UTC m=+0.466237551 container start ad34c76e1da5bd01587bc792dc30978d013365d6b078020489138084124d7060 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9-deactivate, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-19T06:11:42.324 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:42 smithi037 podman[88388]: 2024-09-19 06:11:42.037140948 +0000 UTC m=+0.546182312 container attach ad34c76e1da5bd01587bc792dc30978d013365d6b078020489138084124d7060 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:11:42.325 INFO:journalctl@ceph.osd.9.smithi037.stdout:Sep 19 06:11:42 smithi037 podman[88388]: 2024-09-19 06:11:42.148519283 +0000 UTC m=+0.657560637 container died ad34c76e1da5bd01587bc792dc30978d013365d6b078020489138084124d7060 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4) 2024-09-19T06:11:42.438 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:42 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:42.061+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:24.169913+0000 front 2024-09-19T06:10:24.169648+0000 (oldest deadline 2024-09-19T06:10:48.869512+0000) 2024-09-19T06:11:42.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:42 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:42.061+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:35.771330+0000 front 2024-09-19T06:10:35.771421+0000 (oldest deadline 2024-09-19T06:10:59.871528+0000) 2024-09-19T06:11:42.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:42 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:42.061+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:39.871942+0000 front 2024-09-19T06:10:39.871906+0000 (oldest deadline 2024-09-19T06:11:10.472425+0000) 2024-09-19T06:11:42.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:42 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:42.061+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:51.573543+0000 front 2024-09-19T06:10:51.573591+0000 (oldest deadline 2024-09-19T06:11:13.873555+0000) 2024-09-19T06:11:42.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:42 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:42.061+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:11:00.175701+0000 front 2024-09-19T06:11:00.175670+0000 (oldest deadline 2024-09-19T06:11:23.675762+0000) 2024-09-19T06:11:42.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:42 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:42.061+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.117:6812 osd.5 since back 2024-09-19T06:11:06.576854+0000 front 2024-09-19T06:11:06.576941+0000 (oldest deadline 2024-09-19T06:11:32.476734+0000) 2024-09-19T06:11:42.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:42 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:42.061+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-19T06:11:12.477356+0000 front 2024-09-19T06:11:12.477255+0000 (oldest deadline 2024-09-19T06:11:37.177127+0000) 2024-09-19T06:11:42.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:42 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:42.159+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.243477+0000 front 2024-09-19T06:10:25.243671+0000 (oldest deadline 2024-09-19T06:10:50.543575+0000) 2024-09-19T06:11:42.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:42 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:42.159+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:40.846622+0000 front 2024-09-19T06:10:40.846471+0000 (oldest deadline 2024-09-19T06:11:05.546652+0000) 2024-09-19T06:11:42.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:42 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:42.159+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:50.847827+0000 front 2024-09-19T06:10:50.847888+0000 (oldest deadline 2024-09-19T06:11:14.347890+0000) 2024-09-19T06:11:42.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:42 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:42.159+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:10:57.849182+0000 front 2024-09-19T06:10:57.849209+0000 (oldest deadline 2024-09-19T06:11:21.348954+0000) 2024-09-19T06:11:42.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:42 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:42.159+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6812 osd.5 since back 2024-09-19T06:11:06.550320+0000 front 2024-09-19T06:11:06.550371+0000 (oldest deadline 2024-09-19T06:11:30.650457+0000) 2024-09-19T06:11:42.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:42 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:42.159+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-19T06:11:16.452033+0000 front 2024-09-19T06:11:16.452015+0000 (oldest deadline 2024-09-19T06:11:40.551790+0000) 2024-09-19T06:11:42.846 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@osd.9.service' 2024-09-19T06:11:42.930 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:11:42.931 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-19T06:11:42.931 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-19T06:11:42.931 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@osd.10 2024-09-19T06:11:43.232 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:42 smithi099 systemd[1]: Stopping Ceph osd.10 for b8c8bdae-764b-11ef-bceb-c7b262605968... 2024-09-19T06:11:43.233 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:43 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:43.036+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:24.169913+0000 front 2024-09-19T06:10:24.169648+0000 (oldest deadline 2024-09-19T06:10:48.869512+0000) 2024-09-19T06:11:43.233 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:43 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:43.036+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:35.771330+0000 front 2024-09-19T06:10:35.771421+0000 (oldest deadline 2024-09-19T06:10:59.871528+0000) 2024-09-19T06:11:43.233 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:43 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:43.036+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:39.871942+0000 front 2024-09-19T06:10:39.871906+0000 (oldest deadline 2024-09-19T06:11:10.472425+0000) 2024-09-19T06:11:43.233 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:43 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:43.036+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:51.573543+0000 front 2024-09-19T06:10:51.573591+0000 (oldest deadline 2024-09-19T06:11:13.873555+0000) 2024-09-19T06:11:43.233 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:43 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:43.036+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:11:00.175701+0000 front 2024-09-19T06:11:00.175670+0000 (oldest deadline 2024-09-19T06:11:23.675762+0000) 2024-09-19T06:11:43.233 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:43 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:43.036+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.117:6812 osd.5 since back 2024-09-19T06:11:06.576854+0000 front 2024-09-19T06:11:06.576941+0000 (oldest deadline 2024-09-19T06:11:32.476734+0000) 2024-09-19T06:11:43.233 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:43 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:43.036+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-19T06:11:12.477356+0000 front 2024-09-19T06:11:12.477255+0000 (oldest deadline 2024-09-19T06:11:37.177127+0000) 2024-09-19T06:11:43.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:43 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:43.143+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.243477+0000 front 2024-09-19T06:10:25.243671+0000 (oldest deadline 2024-09-19T06:10:50.543575+0000) 2024-09-19T06:11:43.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:43 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:43.143+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:40.846622+0000 front 2024-09-19T06:10:40.846471+0000 (oldest deadline 2024-09-19T06:11:05.546652+0000) 2024-09-19T06:11:43.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:43 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:43.143+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:50.847827+0000 front 2024-09-19T06:10:50.847888+0000 (oldest deadline 2024-09-19T06:11:14.347890+0000) 2024-09-19T06:11:43.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:43 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:43.143+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:10:57.849182+0000 front 2024-09-19T06:10:57.849209+0000 (oldest deadline 2024-09-19T06:11:21.348954+0000) 2024-09-19T06:11:43.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:43 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:43.143+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6812 osd.5 since back 2024-09-19T06:11:06.550320+0000 front 2024-09-19T06:11:06.550371+0000 (oldest deadline 2024-09-19T06:11:30.650457+0000) 2024-09-19T06:11:43.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:43 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:43.143+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-19T06:11:16.452033+0000 front 2024-09-19T06:11:16.452015+0000 (oldest deadline 2024-09-19T06:11:40.551790+0000) 2024-09-19T06:11:43.688 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:43 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:43.230+0000 7fc16e56e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:11:43.688 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:43 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:43.230+0000 7fc16e56e640 -1 osd.10 95 *** Got signal Terminated *** 2024-09-19T06:11:43.688 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:43 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:43.230+0000 7fc16e56e640 -1 osd.10 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:11:44.438 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:44 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:44.083+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:24.169913+0000 front 2024-09-19T06:10:24.169648+0000 (oldest deadline 2024-09-19T06:10:48.869512+0000) 2024-09-19T06:11:44.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:44 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:44.083+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:35.771330+0000 front 2024-09-19T06:10:35.771421+0000 (oldest deadline 2024-09-19T06:10:59.871528+0000) 2024-09-19T06:11:44.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:44 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:44.083+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:39.871942+0000 front 2024-09-19T06:10:39.871906+0000 (oldest deadline 2024-09-19T06:11:10.472425+0000) 2024-09-19T06:11:44.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:44 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:44.083+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:51.573543+0000 front 2024-09-19T06:10:51.573591+0000 (oldest deadline 2024-09-19T06:11:13.873555+0000) 2024-09-19T06:11:44.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:44 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:44.083+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:11:00.175701+0000 front 2024-09-19T06:11:00.175670+0000 (oldest deadline 2024-09-19T06:11:23.675762+0000) 2024-09-19T06:11:44.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:44 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:44.083+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.117:6812 osd.5 since back 2024-09-19T06:11:06.576854+0000 front 2024-09-19T06:11:06.576941+0000 (oldest deadline 2024-09-19T06:11:32.476734+0000) 2024-09-19T06:11:44.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:44 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:44.083+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-19T06:11:12.477356+0000 front 2024-09-19T06:11:12.477255+0000 (oldest deadline 2024-09-19T06:11:37.177127+0000) 2024-09-19T06:11:44.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:44 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:44.138+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.243477+0000 front 2024-09-19T06:10:25.243671+0000 (oldest deadline 2024-09-19T06:10:50.543575+0000) 2024-09-19T06:11:44.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:44 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:44.138+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:40.846622+0000 front 2024-09-19T06:10:40.846471+0000 (oldest deadline 2024-09-19T06:11:05.546652+0000) 2024-09-19T06:11:44.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:44 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:44.138+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:50.847827+0000 front 2024-09-19T06:10:50.847888+0000 (oldest deadline 2024-09-19T06:11:14.347890+0000) 2024-09-19T06:11:44.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:44 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:44.138+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:10:57.849182+0000 front 2024-09-19T06:10:57.849209+0000 (oldest deadline 2024-09-19T06:11:21.348954+0000) 2024-09-19T06:11:44.501 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:44 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:44.138+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6812 osd.5 since back 2024-09-19T06:11:06.550320+0000 front 2024-09-19T06:11:06.550371+0000 (oldest deadline 2024-09-19T06:11:30.650457+0000) 2024-09-19T06:11:44.501 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:44 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:44.138+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-19T06:11:16.452033+0000 front 2024-09-19T06:11:16.452015+0000 (oldest deadline 2024-09-19T06:11:40.551790+0000) 2024-09-19T06:11:45.438 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:45 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:45.053+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:24.169913+0000 front 2024-09-19T06:10:24.169648+0000 (oldest deadline 2024-09-19T06:10:48.869512+0000) 2024-09-19T06:11:45.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:45 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:45.053+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:35.771330+0000 front 2024-09-19T06:10:35.771421+0000 (oldest deadline 2024-09-19T06:10:59.871528+0000) 2024-09-19T06:11:45.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:45 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:45.053+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:39.871942+0000 front 2024-09-19T06:10:39.871906+0000 (oldest deadline 2024-09-19T06:11:10.472425+0000) 2024-09-19T06:11:45.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:45 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:45.053+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:51.573543+0000 front 2024-09-19T06:10:51.573591+0000 (oldest deadline 2024-09-19T06:11:13.873555+0000) 2024-09-19T06:11:45.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:45 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:45.053+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:11:00.175701+0000 front 2024-09-19T06:11:00.175670+0000 (oldest deadline 2024-09-19T06:11:23.675762+0000) 2024-09-19T06:11:45.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:45 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:45.053+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.117:6812 osd.5 since back 2024-09-19T06:11:06.576854+0000 front 2024-09-19T06:11:06.576941+0000 (oldest deadline 2024-09-19T06:11:32.476734+0000) 2024-09-19T06:11:45.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:45 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:45.053+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-19T06:11:12.477356+0000 front 2024-09-19T06:11:12.477255+0000 (oldest deadline 2024-09-19T06:11:37.177127+0000) 2024-09-19T06:11:45.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:45 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:45.113+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.243477+0000 front 2024-09-19T06:10:25.243671+0000 (oldest deadline 2024-09-19T06:10:50.543575+0000) 2024-09-19T06:11:45.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:45 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:45.113+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:40.846622+0000 front 2024-09-19T06:10:40.846471+0000 (oldest deadline 2024-09-19T06:11:05.546652+0000) 2024-09-19T06:11:45.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:45 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:45.113+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:50.847827+0000 front 2024-09-19T06:10:50.847888+0000 (oldest deadline 2024-09-19T06:11:14.347890+0000) 2024-09-19T06:11:45.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:45 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:45.113+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:10:57.849182+0000 front 2024-09-19T06:10:57.849209+0000 (oldest deadline 2024-09-19T06:11:21.348954+0000) 2024-09-19T06:11:45.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:45 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:45.113+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6812 osd.5 since back 2024-09-19T06:11:06.550320+0000 front 2024-09-19T06:11:06.550371+0000 (oldest deadline 2024-09-19T06:11:30.650457+0000) 2024-09-19T06:11:45.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:45 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:45.113+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-19T06:11:16.452033+0000 front 2024-09-19T06:11:16.452015+0000 (oldest deadline 2024-09-19T06:11:40.551790+0000) 2024-09-19T06:11:46.438 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:46 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:46.093+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:24.169913+0000 front 2024-09-19T06:10:24.169648+0000 (oldest deadline 2024-09-19T06:10:48.869512+0000) 2024-09-19T06:11:46.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:46 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:46.093+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:35.771330+0000 front 2024-09-19T06:10:35.771421+0000 (oldest deadline 2024-09-19T06:10:59.871528+0000) 2024-09-19T06:11:46.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:46 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:46.093+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:39.871942+0000 front 2024-09-19T06:10:39.871906+0000 (oldest deadline 2024-09-19T06:11:10.472425+0000) 2024-09-19T06:11:46.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:46 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:46.093+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:51.573543+0000 front 2024-09-19T06:10:51.573591+0000 (oldest deadline 2024-09-19T06:11:13.873555+0000) 2024-09-19T06:11:46.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:46 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:46.093+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:11:00.175701+0000 front 2024-09-19T06:11:00.175670+0000 (oldest deadline 2024-09-19T06:11:23.675762+0000) 2024-09-19T06:11:46.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:46 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:46.093+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.117:6812 osd.5 since back 2024-09-19T06:11:06.576854+0000 front 2024-09-19T06:11:06.576941+0000 (oldest deadline 2024-09-19T06:11:32.476734+0000) 2024-09-19T06:11:46.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:46 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:46.093+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-19T06:11:12.477356+0000 front 2024-09-19T06:11:12.477255+0000 (oldest deadline 2024-09-19T06:11:37.177127+0000) 2024-09-19T06:11:46.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:46 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:46.152+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.243477+0000 front 2024-09-19T06:10:25.243671+0000 (oldest deadline 2024-09-19T06:10:50.543575+0000) 2024-09-19T06:11:46.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:46 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:46.152+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:40.846622+0000 front 2024-09-19T06:10:40.846471+0000 (oldest deadline 2024-09-19T06:11:05.546652+0000) 2024-09-19T06:11:46.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:46 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:46.152+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:50.847827+0000 front 2024-09-19T06:10:50.847888+0000 (oldest deadline 2024-09-19T06:11:14.347890+0000) 2024-09-19T06:11:46.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:46 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:46.152+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:10:57.849182+0000 front 2024-09-19T06:10:57.849209+0000 (oldest deadline 2024-09-19T06:11:21.348954+0000) 2024-09-19T06:11:46.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:46 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:46.152+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6812 osd.5 since back 2024-09-19T06:11:06.550320+0000 front 2024-09-19T06:11:06.550371+0000 (oldest deadline 2024-09-19T06:11:30.650457+0000) 2024-09-19T06:11:46.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:46 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:46.152+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-19T06:11:16.452033+0000 front 2024-09-19T06:11:16.452015+0000 (oldest deadline 2024-09-19T06:11:40.551790+0000) 2024-09-19T06:11:46.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:46 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:46.152+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.99:6820 osd.7 since back 2024-09-19T06:11:21.652873+0000 front 2024-09-19T06:11:21.652952+0000 (oldest deadline 2024-09-19T06:11:45.152825+0000) 2024-09-19T06:11:47.438 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:47 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:47.056+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:24.169913+0000 front 2024-09-19T06:10:24.169648+0000 (oldest deadline 2024-09-19T06:10:48.869512+0000) 2024-09-19T06:11:47.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:47 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:47.056+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:35.771330+0000 front 2024-09-19T06:10:35.771421+0000 (oldest deadline 2024-09-19T06:10:59.871528+0000) 2024-09-19T06:11:47.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:47 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:47.056+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:39.871942+0000 front 2024-09-19T06:10:39.871906+0000 (oldest deadline 2024-09-19T06:11:10.472425+0000) 2024-09-19T06:11:47.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:47 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:47.056+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:51.573543+0000 front 2024-09-19T06:10:51.573591+0000 (oldest deadline 2024-09-19T06:11:13.873555+0000) 2024-09-19T06:11:47.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:47 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:47.056+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:11:00.175701+0000 front 2024-09-19T06:11:00.175670+0000 (oldest deadline 2024-09-19T06:11:23.675762+0000) 2024-09-19T06:11:47.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:47 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:47.056+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.117:6812 osd.5 since back 2024-09-19T06:11:06.576854+0000 front 2024-09-19T06:11:06.576941+0000 (oldest deadline 2024-09-19T06:11:32.476734+0000) 2024-09-19T06:11:47.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:47 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:47.056+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-19T06:11:12.477356+0000 front 2024-09-19T06:11:12.477255+0000 (oldest deadline 2024-09-19T06:11:37.177127+0000) 2024-09-19T06:11:47.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:47 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:47.164+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.243477+0000 front 2024-09-19T06:10:25.243671+0000 (oldest deadline 2024-09-19T06:10:50.543575+0000) 2024-09-19T06:11:47.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:47 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:47.164+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:40.846622+0000 front 2024-09-19T06:10:40.846471+0000 (oldest deadline 2024-09-19T06:11:05.546652+0000) 2024-09-19T06:11:47.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:47 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:47.164+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:50.847827+0000 front 2024-09-19T06:10:50.847888+0000 (oldest deadline 2024-09-19T06:11:14.347890+0000) 2024-09-19T06:11:47.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:47 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:47.164+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:10:57.849182+0000 front 2024-09-19T06:10:57.849209+0000 (oldest deadline 2024-09-19T06:11:21.348954+0000) 2024-09-19T06:11:47.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:47 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:47.164+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6812 osd.5 since back 2024-09-19T06:11:06.550320+0000 front 2024-09-19T06:11:06.550371+0000 (oldest deadline 2024-09-19T06:11:30.650457+0000) 2024-09-19T06:11:47.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:47 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:47.164+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-19T06:11:16.452033+0000 front 2024-09-19T06:11:16.452015+0000 (oldest deadline 2024-09-19T06:11:40.551790+0000) 2024-09-19T06:11:47.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:47 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:47.164+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.99:6820 osd.7 since back 2024-09-19T06:11:21.652873+0000 front 2024-09-19T06:11:21.652952+0000 (oldest deadline 2024-09-19T06:11:45.152825+0000) 2024-09-19T06:11:48.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:48 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:48.067+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:24.169913+0000 front 2024-09-19T06:10:24.169648+0000 (oldest deadline 2024-09-19T06:10:48.869512+0000) 2024-09-19T06:11:48.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:48 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:48.067+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T06:10:35.771330+0000 front 2024-09-19T06:10:35.771421+0000 (oldest deadline 2024-09-19T06:10:59.871528+0000) 2024-09-19T06:11:48.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:48 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:48.067+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:39.871942+0000 front 2024-09-19T06:10:39.871906+0000 (oldest deadline 2024-09-19T06:11:10.472425+0000) 2024-09-19T06:11:48.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:48 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:48.067+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:51.573543+0000 front 2024-09-19T06:10:51.573591+0000 (oldest deadline 2024-09-19T06:11:13.873555+0000) 2024-09-19T06:11:48.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:48 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:48.067+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:11:00.175701+0000 front 2024-09-19T06:11:00.175670+0000 (oldest deadline 2024-09-19T06:11:23.675762+0000) 2024-09-19T06:11:48.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:48 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:48.067+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.117:6812 osd.5 since back 2024-09-19T06:11:06.576854+0000 front 2024-09-19T06:11:06.576941+0000 (oldest deadline 2024-09-19T06:11:32.476734+0000) 2024-09-19T06:11:48.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:48 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10[60151]: 2024-09-19T06:11:48.067+0000 7fc166b7c640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-19T06:11:12.477356+0000 front 2024-09-19T06:11:12.477255+0000 (oldest deadline 2024-09-19T06:11:37.177127+0000) 2024-09-19T06:11:48.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:48 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:48.192+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.243477+0000 front 2024-09-19T06:10:25.243671+0000 (oldest deadline 2024-09-19T06:10:50.543575+0000) 2024-09-19T06:11:48.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:48 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:48.192+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:40.846622+0000 front 2024-09-19T06:10:40.846471+0000 (oldest deadline 2024-09-19T06:11:05.546652+0000) 2024-09-19T06:11:48.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:48 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:48.192+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:50.847827+0000 front 2024-09-19T06:10:50.847888+0000 (oldest deadline 2024-09-19T06:11:14.347890+0000) 2024-09-19T06:11:48.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:48 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:48.192+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:10:57.849182+0000 front 2024-09-19T06:10:57.849209+0000 (oldest deadline 2024-09-19T06:11:21.348954+0000) 2024-09-19T06:11:48.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:48 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:48.192+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6812 osd.5 since back 2024-09-19T06:11:06.550320+0000 front 2024-09-19T06:11:06.550371+0000 (oldest deadline 2024-09-19T06:11:30.650457+0000) 2024-09-19T06:11:48.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:48 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:48.192+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-19T06:11:16.452033+0000 front 2024-09-19T06:11:16.452015+0000 (oldest deadline 2024-09-19T06:11:40.551790+0000) 2024-09-19T06:11:48.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:48 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:48.192+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.99:6820 osd.7 since back 2024-09-19T06:11:21.652873+0000 front 2024-09-19T06:11:21.652952+0000 (oldest deadline 2024-09-19T06:11:45.152825+0000) 2024-09-19T06:11:48.938 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:48 smithi099 podman[68719]: 2024-09-19 06:11:48.6666506 +0000 UTC m=+5.541235610 container died 15900c6330fc2e92daafe1e63d08a075c7f9185d0639614d5fe169a074df16de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=) 2024-09-19T06:11:49.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:49 smithi099 podman[68719]: 2024-09-19 06:11:49.005182698 +0000 UTC m=+5.879767715 container cleanup 15900c6330fc2e92daafe1e63d08a075c7f9185d0639614d5fe169a074df16de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4) 2024-09-19T06:11:49.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:49 smithi099 bash[68719]: ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10 2024-09-19T06:11:49.439 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:49 smithi099 podman[68735]: 2024-09-19 06:11:49.148107097 +0000 UTC m=+0.481301200 container remove 15900c6330fc2e92daafe1e63d08a075c7f9185d0639614d5fe169a074df16de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-2f599a4) 2024-09-19T06:11:49.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:49 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:49.158+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.243477+0000 front 2024-09-19T06:10:25.243671+0000 (oldest deadline 2024-09-19T06:10:50.543575+0000) 2024-09-19T06:11:49.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:49 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:49.158+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:40.846622+0000 front 2024-09-19T06:10:40.846471+0000 (oldest deadline 2024-09-19T06:11:05.546652+0000) 2024-09-19T06:11:49.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:49 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:49.158+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:50.847827+0000 front 2024-09-19T06:10:50.847888+0000 (oldest deadline 2024-09-19T06:11:14.347890+0000) 2024-09-19T06:11:49.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:49 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:49.158+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:10:57.849182+0000 front 2024-09-19T06:10:57.849209+0000 (oldest deadline 2024-09-19T06:11:21.348954+0000) 2024-09-19T06:11:49.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:49 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:49.158+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6812 osd.5 since back 2024-09-19T06:11:06.550320+0000 front 2024-09-19T06:11:06.550371+0000 (oldest deadline 2024-09-19T06:11:30.650457+0000) 2024-09-19T06:11:49.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:49 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:49.158+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-19T06:11:16.452033+0000 front 2024-09-19T06:11:16.452015+0000 (oldest deadline 2024-09-19T06:11:40.551790+0000) 2024-09-19T06:11:49.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:49 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:49.158+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.99:6820 osd.7 since back 2024-09-19T06:11:21.652873+0000 front 2024-09-19T06:11:21.652952+0000 (oldest deadline 2024-09-19T06:11:45.152825+0000) 2024-09-19T06:11:49.793 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:49 smithi099 podman[68827]: 2024-09-19 06:11:49.540538507 +0000 UTC m=+0.092101949 container create 3157a33d2d924aaf6b75f3d1bd66e18f82172ffed7a6c357f1228c73ff3b257d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-19T06:11:49.794 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:49 smithi099 podman[68827]: 2024-09-19 06:11:49.46396981 +0000 UTC m=+0.015533268 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:11:49.794 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:49 smithi099 podman[68827]: 2024-09-19 06:11:49.792902171 +0000 UTC m=+0.344465616 container init 3157a33d2d924aaf6b75f3d1bd66e18f82172ffed7a6c357f1228c73ff3b257d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:11:50.189 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:49 smithi099 podman[68827]: 2024-09-19 06:11:49.796126457 +0000 UTC m=+0.347689904 container start 3157a33d2d924aaf6b75f3d1bd66e18f82172ffed7a6c357f1228c73ff3b257d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-19T06:11:50.189 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:49 smithi099 podman[68827]: 2024-09-19 06:11:49.901155603 +0000 UTC m=+0.452719059 container attach 3157a33d2d924aaf6b75f3d1bd66e18f82172ffed7a6c357f1228c73ff3b257d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10-deactivate, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD) 2024-09-19T06:11:50.189 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:49 smithi099 podman[68827]: 2024-09-19 06:11:49.993277751 +0000 UTC m=+0.544841211 container died 3157a33d2d924aaf6b75f3d1bd66e18f82172ffed7a6c357f1228c73ff3b257d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10-deactivate, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=) 2024-09-19T06:11:50.499 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:50 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:50.139+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.243477+0000 front 2024-09-19T06:10:25.243671+0000 (oldest deadline 2024-09-19T06:10:50.543575+0000) 2024-09-19T06:11:50.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:50 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:50.139+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:40.846622+0000 front 2024-09-19T06:10:40.846471+0000 (oldest deadline 2024-09-19T06:11:05.546652+0000) 2024-09-19T06:11:50.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:50 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:50.139+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:50.847827+0000 front 2024-09-19T06:10:50.847888+0000 (oldest deadline 2024-09-19T06:11:14.347890+0000) 2024-09-19T06:11:50.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:50 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:50.139+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:10:57.849182+0000 front 2024-09-19T06:10:57.849209+0000 (oldest deadline 2024-09-19T06:11:21.348954+0000) 2024-09-19T06:11:50.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:50 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:50.139+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6812 osd.5 since back 2024-09-19T06:11:06.550320+0000 front 2024-09-19T06:11:06.550371+0000 (oldest deadline 2024-09-19T06:11:30.650457+0000) 2024-09-19T06:11:50.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:50 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:50.139+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-19T06:11:16.452033+0000 front 2024-09-19T06:11:16.452015+0000 (oldest deadline 2024-09-19T06:11:40.551790+0000) 2024-09-19T06:11:50.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:50 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:50.139+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.99:6820 osd.7 since back 2024-09-19T06:11:21.652873+0000 front 2024-09-19T06:11:21.652952+0000 (oldest deadline 2024-09-19T06:11:45.152825+0000) 2024-09-19T06:11:50.516 DEBUG:teuthology.orchestra.run.smithi099:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@osd.10.service' 2024-09-19T06:11:50.539 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:50 smithi099 podman[68850]: 2024-09-19 06:11:50.496283457 +0000 UTC m=+0.496788264 container remove 3157a33d2d924aaf6b75f3d1bd66e18f82172ffed7a6c357f1228c73ff3b257d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-10-deactivate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2) 2024-09-19T06:11:50.539 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:50 smithi099 systemd[1]: ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@osd.10.service: Deactivated successfully. 2024-09-19T06:11:50.539 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:50 smithi099 systemd[1]: Stopped Ceph osd.10 for b8c8bdae-764b-11ef-bceb-c7b262605968. 2024-09-19T06:11:50.539 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 06:11:50 smithi099 systemd[1]: ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@osd.10.service: Consumed 19.007s CPU time. 2024-09-19T06:11:50.554 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:11:50.554 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-19T06:11:50.555 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-19T06:11:50.555 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@osd.11 2024-09-19T06:11:50.856 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:50 smithi117 systemd[1]: Stopping Ceph osd.11 for b8c8bdae-764b-11ef-bceb-c7b262605968... 2024-09-19T06:11:51.156 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:50 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:50.853+0000 7fa3ed2a8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:11:51.156 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:50 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:50.853+0000 7fa3ed2a8640 -1 osd.11 95 *** Got signal Terminated *** 2024-09-19T06:11:51.156 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:50 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:50.853+0000 7fa3ed2a8640 -1 osd.11 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:11:51.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:51 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:51.155+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.243477+0000 front 2024-09-19T06:10:25.243671+0000 (oldest deadline 2024-09-19T06:10:50.543575+0000) 2024-09-19T06:11:51.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:51 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:51.155+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:40.846622+0000 front 2024-09-19T06:10:40.846471+0000 (oldest deadline 2024-09-19T06:11:05.546652+0000) 2024-09-19T06:11:51.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:51 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:51.155+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:50.847827+0000 front 2024-09-19T06:10:50.847888+0000 (oldest deadline 2024-09-19T06:11:14.347890+0000) 2024-09-19T06:11:51.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:51 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:51.155+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:10:57.849182+0000 front 2024-09-19T06:10:57.849209+0000 (oldest deadline 2024-09-19T06:11:21.348954+0000) 2024-09-19T06:11:51.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:51 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:51.155+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6812 osd.5 since back 2024-09-19T06:11:06.550320+0000 front 2024-09-19T06:11:06.550371+0000 (oldest deadline 2024-09-19T06:11:30.650457+0000) 2024-09-19T06:11:51.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:51 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:51.155+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-19T06:11:16.452033+0000 front 2024-09-19T06:11:16.452015+0000 (oldest deadline 2024-09-19T06:11:40.551790+0000) 2024-09-19T06:11:51.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:51 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:51.155+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.99:6820 osd.7 since back 2024-09-19T06:11:21.652873+0000 front 2024-09-19T06:11:21.652952+0000 (oldest deadline 2024-09-19T06:11:45.152825+0000) 2024-09-19T06:11:52.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:52 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:52.200+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.243477+0000 front 2024-09-19T06:10:25.243671+0000 (oldest deadline 2024-09-19T06:10:50.543575+0000) 2024-09-19T06:11:52.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:52 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:52.200+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:40.846622+0000 front 2024-09-19T06:10:40.846471+0000 (oldest deadline 2024-09-19T06:11:05.546652+0000) 2024-09-19T06:11:52.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:52 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:52.200+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:50.847827+0000 front 2024-09-19T06:10:50.847888+0000 (oldest deadline 2024-09-19T06:11:14.347890+0000) 2024-09-19T06:11:52.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:52 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:52.200+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:10:57.849182+0000 front 2024-09-19T06:10:57.849209+0000 (oldest deadline 2024-09-19T06:11:21.348954+0000) 2024-09-19T06:11:52.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:52 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:52.200+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6812 osd.5 since back 2024-09-19T06:11:06.550320+0000 front 2024-09-19T06:11:06.550371+0000 (oldest deadline 2024-09-19T06:11:30.650457+0000) 2024-09-19T06:11:52.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:52 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:52.200+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-19T06:11:16.452033+0000 front 2024-09-19T06:11:16.452015+0000 (oldest deadline 2024-09-19T06:11:40.551790+0000) 2024-09-19T06:11:52.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:52 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:52.200+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.99:6820 osd.7 since back 2024-09-19T06:11:21.652873+0000 front 2024-09-19T06:11:21.652952+0000 (oldest deadline 2024-09-19T06:11:45.152825+0000) 2024-09-19T06:11:53.499 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:53 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:53.157+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.243477+0000 front 2024-09-19T06:10:25.243671+0000 (oldest deadline 2024-09-19T06:10:50.543575+0000) 2024-09-19T06:11:53.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:53 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:53.157+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:40.846622+0000 front 2024-09-19T06:10:40.846471+0000 (oldest deadline 2024-09-19T06:11:05.546652+0000) 2024-09-19T06:11:53.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:53 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:53.157+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:50.847827+0000 front 2024-09-19T06:10:50.847888+0000 (oldest deadline 2024-09-19T06:11:14.347890+0000) 2024-09-19T06:11:53.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:53 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:53.157+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:10:57.849182+0000 front 2024-09-19T06:10:57.849209+0000 (oldest deadline 2024-09-19T06:11:21.348954+0000) 2024-09-19T06:11:53.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:53 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:53.157+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6812 osd.5 since back 2024-09-19T06:11:06.550320+0000 front 2024-09-19T06:11:06.550371+0000 (oldest deadline 2024-09-19T06:11:30.650457+0000) 2024-09-19T06:11:53.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:53 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:53.157+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-19T06:11:16.452033+0000 front 2024-09-19T06:11:16.452015+0000 (oldest deadline 2024-09-19T06:11:40.551790+0000) 2024-09-19T06:11:53.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:53 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:53.157+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.99:6820 osd.7 since back 2024-09-19T06:11:21.652873+0000 front 2024-09-19T06:11:21.652952+0000 (oldest deadline 2024-09-19T06:11:45.152825+0000) 2024-09-19T06:11:53.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:53 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:53.157+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6820 osd.8 since back 2024-09-19T06:11:30.953759+0000 front 2024-09-19T06:11:30.953790+0000 (oldest deadline 2024-09-19T06:11:52.653859+0000) 2024-09-19T06:11:54.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:54 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:54.135+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.243477+0000 front 2024-09-19T06:10:25.243671+0000 (oldest deadline 2024-09-19T06:10:50.543575+0000) 2024-09-19T06:11:54.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:54 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:54.135+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:40.846622+0000 front 2024-09-19T06:10:40.846471+0000 (oldest deadline 2024-09-19T06:11:05.546652+0000) 2024-09-19T06:11:54.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:54 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:54.135+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:50.847827+0000 front 2024-09-19T06:10:50.847888+0000 (oldest deadline 2024-09-19T06:11:14.347890+0000) 2024-09-19T06:11:54.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:54 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:54.135+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:10:57.849182+0000 front 2024-09-19T06:10:57.849209+0000 (oldest deadline 2024-09-19T06:11:21.348954+0000) 2024-09-19T06:11:54.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:54 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:54.135+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6812 osd.5 since back 2024-09-19T06:11:06.550320+0000 front 2024-09-19T06:11:06.550371+0000 (oldest deadline 2024-09-19T06:11:30.650457+0000) 2024-09-19T06:11:54.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:54 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:54.135+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-19T06:11:16.452033+0000 front 2024-09-19T06:11:16.452015+0000 (oldest deadline 2024-09-19T06:11:40.551790+0000) 2024-09-19T06:11:54.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:54 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:54.135+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.99:6820 osd.7 since back 2024-09-19T06:11:21.652873+0000 front 2024-09-19T06:11:21.652952+0000 (oldest deadline 2024-09-19T06:11:45.152825+0000) 2024-09-19T06:11:54.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:54 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:54.135+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6820 osd.8 since back 2024-09-19T06:11:30.953759+0000 front 2024-09-19T06:11:30.953790+0000 (oldest deadline 2024-09-19T06:11:52.653859+0000) 2024-09-19T06:11:55.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:55 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:55.139+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-09-19T06:10:25.243477+0000 front 2024-09-19T06:10:25.243671+0000 (oldest deadline 2024-09-19T06:10:50.543575+0000) 2024-09-19T06:11:55.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:55 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:55.139+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6804 osd.2 since back 2024-09-19T06:10:40.846622+0000 front 2024-09-19T06:10:40.846471+0000 (oldest deadline 2024-09-19T06:11:05.546652+0000) 2024-09-19T06:11:55.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:55 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:55.139+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-09-19T06:10:50.847827+0000 front 2024-09-19T06:10:50.847888+0000 (oldest deadline 2024-09-19T06:11:14.347890+0000) 2024-09-19T06:11:55.500 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:55 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:55.139+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T06:10:57.849182+0000 front 2024-09-19T06:10:57.849209+0000 (oldest deadline 2024-09-19T06:11:21.348954+0000) 2024-09-19T06:11:55.501 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:55 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:55.139+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6812 osd.5 since back 2024-09-19T06:11:06.550320+0000 front 2024-09-19T06:11:06.550371+0000 (oldest deadline 2024-09-19T06:11:30.650457+0000) 2024-09-19T06:11:55.501 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:55 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:55.139+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-09-19T06:11:16.452033+0000 front 2024-09-19T06:11:16.452015+0000 (oldest deadline 2024-09-19T06:11:40.551790+0000) 2024-09-19T06:11:55.501 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:55 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:55.139+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.99:6820 osd.7 since back 2024-09-19T06:11:21.652873+0000 front 2024-09-19T06:11:21.652952+0000 (oldest deadline 2024-09-19T06:11:45.152825+0000) 2024-09-19T06:11:55.501 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:55 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11[59682]: 2024-09-19T06:11:55.139+0000 7fa3e98be640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.117:6820 osd.8 since back 2024-09-19T06:11:30.953759+0000 front 2024-09-19T06:11:30.953790+0000 (oldest deadline 2024-09-19T06:11:52.653859+0000) 2024-09-19T06:11:56.487 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:56 smithi117 podman[68450]: 2024-09-19 06:11:56.186269715 +0000 UTC m=+5.446421856 container died ddcaba36e239f41776347eda0bcebc27e128db92d2a9a3d9f6b779f7fca79ce6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True) 2024-09-19T06:11:56.749 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:56 smithi117 podman[68450]: 2024-09-19 06:11:56.486806601 +0000 UTC m=+5.746958748 container cleanup ddcaba36e239f41776347eda0bcebc27e128db92d2a9a3d9f6b779f7fca79ce6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-19T06:11:56.750 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:56 smithi117 bash[68450]: ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11 2024-09-19T06:11:56.750 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:56 smithi117 podman[68465]: 2024-09-19 06:11:56.704809163 +0000 UTC m=+0.513133659 container remove ddcaba36e239f41776347eda0bcebc27e128db92d2a9a3d9f6b779f7fca79ce6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-19T06:11:57.308 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:57 smithi117 podman[68556]: 2024-09-19 06:11:57.00542587 +0000 UTC m=+0.101719460 container create 08ab781726fb9cab59da8efc8a619ba0cb948bbb52b1ff5b81fb4bbfffb6385d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:11:57.309 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:57 smithi117 podman[68556]: 2024-09-19 06:11:56.91957915 +0000 UTC m=+0.015872746 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:11:57.309 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:57 smithi117 podman[68556]: 2024-09-19 06:11:57.224480564 +0000 UTC m=+0.320774155 container init 08ab781726fb9cab59da8efc8a619ba0cb948bbb52b1ff5b81fb4bbfffb6385d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=) 2024-09-19T06:11:57.309 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:57 smithi117 podman[68556]: 2024-09-19 06:11:57.227743925 +0000 UTC m=+0.324037522 container start 08ab781726fb9cab59da8efc8a619ba0cb948bbb52b1ff5b81fb4bbfffb6385d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-19T06:11:57.309 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:57 smithi117 podman[68556]: 2024-09-19 06:11:57.307793944 +0000 UTC m=+0.404087540 container attach 08ab781726fb9cab59da8efc8a619ba0cb948bbb52b1ff5b81fb4bbfffb6385d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11-deactivate, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-19T06:11:57.703 INFO:journalctl@ceph.osd.11.smithi117.stdout:Sep 19 06:11:57 smithi117 podman[68556]: 2024-09-19 06:11:57.417572572 +0000 UTC m=+0.513866170 container died 08ab781726fb9cab59da8efc8a619ba0cb948bbb52b1ff5b81fb4bbfffb6385d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-osd-11-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=) 2024-09-19T06:11:57.918 DEBUG:teuthology.orchestra.run.smithi117:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@osd.11.service' 2024-09-19T06:11:57.955 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:11:57.955 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-19T06:11:57.955 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-19T06:11:57.956 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@mds.a 2024-09-19T06:11:58.323 INFO:journalctl@ceph.mds.a.smithi037.stdout:Sep 19 06:11:58 smithi037 systemd[1]: Stopping Ceph mds.a for b8c8bdae-764b-11ef-bceb-c7b262605968... 2024-09-19T06:11:58.605 INFO:journalctl@ceph.mds.a.smithi037.stdout:Sep 19 06:11:58 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-a[69531]: 2024-09-19T06:11:58.358+0000 7fb4c5f55640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:11:58.605 INFO:journalctl@ceph.mds.a.smithi037.stdout:Sep 19 06:11:58 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-a[69531]: 2024-09-19T06:11:58.358+0000 7fb4c5f55640 -1 mds.a *** got signal Terminated *** 2024-09-19T06:12:00.802 INFO:journalctl@ceph.mds.a.smithi037.stdout:Sep 19 06:12:00 smithi037 podman[88491]: 2024-09-19 06:12:00.407642025 +0000 UTC m=+2.255251822 container died 2e1b94af7032ec193b25dd92e93b39a9b2d379b3255ea0a3a841e4876067657a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-a, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-19T06:12:01.073 INFO:journalctl@ceph.mds.a.smithi037.stdout:Sep 19 06:12:00 smithi037 podman[88491]: 2024-09-19 06:12:00.983994427 +0000 UTC m=+2.831604223 container cleanup 2e1b94af7032ec193b25dd92e93b39a9b2d379b3255ea0a3a841e4876067657a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-a, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:12:01.074 INFO:journalctl@ceph.mds.a.smithi037.stdout:Sep 19 06:12:00 smithi037 bash[88491]: ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-a 2024-09-19T06:12:01.418 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@mds.a.service' 2024-09-19T06:12:01.454 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:12:01.455 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-19T06:12:01.455 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-19T06:12:01.455 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@mds.d 2024-09-19T06:12:01.790 INFO:journalctl@ceph.mds.d.smithi037.stdout:Sep 19 06:12:01 smithi037 systemd[1]: Stopping Ceph mds.d for b8c8bdae-764b-11ef-bceb-c7b262605968... 2024-09-19T06:12:02.073 INFO:journalctl@ceph.mds.d.smithi037.stdout:Sep 19 06:12:01 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-d[68341]: 2024-09-19T06:12:01.788+0000 7f9c10cdb640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:12:02.074 INFO:journalctl@ceph.mds.d.smithi037.stdout:Sep 19 06:12:01 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-d[68341]: 2024-09-19T06:12:01.788+0000 7f9c10cdb640 -1 mds.d *** got signal Terminated *** 2024-09-19T06:12:05.148 INFO:journalctl@ceph.mds.d.smithi037.stdout:Sep 19 06:12:04 smithi037 podman[88626]: 2024-09-19 06:12:04.891394425 +0000 UTC m=+3.214544404 container died a98194e40add48c39e3aaa43823778463220799546c550dadbd4ba75b4d11ced (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-d, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-19T06:12:05.490 INFO:journalctl@ceph.mds.d.smithi037.stdout:Sep 19 06:12:05 smithi037 podman[88626]: 2024-09-19 06:12:05.238051029 +0000 UTC m=+3.561201008 container cleanup a98194e40add48c39e3aaa43823778463220799546c550dadbd4ba75b4d11ced (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-d, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:12:05.490 INFO:journalctl@ceph.mds.d.smithi037.stdout:Sep 19 06:12:05 smithi037 bash[88626]: ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-d 2024-09-19T06:12:05.632 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@mds.d.service' 2024-09-19T06:12:05.667 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:12:05.668 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-19T06:12:05.668 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-19T06:12:05.668 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@mds.g 2024-09-19T06:12:06.074 INFO:journalctl@ceph.mds.g.smithi037.stdout:Sep 19 06:12:05 smithi037 systemd[1]: Stopping Ceph mds.g for b8c8bdae-764b-11ef-bceb-c7b262605968... 2024-09-19T06:12:06.074 INFO:journalctl@ceph.mds.g.smithi037.stdout:Sep 19 06:12:05 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-g[69132]: 2024-09-19T06:12:05.974+0000 7ff403567640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:12:06.074 INFO:journalctl@ceph.mds.g.smithi037.stdout:Sep 19 06:12:05 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-g[69132]: 2024-09-19T06:12:05.974+0000 7ff403567640 -1 mds.g *** got signal Terminated *** 2024-09-19T06:12:09.168 INFO:journalctl@ceph.mds.g.smithi037.stdout:Sep 19 06:12:08 smithi037 podman[88747]: 2024-09-19 06:12:08.891037149 +0000 UTC m=+3.003213920 container died 303106ce620b3d0cd3f1325aa6d7d04ad5fd3d0e6a2bead8a89dd76b14c1012c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-g, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-19T06:12:09.573 INFO:journalctl@ceph.mds.g.smithi037.stdout:Sep 19 06:12:09 smithi037 podman[88747]: 2024-09-19 06:12:09.383237037 +0000 UTC m=+3.495413812 container cleanup 303106ce620b3d0cd3f1325aa6d7d04ad5fd3d0e6a2bead8a89dd76b14c1012c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-g, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True) 2024-09-19T06:12:09.574 INFO:journalctl@ceph.mds.g.smithi037.stdout:Sep 19 06:12:09 smithi037 bash[88747]: ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-g 2024-09-19T06:12:09.768 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@mds.g.service' 2024-09-19T06:12:09.803 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:12:09.803 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-19T06:12:09.803 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-19T06:12:09.803 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@mds.j 2024-09-19T06:12:10.324 INFO:journalctl@ceph.mds.j.smithi037.stdout:Sep 19 06:12:09 smithi037 systemd[1]: Stopping Ceph mds.j for b8c8bdae-764b-11ef-bceb-c7b262605968... 2024-09-19T06:12:10.324 INFO:journalctl@ceph.mds.j.smithi037.stdout:Sep 19 06:12:10 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-j[67927]: 2024-09-19T06:12:10.111+0000 7f1658bfc640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:12:10.324 INFO:journalctl@ceph.mds.j.smithi037.stdout:Sep 19 06:12:10 smithi037 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-j[67927]: 2024-09-19T06:12:10.111+0000 7f1658bfc640 -1 mds.j *** got signal Terminated *** 2024-09-19T06:12:13.405 INFO:journalctl@ceph.mds.j.smithi037.stdout:Sep 19 06:12:13 smithi037 podman[88866]: 2024-09-19 06:12:13.129695616 +0000 UTC m=+3.107442965 container died 6a8c6eb360b5322af80a4289c800b97434b2ea6a5894c9961c4353481b08b845 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-j, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, RELEASE=squid-2f599a4) 2024-09-19T06:12:13.747 INFO:journalctl@ceph.mds.j.smithi037.stdout:Sep 19 06:12:13 smithi037 podman[88866]: 2024-09-19 06:12:13.486985594 +0000 UTC m=+3.464732932 container cleanup 6a8c6eb360b5322af80a4289c800b97434b2ea6a5894c9961c4353481b08b845 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-j, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:12:13.747 INFO:journalctl@ceph.mds.j.smithi037.stdout:Sep 19 06:12:13 smithi037 bash[88866]: ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-j 2024-09-19T06:12:13.879 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@mds.j.service' 2024-09-19T06:12:13.912 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:12:13.912 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-19T06:12:13.913 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-19T06:12:13.913 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@mds.b 2024-09-19T06:12:14.255 INFO:journalctl@ceph.mds.b.smithi099.stdout:Sep 19 06:12:13 smithi099 systemd[1]: Stopping Ceph mds.b for b8c8bdae-764b-11ef-bceb-c7b262605968... 2024-09-19T06:12:14.688 INFO:journalctl@ceph.mds.b.smithi099.stdout:Sep 19 06:12:14 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-b[65353]: 2024-09-19T06:12:14.253+0000 7f25fb96c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:12:14.688 INFO:journalctl@ceph.mds.b.smithi099.stdout:Sep 19 06:12:14 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-b[65353]: 2024-09-19T06:12:14.253+0000 7f25fb96c640 -1 mds.b *** got signal Terminated *** 2024-09-19T06:12:18.171 INFO:journalctl@ceph.mds.b.smithi099.stdout:Sep 19 06:12:17 smithi099 podman[68928]: 2024-09-19 06:12:17.919240387 +0000 UTC m=+3.820751705 container died 3620b432be0d9a422602974450e93939ca49baa510affdc2ef191ad721bdf070 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-b, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:12:18.438 INFO:journalctl@ceph.mds.b.smithi099.stdout:Sep 19 06:12:18 smithi099 podman[68928]: 2024-09-19 06:12:18.344622905 +0000 UTC m=+4.246134220 container cleanup 3620b432be0d9a422602974450e93939ca49baa510affdc2ef191ad721bdf070 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-b, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:12:18.439 INFO:journalctl@ceph.mds.b.smithi099.stdout:Sep 19 06:12:18 smithi099 bash[68928]: ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-b 2024-09-19T06:12:18.776 INFO:journalctl@ceph.mds.b.smithi099.stdout:Sep 19 06:12:18 smithi099 podman[68940]: 2024-09-19 06:12:18.521033847 +0000 UTC m=+0.594652629 container remove 3620b432be0d9a422602974450e93939ca49baa510affdc2ef191ad721bdf070 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-b, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-19T06:12:18.781 DEBUG:teuthology.orchestra.run.smithi099:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@mds.b.service' 2024-09-19T06:12:18.815 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:12:18.816 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-19T06:12:18.816 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-19T06:12:18.816 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@mds.e 2024-09-19T06:12:19.141 INFO:journalctl@ceph.mds.e.smithi099.stdout:Sep 19 06:12:18 smithi099 systemd[1]: Stopping Ceph mds.e for b8c8bdae-764b-11ef-bceb-c7b262605968... 2024-09-19T06:12:19.438 INFO:journalctl@ceph.mds.e.smithi099.stdout:Sep 19 06:12:19 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-e[64746]: 2024-09-19T06:12:19.139+0000 7f5b04c2b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:12:19.439 INFO:journalctl@ceph.mds.e.smithi099.stdout:Sep 19 06:12:19 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-e[64746]: 2024-09-19T06:12:19.139+0000 7f5b04c2b640 -1 mds.e *** got signal Terminated *** 2024-09-19T06:12:23.438 INFO:journalctl@ceph.mds.e.smithi099.stdout:Sep 19 06:12:23 smithi099 podman[69051]: 2024-09-19 06:12:23.153543666 +0000 UTC m=+4.115089589 container died 89344c0a6c6077b7cdde3df6b401cd73d013053c6d92762c43e85d45d5639c92 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-e, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-19T06:12:23.833 INFO:journalctl@ceph.mds.e.smithi099.stdout:Sep 19 06:12:23 smithi099 podman[69051]: 2024-09-19 06:12:23.631393573 +0000 UTC m=+4.592939496 container cleanup 89344c0a6c6077b7cdde3df6b401cd73d013053c6d92762c43e85d45d5639c92 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-e, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-19T06:12:23.833 INFO:journalctl@ceph.mds.e.smithi099.stdout:Sep 19 06:12:23 smithi099 bash[69051]: ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-e 2024-09-19T06:12:23.988 DEBUG:teuthology.orchestra.run.smithi099:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@mds.e.service' 2024-09-19T06:12:24.021 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:12:24.021 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-19T06:12:24.021 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-19T06:12:24.021 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@mds.h 2024-09-19T06:12:24.438 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 06:12:24 smithi099 systemd[1]: Stopping Ceph mds.h for b8c8bdae-764b-11ef-bceb-c7b262605968... 2024-09-19T06:12:24.439 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 06:12:24 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-h[65052]: 2024-09-19T06:12:24.326+0000 7f5404793640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:12:24.439 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 06:12:24 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-h[65052]: 2024-09-19T06:12:24.326+0000 7f5404793640 -1 mds.h *** got signal Terminated *** 2024-09-19T06:12:27.586 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 06:12:27 smithi099 podman[69170]: 2024-09-19 06:12:27.268665992 +0000 UTC m=+3.036716704 container died 991db6a336b61eec54b69cc6b982007387547c628bb3b422f21c057082e47ff6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-h, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=) 2024-09-19T06:12:27.587 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 06:12:27 smithi099 podman[69170]: 2024-09-19 06:12:27.584827451 +0000 UTC m=+3.352878161 container cleanup 991db6a336b61eec54b69cc6b982007387547c628bb3b422f21c057082e47ff6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-h, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731) 2024-09-19T06:12:27.938 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 06:12:27 smithi099 bash[69170]: ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-h 2024-09-19T06:12:27.939 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 06:12:27 smithi099 podman[69182]: 2024-09-19 06:12:27.752623899 +0000 UTC m=+0.486046974 container remove 991db6a336b61eec54b69cc6b982007387547c628bb3b422f21c057082e47ff6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-h, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:12:27.968 DEBUG:teuthology.orchestra.run.smithi099:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@mds.h.service' 2024-09-19T06:12:28.000 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:12:28.000 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-19T06:12:28.000 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-19T06:12:28.000 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@mds.k 2024-09-19T06:12:28.314 INFO:journalctl@ceph.mds.k.smithi099.stdout:Sep 19 06:12:28 smithi099 systemd[1]: Stopping Ceph mds.k for b8c8bdae-764b-11ef-bceb-c7b262605968... 2024-09-19T06:12:28.688 INFO:journalctl@ceph.mds.k.smithi099.stdout:Sep 19 06:12:28 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-k[64441]: 2024-09-19T06:12:28.312+0000 7f2635808640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:12:28.689 INFO:journalctl@ceph.mds.k.smithi099.stdout:Sep 19 06:12:28 smithi099 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-k[64441]: 2024-09-19T06:12:28.312+0000 7f2635808640 -1 mds.k *** got signal Terminated *** 2024-09-19T06:12:30.074 INFO:journalctl@ceph.mds.k.smithi099.stdout:Sep 19 06:12:29 smithi099 podman[69292]: 2024-09-19 06:12:29.756272094 +0000 UTC m=+1.541676710 container died 10770bcb93c1eaf897560e43809c8be1078a73ff60d739d2c03b70a146bc0e43 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-k, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-19T06:12:30.438 INFO:journalctl@ceph.mds.k.smithi099.stdout:Sep 19 06:12:30 smithi099 podman[69292]: 2024-09-19 06:12:30.130120041 +0000 UTC m=+1.915524656 container cleanup 10770bcb93c1eaf897560e43809c8be1078a73ff60d739d2c03b70a146bc0e43 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-k, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4) 2024-09-19T06:12:30.439 INFO:journalctl@ceph.mds.k.smithi099.stdout:Sep 19 06:12:30 smithi099 bash[69292]: ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-k 2024-09-19T06:12:30.601 DEBUG:teuthology.orchestra.run.smithi099:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@mds.k.service' 2024-09-19T06:12:30.632 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:12:30.632 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-19T06:12:30.632 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-19T06:12:30.633 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@mds.c 2024-09-19T06:12:30.918 INFO:journalctl@ceph.mds.c.smithi117.stdout:Sep 19 06:12:30 smithi117 systemd[1]: Stopping Ceph mds.c for b8c8bdae-764b-11ef-bceb-c7b262605968... 2024-09-19T06:12:31.249 INFO:journalctl@ceph.mds.c.smithi117.stdout:Sep 19 06:12:30 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-c[64539]: 2024-09-19T06:12:30.915+0000 7f2a90c31640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:12:31.250 INFO:journalctl@ceph.mds.c.smithi117.stdout:Sep 19 06:12:30 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-c[64539]: 2024-09-19T06:12:30.915+0000 7f2a90c31640 -1 mds.c *** got signal Terminated *** 2024-09-19T06:12:32.909 INFO:journalctl@ceph.mds.c.smithi117.stdout:Sep 19 06:12:32 smithi117 podman[68659]: 2024-09-19 06:12:32.590529657 +0000 UTC m=+1.765364630 container died 5eacfd090aec2694e4815baa9d198ac027404787c50a7037f292db05539ed7c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-c, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS) 2024-09-19T06:12:33.193 INFO:journalctl@ceph.mds.c.smithi117.stdout:Sep 19 06:12:33 smithi117 podman[68659]: 2024-09-19 06:12:33.007586778 +0000 UTC m=+2.182421751 container cleanup 5eacfd090aec2694e4815baa9d198ac027404787c50a7037f292db05539ed7c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-c, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-19T06:12:33.193 INFO:journalctl@ceph.mds.c.smithi117.stdout:Sep 19 06:12:33 smithi117 bash[68659]: ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-c 2024-09-19T06:12:33.443 INFO:journalctl@ceph.mds.c.smithi117.stdout:Sep 19 06:12:33 smithi117 podman[68670]: 2024-09-19 06:12:33.192149218 +0000 UTC m=+0.596543771 container remove 5eacfd090aec2694e4815baa9d198ac027404787c50a7037f292db05539ed7c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-c, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-19T06:12:33.444 INFO:journalctl@ceph.mds.c.smithi117.stdout:Sep 19 06:12:33 smithi117 systemd[1]: ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@mds.c.service: Deactivated successfully. 2024-09-19T06:12:33.444 INFO:journalctl@ceph.mds.c.smithi117.stdout:Sep 19 06:12:33 smithi117 systemd[1]: Stopped Ceph mds.c for b8c8bdae-764b-11ef-bceb-c7b262605968. 2024-09-19T06:12:33.445 DEBUG:teuthology.orchestra.run.smithi117:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@mds.c.service' 2024-09-19T06:12:33.480 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:12:33.480 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-19T06:12:33.480 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-19T06:12:33.480 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@mds.f 2024-09-19T06:12:33.749 INFO:journalctl@ceph.mds.f.smithi117.stdout:Sep 19 06:12:33 smithi117 systemd[1]: Stopping Ceph mds.f for b8c8bdae-764b-11ef-bceb-c7b262605968... 2024-09-19T06:12:34.249 INFO:journalctl@ceph.mds.f.smithi117.stdout:Sep 19 06:12:33 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-f[64237]: 2024-09-19T06:12:33.785+0000 7ffb14889640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:12:34.250 INFO:journalctl@ceph.mds.f.smithi117.stdout:Sep 19 06:12:33 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-f[64237]: 2024-09-19T06:12:33.785+0000 7ffb14889640 -1 mds.f *** got signal Terminated *** 2024-09-19T06:12:38.179 INFO:journalctl@ceph.mds.f.smithi117.stdout:Sep 19 06:12:37 smithi117 podman[68780]: 2024-09-19 06:12:37.801049849 +0000 UTC m=+4.105075913 container died 1d97abc4ce75d745510b224b1043a9f8602bdfb60bccad298195e9e2df3606a3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-f, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:12:38.499 INFO:journalctl@ceph.mds.f.smithi117.stdout:Sep 19 06:12:38 smithi117 podman[68780]: 2024-09-19 06:12:38.260910459 +0000 UTC m=+4.564936520 container cleanup 1d97abc4ce75d745510b224b1043a9f8602bdfb60bccad298195e9e2df3606a3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-f, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-19T06:12:38.499 INFO:journalctl@ceph.mds.f.smithi117.stdout:Sep 19 06:12:38 smithi117 bash[68780]: ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-f 2024-09-19T06:12:38.689 DEBUG:teuthology.orchestra.run.smithi117:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@mds.f.service' 2024-09-19T06:12:38.721 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:12:38.722 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-19T06:12:38.722 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-19T06:12:38.722 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@mds.i 2024-09-19T06:12:39.040 INFO:journalctl@ceph.mds.i.smithi117.stdout:Sep 19 06:12:38 smithi117 systemd[1]: Stopping Ceph mds.i for b8c8bdae-764b-11ef-bceb-c7b262605968... 2024-09-19T06:12:39.499 INFO:journalctl@ceph.mds.i.smithi117.stdout:Sep 19 06:12:39 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-i[64840]: 2024-09-19T06:12:39.038+0000 7f26a2338640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:12:39.500 INFO:journalctl@ceph.mds.i.smithi117.stdout:Sep 19 06:12:39 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-i[64840]: 2024-09-19T06:12:39.038+0000 7f26a2338640 -1 mds.i *** got signal Terminated *** 2024-09-19T06:12:42.190 INFO:journalctl@ceph.mds.i.smithi117.stdout:Sep 19 06:12:41 smithi117 podman[68901]: 2024-09-19 06:12:41.927773976 +0000 UTC m=+2.996219679 container died c4a6e6593f4bb61940233e307e1ef9093e6ace9c51c3e716ad2d28da583bd5cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-i, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-19T06:12:42.500 INFO:journalctl@ceph.mds.i.smithi117.stdout:Sep 19 06:12:42 smithi117 podman[68901]: 2024-09-19 06:12:42.289156965 +0000 UTC m=+3.357602668 container cleanup c4a6e6593f4bb61940233e307e1ef9093e6ace9c51c3e716ad2d28da583bd5cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-i, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-19T06:12:42.500 INFO:journalctl@ceph.mds.i.smithi117.stdout:Sep 19 06:12:42 smithi117 bash[68901]: ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-i 2024-09-19T06:12:42.709 DEBUG:teuthology.orchestra.run.smithi117:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@mds.i.service' 2024-09-19T06:12:42.741 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:12:42.741 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-19T06:12:42.741 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-19T06:12:42.741 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@mds.l 2024-09-19T06:12:43.060 INFO:journalctl@ceph.mds.l.smithi117.stdout:Sep 19 06:12:42 smithi117 systemd[1]: Stopping Ceph mds.l for b8c8bdae-764b-11ef-bceb-c7b262605968... 2024-09-19T06:12:43.499 INFO:journalctl@ceph.mds.l.smithi117.stdout:Sep 19 06:12:43 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-l[63937]: 2024-09-19T06:12:43.059+0000 7f0fa382b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:12:43.500 INFO:journalctl@ceph.mds.l.smithi117.stdout:Sep 19 06:12:43 smithi117 ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-l[63937]: 2024-09-19T06:12:43.059+0000 7f0fa382b640 -1 mds.l *** got signal Terminated *** 2024-09-19T06:12:47.410 INFO:journalctl@ceph.mds.l.smithi117.stdout:Sep 19 06:12:47 smithi117 podman[69019]: 2024-09-19 06:12:47.072433598 +0000 UTC m=+4.118286934 container died 3fac02c7c848114e246314bc790f9ee2f03991d833f470c7d0397f7ebdff9bc6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-l, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-19T06:12:47.677 INFO:journalctl@ceph.mds.l.smithi117.stdout:Sep 19 06:12:47 smithi117 podman[69019]: 2024-09-19 06:12:47.467155298 +0000 UTC m=+4.513008633 container cleanup 3fac02c7c848114e246314bc790f9ee2f03991d833f470c7d0397f7ebdff9bc6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-l, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:12:47.677 INFO:journalctl@ceph.mds.l.smithi117.stdout:Sep 19 06:12:47 smithi117 bash[69019]: ceph-b8c8bdae-764b-11ef-bceb-c7b262605968-mds-l 2024-09-19T06:12:47.792 DEBUG:teuthology.orchestra.run.smithi117:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b8c8bdae-764b-11ef-bceb-c7b262605968@mds.l.service' 2024-09-19T06:12:47.823 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:12:47.824 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-19T06:12:47.824 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T06:12:48.034 INFO:teuthology.orchestra.run.smithi037.stdout:Deleting cluster with fsid: b8c8bdae-764b-11ef-bceb-c7b262605968 2024-09-19T06:12:50.613 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T06:12:50.813 INFO:teuthology.orchestra.run.smithi099.stdout:Deleting cluster with fsid: b8c8bdae-764b-11ef-bceb-c7b262605968 2024-09-19T06:12:53.202 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T06:12:53.402 INFO:teuthology.orchestra.run.smithi117.stdout:Deleting cluster with fsid: b8c8bdae-764b-11ef-bceb-c7b262605968 2024-09-19T06:12:55.690 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T06:12:55.725 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T06:12:55.758 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T06:12:55.785 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-19T06:12:55.787 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911704/remote/smithi037/crash 2024-09-19T06:12:55.788 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/crash -- . 2024-09-19T06:12:55.818 INFO:teuthology.orchestra.run.smithi037.stderr:tar: /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T06:12:55.818 INFO:teuthology.orchestra.run.smithi037.stderr:tar: Error is not recoverable: exiting now 2024-09-19T06:12:55.820 DEBUG:teuthology.misc:Transferring archived files from smithi099:/var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911704/remote/smithi099/crash 2024-09-19T06:12:55.820 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar c -f - -C /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/crash -- . 2024-09-19T06:12:55.857 INFO:teuthology.orchestra.run.smithi099.stderr:tar: /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T06:12:55.857 INFO:teuthology.orchestra.run.smithi099.stderr:tar: Error is not recoverable: exiting now 2024-09-19T06:12:55.859 DEBUG:teuthology.misc:Transferring archived files from smithi117:/var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911704/remote/smithi117/crash 2024-09-19T06:12:55.860 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar c -f - -C /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/crash -- . 2024-09-19T06:12:55.894 INFO:teuthology.orchestra.run.smithi117.stderr:tar: /var/lib/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T06:12:55.931 INFO:teuthology.orchestra.run.smithi117.stderr:tar: Error is not recoverable: exiting now 2024-09-19T06:12:55.933 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-19T06:12:55.934 DEBUG:teuthology.orchestra.run.smithi037:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-19T06:12:55.980 INFO:tasks.cephadm:Compressing logs... 2024-09-19T06:12:55.980 DEBUG:teuthology.orchestra.run.smithi037:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T06:12:56.027 DEBUG:teuthology.orchestra.run.smithi099:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T06:12:56.030 DEBUG:teuthology.orchestra.run.smithi117:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T06:12:56.053 INFO:teuthology.orchestra.run.smithi037.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2024-09-19T06:12:56.053 INFO:teuthology.orchestra.run.smithi037.stderr:: No such file or directory 2024-09-19T06:12:56.053 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-osd.0.log 2024-09-19T06:12:56.053 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-osd.9.log 2024-09-19T06:12:56.054 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.log: gzip -5 --verbose -- /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T06:12:56.055 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-osd.0.log: /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T06:12:56.055 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-mds.a.log 2024-09-19T06:12:56.055 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-volume.log: /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T06:12:56.055 INFO:teuthology.orchestra.run.smithi037.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2024-09-19T06:12:56.055 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-mon.a.log 2024-09-19T06:12:56.057 INFO:teuthology.orchestra.run.smithi117.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T06:12:56.057 INFO:teuthology.orchestra.run.smithi117.stderr:: No such file or directory 2024-09-19T06:12:56.057 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T06:12:56.057 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-mds.i.log 2024-09-19T06:12:56.057 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-mon.c.log 2024-09-19T06:12:56.057 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T06:12:56.058 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-mds.g.log 2024-09-19T06:12:56.058 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-mon.a.log: 82.3% -- replaced with /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T06:12:56.058 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-osd.6.log 2024-09-19T06:12:56.058 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph.log 2024-09-19T06:12:56.060 INFO:teuthology.orchestra.run.smithi099.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-osd.10.log 2024-09-19T06:12:56.060 INFO:teuthology.orchestra.run.smithi099.stderr:: No such file or directory 2024-09-19T06:12:56.060 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-osd.1.log 2024-09-19T06:12:56.060 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-osd.7.log 2024-09-19T06:12:56.060 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T06:12:56.060 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-mds.b.log 2024-09-19T06:12:56.065 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-mds.g.log: /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-osd.6.log: 90.1% -- replaced with /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T06:12:56.065 INFO:teuthology.orchestra.run.smithi037.stderr: 94.7% -- replaced with /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-mds.a.log.gz 2024-09-19T06:12:56.065 INFO:teuthology.orchestra.run.smithi037.stderr: 94.7% -- replaced with /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-mds.g.log.gz 2024-09-19T06:12:56.065 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-mds.d.log 2024-09-19T06:12:56.065 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-mgr.x.log 2024-09-19T06:12:56.065 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-mds.j.log 2024-09-19T06:12:56.065 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-mgr.x.log: 86.5% -- replaced with /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T06:12:56.065 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-osd.3.log 2024-09-19T06:12:56.065 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-mds.j.log: 94.6% -- replaced with /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-mds.d.log.gz 2024-09-19T06:12:56.066 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-osd.11.log 2024-09-19T06:12:56.066 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-osd.2.log 2024-09-19T06:12:56.066 INFO:teuthology.orchestra.run.smithi117.stderr: 82.8% -- replaced with /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T06:12:56.066 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-osd.5.log 2024-09-19T06:12:56.066 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph.log 2024-09-19T06:12:56.066 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-mds.l.log 2024-09-19T06:12:56.066 INFO:teuthology.orchestra.run.smithi117.stderr: 90.3% -- replaced with /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T06:12:56.066 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-osd.8.log 2024-09-19T06:12:56.067 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-mds.l.log: 86.6% -- replaced with /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T06:12:56.067 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-mgr.z.log 2024-09-19T06:12:56.067 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-osd.8.log: 94.9% -- replaced with /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-mds.l.log.gz 2024-09-19T06:12:56.067 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-mds.c.log 2024-09-19T06:12:56.070 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T06:12:56.070 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-osd.3.log: 94.6% -- replaced with /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-mds.j.log.gz 2024-09-19T06:12:56.070 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/cephadm.log: 90.9% -- replaced with /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T06:12:56.071 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-mds.k.log 2024-09-19T06:12:56.071 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-osd.4.log 2024-09-19T06:12:56.071 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T06:12:56.071 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T06:12:56.071 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph.audit.log: 94.6% -- replaced with /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-mds.k.log.gz 2024-09-19T06:12:56.072 INFO:teuthology.orchestra.run.smithi099.stderr: 90.2% -- replaced with /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T06:12:56.072 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-mgr.y.log 2024-09-19T06:12:56.072 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph.log 2024-09-19T06:12:56.072 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-mgr.y.log: /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph.cephadm.log: 82.8% -- replaced with /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T06:12:56.072 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-mds.h.log 2024-09-19T06:12:56.072 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph.log: 86.5% -- replaced with /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T06:12:56.072 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-mon.b.log 2024-09-19T06:12:56.072 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-mds.h.log: 92.2% -- replaced with /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-mgr.y.log.gz 2024-09-19T06:12:56.074 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-mgr.z.log: 92.4% -- replaced with /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-mgr.z.log.gz 2024-09-19T06:12:56.074 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-mds.f.log 2024-09-19T06:12:56.074 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-mds.c.log: 90.9% -- replaced with /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T06:12:56.074 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T06:12:56.074 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-mds.f.log: 94.8% -- replaced with /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-mds.c.log.gz 2024-09-19T06:12:56.074 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/cephadm.log: 94.7% -- replaced with /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-mds.f.log.gz 2024-09-19T06:12:56.075 INFO:teuthology.orchestra.run.smithi117.stderr: 91.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T06:12:56.076 INFO:teuthology.orchestra.run.smithi099.stderr: 94.7% -- replaced with /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-mds.h.log.gz 2024-09-19T06:12:56.076 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-mds.e.log 2024-09-19T06:12:56.076 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T06:12:56.076 INFO:teuthology.orchestra.run.smithi099.stderr: 90.9%/var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-mon.b.log: -- replaced with /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T06:12:56.076 INFO:teuthology.orchestra.run.smithi037.stderr: 93.7% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T06:12:56.076 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-mds.e.log: 94.7% -- replaced with /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-mds.e.log.gz 2024-09-19T06:12:56.095 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/cephadm.log: 91.5% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T06:12:56.212 INFO:teuthology.orchestra.run.smithi037.stderr: 90.0% -- replaced with /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-mgr.x.log.gz 2024-09-19T06:12:56.256 INFO:teuthology.orchestra.run.smithi117.stderr: 91.9% -- replaced with /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-mon.c.log.gz 2024-09-19T06:12:56.359 INFO:teuthology.orchestra.run.smithi099.stderr: 91.9% -- replaced with /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-mon.b.log.gz 2024-09-19T06:12:56.610 INFO:teuthology.orchestra.run.smithi037.stderr: 90.5% -- replaced with /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-mon.a.log.gz 2024-09-19T06:13:00.389 INFO:teuthology.orchestra.run.smithi117.stderr: 91.6% -- replaced with /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-osd.11.log.gz 2024-09-19T06:13:00.484 INFO:teuthology.orchestra.run.smithi099.stderr: 91.8% -- replaced with /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-osd.1.log.gz 2024-09-19T06:13:01.020 INFO:teuthology.orchestra.run.smithi037.stderr: 91.7% -- replaced with /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-osd.0.log.gz 2024-09-19T06:13:01.055 INFO:teuthology.orchestra.run.smithi099.stderr: 92.4% -- replaced with /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-osd.10.log.gz 2024-09-19T06:13:01.299 INFO:teuthology.orchestra.run.smithi117.stderr: 95.4% -- replaced with /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-mds.i.log.gz 2024-09-19T06:13:01.535 INFO:teuthology.orchestra.run.smithi117.stderr: 91.7% -- replaced with /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-osd.2.log.gz 2024-09-19T06:13:01.552 INFO:teuthology.orchestra.run.smithi099.stderr: 91.9% -- replaced with /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-osd.7.log.gz 2024-09-19T06:13:01.638 INFO:teuthology.orchestra.run.smithi037.stderr: 91.8% -- replaced with /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-osd.9.log.gz 2024-09-19T06:13:01.849 INFO:teuthology.orchestra.run.smithi037.stderr: 91.6% -- replaced with /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-osd.6.log.gz 2024-09-19T06:13:02.176 INFO:teuthology.orchestra.run.smithi099.stderr: 91.7% -- replaced with /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-osd.4.log.gz 2024-09-19T06:13:02.471 INFO:teuthology.orchestra.run.smithi037.stderr: 91.9% -- replaced with /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-osd.3.log.gz 2024-09-19T06:13:02.472 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-09-19T06:13:02.473 INFO:teuthology.orchestra.run.smithi037.stderr:real 0m6.431s 2024-09-19T06:13:02.473 INFO:teuthology.orchestra.run.smithi037.stderr:user 0m22.786s 2024-09-19T06:13:02.473 INFO:teuthology.orchestra.run.smithi037.stderr:sys 0m0.700s 2024-09-19T06:13:02.573 INFO:teuthology.orchestra.run.smithi117.stderr: 91.5% -- replaced with /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-osd.8.log.gz 2024-09-19T06:13:03.106 INFO:teuthology.orchestra.run.smithi117.stderr: 91.5% -- replaced with /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-osd.5.log.gz 2024-09-19T06:13:03.108 INFO:teuthology.orchestra.run.smithi117.stderr: 2024-09-19T06:13:03.109 INFO:teuthology.orchestra.run.smithi117.stderr:real 0m7.062s 2024-09-19T06:13:03.109 INFO:teuthology.orchestra.run.smithi117.stderr:user 0m27.973s 2024-09-19T06:13:03.109 INFO:teuthology.orchestra.run.smithi117.stderr:sys 0m0.843s 2024-09-19T06:13:47.716 INFO:teuthology.orchestra.run.smithi099.stderr: 93.4% -- replaced with /var/log/ceph/b8c8bdae-764b-11ef-bceb-c7b262605968/ceph-mds.b.log.gz 2024-09-19T06:13:47.718 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-09-19T06:13:47.718 INFO:teuthology.orchestra.run.smithi099.stderr:real 0m51.672s 2024-09-19T06:13:47.718 INFO:teuthology.orchestra.run.smithi099.stderr:user 1m10.690s 2024-09-19T06:13:47.718 INFO:teuthology.orchestra.run.smithi099.stderr:sys 0m2.231s 2024-09-19T06:13:47.718 INFO:tasks.cephadm:Archiving logs... 2024-09-19T06:13:47.719 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911704/remote/smithi037/log 2024-09-19T06:13:47.720 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T06:13:51.633 DEBUG:teuthology.misc:Transferring archived files from smithi099:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911704/remote/smithi099/log 2024-09-19T06:13:51.634 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T06:14:04.107 DEBUG:teuthology.misc:Transferring archived files from smithi117:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911704/remote/smithi117/log 2024-09-19T06:14:04.108 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T06:14:08.317 INFO:tasks.cephadm:Removing cluster... 2024-09-19T06:14:08.317 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 --force 2024-09-19T06:14:08.532 INFO:teuthology.orchestra.run.smithi037.stdout:Deleting cluster with fsid: b8c8bdae-764b-11ef-bceb-c7b262605968 2024-09-19T06:14:08.834 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 --force 2024-09-19T06:14:09.036 INFO:teuthology.orchestra.run.smithi099.stdout:Deleting cluster with fsid: b8c8bdae-764b-11ef-bceb-c7b262605968 2024-09-19T06:14:09.368 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid b8c8bdae-764b-11ef-bceb-c7b262605968 --force 2024-09-19T06:14:09.570 INFO:teuthology.orchestra.run.smithi117.stdout:Deleting cluster with fsid: b8c8bdae-764b-11ef-bceb-c7b262605968 2024-09-19T06:14:09.858 INFO:tasks.cephadm:Removing cephadm ... 2024-09-19T06:14:09.858 DEBUG:teuthology.orchestra.run.smithi037:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T06:14:09.879 DEBUG:teuthology.orchestra.run.smithi099:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T06:14:09.895 DEBUG:teuthology.orchestra.run.smithi117:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T06:14:09.911 INFO:tasks.cephadm:Teardown complete 2024-09-19T06:14:09.911 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-19T06:14:09.924 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-19T06:14:09.925 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T06:14:09.927 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T06:14:09.937 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T06:14:10.040 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-19T06:14:10.050 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-19T06:14:10.051 DEBUG:teuthology.orchestra.run.smithi037:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T06:14:10.054 DEBUG:teuthology.orchestra.run.smithi099:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T06:14:10.057 DEBUG:teuthology.orchestra.run.smithi117:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T06:14:10.069 INFO:teuthology.orchestra.run.smithi099.stderr:bash: line 1: ntpq: command not found 2024-09-19T06:14:10.070 INFO:teuthology.orchestra.run.smithi037.stderr:bash: line 1: ntpq: command not found 2024-09-19T06:14:10.071 INFO:teuthology.orchestra.run.smithi117.stderr:bash: line 1: ntpq: command not found 2024-09-19T06:14:10.074 INFO:teuthology.orchestra.run.smithi099.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T06:14:10.074 INFO:teuthology.orchestra.run.smithi099.stdout:=============================================================================== 2024-09-19T06:14:10.074 INFO:teuthology.orchestra.run.smithi099.stdout:^* hv01.front.sepia.ceph.com 3 6 377 23 -86us[ -93us] +/- 49ms 2024-09-19T06:14:10.075 INFO:teuthology.orchestra.run.smithi099.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 24 +326us[ +319us] +/- 64ms 2024-09-19T06:14:10.075 INFO:teuthology.orchestra.run.smithi099.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 22 -287us[ -287us] +/- 88ms 2024-09-19T06:14:10.075 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:14:10.075 INFO:teuthology.orchestra.run.smithi037.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T06:14:10.075 INFO:teuthology.orchestra.run.smithi037.stdout:=============================================================================== 2024-09-19T06:14:10.075 INFO:teuthology.orchestra.run.smithi037.stdout:^* hv01.front.sepia.ceph.com 3 6 377 23 -79us[ -71us] +/- 49ms 2024-09-19T06:14:10.075 INFO:teuthology.orchestra.run.smithi037.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 22 +334us[ +334us] +/- 64ms 2024-09-19T06:14:10.076 INFO:teuthology.orchestra.run.smithi037.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 24 -276us[ -268us] +/- 88ms 2024-09-19T06:14:10.076 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:14:10.076 INFO:teuthology.orchestra.run.smithi117.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T06:14:10.077 INFO:teuthology.orchestra.run.smithi117.stdout:=============================================================================== 2024-09-19T06:14:10.077 INFO:teuthology.orchestra.run.smithi117.stdout:^* hv01.front.sepia.ceph.com 3 6 377 23 -98us[ -96us] +/- 49ms 2024-09-19T06:14:10.077 INFO:teuthology.orchestra.run.smithi117.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 23 +328us[ +331us] +/- 64ms 2024-09-19T06:14:10.077 INFO:teuthology.orchestra.run.smithi117.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 26 -267us[ -265us] +/- 88ms 2024-09-19T06:14:10.077 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:14:10.078 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-19T06:14:10.088 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-19T06:14:10.089 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-19T06:14:10.102 DEBUG:teuthology.orchestra.run.smithi037:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T06:14:10.204 DEBUG:teuthology.orchestra.run.smithi099:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T06:14:10.271 DEBUG:teuthology.orchestra.run.smithi117:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T06:14:10.338 DEBUG:teuthology.orchestra.run.smithi037:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T06:14:10.371 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T06:14:10.371 DEBUG:teuthology.orchestra.run.smithi099:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T06:14:10.399 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T06:14:10.399 DEBUG:teuthology.orchestra.run.smithi117:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T06:14:10.427 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T06:14:10.428 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-19T06:14:10.438 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-19T06:14:10.454 INFO:teuthology.task.internal:Duration was 1504.896597 seconds 2024-09-19T06:14:10.454 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-19T06:14:10.468 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-19T06:14:10.468 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T06:14:10.471 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T06:14:10.474 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T06:14:10.510 INFO:teuthology.orchestra.run.smithi099.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T06:14:10.512 INFO:teuthology.orchestra.run.smithi117.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T06:14:10.514 INFO:teuthology.orchestra.run.smithi037.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T06:14:10.975 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-19T06:14:10.975 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi037.front.sepia.ceph.com 2024-09-19T06:14:10.976 DEBUG:teuthology.orchestra.run.smithi037:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T06:14:10.999 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi099.front.sepia.ceph.com 2024-09-19T06:14:10.999 DEBUG:teuthology.orchestra.run.smithi099:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T06:14:11.040 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi117.front.sepia.ceph.com 2024-09-19T06:14:11.040 DEBUG:teuthology.orchestra.run.smithi117:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T06:14:11.064 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-19T06:14:11.064 DEBUG:teuthology.orchestra.run.smithi037:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T06:14:11.067 DEBUG:teuthology.orchestra.run.smithi099:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T06:14:11.082 DEBUG:teuthology.orchestra.run.smithi117:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T06:14:11.133 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-19T06:14:11.133 DEBUG:teuthology.orchestra.run.smithi037:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T06:14:11.137 DEBUG:teuthology.orchestra.run.smithi099:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T06:14:11.150 DEBUG:teuthology.orchestra.run.smithi117:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T06:14:11.708 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-19T06:14:11.835 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-19T06:14:11.836 DEBUG:teuthology.orchestra.run.smithi037:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T06:14:11.863 DEBUG:teuthology.orchestra.run.smithi099:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T06:14:11.890 DEBUG:teuthology.orchestra.run.smithi117:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T06:14:11.917 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-19T06:14:11.942 DEBUG:teuthology.orchestra.run.smithi037:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T06:14:11.945 DEBUG:teuthology.orchestra.run.smithi099:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T06:14:11.947 DEBUG:teuthology.orchestra.run.smithi117:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T06:14:11.967 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern = core 2024-09-19T06:14:11.970 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern = core 2024-09-19T06:14:11.989 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern = core 2024-09-19T06:14:12.010 DEBUG:teuthology.orchestra.run.smithi037:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T06:14:12.040 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T06:14:12.040 DEBUG:teuthology.orchestra.run.smithi099:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T06:14:12.057 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T06:14:12.057 DEBUG:teuthology.orchestra.run.smithi117:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T06:14:12.073 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T06:14:12.074 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-19T06:14:12.115 INFO:teuthology.task.internal:Transferring archived files... 2024-09-19T06:14:12.136 DEBUG:teuthology.misc:Transferring archived files from smithi037:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911704/remote/smithi037 2024-09-19T06:14:12.136 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T06:14:12.203 DEBUG:teuthology.misc:Transferring archived files from smithi099:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911704/remote/smithi099 2024-09-19T06:14:12.203 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T06:14:12.245 DEBUG:teuthology.misc:Transferring archived files from smithi117:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911704/remote/smithi117 2024-09-19T06:14:12.246 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T06:14:12.289 INFO:teuthology.task.internal:Removing archive directory... 2024-09-19T06:14:12.289 DEBUG:teuthology.orchestra.run.smithi037:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T06:14:12.292 DEBUG:teuthology.orchestra.run.smithi099:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T06:14:12.294 DEBUG:teuthology.orchestra.run.smithi117:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T06:14:12.338 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-19T06:14:12.352 INFO:teuthology.task.internal:Not uploading archives. 2024-09-19T06:14:12.352 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-19T06:14:12.363 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-19T06:14:12.364 DEBUG:teuthology.orchestra.run.smithi037:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T06:14:12.367 DEBUG:teuthology.orchestra.run.smithi099:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T06:14:12.369 DEBUG:teuthology.orchestra.run.smithi117:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T06:14:12.380 INFO:teuthology.orchestra.run.smithi037.stdout: 265336 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 06:14 /home/ubuntu/cephtest 2024-09-19T06:14:12.383 INFO:teuthology.orchestra.run.smithi099.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 06:14 /home/ubuntu/cephtest 2024-09-19T06:14:12.393 INFO:teuthology.orchestra.run.smithi117.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 06:14 /home/ubuntu/cephtest 2024-09-19T06:14:12.394 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-19T06:14:12.405 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-19T06:14:12.435 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-quiesce/with-quiesce 6-workunit/suites/fsstress}} duration: 1504.8965966701508 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-19T06:14:12.436 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T06:14:12.524 INFO:teuthology.run:pass